Voice switching method, electronic device and system

Through VoIP server, a connection between smart speakers and mobile phones is established, seamless voice calls and audio playback switching is achieved, solving the problems of cumbersome and interruption between devices in the existing technology, and improving efficiency and user experience.

CN115665100BActive Publication Date: 2024-11-29HUAWEI TECH CO LTD
View PDF 8 Cites 0 Cited by

Patent Information

Application Number
CN202211073008.1
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2018-12-29
Publication Date
2024-11-29
Estimated Expiration
2038-12-29

AI Technical Summary

Technical Problem

When switching voice between smart speakers and smartphones, the existing technology process is cumbersome and easily leads to voice interruption, reducing the audio playback efficiency and user experience between devices.

Method used

Establish a connection with smart speakers and mobile phones through VoIP servers, detect user input or specific conditions, and automatically or manually trigger voice switching requests to ensure seamless switching between voice calls or audio playback and avoid interruptions.

Benefits of technology

It improves the efficiency and user experience of voice switching between multiple devices, realizes seamless connection between voice calls and audio playback, and reduces user operation steps.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115665100B_ABST
    Figure CN115665100B_ABST
Patent Text Reader

Abstract

A voice switching method, electronic device and system, wherein the voice switching method may include a mobile phone or a voice assistant device sending a voice switching request message to a VoIP server according to a user's operation, and the VoIP server switches the ongoing voice call on the mobile phone to a voice assistant device such as a smart speaker near the mobile phone according to the request message. Based on this method, the user of the mobile phone can disconnect from the mobile phone and continue the voice call through the voice assistant device without interrupting the voice call. The method improves the efficiency of voice switching, facilitates users, and improves the user experience.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] This application claims priority to a Chinese patent application filed with the State Intellectual Property Office of China on October 9, 2018, with application number 201811172286.6 and invention name “A method for seamlessly switching voice calls and audio playback between a smart speaker and a smart phone”, the entire contents of which are incorporated by reference into this application. Technical Field

[0002] The present application relates to the field of mobile communications, and in particular to a voice switching method, electronic equipment and system. Background Art

[0003] With the development of smart home technology, a user or family often has multiple electronic devices that can communicate with each other. For example, a user can use the same account to log in to a mobile phone and electronic devices such as smart speakers and smart TVs at home, so that multiple electronic devices under the same account form a local area network (LAN), and each electronic device in the LAN can communicate with each other through a server.

[0004] In this way, users can choose to use different electronic devices in the local area network to achieve a certain function according to actual needs. For example, when the user is at home, he can use a speaker to obtain audio resources from the server and play them, and when the user is away from home, he can use a mobile phone to obtain audio resources from the server and play them.

[0005] However, when the user needs to continue playing the audio played on the speaker on the mobile phone, the user usually needs to stop playing the audio being played on the speaker and reopen the audio on the mobile phone to continue playing. Obviously, this process of voice switching between multiple electronic devices is relatively cumbersome, and the voice being played will be interrupted during the switching process, which greatly reduces the efficiency of switching audio playback between electronic devices. Summary of the invention

[0006] The purpose of the present invention is to provide a voice switching method, electronic device and system, which can improve the efficiency of switching voices (such as VoIP calls or audio playback) between electronic devices and improve user experience.

[0007] The above-mentioned and other objects are achieved by the features of the independent claims. Further implementations are reflected in the dependent claims, the description and the drawings.

[0008] In a first aspect, a method for voice switching is provided, which may include: a second electronic device (e.g., a smart speaker) detects a user's voice input; in response to the voice input, the second electronic device establishes a VoIP call with a third electronic device through a VoIP server; a first electronic device (e.g., a mobile phone) sends a first switching request message to the VoIP server, and the first switching request message is used to request the VoIP server to switch the VoIP call being conducted on the second electronic device to the first electronic device; wherein the first switching request message includes a first account (e.g., HUAWEI-01), and the first account is used to log in to a device management server; the VoIP server receives the first switching request message; in response to the first switching request message, the VoIP server determines that the source device of the VoIP service corresponding to the first account is the second electronic device; the VoIP server switches the VoIP call being conducted on the second electronic device to the first electronic device.

[0009] In the above technical solution, the source device of the VoIP service is the smart speaker, and the target device of the VoIP service is the mobile phone. The mobile phone can send a first switching request message to the VoIP server, so that the VoIP server can seamlessly switch the VoIP service being executed on the smart speaker under the same account to the mobile phone. The VoIP service will not be interrupted during the switching process, and the user does not need to repeatedly operate between multiple devices, thereby improving the voice switching efficiency between multiple devices and the user experience.

[0010] In a possible implementation, the method may further include: the first electronic device and the second electronic device both log in to the device management server using the first account, which indicates that the two electronic devices belong to the same user and use the services of the same cloud service provider.

[0011] In a possible implementation, the first electronic device sends a first switching request message to the VoIP server, which may specifically include: when the first electronic device detects a specific operation of the user, then in response to the specific operation, the first electronic device sends the first switching request message to the VoIP server. The specific operation is one of the following operations: flipping the phone, tapping the screen with knuckles, double-clicking the power button, preset voice input, or preset sliding gesture. Under this solution, the first electronic device can only be triggered to send the first switching request message when the user performs a specific operation, so that the voice switching process can be triggered based on the actual needs of the user, making the first electronic device more intelligent and improving the user experience.

[0012] In another possible implementation, the first electronic device sends the first switching request information to the VoIP server, which may specifically include: when the first electronic device detects a specific condition, then in response to the specific condition, the first electronic device may send the first switching request information to the VoIP server. The specific condition may be: Wi-Fi signal strength or Bluetooth signal strength in the WLAN network; for example: when the first electronic device detects that the Wi-Fi signal strength is lower than a preset threshold, the first electronic device sends the first switching request information to the VoIP server; or, when the first electronic device detects that the Bluetooth signal strength of the second electronic device is lower than a preset threshold, the first electronic device sends the first switching request information to the VoIP server. Under this solution, the first electronic device can automatically trigger the process of sending the first switching request information according to the detected specific condition, thereby reducing user participation, implementing a more intelligent method of voice switching, and further improving the efficiency of voice switching.

[0013] In a possible implementation, the method may further include: the first electronic device sends a response message to the VoIP server indicating successful joining of the VoIP call; after receiving the response message, the VoIP server interrupts the VoIP service on the second electronic device. After the first electronic device, such as a mobile phone, joins the VoIP call, there is a three-party VoIP call between the first electronic device, the second electronic device, and the third electronic device. If the call is to be switched to the first electronic device to continue execution, interrupting the VoIP service of the second electronic device is a method that saves network resources.

[0014] In a possible implementation, the VoIP server determines that the source device of the VoIP service corresponding to the first account is the second electronic device, which may specifically include: the VoIP server sends the above-mentioned first account to the device management server; the device management server determines at least one electronic device logged in using the first account based on the above-mentioned first account; the device management server sends the device identification of the above-mentioned at least one electronic device to the VoIP server; the VoIP server determines that the source device that is conducting a VoIP call under the first account is the second electronic device based on the above-mentioned device identification.

[0015] In one possible implementation, the above-mentioned determination that the source device that is conducting a VoIP call under the first account is the second electronic device may specifically include: when the VoIP server determines, based on the above-mentioned device identification, that there are at least two electronic devices that are the source devices conducting a VoIP call under the first account, the VoIP server sends the device identifications of the at least two electronic devices to the first electronic device; at least two options are displayed on the first electronic device; the at least two options are used to represent the at least two electronic devices; the first electronic device detects a user's selection operation on one of the options; wherein the above-mentioned option represents the second electronic device; in response to the above-mentioned selection operation, the first electronic device sends the device identification of the second electronic device to the VoIP server; the VoIP server determines, based on the received device identification of the second electronic device, that the source device conducting a VoIP call under the first account is the second electronic device.

[0016] In a second aspect, a voice switching system is provided, which includes a first electronic device, a second electronic device, a device management server and a VoIP server; wherein: the second electronic device is used to establish a VoIP call with a third electronic device through the VoIP server when detecting a user's voice input; the first electronic device is used to send a first switching request message to the VoIP server, and the first switching request message is used to request the VoIP server to switch the VoIP call being conducted on the second electronic device to the first electronic device; wherein the first switching request message includes a first account, and the first account is used to log in to the device management server; the VoIP server is used to receive the first switching request message and determine that the source device of the VoIP service corresponding to the first account is the second electronic device; the VoIP server is also used to switch the VoIP call being conducted on the second electronic device to the first electronic device.

[0017] In a possible implementation, both the first electronic device and the second electronic device log in to the device management server using the first account.

[0018] In one possible implementation, the first electronic device is also used to: send the first switching request information to the VoIP server when a specific operation of the user is detected; the specific operation is one of the following operations: flipping the phone, tapping the screen with knuckles, double-clicking the power button, preset voice input, or preset sliding gesture.

[0019] In a possible implementation manner, the first electronic device sends the first switching request information to the VoIP server, specifically including: when the first electronic device detects a specific condition, the first electronic device sends the first switching request information to the VoIP server.

[0020] In one possible implementation, the specific condition is: Wi-Fi signal strength or Bluetooth signal strength in the WLAN network; wherein: when the first electronic device detects that the Wi-Fi signal strength is lower than a preset threshold, the first electronic device sends the first switching request information to the VoIP server; or, when the first electronic device detects that the Bluetooth signal strength of the second electronic device is lower than a preset threshold, the first electronic device sends the first switching request information to the VoIP server.

[0021] In a possible implementation, the first electronic device is further configured to send a response message to the VoIP server indicating successful joining of the VoIP call; and the VoIP server is further configured to interrupt the VoIP service on the second electronic device after receiving the response message.

[0022] In a possible implementation, the VoIP server determines that the source device of the VoIP service corresponding to the first account is the second electronic device, specifically including: the VoIP server sends the first account to the device management server; the device management server determines at least one electronic device logged in using the first account based on the first account; the device management server sends the device identification of the at least one electronic device to the VoIP server; the VoIP server determines that the source device that is conducting a VoIP call under the first account is the second electronic device based on the device identification.

[0023] In one possible implementation, the VoIP server is also used to send the device identifications of the at least two electronic devices to the first electronic device when it is determined based on the device identification that there are at least two electronic devices as source devices conducting a VoIP call under the first account; the first electronic device is also used to display at least two options; the at least two options are used to represent the at least two electronic devices; the first electronic device detects a user's selection operation on one of the options; wherein the option represents the second electronic device; the first electronic device is also used to send the device identification of the second electronic device to the VoIP server; the VoIP server is also used to determine, based on the received device identification of the second electronic device, that the source device conducting a VoIP call under the first account is the second electronic device.

[0024] In one possible implementation, the first electronic device is a mobile phone, and the second electronic device is a smart speaker equipped with a voice assistant system.

[0025] In a third aspect, a voice switching electronic device is also provided, which has the function of implementing the behavior of the first electronic device in the above method. The function can be implemented by hardware, or by hardware executing corresponding software. The hardware or software may include one or more modules corresponding to the above functions.

[0026] In a fourth aspect, there is also provided an electronic device for voice switching, which has the function of implementing the behavior of the second electronic device in the above method. The function can be implemented by hardware, or by hardware executing corresponding software. The hardware or software may include one or more modules corresponding to the above functions.

[0027] It should be understood that the description of technical features, technical solutions, advantages or similar language in the specification does not imply that all features and advantages can be realized in any single embodiment. On the contrary, it is understood that the description of features or advantages means that specific technical features, technical solutions or advantages are included in at least one embodiment. Therefore, the description of technical features, technical solutions or advantages in this specification does not necessarily refer to the same embodiment. Furthermore, the technical features, technical solutions and advantages described in the following embodiments can also be combined in any appropriate manner. Those skilled in the art will understand that the embodiment can be realized without one or more specific technical features, technical solutions or advantages of a specific embodiment. In other embodiments, additional technical features and advantages can also be identified in specific embodiments that do not embody all embodiments. BRIEF DESCRIPTION OF THE DRAWINGS

[0028] Figure 1 A schematic diagram of an implementation scenario of a voice switching system in an embodiment;

[0029] Figure 2 is a schematic structural diagram of a first electronic device (such as a mobile phone) in an embodiment;

[0030] Figure 3 is a schematic diagram of the structure of a second electronic device (such as a smart speaker) in one embodiment;

[0031] Figure 4 A flow chart of a voice switching method provided in an embodiment;

[0032] Figure 5 is a schematic diagram of a user interface of an electronic device 101 in an embodiment;

[0033] Figure 6 A schematic diagram of a flow chart of a voice switching method provided in another embodiment;

[0034] Figure 7 is a schematic diagram of a user interface of an electronic device 102 in another embodiment;

[0035] Figure 8 A schematic diagram of a flow chart of a voice switching method provided in another embodiment;

[0036] Fig. 9 FIG. 4 is a schematic diagram of the structure of a voice switching system in an embodiment. DETAILED DESCRIPTION

[0037] The terms used in the following embodiments of the present application are only for the purpose of describing specific embodiments, and are not intended to be used as limitations to the present application. As used in the specification and the appended claims of the present application, the singular expressions "one", "a kind of", "said", "above", "the" and "this" are intended to also include plural expressions such as "one or more", unless there is a clear indication to the contrary in the context. It should also be understood that the term "and / or" used in the present application refers to and includes any or all possible combinations of one or more listed items.

[0038] References to "one embodiment" or "some embodiments" etc. described in this specification mean that a particular feature, structure or characteristic described in conjunction with the embodiment is included in at least one embodiment of the present application. Thus, the phrases "in one embodiment", "in some embodiments", "in some other embodiments", "in some other embodiments", etc. that appear in different places in this specification do not necessarily refer to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized in other ways. The terms "including", "comprising", "having" and their variations all mean "including but not limited to", unless otherwise specifically emphasized in other ways.

[0039] As used in the following embodiments, the term "when..." may be interpreted to mean "if..." or "after..." or "in response to determining..." or "in response to detecting...", depending on the context. Similarly, the phrases "upon determining..." or "if (the stated condition or event) is detected" may be interpreted to mean "if determining..." or "in response to determining..." or "upon detecting (the stated condition or event)" or "in response to detecting (the stated condition or event)", depending on the context.

[0040] It should be understood that although the terms "first electronic device", "second electronic device", etc. may be used in this document to describe various electronic devices, these electronic devices should not be limited by these terms. These terms are only used to distinguish one electronic device from another electronic device. For example, the first electronic device may be named as the second electronic device, and similarly, the second electronic device may also be named as the first electronic device without departing from the scope of this application. Both the first electronic device and the second electronic device are electronic devices, but they may not be the same electronic device, and may also be the same electronic device in some scenarios.

[0041] The following describes an electronic device (e.g., a first electronic device, a second electronic device, etc.), a user interface for such an electronic device, and an embodiment for using such an electronic device. In some embodiments, the electronic device may be a portable electronic device that also includes other functions such as a personal digital assistant and / or a music player function, such as a mobile phone, a tablet computer, a wearable electronic device with wireless communication function (e.g., a smart watch), etc. Exemplary embodiments of portable electronic devices include but are not limited to devices equipped with Or a portable electronic device with other operating systems. The portable electronic device may also be other portable electronic devices, such as a laptop computer with a touch panel or a touch-sensitive surface. It should also be understood that in some other embodiments, the electronic device may not be a portable electronic device, but a desktop computer.

[0042] Various embodiments of the present application will be described in detail below with reference to the accompanying drawings.

[0043] like Figure 1 As shown, an embodiment of the present application provides a voice switching system 100, which may include one or more electronic devices, such as a first electronic device (such as Figure 1 The electronic device 101 and the second electronic device (such as Figure 1 The specific structure of the first electronic device will be described in detail in the following embodiments. Figure 2 The specific structure of the second electronic device will be described in detail in the subsequent embodiments. Figure 3 Describe in detail.

[0044] like Figure 1As shown, the electronic device 101 can be connected to the electronic device 102 via one or more networks 109 (e.g., wired or wireless). Exemplarily, the one or more communication networks 109 can be a local area network or a wide area network (WAN) such as the Internet. The one or more communication networks 109 can be implemented using any known network communication protocol, and the network communication protocol can be various wired or wireless communication protocols, such as Ethernet, universal serial bus (USB), FireWire, global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), Bluetooth, wireless fidelity (Wi-Fi), voice over Internet Protocol (VoIP), or any other suitable communication protocol.

[0045] The above-mentioned voice switching system 100 may also include a device management server 103, which is used to manage at least one registered electronic device (such as electronic device 101 and electronic device 102). Exemplarily, when the electronic device 101 sends an access request to the device management server 103 through the network 109, the device management server 103 can authenticate the electronic device (for example, verify whether the account and password match); after the authentication is passed, the device management server 103 can allow the electronic device 101 to access the corresponding data on the device management server 103, such as storage space. For another example, the device management server 103 configures storage space for the electronic device (101, 102), so that the electronic device (101, 102) can send the data (such as pictures, videos, etc.) stored in the memory of the electronic device (101, 102) to the device management server 103 through the network 109, and then the device management server saves the received data in the storage space configured for the electronic device (101, 102). Exemplarily, the device management server 103 may also configure parameters of the electronic devices ( 101 , 102 ) through the network 109 .

[0046] Among them, the account may refer to the credentials used by the electronic device to log in to the device management server 103. The electronic device (101, 102) needs to use an account to log in to the device management server 103 to use some functions of the electronic device. For example, the electronic device needs to log in to the account to use fingerprint recognition, contact synchronization, mobile phone retrieval and other functions. Without a login account, the above functions cannot be used. When the user enters the account and password on the electronic device to log in, the verification information can be sent to the device management server 103 through the network 109 for verification. It can be understood that since the above-mentioned device management server is mainly used to authenticate the account of the electronic device, the cloud server can know which electronic devices have logged in to the same account.

[0047] In some embodiments, the electronic device 101 and the electronic device 102 may be two different electronic devices belonging to the same user 108. For example, Thomas has a smart phone and a voice assistant device (such as a smart speaker); wherein the smart voice device is configured with a voice assistant system (the voice assistant system is described in detail in the following embodiments), and the voice assistant device can receive the user's voice input and analyze the language input and other functions. Both electronic devices can access the device management server 103 using the account owned by Thomas (such as HUAWEI-01). The device management server 103 can manage the access rights between each account and the electronic device accessed using the account; in addition, the same account can also be logged in simultaneously on two or more electronic devices managed by the device management server 103. In this way, the first electronic device (such as the electronic device 101) and the second electronic device (such as the electronic device 102) logged in to the same account can realize data interaction through the device management server 103. It is understandable that the user 108 can use the above account to log in to the device management server 103 through other electronic devices, and adjust the access rights of the electronic devices stored thereon, such as deleting the permission for the electronic device 101 to log in using the account HUAWEI-01, or adding the permission for another electronic device to log in using the above account, etc.

[0048] Exemplarily, Table 1 is some information related to logged-in electronic devices stored in the device management server 103. It can be seen that two electronic devices (device names are mobile phone 101 and smart speaker 102) use the same account (HUAWEI-01) to log in to the device management server 103. When these two electronic devices log in to the device management server 103, they can carry their own device identification (such as IMEI in Table 1), or the device management server 103 requests the corresponding device identification of these electronic devices after the electronic devices log in, so as to manage these electronic devices later. The above-mentioned device identification is used to uniquely identify electronic devices so that other electronic devices or servers in the network can identify them. Common device identifications include international mobile equipment identity (IMEI), international mobile subscriber identification number (IMSI), mobile equipment identification code (MEID), serial number (SN), integrated circuit card identification code (ICCID), and media access control layer (MAC) address or other identifiers that can uniquely identify electronic devices. In this way, the device management server 103 can identify different electronic devices through different device identifiers, even though these electronic devices are logged in with the same account.

[0049]

[0050] Table 1

[0051] In some embodiments, the electronic device 101 (e.g., mobile phone 101) can perform voice communication, such as a VoIP call, with the electronic device 107 (e.g., mobile phone 107) through the network 109. The electronic device 107 can log in to the device management server 103 using a second account (e.g., HUAWI-02 in Table 1).

[0052] In some embodiments, the voice switching system 100 may further include a voice assistant server 105. The voice assistant server 105 may communicate with external services (e.g., streaming services, navigation services, calendar services, phone services, photo services, etc.) through the network 109 to complete tasks or collect information. The voice assistant server 105 may be part of a voice assistant system (not shown in the figure), which may be implemented according to a client-server model. Exemplarily, the voice assistant system may be included in an electronic device (e.g., Figure 1 The client-side part (e.g., voice assistant client) is executed on the electronic device 102 in the example, and the server-side part (e.g., voice assistant system) is executed on the voice assistant server 105. The voice assistant client can communicate with the voice assistant system through the above-mentioned network 109. The voice assistant client provides client-side functions such as user-oriented input and output processing and communication with the voice assistant system on the server side. The voice assistant system can provide server-side functions for one or more voice assistant clients, each of which is located on a corresponding electronic device (e.g., electronic device 101 and electronic device 102).

[0053] For example, Figure 1 The first electronic device shown (such as electronic device 101) may be a mobile phone 101, and the second electronic device (such as electronic device 102) may be a voice assistant device such as a smart speaker 102.

[0054] In some embodiments, both the mobile phone 101 and the smart speaker 102 may have a voice communication function. For example, the mobile phone 101 and the smart speaker 102 may provide a VoIP service. Figure 1 As shown, the voice switching system 100 may also include a VoIP server 104. The VoIP server 104 may be used to implement voice communication related services such as calling, answering, three-way calling, and call transfer of VoIP services. In this way, the mobile phone 101 (or the smart speaker 102) may perform voice communication with other electronic devices having voice communication functions through the VoIP server 104.

[0055] In some embodiments, the voice assistant server 105 may provide the voice recognition result to the VoIP server 104. For example, after the user 108 inputs the voice signal of "call John" to the smart speaker 102, the smart speaker 102 may send the collected voice signal to the voice assistant server 105 for voice recognition. The voice assistant server 105 recognizes that the control instruction corresponding to the above voice signal is: call the contact John. Furthermore, the voice assistant server 105 may send an instruction to call the contact John to the VoIP server 104. In response to the instruction, the VoIP server 104 may initiate a voice call request to John's electronic device (such as a mobile phone). When John accepts the voice call request, a voice call between the smart speaker 102 and John's mobile phone can be established to realize the VoIP service.

[0056] In other embodiments, Figure 1 As shown, the above-mentioned voice switching system 100 may also include a content server 106. The content server 106 can be used to provide streaming media content such as music and video to the smart speaker 102 (or mobile phone 101) according to the request of the user 108. For example, after the user 108 sends a voice signal of "play the song Silence" to the smart speaker 102, the smart speaker 102 can send the collected voice signal to the voice assistant server 105 through the network 109 for voice recognition. The voice assistant server 105 recognizes that the control instruction corresponding to the above-mentioned voice signal is: obtain the media resources of the song Silence. Furthermore, the voice assistant server 105 can send a request message to the content server 106 to obtain the media resources of the song Silence. In response to the request information sent by the voice assistant server 105, the content server 106 can return the playback address to the voice assistant server 105 after finding the media resource of the song Silence, and the voice assistant server 105 will send the media resource to the smart speaker 102, so that the smart speaker 102 can obtain the address of the song Silence according to the media resource and play or save it.

[0057] Of course, the mobile phone 101 (or smart speaker 102) can also interact directly with the content server 106 through the network 109. For example, the mobile phone 101 (or smart speaker 102) can send a request message for playing the song Silence to the content server 106 according to the input of the user 108; after receiving the request message, the content server 106 finds the media resource of the song Silence, and then returns the media resource to the mobile phone 101 (or smart speaker 102); the mobile phone 101 (or smart speaker 102) obtains the address of the song Silence according to the received media resource and plays it, or saves the song in the memory of the mobile phone 101 or the memory of the smart speaker 102.

[0058] In some other embodiments, after the mobile phone 101 and the smart speaker 102 log in to the same account, when the mobile phone 101 executes a voice call service (such as the above-mentioned VoIP service), if the user 108 wishes to switch the voice call service at this time to the smart speaker 102, the user 108 can perform a preset specific operation on the mobile phone 101 or the smart speaker 102, such as a specific gesture or voice input, so as to trigger the VoIP server 104 to switch the voice call service on the mobile phone 101 to the smart speaker 102, so that the voice call service continues to be performed on the smart speaker 102. Correspondingly, when the smart speaker 102 is executing a voice call, the user 108 can also perform a preset specific operation on the mobile phone 101 or the smart speaker 102 to trigger the VoIP server 104 to switch the voice call service on the smart speaker 102 to the mobile phone 101, so that the voice call service continues to be performed on the mobile phone 101. That is to say, in the above embodiment, the user 108 only needs to perform the above specific operations on the electronic device, and the VoIP server 104 can automatically switch the ongoing voice call service from the first electronic device to the second electronic device. In this way, the voice call service will not be interrupted during the entire switching process, and the user does not need to repeatedly operate between multiple electronic devices, thereby improving the voice switching efficiency between multiple electronic devices and the user experience.

[0059] In other embodiments, when the mobile phone 101 and the smart speaker 102 log in to the same account (e.g., HUAWEI-01), when the mobile phone 101 is playing audio / video, if the user 108 wants to switch the played audio / video (e.g., seamlessly switch) to the smart speaker 102 for continued playback, the user 108 can make a preset input operation on the mobile phone 101 or the smart speaker 102, thereby triggering the content server 106 to switch the audio / video service being played on the mobile phone 101 to the smart speaker 102 for continued playback. Similarly, when the smart speaker 102 performs an audio / video service, the user 108 can also make a preset input operation on the mobile phone 101 or the smart speaker 102 to trigger the content server 106 to switch the audio / video being played on the smart speaker 102 to the mobile phone 101 for continued playback.

[0060] It should be noted that, in addition to the mobile phone 101, the first electronic device may also be a tablet computer, a wearable electronic device with wireless communication function (such as a smart watch), a virtual reality device, and other electronic devices that support audio / video services or voice call services. In the following embodiments, no special restrictions are placed on the specific form of the first electronic device. In addition to the smart speaker 102, the second electronic device may also be a smart TV, a tablet computer, a laptop computer, a desktop computer, and other electronic devices that support audio / video services. In the following embodiments, no special restrictions are placed on the specific form of the second electronic device. In some embodiments, the first electronic device may be a mobile phone, and the second electronic device may be a smart speaker or a laptop computer equipped with a voice assistant system.

[0061] For example, Figure 2 The first electronic device is shown Figure 1 A schematic structural diagram of an electronic device 101 (eg, a mobile phone) in FIG.

[0062] The electronic device 101 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195. It can be understood that the structure illustrated in this embodiment does not constitute a specific limitation on the electronic device 101. In other embodiments of the present application, the electronic device 101 may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0063] The processor 110 may include one or more processing units, for example: the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processor (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), a controller, a video codec, a digital signal processor (digital signal processor, DSP), a baseband processor, and / or a neural-network processing unit (neural-network processing unit, NPU), etc. Among them, different processing units may be independent devices or integrated into one or more processors. In some embodiments, the electronic device 101 may also include one or more processors 110. Among them, the controller may be the nerve center and command center of the electronic device 101. The controller may generate an operation control signal according to the instruction opcode and the timing signal to complete the control of fetching and executing instructions. A memory may also be set in the processor 110 for storing instructions and data. In some embodiments, the memory in the processor 110 is a high-speed cache memory. The memory may save instructions or data that the processor 110 has just used or circulated. If the processor 110 needs to use the instruction or data again, it can be directly called from the memory. Repeated access is avoided, and the waiting time of the processor 110 is reduced, thereby improving the efficiency of the electronic device 101 system.

[0064] In some embodiments, the processor 110 may include one or more interfaces. The interface may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc. Among them, the USB interface 130 is an interface that complies with the USB standard specification, and can specifically be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc. The USB interface 130 can be used to connect a charger to charge the electronic device 101, and can also be used to transmit data between the electronic device 101 and a peripheral device. It can also be used to connect headphones and play audio through the headphones.

[0065] It is understandable that the interface connection relationship between the modules illustrated in the embodiment of the present invention is only a schematic illustration and does not constitute a structural limitation on the electronic device 101. In other embodiments of the present application, the electronic device 101 may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.

[0066] The charging management module 140 is used to receive charging input from a charger. The charger may be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 may receive charging input from a wired charger through the USB interface 130. In some wireless charging embodiments, the charging management module 140 may receive wireless charging input through a wireless charging coil of the electronic device 101. While the charging management module 140 is charging the battery 142, it may also power the electronic device 101 through the power management module 141.

[0067] The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, and supplies power to the processor 110, the internal memory 121, the display screen 194, the camera 193, and the wireless communication module 160. The power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle number, battery health status (leakage, impedance), etc. In some other embodiments, the power management module 141 can also be set in the processor 110. In other embodiments, the power management module 141 and the charging management module 140 can also be set in the same device.

[0068] The wireless communication function of the electronic device 101 can be implemented by antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modulation and demodulation processor and baseband processor. Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in the electronic device 101 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of the antenna. For example, antenna 1 can be reused as a diversity antenna of a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.

[0069] The mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G, etc., applied to the electronic device 101. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier, etc. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the same device as at least some of the modules of the processor 110.

[0070] The modem processor may include a modulator and a demodulator. Among them, the modulator is used to modulate the low-frequency baseband signal to be sent into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After the low-frequency baseband signal is processed by the baseband processor, it is passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to a speaker 170A, a receiver 170B, etc.), or displays an image or video through a display screen 194. In some embodiments, the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 110 and be set in the same device as the mobile communication module 150 or other functional modules.

[0071] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as Wi-Fi networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to the electronic device 101. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, modulates the frequency of the electromagnetic wave signal and performs filtering, and sends the processed signal to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, modulate the frequency of it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.

[0072] The wireless communication module 160 can be specifically used to establish a short-range wireless communication link with a second electronic device (e.g., electronic device 102) so that the two can perform short-range wireless data transmission with each other. Exemplarily, the short-range wireless communication link can be a Bluetooth communication link, a Wi-Fi communication link, an NFC communication link, etc. Therefore, the wireless communication module 160 can specifically include a Bluetooth communication module, a Wi-Fi communication module, or an NFC communication module.

[0073] In some embodiments, the antenna 1 of the electronic device 101 is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the electronic device 101 can communicate with the network and other devices through wireless communication technology. The wireless communication technology may include GSM, GPRS, CDMA, WCDMA, TD-SCDMA, LTE, GNSS, WLAN, NFC, FM, and / or IR technology. The above-mentioned GNSS may include a global positioning system (GPS), a global navigation satellite system (GLONASS), a Beidou navigation satellite system (BDS), a quasi-zenith satellite system (QZSS) and / or a satellite based augmentation system (SBAS).

[0074] The electronic device 101 can realize the display function through the GPU, the display screen 194, and the application processor. The GPU is a microprocessor for image processing, which connects the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs, which execute instructions to generate or change display information.

[0075] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the electronic device 101 may include 1 or N display screens 194, where N is a positive integer greater than 1.

[0076] The electronic device 101 can realize the shooting function through an ISP, one or more cameras 193, a video codec, a GPU, one or more display screens 194, and an application processor.

[0077] NPU is a neural network (NN) computing processor. By drawing on the structure of biological neural networks, such as the transmission mode between neurons in the human brain, it can quickly process input information and can also continuously self-learn. Through NPU, applications such as intelligent cognition of electronic device 101 can be realized, such as image recognition, face recognition, voice recognition, text understanding, etc.

[0078] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 101. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function. For example, data files such as music, photos, and videos are stored in the external memory card.

[0079] The internal memory 121 can be used to store one or more computer programs, which include instructions. The processor 110 can run the above instructions stored in the internal memory 121, so that the electronic device 101 performs the voice switching method provided in some embodiments of the present application, as well as various functional applications and data processing. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area can store an operating system; the program storage area can also store one or more applications (such as a gallery, contacts, etc.). The data storage area can store data (such as photos, contacts, etc.) created during the use of the electronic device 101. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc. In some embodiments, the processor 110 can run the instructions stored in the internal memory 121, and / or the instructions stored in the memory provided in the processor 110, so that the electronic device 101 performs the voice switching method provided in the embodiment of the present application, as well as various functional applications and data processing.

[0080] The electronic device 101 can implement audio functions through an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, and an application processor. For example, music playback, recording, etc. Among them, the audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The audio module 170 can also be used to encode and decode audio signals. In some embodiments, the audio module 170 can be arranged in the processor 110, or some functional modules of the audio module 170 are arranged in the processor 110. The speaker 170A, also known as a "speaker", is used to convert audio electrical signals into sound signals. The electronic device 101 can listen to music or listen to hands-free calls through the speaker 170A. The receiver 170B, also known as a "handset", is used to convert audio electrical signals into sound signals. When the electronic device 101 answers a call or voice message, the voice can be answered by placing the receiver 170B close to the human ear. Microphone 170C, also called "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a call or sending a voice message, the user can make a sound by approaching the microphone 170C with his mouth to input the sound signal into the microphone 170C. The electronic device 101 can be provided with at least one microphone 170C. In other embodiments, the electronic device 101 can be provided with two microphones 170C, which can not only collect sound signals but also realize noise reduction function. In other embodiments, the electronic device 101 can also be provided with three, four or more microphones 170C to realize the collection of sound signals, noise reduction, identification of sound sources, realization of directional recording functions, etc. The headphone jack 170D is used to connect wired headphones. The headphone jack 170D can be a USB interface 130, or a 3.5mm open mobile terminal platform (OMTP) standard interface, or a cellular telecommunications industry association of the USA (CTIA) standard interface.

[0081] The sensor 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, and the like.

[0082] Among them, the pressure sensor 180A is used to sense the pressure signal and can convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 180A can be set on the display screen 194. There are many types of pressure sensors 180A, such as resistive pressure sensors, inductive pressure sensors, capacitive pressure sensors, etc. The capacitive pressure sensor can be a parallel plate including at least two conductive materials. When a force acts on the pressure sensor 180A, the capacitance between the electrodes changes. The electronic device 101 determines the intensity of the pressure according to the change in capacitance. When a touch operation acts on the display screen 194, the electronic device 101 detects the touch operation intensity according to the pressure sensor 180A. The electronic device 101 can also calculate the touch position according to the detection signal of the pressure sensor 180A. In some embodiments, touch operations acting on the same touch position but with different touch operation intensities can correspond to different operation instructions. For example: when a touch operation with a touch operation intensity less than the first pressure threshold acts on the short message application icon, an instruction to view the short message is executed. When a touch operation with a touch operation intensity greater than or equal to the first pressure threshold acts on the short message application icon, an instruction to create a new short message is executed.

[0083] The gyro sensor 180B can be used to determine the motion posture of the electronic device 101. In some embodiments, the angular velocity of the electronic device 101 around three axes (i.e., x, y, and z axes) can be determined by the gyro sensor 180B. The gyro sensor 180B can be used for anti-shake shooting. For example, when the shutter is pressed, the gyro sensor 180B detects the angle of the shake of the electronic device 101, calculates the distance that the lens module needs to compensate based on the angle, and allows the lens to offset the shake of the electronic device 101 through reverse movement to achieve anti-shake. The gyro sensor 180B can also be used for navigation, somatosensory game scenes, etc.

[0084] The acceleration sensor 180E can detect the magnitude of the acceleration of the electronic device 101 in all directions (generally three axes). When the electronic device 101 is stationary, the magnitude and direction of gravity can be detected. It can also be used to identify the posture of the electronic device and is applied to applications such as horizontal and vertical screen switching and pedometers.

[0085] The distance sensor 180F is used to measure the distance. The electronic device 101 can measure the distance by infrared or laser. In some embodiments, when shooting a scene, the electronic device 101 can use the distance sensor 180F to measure the distance to achieve fast focusing.

[0086] The proximity light sensor 180G may include, for example, a light emitting diode (LED) and a light detector, such as a photodiode. The light emitting diode may be an infrared light emitting diode. The electronic device 101 emits infrared light outward through the light emitting diode. The electronic device 101 uses a photodiode to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that there is an object near the electronic device 101. When insufficient reflected light is detected, the electronic device 101 can determine that there is no object near the electronic device 101. The electronic device 101 can use the proximity light sensor 180G to detect that the user holds the electronic device 101 close to the ear to talk, so as to automatically turn off the screen to save power. The proximity light sensor 180G can also be used in leather case mode and pocket mode to automatically unlock and lock the screen.

[0087] The ambient light sensor 180L is used to sense the ambient light brightness. The electronic device 101 can adaptively adjust the brightness of the display screen 194 according to the perceived ambient light brightness. The ambient light sensor 180L can also be used to automatically adjust the white balance when taking pictures. The ambient light sensor 180L can also cooperate with the proximity light sensor 180G to detect whether the electronic device 101 is in a pocket to prevent accidental touches.

[0088] The fingerprint sensor 180H (also called a fingerprint identifier) ​​is used to collect fingerprints. The electronic device 101 can use the collected fingerprint characteristics to implement fingerprint unlocking, access application locks, fingerprint photography, fingerprint answering calls, etc. In addition, other records about the fingerprint sensor can refer to the international patent application PCT / CN2017 / 082773 entitled "Method and electronic device for processing notifications", the entire content of which is incorporated by reference in this application.

[0089] The touch sensor 180K may also be referred to as a touch panel or a touch-sensitive surface. The touch sensor 180K may be provided on the display screen 194, and the touch sensor 180K and the display screen 194 may form a touch screen, also referred to as a touch screen. The touch sensor 180K is used to detect a touch operation applied thereto or thereabout. The touch sensor may transmit the detected touch operation to an application processor to determine the type of touch event. Visual output related to the touch operation may be provided through the display screen 194. In other embodiments, the touch sensor 180K may also be provided on the surface of the electronic device 101, at a position different from that of the display screen 194.

[0090] The bone conduction sensor 180M can obtain a vibration signal. In some embodiments, the bone conduction sensor 180M can obtain a vibration signal of a vibrating bone block of the vocal part of the human body. The bone conduction sensor 180M can also contact the human pulse to receive a blood pressure beat signal. In some embodiments, the bone conduction sensor 180M can also be set in an earphone and combined into a bone conduction earphone. The audio module 170 can parse out a voice signal based on the vibration signal of the vibrating bone block of the vocal part obtained by the bone conduction sensor 180M to realize a voice function. The application processor can parse the heart rate information based on the blood pressure beat signal obtained by the bone conduction sensor 180M to realize a heart rate detection function.

[0091] The key 190 includes a power key, a volume key, etc. The key 190 can be a mechanical key or a touch key. The electronic device 101 can receive key input and generate key signal input related to user settings and function control of the electronic device 101.

[0092] The SIM card interface 195 is used to connect a SIM card. The SIM card can be connected to and separated from the electronic device 101 by inserting it into the SIM card interface 195 or pulling it out from the SIM card interface 195. The electronic device 101 can support 1 or N SIM card interfaces, where N is a positive integer greater than 1. The SIM card interface 195 can support Nano SIM cards, Micro SIM cards, SIM cards, and the like. Multiple cards can be inserted into the same SIM card interface 195 at the same time. The types of the multiple cards can be the same or different. The SIM card interface 195 can also be compatible with different types of SIM cards. The SIM card interface 195 can also be compatible with external memory cards. The electronic device 101 interacts with the network through the SIM card to implement functions such as calls and data communications. In some embodiments, the electronic device 101 uses an eSIM, i.e., an embedded SIM card. The eSIM card can be embedded in the electronic device 101 and cannot be separated from the electronic device 101.

[0093] The following embodiments will describe the structure of the second electronic device in detail. It should be understood that in some embodiments, the second electronic device can be connected to the first electronic device (eg Figure 2 The structure of the second electronic device is the same as that of the electronic device 101 in FIG. 1 , so the structure of the second electronic device is not described in detail here. In some other embodiments, the second electronic device (such as the electronic device 102) may be a voice assistant device; therefore, the structure of the second electronic device may also be different from that of the first electronic device. For example, Figure 3 A schematic structural diagram of a second electronic device in some other embodiments is shown.

[0094] Figure 31 is a schematic diagram of the structure of a second electronic device (eg, electronic device 102) in some embodiments. For example, the electronic device 102 may be a voice assistant device (eg, smart speaker 102), which is configured with a voice assistant system.

[0095] Exemplarily, the voice assistant system may refer to any information processing system that interprets natural language input in oral and / or textual form to infer user intent (e.g., identify the task type corresponding to the natural language input) and performs an action based on the inferred user intent (e.g., perform a task corresponding to the identified task type). For example, to perform an action in accordance with the inferred user intent, the system may perform one or more of the following operations: identify a task flow (e.g., identify a task type) by designing steps and parameters to implement the inferred user intent, input specific requirements from the inferred user intent into the task flow, execute the task flow by calling a program, method, service, application programming interface (API), etc. (e.g., send a request to a service provider); and generate an output response to the user in an auditory (e.g., voice) and / or visual form. Specifically, once the voice assistant system is started, it is capable of accepting user requests that are at least partially in the form of natural language commands, requests, statements, narrations, and / or inquiries. Typically, a user request either seeks an informative answer from the voice assistant system or seeks the voice assistant system to perform a task. A satisfactory response to a user's request is typically to provide the requested informative answer, perform the requested task, or a combination of the two. For example, a user may ask a voice assistant system questions such as "Where am I now?" Based on the user's current location, the voice assistant may answer "You are near the West Gate of Central Park." The user may also request to perform a task, such as by narrating "Please invite my friends to my birthday party next week." In response, the voice assistant system may confirm the request by generating a voice output "OK, right away," and then send a suitable calendar invitation from the user's email address to each friend of the user listed in the user's electronic address book or contact list. In some embodiments, there are many other methods of interacting with the voice assistant system to request information or perform various tasks. In addition to providing verbal responses and performing programmed actions, the voice assistant system may also provide responses in other visual or audio forms (e.g., like text, alarms, music, videos, animations, etc.).

[0096] like Figure 3As shown, the electronic device 102 may specifically include a processor 310, an external memory interface 320, a memory 321, a USB interface 330, a charging management module 340, a power management module 341, a battery 342, an antenna 343, a network communication interface 350, an input / output (I / O) interface 351, a wireless communication module 360, an audio module 370, one or more speaker arrays 370A, one or more microphone arrays 370B, one or more sensors 380, a button 390, a motor 391, an indicator 392, a camera 393, and a display screen 394. These components communicate with each other via one or more communication buses or signal lines.

[0097] It is understood that the structure illustrated in this embodiment does not constitute a specific limitation on the electronic device 102. In other embodiments, the electronic device 102 may include more or fewer components than shown in the figure, or combine some components, or separate some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0098] In some embodiments, Figure 3 The external memory interface 320, USB interface 330, charging management module 340, power management module 341, battery 342, antenna 343, wireless communication module 360, audio module 370, one or more sensors 380, button 390, motor 391, indicator 392, camera 393 and display screen 394 in the embodiment can be connected with Figure 2 Some components of the electronic device 101 have the same or similar structure and / or function, so Figure 3 For detailed description of the above components, please refer to Figure 2 And the corresponding description in the related embodiments will not be repeated here.

[0099] The network communication interface 350 may include one or more wired communication ports, or one or more wireless transmission / reception circuits. One or more wired communication ports receive and send communication signals via one or more wired interfaces such as Ethernet, USB, FireWire, etc. The wireless circuit usually receives RF signals or optical signals from a communication network and other electronic devices, and sends RF signals or optical signals to the communication network and other electronic devices. Wireless communication can use any of a variety of communication standards, protocols and technologies, such as GSM, CDMA, WCDMA, TDMA, Bluetooth, Wi-Fi, VoIP or any other suitable communication protocol. The network communication interface 350 enables the electronic device 102 to communicate with other electronic devices (e.g., mobile phone 101) or servers on the network side through a network, such as the Internet, a wireless network such as a cellular network, a wireless local area network, etc.

[0100] The memory 321 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a general flash memory, etc. In some embodiments, the processor 310 may enable the electronic device 102 to execute the voice switching method provided in the embodiment of the present application, as well as various functional applications and data processing by running instructions stored in the memory 321 or instructions stored in a memory provided in the processor 310.

[0101] In some embodiments, the memory 321 may store programs, modules, instructions, and data structures, including all or a subset of the following: an operating system 321A, a communication module 321B, a user interface module 321C, one or more application programs 321D, and a voice assistant module 321E. The one or more processors 310 execute these programs, modules, and instructions, and read data from or write data to the data structure.

[0102] The operating system 321A (e.g., Darwin, RTXC, LINUX, UNIX, OS X, WINDOWS, or an embedded operating system) includes various software components or drivers for controlling and managing general system tasks (e.g., memory management, storage device control, power management, etc.), and facilitates communication between various hardware, firmware, and software components. The communication module 321B facilitates communication between the voice assistant device 300 and other electronic devices through the network communication interface 350. For example, the communication module 321B can communicate with Figure 2 . The communication module 321B may also include various software components that can be used to process data received by the network communication interface 350. The user interface module 321C receives commands or inputs from the user via the I / O interface 351 (for example, from a keyboard, touch screen, or microphone connected to the I / O interface 351) and displays the user interface on the display. The application 321D includes a program or module configured to be executed by one or more processors 310. For example, if the voice assistant system is implemented independently on a voice assistant device, the application 321D may include applications such as games, calendars, navigation, or mail. If the voice assistant system is implemented on a server, the application 321D may include applications such as resource management, diagnosis, or scheduling.

[0103] The memory 321 also stores a voice assistant module 321E. In some specific embodiments, the voice assistant module 321E may include the following submodules, or subsets or supersets thereof: an I / O processing module 321F, a speech to text (STT) processing module 321G, a natural language processing module 321H, a dialogue flow processing module 321I, a task flow processing module 321J, and a service processing module 321K. The voice assistant module 321E is mainly used to implement the voice assistant system in the embodiment of the present application through the information interaction of the above submodules.

[0104] In some embodiments, by using a processing module (e.g., I / O processing module 321F, STT processing module 321G, natural language processing module 321H, dialog flow processing module 321I, task flow processing module 321J, or service processing module 321K), data, and a model implemented in voice assistant module 321E, voice assistant device 300 may perform at least one of the following operations: identifying the user's intent expressed in the natural language input received from the user; actively eliciting and obtaining information required to fully infer the user's intent (e.g., by eliminating ambiguity of words, names, intentions, etc.); determining a task flow for implementing the inferred intent; and executing the task flow to implement the inferred intent. In other embodiments, when a satisfactory response is not or cannot be provided to the user due to various reasons, the voice assistant device 300 also takes other appropriate actions.

[0105] In some embodiments, the I / O processing module 321F can receive a user's command (e.g., voice command) or input (e.g., voice input) through one or more microphone arrays 370B; the I / O processing module 321F can also receive a user's command or input from other connected devices (e.g., a microphone, a touch screen, or a keyboard, etc.) through the I / O interface 351; the I / O processing module 321F can also respond to the user's input through one or more speaker arrays 370A or indicators 392 or display screens 394, thereby interacting with the user; the I / O processing module 321F can also communicate with other electronic devices (e.g., Figure 2The I / O processing module 321F can interact with the electronic device 101 in the embodiment of the present invention to obtain user input (e.g., voice input) and provide a response to the user input. The I / O processing module 321F can obtain context information associated with user input from other electronic devices when receiving the user input or shortly after receiving the user input. The context information includes user-specific data, vocabulary, or preferences related to the user input. In other embodiments, the context information may also include the software and hardware status of the electronic device (e.g., electronic device 101) when receiving the user request, or information related to the user's surrounding environment when receiving the user request. In some embodiments, the I / O processing module 321F also sends follow-up questions related to the user request to the user and receives answers from the user. In some embodiments, when the user request is received by the I / O processing module 321F and the user request contains voice input, the I / O processing module 321F can forward the voice input to the STT processing module 321G for voice-to-text conversion.

[0106] In some embodiments, the STT processing module 321G receives voice input through the I / O processing module 321F. The STT processing module 321G can use various sound models and language models to recognize the voice input as a sequence of phonemes, and ultimately recognize it as a sequence of words or tokens written in one or more languages. The STT processing module 321G can use any suitable speech recognition technology, sound model, and language model, such as hidden Markov models, speech recognition based on dynamic time warping, and other statistical or analytical techniques to implement the embodiments of the present application. In some embodiments, speech-to-text processing may be at least partially performed by a third-party service or performed on an electronic device. Once the STT processing module 321G obtains the result of the speech-to-text processing (e.g., a sequence of words or symbols), it transmits the result to the natural language processing module 321H for intention inference.

[0107] The natural language processing module 321H (also referred to as the natural language processor) obtains a sequence of words or symbols ("symbol sequence") generated by the STT processing module 321G, and attempts to associate the symbol sequence with one or more "actionable intents" recognized by the voice assistant module 321E. "Executable intent" represents a task that can be performed by the voice assistant module 321E and has an associated task flow implemented in the task flow model. The associated task flow is a series of programmed actions and steps taken by the voice assistant module 321E to perform the task. The scope of the voice assistant system's capabilities depends on the number and types of task flows that have been implemented and stored in the task flow model; or in other words, on the number and types of "executable intents" recognized by the voice assistant module 321E. However, the effectiveness of the voice assistant system 300 also depends on the ability of the voice assistant module 321E to infer the correct "one or more executable intents" from user requests expressed in natural language.

[0108] In some embodiments, in addition to the sequence of words or symbols obtained from the STT processing module 321G, the natural language processing module 321H may also receive context information associated with the user request (e.g., from the I / O processing module 321F). The natural language processing module 321H may also use the context information to clarify, supplement, and or further define the information contained in the sequence of symbols received from the STT processing module 321G. The context information includes, for example, user preferences, the hardware and / or software state of the user's device, sensor information collected before, during, or shortly after the user's request, previous interactions (e.g., conversations) between the voice assistant system and the user, and the like.

[0109] In some embodiments, the natural language processing module 321H may specifically include an ontology, vocabulary, user data, and a classification module. Among them, the ontology is a hierarchical structure containing multiple nodes, each node representing an "executable intent" or "attribute" related to one or more of "executable intent" or other "attributes". As described above, "executable intent" represents a task that the voice assistant system 300 can perform (e.g., an executable or executable task). "Attributes" represent parameters associated with sub-aspects of executable intent or another attribute. Each node in the ontology is associated with a group of words and / or phrases related to the attribute or executable intent represented by the node. The corresponding words and / or phrases associated with each node are so-called "vocabulary" associated with the node. A corresponding group of words and / or phrases associated with each node can be stored in a vocabulary index associated with the attribute or executable intent represented by the node. The vocabulary index may include words and phrases in different languages. In some embodiments, the natural language processor 321H receives a symbol sequence (eg, a text string) from the STT processing module 321G and determines which nodes are involved in the words in the symbol sequence.

[0110] User data includes user-specific information, such as user-specific vocabulary, user preferences, user address, user's default language and second language, user's contact list, and other short-term or long-term information for each user. The natural language processor 321H can use user data to supplement the information contained in the user input to further define the user's intent. For example, for a user request to "invite my friends to my birthday party", the natural language processor 321H can access user data to determine who the "friends" are and when and where the "birthday party" will be held, without requiring the user to explicitly provide such information in their request.

[0111] The natural language processor 321H may also include a classification module. In some embodiments, the classification module determines, for example, whether each of one or more words in a text string is an entity, an activity, or a location. Once an executable intent is identified based on a user request, the natural language processor 321H generates a structured query to represent the identified executable intent. In some embodiments, the natural language processor 321H may fill in some parameters of the structured query with the received context information. For example, if a user requests a sushi restaurant "near me", the natural language processor 321H may fill in the location parameter in the structured query with the GPS coordinates from the voice assistant device 300.

[0112] In some embodiments, the natural language processor 321H transmits the structured query to the task flow processing module 321J (also referred to as the task flow processor). The task flow processor 321J is configured to perform one or more of the following: receiving the structured query from the natural language processor 321H, completing the structured query, and performing the actions required for the user's final request. In some embodiments, the various processes necessary to complete these tasks are provided in the task flow model in the task flow processing module 321J. The task flow model includes a process for obtaining additional information from the user, and a task flow for performing actions associated with executable intentions. As described above, in order to complete the structured query, the task flow processor 321J may need to initiate additional dialogues with the user in order to obtain additional information, and / or eliminate the ambiguity of potentially ambiguous utterances. When such interactions are necessary, the task flow processor 321J calls the dialogue processing module 321I (also referred to as the dialogue processor) to conduct a dialogue with the user. In some embodiments, the dialogue processing module 321I determines how (and / or when) to ask the user for additional information, and receives and processes the user's response. In some embodiments, the question is provided to the user and the answer is received from the user through the I / O processing module 351. For example, the dialogue processing module 321I presents dialogue output to the user via the speaker array 370A and / or the display screen 394 and receives input from the user.

[0113] In some embodiments, the dialog processor 321I may include a disambiguation module. The disambiguation module is used to disambiguate one or more ambiguous terms (e.g., one or more ambiguous terms in a text string corresponding to a voice output associated with a digital photo). In some embodiments, the disambiguation module identifies that a first term among the one or more terms has multiple candidate meanings, prompts a user for additional information about the first term, receives the additional information from the user in response to the prompt, and identifies an entity, activity, or location associated with the first term based on the additional information.

[0114] Once the task flow processor 321J has completed the structured query for the executable intent, the task flow processor 321J proceeds to execute the final task associated with the executable intent. Therefore, the task flow processor 321J can execute the steps and instructions in the task flow model according to the specific parameters contained in the structured query. In some embodiments, the task flow processor 321J completes the task requested in the user input with the assistance of the service processing module 321K (also referred to as the service processor), or provides the informational answer requested in the user input. For example, the service processor 321K can replace the task flow processor 321J to initiate a phone call, set a calendar entry, call a map search, call other applications installed on the user device or interact with these other applications, and call third-party services (e.g., restaurant reservation portals, social networking sites or services, bank portals, etc.) or interact with these third-party services. In some embodiments, the protocols and application programming interfaces (application programming interfaces, APIs) required for each service can be specified by the corresponding service model in the service model in the service processing module 321K. The service processor 321K accesses the appropriate service model for the service and generates a request for the service according to the protocol and API required for the service based on the service model.

[0115] In some embodiments, the natural language processor 321H, the dialogue processor 321K, and the task flow processor 321J are used together and repeatedly to infer and define the user's intent, obtain information to further clarify and refine the user's intent, and finally generate a response (e.g., provide output to the user, or complete the task) to satisfy the user's intent. In some embodiments, after all tasks required to satisfy the user's request have been performed, the voice assistant system formulates a confirmation response and sends the response back to the user through the I / O processing module 321F. If the user request seeks an informative answer, the confirmation response presents the requested information to the user.

[0116] In other embodiments, the I / O interface 351 can couple the I / O devices of the voice assistant device 300, such as a keyboard, a touch screen, a microphone, etc., to the user interface module 321C. The I / O interface 351 is combined with the user interface module 321C to receive user input (e.g., voice input, keyboard input, touch input, etc.) and process the input accordingly.

[0117] It is understood that the second electronic device can be distributed across multiple computers to form a client-server voice assistant system. In the voice assistant system, some of the modules and functions of the voice assistant system are divided into a server part and a client part. The client part can be located on the second electronic device (e.g., electronic device 102) and communicate with the server part (e.g., voice assistant server 105) via network 109, such as Figure 1 In some embodiments, the voice assistant system can be Figure 1 . In other embodiments, the voice assistant system can be implemented in the electronic device 102, thereby eliminating the need for a client-server system. It should be noted that the above-described voice assistant system is only one example, and the voice assistant system may have more or fewer components than shown, may combine two or more components, or may have a different configuration or layout of components.

[0118] In the following, the mobile phone 101 is used as the first electronic device and the smart speaker 102 is used as the second electronic device, and the voice switching method provided in the embodiment of the present application is described in detail in conjunction with the accompanying drawings.

[0119] Exemplarily, taking the VoIP service as an example, in the embodiment of the present application, the ongoing VoIP service can be switched between the mobile phone 101 and the smart speaker 102. Among them, the electronic device that is performing the VoIP service before the switch can be called the source device of the VoIP service, and the source device can be the mobile phone 101 or the smart speaker 102. The device that continues to perform the VoIP service after the switch can be called the target device of the VoIP service. When the source device is the mobile phone 101, the target device of the VoIP service can be the smart speaker 102; when the source device is the smart speaker 102, the target device of the VoIP service can be the mobile phone 101.

[0120] The following will explain how to switch the VoIP service between the mobile phone 101 and the smart speaker 102 in conjunction with the specific scenarios of the embodiment.

[0121] In some application scenarios, after the user 108 logs in to the device management server 103 using the same account on the mobile phone 101 and the smart speaker 102, the user 108 can communicate with other electronic devices (such as Figure 1 If the user 108 wishes to switch the VoIP service from the smart speaker 102 to the mobile phone 101, the user can perform a preset input operation on the mobile phone 101 to trigger the VoIP server 104 to switch the ongoing VoIP service on the smart speaker 102 to the mobile phone 101 through the network 109.

[0122] For example, Figure 4 As shown, this embodiment provides a voice switching method, which can be implemented in the electronic device and server involved in the above embodiment, and can include the following steps:

[0123] Step S401: Both the mobile phone 101 and the smart speaker 102 log in to the device management server 103 using a first account.

[0124] Among them, the above-mentioned first account (for example, HUAWEI-01) can be an account of a certain application (for example, Kugou Music) or an account of a certain service (for example, Huawei Cloud Service).

[0125] For example, if the Kugou Music APP is installed in both the mobile phone 101 and the smart speaker 102, then the user 108 can use the account (HUAWEI-01) in the Kugou Music APP of the mobile phone 101 to log in to the device management server 103 corresponding to the APP; and the user 108 can also use the same account (HUAWEI-01) in the Kugou Music APP of the smart speaker 102 to log in to the device management server 103 corresponding to the APP. For another example, if the mobile phone 101 and the smart speaker 102 are both Huawei-branded electronic devices, the mobile phone 101 and the smart speaker 102 can both provide Huawei cloud services to the user 108. Then, the user can use the account (HUAWEI-01) in the mobile phone 101 to log in to the device management server 103 of the Huawei cloud service, and the user 108 can also use the same account (HUAWEI-01) in the smart speaker 102 to log in to the device management server 103 of the Huawei cloud service.

[0126] The device management server 103 stores the account number and the device information of the electronic device logged in with the account number, such as the device identification (as shown in Table 1). When the mobile phone 101 and the smart speaker 102 both use the same account number to log in to the device management server 103, the device management server 103 can establish a corresponding relationship between the first account number and the electronic device using the first account number. In this way, the device management server 103 can query which electronic devices are logged in under a certain account number.

[0127] Step S402: The smart speaker 102 detects an input operation by the user 108 to initiate a voice call.

[0128] Step S403: In response to the above input operation, the smart speaker 102 establishes a connection with a third electronic device (eg, Figure 1 A VoIP call between the mobile phone 107 shown.

[0129] For example, if the user 108 needs to use the VoIP service to talk to a contact (such as Susan), the user 108 can initiate an input operation of a VoIP voice call on the smart speaker 102. The input operation can specifically be an operation in which the user 108 enters Susan's phone number on the display screen 394 of the smart speaker 102.

[0130] In other embodiments, the input operation may also be a voice input operation performed by the user 108 to the smart speaker 102. For example, the user 108 may say "Call Susan" to the smart speaker 102. After the smart speaker 102 collects the voice signal, the voice assistant system in the smart speaker 102 may be used to perform voice recognition on the voice signal to obtain a control instruction corresponding to the voice signal. For example, the voice assistant system recognizes the control instruction as "Call contact Susan" based on the voice signal. Furthermore, the smart speaker 102 may send a call request to the VoIP server 104 to call the phone number of Susan in the address book, so that the VoIP server 104 calls the mobile phone 107 of the contact Susan. Subsequently, if the called mobile phone 107 successfully answers the call initiated by the smart speaker 102, the mobile phone 107 may send a successful answering message to the VoIP server 104, thereby establishing a VoIP call between the smart speaker 102 and the called party (i.e., the mobile phone 107 of the contact Susan). In this way, the user can use the smart speaker 102 to make a VoIP call with the contact.

[0131] It can be understood that in various embodiments of the present application, the smart speaker 102 can collect the user's voice input (i.e., voice signal) from different directions through one or more microphone arrays 370B, and the smart speaker 102 can play the voice feedback of the voice assistant system on the voice recognition results through one or more speaker arrays 370A.

[0132] In some embodiments, after the smart speaker 102 collects the user's voice signal, it can also send the voice signal to the voice assistant server 105, and the voice assistant server 105 performs voice recognition on the voice signal to obtain a control instruction corresponding to the voice signal. When the identified control instruction is related to the VoIP service, the voice assistant server 105 can send the identified control instruction to the VoIP server 104, and the VoIP server 104 establishes the VoIP service between the smart speaker 102 and the called party according to the above method. Of course, in addition to initiating a call operation of the VoIP service by inputting a voice signal, the user can also initiate a call operation of the VoIP service by executing a preset gesture, etc., and the embodiment of the present application does not impose any restrictions on this.

[0133] Step S404: The mobile phone 101 sends a first switching request message to the VoIP server 104, where the first switching request message is used to request the VoIP server 104 to switch the ongoing VoIP service in the smart speaker 102 to the mobile phone 101 for continuation.

[0134] In some embodiments, the first switching request information may include a first account.

[0135] In some application scenarios, the user may want to switch the ongoing VoIP call in the smart speaker 102 to the mobile phone 101. For example, the smart speaker 102 is located at the home of the user 108, and the user can use the smart speaker 102 to make VoIP calls with other electronic devices (such as mobile phone 107) at home. When the user leaves home, the user needs to use the more portable mobile phone 101 to continue the VoIP call with the mobile phone 107. At this time, the user needs to switch the VoIP service being executed in the smart speaker 102 to the mobile phone 101 for continued execution.

[0136] In order to realize the switching function of the VoIP service between the mobile phone 101 and the smart speaker 102, the mobile phone 101 can pre-set a specific operation for switching the VoIP service. Exemplarily, the specific operation can be an input operation such as flipping the phone, tapping the screen with knuckles, double-clicking the power button, or sliding operation. Alternatively, the specific operation can also be a preset voice input. For example, the user 108 can voice input the voice command "switch voice call" to the mobile phone 101. It is understandable that those skilled in the art can set the preset operation according to the actual application scenario or actual experience, and this embodiment does not impose any restrictions on this.

[0137] Then, when the mobile phone 101 detects an input operation of the user on the mobile phone 101 , if the mobile phone 101 determines that the input operation is the above-mentioned specific operation, then in response to determining the above-mentioned specific operation, the mobile phone 101 can send a first switching request message to the VoIP server 104 .

[0138] In other words, when the mobile phone 101 detects the above-mentioned specific operation, it indicates that the user 101 needs to switch the ongoing VoIP service under the first account (for example, HUAWEI-01) to the mobile phone 101. Further, in response to the specific operation, the mobile phone 101 may send a first switching request message to the VoIP server 104 via the network 109.

[0139] Exemplarily, the above-mentioned specific operation can be preset as a sliding gesture on the touch screen of the mobile phone 101. For example, when the sliding track of the sliding gesture is X-shaped, the sliding gesture is used to indicate that the ongoing VoIP call on the mobile phone 101 is switched to the user's smart speaker 102, and the mobile phone 101 can use the smart speaker 102 as the target device for the VoIP call. When the sliding track of the sliding gesture is Y-shaped, the sliding gesture is used to indicate that the ongoing VoIP call on the mobile phone 101 is switched to the user's tablet computer 111 (not shown in the figure). Then, if it is detected that the sliding track of the sliding operation performed by the user is X-shaped, the mobile phone 101 can use the tablet computer 111 as the target device for the VoIP call.

[0140] In other embodiments, the first switching request information may also include the VoIP identifier of the mobile phone 101 in the VoIP service (such as the phone number or IP address of the mobile phone 101 ), and the VoIP identifier of the smart speaker 102 in the VoIP service.

[0141] In some embodiments, the first switching request information may also include the device identification of the mobile phone 101, so that the VoIP server 104 can verify the legitimacy of the electronic device 101 after receiving the first switching request information, thereby further improving the security of voice switching.

[0142] In some other embodiments, the mobile phone 101 may also automatically send the first switching request information to the VoIP server 104 through the network 109 according to the detected specific conditions, without the need for the user to input a specific operation to the mobile phone 101 to trigger it in the above embodiment.

[0143] In some embodiments, the specific condition may be the Wi-Fi signal strength in the WLAN network. Exemplarily, the mobile phone 101 and the smart speaker 102 are both connected to the same Wi-Fi network, that is, both electronic devices can use the same service set identifier (SSID) in the WLAN network to access the network. Since the mobile phone 101 is more portable than the smart speaker 102, when the mobile phone 101 and the smart speaker 102 are connected to the same Wi-Fi network (for example, a Wi-Fi network with an SSID name of "123"), the mobile phone 101 can determine whether to send the first switching request information to the VoIP server 104 based on the change in the detected Wi-Fi signal strength of the Wi-Fi network. For example, when the mobile phone 101 cannot detect the Wi-Fi signal of the above network or the detected Wi-Fi signal is lower than a preset threshold, the mobile phone 101 can automatically send the first switching request information to the VoIP server 104. The above situation shows that the user has taken the mobile phone 101 away from the above Wi-Fi network and the smart speaker 102. In this case, the mobile phone 101 can request the VoIP server 104 to switch the ongoing VoIP call in the smart speaker 102 to the mobile phone 101, so that the user can conveniently continue the VoIP call on the mobile phone 101.

[0144] In other embodiments, the above-mentioned specific condition may also be the Bluetooth signal strength. Exemplarily, a Bluetooth connection may be established between the mobile phone 101 and the smart speaker 102, so that the mobile phone 101 may determine whether to send the above-mentioned first switching request information to the VoIP server 104 according to the detected Bluetooth signal strength between the mobile phone 101 and the smart speaker 102. For example, when the mobile phone 101 detects that the Bluetooth connection with the smart speaker 102 is disconnected, or when the mobile phone 101 detects that the Bluetooth signal strength of the smart speaker 102 is less than a preset threshold, the mobile phone 101 may automatically send the above-mentioned first switching request information to the VoIP server 104. The above situation indicates that the user has taken the mobile phone 101 away from the smart speaker 102 at this time. In this case, the mobile phone 101 can request the VoIP server 104 to seamlessly switch the ongoing VoIP call in the smart speaker 102 to the mobile phone 101, so that the user can conveniently continue the VoIP call on the mobile phone 101.

[0145] It should be noted that those skilled in the art can set other technical solutions for triggering the mobile phone 101 to send the first switching request information to the VoIP server 104 according to actual application scenarios or actual experience, and the embodiments of the present application do not impose any restrictions on this. For example, the mobile phone 101 can be connected to the dock device by wire, and connected to the smart speaker 102 through the dock device. When it is detected that the mobile phone 101 is unplugged from the dock device, in response to the event, the mobile phone 101 can automatically send the above-mentioned first switching request information to the VoIP server 104 through the network 109.

[0146] Step S405 : the VoIP server 104 receives the first switching request information sent by the mobile phone 101 .

[0147] Step S406 : In response to receiving the first switching request information, the VoIP server 104 determines that the source device of the VoIP service corresponding to the first account is the smart speaker 102 .

[0148] Exemplarily, after the VoIP server 104 receives the first switching request information sent by the mobile phone 101 through the network 109, it can send the first account (i.e., HUAWEI-01) carried in the first switching request information to the device management server 103. Since the device management server 103 stores the account number, the device identification of the electronic device, etc. (as shown in Table 1), the device management server 103 can find each electronic device logged in using the first account according to the first account sent by the VoIP server 104, for example, the smart speaker 102 also uses the first account to log in. Of course, there may be one or more electronic devices logged in using the first account, and the device management server 103 can send the device identification of all electronic devices logged in using the first account to the VoIP server 104 through the network 109. In other cases, the device management server 103 can also send the device identification of all electronic devices that support VoIP services in all electronic devices logged in using the first account to the VoIP server 104.

[0149] After receiving the device identifier sent by the device management server 103, the VoIP server 104 can query the source device that is performing the VoIP service under the above-mentioned first account through the device identifier. For example, the device management server 103 queries the device identifier of the smart speaker 102 according to the account HUAWEI-01, and sends the device identifier to the VoIP server. The VoIP server 104 can thus determine that the source device executing the VoIP service is the smart speaker 102, that is, the user needs to switch the VoIP service being executed on the smart speaker 102 to the mobile phone 101.

[0150] In some other embodiments, if two or more electronic devices logged in using the first account are executing VoIP services, for example, in addition to the smart speaker 102, the tablet computer 111 is also executing VoIP services. Then, the VoIP server 104 can send the device identifications of the two electronic devices to the mobile phone 101 through the network 109. Figure 5 As shown, a prompt box 501 may be displayed on the touch screen of the mobile phone 101. There are one or more options in the prompt box 501, which lists a list of multiple source devices that are performing VoIP services under the first account (e.g., HUAWEI-01). In this way, the user can choose in the prompt box 501 which electronic device to switch the VoIP service on to the mobile phone 101. For example, when the mobile phone 101 detects that the user has selected the option representing the smart speaker 102, the mobile phone 101 may send the identifier of the smart speaker 102 to the VoIP server 104. In this way, the VoIP server 104 can determine that the source device of the VoIP service that the user needs to switch is the smart speaker 102.

[0151] Step S407: The VoIP server 104 switches the VoIP call currently being conducted on the smart speaker to the mobile phone 101.

[0152] Exemplarily, first, the VoIP server 104 can add the mobile phone 101 to the VoIP call between the smart speaker 102 and the mobile phone 107. Specifically, the VoIP server 104 can add the mobile phone 101 to the VoIP service between the smart speaker 102 and the mobile phone 107 according to the VoIP identifier of the mobile phone 101 in the VoIP service. At this point, a multi-party call of the VoIP service is established between the mobile phone 101, the smart speaker 102 and the mobile phone 107.

[0153] The VoIP identifier of the mobile phone 101 may be carried in the first switching request information of the mobile phone 101. Alternatively, the VoIP identifiers of various electronic devices in the VoIP service may be pre-registered in the VoIP server 104. In this way, the VoIP identifier of the mobile phone 101 in the VoIP service may be queried in the VoIP server 104.

[0154] After a multi-party call of the VoIP service is established among the mobile phone 101 , the smart speaker 102 and the mobile phone 107 , the mobile phone 101 may send a response message of successfully joining the VoIP service to the VoIP server 104 through the network 109 .

[0155] After receiving the above response message, the VoIP server 104 interrupts the VoIP service of the smart speaker 102. After the interruption, only the mobile phone 101 and the mobile phone 107 are conducting a VoIP call.

[0156] In some embodiments, after the VoIP server 104 adds the mobile phone 101 to the VoIP service between the smart speaker 102 and the mobile phone 107, if the mobile phone 101 successfully accesses the VoIP service, it means that the user has used the mobile phone 101 to connect the VoIP voice call with the mobile phone 107. Then, the mobile phone 101 can send a response message to the VoIP server 104 to successfully join the VoIP service. After receiving the response message, the VoIP server 104 can remove the smart speaker 102 from the multi-party call consisting of the mobile phone 101, the smart speaker 102 and the mobile phone 107, that is, interrupt the VoIP service of the smart speaker 102, so that the VoIP service is switched from the smart speaker 102 to the mobile phone 101 to continue to execute.

[0157] It can be seen that before the mobile phone 101 sends a response message to the VoIP server 104 indicating successful joining of the VoIP service, the VoIP service is connected to both the smart speaker 102 and the mobile phone 101. After the user answers the VoIP voice call on the mobile phone 101, the mobile phone 101 will send the above response message to the VoIP server 104 to trigger the VoIP server 104 to interrupt the VoIP service of the smart speaker 102. In this way, the VoIP service will not be interrupted when switching between the mobile phone 101 and the smart speaker 102, and the user can achieve seamless connection of the VoIP voice call when switching from the smart speaker 102 to the mobile phone 101, thereby improving the voice switching efficiency between multiple devices and the user experience.

[0158] In other embodiments, the VoIP server 104 may also transfer the VoIP call of the smart speaker 102 to the mobile phone 101 through the call forwarding service according to the VoIP identifier of the mobile phone 101 in the VoIP service (for example, the telephone number of the mobile phone 101), thereby switching the ongoing VoIP call on the smart speaker 102 to the mobile phone 101 to continue.

[0159] In the technical solution provided in the above embodiment, the source device of the VoIP service is the smart speaker 102, and the target device of the VoIP service is the mobile phone 101. The mobile phone 101 can identify the switching demand of the VoIP service in response to the user's specific operation. Furthermore, the mobile phone 101 can send a first switching request message to the VoIP server 104, so that the VoIP server 104 can seamlessly switch the VoIP service being executed on the smart speaker 102 under the same account to the mobile phone 101. The VoIP service will not be interrupted during the switching process, and the user does not need to repeatedly operate between multiple devices, thereby improving the voice switching efficiency between multiple devices and the user experience.

[0160] In other application scenarios, if the user wants to switch the VoIP call being conducted on the smart speaker 102 to the mobile phone 101, the user can input a specific operation on the smart speaker 102 to trigger the VoIP server 104 to switch the VoIP call on the smart speaker 102 to other electronic devices (such as mobile phone 101) logged in under the same account.

[0161] For example, Figure 6 As shown, a voice switching method provided in this embodiment includes:

[0162] In step S601, the mobile phone 101 and the smart speaker 102 both log in to the device management server 103 using the first account.

[0163] Step S602: The smart speaker 102 detects the input operation of the user 108 to initiate a voice call.

[0164] Step S603: In response to the above input operation, the smart speaker 102 establishes a connection with a third electronic device (eg, Figure 1 A VoIP call between the mobile phone 107 shown.

[0165] The specific implementation method of steps S601-S603 can refer to the relevant description of steps S401-S402 in the above embodiment, so it will not be repeated here.

[0166] Step S604: The smart speaker 102 sends a second switching request message to the VoIP server 104, where the second switching request message is used to request the VoIP server 104 to switch the ongoing VoIP service in the smart speaker 102 to the mobile phone 101 for continuation.

[0167] The second switching request information may include the first account.

[0168] In this application scenario, the user wants to switch the ongoing VoIP call in the smart speaker 102 to the mobile phone 101 for continued execution. The user can perform an input operation on the source device (i.e., the smart speaker 102) to trigger the VoIP server 104 to switch the VoIP call being executed in the smart speaker 102 to the mobile phone 101 for execution.

[0169] Exemplarily, the above input operation may be a user's voice input. For example, when the user wants to switch the VoIP call being executed in the smart speaker 102 to the mobile phone 101, the voice assistant system of the smart speaker 102 may be in an inactive state, so the user can first voice input a wake-up word to the smart speaker 102, such as "Hello, Xiao E". When the smart speaker 102 detects the wake-up word, the above voice assistant system of the smart speaker 102 is activated and collects further voice input from the user so that the above voice assistant system performs voice recognition processing on the voice input.

[0170] In some embodiments, after the above-mentioned voice assistant system is awakened, the user can continue to make voice input to the smart speaker 102. For example, the user's voice input can be: "Switch the voice call to my mobile phone", that is, the target device for executing the VoIP call is switched to the user's mobile phone 101. After the smart speaker 102 performs voice recognition on the voice input, the smart speaker 102 can generate a second switching request message and send the second switching request message to the VoIP server 104, wherein the second switching request message is used to request the VoIP server 104 to switch the ongoing VoIP call to the second switching request message of the mobile phone 101. The second switching request message may include the first account currently logged in by the smart speaker 102 (for example, HUAWEI-01) and the device identifier of the target device (i.e., mobile phone 101).

[0171] In some other embodiments, the voice input may also be: "Switch voice call". After the smart speaker 102 performs voice recognition on the voice input, it can be determined that the user's operation intention is to switch the VoIP call being executed in the smart speaker 102 to other electronic devices of the user, but the voice input does not clearly indicate which electronic device of the user to switch the VoIP call to for continued execution. At this time, the second switching request information generated by the smart speaker 102 may include the first account currently logged in by the smart speaker 102, but does not include the device identifier of the target device (i.e., mobile phone 101).

[0172] In other embodiments, the smart speaker 102 may be pre-set to switch the VoIP call to another default electronic device of the user, such as the mobile phone 101, for continued execution. Then, when the target device is not specified in the above voice input, the smart speaker 102 may default to the user's mobile phone 101 as the target device for executing the VoIP call after the switch. At this time, the second switching request information generated by the smart speaker 102 may also include the device identifier of the default target device (i.e., the mobile phone 101).

[0173] In other embodiments, after the smart speaker 102 collects the user's voice input, it can also send the voice input to the voice assistant server 105 through the network 109, and the voice assistant server 105 performs voice recognition on the voice input. Then, the voice assistant server 105 can feed back the voice recognition result to the smart speaker 102, and the smart speaker 102 generates the second switching request information according to the voice recognition result, and sends it to the VoIP server 104 through the network 109.

[0174] In some other embodiments, the smart speaker 102 can also automatically send the above-mentioned second switching request information to the VoIP server 104 through the network 109 according to the detected specific conditions, without the user having to input a voice input to the smart speaker 102.

[0175] Exemplarily, the above-mentioned specific condition may be the Wi-Fi signal strength in the WLAN network. Both the mobile phone 101 and the smart speaker 102 are connected to the Wi-Fi network of the same router. When the router detects that the mobile phone 101 has disconnected from the Wi-Fi network at a certain moment, or the detected Wi-Fi signal of the mobile phone 101 is lower than a preset threshold, the router may automatically send a notification message to the smart speaker 102, indicating that the mobile phone 101 has moved away from the Wi-Fi network. In this case, the smart speaker 102 may automatically send the above-mentioned second switching request message to the VoIP server 104 through the network 109, requesting the VoIP server 104 to switch the ongoing VoIP call in the smart speaker 102 to the mobile phone 101, so that the user can conveniently continue the VoIP call on the mobile phone 101. In this scenario, the user first conducts a VoIP call with the mobile phone 107 through the smart speaker 102, and then the user picks up the mobile phone and moves away from the smart speaker 102, and also moves away from the above-mentioned Wi-Fi network. At this time, the VoIP call is automatically switched to the user's mobile phone to continue the VoIP call, which improves the efficiency of the VoIP call and the user's experience.

[0176] Exemplarily, the above-mentioned specific condition may also be Bluetooth signal strength. Exemplarily, a Bluetooth connection may be established between the mobile phone 101 and the smart speaker 102, so that the smart speaker 102 may determine whether to automatically send the above-mentioned second switching request information to the VoIP server 104 according to the detected Bluetooth signal strength between the mobile phone 101 and the smart speaker 102. For example, when the smart speaker 102 detects that the Bluetooth connection with the mobile phone 101 is disconnected, or when the smart speaker 102 detects that the Bluetooth signal strength of the mobile phone 101 is less than a preset threshold, the smart speaker 102 may automatically send the above-mentioned second switching request information to the VoIP server 104.

[0177] It should be noted that those skilled in the art can set a specific technical solution for the smart speaker 102 to send the second switching request information to the VoIP server 104 according to actual application scenarios or actual experience, and this embodiment does not impose any restrictions on this. For example, the smart speaker 102 can pre-set a gesture of tapping the smart speaker 102 once to trigger the smart speaker 102 to switch the ongoing VoIP call to the mobile phone, and a gesture of tapping the smart speaker 102 twice to trigger the smart speaker 102 to switch the above VoIP call to the tablet computer 111, etc.

[0178] Step S605: The VoIP server 104 receives the second switching request information sent by the smart speaker 102.

[0179] Step S606 : In response to receiving the second switching request information, the VoIP server 104 determines that the source device of the VoIP service corresponding to the first account is the smart speaker 102 .

[0180] Step S607: The VoIP server 104 switches the VoIP call to the mobile phone 101.

[0181] First, the VoIP server 104 can determine that the target device for executing the VoIP call is the mobile phone 101 from multiple electronic devices logged in using the first account. After the VoIP server 104 receives the second switching request information sent by the smart speaker 102, the first account (ie, HUAWEI-01) carried in the second switching request information can be sent to the device management server 103. Furthermore, the device management server 103 can query all electronic devices currently using the first account. For example, in addition to the smart speaker 102, the mobile phone 101 and the tablet computer 111 also use the first login. Then, the device management server 103 can send the device identification of the mobile phone 101 and the tablet computer 111 to the VoIP server 104 through the network 109, and the VoIP server 104 determines the target device among these electronic devices that will subsequently replace the smart speaker 102 to continue to execute the VoIP call.

[0182] Exemplarily, if the second switching request message carries the device identification of the target device (e.g., the device identification of the mobile phone 101), the VoIP server 104 may query whether the device identification sent by the device management server 103 contains the device identification of the mobile phone 101. If the device identification of the mobile phone 101 is contained, the VoIP server 104 may determine that the target device for executing the VoIP call is the mobile phone 101.

[0183] Alternatively, if the second switching request message does not carry the identifier of the target device, the VoIP server 104 may select one from the device identifiers sent by the device management server 103 as the device identifier of the target device for the subsequent VoIP call.

[0184] Alternatively, if the second switching request information does not carry the device identifier of the target device, the VoIP server 104 may send the device identifiers of the multiple electronic devices sent by the device management server 103 to the smart speaker 102 via the network 109. Figure 7 As shown, the smart speaker 102 may display a prompt box 701, in which options of target devices that can continue to execute the VoIP call under the first account are listed. In this way, the user can manually select in the prompt box 701 which electronic device to switch the VoIP call on the smart speaker 102 to execute. For example, when it is detected that the user has selected the mobile phone 101 in the prompt box 901, the smart speaker 102 may send the device identification of the mobile phone 101 to the VoIP server 104. In this way, the VoIP server 104 can determine that the target device for continuing to execute the VoIP call is the mobile phone 101.

[0185] The VoIP server 104 can pre-register the VoIP identifier of each electronic device in the VoIP service. The VoIP identifier can be a telephone number or IP address used when executing the VoIP service. Then, after the VoIP server 104 determines the mobile phone 101 as the target device to continue the VoIP call in place of the smart speaker 102, the VoIP identifier of the mobile phone 101 can be queried, for example, the phone number of the mobile phone 101 is 123456. Furthermore, the VoIP server 104 can add the mobile phone 101 to the VoIP call between the smart speaker 102 and the mobile phone 107 according to the phone number. At this time, the VoIP server 104 establishes a VoIP multi-party call between the mobile phone 101, the smart speaker 102 and the mobile phone 107. Then, the VoIP server 104 interrupts the VoIP service of the smart speaker 102. After the interruption, only the mobile phone 101 and the mobile phone 107 are conducting a VoIP call, that is, the VoIP call is switched to the mobile phone 101. At this time, mobile phone 101 and mobile phone 107 are conducting a VoIP call.

[0186] In the voice switching method provided in this embodiment, the source device of the VoIP service is the smart speaker 102, and the target device of the VoIP service is the mobile phone 101. The smart speaker 102 can identify the switching demand of the VoIP service in response to the trigger operation performed by the user. Furthermore, the smart speaker 102 can send a second switching request message to the VoIP server 104, so that the VoIP server 104 seamlessly switches the VoIP service executed on the smart speaker 102 under the same account to the mobile phone 101 for continued execution. There will be no interruption of the VoIP service during the switching process, and the user does not need to repeatedly operate between multiple devices, thereby improving the voice switching efficiency between multiple devices and the user experience.

[0187] In other application scenarios, after the user uses the same account to log in to the device management server 103 on the mobile phone 101 and the smart speaker 102, unlike the application scenarios involved in the above embodiments, the user can use the mobile phone 101 to conduct VoIP services with other electronic devices (such as mobile phone 107). Subsequently, if the user wants to switch the VoIP service from the mobile phone 101 to the smart speaker 102, the user can perform a preset input operation on the smart speaker 102 or the mobile phone 101 to trigger the VoIP server 104 to automatically switch the ongoing VoIP call on the mobile phone 101 to the smart speaker 102; or, the mobile phone 101 or the smart speaker 102 detects a specific condition and automatically switches the VoIP call to the smart speaker 102. The specific technical solutions in this application scenario are similar to the technical solutions involved in the above embodiments and will not be repeated here. It should be explained in detail that in this application scenario, the mobile phone 101 or the smart speaker 102 detects a specific condition that can be the following.

[0188] Exemplarily, the specific condition may be the current status information of the mobile phone 101. The mobile phone 101 may collect various environmental information, mobile phone posture information, etc. through one or more sensors 180. For example, when the mobile phone detects through the acceleration sensor 180E that the mobile phone is currently stationary for more than a preset time period, and the mobile phone has been connected to the same Wi-Fi network as the smart speaker 102, the mobile phone 101 may automatically send a switching request message to the VoIP server 104 based on the above-mentioned status information detected, so that the VoIP server 104 automatically switches the ongoing VoIP call on the mobile phone 101 to the smart speaker 102.

[0189] Exemplarily, the specific condition may also be a Bluetooth connection established between the mobile phone 101 and the smart speaker 102. For example, the user initially conducts a VoIP call with the mobile phone 107 on the mobile phone 101. When the user arrives home, the mobile phone 101 and the smart speaker 102 may automatically establish a Bluetooth connection. After the two devices establish a Bluetooth connection, the mobile phone 101 or the smart speaker 102 may automatically send a switching request message to the VoIP server 104 so that the VoIP server 104 automatically switches the ongoing VoIP call on the mobile phone 101 to the smart speaker 102.

[0190] In some other application scenarios, after the user logs in to the device management server 103 using the same account on the mobile phone 101 and the smart speaker 102, the user can use the smart speaker 102 to perform audio / video playback services. If the user wants to switch the audio playback service from the smart speaker 102 to the mobile phone 101, the user can perform a preset specific operation on the mobile phone 101 or the smart speaker 102 to trigger the content server 106 to switch the audio playback service on the smart speaker 102 to the mobile phone 101.

[0191] For example, Figure 8 As shown, this embodiment provides a voice switching method, including:

[0192] Step S801: The mobile phone 101 and the smart speaker 102 both use the same account (eg, the first account) to log in to the device management server 103.

[0193] Among them, the specific method for the mobile phone 101 and the smart speaker 102 to use the first account to log in to the device management server 103 can be found in the above-mentioned related embodiments, so it will not be repeated here.

[0194] Step S802: the smart speaker 102 receives a user's voice input, where the voice input is used to instruct the smart speaker 102 to play audio B;

[0195] Step S803: In response to the voice input, the smart speaker 102 determines the playback instruction of audio B.

[0196] Step S804: According to the above-mentioned playback instruction, the smart speaker 102 obtains the playback information from the content server 106 and plays audio B.

[0197] When the user wants to use the smart speaker 102 to play a certain audio B (for example, the song Silence), the user can say to the smart speaker 102 "I want to listen to the song Silence". Then, the smart speaker 102 recognizes the voice input as a voice command according to its configured voice assistant system, and the voice command is used to instruct to play the song Silence; then, the smart speaker 102 sends the request information for playing the audio to the content server 106 through the network 109. After receiving the above request information, the content server 106 provides the smart speaker 102 with the song Silence playback service. Then, the smart speaker 102 plays the song Silence from the playback information obtained from the content server 106, and the song can be played through one or more speaker arrays 370A of the smart speaker 102.

[0198] In other embodiments, after collecting the user's voice input, the smart speaker 102 may carry the voice input in the recognition request and send it to the voice assistant server 105 via the network 109. The voice assistant server 105 may use a voice recognition algorithm to perform voice recognition on the voice input and obtain a play instruction for the song Silence. The voice assistant server 105 sends the recognized play instruction to the content server 106, and the content server 106 provides the smart speaker 102 with the play service of the song Silence.

[0199] In other embodiments, in addition to triggering the smart speaker 102 to perform audio playback services by inputting voice, the user can also trigger the smart speaker 102 to obtain a playback instruction for a certain audio by other preset methods, and the embodiments of the present application do not impose any restrictions on this. For example, when it is detected that the user taps the smart speaker 102, it means that the user wants to continue playing the program that was last listened to (such as program C), then the smart speaker 102 can generate a playback instruction for program C and send it to the content server 106. For another example, if the smart speaker is provided with a touch screen, the user can select the audio to be played on the touch screen, thereby triggering the smart speaker 102 to generate a playback instruction for the audio and send it to the content server 106.

[0200] The content server 106 can be used to maintain resource information of audio content such as music and programs. After the voice assistant server 105 sends the identified audio playback instruction to the content server 106, the content server 106 can search for the resource information of audio B. Among them, the resource information can be the audio resource of audio B, or the playback address or download address of audio B. The content server 106 sends the resource information of audio B to the smart speaker 102, so that the smart speaker 102 plays audio B according to the resource information. Taking the resource information of audio B as the playback address of audio B as an example, the content server 106 can send the playback address of audio B to the smart speaker 102. In this way, the smart speaker 102 can obtain the audio resource of audio B according to the playback address, and then execute the audio playback service of audio B.

[0201] It is understandable that the content server 106 may store information such as the audio resource and the device identification of the device requesting to play the audio so as to facilitate subsequent further processing.

[0202] Step S805 : the mobile phone 101 sends a playback switching request to the content server 106 .

[0203] Step S806: In response to the above-mentioned playback switching request, the content server 106 determines that the source device playing audio B is the smart speaker 102.

[0204] Step S807: the content server 106 switches the audio playback service to the mobile phone 101 to continue.

[0205] In some embodiments, the play switching request may include a first account, and both the mobile phone 101 and the smart speaker 102 use the first account to log in to the device management server 103. In other embodiments, the play switching request may also include a device identifier of the mobile phone 101 and / or a device identifier of the smart speaker 102.

[0206] When the user wants to switch the audio B being played in the smart speaker 102 to the mobile phone 101 for continued playback, the user can input a preset specific operation on the mobile phone 101. In response to the specific operation, the mobile phone 101 can send a playback switching request to the content server 106, and the content server 106 determines the source device that is playing the audio B, that is, the smart speaker 102.

[0207] The content server 106 may send the first account to the device management server 103, and the device management server 103 may query which electronic devices are currently logged in to the first account. Furthermore, the content server 106 may determine the electronic device (such as the smart speaker 102) that is playing audio content B as the source device that plays audio content B.

[0208] Of course, if the first playback switching request carries a user-specified source device (such as smart speaker 102), and the smart speaker 102 is playing audio content B under account A (i.e., executing audio playback service), the content server 106 can determine that the source device playing audio B under the first account is the smart speaker 102.

[0209] After the content server 106 determines that the source device playing audio B is the smart speaker 102, in order to enable the mobile phone 101 to continue playing audio B from the current playback position when audio B is subsequently switched to the smart speaker 102, the content server 106 can query the playback progress of audio B on the smart speaker 102.

[0210] The content server 106 sends the resource information and the playing progress of the audio B to the mobile phone 101. The mobile phone 101 continues to play the audio B according to the resource information and the playing progress of the audio B.

[0211] After the content server 106 obtains the playback progress of the audio content B in the smart speaker 102, it can send the playback progress and resource information of the audio content B to the mobile phone 101. In this way, the mobile phone 101 can obtain the audio content B according to the resource information of the audio content B, and the mobile phone 101 can continue to play the audio content B from the current playback position of the smart speaker 102 according to the playback progress of the audio content B, so as to achieve seamless switching of the audio playback service between the smart speaker 102 and the mobile phone 101. After the mobile phone 101 receives the video B, the content server can automatically interrupt the audio playback service of playing the audio content B on the smart speaker 102.

[0212] In other embodiments, the mobile phone 101 may send a playback event of audio B to the content server 106 via the network 109 ; in response to the above playback event, the content server 106 interrupts the audio playback service of playing audio B on the smart speaker 102 .

[0213] When the mobile phone 101 starts playing audio B, the audio B originally played on the smart speaker 102 may not be automatically interrupted. Then, when the mobile phone 101 starts playing audio B, the mobile phone 101 can automatically send a play event of audio B to the content server 106. In this way, the content server 106 can stop the audio play service of the smart speaker 102 after receiving the play event. For example, in response to the play event reported by the mobile phone 101, the content server 106 can send a stop play instruction to the smart speaker 102, so that the smart speaker 102 stops playing audio B on the smart speaker 102 in response to the stop play instruction.

[0214] In other embodiments, it can be set that after the smart speaker 102 and the mobile phone 101 play audio B for a period of time at the same time, the smart speaker 102 stops playing audio B. For example, after the mobile phone 101 plays audio B for 3 seconds, the play event of audio B can be sent to the content server 106. Then, within 3 seconds when the mobile phone 101 just starts playing audio content B, the smart speaker 102 also plays audio B at the same time. In this way, even if some audio is missed due to transmission delay when the audio playback service is switched to the mobile phone 101, the user can also obtain the complete audio content in combination with the audio B played on the smart speaker 102, thereby improving the voice switching efficiency and user experience.

[0215] In the voice switching method provided in the above embodiment, the source device of the audio playback service is the smart speaker 102, and the target device of the audio playback service is the mobile phone 101. The mobile phone 101 can identify the switching demand of the audio playback service in response to the trigger operation performed by the user. Furthermore, the mobile phone 101 can send a first playback switching request to the content server 106, and the content server 106 seamlessly switches the audio playback service executed on the smart speaker 102 under the same account to the mobile phone 101 for continued execution. The audio playback service will not be interrupted during the switching process, and the user does not need to repeatedly operate between multiple devices, thereby improving the voice switching efficiency between multiple devices and the user experience.

[0216] In other application scenarios, after the user logs in to the device management server 103 using the same account on the mobile phone 101 and the smart speaker 102, the user can use the smart speaker 102 to perform the audio playback service. If the user wants to switch the audio playback service from the smart speaker 102 to the mobile phone 101, the user can also perform a preset specific operation on the smart speaker 102 to trigger the content server 106 to switch the audio playback service on the smart speaker 102 to the mobile phone 101. The specific operation can be a voice input from the user to the smart speaker 102, for example, the user says to the smart speaker 102 "switch the song Silence to the mobile phone to play". The way in which the smart speaker 102 processes the voice input can be referred to the relevant description in the above embodiment, which will not be repeated here.

[0217] In other application scenarios, when a user uses the mobile phone 101 to perform an audio playback service, if the user subsequently wishes to switch the audio playback service from the mobile phone 101 to the smart speaker 102, the user can make a preset input operation on the smart speaker 102 / or the mobile phone 101 to trigger the content server 106 to switch the audio playback service on the mobile phone 101 to the smart speaker 102. For the specific technical solution, please refer to the relevant description in the above embodiment, which will not be repeated here.

[0218] like Fig. 9As shown, this embodiment provides a voice switching system 900, which may include: a first electronic device 901 (eg Figure 1 The mobile phone 101 in the example), the second electronic device 902 (e.g. Figure 1 Smart speaker 102 in the device management server 903 (e.g. Figure 1 The device management server 103 in FIG. 100 ) and the VoIP server 904 (eg Figure 1 The system 900 can be used to implement the technical solutions of voice switching involved in the above-mentioned embodiments, which will not be described in detail here.

[0219] In some other embodiments, the system 900 may further include a voice assistant server 905 (e.g. Figure 1 The voice assistant server 105 in the example) and the content server 906 (e.g. Figure 1 The function of the voice assistant server 905 is the same as that of the voice assistant server 105 in the above embodiment, and the function of the content server 906 is the same as that of the content server 106 in the above embodiment.

[0220] Through the description of the above implementation methods, technicians in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above functional modules is used as an example. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. The specific working process of the system, device and unit described above can refer to the corresponding process in the aforementioned method embodiment, and will not be repeated here.

[0221] Each functional unit in each embodiment of the present application can be integrated into a processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The above integrated unit can be implemented in the form of hardware or in the form of software functional units.

[0222] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from a website site, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) mode to another website site, computer, server or data center. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that contains one or more available media integration. The available medium can be a magnetic medium, (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state hard disk), etc.

[0223] The above is only an example of the embodiment of the present application, but the protection scope of the embodiment of the present application is not limited thereto. Any changes or substitutions within the technical scope disclosed in the embodiment of the present application should be included in the protection scope of the embodiment of the present application. Therefore, the protection scope of the embodiment of the present application should be based on the protection scope of the claims.

Claims

1. A method for voice switching, characterized in that: include: The first electronic device and the second electronic device log in to the device management server using the first account; The first account is an account of an application or service; The second electronic device detects a user's voice input; In response to the voice input, the second electronic device establishes a VoIP call with a third electronic device through a VoIP server; The first electronic device sends a first switching request message to the VoIP server, wherein the first switching request message is used to request the VoIP server to switch the VoIP call being conducted on the second electronic device to the first electronic device; wherein the first switching request message includes a first account; The VoIP server receives the first switching request information; In response to the first switching request information, the VoIP server determines that the source device of the VoIP service corresponding to the first account is the second electronic device; The VoIP server switches the VoIP call being conducted on the second electronic device to the first electronic device.

2. The voice switching method according to claim 1, characterized in that: The method further comprises: The second electronic device detects a first operation of the user; In response to the first operation, the second electronic device sends a switching request message to the VoIP server, wherein the switching request message is used to request the VoIP server to switch the VoIP call being conducted on the first electronic device to the second electronic device; wherein the switching request message includes the first account; The VoIP server receives the switching request information; In response to the switching request information, the VoIP server determines that the source device of the VoIP service corresponding to the first account is the first electronic device; The VoIP server switches the VoIP call being conducted on the first electronic device to the second electronic device.

3. The voice switching method according to claim 1, characterized in that: The first electronic device sends first switching request information to the VoIP server, specifically including: When the first electronic device detects a specific operation of the user, the first electronic device sends the first switching request information to the VoIP server in response to the specific operation.

4. The voice switching method according to claim 3, characterized in that: The specific operation is one of the following operations: flipping the phone, tapping the screen with a knuckle, double-clicking the power button, a preset voice input, or a preset sliding gesture.

5. The voice switching method according to claim 1, characterized in that: The first electronic device sends first switching request information to the VoIP server, specifically including: When the first electronic device detects a specific condition, the first electronic device sends the first switching request information to the VoIP server in response to the specific condition.

6. The voice switching method according to claim 5, characterized in that: The specific condition is: Wi-Fi signal strength or Bluetooth signal strength in the WLAN network; wherein: When the first electronic device detects that the Wi-Fi signal strength is lower than a preset threshold, the first electronic device sends the first switching request information to the VoIP server; or, When the first electronic device detects that the Bluetooth signal strength of the second electronic device is lower than a preset threshold, the first electronic device sends the first switching request information to the VoIP server.

7. The voice switching method according to claim 1, characterized in that: The method further comprises: The first electronic device sends a response message to the VoIP server indicating successful joining of the VoIP call; After receiving the response message, the VoIP server interrupts the VoIP service on the second electronic device.

8. The voice switching method according to claim 1, characterized in that: The VoIP server determines that the source device of the VoIP service corresponding to the first account is the second electronic device, specifically including: The VoIP server sends the first account to the device management server; The device management server determines, according to the first account, at least one electronic device to be logged in using the first account; The device management server sends the device identification of the at least one electronic device to the VoIP server; The VoIP server determines, according to the device identifier, that the source device that is conducting a VoIP call under the first account is the second electronic device.

9. The voice switching method according to claim 8, characterized in that: The step of determining that the source device that is currently conducting a VoIP call under the first account is the second electronic device specifically includes: When the VoIP server determines, based on the device identifier, that there are at least two electronic devices as source devices that are conducting a VoIP call under the first account, the VoIP server sends the device identifiers of the at least two electronic devices to the first electronic device; At least two options are displayed on the first electronic device; the at least two options are used to represent the at least two electronic devices; The first electronic device detects a user's selection operation on one of the options; wherein the option represents the second electronic device; In response to the selection operation, the first electronic device sends the device identification of the second electronic device to the VoIP server; The VoIP server determines, based on the received device identification of the second electronic device, that the source device that is conducting the VoIP call under the first account is the second electronic device.

10. A voice switching system, characterized in that: The system includes a first electronic device, a second electronic device, a device management server and a VoIP server; wherein: The first electronic device and the second electronic device log in to the device management server using a first account; the first account is an account of an application or service; The second electronic device is used to establish a VoIP call with a third electronic device through the VoIP server when detecting a user's voice input; The first electronic device is used to send a first switching request message to the VoIP server, wherein the first switching request message is used to request the VoIP server to switch the VoIP call being conducted on the second electronic device to the first electronic device; wherein the first switching request message includes a first account; The VoIP server is used to receive the first switching request information, and determine that the source device of the VoIP service corresponding to the first account is the second electronic device; The VoIP server is further configured to switch the VoIP call being conducted on the second electronic device to the first electronic device.

11. The voice switching system according to claim 10, characterized in that: The second electronic device is further configured to send a switching request message to the VoIP server when detecting a first operation of the user, wherein the switching request message is used to request the VoIP server to switch the VoIP call being conducted on the first electronic device to the second electronic device; wherein the switching request message includes the first account; The VoIP server is further configured to receive the switching request information and determine that the source device of the VoIP service corresponding to the first account is the first electronic device; The VoIP server is further configured to switch the VoIP call being conducted on the first electronic device to the second electronic device.

12. The voice switching system according to claim 10, characterized in that: The first electronic device is also used for: When a specific operation of the user is detected, sending the first switching request information to the VoIP server; The specific operation is one of the following operations: flipping the phone, tapping the screen with a knuckle, double-clicking the power button, a preset voice input, or a preset sliding gesture.

13. The voice switching system according to claim 10, characterized in that: The first electronic device sends first switching request information to the VoIP server, specifically including: When the first electronic device detects a specific condition, the first electronic device sends the first switching request information to the VoIP server.

14. The voice switching system according to claim 13, characterized in that: The specific condition is: Wi-Fi signal strength or Bluetooth signal strength in the WLAN network; wherein: When the first electronic device detects that the Wi-Fi signal strength is lower than a preset threshold, the first electronic device sends the first switching request information to the VoIP server; or, When the first electronic device detects that the Bluetooth signal strength of the second electronic device is lower than a preset threshold, the first electronic device sends the first switching request information to the VoIP server.

15. The voice switching system according to claim 10, characterized in that: The first electronic device is further configured to send a response message to the VoIP server indicating successful joining of the VoIP call; and the VoIP server is further configured to interrupt the VoIP service on the second electronic device after receiving the response message.

16. The voice switching system according to claim 10, characterized in that: The VoIP server determines that the source device of the VoIP service corresponding to the first account is the second electronic device, specifically including: The VoIP server sends the first account to the device management server; The device management server determines, according to the first account, at least one electronic device to be logged in using the first account; The device management server sends the device identification of the at least one electronic device to the VoIP server; The VoIP server determines, according to the device identifier, that the source device that is conducting a VoIP call under the first account is the second electronic device.

17. The voice switching system according to claim 16, characterized in that: The VoIP server is further configured to send the device identifications of the at least two electronic devices to the first electronic device when it is determined according to the device identification that there are at least two electronic devices as source devices that are conducting a VoIP call under the first account; The first electronic device is further used to display at least two options; the at least two options are used to represent the at least two electronic devices; The first electronic device detects a user's selection operation on one of the options; wherein the option represents the second electronic device; The first electronic device is further used to send the device identification of the second electronic device to the VoIP server; The VoIP server is further configured to determine, based on the received device identification of the second electronic device, that the source device that is conducting the VoIP call under the first account is the second electronic device.

18. The voice switching system according to claim 10, characterized in that: The first electronic device is a mobile phone, and the second electronic device is a smart speaker equipped with a voice assistant system.

Citation Information

Patent Citations

  • Switching method, system and device for call between mobile terminal and soft terminal with same number

    CN101242663A

  • Method for controlling voice switching and mobile terminal

    CN105657767A

  • Method and device for interaction in call

    CN107852436A

  • Voice interaction method and device, electronic equipment and storage medium

    CN108257590A

  • Remote configuration of a Voice over Internet Protocol telephone for smart dial tone

    US20060285535A1