Voice interaction method, system and related device

Abstract

The invention discloses a voice interaction method, system and related device, the method is applied to a wearable device, and the wearable device comprises a signal transmitter; when a user wears the wearable device, the orientation of the signal transmitter is a first direction, the included angle between the first direction and a second direction is a first value, and the second direction is the face orientation of the user; the method comprises the following steps: detecting that a user wears a wearable device, and detecting a wake-up event; transmitting a first signal, wherein the direction of the first signal is a first direction; receiving first positioning data sent by the first electronic equipment; and sending a starting instruction to the first electronic equipment, wherein the starting instruction is used for indicating the first electronic equipment to start the voice interaction function. Thus, multiple electronic devices can be prevented from responding to the same voice instruction of the user at the same time, power consumption is saved, and better service is provided for the user.

Description

Technical Field

[0001] The present application relates to the field of communications, and in particular to a voice interaction method, system, and related devices. Background Art

[0002] With the continuous development of communication technology, more and more electronic devices have voice interaction functions, which can respond to user voice commands and perform operations indicated by the voice commands.

[0003] When multiple electronic devices with voice interaction functions are in the same scene, if a user issues a voice command, the multiple electronic devices may respond to the same voice command issued by the user and perform the operation indicated by the voice command.

[0004] This will result in unnecessary power consumption and affect the user's voice interaction experience. Summary of the Invention

[0005] The present application provides a voice interaction method, system and related devices, which enable the selection of an electronic device facing the user's face as the optimal response device when the user issues a voice command, and perform voice interaction with the user, thereby reducing power consumption and providing the user with a better voice interaction experience.

[0006] In a first aspect, the present application provides a voice interaction method, which is applied to a wearable device, the wearable device includes a signal transmitter; when a user wears the wearable device, the signal transmitter is oriented in a first direction, the angle between the first direction and the second direction is a first value, and the second direction is the direction of the user's face; the method includes: detecting that the user is wearing the wearable device and detecting a wake-up event; transmitting a first signal, the direction of the first signal is a first direction; receiving first positioning data sent by a first electronic device; and sending a startup instruction to the first electronic device, the startup instruction being used to instruct the first electronic device to turn on a voice interaction function.

[0007] In this way, when the user issues a voice command, the wearable device can send a first directional signal. The wearable device can use the first positioning data sent by the first electronic device in response to the first signal to determine that the first electronic device is within the reception range of the first signal, and then determine that the first electronic device will perform voice interaction with the user.

[0008] In one possible implementation, after transmitting the first signal, the method further includes: receiving second positioning data sent by the second electronic device; and sending a start instruction to the first electronic device, specifically including: when it is determined based on the first positioning data and the second positioning data that the angle between the first electronic device and the second direction is less than the angle between the second electronic device and the second direction, sending a start instruction to the first electronic device.

[0009] In this way, when the user issues a voice command, the wearable device can determine the electronic device with the smallest angle to the user's facial orientation as the optimal response device based on the positioning data sent by multiple electronic devices received, and use it for voice interaction with the user.

[0010] In one possible implementation, the first positioning data includes a first intensity, which is the intensity of the first signal received by the first electronic device; the second positioning data includes a second intensity, which is the intensity of the first signal received by the second electronic device; the first intensity is used to characterize the first angle between the first electronic device and the second direction, and the second intensity is used to characterize the second angle between the second electronic device and the second direction.

[0011] In this way, the angle between the electronic device and the user's facial orientation can be determined based on the strength of the first signal received by the electronic device. It should be noted that when the first value is 0°, the greater the first strength, the smaller the first angle. When the first value is 180°, the greater the first strength, the larger the first angle.

[0012] In a possible implementation, the first positioning data includes a first angle between the first electronic device and the second direction; and the second positioning data includes a second angle between the second electronic device and the second direction.

[0013] In this way, the electronic device can determine the angle between the electronic device and the user's facial orientation based on the received first signal, and send the angle to the wearable device.

[0014] In one possible implementation, the first positioning data also includes the first moment when the first electronic device receives the first signal, and the first moment is used to determine the first distance between the first electronic device and the user; the second positioning data also includes the second moment when the second electronic device receives the first signal, and the second moment is used to determine the second distance between the second electronic device and the user.

[0015] In this way, the wearable device can determine the distance between the electronic device and the wearable device (ie, the user) through the time when the first signal is received and the time when the first signal is sent.

[0016] In a possible implementation, the first positioning data further includes a first distance between the first electronic device and the user; and the second positioning data further includes a second distance between the second electronic device and the user.

[0017] In this way, the electronic device can calculate the distance between the electronic device and the user and send the distance to the wearable device.

[0018] In one possible implementation, determining, based on the first positioning data and the second positioning data, that the angle between the first electronic device and the second direction is smaller than the angle between the second electronic device and the second direction specifically includes: determining, based on the first positioning data and the second positioning data, that the first angle is smaller than the second angle, and the first distance is smaller than a third distance, where the third distance is a preset distance threshold.

[0019] In this way, the wearable device can determine the optimal response device based on the angle between the electronic device and the user's facial orientation and the distance between the electronic device and the user.

[0020] In a possible implementation, detecting a wake-up event specifically includes: collecting a first voice uttered by a user; and detecting that the first voice includes a wake-up word or a wake-up-free instruction.

[0021] In this way, the wearable device can collect the user's voice and determine whether a wake-up event occurs based on the user's voice.

[0022] In one possible implementation, detecting a wake-up event specifically includes: receiving a first wake-up notification sent by a first electronic device, where the first wake-up notification is used to notify the wearable device that the first electronic device has detected a user issuing a wake-up word or a wake-up-free instruction of the first electronic device.

[0023] In this way, the wearable device can determine whether a wake-up event occurs based on the wake-up notification sent by other electronic devices.

[0024] In one possible implementation, detecting a wake-up event further includes: receiving a second wake-up notification sent by a second electronic device, where the second wake-up notification is used to notify the wearable device that the second electronic device has detected a user issuing a wake-up word or a wake-up-free instruction for the second electronic device.

[0025] In this way, the wearable device can determine whether a wake-up event occurs based on whether it receives wake-up notifications sent by multiple (two or more) electronic devices.

[0026] In one possible implementation, the method also includes: turning on the signal transmitter before transmitting the first signal; turning off the signal transmitter when it is detected that the shutdown condition is met, the shutdown condition including any one or more of the following: sending a startup instruction to the first electronic device; detecting that the time period during which the user has not performed voice interaction reaches a first time period; receiving the user's operation to turn off the signal transmitter; receiving a startup success notification sent by the first electronic device, the startup success notification is used to notify the wearable device that the first electronic device has turned on the voice interaction function; receiving a shutdown instruction sent by the first electronic device, the shutdown instruction is used to instruct the wearable device to turn off the signal transmitter.

[0027] In this way, when there is no need to send the first signal, the wearable device can turn off the signal transmitter to save power consumption.

[0028] In a possible implementation, the first value is 0° or 180°.

[0029] It is understandable that the first value may also be other values, such as 5° or 15°.

[0030] In the second aspect, the present application provides a voice interaction system, including a wearable device, a first electronic device and a second electronic device; the wearable device includes a signal transmitter, when the user wears the wearable device, the direction of the signal transmitter is a first direction, the angle between the first direction and the second direction is a first value, and the second direction is the direction of the user's face; the wearable device is used to detect that the user is wearing the wearable device; the wearable device is also used to detect a wake-up event; the wearable device is also used to transmit a first signal when it detects that the user is wearing the wearable device and detects a wake-up event, and the direction of the first signal is the first direction; the first electronic device is used to receive the first signal; the first electronic device is also used to determine first positioning data based on the received first signal; the first electronic device is also used to turn on the voice interaction function when the second positioning data sent by the second electronic device is not received.

[0031] In a communication network composed of a wearable device, a first electronic device, and a second electronic device, the first electronic device is a master device, and the second electronic device is a slave device.

[0032] In this way, the first electronic device (ie, the main device) can determine that the first electronic device is the best response device when it does not receive positioning data sent by other electronic devices. The best response device is used to perform voice interaction with the user.

[0033] In one possible implementation, the first electronic device is also used to receive second positioning data sent by the second electronic device; the first electronic device is also used to, when it is determined based on the first positioning data and the second positioning data that the first angle is less than the second angle, enable the voice interaction function, the first angle is the angle between the first electronic device and the second direction, and the second angle is the angle between the second electronic device and the second direction; the second electronic device is used to receive the first signal; the second electronic device is also used to determine the second positioning data based on the received first signal; the second electronic device is also used to send the second positioning data to the first electronic device.

[0034] In this way, when the first electronic device receives positioning data sent by other electronic devices, it can determine the device with the smallest angle with the user's face as the optimal response device based on the multiple positioning data, and the optimal response device is used for voice interaction with the user.

[0035] In one possible implementation, the first electronic device is further used to, when it is determined based on the first positioning data and the second positioning data that the first angle is greater than or equal to the second angle, send a start instruction to the second electronic device, the start instruction being used to instruct the second electronic device to turn on the voice interaction function; the second electronic device is further used to receive and respond to the start instruction sent by the first electronic device to turn on the voice interaction function.

[0036] In this way, when the first electronic device receives positioning data sent by other electronic devices, it can determine the device with the smallest angle with the user's face as the optimal response device based on the multiple positioning data, and the optimal response device is used for voice interaction with the user.

[0037] In one possible implementation, the first positioning data includes a first intensity, which is the intensity of the first signal received by the first electronic device; the second positioning data includes a second intensity, which is the intensity of the first signal received by the second electronic device; the first intensity is used to characterize the first angle between the first electronic device and the second direction, and the second intensity is used to characterize the second angle between the second electronic device and the second direction.

[0038] In this way, the angle between the electronic device and the user's facial orientation can be determined based on the strength of the first signal received by the electronic device. It should be noted that when the first value is 0°, the greater the first strength, the smaller the first angle. When the first value is 180°, the greater the first strength, the larger the first angle.

[0039] In a possible implementation, the first positioning data includes a first angle between the first electronic device and the second direction; and the second positioning data includes a second angle between the second electronic device and the second direction.

[0040] In this way, the electronic device can determine the angle between the electronic device and the user's facial orientation based on the received first signal, and send the angle to the main device (ie, the first electronic device).

[0041] In one possible implementation, the first positioning data also includes the first moment when the first electronic device receives the first signal, and the first moment is used to determine the first distance between the first electronic device and the user; the second positioning data also includes the second moment when the second electronic device receives the first signal, and the second moment is used to determine the second distance between the second electronic device and the user.

[0042] In a possible implementation, the first signal carries the sending time of the first signal.

[0043] In this way, the first electronic device can determine the distance between the electronic device and the wearable device (ie, the user) through the time when the first signal is received and the time when the first signal is sent.

[0044] In a possible implementation, the first positioning data further includes a first distance between the first electronic device and the user; and the second positioning data further includes a second distance between the second electronic device and the user.

[0045] In this way, the electronic device can calculate the distance between the electronic device and the user, and send the distance to the first electronic device.

[0046] In one possible implementation, determining, based on the first positioning data and the second positioning data, that the angle between the first electronic device and the second direction is smaller than the angle between the second electronic device and the second direction specifically includes: determining, based on the first positioning data and the second positioning data, that the first angle is smaller than the second angle, and the first distance is smaller than a third distance, where the third distance is a preset distance threshold.

[0047] In this way, the first electronic device can determine the optimal response device based on the angle between the electronic device and the user's facial orientation and the distance between the electronic device and the user.

[0048] In a possible implementation, detecting a wake-up event specifically includes: collecting a first voice uttered by a user; and detecting that the first voice includes a wake-up word or a wake-up-free instruction.

[0049] In this way, the wearable device can collect the user's voice and determine whether a wake-up event occurs based on the user's voice.

[0050] In one possible implementation, detecting a wake-up event specifically includes: receiving a first wake-up notification sent by a first electronic device, where the first wake-up notification is used to notify the wearable device that the first electronic device has detected a user issuing a wake-up word or a wake-up-free instruction of the first electronic device.

[0051] In this way, the wearable device can determine whether a wake-up event occurs based on the wake-up notification sent by other electronic devices.

[0052] In one possible implementation, detecting a wake-up event further includes: receiving a second wake-up notification sent by a second electronic device, where the second wake-up notification is used to notify the wearable device that the second electronic device has detected a user issuing a wake-up word or a wake-up-free instruction for the second electronic device.

[0053] In this way, the wearable device can determine whether a wake-up event occurs based on whether it receives wake-up notifications sent by multiple (two or more) electronic devices.

[0054] In one possible implementation, the wearable device is further used to turn on the signal transmitter before transmitting the first signal; the wearable device is further used to turn off the signal transmitter when it is detected that a shutdown condition is met, and the shutdown condition includes any one or more of the following: sending a startup instruction to the first electronic device; detecting that the time period during which the user has not performed voice interaction reaches a first time period; receiving an operation by the user to turn off the signal transmitter; receiving a startup success notification sent by the first electronic device, the startup success notification is used to notify the wearable device that the first electronic device has turned on the voice interaction function; receiving a shutdown instruction sent by the first electronic device, the shutdown instruction is used to instruct the wearable device to turn off the signal transmitter.

[0055] In this way, when there is no need to send the first signal, the wearable device can turn off the signal transmitter to save power consumption.

[0056] In a possible implementation, the first value is 0° or 180°.

[0057] It is understandable that the first value may also be other values, such as 5° or 15°.

[0058] In a third aspect, the present application provides another voice interaction system, including a wearable device, a first electronic device and a second electronic device; the wearable device includes a signal transmitter, and when the user wears the wearable device, the direction of the signal transmitter is a first direction, the angle between the first direction and the second direction is a first value, and the second direction is the direction of the user's face; the wearable device is used to detect that the user is wearing the wearable device; the wearable device is also used to detect a wake-up event; the wearable device is also used to transmit a first signal when it detects that the user is wearing the wearable device and detects a wake-up event, and the direction of the first signal is a first direction; the wearable device is also used to receive first positioning data sent by the first electronic device; the wearable device is also used to send a startup instruction to the first electronic device, and the startup instruction is used to instruct the first electronic device to turn on the voice interaction function; the first electronic device is used to receive the first signal; the first electronic device is also used to determine the first positioning data based on the received first signal; the first electronic device is also used to send the first positioning data to the wearable device.

[0059] The beneficial effects of any possible implementation method in the third aspect can refer to the beneficial effects of the corresponding implementation method in the above-mentioned first aspect, and will not be repeated here.

[0060] In one possible implementation, the second electronic device is used to receive the first signal; the second electronic device is also used to determine the second positioning data based on the received first signal; the second electronic device is also used to send the first positioning data to the wearable device; the wearable device is also used to receive the second positioning data sent by the second electronic device; the wearable device is also used to send a startup instruction to the first electronic device, specifically including: the wearable device is also used to send a startup instruction to the first electronic device when it is determined based on the first positioning data and the second positioning data that the first angle is less than the second angle, the first angle is the angle between the first electronic device and the second direction, and the second angle is the angle between the second electronic device and the second direction.

[0061] In one possible implementation, the first positioning data includes a first intensity, which is the intensity of the first signal received by the first electronic device; the second positioning data includes a second intensity, which is the intensity of the first signal received by the second electronic device; the first intensity is used to characterize the first angle between the first electronic device and the second direction, and the second intensity is used to characterize the second angle between the second electronic device and the second direction.

[0062] In a possible implementation, the first positioning data includes a first angle between the first electronic device and the second direction; and the second positioning data includes a second angle between the second electronic device and the second direction.

[0063] In one possible implementation, the first positioning data also includes the first moment when the first electronic device receives the first signal, and the first moment is used to determine the first distance between the first electronic device and the user; the second positioning data also includes the second moment when the second electronic device receives the first signal, and the second moment is used to determine the second distance between the second electronic device and the user.

[0064] In a possible implementation, the first signal carries the sending time of the first signal.

[0065] In a possible implementation, the first positioning data further includes a first distance between the first electronic device and the user; and the second positioning data further includes a second distance between the second electronic device and the user.

[0066] In one possible implementation, determining, based on the first positioning data and the second positioning data, that the angle between the first electronic device and the second direction is smaller than the angle between the second electronic device and the second direction specifically includes: determining, based on the first positioning data and the second positioning data, that the first angle is smaller than the second angle, and the first distance is smaller than a third distance, where the third distance is a preset distance threshold.

[0067] In a possible implementation, detecting a wake-up event specifically includes: collecting a first voice uttered by a user; and detecting that the first voice includes a wake-up word or a wake-up-free instruction.

[0068] In one possible implementation, detecting a wake-up event specifically includes: receiving a first wake-up notification sent by a first electronic device, where the first wake-up notification is used to notify the wearable device that the first electronic device has detected a user issuing a wake-up word or a wake-up-free instruction of the first electronic device.

[0069] In one possible implementation, detecting a wake-up event further includes: receiving a second wake-up notification sent by a second electronic device, where the second wake-up notification is used to notify the wearable device that the second electronic device has detected a user issuing a wake-up word or a wake-up-free instruction for the second electronic device.

[0070] In one possible implementation, the wearable device is further used to turn on the signal transmitter before transmitting the first signal; the wearable device is further used to turn off the signal transmitter when it is detected that a shutdown condition is met, and the shutdown condition includes any one or more of the following: sending a startup instruction to the first electronic device; detecting that the time period during which the user has not performed voice interaction reaches a first time period; receiving an operation by the user to turn off the signal transmitter; receiving a startup success notification sent by the first electronic device, the startup success notification is used to notify the wearable device that the first electronic device has turned on the voice interaction function; receiving a shutdown instruction sent by the first electronic device, the shutdown instruction is used to instruct the wearable device to turn off the signal transmitter.

[0071] In a possible implementation, the first value is 0° or 180°.

[0072] It is understandable that the first value may also be other values, such as 5° or 15°.

[0073] In a fourth aspect, the present application provides a wearable device comprising one or more processors, one or more memories, and a signal transmitter. The one or more memories are coupled to the one or more processors, and the one or more memories are used to store computer program code, the computer program code comprising computer instructions, and when the one or more processors execute the computer instructions, the wearable device performs the voice interaction method in any possible implementation of any of the above aspects.

[0074] In a fifth aspect, the present application provides an electronic device, which is a first electronic device, comprising one or more processors and one or more memories. The one or more memories are coupled to the one or more processors, and the one or more memories are used to store computer program code, the computer program code comprising computer instructions. When the one or more processors execute the computer instructions, the first electronic device performs the voice interaction method in any possible implementation of any of the above aspects.

[0075] In a sixth aspect, an embodiment of the present application provides a readable storage medium, comprising instructions, which, when executed on a wearable device, enables the wearable device to execute the voice interaction method in any possible implementation of any of the above aspects.

[0076] In the seventh aspect, an embodiment of the present application provides a readable storage medium, including instructions, which, when executed on a first electronic device, enable the first electronic device to execute the voice interaction method in any possible implementation of any of the above aspects.

[0077] In an eighth aspect, an embodiment of the present application provides a computer program product, which, when running on a wearable device, enables the wearable device to execute the voice interaction method in any possible implementation of any of the above aspects.

[0078] In a ninth aspect, an embodiment of the present application provides a computer program product, which, when running on a first electronic device, enables the first electronic device to execute the voice interaction method in any possible implementation of any of the above aspects.

[0079] The beneficial effects of the fourth to ninth aspects can refer to the beneficial effects of the first to third aspects mentioned above. BRIEF DESCRIPTION OF THE DRAWINGS

[0080] Figure 1 A schematic diagram of a smart home scenario provided in an embodiment of the present application;

[0081] Figure 2A A schematic diagram of the system architecture of a voice interaction system 10 provided in an embodiment of the present application;

[0082] Figure 2B-2C Schematic diagrams of the device forms of two wearable devices 100 provided in the embodiments of the present application;

[0083] Figure 3A A schematic diagram of the hardware structure of a wearable device 100 provided in an embodiment of the present application;

[0084] Figure 3B A schematic diagram of the hardware structure of an electronic device 200 provided in an embodiment of the present application;

[0085] Figure 4 A flowchart of a voice interaction method provided in an embodiment of the present application;

[0086] Figure 5 A schematic diagram of a process for determining an optimal response device based on the offset between an electronic device and a user's facial orientation and the distance between the electronic device and the user, provided in an embodiment of the present application;

[0087] Figure 6A flowchart of another voice interaction method provided in an embodiment of the present application;

[0088] Figure 7 A schematic diagram of the functional modules of a voice interaction system 10 provided in an embodiment of the present application;

[0089] Figure 8A A schematic diagram of a physical device of a wearable device 100 provided in an embodiment of the present application;

[0090] Figure 8B A schematic diagram of a physical device of an electronic device 200 provided in an embodiment of the present application;

[0091] Figure 9 A flowchart of a voice interaction method provided in an embodiment of the present application;

[0092] Figure 10 A flowchart of another voice interaction method provided in an embodiment of the present application. DETAILED DESCRIPTION

[0093] The following is a clear and detailed description of the technical solutions in the embodiments of the present application in conjunction with the accompanying drawings. In the description of the embodiments of the present application, unless otherwise specified, " / " means or, for example, A / B can mean A or B; "and / or" in the text is only a description of the association relationship between related objects, indicating that there can be three relationships, for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, in the description of the embodiments of the present application, "multiple" means two or more than two.

[0094] In the following, the terms "first" and "second" are used for descriptive purposes only and should not be understood to imply or suggest relative importance or implicitly indicate the number of the technical features indicated. Therefore, the features defined as "first" and "second" may explicitly or implicitly include one or more of the features. In the description of the embodiments of this application, unless otherwise specified, "plurality" means two or more.

[0095] The term "user interface (UI)" in the following embodiments of this application refers to a medium interface for interaction and information exchange between an application or operating system and a user, which realizes the conversion between the internal form of information and the form acceptable to the user. The user interface is a source code written in a specific computer language such as Java and extensible markup language (XML). The interface source code is parsed and rendered on an electronic device and finally presented as content that the user can recognize. The commonly used form of user interface is graphical user interface (GUI), which refers to a user interface related to computer operations that is displayed in a graphical manner. It can be a visual interface element such as text, icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, widgets, etc. displayed on the display screen of an electronic device.

[0096] The following introduces some nouns involved in this application.

[0097] Local Area Network (LAN): A LAN is a communication network that connects multiple electronic devices within a specific area. A LAN is a closed network consisting of two or more electronic devices. Through dedicated data lines, a LAN can connect to other LANs or databases elsewhere, forming a larger information processing system.

[0098] Internet of Things (IoT): The Internet of Things (IoT) refers to the connection of any object to a network using information sensing devices, such as radio frequency identification devices, infrared sensors, global positioning systems, and laser scanners, according to agreed protocols. Objects exchange and communicate information through information transmission media to achieve intelligent identification, positioning, tracking, and monitoring functions. Devices in the IoT are referred to as IoT devices.

[0099] Wake-up word: A wake-up word is a pre-set word used to trigger the electronic device to turn on (also called wake up) the voice assistant function (hereinafter referred to as voice assistant). Electronic devices with voice assistants can be set with one or more wake-up words. When the electronic device detects that the user says the preset wake-up word, the electronic device can turn on the voice assistant and start voice interaction with the user. In this way, it is possible to better distinguish between the user's daily chat scenes and voice interaction scenes, and it can also avoid the power consumption caused by the long-term activation of the voice assistant.

[0100] Wake-up-free instruction: The wake-up-free instruction is a pre-set voice instruction that can trigger the electronic device to perform a preset operation. When the electronic device detects that the voice spoken by the user includes a wake-up-free instruction, the electronic device can turn on the voice assistant and perform the operation corresponding to the wake-up-free instruction (such as turning on the device, playing audio, etc.). It should be noted that the difference between the wake-up-free instruction and the wake-up word is that the wake-up word is only used to turn on the voice assistant. After turning on the voice assistant, the electronic device needs to determine the operation to be performed based on the voice instruction spoken by the user later; while the wake-up-free instruction can trigger the electronic device to turn on the voice assistant and perform the specified operation when the voice assistant is not turned on, and after the electronic device performs the operation corresponding to the wake-up-free instruction, the electronic device usually turns off the voice assistant.

[0101] Ultra-Wideband (UWB) technology is a wireless carrier communication technology that uses nanosecond-scale, non-sinusoidal narrow pulses to transmit data rather than a sinusoidal carrier wave. Therefore, it occupies a very wide spectrum. UWB technology offers advantages such as low system complexity, low transmitted signal power spectral density, insensitivity to channel fading, low interception capability, and high positioning accuracy. It is particularly suitable for high-speed wireless access in dense multipath environments, such as indoor locations.

[0102] Figure 1 A schematic diagram of voice interaction between a user and multiple electronic devices in a smart home scenario is shown.

[0103] like Figure 1 As shown, a smart home scene may include multiple electronic devices, such as a smart TV A and a smart speaker B. A communication network may be established between the multiple electronic devices, and the multiple electronic devices all have a voice interaction function.

[0104] When a user issues a voice command that includes a wake-up word, both Smart TV A and Smart Speaker B receive the user's voice command. Both Smart TV A and Smart Speaker B may respond to the user's voice command and execute the corresponding operation. Furthermore, if a user issues multiple voice commands consecutively, each command may be executed by either Smart TV A or Smart Speaker B. This increases system power consumption and affects the user's voice interaction experience.

[0105] The following introduces the system architecture of a voice interaction system 10 provided in an embodiment of the present application.

[0106] like Figure 2AAs shown, the voice interaction system 10 may include a wearable device 100, an electronic device 200, and an electronic device 300. The wearable device 100, the electronic device 200, and the electronic device 300 may form a communication network C. In this communication network C, the electronic device 200 may communicate with the wearable device 100, and the electronic device 300 may also communicate with the wearable device 100. In some embodiments, the electronic devices 200, 300, etc. may also be considered IoT devices.

[0107] In some embodiments, a communication connection can be established between any two of the wearable device 100, the electronic device 200, and the electronic device 300, and based on the above multiple communication connections, the wearable device 100, the electronic device 200, and the electronic device 300 can form a communication network C. In other embodiments, the wearable device 100, the electronic device 200, and the electronic device 300 can also form a communication network based on communication connections different from those in the above embodiments, and this application is not limited thereto.

[0108] In some embodiments, in the voice interaction system 10, the communication network C formed by the wearable device 100, the electronic device 200, and the electronic device 300 can be a local area network. In other embodiments, the devices in the voice interaction system 10 can also use Bluetooth technology, near field communication technology (NFC), infrared technology (IR) and other wireless communication technologies to form the communication network C, which is not limited in this application.

[0109] In the voice interaction system 10, the wearable device 100 can be Figure 2A Smart glasses shown. In some embodiments, when the user wears the wearable device 100, the wearable device 100 can transmit a positioning signal through a signal transmitting device (also referred to as a signal transmitter), and the positioning signal has directionality. For example, when the wearable device 100 is a head-mounted device, such as augmented reality glasses, virtual reality glasses, smart glasses, etc., the direction in which the signal transmitting device transmits the positioning signal can be directly in front of the head-mounted device. When the user wears the wearable device 100, the wearing method of the wearable device 100 has a fixed positional relationship with the user's facial orientation (for example, the user's facial orientation is the same as the orientation of the head-mounted device, or the angle between the user's facial orientation and the orientation of the head-mounted device is 10 degrees). After the user wears the wearable device 100 correctly, the user's facial orientation is the same as the orientation of the head-mounted device, and the direction of the positioning signal can be the user's facial orientation. It should be understood that the user's facial orientation is the same as the orientation of the head-mounted device, which can also include the user's facial orientation and the orientation of the head-mounted device being approximately the same, for example, the angle between the user's facial orientation and the orientation of the head-mounted device is within an allowable error range, such as 5 degrees.

[0110] In some embodiments, after the user wears the wearable device 100, the wearable device 100 can obtain the user's facial orientation and the angle of the wearable device orientation, or detect whether the user is correctly wearing the wearable device 100. For example, when the wearable device 100 is a head-mounted device, the head-mounted device can measure the distance from the head-mounted device to the user's left and right eyes and the user's pupil distance, and calculate the user's facial orientation and the angle of the head-mounted device orientation based on the pupil distance and the distance from the head-mounted device to the user's left and right eyes.

[0111] Electronic devices 200 and 300 have a voice interaction function. When electronic device 200 (or electronic device 300) receives and responds to a voice command (or a wake-up-free command) issued by a user that includes a wake-up word, it turns on the voice interaction function and performs voice interaction with the user.

[0112] When the electronic device 200 (or electronic device 300) receives a voice command 1 issued by the user and determines that the voice command 1 includes a wake-up word or the voice command 1 is a wake-up-free command, the electronic device 200 (or electronic device 300) can report the wake-up event to the wearable device 100 through the above-mentioned communication network C.

[0113] In some embodiments, when the wearable device 100 is worn by the user, the wearable device 100 can transmit a positioning signal, such as an ultrasonic signal, after receiving a wake-up event. The positioning signal can point to the user's current facial orientation or to other directions, and the angle between the pointing direction and the user's current facial orientation is a fixed value (for example, 5°, 180°, etc.).

[0114] The electronic device 200 may receive the positioning signal, and the electronic device 200 may determine the positioning data of the electronic device 200 based on the received positioning signal. The electronic device 200 may send the positioning data 1 to the wearable device 100 via the communication network C.

[0115] Similarly, electronic device 300 can receive a positioning signal. It should be noted that when the offset of electronic device 200 relative to the user's facial orientation is different from the offset of electronic device 300 relative to the user's facial orientation, the signal strength of the positioning signal received by electronic device 200 is different from the signal strength of the positioning signal received by electronic device 300. Electronic device 300 can determine positioning data 2 of electronic device 300 based on the received positioning signal. Electronic device 300 can send positioning data 2 to wearable device 100 via communication network C.

[0116] The wearable device 100 can determine the best response device based on the positioning data 1 sent by the electronic device 200 and the positioning data 2 sent by the electronic device 300. The best response device is the electronic device that responds to the voice instruction 1. If the wearable device 100 determines that the electronic device 200 is the best response device, the wearable device 100 can send a startup instruction to the electronic device 200. The startup instruction is used to notify the electronic device 200 that it is the best response device. After receiving the startup instruction, the electronic device 200 can respond to the user's voice instruction 1, turn on the voice interaction function, and perform voice interaction with the user. It can be understood that the embodiment here is only an example to illustrate that the electronic device 200 can be the best response device. In some embodiments, the electronic device 300 can also be the best response device. This application does not limit this.

[0117] It is understandable that Figure 2A The embodiment shown is only an example. In the embodiment of the present application, the wearable device 100 may be Figure 2A The smart glasses shown in the figure may also be a wearable device such as headphones, which has a fixed position relationship with the user's face. This application does not limit the specific type of wearable device. In addition, in this embodiment of the application, the voice interaction system 10 may also include a Figure 2A The illustrated embodiments may include more, fewer, or different electronic devices than the above-described embodiments, and this application does not limit this.

[0118] The following describes two types of wearable devices 100 and the directions of the transmitted positioning signals.

[0119] Figure 2B A schematic diagram of the device form of a wearable device 100 provided in an embodiment of the present application is shown.

[0120] like Figure 2B As shown, the wearable device 100 can be Figure 2B The smart glasses 20 shown in FIG. 2 may include glasses lenses 21 , glasses frames 22 and a signal transmitter 23 .

[0121] The plane on which the lenses of the smart glasses 20 lie can be referred to as plane G. The multiple normals of plane G can include normal h and normal k. Normal h and normal k both have directions, and the direction of normal h is opposite to the direction of normal k. Normal k points inwardly of the smart glasses 20, while normal h points outwardly of the smart glasses 20. When a user wears the smart glasses 20, the user's face is positioned inwardly of the smart glasses 20. Therefore, when the user wears the smart glasses 20, the user's facial orientation is the same as the direction of normal h.

[0122] The signal transmitter 23 can be used to transmit a positioning signal. The positioning signal transmitted by the signal transmitter 23 can be directed in the direction of the normal h. The signal transmitter 23 can be located on the eyeglass frame 22, for example, on both sides of the eyeglass lens 21, or elsewhere on the eyeglass frame 22. The specific location of the signal transmitter 23 is not limited in this application.

[0123] Figure 2C A schematic diagram of the device form of another wearable device 100 provided in an embodiment of the present application is shown.

[0124] like Figure 2C As shown, the wearable device 100 can be Figure 2C The headset 30 shown in FIG. The headset 30 may include a headset front end 31 and a signal transmitter 32. The signal transmitter 32 may be used to transmit positioning signals. When a user wears the headset 30, the headset front end 31 may contact the ear or be inserted into the ear canal, and the headset front end may emit sound signals and transmit the sound signals to the user's ear.

[0125] When a user is wearing headphones 30, the plane in which the user resides can be referred to as plane G. The multiple normals of plane G can include normal h and normal k. Normal h and normal k both have directions, and the direction of normal h is opposite to the direction of normal k. The user's facial orientation is the same as the direction of normal h. The positioning signal emitted by headphones 30 can be directed in the direction of normal h.

[0126] It is understandable that Figure 2B-2C These are just two examples. In the embodiments of the present application, the wearable device 100 may also be a device of a different type or form than the above embodiments, and the present application does not limit this.

[0127] It should be noted that in the embodiments of the present application, when a user wears the wearable device 100, the angle between the wearable device 100 (the signal transmitter on the wearable device 100 for transmitting positioning signals) and the user's facial orientation is fixed. That is, the wearable device 100 can be a head-mounted device, such as the smart glasses 20 or headphones 30 in the above embodiments. The wearable device 100 can also be a device worn on the user's chest or back, and during wear, the angle between the signal transmitter of the wearable device 100 and the user's facial orientation remains unchanged, such as a brooch-type microphone. This application does not limit the specific device form or wearing location of the wearable device 100.

[0128] The following describes the hardware structure of a wearable device 100 provided in an embodiment of the present application.

[0129] Figure 3A A hardware structure diagram of a wearable device 100 provided in an embodiment of the present application is shown.

[0130] The wearable device 100 can be a wearable device such as smart glasses, headphones, augmented reality (AR) devices, virtual reality (VR) devices, etc. The embodiment of the present application does not impose any special restrictions on the specific type of the electronic device.

[0131] The wearable device 100 may include a processor 110, an internal memory 121, a charging management module 140, a power management module 141, a battery 142, a wireless communication module 160, etc. Optionally, the wearable device 100 may further include any one or more of the following: a universal serial bus (USB) interface 130, an audio module 170, a sensor module 180, a button 190, a motor 191, an indicator 192, etc. Among them, the sensor module 180 may include one or more of the following: a gyroscope sensor 180B, an acceleration sensor 180E, a touch sensor 180K, an air pressure sensor, a magnetic sensor, a distance sensor, a proximity light sensor, a fingerprint sensor, a temperature sensor, an ambient light sensor, a bone conduction sensor, etc.

[0132] It should be understood that the structure illustrated in the embodiments of the present invention does not constitute a specific limitation on the wearable device 100. In other embodiments of the present application, the wearable device 100 may include more or fewer components than shown, or may combine or separate certain components, or arrange the components differently. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0133] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). The different processing units may be independent devices or integrated into one or more processors.

[0134] The controller can generate operation control signals according to the instruction operation code and timing signal to complete the control of instruction fetching and execution.

[0135] Processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in processor 110 is a cache memory. This memory can store instructions or data that have just been used or are being recycled by processor 110. If processor 110 needs to use the same instruction or data again, it can directly access the memory. This avoids duplicate accesses, reduces processor 110 latency, and thus improves system efficiency.

[0136] In some embodiments, the processor 110 may include one or more interfaces. The interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface.

[0137] The USB interface 130 is an interface that complies with USB standards and may be a Mini USB interface, a Micro USB interface, a USB Type-C interface, or the like. The USB interface 130 can be used to connect a charger to charge the wearable device 100 and to transfer data between the wearable device 100 and peripheral devices. This interface can also be used to connect to other electronic devices, such as AR devices.

[0138] The charging management module 140 is configured to receive charging input from a charger. The charger can be either a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 can receive charging input from the wired charger via the USB interface 130. In some wireless charging embodiments, the charging management module 140 can receive wireless charging input via the wireless charging coil of the wearable device 100. While charging the battery 142, the charging management module 140 can also power the electronic device through the power management module 141.

[0139] The power management module 141 is used to connect the battery 142, the charging management module 140, and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140 and provides power to the processor 110, the internal memory 121, the wireless communication module 160, and the like. The power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle count, and battery health status (leakage, impedance). In some other embodiments, the power management module 141 can also be provided in the processor 110. In other embodiments, the power management module 141 and the charging management module 140 can also be provided in the same device.

[0140] The wireless communication module 160 can provide wireless communication solutions for the wearable device 100, including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared technology (IR), etc. The wireless communication module 160 can be one or more devices that integrate at least one communication processing module.

[0141] The internal memory 121 may include one or more random access memories (RAM) and one or more non-volatile memories (NVM).

[0142] The random access memory can be directly read and written by the processor 110, and can be used to store executable programs (such as machine instructions) of the operating system or other running programs, and can also be used to store user and application data.

[0143] The non-volatile memory may also store executable programs and user and application data, etc., and may be loaded into the random access memory in advance for direct reading and writing by the processor 110 .

[0144] The audio module 170 may include any one or more of the following: a speaker 170A, a receiver 170B, a microphone 170C, etc. In some embodiments, the wearable device 100 may implement audio functions such as music playback and recording through the audio module 170 and an application processor.

[0145] The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The audio module 170 can also be used to encode and decode audio signals. In some embodiments, the audio module 170 can be provided in the processor 110, or some functional modules of the audio module 170 can be provided in the processor 110.

[0146] The speaker 170A, also called a "speaker," is used to convert audio electrical signals into sound signals. The wearable device 100 can listen to music or make hands-free calls through the speaker 170A.

[0147] The receiver 170B, also called the "earpiece", is used to convert audio electrical signals into sound signals. When the wearable device 100 receives a call or voice message, the user can hear the voice by placing the receiver 170B close to the ear.

[0148] Microphone 170C, also known as "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a call or sending a voice message, the user can speak by putting their mouth close to the microphone 170C to input the sound signal into the microphone 170C. The wearable device 100 can be provided with at least one microphone 170C. In other embodiments, the wearable device 100 can be provided with two microphones 170C, which can not only collect sound signals but also realize noise reduction function. In other embodiments, the wearable device 100 can also be provided with three, four or more microphones 170C to collect sound signals, reduce noise, identify the source of sound, realize directional recording function, etc.

[0149] The gyro sensor 180B can be used to determine the motion posture of the wearable device 100. In some embodiments, the angular velocity of the wearable device 100 around three axes (ie, x, y, and z axes) can be determined by the gyro sensor 180B.

[0150] Accelerometer 180E detects the magnitude of acceleration of the wearable device 100 in all directions (generally three axes). It can also detect the magnitude and direction of gravity when the wearable device 100 is stationary. It can also be used to identify the electronic device's posture, enabling applications such as switching between landscape and portrait modes and pedometers.

[0151] In some embodiments, the sensor module 180 may further include a bone conduction sensor, which may collect voices emitted by the user.

[0152] The touch sensor 180K, also known as a "touch control device," is used to detect touch operations applied to or near the touch sensor. The touch sensor can transmit the detected touch operations to the application processor to determine the type of touch event. In other embodiments, the touch sensor 180K can also be provided on the surface of the wearable device 100.

[0153] The buttons 190 include a power button, a volume button, and the like. The buttons 190 may be mechanical buttons or touch buttons. The wearable device 100 may receive key inputs and generate key signal inputs related to user settings and function control of the wearable device 100.

[0154] Motor 191 can generate vibration prompts. Motor 191 can be used for incoming call vibration prompts, as well as for touch vibration feedback. For example, touch operations on different applications (such as taking pictures, audio playback, etc.) can correspond to different vibration feedback effects. Different application scenarios (such as time reminders, receiving messages, alarm clocks, games, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also support customization.

[0155] The indicator 192 may be an indicator light, which may be used to indicate the charging status, power level changes, messages, missed calls, notifications, etc.

[0156] Figure 3B A schematic diagram of the hardware structure of an electronic device 200 provided in an embodiment of the present application.

[0157] Figure 3B A hardware structure diagram of an electronic device 200 provided in an embodiment of the present application is shown.

[0158] The electronic device 200 can be a mobile phone, a tablet computer, a desktop computer, a laptop computer, a handheld computer, a notebook computer, an ultra-mobile personal computer (UMPC), a netbook, a cellular phone, a personal digital assistant (PDA), an augmented reality (AR) device, a virtual reality (VR) device, an artificial intelligence (AI) device, a wearable device, an in-vehicle device, a smart home device and / or a smart city device. The embodiments of the present application do not impose any special restrictions on the specific type of the electronic device.

[0159] The electronic device 200 may include a processor 210, an internal memory 221, a universal serial bus (USB) interface 230, a charging management module 240, a power management module 241, a battery 242, an antenna 1, an antenna 2, a mobile communication module 250, a wireless communication module 260, an audio module 270, etc. Optionally, the electronic device 200 may further include any one or more of the following: a sensor module 280, a button 290, a motor 291, an indicator 292, a display screen 294, etc. The sensor module 280 may be any one or more of the following: a pressure sensor 280A, a gyroscope sensor 280B, an air pressure sensor 280C, a magnetic sensor 280D, an acceleration sensor 280E, a distance sensor 280F, a proximity light sensor 280G, a fingerprint sensor 280H, a temperature sensor 280J, a touch sensor 280K, an ambient light sensor 280L, a bone conduction sensor 280M, etc. The audio module 270 may include any one or more of the following: a speaker 270A, a receiver 270B, a microphone 270C, and the like.

[0160] It should be understood that the structure illustrated in the embodiment of the present invention does not constitute a specific limitation on the electronic device 200. In other embodiments of the present application, the electronic device 200 may include more or fewer components than shown, or may combine or separate certain components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0161] Among them, the specific contents of the processor 210, internal memory 221, universal serial bus (USB) interface 230, charging management module 240, power management module 241, battery 242, wireless communication module 260, audio module 270, sensor module 280, button 290, motor 291, indicator 292 and other devices can be referred to above. Figure 3A The detailed description of the related components in the illustrated embodiment will not be repeated here.

[0162] Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 200 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In other embodiments, the antennas can be used in conjunction with a tuning switch.

[0163] The mobile communication module 250 can provide solutions for wireless communications including 2G / 3G / 4G / 5G applied to the electronic device 200. The mobile communication module 250 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 250 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 250 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 250 can be set in the processor 210. In some embodiments, at least some of the functional modules of the mobile communication module 250 can be set in the same device as at least some of the modules of the processor 210.

[0164] The modem processor may include a modulator and a demodulator. The modulator is used to modulate the low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After being processed by the baseband processor, the low-frequency baseband signal is passed to the application processor. The application processor outputs the sound signal through the audio device or displays an image or video through the display screen 294. In some embodiments, the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 210 and be provided in the same device as the mobile communication module 250 or other functional modules.

[0165] Electronic device 200 implements display functionality through a GPU, display screen 294, and an application processor. A GPU is a microprocessor for image processing that connects display screen 294 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 210 may include one or more GPUs that execute program instructions to generate or modify display information.

[0166] Display screen 294 is used to display images, videos, etc. Display screen 294 includes a display panel. The display panel can be a liquid crystal display (LCD). The display panel can also be made of an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a MiniLED, a MicroLED, a Micro-oLed, a quantum dot light-emitting diode (QLED), etc. In some embodiments, electronic device 200 can include one or N display screens 294, where N is a positive integer greater than 1.

[0167] In the sensor module 280, the specific functions of the gyro sensor 280B, the acceleration sensor 280E, the touch sensor 280K and other sensors can refer to the above Figure 3A The relevant descriptions in the illustrated embodiments will not be repeated here.

[0168] Pressure sensor 280A is used to sense pressure signals and convert them into electrical signals. In some embodiments, pressure sensor 280A can be located on display screen 294. There are many types of pressure sensors 280A, such as resistive, inductive, and capacitive. A capacitive pressure sensor can include at least two parallel plates made of conductive material. When force is applied to pressure sensor 280A, the capacitance between the electrodes changes. Electronic device 200 determines the intensity of the pressure based on this change in capacitance. When a touch operation is applied to display screen 294, electronic device 200 detects the touch intensity based on pressure sensor 280A. Electronic device 200 can also calculate the touch location based on the detection signal from pressure sensor 280A. In some embodiments, touch operations applied to the same touch location but with different touch intensities can correspond to different operation instructions. For example, when a touch operation with an intensity less than a first pressure threshold is applied to a short message application icon, a command to view short messages is executed. When a touch operation with an intensity greater than or equal to the first pressure threshold is applied to a short message application icon, a command to create a new short message is executed.

[0169] The air pressure sensor 280C is used to measure air pressure.

[0170] The magnetic sensor 280D includes a Hall sensor.

[0171] The distance sensor 280F is used to measure distance. The electronic device 200 can measure distance using infrared or laser. In some embodiments, when shooting a scene, the electronic device 200 can use the distance sensor 280F to measure distance to achieve fast focusing.

[0172] The proximity light sensor 280G may include, for example, a light emitting diode (LED) and a light detector, such as a photodiode. The light emitting diode may be an infrared light emitting diode. The electronic device 200 emits infrared light outward through the light emitting diode. The electronic device 200 uses the photodiode to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that there is an object near the electronic device 200. When insufficient reflected light is detected, the electronic device 200 can determine that there is no object near the electronic device 200.

[0173] Ambient light sensor 280L is used to sense ambient light brightness. Electronic device 200 can adaptively adjust the brightness of display screen 294 based on the sensed ambient light brightness. Ambient light sensor 280L can also be used to automatically adjust white balance when taking photos.

[0174] The fingerprint sensor 280H is used to collect fingerprints. The electronic device 200 can use the collected fingerprint characteristics to implement fingerprint unlocking, etc.

[0175] The temperature sensor 280J is used to detect temperature. In some embodiments, the electronic device 200 uses the temperature detected by the temperature sensor 280J to execute a temperature processing strategy. For example, when the temperature reported by the temperature sensor 280J exceeds a threshold, the electronic device 200 reduces the performance of the processor located near the temperature sensor 280J to reduce power consumption and implement thermal protection. In other embodiments, when the temperature is lower than another threshold, the electronic device 200 heats the battery 242 to prevent the electronic device 200 from shutting down abnormally due to low temperature. In other embodiments, when the temperature is lower than another threshold, the electronic device 200 boosts the output voltage of the battery 242 to prevent abnormal shutdown due to low temperature.

[0176] It should be noted that the relevant contents of the hardware structure of the electronic device 300 can also refer to the above Figure 3B The description of the hardware structure of the electronic device 200 will not be repeated in this application.

[0177] The present application provides a voice interaction method. When a user wears a wearable device 100, the wearable device 100 can transmit a directional positioning signal when it determines that a wake-up event has occurred (the user issues a voice command including a wake-up word, or the user issues a wake-up-free command). The positioning signal is directed to the user's current facial orientation. The wearable device 100 can receive positioning data sent by multiple other electronic devices (such as electronic device 200 and electronic device 300), and each positioning data is used to indicate the offset of an electronic device relative to the user's facial orientation. The wearable device 100 can determine, based on the multiple positioning data, that the electronic device with the smallest offset from the user's facial orientation is the optimal response device, and instruct the optimal response device to respond to the current wake-up event.

[0178] In this way, in a scenario where there are multiple electronic devices with voice interaction functions around the user, the wearable device 100 can determine the optimal response device based on the user's facial orientation. This not only avoids the power consumption caused by multiple device responses, but also allows the device that the user is facing to interact with the user by voice, providing the user with a better voice interaction experience.

[0179] The following describes a specific process of a voice interaction method provided in an embodiment of the present application.

[0180] Figure 4 A flow chart of a voice interaction method provided in an embodiment of the present application is shown.

[0181] like Figure 4 As shown, the specific process of the voice interaction method may include the following steps:

[0182] S401. The wearable device 100 detects that a user is wearing the wearable device 100 and detects a wake-up event.

[0183] The wearable device 100 can detect whether it is worn by a user.

[0184] In some embodiments, the wearable device 100 can determine whether the wearable device 100 is being worn by the user using devices such as an accelerometer and a gyroscope. In some embodiments, the wearable device 100 can be configured with a charging box, and the wearable device 100 can determine whether the wearable device 100 is being worn by the user by whether the wearable device 100 is removed from the charging box. It is understood that the embodiments herein are only two examples. In the embodiments of the present application, the wearable device 100 can also determine whether the wearable device 100 is being worn by the user using different methods than those described in the above embodiments.

[0185] The following describes how the wearable device 100 detects a wake-up event.

[0186] In one possible implementation, the wearable device 100 may include an audio module. The wearable device 100 may collect the voice of the user through the audio module, and determine whether the user issues a wake-up word or a wake-up-free instruction based on the collected voice. The wake-up word and the wake-up-free instruction may be pre-set, or may be obtained from other electronic devices (such as electronic device 200, electronic device 300, etc.) after the wearable device 100 establishes a communication network with the other electronic devices.

[0187] In some embodiments, different electronic devices may correspond to different wake-up-free instructions and / or wake-up words, and the wearable device 100 may store wake-up words and wake-up-free instructions corresponding to multiple electronic devices.

[0188] For example, Table 1 shows the wake-up words and wake-up-free instructions of multiple electronic devices stored in a wearable device 100 provided in an embodiment of the present application.

[0189] Table 1

[0190]

[0191]

[0192] As shown in Table 1, the wearable device 100 can store device identifiers, wake-up words, and wake-up-free instructions for multiple electronic devices. For example, the device identifier of a smart speaker can be A1, the wake-up word can be XiaoA, and the wake-up-free instructions can include playing music, lowering the volume, and increasing the volume. For another example, the device identifier of a smart TV can be A2, the wake-up word can be XiaoA, and the wake-up-free instructions can include playing a video, lowering the volume, and increasing the volume. The wake-up word of the smart speaker and the wake-up word of the smart TV can be the same, and the wake-up-free instructions of the smart speaker and the smart TV can be partially the same and partially different.

[0193] It is understood that the embodiment shown in Table 1 is only an example. In the embodiment of the present application, the wearable device 100 may also store more, fewer, or different types of electronic devices than those shown in Table 1, as well as device identifiers, wake-up words, and wake-up-free instructions of the electronic devices. In addition, the wake-up words of different electronic devices can be the same or different, and the wake-up-free instructions of different electronic devices can be completely the same, partially the same, or completely different, and this application does not limit them here.

[0194] In some embodiments, the wearable device 100 can determine that a wake-up event has been detected when it detects that the user issues a wake-up word or a wake-up-free instruction of any electronic device. For example, taking the content shown in Table 1 stored in the wearable device 100 as an example, if the wearable device 100 detects that the user issues the voice "Xiao A", the wearable device 100 can determine that a wake-up event has been detected; if the wearable device 100 detects that the user issues a voice such as "play music" or "play video", the wearable device 100 can also determine that a wake-up event has been detected.

[0195] In this way, when it is detected that the user's voice can wake up the voice interaction function of any electronic device, it can be determined that a wake-up event is detected, and subsequent steps can be performed to determine the best response device to the wake-up event among multiple electronic devices in the current communication network.

[0196] In other embodiments, the wearable device 100 may also determine that a wake-up event is detected when it detects that the user issues a wake-up word or a wake-up-free instruction, and the wake-up word or wake-up-free instruction corresponds to multiple electronic devices. It should be noted that in this case, if the wearable device 100 detects that the user issues a wake-up word or a wake-up-free instruction, and the wake-up word or wake-up-free instruction corresponds to an electronic device, the wearable device 100 can send a start instruction to the electronic device, and the start instruction is used to instruct the electronic device to turn on the voice interaction mode and perform voice interaction with the user; if the voice issued by the user is a wake-up-free instruction, the start instruction can also be used to instruct the electronic device to execute the wake-up-free instruction.

[0197] For example, taking the wearable device 100 storing the content shown in Table 1 as an example, if the wearable device 100 detects that the user utters the voice "Xiao A", it is determined that a wake-up event is detected; if the wearable device 100 detects that the user utters the voice "lower / increase the volume", it is determined that a wake-up event is detected; if the wearable device 100 detects that the user utters the voice "play music", the wearable device 100 can send a startup instruction to the smart speaker, instructing the smart speaker to turn on the voice interaction function and execute the voice instruction "play music"; if the wearable device 100 detects that the user utters the voice "play video", the wearable device 100 can send a startup instruction to the smart TV, instructing the smart TV to turn on the voice interaction function and execute the voice instruction "play video".

[0198] In this way, if it is determined that the user's voice can activate the voice interaction functions of multiple electronic devices, the wake-up event is determined to be detected, and subsequent steps are performed to determine the optimal device to respond to the wake-up event. Furthermore, if it is determined that the user's voice can only activate the voice interaction function of one electronic device, the subsequent steps are not performed, thereby saving power consumption and improving decision-making efficiency.

[0199] In another possible implementation, the wearable device 100 may also determine that a wake-up event has been detected based on a wake-up notification sent by other electronic devices. For example, the electronic device 200 may collect the voice of the user and determine whether the user has issued a wake-up word or a wake-up-free instruction for the electronic device 200 based on the collected voice. If the electronic device 200 determines that the user has issued a wake-up word or a wake-up-free instruction, the electronic device 200 may send a wake-up notification to the wearable device 100. Similarly, the electronic device 300 may also send a wake-up notification to the wearable device 100 when it detects that the user has issued a wake-up word or a wake-up-free instruction for the electronic device 300. This application is not limited here.

[0200] It should be noted that multiple electronic devices (such as electronic device 200 and electronic device 300) can detect the user issuing a wake-up word or a wake-up-free instruction one after another (or simultaneously). In this case, the multiple electronic devices can send wake-up notifications to the wearable device 100 respectively. The wearable device 100 can set a timer when receiving the first wake-up notification. The length of the timer can be a preset time length (for example, 1 minute, 3 minutes, 5 minutes, etc.). Before the countdown of the timer ends, one or more wake-up notifications received by the wearable device 100 can be regarded as the same wake-up event.

[0201] In some embodiments, the wearable device 100 may determine that a wake-up event has been detected upon receiving the first wake-up notification, and perform subsequent steps to determine the optimal device to respond to the wake-up event. This can save wake-up event detection time and improve efficiency.

[0202] In other embodiments, the wearable device 100 may set a timer upon receiving the first wake-up notification, and the duration of the timer may be a preset time length (e.g., 1 minute, 3 minutes, 5 minutes, etc.). Before the countdown of the timer ends, if the wearable device 100 receives wake-up notifications sent by multiple different electronic devices, the wearable device 100 may determine that a wake-up event has been detected, and execute subsequent steps to select one electronic device from the multiple electronic devices that sent the wake-up notification before the countdown ends as the optimal response device for responding to the wake-up event. At the end of the countdown of the timer, if the wearable device 100 only receives a wake-up notification sent by one electronic device, the wearable device 100 may send a start instruction to the electronic device, and the start instruction is used to instruct the electronic device to turn on the voice interaction function and perform voice interaction with the user.

[0203] In this way, if it is determined that the user's voice can activate the voice interaction functions of multiple electronic devices, the wake-up event is determined to be detected, and subsequent steps are performed to determine the optimal device to respond to the wake-up event. Furthermore, if it is determined that the user's voice can only activate the voice interaction function of one electronic device, the subsequent steps are not performed, thereby saving power consumption and improving decision-making efficiency.

[0204] S402. The wearable device 100 transmits a positioning signal through a signal transmitter, and the direction of the positioning signal is the current facial orientation of the user.

[0205] When the wearable device 100 determines that the user is wearing the wearable device 100 and detects a wake-up event, it can transmit a positioning signal. The direction of the positioning signal is the current facial orientation of the user. The specific relationship between the wearable device 100 and the user's facial orientation can be referred to above. Figure 2B-2C The relevant descriptions in the illustrated embodiments will not be repeated here.

[0206] In some embodiments, the positioning signal may be a directional signal in a preset frequency band, which may be a frequency band agreed upon by electronic devices such as the wearable device 100 , the electronic device 200 , and the electronic device 300 .

[0207] In the embodiment of the present application, the type of the positioning signal may include but is not limited to any one or more of the following: ultrasonic signal, ultra-wideband signal, infrared signal, radio frequency signal, laser signal, etc.

[0208] In some embodiments, the wearable device 100 may include two modes: mode 1 and mode 2. Mode 1 refers to a mode in which the signal transmitter is in an off state (i.e., the wearable device 100 stops powering the signal transmitter), and mode 2 refers to a mode in which the signal transmitter is in an on state (i.e., the wearable device 100 powers the signal transmitter). When the wearable device 100 is in mode 2, the wearable device 100 can transmit a directional positioning signal through the signal transmitter; in mode 1, the wearable device 100 does not transmit a directional positioning signal. Compared to mode 2, in mode 1, the power consumption of the wearable device 100 is low. In some embodiments, mode 1 may also be referred to as a low power mode, and mode 2 may also be referred to as a working mode. It will be understood that the embodiment here is only an example. In the embodiments of the present application, mode 1 and mode 2 may also be referred to as other modes, and the present application does not limit the specific names of the modes.

[0209] It should be noted that, in some embodiments, the wearable device 100 can switch the wearable device 100 from mode 1 to mode 2 when it detects that the user is wearing the wearable device 100 and detects a wake-up event. In this way, the battery life of the wearable device 100 can be improved by switching between mode 1 and mode 2.

[0210] S403. The electronic device 200 determines positioning data 1 based on the received positioning signal.

[0211] In some embodiments, the positioning data 1 may include the signal strength of the positioning signal received by the electronic device 200, and / or the angle between the electronic device 200 and the user's facial orientation. Both the signal strength and the angle can be used to characterize the offset between the electronic device 200 and the user's facial orientation. Since the positioning signal is a directional signal, and the direction is the user's current facial orientation. Therefore, during the propagation of the positioning signal, the electronic device in the direction indicated by the user's facial orientation receives the highest signal strength, and the electronic device in the direction indicated by the user's back receives the lowest signal strength (or, the electronic device in the direction indicated by the user's back does not receive the positioning signal), and the smaller the offset between the electronic device and the user's facial orientation, the higher the received signal strength. The smaller the angle between the electronic device and the user's facial orientation, the smaller the offset between the electronic device and the user's facial orientation.

[0212] After receiving the positioning signal, the electronic device 200 may determine the signal strength of the positioning signal received by the electronic device 200 .

[0213] After receiving the positioning signal, the electronic device 200 can also calculate the angle between the electronic device 200 and the user's facial orientation based on the received positioning signal. In one possible implementation, the electronic device 200 can also determine the angle between the electronic device 200 and the user's facial orientation based on the signal strength of the positioning signal through a pre-stored calculation model. It can be understood that the embodiment here is only an illustrative example of how the angle between the electronic device 200 and the user's facial orientation can be calculated based on the received positioning signal. In the embodiment of the present application, the electronic device 200 can also calculate the angle between the electronic device 200 and the user's facial orientation in a manner different from the above embodiment, and the present application does not limit this.

[0214] It can be understood that the above embodiment only provides the specific contents of two types of positioning data 1 by way of example. In the embodiment of the present application, the positioning data 1 may also be other types of content that can indicate the offset of the electronic device 200 relative to the user's facial orientation, and the present application does not limit this.

[0215] In other embodiments, the positioning data 1 can also be used to characterize the distance between the electronic device 200 and the user. The positioning data 1 can also include the distance between the electronic device 200 and the user, and / or the reception time of the positioning signal received by the electronic device 200, wherein the reception time of the positioning signal received by the electronic device 200 can be used to determine the distance between the electronic device 200 and the user. In one possible implementation, the electronic device 200 can determine the distance between the electronic device 200 and the user based on the sending time of the wake-up notification (or the sending time of the positioning signal carried in the positioning signal received by the electronic device 200) and the receiving time of the positioning signal received by the electronic device 200.

[0216] It can be understood that the above embodiments are just some examples. In the embodiments of the present application, the positioning data 1 can also use content different from the above embodiments to indicate the distance between the electronic device 200 and the user. In addition, the positioning data 1 can also include more, less or different content than the above embodiments, and the present application does not limit this.

[0217] S404. The electronic device 200 sends positioning data 1 to the wearable device 100.

[0218] After determining the positioning data 1, the electronic device 200 may send the positioning data 1 to the wearable device 100 via the communication network C.

[0219] S405. The electronic device 300 determines positioning data 2 based on the received positioning signal.

[0220] For the relevant content of positioning data 2, reference may be made to the relevant description of positioning data 1 in step S403 above, which will not be repeated here.

[0221] S406 . The electronic device 300 sends positioning data 2 to the wearable device 100 .

[0222] The specific contents of step S405 to step S406 can refer to the relevant description of the above steps S403 to step S404, which will not be repeated here.

[0223] S407. The wearable device 100 determines the optimal response device based on positioning data 1 and positioning data 2.

[0224] In some embodiments, the wearable device 100 can determine the electronic device with the smallest deviation from the user's facial orientation as the optimal response device. The optimal response device is used to respond to the wake-up event in step S401, turn on the voice interaction function, and perform voice interaction with the user.

[0225] The wearable device 100 can determine the electronic device with the smallest deviation from the user's facial orientation based on the positioning data 1 and the positioning data 2.

[0226] In some embodiments, if positioning data 1 includes the signal strength of the positioning signal received by electronic device 200, and positioning data 2 includes the signal strength of the positioning signal received by electronic device 300, then wearable device 100 can determine the optimal response device based on positioning data 1 and positioning data 2. That is, the electronic device with a greater signal strength has a smaller deviation from the user's facial orientation, and the electronic device with the smallest deviation from the user's facial orientation is the optimal response device.

[0227] Optionally, the wearable device 100 may also calculate the angle between the electronic device 200 and the user's facial orientation based on the signal strength in positioning data 1, and calculate the angle between the electronic device 300 and the user's facial orientation based on the signal strength in positioning data 2, and determine the optimal response device based on the magnitudes of the two angles. That is, the smaller the angle between the electronic device and the user's facial orientation, the smaller the offset of the electronic device relative to the user's facial orientation, and the electronic device with the smallest offset from the user's facial orientation is the optimal response device.

[0228] In other embodiments, if the positioning data 1 includes the angle between the electronic device 200 and the user's facial orientation, the wearable device 100 can determine the offset between the electronic device 200 and the user's facial orientation based on the angle in the positioning data 1, that is, the smaller the angle, the smaller the offset, and the electronic device with the smallest offset from the user's facial orientation is the optimal response device.

[0229] In other embodiments, positioning data 1 may also be used to indicate the distance between electronic device 200 and the user, and positioning data 2 may also be used to indicate the distance between electronic device 300 and the user. In this case, wearable device 100 may determine the distance between electronic device 200 and the user, as well as the distance between electronic device 300 and the user based on positioning data 1 and positioning data 2, and determine the optimal response device based on the offset between electronic device 200 and the user's facial orientation, the distance between electronic device 200 and the user, the offset between electronic device 300 and the user's facial orientation, and the distance between electronic device 300 and the user.

[0230] For example, Figure 5 A schematic diagram of a process for determining an optimal response device based on the offsets of multiple electronic devices and the user's facial orientation and the distances between the multiple electronic devices and the user, provided by an embodiment of the present application, is shown.

[0231] like Figure 5 As shown, the specific process of the wearable device 100 determining the optimal response device based on the offset between the multiple electronic devices and the user's facial orientation and the distance between the multiple electronic devices and the user may include the following steps:

[0232] S501. The wearable device 100 determines whether the offset between the electronic device 200 and the user's facial orientation is smaller than the offset between the electronic device 300 and the user's facial orientation.

[0233] If the offset between the electronic device 200 and the user's facial orientation is smaller than the offset between the electronic device 300 and the user's facial orientation, the wearable device 100 may execute the following step S502.

[0234] If the offset between the electronic device 200 and the user's facial orientation is greater than or equal to the offset between the electronic device 300 and the user's facial orientation, the wearable device 100 may execute the following step S503.

[0235] S502. The wearable device 100 determines whether the distance between the electronic device 200 and the user is greater than a preset distance.

[0236] Exemplarily, the preset distance may be 5 meters, 3 meters, or 7 meters, etc. It is understood that the preset distances here are just some examples, and in the embodiments of the present application, the preset distances may also be values different from those in the above embodiments, and the present application does not limit this.

[0237] If the distance between the electronic device 200 and the user is less than or equal to the preset distance, the wearable device 100 may execute the following step S504 to determine that the electronic device 200 is the optimal response device.

[0238] If the distance between the electronic device 200 and the user is greater than the preset distance, the wearable device 100 may execute the following step S503.

[0239] S503. The wearable device 100 determines whether the distance between the electronic device 300 and the user is greater than a preset distance.

[0240] If the distance between the electronic device 300 and the user is less than or equal to the preset distance, the wearable device 100 may execute the following step S505 to determine that the electronic device 300 is the optimal response device.

[0241] If the distance between the electronic device 300 and the user is greater than the preset distance, the wearable device 100 may execute the following step S504 to determine that the electronic device 200 is the optimal response device.

[0242] S504. The wearable device 100 determines that the electronic device 200 is the optimal response device.

[0243] S505. The wearable device 100 determines that the electronic device 300 is the optimal response device.

[0244] It is understandable that Figure 5The embodiment shown is only an example. In the embodiment of the present application, the wearable device 100 may also adopt the same Figure 5 The different judgment logics in the illustrated embodiments determine the optimal response device, and this application does not limit this.

[0245] S408 . When the best-responding device is the electronic device 200 , the wearable device 100 sends a startup instruction to the electronic device 200 .

[0246] After determining that the best response device is the electronic device 200, the wearable device 100 can send a startup instruction to the electronic device 200, where the startup instruction is used to instruct the electronic device 200 to start the voice interaction function.

[0247] S409. The electronic device 200 responds to the start instruction and turns on the voice interaction function.

[0248] The electronic device 200 responds to the start-up instruction, turns on the voice interaction function, and performs voice interaction with the user.

[0249] S410 . When the best-responding device is the electronic device 300 , the wearable device 100 sends a startup instruction to the electronic device 300 .

[0250] S411. The electronic device 300 responds to the start instruction and turns on the voice interaction function.

[0251] The specific contents of step S410 to step S411 can refer to the relevant description of the above steps S408 to step S409, which will not be repeated here.

[0252] S412. When the wearable device 100 detects that the shutdown condition is met, it turns off the signal transmitter.

[0253] Step S412 is an optional step.

[0254] The shutdown conditions may include but are not limited to any one or more of the following: the wearable device 100 determines the best response device; the wearable device 100 detects that the user stops voice interaction for a period of time exceeding a preset period; the wearable device 100 receives a shutdown instruction sent by other electronic devices, and the shutdown instruction is used to instruct the wearable device 100 to turn off the signal transmitter; the wearable device 100 receives a startup success notification sent by the best response device, and the startup success notification is used to notify the wearable device 100 that the best response device has successfully turned on the voice interaction function; the wearable device 100 receives the user's operation to turn off the signal transmitter, etc.

[0255] The following describes several exemplary ways in which the wearable device 100 determines whether the shutdown condition is met.

[0256] In a possible implementation, the wearable device 100 may determine that the shutdown condition is met after executing the above step S407 and determining the optimal response device.

[0257] In one possible implementation, the wearable device 100 may include an audio module, and the wearable device 100 may determine whether the user stops speaking through the audio module. When it is detected that the duration of the user stopping speaking reaches a preset duration, it is determined that the shutdown condition is met.

[0258] In one possible implementation, after the wearable device 100 sends a startup instruction to the best-responding device, the best-responding device may return a startup success notification to the wearable device 100 after turning on the voice interaction function. The startup success notification may be used to notify the wearable device 100 that the best-responding device has successfully turned on the voice interaction function. Upon receiving the startup success notification, the wearable device 100 may determine that the shutdown condition is met.

[0259] In another possible implementation, the optimal response device may send a shutdown instruction to the wearable device 100 after detecting that the voice interaction is finished, where the shutdown instruction is used to instruct the wearable device 100 to turn off the signal transmitter.

[0260] In some embodiments, if the wearable device 100 is set with mode 1 and mode 2 in the above step S402, the wearable device 100 can switch from mode 2 to mode 1 when it is detected that the shutdown condition is met.

[0261] It is understandable that Figure 4 The embodiment shown is only an example. In the embodiment of the present application, the electronic devices with voice interaction function around the user may also include more electronic devices than the above embodiment, and the present application does not limit this.

[0262] By using the voice interaction method provided in this application, in a scenario where there are multiple electronic devices with voice interaction functions around the user, the wearable device 100 can determine the optimal response device based on the user's facial orientation (or the user's facial orientation, the distance between the electronic device and the user). This not only avoids the power consumption caused by multiple device responses, but also allows the device that the user is facing to perform voice interaction with the user, providing the user with a better voice interaction experience.

[0263] In some application scenarios, the communication network C composed of the wearable device 100, the electronic device 200, and the electronic device 300 may include a master device and multiple slave devices. In this case, the positioning data of the one or more electronic devices can be reported to the master device, and the master device determines the best response device based on the positioning results of the multiple electronic devices.

[0264] Below, taking the master device being the electronic device 200 and the slave devices including the electronic device 300 and the wearable device 100 as an example, the specific process of another voice interaction method provided in an embodiment of the present application is introduced.

[0265] Figure 6 A flow chart of another voice interaction method provided in an embodiment of the present application is shown.

[0266] like Figure 6 As shown, the specific process of another voice interaction method provided in an embodiment of the present application may include the following steps:

[0267] S601. The wearable device 100 detects that a user is wearing the wearable device 100 and detects a wake-up event.

[0268] In one possible implementation, the wearable device 100 can determine whether a wake-up event is detected by collecting the user's voice to determine whether the user issues a wake-up word or a wake-up-free instruction. In another possible implementation, the wearable device 100 can also determine whether a wake-up event is detected by determining whether a wake-up notification sent by the main device (i.e., the electronic device 200) is received, or whether a wake-up notification sent by other electronic devices is received.

[0269] In some embodiments, when the electronic device 300 (or other slave device) detects that the user issues a wake-up word or a wake-up-free instruction, it can send a wake-up notification to the master device (i.e., the electronic device 200). Upon receiving the wake-up notification, the electronic device 200 can send the wake-up notification to the wearable device 100. In other embodiments, the electronic device 200 can also send a wake-up notification to the wearable device 100 upon detecting that the user issues a wake-up word or a wake-up-free instruction. Upon receiving the wake-up notification sent by the electronic device 200, the wearable device 100 can determine that a wake-up event has been detected.

[0270] In some embodiments, the electronic device 200 may set a timer when receiving the first wake-up notification or detecting that the user issues a wake-up word or a wake-up-free instruction. Before the countdown of the timer ends, the electronic device 200 may determine that it has received wake-up notifications sent by multiple different electronic devices, or, if it determines that the user issues a wake-up word or a wake-up-free instruction and receives wake-up notifications sent by other electronic devices, the electronic device 200 may send a wake-up notification to the wearable device 100. When the wearable device 100 receives the wake-up notification sent by the electronic device 200, it may determine that a wake-up event has been detected.

[0271] The method for the wearable device 100 to detect the user wearing the wearable device 100 and other methods for detecting wake-up events can refer to the above Figure 4 The relevant description in step S401 is not repeated here.

[0272] S602. The wearable device 100 transmits a positioning signal through a signal transmitter, and the direction of the positioning signal is the current facial orientation of the user.

[0273] S603. The electronic device 200 determines positioning data 1 based on the received positioning signal.

[0274] S604. The electronic device 300 determines positioning data 2 based on the received positioning signal.

[0275] The details of steps S602 to S604 can be found in the above Figure 4 The relevant contents of steps S402 to S403 and step S405 are not repeated here.

[0276] S605 . The electronic device 300 sends the positioning data 2 to the electronic device 200 .

[0277] After determining the positioning data 2 , the electronic device 300 as the slave device may send the positioning data 2 to the master device, that is, the electronic device 200 .

[0278] S606. The electronic device 200 determines the best response device based on the positioning data 1 and the positioning data 2.

[0279] The specific method for the electronic device 200 to determine the best response device based on the positioning data 1 and the positioning data 2 can refer to the above Figure 4 The relevant content of step S407 is not repeated here.

[0280] Optionally, in some embodiments, after determining the optimal response device, the electronic device 200 may send a shutdown instruction to the wearable device 100, where the shutdown instruction is used to instruct the wearable device 100 to turn off the signal transmitter.

[0281] S607. When the best response device is the electronic device 200, the electronic device 200 enables the voice interaction function.

[0282] S608 . When the best responding device is the electronic device 300 , the electronic device 200 sends a start instruction to the electronic device 300 .

[0283] S609. The electronic device 300 responds to the start instruction and turns on the voice interaction function.

[0284] The details of steps S608 to S609 can be found in the above Figure 4 The relevant contents of step S410 to step S411 are not repeated here.

[0285] Optionally, after the voice interaction function is enabled, the best responding device (electronic device 200 or electronic device 300, etc.) may send a startup success notification to the wearable device 100. The startup success notification is used to notify the wearable device 100 that the best responding device has successfully enabled the voice interaction function. In other embodiments, after the voice interaction function is enabled, the best responding device may also send a startup success notification to the wearable device 100 through the master device, which is not limited in this application.

[0286] S610. When the wearable device 100 detects that the shutdown condition is met, it turns off the signal transmitter.

[0287] Step S610 is an optional step.

[0288] The specific content of step S610 can refer to the above Figure 4 The description of step S412 is omitted here.

[0289] It is understandable that Figure 6 The embodiment shown is only an example. In the embodiment of the present application, the slave device may also include more electronic devices, and the device that detects the wake-up event may also be the master device. The present application does not limit this.

[0290] Using the voice interaction method provided in this application, in a scenario where a user is surrounded by multiple electronic devices with voice interaction capabilities, the optimal response device can be determined based on the user's facial orientation (or the user's facial orientation and the distance between the electronic device and the user). This not only avoids the power consumption caused by multiple device responses, but also allows the device the user is facing to perform voice interaction with the user, providing the user with a better voice interaction experience. In addition, by having the master device determine the optimal response device, it can also reduce the computing power requirements of the wearable device 100, making the voice interaction method have a richer application scenario.

[0291] In some embodiments, the above Figure 4 or Figure 6The direction of the positioning signal in the illustrated embodiment may also be a direction having a fixed angle with the current facial orientation of the user. For example, the instruction of the positioning signal may be the current back orientation of the user, in which case the fixed angle may be 180°. In this case, the electronic device 200 may also determine the offset between the electronic device 200 and the direction of the positioning signal based on the received positioning signal, and determine the offset between the electronic device 200 and the current facial orientation of the user based on the angle between the direction of the positioning signal and the current facial orientation of the user. It will be understood that this is merely an illustrative illustration, and the direction of the positioning signal may also be other fixed directions different from the facial orientation of the user. In the embodiment of the present application, the electronic device 200 (or other electronic devices) may also determine the offset between the electronic device 200 and the facial orientation of the user in a manner different from that of the above-mentioned embodiment, and the present application does not limit this.

[0292] In other embodiments, the positioning signal is very directional, and only electronic devices within a specific range (for example, within a range of -15° to +15° of the orientation of the positioning signal) can receive the positioning signal, and electronic devices outside the specific range cannot receive the positioning signal (or, the positioning signal at this orientation is severely attenuated, so that the positioning signal received by the electronic device in this orientation can be ignored). In this case, the wearable device 100 (or the main device) can determine the best response device based on the received positioning data. For example, if the positioning signal is directed in the same direction as the user's face, and the electronic devices within the specific range can receive the positioning signal and return positioning data, then the wearable device 100 (or the main device) can determine the best response device from the electronic devices that sent the one or more positioning data based on the received one or more positioning data. For another example, if the positioning signal is directed in the same direction as the user's back, and the electronic devices within the specific range can receive the positioning signal and return positioning data, then the wearable device 100 (or the main device) can determine the best response device from one or more electronic devices that did not send positioning data in the current communication network C based on the received one or more positioning data.

[0293] The following introduces the functional modules of a voice interaction system 10 provided in an embodiment of the present application.

[0294] Figure 7 A functional module diagram of a voice interaction system 10 provided in an embodiment of the present application is shown.

[0295] like Figure 7As shown, the voice interaction system 10 may include a wearable device 100 and multiple electronic devices with voice interaction capabilities, such as electronic devices 200 and 300. Wearable device 100 may include a wearing detection module 711 and a signal transceiver module 712. Optionally, wearable device 100 may also include a mode control module 713, a decision module 714, a voice acquisition module 715, and a wake-up detection module 716. Electronic device 200 may include a voice acquisition module 721, a voice processing module 722, a wake-up detection module 723, a positioning module 724, and a voice interaction module 725. Optionally, if electronic device 200 is a master device, electronic device 200 may also include a decision module 726. Electronic device 300 may include a voice acquisition module 731, a voice processing module 732, a wake-up detection module 733, a positioning module 734, and a voice interaction module 735. Optionally, if electronic device 200 is a master device, electronic device 200 may also include a decision module 736.

[0296] In the wearable device 100, the wearing detection module 711 can determine a wearing detection result, which is used to indicate whether the wearable device 100 is worn by the user. In some embodiments, the wearing detection module 711 can send the wearing detection result to the mode control module 713. In other embodiments, the wearing detection module 711 can also send the wearing detection result to the signal transceiver module 712.

[0297] The signal transceiver module 712 can transmit a directional positioning signal (such as the above Figure 4 、 Figure 6 The positioning signal in the embodiment shown). The direction of the positioning signal can be the user's current facial orientation, or the user's current back orientation, etc. In some embodiments, the signal transceiver module 712 can receive and transmit a positioning signal in response to a transmission instruction sent by the mode control module 713. In other embodiments, the signal transceiver module 712 can also receive wearing detection results and wake-up detection results, and determine whether to transmit a positioning signal based on the wearing detection results and the wake-up detection results. In some embodiments, the signal transceiver module 712 can also receive positioning data sent by other electronic devices (such as positioning data 1 and positioning data 2 in the above embodiment). The signal transceiver module 712 can also send the received positioning data of multiple electronic devices to the decision module 714.

[0298] The mode control module 713 can control the mode switching of the wearable device 100. In some embodiments, upon receiving the wearing detection result and determining that the user is wearing the wearable device 100, the mode control module 713 can determine to turn on mode 1 (e.g., low power mode). In some embodiments, the mode control module 713 can also receive and respond to wake-up notifications sent by other electronic devices (e.g., master devices, slave devices, etc.) to switch the wearable device 100 from mode 1 to mode 2. After switching to mode 2, the mode control module 713 can send a transmission instruction to the signal transceiver module 712, and the transmission instruction is used to instruct the signal transceiver module 712 to transmit a positioning signal. In other embodiments, when it is detected that the shutdown condition is met, the mode control module 713 can also switch the wearable device 100 from mode 2 to mode 1.

[0299] The decision module 714 can receive the positioning data of multiple electronic devices sent by the signal transceiver module 712 (e.g., positioning data 1 and positioning data 2 in the above embodiment). The decision module 714 can determine the best response device from the multiple electronic devices based on the positioning data of the multiple electronic devices. The decision module 714 can also send a startup instruction to the determined best response device, which is used to instruct the electronic device to enable the voice interaction function.

[0300] The voice collection module 715 can collect the user's voice signal, and optionally, can also perform filtering, noise reduction, etc. on the collected voice signal. The voice collection module 715 can send the collected (or processed) voice signal to the wake-up detection module 716.

[0301] The wake-up detection module 716 can determine whether the voice signal sent by the voice acquisition module 715 includes a wake-up word or a wake-up-free instruction. If it is determined that the voice signal includes a wake-up word or a wake-up-free instruction, in some embodiments, the wake-up detection module 716 can send a wake-up detection result to the signal transceiver module 712; in other embodiments, the wake-up detection module 716 can send a mode switching instruction to the mode control module 713, which is used to instruct the mode control module 713 to switch the mode of the wearable device 100 to Mode 2.

[0302] In the electronic device 200 , the voice collection module 721 can collect voice signals and send the collected voice signals to the voice processing module 722 .

[0303] The voice processing module 722 can process the voice signal sent by the voice acquisition module 721 (for example, noise reduction, filtering, voice enhancement, etc.), and send the processed voice signal to the wake-up detection module 723.

[0304] The wake-up detection module 723 can detect a wake-up event. If the processed voice signal sent by the voice processing module 722 includes a wake-up word or is a wake-up-free instruction, the wake-up detection module 723 can determine that a wake-up event has occurred. When it is determined that a wake-up event has occurred, in some embodiments, the wake-up detection module 723 can report the wake-up event to the mode control module 713 in the wearable device 100; in other embodiments, the wake-up detection module 723 can also report the wake-up event to the wake-up detection module in the master device. If the electronic device 200 is the master device, then when it is determined that a wake-up event has occurred or a wake-up event reported by other slave devices is received, the wake-up detection module 723 can send a wake-up notification to the mode control module 713 in the wearable device 100. The wake-up notification is used to trigger the mode control module 713 to switch the mode of the wearable device 100 from mode 1 to mode 2.

[0305] The positioning module 724 can receive a positioning signal sent by the wearable device 100, such as the positioning signal in the above embodiment. The positioning module 724 can also determine the positioning data of the electronic device 200 (i.e., the positioning data 1 in the above embodiment) based on the received positioning signal. The positioning data 1 is used to indicate the offset between the electronic device 200 and the user's facial orientation. Optionally, the positioning data 1 can also be used to indicate the distance between the electronic device 200 and the user. In some embodiments, the positioning module 724 can send the positioning data 1 to the decision module 714 in the wearable device 100. In other embodiments, the positioning module 724 can also send the positioning data 1 to the decision module in the main device, such as the decision module 726 in the electronic device 200.

[0306] The voice interaction module 725 can perform voice interaction with the user. In some embodiments, the voice interaction module 725 can receive and respond to a startup instruction sent by the decision module 714 in the wearable device 100, enable the voice interaction function, and perform voice interaction with the user. In other embodiments, the voice interaction module 725 can receive and respond to a startup instruction sent by the decision module in the main device (e.g., the decision module 726 in the electronic device 200), enable the voice interaction function, and perform voice interaction with the user.

[0307] The decision module 726 can receive positioning data sent by multiple slave devices, and can also receive positioning data 1 of the electronic device 200 sent by the positioning module 724. The decision module 726 can determine the best response device from the multiple electronic devices (including master devices and slave devices) based on the positioning data of the multiple electronic devices. The decision module 726 can also send a startup instruction to the determined best response device, and the startup instruction is used to instruct the electronic device to turn on the voice interaction function. It should be noted that if the best response device is the electronic device 200, the decision module 726 can send a startup instruction to the voice interaction module 725, instructing the voice interaction module 725 to turn on the voice interaction function and perform voice interaction with the user.

[0308] It should be noted that the functional description of each module in the electronic device 300 can refer to the functional description of the corresponding module in the above-mentioned electronic device 200, and will not be repeated here.

[0309] It is understandable that Figure 7 The embodiment shown is merely an example. In the embodiments of the present application, the voice interaction system 10 may include more, fewer, or different devices than those in the above embodiment, and each device may also include more, fewer, or different functional modules than those in the above embodiment. In addition, any functional module in the above embodiment may be split into multiple functional modules, and any two functional modules may be combined into one functional module, which is not limited in this application.

[0310] Figure 8A A schematic diagram of a physical device of a wearable device 100 provided in an embodiment of the present application is shown.

[0311] like Figure 8A As shown, the wearable device 100 may include a capacitive sensor 811, a signal transmitter 812, a receiver 813, a battery 816, and a processor 817. Optionally, the wearable device 100 may also include any one or more of the following: a microphone 814, a bone conduction sensor 815, etc.

[0312] The specific functions of the capacitive sensor 811 can be referred to above. Figure 7 The functional description of the wearing detection module 711 is shown; the specific functions of the signal transmitter 812 and the receiver 813 can be referred to Figure 7 The relevant functional description of the signal transceiver module 712 is shown; the specific functions of the microphone 814 / bone conduction sensor 815 can be referred to above Figure 7 The relevant functional description of the voice collection module 715 is shown.

[0313] The battery 816 can power multiple devices in the wearable device 100. The processor 817 can control the battery 816 to power the signal transmitter 812, or control the battery 816 to stop powering the signal transmitter 812, so as to achieve the above Figure 7 The corresponding functions of the mode control module 713 are shown.

[0314] The processor 817 can also implement the above Figure 7 The related functions of the decision module 714 and the wake-up detection module 716 are shown.

[0315] It is understandable that Figure 8A The embodiment shown is only an example. In the embodiment of the present application, the wearable device 100 may also include more, fewer or different devices than the above embodiment, or the devices in the above embodiment may also be replaced by other devices with the same or similar functions. This application does not limit this.

[0316] Figure 8B A schematic diagram of a physical device of an electronic device 200 provided in an embodiment of the present application is shown.

[0317] like Figure 8B As shown, the electronic device 200 may include a microphone 821, a filter 822, a signal receiver 823, a speaker 824, a processor 825, a communication module 826, and optionally, the electronic device 200 may also include a display screen 827 and the like.

[0318] The specific function of the microphone 821 can be referred to above. Figure 7 The relevant functional description of the voice acquisition module 721 is shown; the specific function of the filter 822 can be referred to Figure 7 The relevant functional description of the voice processing module 722 is shown.

[0319] The signal receiver 823 can receive the positioning signal transmitted by the wearable device 100. In some embodiments, the signal receiver 823 can also determine the strength of the received positioning signal. The signal receiver 823 can send the positioning signal / the signal strength of the positioning signal to the processor 825.

[0320] In some embodiments, the processor 825 may also receive the positioning signal / the signal strength of the positioning signal sent by the signal receiver 823 to determine the positioning data 1, and control the communication module 826 to send the positioning data 1 to the wearable device 100.

[0321] In some embodiments, the processor 825 may also receive the user voice processed by the filter 822 and determine whether the user voice includes a wake-up word or a wake-up-free instruction. If the user issues a wake-up word or a wake-up-free instruction, the processor 825 may also control the communication module 826 to send a wake-up notification to the wearable device 100.

[0322] In some embodiments, the processor 825 can also control the speaker 824 and / or the display screen 827 to output interactive information to achieve Figure 7 The relevant functions of the voice interaction module 725 are shown.

[0323] It is understandable that Figure 8B The embodiment shown is only an example. In the embodiment of the present application, the electronic device 200 may also include more, fewer or different devices than the above embodiment, or the devices in the above embodiment may also be replaced by other devices with the same or similar functions. The present application does not limit this.

[0324] It should be noted that the specific content of the physical device of the electronic device 300 can be referred to Figure 8B The relevant contents of the electronic device 200 in the illustrated embodiment will not be further elaborated in this application.

[0325] Figure 9 A flow chart of a voice interaction method provided in an embodiment of the present application is shown.

[0326] like Figure 9 As shown, the specific process of a voice interaction method provided in an embodiment of the present application may include the following steps:

[0327] S901. The wearable device detects that the user is wearing the wearable device and detects a wake-up event.

[0328] The wearable device may be the wearable device 100 in the above embodiment. Figure 4 The relevant content of step S401 is not repeated here.

[0329] A wearable device includes a signal transmitter; when a user wears the wearable device, the signal transmitter is oriented in a first direction, the angle between the first direction and a second direction is a first value, and the second direction is the orientation of the user's face. In the embodiments of the present application, the orientation of the signal transmitter refers to the direction of the signal emitted by the signal transmitter.

[0330] In a possible implementation, detecting a wake-up event specifically includes: collecting a first voice uttered by a user; and detecting that the first voice includes a wake-up word or a wake-up-free instruction.

[0331] In this way, the wearable device can collect the user's voice and determine whether a wake-up event occurs based on the user's voice.

[0332] In one possible implementation, detecting a wake-up event specifically includes: receiving a first wake-up notification sent by a first electronic device, where the first wake-up notification is used to notify the wearable device that the first electronic device has detected a user issuing a wake-up word or a wake-up-free instruction of the first electronic device.

[0333] In this way, the wearable device can determine whether a wake-up event occurs based on the wake-up notification sent by other electronic devices.

[0334] In one possible implementation, detecting a wake-up event further includes: receiving a second wake-up notification sent by a second electronic device, where the second wake-up notification is used to notify the wearable device that the second electronic device has detected a user issuing a wake-up word or a wake-up-free instruction for the second electronic device.

[0335] In this way, the wearable device can determine whether a wake-up event occurs based on whether it receives wake-up notifications sent by multiple (two or more) electronic devices.

[0336] S902. The wearable device transmits a first signal, where the first signal is directed in a first direction.

[0337] The first signal may be the positioning signal in the above embodiment.

[0338] S903. The wearable device receives the first positioning data sent by the first electronic device.

[0339] The first electronic device may be the electronic device 200 in the above embodiment, and the first positioning data may be the positioning data 1 in the above embodiment.

[0340] S904. The wearable device sends a startup instruction to the first electronic device, where the startup instruction is used to instruct the first electronic device to enable a voice interaction function.

[0341] In some embodiments, the wearable device only receives the first positioning data sent by the first electronic device. In this case, the wearable device can determine that the first electronic device is the optimal response device, which is used to respond to the wake-up event in step S901 and interact with the user by voice. At this time, the wearable device can send a startup instruction to the first electronic device.

[0342] Figure 9 The specific steps in the embodiment shown can refer to the above Figure 4 The relevant steps in the illustrated embodiment will not be repeated here.

[0343] In this way, when the user issues a voice command, the wearable device can send a first directional signal. The wearable device can use the first positioning data sent by the first electronic device in response to the first signal to determine that the first electronic device is within the reception range of the first signal, and then determine that the first electronic device will perform voice interaction with the user.

[0344] In one possible implementation, after transmitting the first signal, the method further includes: receiving second positioning data sent by the second electronic device; and sending a start instruction to the first electronic device, specifically including: when it is determined based on the first positioning data and the second positioning data that the angle between the first electronic device and the second direction is less than the angle between the second electronic device and the second direction, sending a start instruction to the first electronic device.

[0345] The second electronic device may be the electronic device 300 in the above embodiment, and the second positioning data may be the positioning data 2 in the above embodiment. The specific method for the wearable device to determine the optimal response device based on the first positioning data and the second positioning data can refer to the above embodiment. Figure 4-Figure 5 The relevant steps in the illustrated embodiment will not be described in detail in this application.

[0346] In this way, when the user issues a voice command, the wearable device can determine the electronic device with the smallest angle to the user's facial orientation as the optimal response device based on the positioning data sent by multiple electronic devices received, and use it for voice interaction with the user.

[0347] In one possible implementation, the first positioning data includes a first intensity, which is the intensity of the first signal received by the first electronic device; the second positioning data includes a second intensity, which is the intensity of the first signal received by the second electronic device; the first intensity is used to characterize the first angle between the first electronic device and the second direction, and the second intensity is used to characterize the second angle between the second electronic device and the second direction.

[0348] In this way, the angle between the electronic device and the user's facial orientation can be determined based on the strength of the first signal received by the electronic device. It should be noted that when the first value is 0°, the greater the first strength, the smaller the first angle. When the first value is 180°, the greater the first strength, the larger the first angle.

[0349] In a possible implementation, the first positioning data includes a first angle between the first electronic device and the second direction; and the second positioning data includes a second angle between the second electronic device and the second direction.

[0350] In this way, the electronic device can determine the angle between the electronic device and the user's facial orientation based on the received first signal, and send the angle to the wearable device.

[0351] In one possible implementation, the first positioning data also includes the first moment when the first electronic device receives the first signal, and the first moment is used to determine the first distance between the first electronic device and the user; the second positioning data also includes the second moment when the second electronic device receives the first signal, and the second moment is used to determine the second distance between the second electronic device and the user.

[0352] In this way, the wearable device can determine the distance between the electronic device and the wearable device (ie, the user) through the time when the first signal is received and the time when the first signal is sent.

[0353] In a possible implementation, the first positioning data further includes a first distance between the first electronic device and the user; and the second positioning data further includes a second distance between the second electronic device and the user.

[0354] In this way, the electronic device can calculate the distance between the electronic device and the user and send the distance to the wearable device.

[0355] In one possible implementation, determining, based on the first positioning data and the second positioning data, that the angle between the first electronic device and the second direction is smaller than the angle between the second electronic device and the second direction specifically includes: determining, based on the first positioning data and the second positioning data, that the first angle is smaller than the second angle, and the first distance is smaller than a third distance, where the third distance is a preset distance threshold.

[0356] In this way, the wearable device can determine the optimal response device based on the angle between the electronic device and the user's facial orientation and the distance between the electronic device and the user.

[0357] In one possible implementation, the method also includes: turning on the signal transmitter before transmitting the first signal; turning off the signal transmitter when it is detected that the shutdown condition is met, the shutdown condition including any one or more of the following: sending a startup instruction to the first electronic device; detecting that the time period during which the user has not performed voice interaction reaches a first time period; receiving the user's operation to turn off the signal transmitter; receiving a startup success notification sent by the first electronic device, the startup success notification is used to notify the wearable device that the first electronic device has turned on the voice interaction function; receiving a shutdown instruction sent by the first electronic device, the shutdown instruction is used to instruct the wearable device to turn off the signal transmitter.

[0358] In this way, when there is no need to send the first signal, the wearable device can turn off the signal transmitter to save power consumption.

[0359] In a possible implementation, the first value is 0° or 180°.

[0360] It is understandable that the first value may also be other values, such as 5° or 15°.

[0361] Figure 10 A flow chart of another voice interaction method provided in an embodiment of the present application is shown.

[0362] like Figure 10 As shown, the specific process of another voice interaction method provided in an embodiment of the present application may include the following steps:

[0363] S1001. The wearable device detects that a user is wearing the wearable device and detects a wake-up event.

[0364] The wearable device includes a signal transmitter. When a user wears the wearable device, the signal transmitter is oriented in a first direction, the angle between the first direction and a second direction is a first value, and the second direction is the direction of the user's face.

[0365] In a communication network composed of a wearable device, a first electronic device, and a second electronic device, the first electronic device is a master device, and the second electronic device is a slave device.

[0366] The wearable device may be the wearable device 100 in the above embodiment, the first electronic device may be the electronic device 200 in the above embodiment, and the second electronic device may be the electronic device 300 in the above embodiment.

[0367] S1002. The wearable device transmits a first signal, and the direction of the first signal is a first direction.

[0368] The first signal may be the positioning signal in the above embodiment.

[0369] S1003. The first electronic device receives the first signal and determines first positioning data based on the received first signal.

[0370] The first positioning data may be the above Figure 6 Positioning data 1 in the illustrated embodiment.

[0371] S1004. When the first electronic device does not receive the second positioning data sent by the second electronic device, the first electronic device activates a voice interaction function.

[0372] The second positioning data may be the above Figure 6 Positioning data 2 in the embodiment shown.

[0373] In this way, the first electronic device (ie, the main device) can determine that the first electronic device is the best response device when it does not receive positioning data sent by other electronic devices. The best response device is used to perform voice interaction with the user.

[0374] In a possible implementation, the voice interaction method further includes the following steps:

[0375] S1005. The second electronic device receives the first signal and determines second positioning data based on the received first signal.

[0376] S1006. The second electronic device sends second positioning data to the first electronic device.

[0377] S1007. When the first electronic device determines, based on the first positioning data and the second positioning data, that the first angle is smaller than the second angle, the first electronic device activates the voice interaction function, where the first angle is the angle between the first electronic device and the second direction, and the second angle is the angle between the second electronic device and the second direction.

[0378] In this way, when the first electronic device receives positioning data sent by other electronic devices, it can determine the device with the smallest angle with the user's face as the optimal response device based on the multiple positioning data, and the optimal response device is used for voice interaction with the user.

[0379] S1008. When the first electronic device determines based on the first positioning data and the second positioning data that the first angle is greater than or equal to the second angle, the first electronic device sends a startup instruction to the second electronic device, where the startup instruction is used to instruct the second electronic device to enable a voice interaction function.

[0380] S1009. The second electronic device responds to the start instruction and turns on the voice interaction function.

[0381] Figure 10 For details of each step in the embodiment shown, please refer to the above Figure 6 The relevant contents in the illustrated embodiment will not be repeated here.

[0382] In this way, when the first electronic device receives positioning data sent by other electronic devices, it can determine the device with the smallest angle with the user's face as the optimal response device based on the multiple positioning data, and the optimal response device is used for voice interaction with the user.

[0383] The various implementation modes of this application can be combined arbitrarily to achieve different technical effects.

[0384] In the above embodiments, all or part of the embodiments may be implemented by software, hardware, firmware, or any combination thereof. When implemented using software, all or part of the embodiments may be implemented in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described herein are generated. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions may be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions may be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via a wired (e.g., coaxial cable, optical fiber, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) method. The computer-readable storage medium may be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integrated therein. The available medium may be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state drive (SSD)).

[0385] Those skilled in the art will appreciate that all or part of the process steps in the above-described method embodiments can be implemented by a computer program instructing the relevant hardware. The program can be stored in a computer-readable storage medium, and when executed, the program can include the process steps in the above-described method embodiments. The aforementioned storage medium includes various media capable of storing program code, such as ROM or random access memory (RAM), magnetic disks, or optical disks.

[0386] In short, the above description is only an embodiment of the technical solution of the present invention and is not intended to limit the scope of protection of the present invention. Any modifications, equivalent replacements, improvements, etc. made based on the disclosure of the present invention should be included in the scope of protection of the present invention.

Claims

1. A voice interaction method, characterized in that: Applied to a wearable device, the wearable device includes a signal transmitter; when a user wears the wearable device, the signal transmitter is oriented in a first direction, the angle between the first direction and a second direction is a first value, and the second direction is the direction of the user's face; The method comprises: Detecting that the user is wearing a wearable device and a wake-up event is detected; Transmitting a first signal, where the direction of the first signal is the first direction; receiving first positioning data sent by a first electronic device; A startup instruction is sent to the first electronic device, where the startup instruction is used to instruct the first electronic device to enable a voice interaction function.

2. The method according to claim 1, characterized in that After transmitting the first signal, the method further includes: receiving second positioning data sent by a second electronic device; The sending of the startup instruction to the first electronic device specifically includes: When it is determined based on the first positioning data and the second positioning data that the angle between the first electronic device and the second direction is smaller than the angle between the second electronic device and the second direction, the start instruction is sent to the first electronic device.

3. The method according to claim 2, characterized in that The first positioning data includes a first strength, which is the strength of the first signal received by the first electronic device; the second positioning data includes a second strength, which is the strength of the first signal received by the second electronic device; The first intensity is used to characterize a first angle between the first electronic device and the second direction, and the second intensity is used to characterize a second angle between the second electronic device and the second direction.

4. The method according to claim 2, characterized in that The first positioning data includes a first angle between the first electronic device and the second direction; the second positioning data includes a second angle between the second electronic device and the second direction.

5. The method according to claim 3 or 4, characterized in that The first positioning data also includes the first moment when the first electronic device receives the first signal, and the first moment is used to determine the first distance between the first electronic device and the user; the second positioning data also includes the second moment when the second electronic device receives the first signal, and the second moment is used to determine the second distance between the second electronic device and the user.

6. The method according to claim 3 or 4, characterized in that The first positioning data further includes a first distance between the first electronic device and the user; the second positioning data further includes a second distance between the second electronic device and the user.

7. The method according to claim 5 or 6, characterized in that The determining, based on the first positioning data and the second positioning data, that the angle between the first electronic device and the second direction is smaller than the angle between the second electronic device and the second direction specifically includes: It is determined based on the first positioning data and the second positioning data that the first angle is smaller than the second angle, and the first distance is smaller than a third distance, where the third distance is a preset distance threshold.

8. The method according to any one of claims 1 to 7, characterized in that The detecting of the wake-up event specifically includes: The first voice message uttered by the user is collected; It is detected that the first voice includes a wake-up word or a wake-up-free instruction.

9. The method according to any one of claims 1 to 7, characterized in that The detecting of the wake-up event specifically includes: Receive a first wake-up notification sent by the first electronic device, where the first wake-up notification is used to notify the wearable device that the first electronic device detects a user issuing a wake-up word or a wake-up-free instruction for the first electronic device.

10. The method according to claim 9, characterized in that The detecting of a wake-up event further includes: Receive a second wake-up notification sent by the second electronic device, where the second wake-up notification is used to notify the wearable device that the second electronic device has detected a user issuing a wake-up word or a wake-up-free instruction for the second electronic device.

11. The method according to any one of claims 1 to 10, characterized in that The method further comprises: Before transmitting the first signal, turning on the signal transmitter; When it is detected that the shutdown condition is met, the signal transmitter is turned off, and the shutdown condition includes any one or more of the following: sending the startup instruction to the first electronic device; detecting that the time period during which the user has not performed voice interaction reaches a first time period; receiving the user's operation to turn off the signal transmitter; receiving a startup success notification sent by the first electronic device, and the startup success notification is used to notify the wearable device that the first electronic device has turned on the voice interaction function; receiving a shutdown instruction sent by the first electronic device, and the shutdown instruction is used to instruct the wearable device to turn off the signal transmitter.

12. The method according to any one of claims 1 to 11, characterized in that The first value is 0° or 180°.

13. A voice interaction system, characterized in that: The invention comprises a wearable device, a first electronic device, and a second electronic device; the wearable device comprises a signal transmitter, and when a user wears the wearable device, the signal transmitter is oriented in a first direction, the angle between the first direction and a second direction is a first value, and the second direction is the direction of the user's face; The wearable device is used to detect that a user is wearing the wearable device; The wearable device is further configured to detect a wake-up event; The wearable device is further configured to transmit a first signal when detecting that a user is wearing the wearable device and a wake-up event is detected, wherein the direction of the first signal is the first direction; The first electronic device is used to receive the first signal; The first electronic device is further configured to determine first positioning data based on the received first signal; The first electronic device is further configured to enable a voice interaction function when the first electronic device does not receive the second positioning data sent by the second electronic device.

14. The system according to claim 13, wherein: The first electronic device is further configured to receive the second positioning data sent by the second electronic device; The first electronic device is further configured to enable a voice interaction function when it is determined based on the first positioning data and the second positioning data that a first angle is less than a second angle, where the first angle is an angle between the first electronic device and the second direction, and the second angle is an angle between the second electronic device and the second direction; The second electronic device is used to receive the first signal; The second electronic device is further configured to determine the second positioning data based on the received first signal; The second electronic device is further configured to send the second positioning data to the first electronic device.

15. The system according to claim 14, wherein: The first electronic device is further configured to, when it is determined based on the first positioning data and the second positioning data that the first angle is greater than or equal to the second angle, send a start instruction to the second electronic device, wherein the start instruction is used to instruct the second electronic device to enable a voice interaction function; The second electronic device is further configured to receive and respond to the start-up instruction sent by the first electronic device to enable a voice interaction function.

16. A voice interaction system, characterized in that: The invention comprises a wearable device, a first electronic device, and a second electronic device; the wearable device comprises a signal transmitter, and when a user wears the wearable device, the signal transmitter is oriented in a first direction, the angle between the first direction and a second direction is a first value, and the second direction is the direction of the user's face; The wearable device is used to detect that a user is wearing the wearable device; The wearable device is further configured to detect a wake-up event; The wearable device is further configured to transmit a first signal when detecting that a user is wearing the wearable device and a wake-up event is detected, wherein the direction of the first signal is the first direction; The wearable device is further configured to receive first positioning data sent by the first electronic device; The wearable device is further configured to send a startup instruction to the first electronic device, wherein the startup instruction is configured to instruct the first electronic device to enable a voice interaction function; The first electronic device is used to receive the first signal; The first electronic device is further configured to determine the first positioning data based on the received first signal; The first electronic device is further configured to send the first positioning data to the wearable device.

17. The system according to claim 16, wherein: The second electronic device is used to receive the first signal; The second electronic device is further configured to determine the second positioning data based on the received first signal; The second electronic device is further configured to send the first positioning data to the wearable device; The wearable device is further configured to receive second positioning data sent by the second electronic device; The wearable device is further configured to send a startup instruction to the first electronic device, specifically including: The wearable device is further used to send the start-up instruction to the first electronic device when it is determined based on the first positioning data and the second positioning data that the first angle is less than the second angle, where the first angle is the angle between the first electronic device and the second direction, and the second angle is the angle between the second electronic device and the second direction.

18. A wearable device, characterized in that: The wearable device comprises one or more memories, one or more processors, and a signal transmitter; the one or more memories are coupled to the one or more processors, and the one or more memories are used to store computer program codes, and the computer program codes include computer instructions. When the one or more processors execute the computer instructions, the wearable device executes the method described in any one of claims 1 to 12.

19. A readable storage medium comprising instructions, characterized in that: When the instruction is executed on the wearable device, the wearable device executes the method according to any one of claims 1 to 12.

Images