Interaction control method and apparatus, and device, medium and program product

Abstract

An interaction control method (200) and apparatus, and a device, a medium and a program product. The interaction control method (200) comprises: step 210, a wearable device (150) collecting speech information of a user, wherein the wearable device (150) is connected to a plurality of terminal devices (120); step 220, on the basis of at least one of activity states of the plurality of terminal devices (120), the priorities of the plurality of terminal devices (120), and the validity of communication connections between the plurality of terminal devices (120) and the wearable device (150), selecting a first terminal device from among the plurality of terminal devices (120); and step 230, via the communication connection between the wearable device (120) and the first terminal device, sending the collected speech information to the first terminal device.

Description

Method, apparatus, device, medium and program product for interactive control

[0001] The present application claims priority to the Chinese patent application No. 202411310945.3, filed on September 19, 2024, entitled “Method, apparatus, device, medium and program product for interactive control”, the content of which is incorporated herein by reference in its entirety. TECHNICAL FIELD

[0002] Example embodiments of the present disclosure generally relate to the field of computers, and in particular, to a method, apparatus, device, computer-readable storage medium and computer program product for interactive control. BACKGROUND

[0003] A wearable device is a portable device that is directly worn on the body or integrated into a user's clothing or accessories. A wearable device is not just a hardware device, but also a powerful function through software support and data interaction, cloud interaction. Wearable devices will bring great changes to people's lives and perceptions. People expect that the interaction with the wearable device can handle more functions, so that the wearable device can play a greater role. SUMMARY

[0004] In a first aspect of the present disclosure, a method for interactive control is provided. The method is implemented at a wearable device, comprising: collecting, by the wearable device, voice information of a user, the wearable device being connected to a plurality of terminal devices; selecting a first terminal device from the plurality of terminal devices based on at least one of an active state of the plurality of terminal devices, a priority of the plurality of terminal devices, and an effectiveness of a communication connection between the plurality of terminal devices and the wearable device; and sending the collected voice information to the first terminal device via the communication connection between the wearable device and the first terminal device.

[0005] In a second aspect of the present disclosure, a method for interactive control is provided. The method is implemented at a server device, comprising: receiving, from a first terminal device of a plurality of terminal devices, voice information collected by a wearable device, the wearable device being connected to the plurality of terminal devices; determining a reply to the voice information; determining a target device from at least the plurality of terminal devices and the wearable device based on at least one of an active state of the plurality of terminal devices, and a priority of the plurality of terminal devices and the wearable device; and controlling the reply to be sent to the target device for providing to the user.

[0006] In a third aspect of the present disclosure, an apparatus for interaction control is provided. The apparatus includes: an acquisition module configured to acquire voice information of a user by a wearable device, the wearable device being connected to a plurality of terminal devices; a selection module configured to select a first terminal device from the plurality of terminal devices based on at least one of an active state of the plurality of terminal devices, a priority of the plurality of terminal devices, and an effectiveness of a communication connection between the plurality of terminal devices and the wearable device; and a sending module configured to send the acquired voice information to the first terminal device via the communication connection between the wearable device and the first terminal device.

[0007] In a fourth aspect of the present disclosure, an apparatus for interaction control is provided. The apparatus includes: a voice receiving module configured to receive voice information acquired by a wearable device from a first terminal device of a plurality of terminal devices, the wearable device being connected to the plurality of terminal devices; a reply determining module configured to determine a reply to the voice information; a target device determining module configured to determine at least a target device from at least the plurality of terminal devices and the wearable device based on at least one of an active state of the plurality of terminal devices, and a priority of the plurality of terminal devices and the wearable device; and a reply sending module configured to control sending of the reply to the target device for providing to the user.

[0008] In a fifth aspect of the present disclosure, an electronic device is provided. The device includes at least one processor; and at least one memory coupled to the at least one processor and storing instructions for execution by the at least one processor. The instructions, when executed by the at least one processor, cause the electronic device to perform the method of the first aspect.

[0009] In a sixth aspect of the present disclosure, a computer-readable storage medium is provided. The medium has stored thereon computer-executable instructions that, when executed by a processor, implement the method of the first aspect.

[0010] According to a seventh aspect of the present disclosure, a computer program product is provided, comprising computer-executable instructions, wherein the computer-executable instructions, when executed by a processor, implement the method according to the first aspect of the present disclosure.

[0011] It should be understood that nothing in this section is intended to limit the key or critical features of the embodiments of the present disclosure or limit the scope of the present disclosure. Other features of the present disclosure will become apparent from the following description. BRIEF DESCRIPTION OF DRAWINGS

[0012] The above and other features, aspects and advantages of embodiments of the present disclosure will become more apparent from the following description in conjunction with the accompanying drawings. In the drawings, the same or similar reference numerals designate the same or similar elements, wherein: a first terminal device from the plurality of terminal devices based on at least one of an active state of the plurality of terminal devices, a priority of the plurality of terminal devices, and an effectiveness of a communication connection between the plurality of terminal devices and the wearable device; and a sending module configured to send the acquired voice information to the first terminal device via the communication connection between the wearable device and the first terminal device.

[0007] In a fourth aspect of the present disclosure, an apparatus for interaction control is provided. The apparatus includes: a voice receiving module configured to receive voice information acquired by a wearable device from a first terminal device of a plurality of terminal devices, the wearable device being connected to the plurality of terminal devices; a reply determining module configured to determine a reply to the voice information; a target device determining module configured to determine at least a target device from at least the plurality of terminal devices and the wearable device based on at least one of an active state of the plurality of terminal devices, and a priority of the plurality of terminal devices and the wearable device; and a reply sending module configured to control sending of the reply to the target device for providing to the user.

[0008] In a fifth aspect of the present disclosure, an electronic device is provided. The device includes at least one processor; and at least one memory coupled to the at least one processor and storing instructions for execution by the at least one processor. The instructions, when executed by the at least one processor, cause the electronic device to perform the method of the first aspect.

[0009] In a sixth aspect of the present disclosure, a computer-readable storage medium is provided. The medium has stored thereon computer-executable instructions that, when executed by a processor, implement the method of the first aspect.

[0010] According to a seventh aspect of the present disclosure, a computer program product is provided, comprising computer-executable instructions, wherein the computer-executable instructions, when executed by a processor, implement the method according to the first aspect of the present disclosure.

[0011] It should be understood that nothing in this section is intended to limit the key or critical features of the embodiments of the present disclosure or limit the scope of the present disclosure. Other features of the present disclosure will become apparent from the following description. BRIEF DESCRIPTION OF DRAWINGS

[0012] The above and other features, aspects and advantages of embodiments of the present disclosure will become more apparent from the following description in conjunction with the accompanying drawings. In the drawings, the same or similar reference numerals designate the same or similar elements, wherein:

[0013] FIG. 1 shows a schematic diagram of an example environment in which embodiments of the present disclosure can be implemented;

[0014] FIG. 2A shows a flowchart of a process implemented at a wearable device for interactive control, according to some embodiments of the present disclosure;

[0015] FIG. 2B shows a schematic diagram of an example architecture of a terminal device for determining to receive voice information, according to some embodiments of the present disclosure;

[0016] FIG. 3 shows a flowchart of a process implemented at a server device for interactive control, according to some embodiments of the present disclosure;

[0017] FIG. 4 shows a flowchart of a process for determining a target device to provide a reply, according to some embodiments of the present disclosure;

[0018] FIG. 5 shows a schematic structural block diagram of an apparatus for interactive control, according to some embodiments of the present disclosure;

[0019] FIG. 6 shows a schematic structural block diagram of an apparatus for interactive control, according to some embodiments of the present disclosure; and

[0020] FIG. 7 shows a block diagram of an electronic device that can implement one or more embodiments of the present disclosure. DETAILED DESCRIPTION

[0021] Embodiments of the present disclosure will be described below in greater detail with reference to the accompanying drawings. While certain embodiments of the present disclosure are shown in the drawings, it is understood that the present disclosure can be embodied in various forms and should not be interpreted as being limited to the embodiments set forth herein; rather, these embodiments are provided so that the present disclosure can be more thoroughly and completely understood. It should be understood that the drawings and embodiments of the present disclosure are only for exemplary purposes and are not intended to limit the scope of protection of the present disclosure.

[0022] In the description of embodiments of the present disclosure, the term "include" and its derivatives shall not be construed as "consist only of", that is, "including but not limited to". The term "based on" shall be construed as "based at least in part on". The term "one embodiment" or "the embodiment" shall be construed as "at least one embodiment". The term "some embodiments" shall be construed as "at least some embodiments". Other explicit and implicit definitions can also be included below.

[0023] In this document, unless explicitly stated otherwise, performing a step "in response to" A does not mean that the step is performed immediately after A, but can include one or more intermediate steps.

[0024] It can be understood that the data involved in the technical solutions of the present disclosure (including but not limited to the data itself, the obtaining, use, storage or deletion of the data) should comply with the requirements of the corresponding laws and regulations and relevant provisions.

[0025] It can be understood that before using the technical solutions disclosed in the embodiments of the present disclosure, the type of information involved in the present disclosure, the use range, use scenario, etc. should be informed to the relevant user and the authorization of the relevant user should be obtained through appropriate means according to relevant laws and regulations, wherein the relevant user can include any type of right subject, such as an individual, an enterprise or a group.

[0026] For example, in response to receiving the active request of the user, the prompt information is sent to the relevant user to explicitly prompt the relevant user that the operation requested to be performed will require obtaining and using the information of the relevant user, so that the relevant user can voluntarily choose whether to provide the information to the software or hardware such as electronic device, application program, server or storage medium, etc. performing the operation of the technical solutions of the present disclosure according to the prompt information.

[0027] As an optional but non-limiting implementation manner, in response to receiving the active request of the relevant user, the prompt information is sent to the relevant user in the form of a pop-up window, and the prompt information can be presented in the form of text in the pop-up window. In addition, the pop-up window can also carry selection controls for the user to select "agree" or "disagree" to provide information to the electronic device.

[0028] It can be understood that the above notification and user authorization process is only illustrative and does not limit the implementation manner of the present disclosure, and other manners meeting the relevant laws and regulations can also be applied to the implementation manner of the present disclosure.

[0029] As used herein, the term "model" can learn the association between the corresponding input and output from the training data, so that the corresponding output can be generated for a given input after the training is completed. The generation of the model can be based on machine learning technology. Deep learning is a machine learning algorithm that processes input and provides corresponding output by using multiple layers of processing units. The neural network model is an example of a model based on deep learning. In this paper, "model" can also be referred to as "machine learning model", "learning model", "machine learning network" or "learning network", which are used interchangeably in this paper.

[0030] A“neural network” is a machine learning network based on deep learning. A neural network is capable of processing inputs and providing corresponding outputs, which generally includes an input layer and an output layer and one or more hidden layers between the input layer and the output layer. Neural networks used in deep learning applications often include many hidden layers, increasing the depth of the network. The layers of a neural network are connected in sequence, such that the output of a previous layer is provided as input to a subsequent layer, with the input layer receiving the input to the neural network and the output of the output layer as the final output of the neural network. Each layer of the neural network includes one or more nodes (also referred to as processing nodes or neurons), each of which processes inputs from the previous layer.

[0031] Generally, machine learning can include three stages, namely a training stage, a testing stage, and an application stage (also referred to as an inference stage). In the training stage, a given model can be trained using a large amount of training data, iteratively updating parameter values until the model is able to derive consistent inferences from the training data that meet an expected objective. Through training, the model can be considered to have learned an association (also referred to as a mapping) from input to output from the training data. The parameter values of the trained model are determined. In the testing stage, test inputs are applied to the trained model to test whether the model is able to provide correct outputs, thereby determining the performance of the model. In the application stage, the model can be used to process actual inputs based on the trained parameter values to determine corresponding outputs.

[0032] FIG. 1 illustrates a schematic diagram of an example environment 100 in which embodiments of the present disclosure can be implemented. The example environment 100 includes a plurality of terminal devices 120 (which can include a terminal device 120-1, a terminal device 120-2,..., and a terminal device 120-N, where N is a positive integer). Each of the terminal devices is installed with a digital assistant, e.g., the terminal device 120-1 is installed with a digital assistant 130-1, the terminal device 120-2 is installed with a digital assistant 130-2,..., and the terminal device 120-N is installed with a digital assistant 130-N. The digital assistants can assist a user 140 in processing tasks. The digital assistants can have the capability of conversing with the user and processing tasks.

[0033] In the environment 100, the user 140 can implement interactive operations by wearing at least one wearable device 150. In some embodiments, the wearable device 150 can include a ring, a watch, a bracelet, a handle, a glove, a finger sleeve, glasses, a brooch, and the like, which can be worn on various parts of the human body. In addition, the wearable device 150 can also be referred to as a wearable interactive device.

[0034] In some embodiments, the user 140 can wake up the digital assistant through the wearable device 150 and input voice commands to the wearable device 150, thereby enabling interaction with the digital assistant. In such embodiments, the wearable device 150 is equipped with a sound receiving device, such as a microphone.

[0035] In some embodiments, the user 140 can interact with the digital assistant via the plurality of terminal devices 120 and / or attached devices of the plurality of terminal devices 120. Such attached devices can include, for example, an audio output device (e.g., a headset) for outputting voice replies corresponding to voice commands. In some embodiments, the plurality of terminal devices 120 can also present text replies corresponding to voice commands through a user interface. In some embodiments, voice replies can also be provided to the wearable device 150 for playing by the wearable device 150. In such cases, the wearable device 150 can be equipped with an audio output device, such as a speaker.

[0036] In some embodiments, the digital assistant 130-N can utilize machine learning models (which can include one or more machine learning models) to support the user 140’s control of the terminal devices 120-N. For example, the digital assistant can utilize one or more machine learning models to provide a question-answering service to the user 140. It should be appreciated that the machine learning models can be different types of models.

[0037] In some embodiments, the plurality of terminal devices 120 communicate with the server device 110 to enable the provision of services of the digital assistant of the plurality of terminal devices 120 and / or other services at the plurality of terminal devices 120. The server device 110 can invoke machine learning models to support the interaction between the digital assistant 130-N and the user 140 based on the output of the machine learning models. For example, upon receiving a voice command of the user 140 to the digital assistant 130-N, the terminal device 120-N can request the server device 110 to determine or assist in determining a voice reply to the voice command. The server device 110 can send the voice reply or related information for determining the voice reply to a certain terminal device of the plurality of terminal devices 120.

[0038] The terminal device can be any type of mobile terminal, fixed terminal, or portable terminal including a mobile handset, a desktop computer, a laptop computer, a notebook computer, a netbook computer, a tablet computer, a media player, a multimedia player, a personal navigation device, a personal digital assistant (PDA), an audio / video player, a digital camera / camcorder, a positioning device, a television receiver, a radio broadcast receiver, an electronic book device, a game device, or any combinations of these devices, including accessories and peripherals for these devices, or any combinations thereof. In some embodiments, the terminal device 120 can also support any type of interface to the user (such as "wearable" circuitry, etc.).

[0039] The server device 110 can be various types of computing systems / servers capable of providing computing capabilities, including but not limited to mainframes, edge computing nodes, computing devices in a cloud environment, etc. The server device 110 can be implemented based on a cloud environment, for example.

[0040] It should be understood that the structure and function of the various elements in the environment 100 are described for illustrative purposes only, without implying any limitation on the scope of the present disclosure.

[0041] As mentioned previously, it is expected that the interaction with the wearable device can handle more functions, making the wearable device play a greater role, so as to meet the needs of the user in various scenarios and provide a better interaction experience for the user.

[0042] Embodiments of the present disclosure provide a scheme for interaction control. In the scheme, at the wearable device, voice information of a user is collected by the wearable device, the wearable device being connected to a plurality of terminal devices. Based on at least one of an active state of the plurality of terminal devices, a priority of the plurality of terminal devices, and an effectiveness of a communication connection between the plurality of terminal devices and the wearable device, a first terminal device is selected from the plurality of terminal devices. The collected voice information is sent to the first terminal device via the communication connection between the wearable device and the first terminal device. At the server device, the voice information collected by the wearable device is received from the first terminal device of the plurality of terminal devices, the wearable device being connected to the plurality of terminal devices. A reply to the voice information is determined. Based on at least one of the active state of the plurality of terminal devices, and the priority of the plurality of terminal devices and the wearable device, a target device is determined from at least the plurality of terminal devices and the wearable device. The reply is controlled to be sent to the target device for providing to the user.

[0043] In this way, by selecting one terminal device from the plurality of terminal devices to receive the voice information of the user, and determining the target device from the plurality of terminal devices and the wearable device at least to provide the reply to the voice information to the user, the fluency of the interaction can be ensured in the case that the wearable device is connected to the plurality of terminal devices, to support the user to smoothly perform the voice interaction. In addition, this can be compatible with various use scenarios of the plurality of terminal devices, and fully meet the needs of the user to work, study, entertain and the like by using the plurality of terminal devices. By enabling the user to interact with the wearable device and the plurality of terminal devices in the voice manner, the interaction convenience and speed of the user are effectively improved.

[0044] Some example embodiments of the present disclosure will be described in detail below with reference to examples of the accompanying drawings.

[0045] FIG. 2A shows a flowchart of a process 200 for interaction control implemented at a wearable device according to some embodiments of the present disclosure. For ease of discussion, the process 200 will be described with reference to the environment 100 of FIG. 1. The process 200 can be implemented at the wearable device 150 of FIG. 1.

[0046] At block 210, voice information of the user 140 is collected by the wearable device 150, and the wearable device 150 is connected to the plurality of terminal devices 120. In some embodiments, the wearable device 150 can include a ring. In other embodiments, the wearable device 150 can also include a watch, a bracelet, a handle, a glove, a finger sleeve, glasses, a brooch, and the like, which can be worn on various parts of the human body. It should be understood that such wearable devices 150 can belong to smart devices. For example, the ring of the embodiments of the present disclosure can be a smart ring.

[0047] In some embodiments, each terminal device (such as the terminal device 120-1, the terminal device 120-2, …, the terminal device 120-N, where N is a positive integer) in the plurality of terminal devices 120 can be communicatively connected to the wearable device 150 in a Bluetooth connection or other wireless communication connection manner, or in a wired communication connection manner. By using the Bluetooth connection or other wireless communication connection manner, the convenience of the interaction can be improved, and the interaction scenarios can be made more extensive.

[0048] In some embodiments, the wearable device 150 can be configured with a microphone, a speaker, and the like, to facilitate providing voice interaction services for the user 140. Through the microphone on the wearable device 150, the voice information of the user 140 can be collected. The voice information can include, for example, questions of the user 140, recordings, voice calls, and wake-up words for waking up a digital assistant of a terminal device, and the like.

[0049] At block 220, the wearable device 150 selects a first terminal device 120 from the plurality of terminal devices 120 based on at least one of the active status of the plurality of terminal devices 120, the priority of the plurality of terminal devices 120, and the validity of the communication connection between the plurality of terminal devices 120 and the wearable device 150.

[0050] In some cases, the first terminal device can be selected from the plurality of terminal devices 120 based on all of the active status of the plurality of terminal devices 120, the priority of the plurality of terminal devices 120, and the validity of the communication connection between the plurality of terminal devices 120 and the wearable device 150. Specific embodiments of selecting the first terminal device from the plurality of terminal devices 120 based on all of the three conditions will be discussed in detail below.

[0051] In some other cases, the first terminal device can be selected from the plurality of terminal devices 120 based on one of the active status of the plurality of terminal devices 120, the priority of the plurality of terminal devices 120, and the validity of the communication connection between the plurality of terminal devices 120 and the wearable device 150.

[0052] As an example, if the first terminal device is to be selected from the plurality of terminal devices 120 based on the validity of the communication connection between the plurality of terminal devices 120 and the wearable device 150, the first terminal device can be selected from the terminal devices 120 whose communication connection with the wearable device 150 is valid. For example, if only one terminal device has a valid communication connection with the wearable device 150, the terminal device with the valid communication connection can be selected as the first terminal device. As another example, if all of the plurality of terminal devices 120 have valid communication connections with the wearable device 150, one of the terminal devices can be randomly selected as the first terminal device, and the wearable device 150 can be caused to send the collected voice information to the selected first terminal device. It should be understood that this is merely an example and is not intended to be limiting in any way.

[0053] As another example, if the first terminal device is to be selected from the plurality of terminal devices 120 based on the priority of the plurality of terminal devices 120, the first terminal device can be selected in an order from high to low priority of the plurality of terminal devices 120. For example, a terminal device with the highest priority can be selected as a current first terminal device, and the wearable device 150 can be caused to send the collected voice information to the current first terminal device. If the sending is successful, the terminal device with the highest priority can be determined as the first terminal device. If the sending fails, a terminal device with a next priority (e.g., a second priority) can be selected as the first terminal device, and similar operations can be repeated in sequence. It should be understood that this is merely an example and is not intended to be limiting in any way.

[0054] As a further example, if the first terminal device is to be selected from the plurality of terminal devices 120 based on the active state of the plurality of terminal devices 120, the first terminal device can be selected from among the terminal devices of the plurality of terminal devices 120 that are in the active state. For example, when only one terminal device is in the active state, the active terminal device can be selected as the first terminal device. As another example, when the plurality of terminal devices 120 are all in the active state, one terminal device can be randomly selected as the first terminal device, and the wearable device 150 can be caused to send the collected voice information to the selected first terminal device. It should be understood that this is merely an example and is not intended to impose any limitation. The following embodiments will discuss in detail the specific manner of determining the active state of the plurality of terminal devices 120.

[0055] It should be understood that in other cases, the first terminal device can also be selected from the plurality of terminal devices 120 based on any two of the active state of the plurality of terminal devices 120, the priority of the plurality of terminal devices 120, and the effectiveness of the communication connection between the plurality of terminal devices 120 and the wearable device 150, which will not be repeated here.

[0056] In some embodiments, the active state of a given terminal device 120-n (where n is a positive integer, and n ranges from 1 to N) of the plurality of terminal devices 120 can be determined in the following manner: if it is determined that the given terminal device 120-n is in the unlocked state or the use state, the wearable device 150 can determine that the given terminal device 120-n is in the active state. If it is determined that the given terminal device 120 is in the lock screen state or the sleep state, the wearable device 150 can determine that the given terminal device 120-n is not in the active state.

[0057] In such embodiments, the manner of determining the active state can be different for different types of given terminal devices 120-n (which can also be a terminal device of the plurality of terminal devices 120).

[0058] Taking the type of the given terminal device 120-n as a computer as an example, if the given terminal device 120-n is turned on, and if the given terminal device 120-n is in the unlocked state (the computer is not in the use state, nor in the sleep state) or the use state, it can be determined that it is in the active state. If the given terminal device 120-n is in the sleep state, it can be determined that it is not in the active state.

[0059] Taking the type of the given terminal device 120-n as a mobile phone as an example, if the given terminal device 120-n is turned on, and if the given terminal device 120-n is in the unlocked state (the mobile phone screen is on for a long time, but the mobile phone is not in use) or the use state, it can be determined that it is in the active state. If the given terminal device 120-n is in the lock screen state, it can be determined that it is not in the active state.

[0060] It should be appreciated that the active status of a given terminal device 120-n can be determined in other manners without limitation.

[0061] In some embodiments, the active status of a given terminal device 120-n among the plurality of terminal devices 120 can be determined in the following manner: the wearable device 150 can receive a status message from the given terminal device 120-n, the status message can indicate the status of the given terminal device 120-n, and determine whether the given terminal device 120-n is in or not in the active status based on the status message. In some embodiments, the status message can be directly generated by the given terminal device 120-n according to the status of the given terminal device 120-n itself. In other embodiments, the status message can be generated by the digital assistant 130-n of the given terminal device 120-n based on the status of the given terminal device 120-n after the status of the given terminal device 120-n is acquired.

[0062] In such embodiments, the wearable device 150 receiving the status message from the given terminal device 120-n can be in various cases. In one case, the given terminal device 120-n can actively send the status message to the wearable device 150, the status message can indicate that the given terminal device 120-n is in the active status or not in the active status. This way of the given terminal device 120-n actively reporting its active status can keep its active status in maintenance. In another case, the wearable device 150 can request the given terminal device 120-n to send the status message, and then the given terminal device 120-n can respond to the request and send the status message to the wearable device 150. It should be appreciated that the above two cases are merely examples, and other cases of the wearable device 150 receiving the status message from the given terminal device 120-n are also possible without any limitation.

[0063] In some embodiments, when selecting the first terminal device from the plurality of terminal devices 120, if it is determined that at least two terminal devices among the plurality of terminal devices 120 are in the active status and the communication connection between the at least two terminal devices and the wearable device 150 is valid, the wearable device 150 can select the first terminal device from the at least two terminal devices based on the priority of the at least two terminal devices.

[0064] Here, the first terminal device is selected from the plurality of terminal devices 120 based on the active status of the plurality of terminal devices 120, the priority of the plurality of terminal devices 120, and the validity of the communication connection between the plurality of terminal devices 120 and the wearable device 150.

[0065] In such embodiments, if at least two terminal devices (which can also be the plurality of terminal devices 120) of the plurality of terminal devices 120 are in the active state and the communication connection between the at least two terminal devices and the wearable device 150 is valid, the first terminal device can be selected from the at least two terminal devices in order of the priority of the at least two terminal devices from high to low. In some embodiments, different types of terminal devices can have different priorities, and the same type of terminal devices can allow the user 140 to set or otherwise determine the respective priority, which is not limited herein.

[0066] For example, assuming that the plurality of terminal devices 120 includes one mobile phone and three computers (computer 1, computer 2, and computer 3), and that the computer 3 is not in the active state and / or the communication connection between the computer 3 and the wearable device 150 is not valid, and the mobile phone, the computer 1, and the computer 2 are in the active state and the communication connection between the mobile phone, the computer 1, and the computer 2 and the wearable device 150 is valid, the first terminal device can be selected from the mobile phone, the computer 1, and the computer 2 based on the priority of the mobile phone, the computer 1, and the computer 2. Assuming that the priority of the computer is higher than the priority of the mobile phone, and that the priority of the computer 1 is higher than the priority of the computer 2, it can be determined that the computer 1 is selected as the first terminal device.

[0067] In some embodiments, when selecting the first terminal device from the plurality of terminal devices 120, if it is determined that the first terminal device is in the active state and the communication connection between the first terminal device and the wearable device 150 is valid, and other terminal devices of the plurality of terminal devices 120 are not in the active state and / or the communication connection between the other terminal devices and the wearable device 150 is not valid, the wearable device 150 can select the first terminal device.

[0068] In such embodiments, if only one terminal device of the plurality of terminal devices 120 is in the active state and the communication connection between the one terminal device and the wearable device 150 is valid, and other terminal devices are not in the active state and / or the communication connection between the other terminal devices and the wearable device 150 is not valid, the one terminal device can be determined as the first terminal device.

[0069] Therefore, by selecting the first terminal device from the plurality of terminal devices based on at least one of the active state of the plurality of terminal devices, the priority of the plurality of terminal devices, and the validity of the communication connection between the plurality of terminal devices and the wearable device, the accuracy of the interaction can be ensured and the user experience can be improved under sufficient judgment.

[0070] At block 230, the wearable device 150 sends the collected voice information to the first terminal device via the communication connection between the wearable device 150 and the first terminal device. At this time, the communication connection between the wearable device 150 and the first terminal device is valid.

[0071] FIG. 2B illustrates a schematic diagram of an example architecture 250 for determining a terminal device to receive the voice information, according to some embodiments of the present disclosure. In the architecture 250, there can be a state machine inside the wearable device 150 to maintain the active states of the connected plurality of terminal devices 120 (which can include terminal device 120-1, terminal device 120-2,..., terminal device 120-N). When the user 140 speaks to the wearable device 150 to wake up the digital assistant, the wearable device 150 can select one terminal device (e.g., terminal device 120-1) to send the voice information based on the active states of the plurality of terminal devices 120 maintained by the internal state machine, the priorities of the plurality of terminal devices 120, and the validity of the communication connection between the plurality of terminal devices 120 and the wearable device 150.

[0072] Thus, the embodiments of the present disclosure can select one terminal device from the plurality of terminal devices to send the collected voice information of the user to the selected terminal device, to wake up the digital assistant of the terminal device, in the case that the wearable device is connected to the plurality of terminal devices.

[0073] In some embodiments, via the communication connection between the wearable device 150 and the second terminal device of the plurality of terminal devices 120, the wearable device 150 can receive the reply to the voice information and play the voice corresponding to the reply.

[0074] In such embodiments, the wearable device 150 can receive the reply to the voice information from the second terminal device. The second terminal device can be different from the first terminal device, i.e., the terminal device used to generate the reply to the voice information can be different from the terminal device used to receive the collected voice information. It should be appreciated that the second terminal device can also be the same as the first terminal device, i.e., the same terminal device receives the collected voice information and generates the reply to the voice information.

[0075] In some embodiments, the wearable device 150 is configured with a speaker to play the voice content corresponding to the reply. In other embodiments, the voice content corresponding to the reply can be played through the second terminal device or an audio output device (e.g., earphone, etc.) attached to the second terminal device. In addition, if the second terminal device is a computer, the text content corresponding to the reply can also be presented on the interface of the computer, which can not require playing the voice content corresponding to the reply.

[0076] The specific manners of determining the terminal device to generate the reply to the voice information and determining the device to output the reply will be discussed in detail below.

[0077] FIG. 3 illustrates a flowchart of a process 300 for interaction control implemented at a server device, according to some embodiments of the present disclosure. For ease of discussion, the process 300 will be described with reference to the environment 100 of FIG. 1. The process 300 can be implemented at the server device 110 of FIG. 1.

[0078] At block 310, the server device 110 receives, from a first terminal device of a plurality of terminal devices 120, voice information collected by a wearable device 150 connected to the plurality of terminal devices 120.

[0079] As discussed above, the voice information of the user is collected by the wearable device 150 and sent to the first terminal device. Here, the first terminal device sends the voice information to the server device 110, and accordingly, the server device 110 receives the voice information. The manner of communication connection between the wearable device 150 and the plurality of terminal devices 120 has also been discussed above, and will not be repeated here.

[0080] At block 320, the server device 110 determines a reply to the voice information. As an example, the reply to the voice information determined by the server device 110 can be generated by the server device 110 itself. As another example, the reply determined by the server device 110 can be generated by a terminal device (e.g., the first terminal device) of the plurality of terminal devices 120 and sent to the server device 110 by the terminal device.

[0081] At block 330, based on at least one of the active status of the plurality of terminal devices 120 and the priority of the plurality of terminal devices 120 and the wearable device 150, the server device 110 determines a target device from at least the plurality of terminal devices 120 and the wearable device 150. Here, the target device is configured to output the reply to the voice information to provide to the user 140.

[0082] In some embodiments, in determining the target device, the server device 110 can also determine the target device from the plurality of terminal devices 120, the wearable device 150, and an attached audio output device based on whether each of the plurality of terminal devices 120 is attached to a corresponding audio output device. The audio output device can include, for example, a headset or other speaker, etc. Such an audio output device can be attached to the corresponding terminal device in a wired manner or a wireless manner.

[0083] Based on this, the server device 110 can determine the target device from the plurality of terminal devices 120, the wearable device 150, and the attached audio output device based on at least one of the active status of the plurality of terminal devices 120 and the priority of the plurality of terminal devices 120 and the wearable device 150.

[0084] In some cases, the target device can be determined from the plurality of terminal devices 120, the wearable device 150, and the attached audio output device based on both the active status of the plurality of terminal devices 120 and the priority of the plurality of terminal devices 120 and the wearable device 150. Determining the target device from the plurality of terminal devices 120, the wearable device 150, and the attached audio output device based on both conditions will be discussed in detail below.

[0085] In some other cases, the target device can be determined from the plurality of terminal devices 120, the wearable device 150, and the attached audio output device based on one of the active status of the plurality of terminal devices 120 and the priority of the plurality of terminal devices 120 and the wearable device 150.

[0086] As an example, if the target device is to be determined from the plurality of terminal devices 120, the wearable device 150, and the attached audio output device based on the active status of the plurality of terminal devices 120, the wearable device 150 can be directly selected as the target device when none of the plurality of terminal devices 120 is in the active status. If several terminal devices of the plurality of terminal devices 120 are in the active status and none of them is attached with an audio output device, one of the several terminal devices can be randomly selected as the target device. If the several terminal devices are collectively attached with one audio output device, the audio output device can be determined as the target device. It should be understood that this is only an example, and other cases can also exist in actual use, which will not be described here.

[0087] As an example, if the target device is to be determined from the plurality of terminal devices 120, the wearable device 150, and the attached audio output device based on the priority of the plurality of terminal devices 120 and the wearable device 150, the wearable device 150 can be directly determined as the target device when the priority of the wearable device 150 is the highest. If the priority of the wearable device 150 is the lowest, the target device can be determined from the plurality of terminal devices 120 and the attached audio output device in the order of the priority of the plurality of terminal devices 120 from high to low. For example, if the terminal device with the highest priority is not attached with an audio output device, it can be determined as the target device. If the terminal device with the highest priority is attached with an audio output device, the audio output device can be determined as the target device. It should be understood that this is only an example, and other cases can also exist in actual use, which will not be described here.

[0088] In other embodiments, in addition to the active status of the plurality of terminal devices 120 and / or the priority of the plurality of terminal devices 120 and the wearable device 150, other conditions can also be used to determine the target device from at least the plurality of terminal devices 120 and the wearable device 150.

[0089] In some embodiments, based on the historical interactions of the user 140 with the plurality of terminal devices 120, the server device 110 can determine the priority of the plurality of terminal devices 120. In some embodiments, alternatively or additionally, based on the interaction events detected in at least one terminal device of the plurality of terminal devices 120 within a predetermined time window of receiving the voice information, the server device 110 can determine the priority of the plurality of terminal devices 120. In some embodiments, alternatively or additionally, based on whether the reply indicates an operation performed by a specific terminal device of the plurality of terminal devices 120, the server device 110 can determine the priority of the plurality of terminal devices 120. It should be understood that the manner of determining the priority of the plurality of terminal devices 120 can also be any other appropriate manner, which is not limited herein.

[0090] In some embodiments, when determining the priority of the plurality of terminal devices 120 based on the historical interactions, the server device 110 can determine the terminal device of the plurality of terminal devices 120 that has been interacted with most recently, and set the highest priority for the terminal device that has been interacted with most recently.

[0091] As an example, when determining the terminal device of the plurality of terminal devices 120 that has been interacted with most recently, the server device 110 can first determine the most recent interaction time of the plurality of terminal devices 120, then select the terminal device with the closest interaction time to the current time, and set the highest priority for the selected terminal device. The most recent interaction time of the plurality of terminal devices 120 can be determined based on the touch interaction time, the time of mouse slide click, or other interaction time. As an example, the respective digital assistants 130 of the plurality of terminal devices 120 can obtain the corresponding most recent interaction time, and send to the server device 110 via the respective terminal devices. It should be understood that these are only examples, and are not intended to be any limitation.

[0092] In some embodiments, when determining the priority of the plurality of terminal devices 120 based on the detected interaction events, if the server device 110 detects a preset interaction event in at least one terminal device within a predetermined time window of receiving the voice information (which can be a time range before and after receiving the voice information), the server device 110 can set a higher priority for the at least one terminal device. Then, the highest priority for a terminal device of the at least one terminal device can be set according to any other appropriate manner. For example, the highest priority for a terminal device of the at least one terminal device can be further set according to the above-mentioned manner of determining the historical interactions or the pre-setting of the user 140, etc. It should be understood that this is only an example, which is not limited herein.

[0093] In some embodiments, there can be different preset interaction events for different types of terminal devices. For example, if the type of the at least one terminal device is a personal computer, the preset interaction events can include, but are not limited to, that the user 140 selects a portion of text on the user interface of the computer by a mouse or touchpad, that an input box on the computer is focused (e.g., a cursor is in the input box), that a floating window of the digital assistant is presented on the user interface of the computer, etc. In addition, if the type of the at least one terminal device is a mobile phone, it can also have preset interaction events, which are not described herein again.

[0094] In some embodiments, when determining the priority of the plurality of terminal devices 120 based on whether the reply indicates an operation performed by a specific terminal device, the service-side device 110 can set the highest priority for the specific terminal device if the reply indicates the operation performed by the specific terminal device. As an example, if the reply does not indicate the operation performed by the specific terminal device, the service-side device 110 can determine the operation capability of the plurality of terminal devices 120 based on the voice information to determine a terminal device suitable for performing the operation corresponding to the voice information, and set the highest priority for the terminal device. It should be understood that this is only an example and is not intended to be any limitation.

[0095] In some embodiments, different types of terminal devices can have different operation capabilities and be able to perform different specific operations. For example, if the terminal device is a personal computer, the specific operations that it can perform can include, but are not limited to, searching for a file from a specified hard disk partition, opening a specific large drawing application, etc. For example, if the terminal device is a mobile phone, the specific operations that it can perform can include, but are not limited to, adjusting different photographing modes, opening a specific payment method, etc. In addition, if the operation capabilities of the plurality of terminal devices 120 are the same, the priority of the plurality of terminal devices 120 can be determined according to the above manners of determining the historical interaction or detecting the interaction event. It should be understood that the priority of the plurality of terminal devices 120 can also be determined according to other appropriate manners.

[0096] By determining the priority of the plurality of terminal devices 120 in the above manners, the selection intention of the user for the device outputting the reply can be effectively determined, and the convenience and speed of the user's interaction can be improved. In addition, the above manners of determining the priority of the plurality of terminal devices 120 can be dynamically adjusted according to actual situations to meet actual needs.

[0097] FIG. 4 illustrates a flowchart of a process 400 for determining a target device to provide a reply according to some embodiments of the present disclosure. The process 400 can be implemented at the server device 110 of FIG. 1. The process 400 can be a specific implementation of the steps of block 330 in the process 300. The determination of a target device from the plurality of terminal devices 120, the wearable device 150, and the attached audio output device based on the active status of the plurality of terminal devices 120 and the priority of the plurality of terminal devices 120 and the wearable device 150 is discussed in detail below with reference to FIG. 4.

[0098] In the process 400, it is first determined whether there is at least one terminal device 120 in the plurality of terminal devices 120 that is in an active state (410). In some embodiments, if it is determined that none of the plurality of terminal devices 120 is in an active state and none of the plurality of terminal devices 120 is attached to an audio output device (415), the server device 110 can determine the wearable device 150 as the target device (420). By way of example, in a specific application scenario, the user 140 is walking on the road, and all of the plurality of terminal devices 120 are locked (e.g., a personal computer is put in a backpack, a mobile phone is put in a pocket), and no earphone is worn. In this case, the wearable device 150 can be used to play the voice content corresponding to the reply.

[0099] In some embodiments, if it is determined that none of the plurality of terminal devices 120 is in an active state and some of the plurality of terminal devices 120 are attached to the same audio output device, the server device 110 can determine the audio output device as the target device (425). By way of example, in the above application scenario, if the user 140 wears an earphone while walking on the road, the earphone can be used to play the voice content corresponding to the reply. It should be understood that, for a user 140, if the audio output device is a wearable device such as an earphone, the user 140 usually attaches one audio output device to one or more terminal devices. If the user 140 has multiple audio output devices attached to the plurality of terminal devices, one of the audio output devices can be selected as the target device. This is merely an example and is not intended to be limiting in any way.

[0100] In some embodiments, if at least one terminal device 120 of the plurality of terminal devices 120 is in an active state, the server device 110 can select a target terminal device from the at least one terminal device and the wearable device 150 based on the priority of the plurality of terminal devices 120 and the wearable device 150. In step 430, the server device 110 can determine the priority of each of the at least one terminal device and the wearable device 150. If the wearable device 150 has the highest priority (435), the wearable device 150 is directly selected as the target device (440).

[0101] In some embodiments, if the wearable device 150 does not have the highest priority (445), the terminal device with the highest priority is selected as the target terminal device from the at least one terminal device in the active state (460). Further, the server device 110 can determine whether the target terminal device is attached to an audio output device (465). In some embodiments, if the target terminal device is attached to an audio output device, the server device 110 can determine that the audio output device is the target device (470). If the target terminal device is not attached to an audio output device, the server device 110 can determine that the target terminal device is the target device (475). By way of example in connection with a specific application scenario, for example, the user 140 is using a mobile phone (which can be a terminal device with the second highest priority) and can use the mobile phone to play / display the corresponding voice content / text content of the reply. If the mobile phone is attached to a headset, the corresponding voice content of the reply can be directly broadcasted by the headset.

[0102] In other embodiments, if the target terminal device is a personal computer, even if it is attached to an audio output device, the target terminal device can be directly used as the target device. By way of example in connection with a specific application scenario, for example, the user 140 is using a computer in an office environment and can use the computer to display the corresponding text content of the reply. In general, the speed of the user 140 reading the text content can be greater than the speed of listening to the corresponding voice content of the reply, so this can effectively improve work efficiency.

[0103] Through the process 400, the selection intention of the user for the device outputting the reply can be determined in various application scenarios, which can be compatible with various use scenarios of the terminal devices and fully meet the needs of the user using the terminal devices for work, study, entertainment, and the like.

[0104] Referring back to FIG. 3, at block 340, the server device 110 controls sending the reply to the target device for providing to the user 140. For different types of target devices, the server device 110 can use different ways to control sending the reply.

[0105] In some embodiments, if it is determined that the target device is the wearable device 150, the server device 110 can send the reply to a second terminal device in the terminal devices 120 to make the second terminal device forward the reply to the wearable device 150, wherein the communication connection between the second terminal device and the wearable device 150 is valid.

[0106] In some embodiments, if it is determined that the target device is an audio output device, the server device 110 can send the reply to a terminal device to which the audio output device is attached, so that the terminal device sends the reply to the audio output device. In some embodiments, if it is determined that the target device is a certain terminal device among the plurality of terminal devices 120, the server device 110 can send the reply directly to the terminal device.

[0107] In embodiments of the present disclosure, by selecting a terminal device from the plurality of terminal devices to receive the voice information of the user, and determining the target device from at least the plurality of terminal devices and the wearable device to provide the reply to the voice information to the user, the fluency of the interaction can be ensured in the case that the wearable device is connected to the plurality of terminal devices, to support the user to smoothly perform voice interaction. In addition, this can be compatible with various use scenarios of the plurality of terminal devices, and fully meet the needs of the user to work, study, entertain and the like by using the plurality of terminal devices. By enabling the user to interact with the wearable device and the plurality of terminal devices in a voice manner, the interaction convenience and speed of the user are effectively improved.

[0108] Embodiments of the present disclosure also provide a corresponding apparatus for implementing the above method or process. FIG. 5 shows a schematic structural block diagram of an apparatus 500 for interaction control, according to some embodiments of the present disclosure. The apparatus 500 may, for example, be implemented in or included in the wearable device 150. Various modules / components in the apparatus 500 can be implemented by hardware, software, firmware, or any combination thereof.

[0109] As shown, the apparatus 500 can include an acquisition module 510 configured to acquire, by a wearable device, voice information of a user, the wearable device being connected to a plurality of terminal devices; a selection module 520 configured to select a first terminal device from the plurality of terminal devices based on at least one of an active state of the plurality of terminal devices, a priority of the plurality of terminal devices, and an effectiveness of a communication connection between the plurality of terminal devices and the wearable device; and a sending module 530 configured to send the acquired voice information to the first terminal device via the communication connection between the wearable device and the first terminal device.

[0110] In some embodiments, the selection module 520 is further configured to, in response to determining that at least two terminal devices among the plurality of terminal devices are in the active state and the communication connection between the at least two terminal devices and the wearable device is effective, select the first terminal device from the at least two terminal devices based on the priority of the at least two terminal devices.

[0111] In some embodiments, the selection module 520 is further configured to select the first terminal device in response to determining that the first terminal device is in an active state and a communication connection between the wearable device and the first terminal device is valid, and other terminal devices in the plurality of terminal devices are not in the active state and / or the communication connection between the wearable device and the other terminal devices is not valid.

[0112] In some embodiments, the apparatus 500 further comprises an active state determination module configured to determine that a given terminal device is in an active state in response to determining that the given terminal device is in an unlocked state or a using state; or determine that the given terminal device is not in the active state in response to determining that the given terminal device is in a lock screen state or a hibernate state.

[0113] In some embodiments, the active state determination module is further configured to receive a state message from the given terminal device, the state message indicating a state of the given terminal device; and determine that the given terminal device is or is not in the active state based on the state message.

[0114] In some embodiments, the apparatus 500 further comprises a playing module configured to receive, via a communication connection between the wearable device and a second terminal device in the plurality of terminal devices, a reply to the voice information; and play a voice corresponding to the reply.

[0115] In some embodiments, the wearable device comprises a ring.

[0116] FIG. 6 shows a schematic structural block diagram of an apparatus 600 for interaction control, according to some embodiments of the present disclosure. The apparatus 600 may, for example, be implemented in or included in the server device 110. Various modules / components in the apparatus 600 can be implemented by hardware, software, firmware, or any combination thereof.

[0117] As shown, the apparatus 600 can comprise a voice receiving module 610 configured to receive, from a first terminal device in a plurality of terminal devices, voice information collected by a wearable device connected to the plurality of terminal devices; a reply determining module 620 configured to determine a reply to the voice information; a target device determining module 630 configured to determine, based on at least one of active states of the plurality of terminal devices and priorities of the plurality of terminal devices and the wearable device, a target device from at least the plurality of terminal devices and the wearable device; and a reply sending module 640 configured to control sending of the reply to the target device for providing to a user.

[0118] In some embodiments, the target device determining module 630 is further configured to determine the target device from the plurality of terminal devices, the wearable device, and an attached audio output device based on whether the plurality of terminal devices are respectively attached to the corresponding audio output devices. In some embodiments, the target device determining module 630 is further configured to determine the target device from the plurality of terminal devices, the wearable device, and an attached audio output device based on whether the plurality of terminal devices are respectively attached to the corresponding audio output devices.

[0119] In some embodiments, the target device determination module 630 is further configured to, in response to at least one terminal device of the plurality of terminal devices being in an active state, select a target terminal device from the at least one terminal device and the wearable device based on priorities of the plurality of terminal devices and the wearable device; in response to the target terminal device being attached to the audio output device, determine the audio output device as the target device; and in response to the target terminal device not being attached to the audio output device, determine the target terminal device as the target device.

[0120] In some embodiments, the target device determination module 630 is further configured to, in response to detecting that none of the plurality of terminal devices is in an active state and none of the plurality of terminal devices is attached to the audio output device, determine the wearable device as the target device.

[0121] In some embodiments, the reply sending module 640 is further configured to, in response to determining that the target device is the wearable device, send the reply to a second terminal device of the terminal devices, so as to cause the second terminal device to forward the reply to the wearable device, wherein a communication connection between the second terminal device and the wearable device is valid.

[0122] In some embodiments, the apparatus 600 further includes a priority determination module configured to determine the priorities of the plurality of terminal devices based on at least one of: historical interactions of a user with the plurality of terminal devices, interaction events detected in at least one terminal device of the plurality of terminal devices within a predetermined time window of receiving the voice information, whether the reply indicates an operation performed by a specific terminal device of the plurality of terminal devices.

[0123] The units and / or modules included in the apparatus 500, the apparatus 600 can be implemented in various ways, including software, hardware, firmware, or any combination thereof. In some embodiments, one or more units and / or modules can be implemented using software and / or firmware, e.g., machine-executable instructions stored on a storage medium. In addition or as an alternative, part or all of the units and / or modules in the apparatus 500, the apparatus 600 can be implemented at least partially by one or more hardware logic components. As an example and not by way of limitation, example types of hardware logic components that can be used include field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard products (ASSPs), system-on-a-chip (SOCs), complex programmable logic devices (CPLDs), etc.

[0124] FIG. 7 illustrates a block diagram of an electronic device 700 in which one or more embodiments of the disclosure can be implemented. It should be understood that the electronic device 700 illustrated in FIG. 7 is merely exemplary and should not be construed as limiting the functionality and scope of the embodiments described herein. The electronic device 700 illustrated in FIG. 7 can include or be implemented as the terminal device 110 or the wearable device 130 of FIG. 1, or the apparatus 500 of FIG. 5 or the apparatus 600 of FIG. 6.

[0125] As illustrated in FIG. 7, the electronic device 700 is in the form of a general electronic device. Components of the electronic device 700 can include, but are not limited to, one or more processors 710 or processing units, a memory 720, a storage device 730, one or more communication units 740, one or more input devices 750, and one or more output devices 760. The processor 710 can be a real or virtual processor and is capable of performing various processing according to programs stored in the memory 720. In a multi-processor system, multiple processing units perform computer-executable instructions in parallel to improve parallel processing capability of the electronic device 700.

[0126] The electronic device 700 typically includes a number of computer storage media. Such media can be any available media that is accessible by the electronic device 700 and includes both volatile and non-volatile media, removable and non-removable media. The memory 720 can be a volatile memory (e.g., registers, cache, random access memory (RAM)), a non-volatile memory (e.g., read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory), or some combination thereof. The storage device 730 can be a removable or non-removable media and can include a machine-readable medium, such as a flash drive, a disk drive, or any other medium that can be used to store information and / or data and that can be accessed by the electronic device 700.

[0127] The electronic device 700 can further include additional removable / non-removable, volatile / non-volatile storage media. Although not shown in FIG. 7, a disk drive and a disk drive interface can be provided for reading from or writing to a removable, non-volatile magnetic disk (e.g., a "floppy disk"), and an optical disk drive and disk drive interface can be provided for reading from or writing to a removable, non-volatile optical disk (e.g., a "CD-ROM" or "DVD"). In these instances, each drive can be connected to the bus (not shown) by one or more data media interfaces. The memory 720 can include a computer program product 725 having one or more program modules configured to carry out the various methods or actions of the various embodiments of the present disclosure.

[0128] The communication unit 740 enables communication through communication media with other electronic devices. Additionally, the functionality of the components of the electronic device 700 can be implemented in a single computing cluster or a plurality of computer machines capable of communicating over a communication connection. As such, the electronic device 700 can operate in a networked environment using logical connections to one or more other servers, network personal computers (PCs), or another network node.

[0129] The input device 750 can be one or more input devices, such as a mouse, a keyboard, a trackball, etc. The output device 760 can be one or more output devices, such as a display, a speaker, a printer, etc. The electronic device 700 can also communicate with one or more external devices (not shown), such as a storage device, a display device, etc., through the communication unit 740, as needed, with one or more devices that enable a user to interact with the electronic device 700, or with any devices (e.g., a network card, a modem, etc.) that enable the electronic device 700 to communicate with one or more other electronic devices. Such communication can be carried out via an input / output (I / O) interface (not shown).

[0130] According to an example implementation of the present disclosure, there is provided a computer-readable storage medium having computer-executable instructions stored thereon, where the computer-executable instructions are executed by a processor to implement the method described above. According to an example implementation of the present disclosure, there is also provided a computer program product tangibly stored on a non-transitory computer-readable medium and comprising computer-executable instructions, where the computer-executable instructions are executed by a processor to implement the method described above.

[0131] Various aspects of the disclosure can be described herein with reference to flowchart illustrations and / or block diagrams of methods, apparatuses, systems, and computer program products according to this disclosure. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer-readable program instructions.

[0132] These computer readable program instructions can be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions / acts specified in the flowchart and / or block diagram block or blocks. These computer readable program instructions can also be stored in a computer readable storage medium that can include a non-transitory computer readable storage medium that can direct a computer, a programmable data processing apparatus, and / or other devices to function in a particular manner, such that the computer readable storage medium having instructions stored therein comprises an article of manufacture including instructions which implement aspects of the function / act specified in the flowchart and / or block diagram block or blocks.

[0133] The computer readable program instructions can also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus or other device to produce a computer implemented process such that the instructions which execute on the computer, other programmable data processing apparatus, or other device implement the functions / acts specified in the flowchart and / or block diagram block or blocks.

[0134] The flow diagrams and the block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various implementations of the present disclosure. In this regard, each block in the flow diagrams and the block diagrams can represent a module, segment, or portion of instructions, which comprises one or more executable instructions for implementing the specified logic functions (s). In some alternative implementations, the functions noted in the blocks can occur out of the order noted in the figures. For example, two blocks shown in succession may, in some cases, be executed substantially concurrently, or the blocks can sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and / or flow diagrams, and combinations thereof, can be implemented by special purpose hardware-based systems that perform the specified functions or acts, or combinations of special purpose hardware and

[0135] implementations. Numerous modifications and adaptations will be apparent to those skilled in the art without departing from the scope and spirit of the described implementations. The herein described subject matter is to be considered in all its novel implications and applications and can be practiced in a variety of environments. It is also to be understood that such features are only examples and that many modifications, additions, or omissions can be made without departing from the scope of the claimed subject matter. Accordingly, the exemplary implementations described herein are not intended to limit the scope of the claimed subject matter but rather are intended to embrace all such alterations, modifications, additions, omissions, and equivalents that are within the scope and spirit of the claimed subject matter.

Claims

1. An interaction control method implemented at a wearable device, comprising: capturing, by the wearable device, voice information of a user, the wearable device being connected to a plurality of terminal devices; selecting, from the plurality of terminal devices, a first terminal device based on at least one of active states of the plurality of terminal devices, priorities of the plurality of terminal devices, and effectiveness of communication connections between the plurality of terminal devices and the wearable device; and sending, to the first terminal device, the captured voice information via a communication connection between the wearable device and the first terminal device.

2. The method of claim 1, wherein selecting, from the plurality of terminal devices, a first terminal device comprises: in response to determining that at least two terminal devices of the plurality of terminal devices are in active states and have effective communication connections with the wearable device, selecting, from the at least two terminal devices, the first terminal device based on priorities of the at least two terminal devices.

3. The method of claim 1, wherein selecting, from the plurality of terminal devices, a first terminal device comprises: in response to determining that the first terminal device is in an active state and has an effective communication connection with the wearable device, and other terminal devices of the plurality of terminal devices are not in the active state and / or do not have effective communication connections with the wearable device, selecting the first terminal device.

4. The method of claim 1, wherein an active state of a given terminal device of the plurality of terminal devices is determined by: in response to determining that the given terminal device is in an unlocked state or a used state, determining that the given terminal device is in the active state; or in response to determining that the given terminal device is in a locked state or a hibernation state, determining that the given terminal device is not in the active state.

5. The method of claim 1, wherein an active state of a given terminal device of the plurality of terminal devices is determined by: receiving, from the given terminal device, a state message indicating a state of the given terminal device; and determining, based on the state message, that the given terminal device is or is not in the active state.

6. The method of claim 1, further comprising: receiving, via a communication connection between the wearable device and a second terminal device of the plurality of terminal devices, a reply to the voice information; and playing a voice corresponding to the reply.

7. The method of claim 1, wherein the wearable device comprises a ring.

8. An interaction control method implemented at a server device, comprising: receiving, from a first terminal device of a plurality of terminal devices, voice information captured by a wearable device, the wearable device being connected to the plurality of terminal devices; determining a reply to the voice information; determining, based on at least one of active states of the plurality of terminal devices and priorities of the plurality of terminal devices and the wearable device, a target device from at least the plurality of terminal devices and the wearable device; and sending, to the target device, the reply. ​ ​ controlling sending of the reply to the target device for providing to a user. 9.The method of claim 8, wherein determining the target device comprises: determining the target device from the plurality of terminal devices, the wearable device, and an attached audio output device, further based on whether each of the plurality of terminal devices is attached to a corresponding audio output device. 10.The method of claim 9, wherein determining the target device from the plurality of terminal devices, the wearable device, and an attached audio output device comprises: selecting a target terminal device from at least one terminal device of the plurality of terminal devices and the wearable device based on priorities of the plurality of terminal devices and the wearable device, in response to the at least one terminal device being in an active state; determining the audio output device to be the target device in response to the target terminal device being attached to the audio output device; and determining the target terminal device to be the target device in response to the target terminal device not being attached to an audio output device. 11.The method of claim 9, wherein determining the target device from the plurality of terminal devices, the wearable device, and an attached audio output device comprises: determining the wearable device to be the target device in response to detecting that none of the plurality of terminal devices is in an active state and none of the plurality of terminal devices is attached to an audio output device. 12.The method of claim 8, wherein controlling sending of the reply to the target device comprises: sending the reply to a second terminal device of the terminal devices to cause the second terminal device to forward the reply to the wearable device in response to determining the target device to be the wearable device, wherein a communication connection between the second terminal device and the wearable device is active. 13.The method of claim 8, further comprising determining priorities of the plurality of terminal devices based on at least one of: historical interactions of a user with the plurality of terminal devices, interaction events detected in at least one terminal device of the plurality of terminal devices within a predetermined time window of receiving the voice information, whether the reply indicates an operation to be performed by a particular terminal device of the plurality of terminal devices. 14.An apparatus for interaction control, comprising: a collection module configured to collect, by a wearable device, voice information of a user, the wearable device being connected to a plurality of terminal devices; a selection module configured to select a first terminal device from the plurality of terminal devices based on at least one of active states of the plurality of terminal devices, priorities of the plurality of terminal devices, and availability of communication connections between the plurality of terminal devices and the wearable device; and a sending module configured to send the collected voice information to the first terminal device via a communication connection between the wearable device and the first terminal device. 15.An apparatus for interaction control, comprising: ​ ​ a voice receiving module configured to receive voice information collected by a wearable device from a first terminal device of a plurality of terminal devices, the wearable device being connected to the plurality of terminal devices; a reply determining module configured to determine a reply to the voice information; a target device determining module configured to determine a target device from at least the plurality of terminal devices and the wearable device based on at least one of an active state of the plurality of terminal devices and a priority of the plurality of terminal devices and the wearable device; and a reply sending module configured to control sending of the reply to the target device for providing to a user.

16. An electronic device, comprising: at least one processor; and at least one memory that is coupled to the at least one processor and stores instructions for execution by the at least one processor, the instructions, when executed by the at least one processor, cause the electronic device to perform the method according to any one of claims 1-7 or 8-13.

17. A computer-readable storage medium having computer-executable instructions stored therein, the computer-executable instructions being executable by a processor to implement the method according to any one of claims 1-7 or 8-13.

18. A computer program product tangibly stored in a computer storage medium and comprising computer-executable instructions that, when executed by a device, cause the device to perform the method according to any one of claims 1-7 or 8-13. ​

Images