Voice control method, device, terminal equipment and storage medium

Abstract

The present application discloses a voice control method, apparatus, terminal device and storage medium, wherein the voice control method comprises: receiving a first voice message; determining an instruction intent corresponding to the first voice message; the instruction intent represents an instruction for a terminal device of a first device type to perform a first operation; in the case of determining that a second terminal device of the first device type exists in a first group, sending a first control instruction to the second terminal device so that the second terminal device executes the first control instruction; wherein, when the first control instruction is executed, the corresponding terminal device executes the first operation; the first terminal device is located in the first group, and each terminal device in the first group communicates based on short-range wireless communication technology.

Description

Technical Field

[0001] The present application relates to the field of voice technology, and in particular to a voice control method, apparatus, terminal device and storage medium. Background Art

[0002] In the related art, users usually use remote controls to control smart TVs to play programs on demand or adjust the volume. When the remote control is lost or damaged, users can use mobile phones and other electronic devices to perform voice control on smart TVs. However, there is a problem that the smart TV acquires control commands slowly, that is, voice control is inefficient. Summary of the invention

[0003] In view of this, embodiments of the present application provide a voice control method, apparatus, terminal device, and storage medium, which can improve the efficiency of executing voice commands across devices.

[0004] To achieve the above purpose, the technical solution of this application is implemented as follows:

[0005] The present application provides a voice control method, which is applied to a first terminal device, and the method includes:

[0006] receiving a first voice message;

[0007] Determine the instruction intention corresponding to the first voice information; the instruction intention represents instructing a terminal device of the first device type to perform a first operation;

[0008] When it is determined that there is a second terminal device of the first device type in the first group, a first control instruction is sent to the second terminal device so that the second terminal device executes the first control instruction; wherein,

[0009] When the first control instruction is executed, the corresponding terminal device executes the first operation; the first terminal device is located in the first group, and each terminal device in the first group communicates based on short-range wireless communication technology.

[0010] The present application also provides a voice control method, including:

[0011] Each first terminal device of at least one first terminal device receives the first voice information;

[0012] All or part of the at least one first terminal device determine the instruction intent corresponding to the first voice information, and when determining that there is a second terminal device of the first device type in the first group, send a first control instruction corresponding to the instruction intent to the second terminal device; wherein the instruction intent represents instructing the terminal device of the first device type to perform a first operation;

[0013] The second terminal device that receives the first control instruction executes the first control instruction to perform the first operation; wherein,

[0014] The at least one first terminal device is located in the first group, and each terminal device in the first group communicates based on a short-range wireless communication technology.

[0015] The present application also provides a voice control device, including:

[0016] A receiving module, used for receiving first voice information;

[0017] A determination module, configured to determine an instruction intention corresponding to the first voice information, wherein the instruction intention indicates instructing a terminal device of a first device type to perform a first operation;

[0018] a sending module, configured to send a first control instruction to a second terminal device of the first device type when determining that the second terminal device exists in the first group, so that the second terminal device executes the first control instruction; wherein,

[0019] When the first control instruction is executed, the corresponding terminal device executes the first operation; the first terminal device is located in the first group, and each terminal device in the first group communicates based on short-range wireless communication technology.

[0020] The embodiment of the present application further provides a terminal device, comprising: a processor and a memory for storing a computer program that can be run on the processor,

[0021] Wherein, the processor is used to execute the steps of the above-mentioned voice control method when running the computer program.

[0022] An embodiment of the present application further provides a storage medium on which a computer program is stored, wherein the computer program implements the steps of the above-mentioned voice control method when executed by a processor.

[0023] In an embodiment of the present application, in a group composed of terminal devices that communicate based on short-range wireless communication technology, a first terminal device receives a first voice message sent by a user and determines the instruction intent corresponding to the first voice message; the instruction intent represents an instruction to instruct a terminal device of the first device type to perform a first operation; when it is determined that there is a second terminal device of the first device type in the group, the first terminal device sends a first control instruction to the second terminal device, so that the second terminal device executes the first control instruction to perform the first operation. In this way, when operating across devices, the execution device only needs to receive the corresponding control instruction and execute related operations based on the communication within the group with the wake-up device, eliminating the excessive time consumption generated by the execution device interacting with the cloud, reducing the time required for the execution device to obtain the first control instruction, and improving the voice control efficiency when executing across devices. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] Figure 1 A schematic diagram of a voice control method in the related art;

[0025] Figure 2 A schematic diagram of a voice control system provided in an embodiment of the present application;

[0026] Figure 3 A schematic diagram of the implementation flow of the voice control method provided in the embodiment of the present application;

[0027] Figure 4 An interactive diagram of the voice control method provided in an embodiment of the present application;

[0028] Figure 5 An interactive diagram of a voice control method provided by another embodiment of the present application;

[0029] Figure 6 A schematic diagram of the implementation flow of the voice control method provided in the application embodiment of the present application;

[0030] Figure 7 A schematic diagram of the structure of a voice control device provided in an embodiment of the present application;

[0031] Figure 8 A schematic diagram of the hardware composition structure of a terminal device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0032] In daily life, users usually control smart TVs through TV remote controls. When the TV remote control is lost or damaged, users can wake up the voice assistant in the smart TV loudly and control the smart TV through the voice assistant in the smart TV. However, the voice information sent by the user is mixed with the audio played by the smart TV, which may cause the voice information obtained by the smart TV to deviate from the voice information sent by the user, or even obtain incorrect voice information. In addition, when the user is far away from the smart TV, the transmission path of the voice information also has a large path loss, making it difficult for the smart TV to accurately receive it.

[0033] In order to solve the above technical problems, in the IoT scenario, related technologies provide a method for voice control across devices. Taking mobile phones controlling smart TVs as an example, the main methods include: Figure 1 Three implementations are shown:

[0034] Solution A: The mobile phone receives the voice information sent by the user and sends the voice information to the cloud; the cloud sends a cross-device forwarding instruction to the mobile phone; the mobile phone forwards the voice information to the execution device (smart TV) based on the cross-device forwarding instruction; the smart TV sends the received voice information to the cloud; the cloud sends the corresponding control instruction to the smart TV, so that the smart TV executes the operation indicated by the voice information according to the control instruction.

[0035] Solution B: The mobile phone receives the voice message sent by the user and sends the voice message to the cloud; the cloud forwards the voice message to the smart TV; the smart TV sends the voice message and the working status of the smart TV to the cloud; the cloud sends the corresponding control instructions to the smart TV based on the working status of the smart TV, so that the smart TV executes the operation indicated by the voice message according to the control instructions.

[0036] Solution C: The mobile phone requests the working status of the smart TV; the smart TV returns the corresponding working status to the mobile phone; the mobile phone receives the voice message sent by the user, and sends the voice message and the working status of the smart TV to the cloud; the cloud sends the corresponding control instructions to the smart TV based on the working status of the smart TV, so that the smart TV executes the operation indicated by the voice message according to the control instructions.

[0037] In the above three solutions, the mobile phone is used as the wake-up device and the smart TV is used as the execution device, which realizes the cross-device operation from the mobile phone to the smart TV. The interaction process of any of the above solutions includes the interaction process between the mobile phone and the cloud and the interaction process between the smart TV and the cloud. Because the terminal device does not maintain a long connection with the cloud before the terminal device interacts with the cloud, the above three solutions all need to consume the time to establish the connection between the mobile phone and the cloud, as well as the time to establish the connection between the smart TV and the cloud. The double connection establishment time causes the smart TV to take a long time to obtain the control instructions corresponding to the voice information sent by the user, and the voice control efficiency is low.

[0038] Based on this, an embodiment of the present application provides a voice control method, in which, in a group composed of terminal devices that communicate based on short-range wireless communication technology, a first terminal device receives a first voice message sent by a user and determines the instruction intent corresponding to the first voice message; the instruction intent representation indicates that a terminal device of the first device type executes a first operation; when it is determined that there is a second terminal device of the first device type in the group, the first terminal device sends a first control instruction to the second terminal device, so that the second terminal device executes the first control instruction, thereby executing the first operation. In this way, when operating across devices, the execution device only needs to receive the corresponding control instruction and execute related operations based on the communication within the group with the wake-up device, eliminating the excessive time consumption generated by the execution device interacting with the cloud, reducing the time required for the execution device to obtain the first control instruction, and improving the voice control efficiency when executing across devices.

[0039] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0040] Figure 2A schematic diagram of a voice control system provided for an embodiment of the present application. Among them, the voice control system includes a plurality of terminal devices 21-22 and a cloud server 3. A group of terminal devices interconnected by at least two terminal devices is deployed in the voice control system, and the terminal devices communicate based on short-range wireless communication technology. Short-range wireless communication technology includes Bluetooth communication technology or wireless fidelity (WiFi, Wireless Fidelity) communication technology, etc. When a group includes multiple terminal devices, one-to-one communication, one-to-many communication or many-to-one communication can be performed between the terminal devices based on short-range wireless communication technology. In actual application, the interconnection group can be established based on Bluetooth communication technology, or based on WiFi communication technology, or based on a third-party communication framework, for example, the third-party communication framework can be an OAF communication framework (OPlus Accessory Framework). A group consisting of at least two terminal devices communicates wirelessly with the cloud server 3. In a cross-device execution scenario, the terminal device 21 that receives the voice information is usually called a wake-up device, and the terminal device 22 that performs the operation indicated by the voice information is called an execution device. In one embodiment, the wake-up device can interact with the cloud server, while the execution device and the cloud server may not interact. It should be noted that Figure 2 The cloud server 3 is not necessary, and the voice control system may not include the cloud server 3. That is to say, when neither the wake-up device nor the execution device interacts with the cloud server, the user can also perform voice control on the execution device through the wake-up device, thereby realizing cross-device operation.

[0041] It should be noted that Figure 2 The terminal devices in the voice control system shown are all installed with a first application, for example, the first application can be a voice assistant. The first application is used to support the user to input voice information, and to support the interaction between the terminal device and the cloud (i.e., the cloud server 3), and between the terminal devices at the application layer. Based on the first application, the user can operate any terminal device in the group by inputting voice information.

[0042] In practical application, for example, Figure 2 The terminal device may include at least one of the following:

[0043] Mobile phones, smart speakers, laptops, smart watches, tablets, TVs, refrigerators, air conditioners and other IoT terminals.

[0044] In the IoT scenario, with the family as the unit, the terminal devices in a group include at least various terminal devices and smart appliances used by family members. For example, the terminal devices used by family members and guests, as well as the smart appliances in the home, establish a first group based on short-range wireless communication technology. As a result, all the above terminal devices can communicate based on short-range wireless communication technology, and a voice message can be sent to any terminal device in the first group to control another terminal device to perform the operation corresponding to the voice message, wherein the wake-up device and execution device corresponding to the voice message do not have to be terminal devices that rely on the same cloud account. In actual application, family members or guests can use different wake-up devices to voice control the smart TV.

[0045] It should be noted that in the cross-device execution scenario, before the user first wakes up the device to control the execution device, the terminal devices use the following two methods to establish the first group:

[0046] Method 1: The user can trigger the wake-up device to establish a first interconnected group with at least one terminal device in the home based on the short-range wireless communication technology through a set interactive interface. Other users can add the terminal devices they use to the group through a set interactive interface. For example, when a user configures a terminal device to access a wireless local area network, the terminal device can be added to the group corresponding to the wireless local area network.

[0047] Method 2: When the wake-up device detects that the distance between itself and the execution device is less than or equal to a set threshold, the wake-up device establishes a first group with the execution device based on short-range wireless communication technology; when the distance between other terminal devices and any terminal device in the group is less than or equal to the set threshold, the terminal device joins the group.

[0048] In actual application, when user A carries a terminal device 21 close to another terminal device 21 and the distance between the two terminal devices is less than or equal to a set threshold, the two terminal devices are triggered to establish a first group; when user B carries a terminal device 21 close to any terminal device in the group and the distance between the two terminal devices close to each other is less than or equal to the set threshold, the terminal device 21 carried by user B joins the group.

[0049] It should be noted that in the process of establishing the first group, the device type of each terminal device needs to be set. After the first group is established, the user can add or delete terminal devices in the group through the set interactive interface. If the first group is not disbanded, there is no need to establish the first group again. Each terminal device in the first group can display relevant information of all terminal devices in the group through the set interactive interface for users to view. It should be noted that device types can be divided according to physical entities, such as smart TVs, mobile phones, tablets, smart watches, etc., and can also be divided according to functions, such as audio, video, control, smart question and answer, content search, etc. The device type of the terminal device can be pre-set by the user.

[0050] Considering that when the distance between terminal devices in the first group is greater than the corresponding maximum communication distance, short-distance wireless communication cannot be performed between terminal devices. In order to facilitate identification of terminal devices that can communicate with each other in the first group, in some embodiments, each terminal device in the first group can mark the terminal devices in the group as online or offline. The online state indicates that short-distance wireless communication can be performed with the corresponding terminal device, and the offline state indicates that short-distance wireless communication cannot be performed with the corresponding terminal device. In actual application, in the first group, terminal devices in the online state can be marked as a first color, such as green; and terminal devices in the offline state can be marked as a second color, such as gray.

[0051] The following will specifically describe the technical solution of the present application and how the technical solution of the present application solves the above technical problems through embodiments and in conjunction with the accompanying drawings. The following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be repeated in some embodiments.

[0052] Figure 3 The following is a schematic diagram of the implementation process of the voice control method provided in the embodiment of the present application. The execution subject of this process is the first terminal device, and the first terminal device is Figure 2 In an embodiment of the present application, the first terminal device is located in the first group, and each terminal device in the first group communicates based on short-range wireless communication technology. The first group is an interconnected group; the first terminal device is a wake-up device, and the second terminal device is an execution device.

[0053] like Figure 3 As shown, the voice control method includes:

[0054] Step 301: Receive first voice information.

[0055] Here, when the user wants to voice control the second terminal device in the established first group through the first terminal device, the user inputs the first voice information to the first terminal device through the first application in the first terminal device. The first terminal device receives the first voice information. Among them, the first voice information includes at least skill intent, and may also include a first device type. The skill intent represents the goal that the user wants to achieve within the skills supported by the corresponding terminal device, and represents an instruction to the corresponding terminal device to perform a first operation. Skills generally refer to the capabilities or achievable functions of a terminal device. When the first device type is not included in the first voice information, the first terminal device determines the first device type based on the skill intent in the first voice information.

[0056] For example, when the first voice message is to turn up the volume of the TV, the first device type is TV, and the skill intention is to increase the playback volume. At this time, the first device type is directly extracted from the first voice message.

[0057] For another example, when the first voice information is to lower the volume, the first device type is an audio type or a video type, and the skill intent is to lower the playback volume. In this case, the first device type is obtained by analyzing the skill intent.

[0058] Step 302: Determine the instruction intent corresponding to the first voice information; the instruction intent represents an instruction to a terminal device of a first device type to perform a first operation.

[0059] Here, the instruction intent corresponding to the first voice information can be obtained by the first terminal device parsing the first voice information, or by the cloud server parsing the first voice information. The implementation method of determining the instruction intent corresponding to the first voice information includes:

[0060] Method 1: The first terminal device parses the first voice information, determines the first device type and the first operation corresponding to the first voice information, and obtains the instruction intention corresponding to the first voice information.

[0061] Method 2: The first terminal device sends the first voice message to the cloud server, and the cloud server receives the analysis result of the first voice message and returns the instruction intent corresponding to the first voice message. The analysis result includes the first device type and the first operation.

[0062] It should be noted that the first terminal device may preferentially analyze the first voice information locally, and when the first setting condition is currently met, send the received first voice information to the cloud server so that the first voice information is analyzed by the cloud server. The first setting condition represents one of the following:

[0063] The first terminal device does not support the voice information parsing function;

[0064] The first terminal device fails to parse the first voice information;

[0065] The usage rate of computing resources of the first terminal device is greater than or equal to a set threshold; the computing resources include a processor and / or memory, etc.

[0066] Step 303: When it is determined that there is a second terminal device of the first device type in the first group, a first control instruction is sent to the second terminal device so that the second terminal device executes the first control instruction.

[0067] Since the command intent represents the instruction for the terminal device of the first device type to perform the first operation, the first terminal device, when determining the command intent corresponding to the first voice information, determines whether there is a second terminal device of the first device type in the first group; when there is a second terminal device of the first device type in the first group, sends the first control instruction to the second terminal device, so that the second terminal device, when receiving the first control instruction, executes the first control instruction, thereby performing the corresponding first operation. It should be noted that the first control instruction can be generated by the first terminal device based on the command intent corresponding to the first voice information, or it can be generated by the cloud server when the command intent corresponding to the first voice information is parsed. In this case, the first terminal device obtains the first control instruction corresponding to the first voice information sent by the cloud server.

[0068] It should be noted that, if there is no second terminal device of the first device type in the first group, no cross-device operation is performed, and the first terminal device executes the first control instruction. When the first terminal device does not support the first operation indicated by the first control instruction, the first operation fails to be executed.

[0069] It should be noted that, if there is no second terminal device of the first device type in the first group, the first terminal device can output a prompt message to ask the user whether to execute the first control instruction locally. Thus, the user can determine whether the instruction intention is accurate based on the prompt message output by the first terminal device, and if there is a deviation between the instruction intention obtained by the first terminal device and the control intention of the user, the first terminal device can terminate the execution of the first control instruction in a timely manner.

[0070] In this embodiment, in a group composed of terminal devices that communicate based on short-range wireless communication technology, a first terminal device receives a first voice message sent by a user; the first voice message is used to instruct a terminal device of a first device type to perform a first operation; a first control instruction corresponding to the first voice message is determined, and when it is determined that there is a second terminal device of the first device type in the first group, the first terminal device sends the first control instruction to the second terminal device, so that the second terminal device executes the first control instruction, thereby performing the first operation. In this way, when operating across devices, the executing device only needs to receive the corresponding control instruction and perform related operations based on the communication within the group with the wake-up device, eliminating the excessive time consumption generated by the interaction between the executing device and the cloud, reducing the time required for the executing device to obtain the first control instruction, and improving the voice control efficiency when executing across devices.

[0071] Considering that in actual application, the instruction intention corresponding to the first voice information can be parsed by the wake-up device or by the cloud server. Figure 4 and Figure 5 Detailed description Figure 2 The corresponding voice control system realizes the process of voice control. Figure 4 The corresponding embodiments and Figure 5 The difference between the corresponding embodiments is that Figure 4 In the corresponding embodiment, the cloud server is not included, and the first terminal device parses the received first voice information; Figure 5 In a corresponding embodiment, the cloud server parses the first voice information received by the first terminal device.

[0072] Figure 4 An interactive diagram of the voice control method provided in the embodiment of the present application, such as Figure 4 As shown, the voice control method includes:

[0073] Step 401: A first terminal device receives a first voice message.

[0074] The implementation process of step 401 please refer to the relevant description of step 301, which will not be repeated here.

[0075] Considering that the terminal devices in the first group can change dynamically, the terminal devices in the first group that are in an online state also change dynamically. Therefore, in order to accurately determine the corresponding execution device and avoid the situation where the awakening device sends a control instruction to the terminal device in an offline state, thereby wasting resources, before executing step 401, the method further includes:

[0076] The first terminal device determines each terminal device in the first group and the corresponding device type at every set period.

[0077] Here, the first terminal device determines each terminal device and corresponding device type that can communicate with each other in the established first group at every set period.

[0078] In actual application, each terminal device in the first group can mark the terminal device in the first group as online or offline. The first terminal device obtains the online terminal devices and the corresponding device types from the device list corresponding to the first group, so as to perform cross-device voice control on the online terminal devices.

[0079] Step 402: The first terminal device parses the first voice information to obtain a command intent corresponding to the first voice information; the command intent representation instructs a terminal device of the first device type to perform a first operation.

[0080] Here, when the first terminal device receives the first voice information, it parses the first voice information to obtain the first device type and the first operation, and determines the instruction intent corresponding to the first voice information based on the first device type and the first operation obtained by parsing.

[0081] For example, when the first voice information is to turn up the volume of the TV, the determined first device type is the TV, the first operation represents turning up the playback volume, and the instruction corresponding to the first voice information is intended to turn up the playback volume of the TV.

[0082] In actual application, in the application scenario of cross-device operation, the first terminal device will fill the information elements parsed from the first voice information into the corresponding slots, thereby determining which slots are not filled in this round of cross-device operation, and based on the information elements corresponding to the unfilled slots, output a voice prompt to prompt the user to continue to input the corresponding information elements to the first terminal through the first application.

[0083] Each slot represents an information element, and the information element includes a device type and an operation indicated by the voice information. Considering that in actual applications, each terminal device can receive voice information and can also perform operations indicated by the voice information, the wake-up device may also be an execution device. Based on this, in some embodiments, the method further includes:

[0084] When the first terminal device is of the first device type, the first terminal device executes the first control instruction.

[0085] Here, when the first terminal device obtains the instruction intent corresponding to the first voice information, it determines that the first terminal device is the first device type and obtains a judgment result; when the judgment result indicates that the first terminal device is the first device type, the first terminal device generates a first control instruction based on the instruction intent, and executes the first control instruction to perform the first operation indicated by the first control instruction; when the judgment result indicates that the first terminal device is not the first device type, step 403 is executed.

[0086] Considering that there may be a situation where there is no second terminal device of the first device type in the first group, or the second terminal device of the first device type does not support the first operation corresponding to the first voice information, based on this, in some embodiments, the method further includes:

[0087] If there is no terminal device of the first device type in the first group, or if the first operation is a setting operation, the first terminal device issues a first voice prompt; wherein,

[0088] The first voice prompt is used to prompt the user to re-enter the voice information;

[0089] The setting operation represents an operation that is not supported to be performed across terminal devices or an operation that is not supported by the second terminal device.

[0090] Here, when the first terminal device obtains the instruction intention corresponding to the first voice information, based on the device type of each terminal device in the first group, searches for terminal devices of the first device type in the first group, and issues a first voice prompt if the terminal device of the first device type is not found in the first group. For example, the first voice prompt may be that the terminal device of the first device type is not found, please re-enter the voice information; when the second terminal device of the first device type is found in the first group, step 403 is executed.

[0091] When the first terminal device obtains the instruction intent corresponding to the first voice information, it determines whether the first operation represented by the instruction intent is a setting operation. When the first operation represented by the instruction intent is a setting operation, it issues a first voice prompt, for example, the first operation is not supported, please re-enter the voice information. When the first operation represented by the instruction intent is not a setting operation, execute step 403. Among them, the first terminal device pre-stores operations that support execution across terminal devices, and also stores operations supported by each terminal device in the first group. The first terminal device searches for the first operation in the pre-stored operations that support execution across terminal devices. When the first operation is not found, it characterizes the first operation as an operation that does not support execution across terminal devices. The first terminal device searches for operations supported by the second terminal device of the first device type in the pre-stored operations supported by each terminal device in the first group, and searches for the first operation in operations supported by the second terminal device of the first device type. When the first operation is not found, it characterizes the first operation as an operation that is not supported by the second terminal device.

[0092] For example, the first voice message is to make a phone call on the TV. If an instant messaging application is installed in the smart TV, the pre-stored operations supported by the smart TV include making phone calls, i.e., voice calls or video calls. At this time, the first operation is an operation supported by the second terminal device. If there is no instant messaging application in the smart TV, the pre-stored operations supported by the smart TV do not include making phone calls. The first operation is an operation not supported by the second terminal device.

[0093] In order to facilitate the user to know the execution status of the first control instruction, the execution result corresponding to the first control instruction can be played by voice; in some embodiments, after the first terminal device executes the first control instruction when the set conditions are met, the method further includes:

[0094] The first terminal device sends a first voice response to the first voice information; wherein,

[0095] The first voice response represents an execution result of the first operation.

[0096] Here, when executing the first control instruction, the first terminal device obtains the execution result corresponding to the first control instruction, and based on the text to speech (TTS) synthesis technology, converts the execution result corresponding to the first control instruction into a first voice response, and plays the first voice response in voice.

[0097] It should be noted that the first terminal device may not support the first operation, and therefore, the execution result corresponding to the first control instruction may be that the first operation is executed, or it may be that the first operation is not executed because the first operation is not supported. In the case where the first operation is executed, there are also two corresponding execution results, one is that the first operation is successfully executed, and the other is that the first operation fails to be executed, for example, the execution fails because the adjustment range indicated by the first control instruction exceeds the maximum setting range.

[0098] Step 403: When it is determined that a second terminal device of the first device type exists in the first group, the first terminal device sends a first control instruction to the second terminal device; wherein the first terminal device is located in the first group, and each terminal device in the first group communicates based on short-range wireless communication technology.

[0099] Here, when the first terminal device obtains the instruction intent corresponding to the first voice information, based on the device type of each terminal device in the first group, searches for a second terminal device of the first device type in the first group; when the second terminal device of the first device type is found in the first group, the first terminal device generates a first control instruction based on the first operation represented by the instruction intent corresponding to the first voice information, and sends the first control instruction to the second terminal device.

[0100] It should be noted that, in some embodiments, when the first terminal device fails to find a terminal device of the first device type in the first group, the first terminal device detects whether there is a terminal device of the first device type that has not joined the first group within the current communication range based on the short-range wireless communication technology; when it is detected that there is a second terminal device of the first device type that has not joined the first group, an add request representing joining the first group is sent to the detected second terminal device; when it is detected that the second terminal device agrees to join the first group, the second terminal device is added to the first group, and a first control instruction is sent to the second terminal device.

[0101] For example, based on the terminal devices in the wireless local area network accessed by the first terminal device and the terminal devices in the first group, it is detected whether there is a second terminal device of the first device type that has not joined the first group in the wireless local area network; if there is a second terminal device of the first device type that has not joined the first group in the wireless local area network, a request to join the first group is sent to the detected second terminal device; the user can trigger the second terminal device to return information representing consent or rejection to the first terminal device through a remote control or an interactive interface. When the first terminal device detects that the second terminal device agrees to join the first group, it adds the second terminal device to the first group and sends a first control instruction to the second terminal device.

[0102] In this solution, the wake-up device can parse the received voice information locally, which can further improve the efficiency of the execution device in obtaining the first control instruction compared to the solution in which the cloud server parses the voice information.

[0103] Considering that the terminal devices in the first group can perform one-to-one communication, one-to-many communication, or many-to-many communication, in order to improve the control efficiency or control accuracy of cross-device voice control, in some embodiments, when it is determined that there is a second terminal device of the first device type in the first group, the first terminal device sends a first control instruction to the second terminal device, including:

[0104] When it is determined that there are at least two second terminal devices of the first device type in the first group, the first terminal device sends the first control instruction to all or part of the at least two second terminal devices.

[0105] Here, when the first terminal device determines that there are at least two second terminal devices of the first device type in the first group, the first terminal device may send the first control instruction to all the determined second terminal devices respectively, or may send the first control instruction to some of the determined second terminal devices. Some of the second terminal devices may be randomly selected by the first terminal device from at least two second terminal devices, or may be determined by the first terminal device based on the parameter values ​​of the set parameters of the second terminal devices. In order to select a better second terminal device from different dimensions to execute the first control instruction, in some embodiments, sending the first control instruction to some of the at least two second terminal devices includes:

[0106] The first terminal device determines at least one second terminal device from the at least two second terminal devices according to the parameter value of the setting parameter of the second terminal device; the number of the at least one second terminal device is less than the total number of all the second terminal devices;

[0107] The first terminal device sends the first control instruction to the determined at least one second terminal device.

[0108] Here, the first terminal device selects N second terminal devices from the determined second terminal devices based on the parameter value of the set parameter, and sends the first control instruction to the N second terminal devices respectively. N is an integer greater than or equal to 1, and N is less than the total number of all the determined second terminal devices.

[0109] The setting parameters include at least one of the following:

[0110] Power;

[0111] Software / hardware performance indicators, including processor usage, memory usage, etc.;

[0112] User usage frequency;

[0113] The distance from the first terminal device;

[0114] The activity status of the device.

[0115] Here, the first terminal device may determine at least one second terminal device from at least two second terminal devices according to a selection strategy corresponding to the following setting parameters:

[0116] The power level is maximum, or the power level is greater than the set power threshold;

[0117] Optimal performance;

[0118] The usage frequency is the highest, or the usage frequency is greater than the set frequency threshold;

[0119] The distance is the shortest, or the distance is less than the set distance threshold;

[0120] Active terminal devices or recently used terminal devices.

[0121] For example, in a scenario where a smart TV is voice controlled through a terminal device such as a mobile phone or a smart watch, when both the living room and the room are equipped with smart TVs and are in the first group, the first terminal device can send a first control instruction to both the smart TVs in the living room and the room, thereby allowing different smart TVs to be controlled simultaneously through one first terminal device, thereby improving control efficiency; the first terminal device can also send the first control instruction to the smart TV closest to the first terminal device, thereby allowing smart TVs in different spaces or at different distances to be controlled separately, thereby improving control accuracy.

[0122] In order to facilitate the user to know whether the first control instruction is sent successfully, in some embodiments, after sending the first control instruction to the second terminal device, the method further includes:

[0123] When the first terminal device successfully sends the first control instruction to the second terminal device, the first terminal device issues a second voice response regarding the first voice information; the second voice response indicates that the terminal device of the first device type has been instructed to perform the first operation; or

[0124] When the first control instruction fails to be sent or times out, the first terminal device issues a third voice response regarding the first voice information; the third voice response indicates that the terminal device of the first device type is not instructed to perform the first operation.

[0125] Here, when the second terminal device receives the first control instruction sent by the first terminal device, it returns a first notification message to the first terminal device, and the first notification message indicates that the corresponding first control instruction has been successfully received.

[0126] After sending the first control instruction to the second terminal device, and upon receiving the first notification message returned by the second terminal device, the first terminal device plays a second voice response to the first voice information, for example, the instruction has been successfully sent.

[0127] After the first terminal device sends the first control instruction to the second terminal device, and does not receive the first notification message returned by the second terminal device within a set time period, indicating that the first control instruction has failed to be sent or has timed out, the first terminal device voice broadcasts a third voice response to the first voice message, for example, sorry, the connection is unstable and the instruction sending failed.

[0128] After the first terminal device sends the third voice response to the first voice message, the user can input the first voice message to the first terminal device again through the first application, so that the first terminal re-sends the first control instruction to the second terminal device of the first device type. Alternatively, after the first terminal device sends the third voice response to the first voice message, the first terminal device can send the first control instruction to the second terminal device of the first device type again after a set time, such as 1 minute.

[0129] Step 404: Upon receiving the first control instruction, the second terminal device executes the first control instruction to perform the first operation.

[0130] Here, the second terminal device, upon receiving the first control instruction sent by the first terminal device, executes the first control instruction to perform the first operation. In actual application, upon receiving the first control instruction sent by the first terminal device, or in the process of executing the first control instruction, the second terminal device determines whether the first operation is supported, and if it is determined that the first operation is supported, executes the first operation; if the first operation is not supported, a voice prompt is issued, for example, the instruction execution fails, or the first operation is not supported.

[0131] Here, we continue to use the example of the first voice message being to turn up the TV volume, and the second terminal device being a smart TV. When the smart TV receives the first control instruction, it increases the volume based on the current volume. In actual application, if the volume adjustment range is not specified in the first control instruction, the smart TV can increase the volume according to the set step size; if the volume adjustment range is specified in the first control instruction, the volume is increased according to the volume adjustment range in the first control instruction.

[0132] It should be noted that when the first control instruction includes an adjustment amplitude or an adjustment value, when the adjustment amplitude or the adjustment value is greater than the maximum setting threshold of the corresponding function of the second terminal device, the second terminal device can output a voice response of execution failure, or it can be adjusted to the corresponding maximum setting threshold.

[0133] Considering that multiple users can perform voice control on the same terminal device through their respective terminal devices, or when the signal of the wireless local area network or the Bluetooth signal is unstable, the same user may send the first voice message multiple times. In order to reduce misoperation or avoid the second terminal device from frequently executing multiple identical control instructions received in a short time, in some embodiments, the method further includes:

[0134] In the case where the second terminal device receives one or more of the first control instructions again within a set time period after receiving the first control instruction, the second terminal device ignores the one or more first control instructions received again.

[0135] Here, if the second terminal device receives one or more first control instructions again within the set time after receiving the first control instruction, at this time, all the first control instructions received again are invalid instructions, and the second terminal device ignores all the first control instructions received again. In actual application, the set time can be 1.5 seconds, 1 second, 2 seconds, etc., and this embodiment does not specifically limit this.

[0136] In the present application, in a group composed of terminal devices that communicate based on short-range wireless communication technology, a first terminal device receives a first voice message sent by a user, and determines the instruction intention corresponding to the first voice message by parsing the first voice message; when it is determined that there is a second terminal device of the first device type in the first group, a first control instruction is sent to the second terminal device so that the second terminal device executes the first control instruction, thereby performing the first operation. In this way, when operating across devices, the execution device only needs to receive the corresponding control instruction and perform related operations based on the communication within the group with the wake-up device, eliminating the excessive time consumption generated by the interaction between the execution device and the cloud, reducing the time required for the execution device to obtain the first control instruction, and improving the voice control efficiency when executing across devices. In addition, the first terminal device locally parses the received voice information, eliminating the excessive time consumption generated by the interaction between the wake-up device and the cloud, saving the time consumed by transmitting voice information to the cloud server and waiting for the corresponding parsing results, which can further improve the voice control efficiency when executing across devices.

[0137] Figure 5 An interactive diagram of the voice control method provided in an embodiment of the present application. Figure 5The corresponding embodiments and Figure 4 The difference between the corresponding embodiments lies in step 502 and step 504. Figure 5 As shown, the voice control method includes:

[0138] Step 501: A first terminal device receives a first voice message.

[0139] Among them, step 501 is the same as step 301, and the implementation process please refer to the relevant description in step 301.

[0140] Step 502: When the first set condition is met, the first terminal device sends the first voice information to the cloud server.

[0141] Here, when the first terminal device receives the first voice message, it determines whether the first set condition is currently met. If the first set condition is met, it sends the first voice message to the cloud server, thereby improving the success rate of obtaining the instruction intent corresponding to the first voice message.

[0142] Among them, the first set condition indicates that the first terminal device does not support the voice information parsing function, the first terminal device fails to parse the first voice information, or the usage rate of the computing resources of the first terminal device is greater than or equal to a set threshold.

[0143] Step 503: The cloud server parses the first voice information to obtain the instruction intent corresponding to the first voice information.

[0144] Here, when the cloud server receives the first voice information, it parses the first voice information to obtain the instruction intent corresponding to the first voice information, and the instruction intent represents an instruction to instruct a terminal device of the first device type to perform a first operation.

[0145] Step 504: The cloud server returns the instruction intent to the first terminal device that sent the first voice information.

[0146] Here, upon obtaining the instruction intent corresponding to the first voice message, the cloud server returns the instruction intent corresponding to the first voice message to the first terminal device that sent the first voice message.

[0147] Step 505: The first terminal device receives the instruction intent returned by the cloud server.

[0148] Step 506: When it is determined that there is a second terminal device of the first device type in the first group, the first terminal device sends a first control instruction corresponding to the instruction intent to the second terminal device; wherein,

[0149] The first terminal device is located in the first group, and each terminal device in the first group communicates based on a short-range wireless communication technology.

[0150] Among them, step 506 is the same as step 303, and the implementation process please refer to the relevant description in step 303.

[0151] Step 507: Upon receiving the first control instruction, the second terminal device executes the first control instruction to perform the first operation.

[0152] Among them, step 507 is the same as step 404. Please refer to the relevant description in step 404 for the implementation process.

[0153] It should be noted that, considering that in daily life, users often do not remember where the terminal device is placed and need to find the terminal device, the user can input the first voice information to the first terminal device to find the terminal device according to the first voice information. Figure 4 or Figure 5 In a corresponding embodiment, the second terminal device is searched for through the first terminal device.

[0154] In the application scenario of searching for terminal devices, the first terminal device can be a mobile phone, notebook, smart watch, tablet computer, TV, refrigerator, air conditioner and other types of IoT terminals, and the second terminal device can be any type of movable terminal device, that is, the second terminal device can be any type of terminal device other than smart home appliances installed or placed in a fixed position; the first voice information is used to instruct the terminal device of the first device type to make a sound so that the user can find the corresponding terminal device based on the sound. In actual application, the first control instruction is used to control the second terminal device to vibrate, ring or play a set audio.

[0155] In some embodiments, when the user does not input voice information, the terminal devices in the first group can actively obtain the first information across devices, and when the obtained first information meets the set trigger conditions, output a voice prompt to prompt the user to perform corresponding processing.

[0156] The first information includes power information of the terminal device and / or a notification message newly received by the terminal device. The received notification message includes a text message notification and / or an incoming call notification.

[0157] When the first information is power information, the set trigger condition is that the power is less than or equal to the set power threshold, and the corresponding output voice prompt is used to remind the user to charge, for example, the power of device A is too low, please charge it in time.

[0158] When the first information is a notification message newly received by the terminal device, the set trigger condition is the existence of unread notification information, and the corresponding output voice prompt is used to remind the user to answer the phone, remind the user to check the text message, caller number or text message content, etc. For example, device B receives a new text message, or device C receives a new call, please handle it in time. In this way, the user can be reminded to handle unread text messages in time or to answer the call in time when the phone is muted, so as to avoid missing important information or calls.

[0159] Of course, when the first terminal device in the first group detects that the local first information meets the set trigger condition, it can also send a second control instruction to the second terminal device that supports audio playback, and the second control instruction is used to control the corresponding terminal device to perform a second operation. The second operation represents an operation related to the first information, for example, broadcasting the first information, or reminding the user to process the first information.

[0160] For example, when the current battery level of the mobile phone is less than 20%, or it is currently in low battery mode, a second control instruction is sent to a second terminal device that supports audio playback, triggering the second terminal device to voice broadcast the set charging reminder information. When the mobile phone receives an unread text message or an incoming call, a second control instruction is sent to a second terminal device that supports audio playback, triggering the second terminal device to voice broadcast the unread text message or incoming call number, so that even if the mobile phone is not with the user or the mobile phone is in silent mode, the user can handle it in time to avoid missing important information or calls.

[0161] In the present application, in a group composed of terminal devices that communicate based on short-range wireless communication technology, the first terminal device sends the received first voice information to the cloud server, the cloud server parses the first voice information, obtains the instruction intent corresponding to the first voice information, and returns the instruction intent to the first terminal device; when the first terminal device determines that there is a second terminal device of the first device type in the first group, it sends the first control instruction to the second terminal device, so that the corresponding second terminal device performs the first operation. In this way, when operating across devices, the execution device only needs to receive the corresponding control instruction and perform related operations based on the communication within the group with the wake-up device, eliminating the excessive time consumption generated by the interaction between the execution device and the cloud, and shortening the transmission distance of the first control instruction, reducing the time required for the execution device to obtain the first control instruction, and improving the voice control efficiency when executing across devices.

[0162] Figure 6 The following is a flow chart of the implementation of the voice control method provided by the application embodiment of the present application. The execution subject of this process is the first terminal device, such as Figure 6 As shown, the voice control method includes:

[0163] Step 601: Determine each terminal device and the corresponding device type in a first group at every set period; wherein the first terminal device is located in the first group, and each terminal device in the first group communicates based on short-range wireless communication technology.

[0164] Step 602: Receive first voice information.

[0165] Step 603: parse the first voice information to obtain the instruction intent corresponding to the first voice information; the instruction intent represents an instruction to instruct a terminal device of a first device type to perform a first operation.

[0166] Step 604: Determine whether the device type of the first terminal device is the first device type.

[0167] Here, the first terminal device determines whether the device type of the first terminal device is the first device type, and obtains a first determination result.

[0168] When the first judgment result indicates that the device type of the first terminal device is the first device type, indicating that the first control instruction is executed by the first terminal device, step 605 is executed.

[0169] If the first judgment result indicates that the device type of the first terminal device is not the first device type, it indicates that the first operation is performed by other terminal devices in the first group, and step 606 is executed. The first control instruction is used to instruct the corresponding terminal device to perform the first operation.

[0170] Step 605: Execute a first control instruction generated based on the instruction intention.

[0171] Step 606: Determine whether there is a second terminal device of the first device type in the first group.

[0172] Here, the first terminal device determines whether there is a second terminal device of the first device type in the first group, and obtains a second determination result.

[0173] When the second determination result indicates that there is a second terminal device of the first device type in the first group, step 607 is executed.

[0174] If the second judgment result indicates that there is no second terminal device of the first device type in the first group, step 605 is executed. In some embodiments, if the second judgment result indicates that there is no second terminal device of the first device type in the first group, step 605 is not executed, and a first voice prompt is issued, the first voice prompt being used to prompt the user to re-enter the voice information.

[0175] Step 607: Determine whether the first operation is a setting operation; wherein the setting operation represents an operation that is not supported to be executed across terminal devices or an operation that is not supported by the second terminal device.

[0176] Here, when the first terminal device has a second terminal device of the first device type in the first group, the first terminal device determines whether the first operation is a setting operation to obtain a third determination result. Figure 4 The relevant descriptions in the corresponding embodiments are not repeated here.

[0177] If the third judgment result indicates that the first operation is a setting operation, step 608 is executed; if the third judgment result indicates that the first operation is not a setting operation, step 605 is executed. It should be noted that, in some embodiments, if the third judgment result indicates that the first operation is not a setting operation, step 605 is not executed, and a first voice prompt is issued, and the first voice prompt is used to prompt the user to re-enter the voice information.

[0178] Step 608: When it is determined that there is a second terminal device of the first device type in the first group, a first control instruction is sent to the second terminal device so that the second terminal device executes the first control instruction.

[0179] The implementation process of step 608 may refer to the relevant description of step 303 and will not be repeated here.

[0180] After executing step 608 , the first terminal device executes step 609 .

[0181] Step 609: Determine whether the first control instruction is sent successfully.

[0182] Here, after sending the first control instruction to the second terminal device, the first electronic device determines whether a first notification message returned by the second terminal device is received within a set time period, and the first notification message indicates that the corresponding first control instruction has been successfully received.

[0183] If the first notification message is received within the set time, it indicates that the first control instruction is sent successfully, and step 610 is executed; if the first notification message is not received within the set time, it indicates that the first control instruction fails to be sent or the sending times out, and step 611 is executed.

[0184] Step 610: Issue a second voice response regarding the first voice information; the second voice response indicates that the terminal device of the first device type has been instructed to perform the first operation.

[0185] Step 611: issuing a third voice response regarding the first voice information; the third voice response indicates that the terminal device of the first device type is not instructed to perform the first operation.

[0186] To implement the voice control method of the present application, the present application also provides a voice control device, such as Figure 7 As shown, the voice control device comprises:

[0187] The receiving module 71 is used to receive the first voice information;

[0188] A determination module 72, configured to determine an instruction intention corresponding to the first voice information, wherein the instruction intention indicates instructing a terminal device of a first device type to perform a first operation;

[0189] The sending module 73 is used to send a first control instruction to a second terminal device of the first device type when it is determined that the second terminal device exists in the first group, so that the second terminal device executes the first control instruction; wherein,

[0190] When the first control instruction is executed, the corresponding terminal device executes the first operation; the first terminal device is located in the first group, and each terminal device in the first group communicates based on short-range wireless communication technology.

[0191] In some embodiments, the sending module 73 is specifically used to: when it is determined that there are at least two second terminal devices of the first device type in the first group, send the first control instruction to all or part of the at least two second terminal devices.

[0192] In some embodiments, the determination module 72 is further used to: determine at least one second terminal device from the at least two second terminal devices according to the parameter value of the setting parameter of the second terminal device; wherein the number of the at least one second terminal device is less than the total number of all second terminal devices;

[0193] The sending module 73 is further used to: send the first control instruction to the determined at least one second terminal device.

[0194] In some embodiments, the setting parameters include at least one of the following:

[0195] Power;

[0196] Software / hardware performance indicators;

[0197] User usage frequency;

[0198] The distance from the first terminal device;

[0199] The active state of the device.

[0200] In some embodiments, the determination module 72 is specifically used to: analyze the first voice information to obtain the instruction intention; or

[0201] The sending module 73 is also used to: send the first voice information to the cloud server when a first set condition is met; and the receiving module 71 is also used to: receive the instruction intention obtained by parsing the cloud server; the first set condition indicates that the first terminal device does not support the voice information parsing function, the determination module 72 fails to parse the first voice information, or the usage rate of the computing resources of the voice control device is greater than or equal to the set threshold.

[0202] In some embodiments, the voice control device further includes:

[0203] An execution module is used to execute the first control instruction when the voice control device is of the first device type.

[0204] In some embodiments, the voice control device further includes:

[0205] an output module, configured to issue a first voice prompt when there is no terminal device of the first device type in the first group, or when the first operation is a setting operation; wherein:

[0206] The first voice prompt is used to prompt the user to re-enter the voice information; the setting operation represents an operation that is not supported to be executed across terminal devices or an operation that is not supported by the second terminal device.

[0207] In some embodiments, the determination module 72 is further used to: determine each terminal device in the first group and the corresponding device type every set period.

[0208] In actual application, the voice control device includes an execution module, an output module and a determination module 72, which can be implemented by a processor in the voice control device, such as a central processing unit (CPU), a digital signal processor (DSP), a microcontroller unit (MCU) or a programmable gate array (FPGA); the voice control device includes a receiving module 71 and a sending module 73, which can be implemented together by the processor and the communication interface in the voice control device.

[0209] It should be noted that: when the voice control device provided in the above embodiment performs voice control, only the division of the above program modules is used as an example. In actual applications, the above processing can be assigned to different program modules as needed, that is, the internal structure of the voice control device is divided into different program modules to complete all or part of the above-described processing. In addition, the voice control device provided in the above embodiment and the voice control method embodiment belong to the same concept, and the specific implementation process is detailed in the method embodiment, which will not be repeated here.

[0210] Based on the hardware implementation of the above program modules, and in order to implement the voice control method of the embodiment of the present application, the embodiment of the present application also provides a terminal device. Figure 8 A schematic diagram of the hardware structure of the terminal device provided in the embodiment of the present application is shown in FIG. Figure 8 As shown, the terminal device 8 includes:

[0211] Communication interface 81, capable of exchanging information with other devices such as network devices;

[0212] The processor 82 is connected to the communication interface 81 to implement information interaction with other devices and is used to execute the voice control method provided by one or more technical solutions on the terminal side when running a computer program. The computer program is stored in the memory 83.

[0213] Of course, in actual application, the various components in the terminal device 8 are coupled together through the bus system 84. It can be understood that the bus system 84 is used to realize the connection and communication between these components. In addition to the data bus, the bus system 84 also includes a power bus, a control bus and a status signal bus. However, for the sake of clarity, Figure 8 Various buses are labeled as bus system 84 .

[0214] The memory 83 in the embodiment of the present application is used to store various types of data to support the operation of the terminal device 8. Examples of such data include: any computer program used to operate on the terminal device 8.

[0215] It can be understood that the memory 83 can be a volatile memory or a non-volatile memory, and can also include both volatile and non-volatile memories. Among them, the non-volatile memory can be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), a magnetic random access memory (FRAM), a flash memory, a magnetic surface memory, an optical disk, or a compact disc read-only memory (CD-ROM); the magnetic surface memory can be a disk memory or a tape memory. The volatile memory can be a random access memory (RAM), which is used as an external cache. By way of example and not limitation, many forms of RAM are available, such as Static Random Access Memory (SRAM), Synchronous Static Random Access Memory (SSRAM), Dynamic Random Access Memory (DRAM), Synchronous Dynamic Random Access Memory (SDRAM), Double Data Rate Synchronous Dynamic Random Access Memory (DDRSDRAM), Enhanced Synchronous Dynamic Random Access Memory (ESDRAM), Sync Link Dynamic Random Access Memory (SLDRAM), and Direct Rambus Random Access Memory (DRRAM).The memory 83 described in the embodiments of the present application is intended to include but is not limited to these and any other suitable types of memory.

[0216] The method disclosed in the above embodiment of the present application can be applied to the processor 82, or implemented by the processor 82. The processor 82 may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above method can be completed by the hardware integrated logic circuit in the processor 82 or the instruction in the form of software. The above processor 82 can be a general-purpose processor, a DSP, or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components, etc. The processor 82 can implement or execute the methods, steps and logic block diagrams disclosed in the embodiments of the present application. The general-purpose processor can be a microprocessor or any conventional processor, etc. In combination with the steps of the method disclosed in the embodiment of the present application, it can be directly embodied as a hardware decoding processor to execute, or it can be executed by a combination of hardware and software modules in the decoding processor. The software module can be located in a storage medium, which is located in the memory 83, and the processor 82 reads the program in the memory 83 and completes the steps of the above method in combination with its hardware.

[0217] Optionally, when the processor 82 executes the program, it implements the corresponding processes implemented by the terminal in each method of the embodiments of the present application, which will not be described here for the sake of brevity.

[0218] In an exemplary embodiment, the present application also provides a storage medium, namely a computer storage medium, specifically a computer-readable storage medium, for example, including a first memory 83 storing a computer program, and the computer program can be executed by a processor 82 of the terminal to complete the steps of the aforementioned method. The computer-readable storage medium can be a memory such as FRAM, ROM, PROM, EPROM, EEPROM, Flash Memory, magnetic surface storage, optical disk, or CD-ROM.

[0219] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. The device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation, such as: multiple units or components can be combined, or can be integrated into another system, or some features can be ignored or not executed. In addition, the coupling, direct coupling, or communication connection between the components shown or discussed can be through some interfaces, and the indirect coupling or communication connection of the devices or units can be electrical, mechanical or other forms.

[0220] The units described above as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units; some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.

[0221] In addition, all functional units in the embodiments of the present application may be integrated into one processing module, or each unit may be separately configured as a unit, or two or more units may be integrated into one unit; the above-mentioned integrated units may be implemented in the form of hardware or in the form of hardware plus software functional units.

[0222] A person of ordinary skill in the art can understand that: all or part of the steps of implementing the above method embodiment can be completed by hardware related to program instructions, and the aforementioned program can be stored in a computer-readable storage medium. When the program is executed, it executes the steps of the above method embodiment; and the aforementioned storage medium includes: mobile storage devices, read-only memory (ROM), random access memory (RAM), magnetic disks or optical disks, etc., various media that can store program codes.

[0223] It should be noted that the technical solutions described in the embodiments of the present application can be combined arbitrarily without conflict.

[0224] It should be noted that the term "and / or" in the embodiments of the present application is only a description of the association relationship of the associated objects, indicating that there may be three relationships. For example, A and / or B can represent the three situations of: A exists alone, A and B exist at the same time, and B exists alone. In addition, the term "at least one" in this article represents any combination of at least two of any one or more of a plurality of. For example, including at least one of A, B, and C can represent including any one or more elements selected from the set consisting of A, B, and C.

[0225] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art who is familiar with the present technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

Claims

1. A voice control method, characterized in that: Applied to a first terminal device, the method includes: receiving a first voice message; Determine the instruction intention corresponding to the first voice information; the instruction intention represents instructing a terminal device of the first device type to perform a first operation; When it is determined that there is a second terminal device of the first device type in the first group, a first control instruction is sent to the second terminal device so that the second terminal device executes the first control instruction; wherein, When the first control instruction is executed, the corresponding terminal device executes the first operation; the first terminal device is located in the first group, and each terminal device in the first group communicates based on short-range wireless communication technology; When it is determined that there is no terminal device of the first device type in the first group, based on the short-range wireless communication technology, detect whether there is a terminal device of the first device type that has not joined the first group within the current communication range; when it is detected that there is a second terminal device of the first device type that has not joined the first group, send an add request representing joining the first group to the detected second terminal device; when it is detected that the second terminal device agrees to join the first group, add the second terminal device to the first group, and send the first control instruction to the second terminal device.

2. The method according to claim 1, characterized in that The sending a first control instruction to a second terminal device of the first device type when it is determined that the second terminal device exists in the first group includes: When it is determined that at least two second terminal devices of the first device type exist in the first group, the first control instruction is sent to all or part of the at least two second terminal devices.

3. The method according to claim 2, characterized in that Sending the first control instruction to some of the at least two second terminal devices includes: Determining at least one second terminal device from the at least two second terminal devices according to the parameter value of the setting parameter of the second terminal device; wherein the number of the at least one second terminal device is less than the total number of all the second terminal devices; The first control instruction is sent to the determined at least one second terminal device.

4. The method according to claim 3, characterized in that The setting parameters include at least one of the following: Power; Software / hardware performance indicators; User usage frequency; The distance from the first terminal device; The activity status of the device.

5. The method according to claim 1, characterized in that The determining the instruction intention corresponding to the first voice information includes: Analyze the first voice information to obtain the instruction intention; or, if a first set condition is met, send the first voice information to a cloud server and receive the instruction intention analyzed by the cloud server; the first set condition indicates that the first terminal device does not support the voice information analysis function, the first terminal device fails to parse the first voice information, or the usage rate of the computing resources of the first terminal device is greater than or equal to a set threshold.

6. The method according to claim 1, characterized in that The method further comprises: When the first terminal device is of the first device type, the first control instruction is executed.

7. The method according to claim 1, characterized in that The method further comprises: If there is no terminal device of the first device type in the first group, or if the first operation is a setting operation, a first voice prompt is issued; wherein, The first voice prompt is used to prompt the user to re-enter the voice information; The setting operation represents an operation that is not supported to be performed across terminal devices or an operation that is not supported by the second terminal device.

8. The method according to any one of claims 1 to 7, characterized in that: Before receiving the first voice information, the method further includes: At every set period, each terminal device in the first group and the corresponding device type are determined.

9. A voice control method, characterized in that: include: Each first terminal device of at least one first terminal device receives the first voice information; All or part of the at least one first terminal device determine the instruction intent corresponding to the first voice information, and when determining that there is a second terminal device of the first device type in the first group, send a first control instruction corresponding to the instruction intent to the second terminal device; wherein the instruction intent represents an instruction to instruct the terminal device of the first device type to perform a first operation; The second terminal device that receives the first control instruction executes the first control instruction to perform the first operation; wherein, The at least one first terminal device is located in the first group, and each terminal device in the first group communicates based on a short-range wireless communication technology; When it is determined that there is no terminal device of the first device type in the first group, the at least one first terminal device detects, based on the short-range wireless communication technology, whether there is a terminal device of the first device type that has not joined the first group within the current communication range; when it is detected that there is a second terminal device of the first device type that has not joined the first group, the at least one first terminal device sends an add request representing joining the first group to the detected second terminal device; when it is detected that the second terminal device agrees to join the first group, the second terminal device is added to the first group, and the first control instruction is sent to the second terminal device.

10. The method according to claim 9, characterized in that The method further comprises: In the case where the second terminal device receives one or more of the first control instructions again within a set time period after receiving the first control instruction, the second terminal device ignores the one or more first control instructions received again.

11. A voice control device, applied to a first terminal device, characterized in that: include: A receiving module, used for receiving first voice information; A determination module, configured to determine an instruction intention corresponding to the first voice information, wherein the instruction intention indicates instructing a terminal device of a first device type to perform a first operation; a sending module, configured to send a first control instruction to a second terminal device of the first device type when determining that the second terminal device exists in the first group, so that the second terminal device executes the first control instruction; wherein, When the first control instruction is executed, the corresponding terminal device executes the first operation; the first terminal device is located in the first group, and each terminal device in the first group communicates based on short-range wireless communication technology; The sending module is further configured to detect, based on the short-range wireless communication technology, whether there is a terminal device of the first device type that has not joined the first group within a current communication range when it is determined that there is no terminal device of the first device type in the first group; When it is detected that there is a second terminal device of the first device type that has not joined the first group, an add request representing joining the first group is sent to the detected second terminal device; when it is detected that the second terminal device agrees to join the first group, the second terminal device is added to the first group, and the first control instruction is sent to the second terminal device.

12. A terminal device, characterized in that: include: A processor and a memory for storing a computer program that can be run on the processor, wherein the processor, when running the computer program, executes the steps of the voice control method according to any one of claims 1 to 8 or 9 to 10.

13. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the voice control method according to any one of claims 1 to 8 or 9 to 10 are implemented.

Images