Voice control method and device of intelligent device, storage medium and electronic device

Abstract

The application discloses a voice control method and device of an intelligent device, a storage medium and an electronic device, relates to the technical field of smart homes, and solves the technical problem of how to control a device to improve the response speed of the device. The voice control method of the intelligent device comprises the following steps: analyzing voice interaction data of a target object, and determining a plurality of voice data packets corresponding to the voice interaction data; determining a voice control instruction of the target object and an intelligent device to be controlled by the voice control instruction according to the recognition results of the plurality of voice data packets; searching for a target voice control instruction consistent with the voice control instruction from a device instruction set supported by the intelligent device, and controlling the intelligent device according to the target voice control instruction.

Description

Technical Field

[0001] This application relates to the field of smart home technology, and more specifically, to a voice control method, apparatus, storage medium, and electronic device for a smart device. Background Technology

[0002] Currently, with the continuous advancement of technology, more and more smart devices support voice control. For example, Haier's smart home appliances can be controlled using voice commands such as "Xiao You, Xiao You, turn on the air conditioner," eliminating the need for manual remote control operation. However, when controlling smart home appliances via voice, delays in device response can occur, reducing the user experience. Solutions in this area include: 1. Improving the user's home internet speed; 2. Enhancing the device's response speed.

[0003] For Option 1, due to considerations of technology and cost, the industry generally uses ASR (Automatic Speech Recognition), NLP (Natural Language Processing), and TTS (Text-to-Speech) to complete voice acquisition and voice broadcasting on the server side. However, users' home network speed has a speed bottleneck. After exceeding a certain threshold, it cannot be improved further. In addition, the reasons for response delay are not only due to poor network speed. Simply increasing the network speed cannot completely solve the problem of response delay.

[0004] For Option 2, sometimes improving the device's response speed cannot meet the requirements of the device access platform. For example, the actual response speed of the device cannot be balanced with the time required by the device access platform to respond to commands. This is not conducive to the promotion of the device access platform. Moreover, the device response speed is limited by the device hardware and cannot be improved indefinitely.

[0005] Therefore, in related technologies, there is a technical problem of how to control the equipment to improve its response speed.

[0006] Regarding the technical problem of how to control equipment to improve its response speed in related technologies, no effective solution has yet been proposed. Summary of the Invention

[0007] This application provides a voice control method, apparatus, storage medium, and electronic device for smart devices, to at least solve the technical problem in the related art of how to control devices to improve device response speed.

[0008] According to one embodiment of this application, a voice control method for a smart device is provided, comprising: parsing voice interaction data of a target object to determine a plurality of voice data packets corresponding to the voice interaction data; wherein the plurality of voice data packets include: a first voice data packet and a second voice data packet, the first voice data packet including: entity words for indicating the smart device, and the second voice data packet including: other voice interaction data in the voice interaction data excluding the first voice data packet; determining a voice control command for the target object and a smart device to be controlled by the voice control command based on the recognition results of the plurality of voice data packets; searching for a target voice control command consistent with the voice control command from a set of device commands supported by the smart device, and controlling the smart device according to the target voice control command.

[0009] In one exemplary embodiment, determining multiple voice data packets corresponding to the voice interaction data includes: grouping the voice interaction data according to a preset period to obtain multiple voice interaction data, wherein the multiple voice interaction data are continuous in time; and recognizing each voice interaction data in the multiple voice interaction data to obtain multiple voice data packets included in each voice data.

[0010] In one exemplary embodiment, determining the voice control command of the target object based on the recognition results of the plurality of voice data packets includes: comparing the plurality of second voice data packets with a preset white noise to obtain the data similarity between the plurality of second voice data packets and the preset white noise; determining the second voice data packet corresponding to the largest data similarity as the target voice data packet; if the data similarity of the target voice data packet is determined to be greater than a preset threshold, determining other voice data packets besides the target voice data packet from the plurality of second voice data packets, and determining the voice control command of the target object based on the voice recognition results of the other voice data packets and the first voice data packet.

[0011] In an exemplary embodiment, before searching for a target voice control command consistent with the voice control command from the set of device commands supported by the smart device, the method further includes: obtaining device information sent by the smart device, determining the device state of the smart device based on the device information; and, if the device state of the smart device is determined to be a working state, obtaining a set of device commands supported by the smart device preset by the target object.

[0012] In one exemplary embodiment, controlling the smart device according to the target voice control instruction includes: acquiring a set of mutually exclusive instructions for the smart device, wherein the set of mutually exclusive instructions includes: different device modes that the smart device is allowed to run, and voice control instructions that the different device modes cannot support; if the target voice control instruction is not found in the set of mutually exclusive instructions, pausing the execution of control instructions in the current device mode of the smart device, and executing the target voice control instruction; after executing the target voice control instruction, continuing to execute control instructions in the current device mode.

[0013] In one exemplary embodiment, after controlling the smart device according to the target voice control instruction, the method includes: receiving a response message from the smart device, wherein the response message includes an execution result of the smart device executing the target voice control instruction; if it is determined that the execution result indicates that the smart device failed to execute the target voice control instruction, and if it is determined that the device state of the smart device is a working state, then sending the target voice control instruction to the smart device to control the smart device to re-execute the target voice control instruction.

[0014] In an exemplary embodiment, before searching for a target voice control command consistent with the voice control command from the set of device commands supported by the smart device, the method further includes: obtaining a set of dedicated device commands preset for the target object, wherein the set of dedicated device commands represents the historical device control commands of the target object; and searching for a target voice control command consistent with the voice control command from the set of dedicated device commands.

[0015] According to another embodiment of this application, a voice control device for a smart device is also provided, comprising: a first determining module, configured to parse voice interaction data of a target object and determine a plurality of voice data packets corresponding to the voice interaction data; wherein the plurality of voice data packets include: a first voice data packet and a second voice data packet, the first voice data packet including: entity words for indicating the smart device, and the second voice data packet including: other voice interaction data in the voice interaction data besides the first voice data packet; a second determining module, configured to determine the voice control command of the target object and the smart device to be controlled by the voice control command based on the recognition results of the plurality of voice data packets; and a control module, configured to search for a target voice control command consistent with the voice control command from a set of device commands supported by the smart device, and control the smart device according to the target voice control command.

[0016] According to another aspect of the embodiments of this application, a computer-readable storage medium is also provided, wherein a computer program is stored in the computer-readable storage medium, and the computer program is configured to execute the voice control method of the above-described smart device when it is run.

[0017] According to another aspect of the embodiments of this application, an electronic device is also provided, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the voice control method of the above-mentioned smart device through the computer program.

[0018] In this embodiment, the voice interaction data of the target object is parsed to determine multiple voice data packets corresponding to the voice interaction data. These multiple voice data packets include a first voice data packet and a second voice data packet. The first voice data packet includes entity words used to indicate the smart device, and the second voice data packet includes other voice interaction data in the voice interaction data besides the first voice data packet. Based on the recognition results of the multiple voice data packets, the voice control command of the target object and the smart device to be controlled by the voice control command are determined. A target voice control command consistent with the voice control command is searched from the set of device commands supported by the smart device, and the smart device is controlled according to the target voice control command. By adopting the above technical solution, the technical problem of how to control the device to improve the device response speed is solved, thereby improving the device response speed and enhancing the user experience. Attached Figure Description

[0019] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this application and, together with the description, serve to explain the principles of this application.

[0020] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, for those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0021] Figure 1 This is a schematic diagram of the hardware environment for a voice control method for a smart device according to an embodiment of this application;

[0022] Figure 2 This is a flowchart of a voice control method for a smart device according to an embodiment of this application;

[0023] Figure 3 This is a schematic diagram of a voice control method for a smart device according to an embodiment of this application;

[0024] Figure 4 This is a structural block diagram (a) of a voice control device for a smart device according to an embodiment of this application;

[0025] Figure 5 This is a structural block diagram (II) of a voice control device for a smart device according to an embodiment of this application. Detailed Implementation

[0026] To enable those skilled in the art to better understand the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present application, and not all embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative effort should fall within the scope of protection of the present application.

[0027] It should be noted that the terms "first," "second," etc., in the specification, claims, and accompanying drawings of this application are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of this application described herein can be implemented in orders other than those illustrated or described herein. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.

[0028] According to one aspect of the embodiments of this application, a voice control method for a smart device is provided. This voice control method for a smart device is widely used in whole-house intelligent digital control application scenarios such as smart homes, smart home ecosystems, and smart house ecosystems. Optionally, in this embodiment, the above-mentioned voice control method for a smart device can be applied to, for example... Figure 1 The hardware environment shown consists of terminal device 102 and server 104. For example... Figure 1 As shown, server 104 is connected to terminal device 102 via a network and can be used to provide services (such as application services) to the terminal or clients installed on the terminal. A database can be set up on the server or independently of the server to provide data storage services for server 104. Cloud computing and / or edge computing services can be configured on the server or independently of the server to provide data processing services for server 104.

[0029] The aforementioned network may include, but is not limited to, at least one of the following: wired network, wireless network. The aforementioned wired network may include, but is not limited to, at least one of the following: wide area network, metropolitan area network, local area network. The aforementioned wireless network may include, but is not limited to, at least one of the following: Wi-Fi (Wireless Fidelity), Bluetooth. The terminal device 102 may not be limited to PC, mobile phone, tablet computer, smart air conditioner, smart range hood, smart refrigerator, smart oven, smart stove, smart washing machine, smart water heater, smart washing equipment, smart dishwasher, smart projector, smart TV, smart clothes rack, smart curtains, smart audio-visual equipment, smart socket, smart speaker, smart speaker box, smart fresh air equipment, smart kitchen and bathroom equipment, smart bathroom equipment, smart robot vacuum cleaner, smart window cleaning robot, smart mopping robot, smart air purifier, smart steam oven, smart microwave oven, smart water heater, smart air purifier, smart water dispenser, smart door lock, etc.

[0030] This embodiment provides a voice control method for a smart device, applied to the aforementioned computer terminal. Figure 2 This is a flowchart of a voice control method for a smart device according to an embodiment of this application, the process including the following steps:

[0031] Step S202: Analyze the voice interaction data of the target object to determine multiple voice data packets corresponding to the voice interaction data; wherein, the multiple voice data packets include: a first voice data packet and a second voice data packet, the first voice data packet includes: entity words used to indicate the smart device, and the second voice data packet includes: other voice interaction data in the voice interaction data besides the first voice data packet;

[0032] Step S204: Determine the voice control command of the target object and the smart device to be controlled by the voice control command based on the recognition results of the multiple voice data packets;

[0033] Step S206: Search for a target voice control command that matches the voice control command from the set of device commands supported by the smart device, and control the smart device according to the target voice control command.

[0034] Through the above steps, the voice interaction data of the target object is parsed to determine multiple voice data packets corresponding to the voice interaction data. These multiple voice data packets include a first voice data packet and a second voice data packet. The first voice data packet includes entity words used to indicate the smart device, and the second voice data packet includes other voice interaction data in the voice interaction data besides the first voice data packet. Based on the recognition results of the multiple voice data packets, the voice control command of the target object and the smart device to be controlled by the voice control command are determined. A target voice control command consistent with the voice control command is searched from the set of device commands supported by the smart device, and the smart device is controlled according to the target voice control command. This solves the technical problem in related technologies of how to control devices to improve device response speed, thereby improving device response speed and enhancing user experience.

[0035] In the above embodiments, it should be noted that, in the process of searching for a target voice control command that matches the voice control command from the set of device commands supported by the smart device, if the search fails, a preset reply is sent to the user (i.e., the target object), and the user's voice interaction data is re-analyzed to determine the latest multiple voice data packets. Then, the recognition results of the latest multiple voice data packets are used to determine the user's voice control command and the smart device to be controlled by the voice control command.

[0036] Optionally, the aforementioned preset response may include, for example, "This operation is not supported in the current mode," but is not limited to this. In this embodiment, after searching for a target voice control command that matches the voice control command from the set of device commands supported by the smart device, a preset response such as "Okay, a target voice control command has been found for you" may also be sent to the user (i.e., the aforementioned target object).

[0037] In an exemplary embodiment, to better understand the process of determining the multiple voice data packets corresponding to the voice interaction data in step S202 above, the following technical solution is proposed, the specific steps of which include: grouping the voice interaction data according to a preset period to obtain multiple voice interaction data, wherein the multiple voice interaction data are continuous in time; and recognizing each voice interaction data in the multiple voice interaction data to obtain the voice data packet included in each voice data.

[0038] Through the above embodiments, a technical solution for periodically grouping voice interaction data is proposed. The preset period can be flexibly adjusted. It can be fixed, in which case the preset time interval between two consecutive groups of voice interaction data at any time can be the same. Alternatively, it can change in real time, in which case the preset time interval between two consecutive groups of voice interaction data at any time can be different. Optionally, for example, the interval between two consecutive groups of voice interaction data in group A is set to 2s, and the interval between two consecutive groups of voice interaction data in group (A+1) is set to 3s. This application does not limit this.

[0039] In an exemplary embodiment, to better understand the technical solution of determining the voice control command of the target object based on the recognition results of the plurality of voice data packets in step S204 above, the following implementation steps are specifically proposed: comparing the plurality of second voice data packets with preset white noise respectively to obtain the data similarity between the plurality of second voice data packets and the preset white noise; determining the second voice data packet corresponding to the largest data similarity as the target voice data packet; if the data similarity of the target voice data packet is determined to be greater than a preset threshold, determining other voice data packets other than the target voice data packet from the plurality of second voice data packets, and determining the voice control command of the target object based on the voice recognition results of the other voice data packets and the first voice data packet.

[0040] Optionally, when preset white noise data is detected, the noise time period of the process of detecting the preset white noise data is acquired; if it is determined that the noise time period is longer than the preset time period, the smart device is controlled to send an inquiry message to the target object, the inquiry message being used to ask the target object whether to end the current voice interaction process; if a reply message is received from the target object, if it is determined that the reply message indicates that the target object does not end the current voice interaction process, the voice interaction data of the target object is acquired again; if it is determined that the reply message indicates that the target object ends the current voice interaction process, the voice interaction data of the target object is stopped, and the smart device is controlled to prompt the target object that the current voice interaction process has ended.

[0041] In one exemplary embodiment, before searching for a target voice control command consistent with the voice control command from the set of device commands supported by the smart device, other technical solutions are further proposed, specifically including: obtaining device information sent by the smart device, determining the device state of the smart device based on the device information; and, if the device state of the smart device is determined to be a working state, obtaining the set of device commands supported by the smart device preset by the target object.

[0042] Through the above embodiments, the status information of the smart device can be queried in advance, and the set of device commands supported by the smart device can be determined in advance, thereby saving the time for the user to find the set of device commands supported by the smart device after ending the voice interaction and improving the device control efficiency.

[0043] In an exemplary embodiment, a technical solution is proposed to illustrate the control of the smart device according to the target voice control instruction in step S206 above. The specific steps include: obtaining a set of mutually exclusive instructions for the smart device, wherein the set of mutually exclusive instructions includes: different device modes that the smart device is allowed to run, and voice control instructions that the different device modes cannot support; if the target voice control instruction is not found in the set of mutually exclusive instructions, pausing the execution of control instructions in the current device mode of the smart device, and executing the target voice control instruction; after executing the target voice control instruction, continuing to execute control instructions in the current device mode.

[0044] It should be noted that the control commands in the current device mode of the aforementioned smart device may include, for example, remote control commands, on-site control commands, etc., but are not limited to these.

[0045] In an exemplary embodiment, further, after controlling the smart device according to the target voice control command, the following technical solution is proposed, the specific steps of which include: receiving a response message from the smart device, wherein the response message includes the execution result of the smart device executing the target voice control command; if it is determined that the execution result indicates that the smart device has failed to execute the target voice control command, and if it is determined that the device state of the smart device is a working state, then sending the target voice control command to the smart device to control the smart device to re-execute the target voice control command.

[0046] In an exemplary embodiment, further, before searching for a target voice control command consistent with the voice control command from the set of device commands supported by the smart device, a set of dedicated device commands preset for the target object may be obtained, wherein the set of dedicated device commands represents the historical device control commands of the target object; and a target voice control command consistent with the voice control command is searched from the set of dedicated device commands.

[0047] Furthermore, in this embodiment, if the search is successful, the smart device is controlled according to the found target voice control command; if the search fails, a target voice control command consistent with the voice control command is then searched from the set of device commands supported by the smart device.

[0048] In an optional embodiment, a preset response corresponding to the target voice control command is obtained; the broadcast format supported by the smart device is determined according to the device type of the smart device, and the preset response is broadcast in the broadcast format supported by the smart device.

[0049] The broadcast formats supported by smart devices may include audio and video broadcasts, text broadcasts, pop-up broadcasts, virtual avatar broadcasts, etc., and this application does not impose any restrictions on them.

[0050] To better understand the process of the voice control method for the above-mentioned smart device, the implementation flow of the voice control method for the above-mentioned smart device will be described below in conjunction with optional embodiments, but this is not intended to limit the technical solution of the embodiments of this application.

[0051] In this embodiment, combined with Figure 3 A voice control method for smart devices is provided. Figure 3 This is a schematic diagram of a voice control method for a smart device according to an embodiment of this application, such as... Figure 3 As shown, the specific steps are as follows:

[0052] Step 1: The user's voice interaction data can be broken down into small audio packets and uploaded to the server. For example, the audio duration of each small audio packet can be set to be less than 200ms.

[0053] Optionally, the user may end the voice interaction based on whether the audio in the small audio packet is white noise. For example, if multiple small audio packets are identified as having white noise and last for more than 500ms, the user may end the voice interaction.

[0054] Step 2: Perform streaming ASR (i.e., real-time recognition of the uploaded audio) and return the recognition results in real time;

[0055] Step 3: Perform streaming NLP (i.e., perform real-time semantic understanding on the identified content) to identify user intent in real time;

[0056] Step 4: Query the status information of the smart device;

[0057] It should be noted that steps 2, 3, and 4 can be executed simultaneously or sequentially, and this application does not impose any restrictions on this.

[0058] Step 5: Based on the intent identified in Steps 2-3, pre-synthesize the text to be broadcast (i.e., the preset response above).

[0059] Step 6: Perform mutual exclusion logic verification on the intent identified in Steps 2-3 (i.e., whether the smart device supports executing the user command in the current mode), and broadcast the corresponding text according to the mutual exclusion logic verification result. If the verification passes, a success message such as "Okay, the operation has been performed for you" will be broadcast directly; if the verification fails, a mutually exclusive message such as "This operation is not supported in the current mode" or "It is already in XX mode" will be broadcast.

[0060] Step 7: Perform a fallback: If the broadcast fails, retrieve the latest device status from the server and automatically retry the command. If it still fails, notify the user. This step is generally applicable to scenarios where the mutual exclusion check has passed but the command still fails.

[0061] Through the above embodiments, the device can be controlled according to the status information of the smart device, and the response accuracy of the device can be improved through mutual exclusion logic verification.

[0062] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods according to the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) and includes several instructions to cause a terminal device (which may be a mobile phone, computer, server, or network device, etc.) to execute the methods of the various embodiments of this application.

[0063] Figure 4 This is a structural block diagram (a) of a voice control device for a smart device according to an embodiment of this application; as shown... Figure 4 As shown, it includes:

[0064] The first determining module 42 is used to parse the voice interaction data of the target object and determine multiple voice data packets corresponding to the voice interaction data; wherein, the multiple voice data packets include: a first voice data packet and a second voice data packet, the first voice data packet includes: entity words used to indicate the smart device, and the second voice data packet includes: other voice interaction data in the voice interaction data besides the first voice data packet;

[0065] The second determining module 44 is used to determine the voice control command of the target object and the smart device to be controlled by the voice control command based on the recognition results of the multiple voice data packets.

[0066] The control module 46 is used to search for a target voice control command that matches the voice control command from the set of device commands supported by the smart device, and control the smart device according to the target voice control command.

[0067] The aforementioned device parses the voice interaction data of the target object to determine multiple voice data packets corresponding to the voice interaction data. These multiple voice data packets include a first voice data packet and a second voice data packet. The first voice data packet includes entity words used to indicate the smart device, and the second voice data packet includes other voice interaction data in the voice interaction data besides the first voice data packet. Based on the recognition results of the multiple voice data packets, the device's voice control command and the smart device to be controlled by the voice control command are determined. A target voice control command consistent with the voice control command is searched from the set of device commands supported by the smart device, and the smart device is controlled according to the target voice control command. This solves the technical problem in related technologies of how to control devices to improve device response speed, thereby improving device response speed and enhancing user experience.

[0068] In the above embodiments, it should be noted that, in the process of searching for a target voice control command that matches the voice control command from the set of device commands supported by the smart device, if the search fails, a preset reply is sent to the user (i.e., the target object), and the user's voice interaction data is re-analyzed to determine the latest multiple voice data packets. Then, the recognition results of the latest multiple voice data packets are used to determine the user's voice control command and the smart device to be controlled by the voice control command.

[0069] Optionally, the aforementioned preset response may include, for example, "This operation is not supported in the current mode," but is not limited to this. In this embodiment, after searching for a target voice control command that matches the voice control command from the set of device commands supported by the smart device, a preset response such as "Okay, a target voice control command has been found for you" may also be sent to the user (i.e., the aforementioned target object).

[0070] In an exemplary embodiment, the first determining module 42 is further configured to: group the voice interaction data according to a preset period to obtain multiple voice interaction data, wherein the multiple voice interaction data are continuous in time; and identify each voice interaction data in the multiple voice interaction data to obtain the voice data packet included in each voice data.

[0071] Through the above embodiments, a technical solution for periodically grouping voice interaction data is proposed. The preset period can be flexibly adjusted. It can be fixed, in which case the preset time interval between two consecutive groups of voice interaction data at any time can be the same. Alternatively, it can change in real time, in which case the preset time interval between two consecutive groups of voice interaction data at any time can be different. Optionally, for example, the interval between two consecutive groups of voice interaction data in group A is set to 2s, and the interval between two consecutive groups of voice interaction data in group (A+1) is set to 3s. This application does not limit this.

[0072] In an exemplary embodiment, the second determining module 44 is further configured to: compare the plurality of second voice data packets with the preset white noise respectively to obtain the data similarity between the plurality of second voice data packets and the preset white noise; determine the second voice data packet corresponding to the largest data similarity as the target voice data packet; if the data similarity of the target voice data packet is determined to be greater than a preset threshold, determine other voice data packets other than the target voice data packet from the plurality of second voice data packets, and determine the voice control command of the target object based on the voice recognition results recognized by the other voice data packets and the first voice data packet.

[0073] Optionally, when preset white noise data is detected, the noise time period of the process of detecting the preset white noise data is acquired; if it is determined that the noise time period is longer than the preset time period, the smart device is controlled to send an inquiry message to the target object, the inquiry message being used to ask the target object whether to end the current voice interaction process; if a reply message is received from the target object, if it is determined that the reply message indicates that the target object does not end the current voice interaction process, the voice interaction data of the target object is acquired again; if it is determined that the reply message indicates that the target object ends the current voice interaction process, the voice interaction data of the target object is stopped, and the smart device is controlled to prompt the target object that the current voice interaction process has ended.

[0074] In an exemplary embodiment, the second determining module 44 is further configured to: obtain device information sent by the smart device before searching for a target voice control command consistent with the voice control command from the set of device commands supported by the smart device, and determine the device state of the smart device based on the device information; and, if the device state of the smart device is determined to be a working state, obtain the set of device commands supported by the smart device preset by the target object.

[0075] In an exemplary embodiment, the control module 46 is further configured to: acquire a set of mutually exclusive instructions for the smart device, wherein the set of mutually exclusive instructions includes: different device modes that the smart device is allowed to run, and voice control instructions that the different device modes cannot support; if the target voice control instruction is not found in the set of mutually exclusive instructions, suspend the execution of control instructions in the current device mode of the smart device, and execute the target voice control instruction; after executing the target voice control instruction, continue to execute control instructions in the current device mode.

[0076] It should be noted that the control commands in the current device mode of the aforementioned smart device may include, for example, remote control commands, on-site control commands, etc., but are not limited to these.

[0077] In an exemplary embodiment, the control module 46 is further configured to: receive a response message from the smart device, wherein the response message includes the execution result of the smart device executing the target voice control command; if the execution result indicates that the smart device has failed to execute the target voice control command, and if the device state of the smart device is determined to be in a working state, then send the target voice control command to the smart device to control the smart device to re-execute the target voice control command.

[0078] In one exemplary embodiment, such as Figure 5 As shown, Figure 5 This is a structural block diagram (II) of a voice control device for a smart device according to an embodiment of this application. In addition to the first determining module 42, the second determining module 44, and the control module 46, the voice control device for the smart device also includes a search module 52, configured to: before searching for a target voice control command consistent with the voice control command from the set of device commands supported by the smart device, further acquire a set of dedicated device commands preset for the target object, wherein the set of dedicated device commands represents the historical device control commands of the target object; and search for a target voice control command consistent with the voice control command from the set of dedicated device commands.

[0079] Furthermore, in this embodiment, if the search is successful, the smart device is controlled according to the found target voice control command; if the search fails, a target voice control command consistent with the voice control command is then searched from the set of device commands supported by the smart device.

[0080] In an optional embodiment, a preset response corresponding to the target voice control command is obtained; the broadcast format supported by the smart device is determined according to the device type of the smart device, and the preset response is broadcast in the broadcast format supported by the smart device.

[0081] The broadcast formats supported by smart devices may include audio and video broadcasts, text broadcasts, pop-up broadcasts, virtual avatar broadcasts, etc., and this application does not impose any restrictions on them.

[0082] Embodiments of this application also provide a storage medium including a stored program, wherein the program executes any of the methods described above when it is run.

[0083] Optionally, in this embodiment, the storage medium may be configured to store program code for performing the following steps:

[0084] S1, parse the voice interaction data of the target object to determine multiple voice data packets corresponding to the voice interaction data; wherein, the multiple voice data packets include: a first voice data packet and a second voice data packet, the first voice data packet includes: entity words used to indicate the smart device, and the second voice data packet includes: other voice interaction data in the voice interaction data besides the first voice data packet;

[0085] S2, determine the voice control command of the target object and the smart device to be controlled by the voice control command based on the recognition results of the multiple voice data packets;

[0086] S3, search for a target voice control command that matches the voice control command from the set of device commands supported by the smart device, and control the smart device according to the target voice control command.

[0087] Embodiments of this application also provide an electronic device including a memory and a processor, the memory storing a computer program and the processor being configured to run the computer program to perform the steps in any of the above method embodiments.

[0088] Optionally, the electronic device may further include a transmission device and an input / output device, wherein the transmission device is connected to the processor and the input / output device is connected to the processor.

[0089] Optionally, in this embodiment, the processor can be configured to perform the following steps via a computer program:

[0090] S1, parse the voice interaction data of the target object to determine multiple voice data packets corresponding to the voice interaction data; wherein, the multiple voice data packets include: a first voice data packet and a second voice data packet, the first voice data packet includes: entity words used to indicate the smart device, and the second voice data packet includes: other voice interaction data in the voice interaction data besides the first voice data packet;

[0091] S2, determine the voice control command of the target object and the smart device to be controlled by the voice control command based on the recognition results of the multiple voice data packets;

[0092] S3, search for a target voice control command that matches the voice control command from the set of device commands supported by the smart device, and control the smart device according to the target voice control command.

[0093] Optionally, in this embodiment, the storage medium may include, but is not limited to, various media capable of storing program code, such as USB flash drives, read-only memory (ROM), random access memory (RAM), portable hard drives, magnetic disks, or optical disks.

[0094] Optionally, specific examples in this embodiment can refer to the examples described in the above embodiments and optional implementations, and will not be repeated here.

[0095] Obviously, those skilled in the art should understand that the modules or steps of this application described above can be implemented using general-purpose computing devices. They can be centralized on a single computing device or distributed across a network of multiple computing devices. Optionally, they can be implemented using computer-executable program code, thereby storing them in a storage device for execution by a computing device. In some cases, the steps shown or described can be performed in a different order than those presented here, or they can be fabricated as separate integrated circuit modules, or multiple modules or steps can be fabricated as a single integrated circuit module. Thus, this application is not limited to any particular combination of hardware and software.

[0096] The above description is only a preferred embodiment of this application. It should be noted that for those skilled in the art, several improvements and modifications can be made without departing from the principle of this application, and these improvements and modifications should also be considered within the scope of protection of this application.

Claims

1. A voice control method for a smart device, characterized in that, include: The voice interaction data of the target object is parsed to determine multiple voice data packets corresponding to the voice interaction data; wherein, the multiple voice data packets include: a first voice data packet and a second voice data packet, the first voice data packet includes: entity words used to indicate the smart device, and the second voice data packet includes: other voice interaction data in the voice interaction data besides the first voice data packet; Based on the recognition results of the multiple voice data packets, the voice control command of the target object and the smart device to be controlled by the voice control command are determined; The system searches for a target voice control command that matches the voice control command from the set of device commands supported by the smart device, and controls the smart device according to the target voice control command. Determining the voice control command for the target object based on the recognition results of the multiple voice data packets includes: The data similarity between the multiple second speech data packets and the preset white noise is obtained by comparing the multiple second speech data packets with the preset white noise. The second speech data packet corresponding to the highest data similarity is determined as the target speech data packet; If the data similarity of the target voice data packet is determined to be greater than a preset threshold, other voice data packets besides the target voice data packet are determined from multiple second voice data packets, and the voice control command of the target object is determined based on the voice recognition results of the other voice data packets and the first voice data packet.

2. The voice control method for intelligent devices according to claim 1, characterized in that, The multiple voice data packets corresponding to the voice interaction data are determined, including: The voice interaction data is grouped according to a preset period to obtain multiple voice interaction data, wherein the multiple voice interaction data are continuous in time. Each of the multiple voice interaction data is identified to obtain multiple voice data packets included in each voice data.

3. The voice control method for intelligent devices according to claim 1, characterized in that, Before searching for a target voice control command that matches the voice control command from the set of device commands supported by the smart device, the method further includes: Obtain device information sent by the smart device, and determine the device status of the smart device based on the device information; If the device status of the smart device is determined to be working, the set of device instructions supported by the smart device preset by the target object is obtained.

4. The voice control method for a smart device according to claim 1 or 3, characterized in that, Controlling the smart device according to the target voice control command includes: Obtain the set of mutually exclusive instructions for the smart device, wherein the set of mutually exclusive instructions includes: different device modes that the smart device is allowed to run, and voice control instructions that the different device modes cannot support; If the target voice control command is not found in the set of mutually exclusive commands, the execution of the control commands in the current device mode of the smart device is paused, and the target voice control command is executed. After executing the target voice control command, continue executing the control commands in the current device mode.

5. The voice control method for intelligent devices according to claim 1, characterized in that, After controlling the smart device according to the target voice control command, the process includes: Receive a response message from the smart device, wherein the response message includes the execution result of the smart device executing the target voice control command; If the execution result indicates that the smart device has failed to execute the target voice control command, and if the device status of the smart device is determined to be in a working state, then the target voice control command is sent to the smart device to control the smart device to re-execute the target voice control command.

6. The voice control method for a smart device according to claim 1, characterized in that, Before searching for a target voice control command that matches the voice control command from the set of device commands supported by the smart device, the method further includes: Obtain a set of dedicated device instructions preset for the target object, wherein the set of dedicated device instructions represents the historical device control instructions of the target object; Search within the set of dedicated device instructions for a target voice control instruction that matches the voice control instruction.

7. A voice control device for a smart device, characterized in that, include: The first determining module is used to parse the voice interaction data of the target object and determine multiple voice data packets corresponding to the voice interaction data; wherein, the multiple voice data packets include: a first voice data packet and a second voice data packet, the first voice data packet includes: entity words used to indicate the smart device, and the second voice data packet includes: other voice interaction data in the voice interaction data besides the first voice data packet; The second determining module is used to determine the voice control command of the target object and the smart device to be controlled by the voice control command based on the recognition results of the multiple voice data packets. The control module is used to search for a target voice control command that matches the voice control command from the set of device commands supported by the smart device, and control the smart device according to the target voice control command; The second determining module is further configured to compare the plurality of second voice data packets with the preset white noise respectively to obtain the data similarity between the plurality of second voice data packets and the preset white noise; determine the second voice data packet corresponding to the largest data similarity as the target voice data packet; if the data similarity of the target voice data packet is determined to be greater than a preset threshold, determine other voice data packets other than the target voice data packet from the plurality of second voice data packets, and determine the voice control command of the target object based on the voice recognition results recognized by the other voice data packets and the first voice data packet.

8. A computer-readable storage medium, characterized in that, The computer-readable storage medium includes a stored program, wherein the program, when executed, performs the method described in any one of claims 1 to 6.

9. An electronic device comprising a memory and a processor, characterized in that, The memory stores a computer program, and the processor is configured to execute the method described in any one of claims 1 to 6 through the computer program.

Images