Voice control method and device, household appliance and storage medium

Abstract

The invention relates to the technical field of intelligent household electrical appliances, and discloses a method for voice control, and the method for voice control comprises the steps: receiving a voice instruction of a user; analyzing the voice instruction to obtain the attribute of the voice instruction; and according to the attribute of the voice instruction, enabling to-be-controlled equipment to execute a corresponding operation. By providing a voice control mechanism in an intelligent household appliance scene, the voice control mode of the household appliance is optimized. After the voice instruction is obtained, the corresponding control flow is determined to be executed according to the instruction attribute of the voice instruction, so that the probability that the equipment correctly executes the operation semantics corresponding to the voice instruction is improved, and the execution of the voice instruction can meet the corresponding service requirement. The invention further discloses a device for voice control, a household appliance and a storage medium.

Description

Technical Field

[0001] The present application relates to the field of smart home technology, for example, to a method and device for voice control, home appliance, and storage medium. Background Art

[0002] At present, with the rapid development of Internet of Things technology, information technology, artificial intelligence technology, etc., intelligent devices have been widely popularized in the fields of home, entertainment, travel, etc., and concepts such as smart home and smart city have gradually become popular. The development of technologies such as voice recognition has also made voice control technology a new type of human-computer interaction method that gradually replaces traditional control methods such as touch technology, and plays an increasingly important role in intelligent scenarios such as smart home.

[0003] For devices that support voice control, voice control can be used to replace traditional control methods (such as touch panels) to control the device. Compared with traditional control methods, voice control is more convenient and faster, can adapt to more people, and be more widely used; on the other hand, as the most natural human-computer interaction interface, it has a more convenient hands-free operation feature than traditional control methods such as touch or gestures. In addition, considering the special needs of the elderly and some people with limited mobility, the use of voice commands can allow them to better enjoy the convenience brought by smart homes.

[0004] Compared with traditional human-computer interaction, voice control can control the device through voice commands without the operator touching the device, and can even operate the device through remote control when the device is not within the operator's line of sight. However, given the characteristics of voice control, such as flexibility, ambiguity, and susceptibility to environmental factors, the research of voice technology alone cannot eliminate the phenomenon of misoperation, let alone solve the series of hidden dangers caused by the device being out of the operator's line of sight.

[0005] In the process of implementing the embodiments of the present disclosure, it is found that there are at least the following problems in the related art:

[0006] Existing research and technology mainly focus on the research of voice technologies such as speech recognition and voiceprint recognition, and are committed to improving the accuracy of devices in parsing voice commands. However, due to the complexity of the use environment and the limitations of voice technology, simply through research and solutions at the voice technology level, it is impossible to improve the accuracy of voice control of home appliances to meet business needs.

[0007] It should be noted that the information disclosed in the above background technology section is only used to enhance the understanding of the background of the present application, and therefore may include information that does not constitute the prior art known to ordinary technicians in the field. Summary of the invention

[0008] In order to provide a basic understanding of some aspects of the disclosed embodiments, a brief summary is given below. The summary is not an extensive review, nor is it intended to identify key / critical components or delineate the scope of protection of these embodiments, but rather serves as a prelude to the detailed description that follows.

[0009] The embodiments of the present disclosure provide a method and device for voice control, a home appliance, and a storage medium to improve the accuracy of voice control of the home appliance.

[0010] In some embodiments, the method for voice control includes: receiving a user's voice command; parsing the voice command to obtain attributes of the voice command; and causing the device to be controlled to perform a corresponding operation according to the attributes of the voice command.

[0011] Optionally, according to the attribute of the voice command, causing the device to be controlled to perform a corresponding operation includes:

[0012] Obtaining the correspondence between the attributes of the voice command and the control process;

[0013] Determine a control flow corresponding to the attributes of the current voice command, and make the device to be controlled perform an operation corresponding to the control flow;

[0014] The attribute of the voice instruction includes information indicating one or more of a business characteristic, a constraint condition, and a recognition characteristic of the voice instruction.

[0015] Optionally, when the attribute of the voice instruction includes information indicating a service characteristic of the voice instruction, the determining a control flow corresponding to the attribute of the current voice instruction includes:

[0016] In the case where the service characteristics of the voice command include that the voice command requires feedback confirmation, the control process is to enable the device to be controlled to feedback a confirmation voice;

[0017] In the case where the service characteristic of the voice instruction includes that the voice instruction does not require feedback confirmation, the control flow is to enable the device to be controlled to execute the operational semantics of the voice instruction.

[0018] Optionally, when the attribute of the voice instruction includes information for indicating a constraint condition of the voice instruction, the determining a control flow corresponding to the attribute of the current voice instruction includes:

[0019] Analyzing the constraint conditions to determine the constraint elements that the voice command needs to satisfy;

[0020] A corresponding control process is determined according to the constraint elements.

[0021] Optionally, controlling the device to be controlled to perform a corresponding operation according to the constraint factor includes:

[0022] When the voice command satisfies the constraint elements, causing the device to be controlled to execute the operational semantics of the voice command;

[0023] When the voice command does not satisfy the constraint elements, the device to be controlled is enabled to feedback a confirmation voice.

[0024] Optionally, when the attribute of the voice instruction includes information indicating a recognition characteristic of the voice instruction, the determining a control flow corresponding to the attribute of the current voice instruction includes:

[0025] When the false recognition rate of the recognition characteristic is less than or equal to the operation threshold, the device to be controlled is caused to feedback a confirmation voice;

[0026] When the false recognition rate of the recognition characteristic is greater than the operation threshold, the device to be controlled executes the operation semantics of the voice command and feeds back the execution result.

[0027] In some embodiments, the device for voice control includes: a receiving module configured to receive a user's voice command; a parsing module configured to parse the voice command and obtain the attributes of the voice command; and an execution module configured to enable the controlled device to perform corresponding operations according to the attributes of the voice command.

[0028] In some embodiments, the apparatus for voice control includes a processor and a memory storing program instructions, and the processor is configured to execute the above-mentioned method for voice control when running the program instructions.

[0029] In some embodiments, the household appliance includes:

[0030] Device body; the device for voice control as described above is installed on the device body.

[0031] In some embodiments, the storage medium stores program instructions, and when the program instructions are run, the method for voice control as described above is executed.

[0032] The method and device for voice control, home appliance, and storage medium provided by the embodiments of the present disclosure can achieve the following technical effects:

[0033] By providing a voice control mechanism in the smart home appliance scenario, the voice control method of home appliances is optimized. After obtaining the voice command, the corresponding control process execution is determined according to the command attributes of the voice command, thereby increasing the probability that the device correctly executes the operation semantics corresponding to the voice command, so that the execution of the voice command can meet its corresponding business needs.

[0034] The above general description and the following description are exemplary and explanatory only and are not intended to limit the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0035] One or more embodiments are exemplarily described by corresponding drawings, which do not limit the embodiments. Elements with the same reference numerals in the drawings are shown as similar elements, and the drawings do not constitute a scale limitation, and wherein:

[0036] Figure 1 is an environmental schematic diagram of an implementation environment of the method for voice control provided by an embodiment of the present disclosure;

[0037] Figure 2 is a schematic diagram of a method for voice control provided by an embodiment of the present disclosure;

[0038] Figure 3a is a schematic diagram of another method for voice control provided by an embodiment of the present disclosure;

[0039] Figure 3b is an interactive diagram of a method for voice control provided by an embodiment of the present disclosure;

[0040] Figure 4a is a schematic diagram of another method for voice control provided by an embodiment of the present disclosure;

[0041] Figure 4b is an interactive diagram of a method for voice control provided by an embodiment of the present disclosure;

[0042] Figure 4c is an interaction diagram of another method for voice control provided by an embodiment of the present disclosure;

[0043] Figure 5 is a schematic diagram of another method for voice control provided by an embodiment of the present disclosure;

[0044] Figure 6 is a schematic diagram of another method for voice control provided by an embodiment of the present disclosure;

[0045] Figure 7 is a schematic diagram of a device for voice control provided by an embodiment of the present disclosure;

[0046] Figure 8 is a schematic diagram of another device for voice control provided by an embodiment of the present disclosure. DETAILED DESCRIPTION

[0047] In order to be able to understand the features and technical contents of the embodiments of the present disclosure in more detail, the implementation of the embodiments of the present disclosure is described in detail below in conjunction with the accompanying drawings. The attached drawings are for reference only and are not used to limit the embodiments of the present disclosure. In the following technical description, for the convenience of explanation, a full understanding of the disclosed embodiments is provided through multiple details. However, one or more embodiments can still be implemented without these details. In other cases, to simplify the drawings, well-known structures and devices can be simplified for display.

[0048] The terms "first", "second", etc. in the specification and claims of the embodiments of the present disclosure and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the terms used in this way can be interchanged where appropriate, so that the embodiments of the embodiments of the present disclosure described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions.

[0049] Unless otherwise stated, the term "plurality" means two or more.

[0050] In the embodiment of the present disclosure, the character " / " indicates that the preceding and following objects are in an "or" relationship. For example, A / B indicates: A or B.

[0051] The term "and / or" is a description of the association relationship between objects, indicating that three relationships can exist. For example, A and / or B means: A or B, or, A and B.

[0052] The term "correspondence" may refer to an association relationship or a binding relationship. The correspondence between A and B means that there is an association relationship or a binding relationship between A and B.

[0053] In the embodiments of the present disclosure, smart home appliances refer to home appliances that are formed by introducing microprocessors, sensor technology, and network communication technology into home appliances. They have the characteristics of intelligent control, intelligent perception, and intelligent application. The operation process of smart home appliances often relies on the application and processing of modern technologies such as the Internet of Things, the Internet, and electronic chips. For example, smart home appliances can be connected to electronic devices to enable users to remotely control and manage the smart home appliances.

[0054] In the embodiments of the present disclosure, a mobile terminal refers to an electronic device with a wireless connection function. The terminal device can communicate with the above-mentioned smart home appliances by connecting to the Internet, or can directly communicate with the above-mentioned smart home appliances by means of Bluetooth, WiFi, etc. In some embodiments, the terminal device is, for example, a mobile device, a computer, or a vehicle-mounted device built into a hover car, or any combination thereof. Mobile devices may include, for example, mobile phones, smart home devices, wearable devices, smart mobile devices, virtual reality devices, etc., or any combination thereof, wherein wearable devices include, for example: smart watches, smart bracelets, pedometers, etc.

[0055] With the popularity of smart home appliances that support voice control functions, voice control technology plays an increasingly important role in smart scenarios such as smart homes. On the one hand, compared with traditional control methods such as control panels that require a long time to learn, voice control is more convenient and quick, can adapt to more people, and be more widely used; on the other hand, voice commands, as the most natural human-computer interaction interface, have more convenient hands-free operation characteristics than traditional control methods such as control panels. In addition, considering the special needs of the elderly and some people with limited mobility, the use of voice commands can allow them to better enjoy the convenience brought by smart homes.

[0056] Compared with traditional human-computer interaction methods, voice control can control the device through voice commands without the operator having direct contact with the device, and can even operate the device through remote control when the device is not within the operator's line of sight. However, due to the characteristics of voice commands such as flexibility, easy generalization, easy ambiguity, and susceptibility to interference from environmental noise during the transmission process, while it brings great convenience, it also poses new challenges.

[0057] For example, the limitations of voice technology, environmental noise and the complexity of natural language (such as language habits, accents, languages, etc.) lead to erroneous operations caused by voice command recognition errors; compared with traditional human-computer interaction methods, the use of voice control interaction allows operators to operate the device when the device is not within their line of sight, making it impossible for operators to promptly understand the device's execution of voice commands; since the device is not always within the operator's line of sight, abnormal conditions such as erroneous operation of the device to voice commands cannot always be discovered and handled by the operator in a timely manner, especially in situations involving stricter safety requirements.

[0058] Given the many challenges that come with introducing voice control, a mechanism is needed to ensure that the above-mentioned and other possible issues can be effectively handled.

[0059] Figure 1Schematic diagram of the implementation environment of the embodiment of the present disclosure. Figure 1 As shown, the implementation environment may include a mobile terminal 10 , a home appliance 20 , a router 30 and a cloud server 40 .

[0060] An application is installed on the mobile terminal 10, and the user can use the application to configure the operation of the home appliance 20. The mobile terminal 10 can be any electronic device that supports information input, such as a smart phone and a tablet computer.

[0061] The home appliance 20 can communicate with the cloud server 40 and the mobile terminal 10 through the router 30. The home appliance 20 can be a smart home appliance such as a television, a refrigerator, a washing machine, an air conditioner, etc. that is integrated with a WIFI module.

[0062] The router 30 is a device that connects the local area networks and wide area networks in the Internet. It automatically selects and sets routes according to the channel conditions and sends signals in the best path and in a forward and backward order. The home appliance 20 can establish a communication connection with the cloud server 40 through the router 30.

[0063] The cloud server 40 may be a single server, or a server cluster consisting of a plurality of servers, or a cloud computing service center, which is not limited in the embodiments of the present disclosure.

[0064] It should be understood that Figure 1 The number of mobile terminals, home appliances, routers and cloud servers in the figure is only illustrative. According to actual needs, there may be any number of mobile terminals, home appliances, routers and servers. For example, multiple home appliances may correspond to one cloud server.

[0065] It should be noted that the method for voice control provided in the embodiments of the present disclosure is generally executed by one or more of a mobile terminal, a home appliance, a router and a cloud server. Accordingly, the device for voice control is generally arranged on one or more of a mobile terminal, a home appliance, a router and a cloud server.

[0066] Combination Figure 2 As shown, the present disclosure provides a method for voice control, which is applied to Figure 1 In an environment. When the home appliance has a voice recognition function, the method can be executed on the home appliance side, for example, by a processor of the home appliance; in some cases, the method can also be executed by one or more of a cloud server, a mobile terminal, and a router. In the embodiment of the present disclosure, the solution is described with the processor of the home appliance as the execution subject.

[0067] like Figure 2 As shown, the method for voice control includes:

[0068] Step S201, receiving a user's voice command.

[0069] Among them, the voice command can be a voice command directly issued by the receiving operator; or the voice command sent by the operator is received by other devices and forwarded to the home appliance. For example, the voice command can be input into the mobile terminal by the user of the mobile terminal, and then received by the home appliance through the communication relationship between the mobile terminal and the home appliance. For example, a voice input button is set in the application of the mobile terminal, and the user inputs the voice command by touching or clicking the voice input button; or a plurality of voice messages that can match the user's operation intention are set in the application of the mobile terminal, and the user selects from a plurality of voice messages to send the corresponding voice message as a voice command to the home appliance. The voice command carries information such as the command attributes of the voice command, and can control the controlled device to perform the corresponding operation.

[0070] Step S202: parse the voice command to obtain the attributes of the voice command.

[0071] The attributes of a voice command may include the voice command itself, the operation command corresponding to the voice command, the operation semantics of the voice command, etc. The command attributes of a voice command may also include one or more information of the target device operated by the voice command, the service characteristics of the voice command, the constraints, and the recognition characteristics. Here, the recognition characteristics may include the recognition accuracy that the voice command needs to meet, the severity of the loss caused by the possible misoperation of the voice command, etc.

[0072] The step of parsing the voice command can be completed locally by the device or by obtaining relevant services from a cloud server or edge computing node or controller.

[0073] Step S203: according to the attribute of the voice command, the device to be controlled executes a corresponding operation.

[0074] Here, the device to be controlled is Figure 1 One or more of the household appliances shown in . By establishing an association relationship or mapping relationship between the attributes of the voice command and the control process of the device to be controlled, after parsing and obtaining the attributes of the voice command, the device to be controlled executes the control process associated with the command attributes according to the attributes of the voice command, thereby ensuring that the execution of the voice command can meet its attribute requirements. Optionally, this association relationship or mapping relationship can be implemented on the device to be controlled, and the device to be controlled selects the control process according to the association relationship or mapping relationship; or this association relationship or mapping relationship is specified by the cloud server, and after receiving the voice command, the voice command or the command attribute of the voice command is reported to the cloud, and the cloud selects the corresponding control process and instructs the device to be controlled to execute according to the control process.

[0075] Figure 3aand Figure 3b A method for voice control is provided in an embodiment of the present disclosure, which is applied to Figure 1 In the disclosed embodiment, the solution is described by taking the processor of the home appliance as the execution subject.

[0076] In an embodiment of the present disclosure, the instruction attributes of the voice instruction are associated with the corresponding control flow to ensure that when the device uses the control flow associated with the instruction attributes of the received voice instruction to execute the received voice instruction, the execution of the voice instruction can meet its business needs.

[0077] like Figure 3a As shown, the method for voice control includes:

[0078] Step S301, receiving a user's voice command.

[0079] Step S302: parse the voice command to obtain the attributes of the voice command.

[0080] Step S303, obtaining the corresponding relationship between the attributes of the voice command and the control process.

[0081] Step S304, determine the control flow corresponding to the attribute of the current voice command, and make the controlled device perform the operation corresponding to the control flow. The attribute of the voice command includes one or more information indicating the service characteristics, constraint conditions, and recognition characteristics of the voice command.

[0082] Here, the control flow associated with the command attribute of the voice command refers to the use of the corresponding control flow to interact with the user or perform related operations after the device receives the voice command. The business requirements of the voice command can be met by executing the control flow.

[0083] The control process executed by the device may include: whether the device needs to provide confirmation voice feedback to the user when executing a voice command; and / or whether the device needs or does not need the voice command to meet preset constraints when executing a voice command; and / or whether the device needs or does not need the device state to meet preset constraints when executing a voice command; and / or whether the device needs or does not need to provide execution status feedback to the operator after executing a voice command, etc.

[0084] According to the command attributes of the voice command, a corresponding control flow is selected for the voice command to ensure that when the device receives the voice command, the execution of the voice command can meet its business needs when the voice command is executed using the control flow associated with the command attributes of the received voice command.

[0085] By establishing a correspondence between the attributes of voice commands and the control process, the controlled device can execute the voice command according to the control process corresponding to the command attributes of the voice command, thereby ensuring that the execution of the voice command can meet the business requirements of the voice command or the operation.

[0086] Optionally, the correspondence between the attributes of the voice command and the control process can be implemented in the home appliance in the form of a configuration file, software or firmware; that is, the correspondence between the attributes of the voice command and the control process is implemented in the voice control system of the device to be controlled in the form of a configuration file, software code or firmware. Optionally, the acquisition of the correspondence can be achieved when the home appliance is produced, or it can be loaded after the home appliance is connected to the Internet, for example, when the manufacturer upgrades the device online, it can be achieved through OTA (Over-The-Air) technology.

[0087] In some cases, the step of obtaining the association relationship or mapping relationship may not be performed in each specific voice control process after it is implemented during device production or through online upgrades, that is, this step is not a necessary operation for each voice command execution.

[0088] Figure 3b The above-mentioned voice control method is shown in Figure 1 The interaction flow in the system shown.

[0089] In this embodiment, the correspondence between the attributes of the voice command and the control process can be implemented on the cloud server in the form of a configuration file, software or firmware; that is, the correspondence between the attributes of the voice command and the control process can be implemented on the cloud server in the form of a configuration file, software code or firmware.

[0090] like Figure 3b As shown, the method includes:

[0091] Step S300b: The cloud server obtains configuration information. The configuration information indicates the control process and configuration information that the device to be controlled should use to execute the voice command.

[0092] Step S301b: the device to be controlled receives a voice command sent by a user.

[0093] Step S302b: the device to be controlled sends a voice command to the cloud server.

[0094] Step S303b: the cloud server parses the voice command and obtains the command attributes of the voice command.

[0095] Step S304b: The cloud server selects a corresponding control process and sends configuration information of the selected control process to the device to be controlled.

[0096] Step S305b: the device to be controlled executes an operation corresponding to the control process.

[0097] In other embodiments, after the device receives the voice command, it obtains the command attributes of the voice command and sends the command attributes of the voice command to the cloud server. After the cloud server receives the command attributes of the voice command sent by the device, it selects the corresponding control flow and sends the configuration information of the selected control flow to the device. The configuration information indicates the control flow and its configuration information that the device should use to execute the voice command. After receiving the configuration information, the device uses the control flow indicated by the configuration information to interact with the operator and execute the voice command.

[0098] Optionally, the instruction attributes of a voice instruction may be the voice instruction itself, the operation corresponding to the voice instruction, or the operation instruction; the instruction attributes of a voice instruction may also be the device or device type that executes the voice instruction; the instruction attributes of a voice instruction may also be the business requirements of the voice instruction, such as the accuracy of voice instruction recognition that needs to be met for the operation executed by the voice instruction and / or the interaction success rate that needs to be met for the execution of the voice instruction and / or the response time requirements that need to be met for the execution of the voice instruction, etc.; the instruction attributes of a voice instruction may also be the constraints that need to be met for the voice instruction and / or the constraints that need to be met for the device to execute the voice instruction and / or the losses that may be caused by the incorrect operation of the voice instruction, etc.; these are not limited in the present invention.

[0099] Optionally, the control process may be that the execution of the voice command requires or does not require the operator to perform a second confirmation and / or the voice command requires or does not require the preset constraints and / or the execution of the voice command requires or does not require the device to satisfy the preset constraints and / or the execution of the voice command requires or does not require feedback of the execution status to the operator, etc.; this is not limited in the present invention.

[0100] The following describes the execution process of the voice control method in combination with the command attributes of different voice commands.

[0101] Figure 4a A method for voice control is shown, which is applied to Figure 1 In the system, it is used to illustrate the situation where the command attribute of the voice command is a business characteristic.

[0102] like Figure 4a As shown, the method for voice control includes:

[0103] Step S401, receiving a user's voice command.

[0104] Step S402: parse the voice command to obtain the attributes of the voice command.

[0105] Step S403: when the attribute of the voice instruction includes information indicating the service characteristics of the voice instruction, a control flow corresponding to the attribute of the current voice instruction is determined.

[0106] Step S404, when the service characteristics of the voice command include that the voice command requires feedback confirmation, the control flow is to make the controlled device feedback a confirmation voice;

[0107] Here, the business characteristics are used to indicate whether the voice command requires a second confirmation between the home appliance and the operator. Accordingly, in the case where the voice command requires feedback confirmation, the control process can be set to enable the controlled device to feedback the confirmation voice and execute the operational semantics of the voice command after receiving the confirmation command. That is, after receiving and parsing the voice command, the controlled device feedbacks the confirmation voice to confirm the voice command or the operation to be performed with the operator, and executes the voice command after obtaining the operator's confirmation.

[0108] Step S405, when the service characteristic of the voice command includes that the voice command does not require feedback confirmation, the control flow is to make the controlled device execute the operational semantics of the voice command. After receiving the voice command, the device parses the voice command and directly executes the operational semantics of the voice command.

[0109] By instructing the device to provide feedback to the operator for confirmation after receiving and parsing the voice command, and then executing the voice command after obtaining the operator's second confirmation, the probability of misidentification and misoperation can be reduced.

[0110] Optionally, the control flow corresponding to the command attribute selection of the above-mentioned voice command and the business characteristics can be executed by the device. In this case, the association relationship between the command attribute of the voice command and the control flow is implemented on the device in the form of a configuration file, software or firmware.

[0111] Figure 4b The above-mentioned voice control method is shown in Figure 1 The interaction flow in the system shown in Figure 1 is as follows. Figure 4b As shown, the method includes:

[0112] Step S401b: The cloud server sends configuration information to the device to be controlled. The configuration information includes a mapping relationship between the attributes of the voice command and the control process.

[0113] Step S402b: the device to be controlled receives the configuration information and performs configuration within the device.

[0114] Step S403b: the device to be controlled receives a voice command sent by the user.

[0115] Step S404b: the device to be controlled analyzes the attributes of the voice command to determine the service characteristics of the voice command.

[0116] Step S405b: When the service characteristics of the voice command include that the voice command requires feedback confirmation, voice interaction is performed with the user.

[0117] Step S406b: the device to be controlled receives the confirmation instruction and executes the operational semantics of the voice instruction.

[0118] For example, the mapping relationship between the attributes of the voice command and the control flow in the above configuration information can be reflected in the form of a mapping table. Table 1 shows a mapping table between the attributes of the voice command and the control flow.

[0119] Table 1

[0120] Voice command properties Control Flow Service Features A Feedback confirmation voice Service Feature B Execution Operational Semantics

[0121] In this way, when the home appliance receives a voice command, it selects the control flow corresponding to the service characteristic to run according to the command attribute of the voice command. That is, when the command attribute includes service characteristic A, it means that the current voice command needs feedback confirmation, and the control flow is to feedback the confirmation voice and verify with the operator; when the command attribute includes service characteristic B, the voice command is directly executed.

[0122] For example, the mapping relationship between the attributes of the voice command in the above configuration information and the control flow can also be achieved by setting corresponding indication information, and different values ​​of the indication information indicate whether the service characteristics of the voice command need to feedback a confirmation voice to the user for secondary confirmation with the user. Table 2 shows a correspondence table between the attributes of a voice command and the control flow.

[0123] Table 2

[0124] Voice command properties Control Flow Attr0 Action0 Attr1 Action1 Attr2 Action2 …… ……

[0125] In this way, when the home appliance receives a voice command, it selects the control flow corresponding to the service characteristic to run according to the command attribute of the voice command. That is, when the command attribute includes the indication information that the service characteristic is attr0, the control flow is to execute action action0; when the command attribute includes the indication information that the service characteristic is attr1, the control flow is to execute action action1; when the command attribute includes the indication information that the service characteristic is attr2, the control flow is to execute action action2. Here, the execution action may include direct execution, feedback of the first voice, feedback of the second voice, etc.

[0126] Optionally, the above-mentioned control process corresponding to the business characteristics selected according to the command attributes of the voice command can also be executed by the cloud server. After receiving the voice command, the home appliance sends information such as the voice command or its command attributes to the cloud server. The cloud server selects the corresponding control process according to the relevant configuration information and sends it to the home appliance. The home appliance uses the corresponding control process according to the relevant configuration information received from the cloud server to execute the voice command.

[0127] Figure 4c The above-mentioned voice control method is shown in Figure 1 Another interaction flow in the system shown.

[0128] like Figure 4c As shown, the method includes:

[0129] Step S401c: The cloud server obtains configuration information, which includes a mapping relationship between the attributes of the voice command and the control process.

[0130] Step S402c: the device to be controlled receives a voice command sent by the user.

[0131] Step S403c: the device to be controlled sends a voice command, or a command attribute of the voice command, to the cloud server.

[0132] Step S404c: the cloud server determines the business characteristics of the voice command according to the attributes of the voice command, and determines the control flow corresponding to the business characteristics.

[0133] Step S405c: the cloud server feeds back configuration information corresponding to the control process to the device to be controlled, or feeds back the control process to the device to be controlled.

[0134] Step S406c: When the service characteristic of the voice command includes that the voice command requires feedback confirmation, the device to be controlled performs voice interaction with the user.

[0135] Step S407c: the device to be controlled receives the confirmation instruction and executes the operational semantics of the voice instruction.

[0136] Figure 5 A method for voice control is shown, which is applied to Figure 1 In a system, it is used to illustrate the situation where the instruction attribute of the voice instruction is a constraint condition.

[0137] like Figure 5 As shown, the method for voice control includes:

[0138] Step S501, receiving a user's voice command.

[0139] Step S502: parse the voice command to obtain the attributes of the voice command.

[0140] Step S503: When the attributes of the voice instruction include information indicating constraint conditions of the voice instruction, the constraint conditions are parsed to determine constraint elements that the voice instruction needs to satisfy.

[0141] Step S504: determine the corresponding control process according to the constraint elements, so that the device to be controlled executes the operation corresponding to the control process.

[0142] Here, the constraint conditions include constraint conditions that the voice command needs to satisfy and / or constraint conditions that the controlled device needs to satisfy when executing the voice command.

[0143] Optionally, the constraints that the voice command needs to meet may be that the voice command does not need to meet any constraints, or the voice command needs to contain a specific preset word, or the voice command needs to meet a specific preset paradigm; for example, the device shutdown command needs to include the keyword "confirm" at the beginning of the voice command, such as "confirm shutdown".

[0144] When the voice command meets the constraint elements, the device to be controlled executes the operational semantics of the voice command; when the voice command does not meet the constraint elements, the device to be controlled feeds back a confirmation voice.

[0145] Optionally, the constraints that the device needs to meet to execute voice commands may be that the device does not need to meet any constraints to execute voice commands, or the device needs to be in a certain state to execute voice commands. For example, when a washing machine executes commands such as turning on and washing, it is necessary to ensure that the cover of the washing machine is in a closed state, or to ensure that there are no foreign objects (such as pets) in the washing machine.

[0146] Here, the operating status of the device to be controlled can be detected. When the device to be controlled meets the constraint elements, the device to be controlled executes the operational semantics of the voice command; when the device to be controlled does not meet the constraint elements, the device to be controlled feeds back a confirmation voice.

[0147] In this embodiment, if the voice instruction does not need to satisfy the preset constraints, or if the voice instruction satisfies the preset constraints, the device to be controlled executes the operational semantics of the voice instruction; and / or, if the device does not need to satisfy the preset constraints to execute the voice instruction, or if the state of the device satisfies the constraints required to execute the voice instruction, the device to be controlled executes the operational semantics of the voice instruction.

[0148] In the above method, the judgment of whether the voice command meets the preset constraints or whether the device meets the constraints for executing the voice command can be made by the controlled device itself, or the controlled device can send a request to the cloud server, and the cloud server makes a judgment and sends the judgment result to the device.

[0149] Here, the parsing of the voice command can be completed locally by the device to be controlled or by obtaining relevant services from a cloud server or edge computing node or controller. For example, the device sends the voice command or command attributes to the cloud server, and the cloud server selects the corresponding control process for the device to be controlled based on the constraints that the voice command needs to meet and / or the constraints that the device needs to meet when executing the voice command, and sends the selected control process configuration information to the device to be controlled.

[0150] Figure 6 A method for voice control is shown, which is applied to Figure 1 In a system, the invention is used to explain the case where the instruction attribute of the voice instruction is a recognition characteristic.

[0151] like Figure 6 As shown, the method for voice control includes:

[0152] Step S601, receiving a user's voice command.

[0153] Step S602: parse the voice command to obtain the attributes of the voice command.

[0154] Step S603: when the attribute of the voice instruction includes information indicating the recognition characteristic of the voice instruction, the recognition characteristic is analyzed to determine the control flow corresponding to the recognition characteristic of the current voice instruction.

[0155] Step S604: when the misrecognition rate of the recognition characteristic is greater than the operation threshold, the device to be controlled is enabled to feed back a confirmation voice.

[0156] Step S605: when the false recognition rate of the recognition characteristic is less than or equal to the operation threshold, the device to be controlled executes the operation semantics of the voice command.

[0157] According to the operational intent of the voice command, different voice command operations have different tolerance requirements for misidentification and misoperation of the voice command. The recognition characteristics may include the degree of tolerance for misidentification and misoperation. For commands with a higher tolerance, that is, voice commands for services with lower accuracy requirements for voice command recognition and execution, the voice commands can be directly executed after the device receives and parses the voice commands without the need for secondary confirmation with the operator. For services with lower tolerance for misidentification and misoperation, the accuracy requirements for voice command recognition and execution are higher. After receiving and parsing the voice command, the device will verify the operation with the operator, and execute the voice command after obtaining the operator's secondary confirmation. This can reduce the phenomenon of misidentification and misoperation.

[0158] Identification characteristics may also include false recognition rate. For instructions with a false recognition rate less than or equal to the operation threshold, that is, after the device executes the instruction, the voice instruction achieves the operation purpose consistent with the user's operation intention more times, the voice instruction can be directly executed after the device receives and parses the voice instruction without the need for secondary confirmation with the operator. For instructions with a false recognition rate greater than the operation threshold, it indicates that the execution success rate of the instruction is low, and the accuracy of its voice instruction recognition and execution is required to be high. After receiving and parsing the voice instruction, the device will feedback the operation to the user for confirmation, and execute the voice instruction after obtaining the operator's confirmation instruction. This can reduce the phenomenon of false recognition and misoperation, improve the execution success rate of the instruction, and thus meet the user's control needs.

[0159] Figure 7 1 is a schematic diagram of a device for voice control provided in an embodiment of the present application. The device for voice control can be implemented in the form of software, hardware or a combination of the two.

[0160] Combination Figure 7 As shown, the embodiment of the present disclosure provides a device for voice control, including a receiving module 71, a parsing module 72 and an execution module 73. The receiving module 71 is configured to receive a user's voice command; the parsing module 72 is configured to parse the voice command and obtain the attributes of the voice command; the execution module 73 is configured to enable the controlled device to perform a corresponding operation according to the attributes of the voice command.

[0161] Figure 8 is a schematic diagram of a device for voice control provided in an embodiment of the present application. Figure 8 As shown, the device for voice control includes:

[0162] Processor 800 and memory 801. Optionally, the device may also include a communication interface 802 and a bus 803. The processor 800, the communication interface 802, and the memory 801 may communicate with each other through the bus 803. The communication interface 802 may be used for information transmission. The processor 800 may call the logic instructions in the memory 801 to execute the method for voice control of the above embodiment.

[0163] In addition, the logic instructions in the memory 801 described above can be implemented in the form of software functional units and can be stored in a computer-readable storage medium when sold or used as an independent product.

[0164] The memory 801 is a computer-readable storage medium that can be used to store software programs and computer executable programs, such as program instructions / modules corresponding to the method in the embodiment of the present disclosure. The processor 800 executes the function application and data processing by running the program instructions / modules stored in the memory 801, that is, implements the method for voice control in the above embodiment.

[0165] The memory 801 may include a program storage area and a data storage area, wherein the program storage area may store an operating system and an application required for at least one function; the data storage area may store data created according to the use of the terminal device, etc. In addition, the memory 801 may include a high-speed random access memory and may also include a non-volatile memory.

[0166] An embodiment of the present disclosure provides a household appliance, including an appliance body and the above-mentioned device for voice control.

[0167] An embodiment of the present disclosure provides a computer-readable storage medium storing computer-executable instructions, wherein the computer-executable instructions are configured to execute the above-mentioned method for voice control.

[0168] An embodiment of the present disclosure provides a computer program product, which includes a computer program stored on a computer-readable storage medium, and the computer program includes program instructions. When the program instructions are executed by a computer, the computer executes the above-mentioned method for voice control.

[0169] The computer-readable storage medium mentioned above may be a transient computer-readable storage medium or a non-transitory computer-readable storage medium.

[0170] The technical solution of the embodiment of the present disclosure can be embodied in the form of a software product, which is stored in a storage medium and includes one or more instructions for enabling a computer device (which may be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in the embodiment of the present disclosure. The aforementioned storage medium may be a non-transient storage medium, including: a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a disk or an optical disk, and other media that can store program codes, or a transient storage medium.

[0171] The above description and the accompanying drawings fully illustrate the embodiments of the present disclosure so that those skilled in the art can practice them. Other embodiments may include structural, logical, electrical, process and other changes. The embodiments represent only possible changes. Unless explicitly required, separate components and functions are optional, and the order of operation may vary. The parts and features of some embodiments may be included in or replace the parts and features of other embodiments. Moreover, the words used in this application are only used to describe the embodiments and are not used to limit the claims. As used in the description of the embodiments and the claims, unless the context clearly indicates, the singular forms of "a", "an" and "the" are intended to include plural forms as well. Similarly, the term "and / or" as used in this application refers to any and all possible combinations of listings containing one or more associated ones. In addition, when used in the present application, the term "comprise" and its variants "comprises" and / or comprising refer to the presence of stated features, wholes, steps, operations, elements, and / or components, but do not exclude the presence or addition of one or more other features, wholes, steps, operations, elements, components and / or groups thereof. In the absence of further restrictions, the elements defined by the sentence "comprising a ..." do not exclude the presence of other identical elements in the process, method or device comprising the elements. In this article, each embodiment may focus on the differences from other embodiments, and the same and similar parts between the various embodiments may refer to each other. For the methods, products, etc. disclosed in the embodiments, if they correspond to the method part disclosed in the embodiments, then the relevant parts can refer to the description of the method part.

[0172] Those skilled in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software may depend on the specific application and design constraints of the technical solution. The technicians may use different methods for each specific application to implement the described functions, but such implementations should not be considered to exceed the scope of the embodiments of the present disclosure. The technicians may clearly understand that, for the convenience and simplicity of description, the specific working processes of the systems, devices and units described above may refer to the corresponding processes in the aforementioned method embodiments, and will not be repeated here.

[0173] In the embodiments disclosed herein, the disclosed methods and products (including but not limited to devices, equipment, etc.) can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the units can be only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the coupling or direct coupling or communication connection between each other shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms. The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the units may be selected according to actual needs to implement this embodiment. In addition, each functional unit in the embodiment of the present disclosure may be integrated in a processing unit, or each unit may exist physically alone, or two or more units may be integrated in one unit.

[0174] The flowchart and block diagram in the accompanying drawings show the possible architecture, function and operation of the system, method and computer program product according to the embodiment of the present disclosure. In this regard, each box in the flowchart or block diagram can represent a module, a program segment or a part of the code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. In some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two consecutive boxes can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, which can depend on the functions involved. In the description corresponding to the flowchart and the block diagram in the accompanying drawings, the operations or steps corresponding to different boxes can also occur in a different order from the order disclosed in the description, and sometimes there is no specific order between different operations or steps. For example, two consecutive operations or steps can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, which can depend on the functions involved. Each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, may be implemented by a dedicated hardware-based system that performs the specified functions or actions, or may be implemented by a combination of dedicated hardware and computer instructions.

Claims

1. A method for voice control, characterized in that: include: Receive user's voice command; Parsing the voice command to obtain the attributes of the voice command; According to the attributes of the voice command, the device to be controlled executes a corresponding operation.

2. The method according to claim 1, characterized in that According to the attributes of the voice command, the device to be controlled performs a corresponding operation, including: Obtaining the correspondence between the attributes of the voice command and the control process; Determine a control flow corresponding to the attributes of the current voice command, and make the device to be controlled perform an operation corresponding to the control flow; The attribute of the voice instruction includes information indicating one or more of a business characteristic, a constraint condition, and a recognition characteristic of the voice instruction.

3. The method according to claim 2, characterized in that When the attribute of the voice instruction includes information indicating a service characteristic of the voice instruction, the determining a control flow corresponding to the attribute of the current voice instruction includes: In the case where the service characteristics of the voice command include that the voice command requires feedback confirmation, the control process is to enable the device to be controlled to feedback a confirmation voice; In the case where the service characteristic of the voice instruction includes that the voice instruction does not require feedback confirmation, the control flow is to enable the device to be controlled to execute the operational semantics of the voice instruction.

4. The method according to claim 2, characterized in that: When the attribute of the voice instruction includes information for indicating a constraint condition of the voice instruction, the determining of a control flow corresponding to the attribute of the current voice instruction includes: Analyzing the constraint conditions to determine the constraint elements that the voice command needs to satisfy; A corresponding control process is determined according to the constraint elements.

5. The method according to claim 4, characterized in that The controlling the device to be controlled to perform a corresponding operation according to the constraint factor includes: When the voice command satisfies the constraint elements, causing the device to be controlled to execute the operational semantics of the voice command; When the voice command does not satisfy the constraint elements, the device to be controlled is enabled to feedback a confirmation voice.

6. The method according to claim 2, characterized in that When the attribute of the voice instruction includes information indicating a recognition characteristic of the voice instruction, the control flow corresponding to the attribute of the current voice instruction includes: When the false recognition rate of the recognition characteristic is less than or equal to the operation threshold, the device to be controlled is made to feedback a confirmation voice; When the false recognition rate of the recognition characteristic is greater than the operation threshold, the device to be controlled executes the operation semantics of the voice command and feeds back the execution result.

7. A device for voice control, characterized in that: include: A receiving module, configured to receive a user's voice command; A parsing module, configured to parse the voice command and obtain the attribute of the voice command; The execution module is configured to enable the device to be controlled to perform a corresponding operation according to the attributes of the voice command.

8. A device for voice control, comprising a processor and a memory storing program instructions, characterized in that: The processor is configured to execute the method for voice control according to any one of claims 1 to 6 when running the program instructions.

9. A household appliance, characterized in that: include: Equipment body; The device for voice control as claimed in claim 7 or 8 is installed on the device body.

10. A storage medium storing program instructions, characterized in that: When the program instructions are executed, the method for voice control according to any one of claims 1 to 6 is executed.

Images