Control method and device for household electrical appliances, and household electrical appliances

Abstract

The present application discloses a control method and device for household appliances, and household appliances. The method includes: obtaining a first voice control instruction, recognizing the first voice control instruction, and obtaining a first text message; obtaining a second text message, wherein the second text message is obtained by recognizing the second voice control instruction obtained by a controller of the household appliance; determining whether the first text message and the second text message are consistent; and determining whether to control the household appliance according to the first voice control instruction based on the judgment result. The present application solves the technical problem of incorrect operation of household appliances caused by inaccurate voice recognition.

Description

Technical Field

[0001] The present application relates to the field of home appliance control, and more specifically, to a method and device for controlling home appliance, and home appliance. Background Art

[0002] With the development of society and the advancement of technology, smart homes are appearing more and more in people's lives. People have become accustomed to the ability to control home appliances through voice. For example, air conditioners can be controlled by voice to adjust operating parameters such as temperature and wind speed, and TVs can be controlled by voice to select content to play. Although voice control has been popularized in many aspects of smart homes, there is a problem of inaccurate voice recognition when controlling home appliances through voice commands, which causes home appliances to make incorrect operations and a poor user experience.

[0003] To address the above-mentioned problems, no effective solution has been proposed yet. Summary of the invention

[0004] The embodiments of the present application provide a control method and device for a household appliance, and a household appliance, so as to at least solve the technical problem that the household appliance makes erroneous operations due to inaccurate voice recognition.

[0005] According to one aspect of an embodiment of the present application, a method for controlling a household appliance is provided, comprising: obtaining a first voice control instruction, and identifying the first voice control instruction to obtain first text information; obtaining second text information, wherein the second text information is obtained by identifying the second voice control instruction obtained by a controller of the household appliance; determining whether the first text information and the second text information are consistent; and determining whether to control the household appliance according to the first voice control instruction based on the determination result.

[0006] Optionally, determining whether the first text information and the second text information are consistent includes: extracting a preset number of first keywords from the first text information, and extracting a preset number of second keywords from the second text information; comparing all the first keywords and all the second keywords; if the ratio of the number of identical keywords in the first keywords and the second keywords to a preset number exceeds a preset threshold, determining that the first text information and the second text information are consistent; otherwise, determining that the first text information and the second text information are inconsistent.

[0007] Optionally, determining whether to control the home appliance according to the first voice control instruction is based on the judgment result, including: when the first text information and the second text information are consistent, controlling the home appliance according to the first voice control instruction; when the first text information and the second text information are inconsistent, refusing to control the home appliance according to the first voice control instruction, and re-obtaining the control instruction of the home appliance.

[0008] Optionally, reacquiring control instruction information of the household appliance includes: sending a first prompt message, wherein the prompt message is used to prompt reacquiring a first voice control instruction; and sending a second prompt message to a controller of the household appliance, wherein the second prompt message is used to prompt the controller to reacquire a second voice control instruction.

[0009] Optionally, identifying the first voice control instruction includes: converting the first voice control instruction into first initial text information; and processing the first initial text information using a pre-trained recurrent neural network model to obtain first text information.

[0010] Optionally, before using a pre-trained recurrent neural network model to process the first initial text information, the method also includes training the neural network model by the following method: obtaining a training data set, wherein the training data set includes: sample data and labels corresponding to the sample data, the sample data includes: the first initial text information, and the label includes: the first text information; training the neural network model based on the training data set.

[0011] Optionally, after identifying the first voice control instruction and obtaining the first text information, the method further includes: updating the training data set using the first text information; and retraining the neural network model using the updated training data set.

[0012] According to another aspect of the embodiment of the present application, a control device for a household appliance is provided, including:

[0013] The first acquisition module is used to acquire a first voice control instruction, and recognize the first voice control instruction to obtain a first text message; the second acquisition module is used to acquire a second text message, wherein the second text message is obtained by recognizing the second voice control instruction acquired by the second acquisition module; the judgment module is used to judge whether the first text message and the second text message are consistent; the control module is used to determine whether to control the home appliance according to the first voice control instruction based on the judgment result.

[0014] According to another aspect of an embodiment of the present application, a household appliance is also provided, including: a processor, used to obtain a first voice control instruction, and identify the first voice control instruction to obtain a first text message; a remote control device, communicating with the processor, used to obtain a second voice control instruction, and identify the second voice control instruction to obtain a second text message; sending the second text message to the processor; the processor is also used to determine whether the first text message and the second text message are consistent; and determining whether to control the household appliance according to the first voice control instruction based on the determination result.

[0015] According to another aspect of an embodiment of the present application, a non-volatile storage medium is further provided, the non-volatile storage medium including a stored program, wherein when the program is running, the device where the non-volatile storage medium is located is controlled to execute the control method of the household appliance.

[0016] In an embodiment of the present application, a first voice control instruction is obtained and recognized to obtain a first text message; a second text message is obtained, wherein the second text message is obtained by recognizing a second voice control instruction obtained by a controller of a home appliance; whether the first text message and the second text message are consistent is determined; and based on the determination result, whether the home appliance is to be controlled according to the first voice control instruction is determined, voice control instructions are obtained through multiple channels of the home appliance itself and the home appliance controller, and then the voice control instructions obtained from different channels are compared and the home appliance is controlled based on the comparison result, thereby achieving the purpose of secondary review of the obtained voice control instructions, thereby realizing the technical effect of improving the accuracy of voice recognition, and further solving the technical problem of incorrect operation of home appliances caused by inaccurate voice recognition. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] The drawings described herein are used to provide a further understanding of the present application and constitute a part of the present application. The illustrative embodiments of the present application and their descriptions are used to explain the present application and do not constitute an improper limitation on the present application. In the drawings:

[0018] Figure 1 It is a hardware structure block diagram of a computer terminal (or mobile device) for an optional control method of a household appliance according to an embodiment of the present application;

[0019] Figure 2 is a schematic diagram of an optional control method for a household appliance according to an embodiment of the present application;

[0020] Figure 3 is a schematic diagram of an optional control device for household electrical appliances according to an embodiment of the present application;

[0021] Figure 4 It is a schematic diagram of an optional household appliance according to an embodiment of the present application. DETAILED DESCRIPTION

[0022] In order to enable those skilled in the art to better understand the solution of the present application, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present application.

[0023] It should be noted that the terms "first", "second", etc. in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present application described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device comprising a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0024] The method embodiments provided in the embodiments of the present application can be executed in a mobile terminal, a computer terminal or a similar computing device. Figure 1 The hardware structure block diagram of a computer terminal (or mobile device) for implementing a method for controlling a household appliance is shown. Figure 1 As shown, the computer terminal 10 (or mobile device 10) may include one or more (102a, 102b, ..., 102n are used to illustrate) processors 102 (the processor 102 may include but is not limited to a processing device such as a microprocessor MCU or a programmable logic device FPGA), a memory 104 for storing data, and a transmission module 106 for communication functions. In addition, it may also include: a display, an input / output interface (I / O interface), a universal serial bus (USB) port (which may be included as one of the ports of the I / O interface), a network interface, a power supply and / or a camera. It can be understood by those skilled in the art that Figure 1 The structure shown is only for illustration and does not limit the structure of the above electronic device. Figure 1 More or fewer components as shown, or with Figure 1 Different configurations are shown.

[0025] It should be noted that the one or more processors 102 and / or other data processing circuits described above may generally be referred to herein as "data processing circuits". The data processing circuits may be embodied in whole or in part as software, hardware, firmware, or any other combination thereof. In addition, the data processing circuit may be a single independent processing module, or may be incorporated in whole or in part into any of the other components in the computer terminal 10 (or mobile device). As described in the embodiments of the present application, the data processing circuit acts as a processor control (e.g., selection of a variable resistor terminal path connected to an interface).

[0026] The memory 104 can be used to store software programs and modules of application software, such as the program instructions / data storage device corresponding to the control method of the household appliance in the embodiment of the present application. The processor 102 executes various functional applications and data processing by running the software programs and modules stored in the memory 104, that is, realizing the vulnerability detection method of the above-mentioned application. The memory 104 may include a high-speed random access memory, and may also include a non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some examples, the memory 104 may further include a memory remotely arranged relative to the processor 102, and these remote memories may be connected to the computer terminal 10 via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and a combination thereof.

[0027] The transmission module 106 is used to receive or send data via a network. The specific example of the above network may include a wireless network provided by a communication provider of the computer terminal 10. In one example, the transmission device 106 includes a network adapter (Network Interface Controller, NIC), which can be connected to other network devices through a base station so as to communicate with the Internet. In one example, the transmission module 106 can be a radio frequency (RF) module, which is used to communicate with the Internet wirelessly.

[0028] The display may be, for example, a touch screen liquid crystal display (LCD) that enables a user to interact with a user interface of the computer terminal 10 (or mobile device).

[0029] In the above operating environment, an embodiment of the present application provides an embodiment of a method for controlling a household appliance. It should be noted that the steps shown in the flowchart of the accompanying drawings can be executed in a computer system such as a set of computer executable instructions, and although the logical order is shown in the flowchart, in some cases, the steps shown or described can be executed in an order different from that shown here.

[0030] According to an embodiment of the present application, a method embodiment of a method for controlling a household appliance is provided. It should be noted that the steps shown in the flowchart of the accompanying drawings can be executed in a computer system such as a set of computer executable instructions, and although a logical order is shown in the flowchart, in some cases, the steps shown or described can be executed in an order different from that shown here.

[0031] Figure 2 A control method for a household appliance according to an embodiment of the present application is as follows: Figure 2 As shown, the method comprises the following steps:

[0032] Step S202, obtaining a first voice control instruction, and identifying the first voice control instruction to obtain first text information;

[0033] It should be noted that the first voice control instruction can obtain the user's voice through the home appliance itself, or through the smart home system.

[0034] In some embodiments of the present application, identifying the first voice control instruction is achieved in the following manner: specifically, converting the first voice control instruction into first initial text information; using a pre-trained recurrent neural network model to process the first initial text information to obtain the first text information.

[0035] In some embodiments of the present application, the neural network model is trained by the following method, specifically, a training data set is obtained, wherein the training data set includes: sample data and labels corresponding to the sample data, the sample data includes: first initial text information, and the labels include: first text information; the neural network model is trained based on the training data set. The training data set can be obtained by crawling the Internet, and the user manual of the home appliance, the dictionary, etc. can provide a resource library of home appliance control information words.

[0036] Step S204, obtaining second text information, wherein the second text information is obtained by recognizing a second voice control instruction obtained by a controller of the home appliance;

[0037] It should be noted that the controller of the home appliance may be a remote controller of the home appliance or other electronic devices that can control the home appliance.

[0038] In some embodiments of the present application, the recognition of the second voice control instruction is achieved by, specifically, converting the second voice control instruction into second initial text information; and processing the second initial text information using a pre-trained recurrent neural network model to obtain the second text information. The training data set also includes the second text information converted from the second voice control instruction, and the label also includes the second text information.

[0039] The first initial text information and the second initial text information are processed by a recurrent neural network, thereby improving the accuracy of the converted text information and eliminating words that are irrelevant to the control instructions of the home appliance to achieve better comparison.

[0040] Step S206, determining whether the first text information and the second text information are consistent;

[0041] Specifically, the judgment is made in the following manner: extract a preset number of first keywords from the first text information, and extract a preset number of second keywords from the second text information; compare all first keywords and all second keywords; if the ratio of the number of identical keywords in the first keywords and the second keywords to the preset number exceeds a preset threshold, determine that the first text information and the second text information are consistent; otherwise, determine that the first text information and the second text information are inconsistent.

[0042] It should be noted that when extracting the first keyword and the second keyword, the number of the two is the same and the type of the keyword is the same. For example, if the first keyword is open, second gear, and timed for 15 minutes, and the second keyword is open, second gear, and timed for 15 minutes, then the first keyword and the second keyword are considered to be consistent. By comparing the keywords and confirming whether the keywords are consistent, the accuracy of voice control information recognition is improved.

[0043] Step S208, determining whether to control the home appliance according to the first voice control instruction based on the judgment result.

[0044] In some embodiments of the present application, when the first text information and the second text information are consistent, the home appliance is controlled according to the first voice control instruction; when the first text information and the second text information are inconsistent, the home appliance is refused to be controlled according to the first voice control instruction, and the control instruction of the home appliance is re-acquired. The control instruction is executed when the consistency is confirmed, avoiding the operation error of the home appliance caused by the execution of the wrong control instruction.

[0045] In some embodiments of the present application, reacquiring control instructions of the household appliance device is performed by sending a first prompt message, wherein the prompt message is used to prompt reacquiring the first voice control instruction; and simultaneously sending a second prompt message to the controller of the household appliance device, wherein the second prompt message is used to prompt the controller to reacquire the second voice control instruction.

[0046] The second prompt information is sent to the controller of the home appliance, wherein the second prompt information is used to prompt the controller to reacquire the second voice control instruction. For example, the prompt information can be sent in the form of voice broadcast.

[0047] In some embodiments of the present application, after recognizing the first voice control instruction and obtaining the first text information, the training data set of the recurrent neural network can be updated using the first text information, and then the recurrent neural network can be trained using the updated training data set. The same applies after obtaining the second text information.

[0048] Through the above steps, the home appliance itself and the home appliance controller can obtain voice control instructions in multiple ways respectively, and then compare the voice control instructions obtained from different ways to control the home appliance according to the comparison results, thereby achieving the purpose of secondary review of the obtained voice control instructions, thereby improving the accuracy of voice recognition, and further solving the technical problem of incorrect operation of home appliances caused by inaccurate voice recognition.

[0049] According to another aspect of the embodiment of the present application, the present application also proposes a control device for household electrical appliances, such as Figure 3 As shown, it includes: a first acquisition module 30, used to acquire a first voice control instruction, and identify the first voice control instruction to obtain a first text message; a second acquisition module 32, used to acquire a second text message, wherein the second text message is obtained by identifying the second voice control instruction acquired by the second acquisition module; a judgment module 34, used to judge whether the first text message and the second text message are consistent; a control module 36, used to determine whether to control the home appliance according to the first voice control instruction based on the judgment result.

[0050] The first acquisition module 30 includes a first acquisition submodule, a first recognition submodule and a first neural network module; wherein the first acquisition submodule is used to acquire the first voice control instruction; the first recognition submodule is used to convert the first voice control instruction into the first initial text information; the first initial text information is processed using a pre-trained recurrent neural network model to obtain the first text information; the first neural network module is used to acquire a training data set, wherein the training data set includes: sample data and labels corresponding to the sample data, the sample data includes: the first initial text information, the labels include: the first text information and the neural network model is trained based on the training data set; and after obtaining the first text information, the training data set is updated using the first text information and the neural network model is retrained using the updated training data set.

[0051] The second acquisition module 32 includes a second acquisition submodule, a second recognition submodule and a second neural network module; wherein the second acquisition submodule is used to acquire the second voice control instruction; the second recognition submodule is used to convert the second voice control instruction into the second initial text information; the second initial text information is processed using a pre-trained recurrent neural network model to obtain the second text information; the second neural network module is used to acquire a training data set, wherein the training data set includes: sample data and labels corresponding to the sample data, the sample data includes: the second initial text information, the labels include: the second text information and the neural network model is trained based on the training data set; and after obtaining the second text information, the training data set is updated using the second text information and the neural network model is retrained using the updated training data set.

[0052] The judgment module 34 includes an extraction submodule and a comparison submodule; wherein the extraction submodule is used to extract a preset number of first keywords from the first text information, and to extract a preset number of second keywords from the second text information; the comparison submodule is used to determine that the first text information and the second text information are consistent when the ratio of the number of identical keywords in the first keyword and the second keyword to the preset number exceeds a preset threshold; otherwise, determine that the first text information and the second text information are inconsistent.

[0053] The control module 36 includes a control submodule and a prompt submodule; wherein the control submodule is used to control the home appliance according to the first voice control instruction when the first text information and the second text information are consistent; when the first text information and the second text information are inconsistent, refuse to control the home appliance according to the first voice control instruction and re-acquire the control instruction of the home appliance; the prompt submodule is used to send a first prompt message, wherein the prompt message is used to prompt the re-acquisition of the first voice control instruction; and send a second prompt message to the second acquisition module, wherein the second prompt message is used to prompt the second acquisition module to re-acquire the second voice control instruction.

[0054] According to another aspect of the embodiment of the present application, the present application also proposes a household appliance 40, such as Figure 4 As shown, it includes: a remote control device 401 and a processor 402; wherein the processor 402 is used to obtain a first voice control instruction, identify the first voice control instruction, and obtain a first text message; the remote control device 401 communicates with the processor 402, is used to obtain a second voice control instruction, identify the second voice control instruction, and obtain a second text message; the second text message is sent to the processor 402; the processor 402 is also used to determine whether the first text message and the second text message are consistent; and determine whether to control the home appliance 40 according to the first voice control instruction based on the determination result.

[0055] According to another aspect of the embodiment of the present application, the present application also proposes a non-volatile storage medium, which includes a stored program, wherein when the program is running, the device where the non-volatile storage medium is located is controlled to execute the control method of the above-mentioned home appliance.

[0056] The serial numbers of the above-mentioned embodiments of the present application are for description only and do not represent the advantages or disadvantages of the embodiments.

[0057] In the above embodiments of the present application, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, please refer to the relevant description of other embodiments.

[0058] In the several embodiments provided in this application, it should be understood that the disclosed technical content can be implemented in other ways. Among them, the device embodiments described above are only schematic. For example, the division of units can be a logical function division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of units or modules, which can be electrical or other forms.

[0059] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed over multiple units. Some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.

[0060] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0061] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art or all or part of the technical solution, can be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for a computer device (which can be a personal computer, server or network device, etc.) to perform all or part of the steps of each embodiment method of the present application. The aforementioned storage medium includes: U disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), mobile hard disk, disk or optical disk, etc. Various media that can store program codes.

[0062] The above are only preferred implementations of the present application. It should be pointed out that for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the principles of the present application. These improvements and modifications should also be regarded as the scope of protection of the present application.

Claims

1. A method for controlling a household appliance, characterized in that: include: Acquire a first voice control instruction, and recognize the first voice control instruction to obtain first text information; Acquire second text information, wherein the second text information is obtained by recognizing a second voice control instruction acquired by a controller of the home appliance; Determining whether the first text information and the second text information are consistent; Determining whether to control the home appliance according to the first voice control instruction according to the judgment result; Wherein, determining whether the first text information and the second text information are consistent includes: extracting a preset number of first keywords from the first text information, and extracting a preset number of second keywords from the second text information; Compare all first keywords with all second keywords; When the ratio of the number of identical keywords in the first keyword and the second keyword to the preset number exceeds a preset threshold, it is determined that the first text information and the second text information are consistent; otherwise, it is determined that the first text information and the second text information are inconsistent.

2. The method according to claim 1, characterized in that Determining whether to control the home appliance according to the first voice control instruction according to the judgment result includes: When the first text information and the second text information are consistent, controlling the home appliance according to the first voice control instruction; When the first text information and the second text information are inconsistent, the home appliance is refused to be controlled according to the first voice control instruction, and the control instruction of the home appliance is re-acquired.

3. The method according to claim 2, characterized in that Re-obtaining the control instruction of the household appliance includes: Sending a first prompt message, wherein the prompt message is used to prompt to re-acquire the first voice control instruction; Sending a second prompt message to the controller of the household appliance, wherein the second prompt message is used to prompt the controller to reacquire the second voice control instruction.

4. The method according to claim 1, characterized in that: Recognizing the first voice control instruction includes: Converting the first voice control instruction into a first initial text message; The first initial text information is processed using a pre-trained recurrent neural network model to obtain the first text information.

5. The method according to claim 4, characterized in that Before processing the first initial text information using the pre-trained recurrent neural network model, the method further includes training the neural network model by the following method: Acquire a training data set, wherein the training data set includes: sample data and labels corresponding to the sample data, the sample data includes: the first initial text information, and the label includes: the first text information; The neural network model is trained based on the training data set.

6. The method according to claim 5, characterized in that After identifying the first voice control instruction and obtaining the first text information, the method further includes: Updating the training data set using the first text information; The neural network model is retrained using the updated training data set.

7. A control device for household electrical appliances, characterized in that: include: A first acquisition module, used to acquire a first voice control instruction, and identify the first voice control instruction to obtain first text information; A second acquisition module, used to acquire second text information, wherein the second text information is obtained by recognizing a second voice control instruction acquired by the second acquisition module; A judging module, used for judging whether the first text information and the second text information are consistent; A control module, used for determining whether to control the home appliance according to the first voice control instruction according to the judgment result; Wherein, the judgment module includes: An extraction submodule, configured to extract a preset number of first keywords from the first text information, and to extract a preset number of second keywords from the second text information; The comparison submodule is used to determine that the first text information and the second text information are consistent when the ratio of the number of identical keywords in the first keyword and the second keyword to the preset number exceeds a preset threshold; otherwise, determine that the first text information and the second text information are inconsistent.

8. A household appliance, characterized in that: include: A remote control device and a processor, wherein: The processor is used to obtain a first voice control instruction, and recognize the first voice control instruction to obtain first text information; The remote control device communicates with the processor to obtain a second voice control instruction, identify the second voice control instruction, obtain a second text message, and send the second text message to the processor; The processor is further configured to determine whether the first text information and the second text information are consistent; and determine whether to control the home appliance according to the first voice control instruction based on the determination result; Wherein, determining whether the first text information and the second text information are consistent includes: extracting a preset number of first keywords from the first text information, and extracting a preset number of second keywords from the second text information; Compare all first keywords with all second keywords; When the ratio of the number of identical keywords in the first keyword and the second keyword to the preset number exceeds a preset threshold, it is determined that the first text information and the second text information are consistent; otherwise, it is determined that the first text information and the second text information are inconsistent.

9. A non-volatile storage medium, characterized in that: The non-volatile storage medium includes a stored program, wherein when the program is executed, the device where the non-volatile storage medium is located is controlled to execute the control method of the household appliance according to any one of claims 1 to 6.

Images