Washing machine control method, electronic equipment, medium and washing machine

Abstract

The invention relates to the technical field of washing machines, particularly provides a washing machine control method, electronic equipment, a medium and a washing machine, and aims to solve the problem of no-load operation of the washing machine caused by mistaken touch. In order to achieve the purpose, the washing machine control method comprises the steps that in response to a washing program starting instruction, whether the washing machine is in an empty barrel state or not is judged; selectively asking the user whether to switch to a tub self-cleaning program based on the determination result; and obtaining a voice answer of the user, and selectively executing a user instruction or pausing to start the washing program based on the voice answer. After a washing program starting instruction of a user is received, whether the washing machine is in an empty barrel state or not is judged, and the no-load running situation of the washing machine is accurately recognized; by inquiring the user whether to switch to the barrel self-cleaning program or not and further selectively executing the user instruction or pausing to start the washing program based on the voice answer, mistaken touch of the user is accurately recognized, and the problem of no-load operation of the washing machine caused by mistaken touch is solved.

Description

Technical Field

[0001] The present invention relates to the technical field of washing machines, and specifically provides a washing machine control method, electronic equipment, a medium and a washing machine. Background Art

[0002] In smart home scenarios, with the popularization of home appliances controlled by buttons or touch screens, there are many false touches, especially false touches caused by children and pets in the home are particularly common.

[0003] In the working scenario of the washing machine, accidental touch often causes the washing machine to run empty without any dirty clothes. In addition to wasting water and electricity and affecting the user experience, there are also certain safety hazards.

[0004] Accordingly, the art requires a new washing machine control solution to solve the above problems. Summary of the invention

[0005] In order to overcome the above defects, the present invention is proposed to provide a washing machine control method, an electronic device, a medium and a washing machine to solve or at least partially solve the technical problem of the washing machine running without load due to mis-touch.

[0006] In a first aspect, the present invention provides a washing machine control method, which is applied to a washing machine, comprising:

[0007] In response to a washing program start instruction, determining whether the washing machine is in an empty barrel state;

[0008] Based on the judgment result, the user is selectively asked whether to switch to the barrel self-cleaning program;

[0009] The user's voice response is obtained, and based on the voice response, the user's instruction is selectively executed or the washing program is paused and started.

[0010] In a technical solution of the above-mentioned washing machine control method, the step of determining whether the washing machine is in an empty barrel state comprises:

[0011] Acquire an image inside the drum of the washing machine;

[0012] Based on the image inside the drum and the clothing detection algorithm, it is determined whether the washing machine is in an empty drum state.

[0013] In a technical solution of the above-mentioned washing machine control method, the step of determining whether the washing machine is in an empty tub state further comprises:

[0014] Based on the drum image and the clothing detection algorithm, obtaining an output result of the clothing status in the washing machine drum;

[0015] If the output result of the clothing status is within a preset range, obtaining the weight of the clothing in the washing machine drum;

[0016] Whether the washing machine is in an empty tub state is determined based on the weight of the laundry.

[0017] In a technical solution of the above-mentioned washing machine control method, selectively asking the user whether to switch to the tub self-cleaning program based on the judgment result includes:

[0018] If the judgment result is no, the washing program starts;

[0019] If the judgment result is yes, the voice prompts the user that the current washing machine is in the empty drum operation state, and asks the user whether to switch to the drum self-cleaning program.

[0020] In a technical solution of the above-mentioned washing machine control method, the obtaining of the user's voice response and selectively executing the user's instruction or pausing the washing program based on the voice response includes:

[0021] Determine whether the user is a child based on the user's voice response and voiceprint recognition algorithm;

[0022] If not, execute the user's instruction according to the user's voice answer;

[0023] If yes, the washing program will be paused and a voice prompt will be given.

[0024] In a technical solution of the above washing machine control method, the method further includes:

[0025] If no user voice response is obtained after asking the user whether to switch to the drum self-cleaning program, the washing program is paused and an alert is issued through the APP associated with the washing machine.

[0026] In a technical solution of the above washing machine control method, the method further includes:

[0027] If the washing machine is determined to be in an empty barrel state, the user is prompted through an APP associated with the washing machine that the washing machine is currently operating in an empty barrel state, and the user is asked through the APP whether to switch to the barrel self-cleaning program.

[0028] In a second aspect, an electronic device is provided, which includes a processor and a memory, wherein the memory is suitable for storing multiple program codes, and the program codes are suitable for being loaded and run by the processor to execute the washing machine control method described in any one of the technical solutions of the above-mentioned washing machine control method.

[0029] In a third aspect, a computer-readable storage medium is provided, in which a plurality of program codes are stored, wherein the program codes are suitable for being loaded and run by a processor to execute the washing machine control method described in any one of the technical solutions of the above-mentioned washing machine control method.

[0030] In a fourth aspect, the present invention provides a washing machine, comprising a washing machine body and the above-mentioned electronic device.

[0031] The above one or more technical solutions of the present invention have at least one or more of the following Beneficial effects:

[0032] In the technical solution of the present invention, by judging whether the washing machine is in an empty drum state after receiving the washing program start instruction from the user, the scenario of the washing machine running empty can be accurately identified; by asking the user whether to switch to the drum self-cleaning program, and further selectively executing the user's instructions or pausing the start of the washing program based on the voice answer, the user's accidental touch is accurately identified, thereby solving the problem of the washing machine running empty due to accidental touch. BRIEF DESCRIPTION OF THE DRAWINGS

[0033] The disclosure of the present invention will become more easily understood with reference to the accompanying drawings. It is easy for those skilled in the art to understand that these drawings are only for illustrative purposes and are not intended to limit the scope of protection of the present invention. In addition, similar numbers in the figures are used to represent similar components, among which:

[0034] Figure 1 is a flow chart of main steps of a washing machine control method according to an embodiment of the present invention;

[0035] Figure 2 is a detailed flowchart of a washing machine control method according to an embodiment of the present invention;

[0036] Figure 3 It is a main structural block diagram of an electronic device for executing the washing machine control method of the present invention. DETAILED DESCRIPTION

[0037] Some embodiments of the present invention are described below with reference to the accompanying drawings. It should be understood by those skilled in the art that these embodiments are only used to explain the technical principles of the present invention and are not intended to limit the protection scope of the present invention.

[0038] In the description of the present invention, "module" and "processor" may include hardware, software or a combination of the two. A module may include hardware circuits, various suitable sensors, communication ports, and memories, and may also include software parts, such as program codes, or a combination of software and hardware. The processor may be a central processing unit, a microprocessor, an image processor, a digital signal processor, or any other suitable processor. The processor has data and / or signal processing functions. The processor may be implemented in software, hardware, or a combination of the two. Non-temporary computer-readable storage media include any suitable medium that can store program codes, such as a magnetic disk, a hard disk, an optical disk, a flash memory, a read-only memory, a random access memory, and the like. The term "A and / or B" means all possible combinations of A and B, such as only A, only B, or A and B. The term "at least one A or B" or "at least one of A and B" has a similar meaning to "A and / or B", and may include only A, only B, or A and B. The singular terms "one" and "the" may also include plural forms.

[0039] The invention provides a washing machine control method, which is applied to the washing machine.

[0040] Please see attached Figure 1 , Figure 1 FIG. 1 is a flow chart of the main steps of a washing machine control method according to an embodiment of the present invention. Figure 1 As shown, the washing machine control method in the embodiment of the present invention mainly includes the following steps S11 to S13.

[0041] Step S11, in response to a washing program start instruction, determining whether the washing machine is in an empty tub state.

[0042] In one embodiment of the present invention, determining whether the washing machine is in an empty barrel state includes:

[0043] Acquire an image inside the drum of the washing machine;

[0044] Based on the image inside the drum and the clothing detection algorithm, it is determined whether the washing machine is in an empty drum state.

[0045] Specifically, a camera disposed in the washing machine may be used to take a picture of the inside of the drum to obtain an image of the inside of the drum of the washing machine.

[0046] Based on the image in the barrel and the clothing detection algorithm, it is determined whether the washing machine is in an empty barrel state. Specifically, the determination can be made by adopting a deep learning model suitable for image classification, such as a convolutional neural network. A pre-trained CNN model, such as ResNet, Inception, etc., can also be used, and fine-tuned to adapt to the task of determining whether the washing machine is in an empty barrel state.

[0047] Before application, the model usually needs to be trained and evaluated, and the model is continuously improved to improve its accuracy to meet the needs of accurate judgment.

[0048] Since the image inside the barrel can be collected in real time based on the camera, using the image inside the barrel to determine whether the washing machine is in an empty barrel state is time-saving and efficient, and can meet the need for determining whether the washing machine is empty in most scenarios.

[0049] In another embodiment of the present invention, the step of determining whether the washing machine is in an empty tub state further comprises:

[0050] Based on the drum image and the clothing detection algorithm, obtaining an output result of the clothing status in the washing machine drum;

[0051] If the output result of the clothing status is within a preset range, obtaining the weight of the clothing in the washing machine drum;

[0052] Whether the washing machine is in an empty tub state is determined based on the weight of the laundry.

[0053] Since the performance of the model may also be affected by factors such as lighting conditions, camera quality, and image background, some clothes that are close in color to the inner drum of the washing machine or are light and thin may be ignored. Therefore, in this embodiment, further judgment is made for such situations.

[0054] In this embodiment, a preset interval can be set for the probability value output by the model, and the preset interval is set at the boundary of whether the washing machine is empty. If the output result of the clothing status is within the preset interval, the weight of the clothing in the washing machine barrel is further obtained, and based on the clothing weight, it is determined whether the washing machine is in an empty barrel state.

[0055] Specifically, the weight of the clothes in the drum may be acquired based on a sensor pair disposed in the washing machine.

[0056] The washing machine control method shown in this embodiment determines whether the washing machine is in an empty barrel state by combining the barrel image and the laundry weight detection, which can ensure the detection efficiency and improve the accuracy of the judgment.

[0057] Step S12, based on the judgment result, selectively ask the user whether to switch to the barrel self-cleaning program.

[0058] In one embodiment of the present invention, selectively asking the user whether to switch to the barrel self-cleaning program based on the judgment result includes:

[0059] If the judgment result is no, the washing program starts;

[0060] If the judgment result is yes, the voice prompts the user that the current washing machine is in the empty drum operation state, and asks the user whether to switch to the drum self-cleaning program.

[0061] If it is determined that the washing machine is not running idle, the washing program will be started directly, which can ensure that the washing program set by the user can proceed smoothly; if it is detected that the washing machine is running idle, voice prompts will be given and further inquiries will be made, which can avoid water and electricity waste and safety hazards caused by accidental touches.

[0062] In one embodiment, the method further comprises:

[0063] If the washing machine is determined to be in an empty barrel state, the user is prompted through an APP associated with the washing machine that the washing machine is currently operating in an empty barrel state, and the user is asked through the APP whether to switch to the barrel self-cleaning program.

[0064] For smart home appliances associated with an APP, further reminders can be provided through APP prompts in case the user has left the vicinity of the washing machine and ignored the voice reminder.

[0065] Step S13, obtaining the user's voice response, and selectively executing the user's instructions or pausing the start of the washing program based on the voice response.

[0066] Specifically, if the user is judged to be an adult based on the voice answer, the instructions in the user's voice answer are executed; if the user is judged to be a child based on the voice answer, the washing program is paused.

[0067] Further, in one embodiment of the present invention, obtaining the user's voice response and selectively executing the user's instruction or pausing the washing program based on the voice response includes:

[0068] Determine whether the user is a child based on the user's voice response and voiceprint recognition algorithm;

[0069] If not, execute the user's instruction according to the user's voice answer;

[0070] If yes, the washing program will be paused and a voice prompt will be given.

[0071] The method of judging whether the user is a child based on the user's voice answer and the voiceprint recognition algorithm can be specifically judged by using a deep learning model suitable for voiceprint recognition, such as a convolutional neural network or a recurrent neural network. First, based on the obtained user's voice answer, the voiceprint features are extracted, and then based on the voiceprint features and the voiceprint recognition algorithm, the user's age is classified to judge whether the user is a child.

[0072] The voice prompt can be set as needed to provide a personalized prompt tone, such as "Children are not allowed to wash with an empty bucket."

[0073] The method described in this embodiment can accurately identify the situation where a child accidentally touches the washing machine and causes it to run empty, so as to promptly pause the washing program and issue a reminder.

[0074] In one embodiment, the method further comprises:

[0075] If no user voice response is obtained after asking the user whether to switch to the drum self-cleaning program, the washing program is paused and an alert is issued through the APP associated with the washing machine.

[0076] The method described in this embodiment can be used to address situations where animals accidentally touch the washing program, such as cats, dogs and other pets at home accidentally touching the washing program; it can also identify users who have left the scene or children who cannot speak, and promptly pause the washing program and issue an APP reminder, and promptly notify users bound to the APP of abnormal situations.

[0077] Based on the above steps S11 to S13, by determining whether the washing machine is in an empty drum state after receiving the user's washing program start instruction, the scenario of the washing machine running empty can be accurately identified; by asking the user whether to switch to the drum self-cleaning program, and further selectively executing the user's instructions or pausing the start of the washing program based on the voice answer, the user's accidental touch is accurately identified, thereby solving the problem of the washing machine running empty due to accidental touch.

[0078] Furthermore, the present invention also provides an embodiment to illustrate the detailed process of the washing machine control method of the present invention.

[0079] Please see attached Figure 2 , Figure 2 FIG. 1 is a detailed flow chart of a washing machine control method according to an embodiment of the present invention. Figure 2 As shown, the washing machine control method in the embodiment of the present invention mainly includes the following steps S21 to S26.

[0080] Step S21, in response to the washing program start instruction, determine whether the washing machine is in an empty barrel state; if the judgment result is no, execute step S22; if the judgment result is yes, execute step S23.

[0081] Step S22, starting the washing process;

[0082] Step S23, the user is prompted by voice that the washing machine is currently in the empty tub operation state, and the user is asked whether to switch to the tub self-cleaning program;

[0083] Step S24, based on the user's voice answer and the voiceprint recognition algorithm, determine whether the user is a child; if the judgment result is no, execute step S25; if the judgment result is yes, execute step S26.

[0084] Step S25, executing the user instruction according to the user's voice answer;

[0085] Step S26, pausing the washing program, and giving a voice prompt "Children are not allowed to wash with an empty tub".

[0086] It should be pointed out that although the various steps in the above embodiments are described in a specific order, those skilled in the art can understand that in order to achieve the effects of the present invention, different steps do not have to be performed in such an order. They can be performed simultaneously (in parallel) or in other orders. These changes are within the scope of protection of the present invention.

[0087] Furthermore, the present invention also provides an electronic device. Figure 3 , Figure 3 It is a main structural block diagram of an electronic device for executing the washing machine control method of the present invention.

[0088] like Figure 3 As shown, in an electronic device embodiment according to the present invention, the electronic device 300 includes a processor 301 and a memory 302, the memory 302 can be configured to store a program code 303 for executing the washing machine control method of the above method embodiment, and the processor 301 can be configured to execute the program code 303 in the memory 302, the program code 303 includes but is not limited to the program code 303 for executing the washing machine control method of the above method embodiment. For ease of explanation, only the part related to the embodiment of the present invention is shown, and for specific technical details not disclosed, please refer to the method part of the embodiment of the present invention.

[0089] Exemplarily, the processor 301 may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or the processor may also be any conventional processor, etc.

[0090] The memory 302 may be an internal storage unit of the electronic device 300, for example, a hard disk or memory of the electronic device 300; the memory 302 may also be an external storage device of the electronic device 300, for example, a plug-in hard disk, a smart media card (SMC), a secure digital (SD) card, a flash card, etc. equipped on the electronic device 300. Further, the memory 302 may also include both an internal storage unit of the electronic device 300 and an external storage device. The memory 302 is used to store computer programs and other programs and data required by the electronic device 300. The memory 302 may also be used to temporarily store data that has been output or is to be output.

[0091] In some possible implementations, the electronic device 300 may include multiple processors 301 and memories 302. The program code 303 for executing the washing machine control method of the above method embodiment may be divided into multiple subprograms, each of which may be loaded and run by the processor 301 to execute different steps of the washing machine control method of the above method embodiment. Specifically, each subprogram may be stored in different memories 302, and each processor 301 may be configured to execute programs in one or more memories 302 to jointly implement the washing machine control method of the above method embodiment, that is, each processor 301 executes different steps of the washing machine control method of the above method embodiment to jointly implement the washing machine control method of the above method embodiment.

[0092] Furthermore, the present invention also provides a computer-readable storage medium. In a computer-readable storage medium embodiment according to the present invention, the computer-readable storage medium can be configured to store a program for executing the washing machine control method of the above method embodiment, and the program can be loaded and run by the processor to implement the above washing machine control method. For ease of explanation, only the parts related to the embodiment of the present invention are shown. For specific technical details not disclosed, please refer to the method part of the embodiment of the present invention. The computer-readable storage medium can be a storage device formed by various electronic devices. Optionally, the computer-readable storage medium in the embodiment of the present invention is a non-temporary computer-readable storage medium.

[0093] Furthermore, the present invention also provides a washing machine, comprising a washing machine body and the above-mentioned electronic device.

[0094] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described or recorded in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0095] Those skilled in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments of the present invention can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the present invention.

[0096] In the embodiments provided by the present invention, it should be understood that the disclosed electronic devices and methods can be implemented in other ways. For example, the electronic device embodiments described above are only schematic, for example, the division of modules or units is only a logical function division, and there may be other division methods in actual implementation, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interfaces, devices or units, which may be electrical, mechanical or other forms.

[0097] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0098] In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0099] If the integrated module / unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the present invention implements all or part of the processes in the above-mentioned embodiment method, and can also be completed by instructing the relevant hardware through a computer program. The computer program can be stored in a computer-readable storage medium, and the computer program can implement the steps of the above-mentioned various method embodiments when executed by the processor. The computer program may include computer program code, and the computer program code may be in source code form, object code form, executable file or some intermediate form. The computer-readable medium may include: any entity or device capable of carrying computer program code, recording medium, U disk, mobile hard disk, magnetic disk, optical disk, computer memory, read-only memory (ROM), random access memory (RAM), electric carrier signal, telecommunication signal and software distribution medium. It should be noted that the content contained in the computer-readable medium can be appropriately increased or decreased according to the requirements of legislation and patent practice in the jurisdiction. For example, in some jurisdictions, according to legislation and patent practice, the computer-readable medium does not include electric carrier signals and telecommunication signals.

[0100] So far, the technical solutions of the present invention have been described in conjunction with the preferred embodiments shown in the accompanying drawings. However, it is easy for those skilled in the art to understand that the protection scope of the present invention is obviously not limited to these specific embodiments. Without departing from the principle of the present invention, those skilled in the art can make equivalent changes or substitutions to the relevant technical features, and the technical solutions after these changes or substitutions will fall within the protection scope of the present invention.

Claims

1. A washing machine control method, applied to a washing machine, characterized in that: include: In response to a washing program start instruction, determining whether the washing machine is in an empty barrel state; Based on the judgment result, the user is selectively asked whether to switch to the barrel self-cleaning program; The user's voice response is obtained, and based on the voice response, the user's instruction is selectively executed or the washing program is paused and started.

2. The washing machine control method according to claim 1, characterized in that: The step of determining whether the washing machine is in an empty barrel state comprises: Acquire an image inside the drum of the washing machine; Based on the image inside the drum and the clothing detection algorithm, it is determined whether the washing machine is in an empty drum state.

3. The washing machine control method according to claim 2, characterized in that: The step of determining whether the washing machine is in an empty tub state further includes: Based on the drum image and the clothing detection algorithm, obtaining an output result of the clothing status in the washing machine drum; If the output result of the clothing status is within a preset range, obtaining the weight of the clothing in the washing machine drum; Whether the washing machine is in an empty tub state is determined based on the weight of the laundry.

4. The washing machine control method according to claim 1, characterized in that: The selectively asking the user whether to switch to the barrel self-cleaning program based on the judgment result includes: If the judgment result is no, the washing program starts; If the judgment result is yes, the voice prompts the user that the current washing machine is in the empty drum operation state, and asks the user whether to switch to the drum self-cleaning program.

5. The washing machine control method according to claim 1, characterized in that: The method of obtaining a user's voice response and selectively executing the user's instruction or pausing the washing program based on the voice response includes: Determine whether the user is a child based on the user's voice response and voiceprint recognition algorithm; If not, execute the user's instruction according to the user's voice answer; If yes, the washing program will be paused and a voice prompt will be given.

6. The washing machine control method according to claim 1, characterized in that: The method further comprises: If no user voice response is obtained after asking the user whether to switch to the drum self-cleaning program, the washing program is paused and an alert is issued through the APP associated with the washing machine.

7. The washing machine control method according to claim 4, characterized in that: The method further comprises: If the washing machine is determined to be in an empty barrel state, the user is prompted through an APP associated with the washing machine that the washing machine is currently operating in an empty barrel state, and the user is asked through the APP whether to switch to the barrel self-cleaning program.

8. An electronic device, comprising a processor and a memory, wherein the memory is suitable for storing a plurality of program codes, characterized in that: The program code is suitable for being loaded and run by the processor to execute the washing machine control method according to any one of claims 1 to 7.

9. A computer-readable storage medium storing a plurality of program codes, characterized in that: The program code is suitable for being loaded and run by a processor to execute the washing machine control method according to any one of claims 1 to 7.

10. A washing machine, characterized in that: The invention comprises a washing machine body and the electronic device according to claim 8.

Images