Control method of a laundry treating apparatus

CN115584613BActive Publication Date: 2026-08-18QINGDAO HAIER WASHING MASCH CO LTD +1
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202110757378.6
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-07-05
Publication Date
2026-08-18
Estimated Expiration
2041-07-05

AI Technical Summary

Technical Problem

[0005]本发明旨在解决上述技术问题,即,解决现有技术不能实现语音模块的无感启动的问题

Benefits of technology

[0018] If the user has no clothes, it means the user is not planning to do laundry and may only be passing through the clothing processing equipment. In this case, the image acquisition module is turned off to save power.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115584613B_ABST
    Figure CN115584613B_ABST
Patent Text Reader

Abstract

The present application relates to the technical field of clothes processing, and particularly provides a control method of clothes processing equipment, aiming at solving the problem that the prior art cannot realize non-susceptible starting of a voice module. To this end, the control method comprises: acquiring an image of a user through an image acquisition module; judging whether the user has clothes in hand based on the image; if the user has clothes in hand, further judging whether the weight of clothes to be processed in the current clothes processing cylinder exceeds a threshold value; and selectively starting the voice module for washing reminding or starting the weighing module for clothes weighing based on the judgment result. The present application further starts the voice module or the weighing module according to whether the weight of clothes to be processed in the current clothes processing cylinder exceeds a threshold value when the user has clothes in hand, so that the voice module can be started without any operation of the user, the voice module is started non-susceptibly, and user experience is improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This invention relates to the field of clothing processing technology, and specifically provides a control method for clothing processing equipment. Background Technology

[0002] With the continuous development of technology, the functions of smart washing machines are constantly increasing. For example, smart washing machines are equipped with voice modules, which enable users to interact with the machine or announce its current working status, thus allowing users to better utilize the machine and enhancing the user experience.

[0003] However, currently, washing machines require a wake-up keyword before activating the voice module. For example, the user issues a command to activate the voice module, and the washing machine activates it only after receiving the command. Alternatively, the washing machine or mobile terminal may have a button to activate the voice module, which the user can select when needed. Clearly, the current voice module activation cannot be truly seamless.

[0004] Accordingly, a new technical solution is needed in this field to solve the above problems. Summary of the Invention

[0005] The present invention aims to solve the above-mentioned technical problem, namely, to solve the problem that the existing technology cannot achieve seamless start-up of the voice module.

[0006] In a first aspect, the present invention provides a control method for a garment processing device, the garment processing device including a garment processing drum for holding garments to be processed, the garment processing device being configured with an image acquisition module, a voice module, and a weighing module, the control method including: acquiring an image of a user through the image acquisition module; determining, based on the image, whether the user has garments in their hands; if there are garments, further determining whether the weight of the garments to be processed in the garment processing drum currently exceeds a threshold; and, based on the determination result, selectively activating the voice module to provide a washing reminder or activating the weighing module to weigh the garments.

[0007] In the preferred embodiment of the above control method, the step of "selectively activating the voice module to provide a washing reminder or activating the weighing module to weigh the clothes based on the judgment result" further includes: if the weight of the clothes to be processed exceeds the threshold, then the voice module is activated to provide a washing reminder; if the weight of the clothes to be processed does not exceed the threshold, then the weighing module is activated to weigh the clothes.

[0008] In the preferred embodiment of the above control method, the voice module has a pronunciation mode and a pickup mode, and the step of "starting the voice module" further includes: controlling the voice module to enter the pronunciation mode.

[0009] In the preferred embodiment of the above control method, the voice module has a pronunciation mode and a pickup mode, and the step of "starting the voice module" further includes: controlling the voice module to enter the pronunciation mode.

[0010] In a preferred embodiment of the above control method, after the step of "controlling the voice module to enter the pronunciation mode", the control method further includes: controlling the voice module to issue a reminder of "washing clothes".

[0011] In the preferred embodiment of the above control method, after the step of "starting the weighing module to weigh the clothes", the control method further includes: obtaining the weight of the clothes to be processed in the clothes processing drum and saving the weight.

[0012] In a preferred embodiment of the above control method, after the step of "controlling the voice module to enter the pronunciation mode" or after the step of "obtaining the weight of the clothing to be processed in the clothing processing tube", the control method further includes: controlling the voice module to enter the sound pickup mode.

[0013] In a preferred embodiment of the above control method, the control method further includes: if the voice module does not receive a valid instruction within a preset time period after the voice module enters the pickup mode, then controlling the voice module to exit the pickup mode; wherein, the valid instruction includes a start washing instruction, a stop washing instruction, a power-on instruction, and a power-off instruction.

[0014] In the preferred embodiment of the above control method, after the step of "controlling the voice module to exit the pickup mode", the control method further includes: controlling the voice module to operate at a first power.

[0015] In a preferred embodiment of the above control method, the control method further includes: if there is no clothing, then the image acquisition module is turned off.

[0016] In a preferred embodiment of the above control method, the clothing processing device is further equipped with a human body detection module. Before the step of "acquiring the user's image through the image acquisition module", the control method further includes: detecting whether a user has entered a preset area through the human body detection module; if a user has entered the preset area, then activating the image acquisition module.

[0017] In the technical solution of this invention, the clothing processing device includes a clothing processing drum for holding clothes to be processed. During washing, the clothes are placed in the clothing processing drum for washing. The clothing processing device is equipped with an image acquisition module, a voice module, and a weighing module. The control method of this invention includes: acquiring an image of the user through the image acquisition module; determining whether the user has clothes in their hands based on the image; if so, further determining whether the weight of the clothes to be processed in the current clothing processing drum exceeds a threshold; and, based on the determination result, selectively activating the voice module to provide a washing reminder or activating the weighing module to weigh the clothes. Through this control method, when the user has clothes in their hands, it indicates that the user intends to wash clothes. Then, further determining whether the weight of the clothes to be processed in the current clothing processing drum exceeds a threshold, and based on the determination result, activating the voice module to provide a washing reminder or activating the weighing module to weigh the clothes, allows the voice module to be activated without any user intervention, thus achieving seamless activation of the voice module and improving the user experience. Alternatively, the weighing module can be activated without any user intervention to obtain the weight of the clothes to be washed in the laundry drum. This weight can be used to compare the weight of the current clothes to be processed with a threshold in the next judgment, and then further determine whether to activate the voice module based on the judgment result, thereby better realizing the seamless activation of the voice module.

[0018] If the user has no clothes, it means the user is not planning to do laundry and may only be passing through the clothing processing equipment. In this case, the image acquisition module is turned off to save power.

[0019] Furthermore, if the weight of the clothes to be processed exceeds the threshold, it means there are enough clothes in the processing drum to begin washing. In this case, the voice module is activated to provide a washing reminder. If the weight of the clothes to be processed does not exceed the threshold, it means there are still relatively few clothes in the processing drum, and more clothes can be added. In this case, the weighing module is activated to weigh the clothes. This control method allows the operation of either the voice module or the weighing module to be controlled based on the current weight of the clothes in the processing drum, thus providing better service to the user.

[0020] Furthermore, the voice module has a pronunciation mode and a sound pickup mode. The "starting the voice module" step further includes: controlling the voice module to enter pronunciation mode, so that washing reminders can be given via voice. After the step of "controlling the voice module to enter pronunciation mode", the voice module is controlled to issue a reminder of "washing clothes". After hearing this reminder, the user knows that it is time to wash clothes, thus better achieving the purpose of reminding the user.

[0021] Furthermore, after the step of "starting the weighing module to weigh the clothes", the control method of the present invention further includes: acquiring the weight of the clothes to be processed in the clothes processing drum and saving the weight. Based on the weight, it can be further determined whether the weight exceeds a threshold, and then based on the determination result, it can be further determined whether to start the voice module, thereby better realizing the seamless start of the voice module.

[0022] Furthermore, after the step of "controlling the voice module to enter the speech mode" or the step of "obtaining the weight of the clothes to be processed in the clothing processing drum," the control method further includes: controlling the voice module to enter the sound pickup mode. In this way, users can interact with the clothing processing equipment through the voice module, better meeting their needs.

[0023] Furthermore, if the voice module does not receive a valid command within the preset time frame of the voice pickup mode (including commands to start washing, stop washing, power on, and power off), it indicates that the user does not currently intend to control the garment processing device through effective human-computer interaction. In this case, the voice module will exit the voice pickup mode, closing the human-computer interaction channel.

[0024] Furthermore, after the step of "controlling the voice module to exit the pickup mode," the voice module is controlled to operate at a first power level. It should be noted that this first power level is lower than the power level of the voice module during normal operation; that is, the voice module is controlled to operate at a low power level. This control method effectively reduces power consumption.

[0025] Furthermore, the garment handling equipment is also equipped with a human body detection module. Before the step of "acquiring the user's image through the image acquisition module," the control method of the present invention further includes: detecting whether a user has entered a preset area through the human body detection module. If a user enters the preset area, it indicates that the user may intend to do laundry, and at this time, the image acquisition module is activated. By acquiring the user's image through the image acquisition module, and then analyzing whether the user has clothes in their hands based on the image, it is further determined whether they intend to do laundry, thereby better realizing the intelligent control of the garment handling equipment and improving the user experience. Attached Figure Description

[0026] The control method of the garment processing device of the present invention will now be described with reference to the accompanying drawings, in which:

[0027] Figure 1 This is a main flowchart of a control method for a garment processing device according to an embodiment of the present invention;

[0028] Figure 2 This is a flowchart of the voice module entering the sound pickup mode according to an embodiment of the present invention;

[0029] Figure 3 This is a flowchart of the startup image acquisition module according to an embodiment of the present invention;

[0030] Figure 4 This is a flowchart of an embodiment of the present invention that calls a preset model to analyze an image and determine whether the user has clothing in their hands;

[0031] Figure 5 This is a flowchart illustrating an embodiment of the present invention that uses the ResNet18 model to analyze images;

[0032] Figure 6 This is a flowchart of an embodiment of the present invention, which uses the analysis results of the ResNet18 model to determine whether a user has clothing in their hands. Detailed Implementation

[0033] Preferred embodiments of the present invention will now be described with reference to the accompanying drawings. Those skilled in the art should understand that these embodiments are merely illustrative of the technical principles of the present invention and are not intended to limit the scope of protection of the present invention. Although this embodiment uses a washing machine as an example, it is equally applicable to various types of clothing processing equipment such as shoe washing machines, dryers, washer-dryer combos, and garment care machines. For example, when the clothing processing equipment is a shoe washing machine, image analysis requires determining whether the user has shoes in their hands.

[0034] It should be noted that the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance.

[0035] To better serve users, current smart washing machines are typically equipped with voice modules. These modules allow users to interact with the washing machine or announce its current operating status. However, current voice modules require user commands or manual selection to activate, failing to achieve truly seamless startup. Therefore, the control method of the clothing processing device in this invention determines whether the user has clothing in their hands based on an image. If clothing is present, it further determines whether the weight of the clothing to be processed in the processing drum exceeds a threshold. Based on the determination result, it activates either the voice module to provide washing reminders or the weighing module to weigh the clothing. This allows the voice module to be activated without any user intervention, achieving seamless startup and improving the user experience.

[0036] In this embodiment, the washing machine includes a washing drum for holding clothes to be washed. When washing clothes, the clothes are simply placed inside the washing drum. The washing machine is equipped with an image acquisition module, a voice module, a weighing module, and a control module. The image acquisition module, voice module, and weighing module are all connected to the control module. The image acquisition module is used to acquire images of the user. The voice module is used to enable interaction between the user and the washing machine, or to provide voice reminders. The weighing module is used to acquire the weight of the clothes to be washed inside the washing drum. The control module controls a preset model to analyze the user's image acquired by the image acquisition module, and determines whether the user has clothes in their hands based on the analysis results. It also controls whether the weight of the clothes to be washed inside the washing drum exceeds a threshold, and based on the determination result, activates the voice module to provide a voice reminder or activates the weighing module to weigh the clothes.

[0037] In this embodiment, the image acquisition module can be, but is not limited to, a camera, a video camera, etc., and those skilled in the art can choose flexibly. This image acquisition module can be installed on the front panel of the washing machine, but obviously it can also be installed in other convenient locations for acquiring images of the user.

[0038] The voice module can be, but is not limited to, a speaker or loudspeaker capable of broadcasting voice prompts, or a pickup or microphone capable of collecting ambient sound. The voice module can be installed on the front or side panel of the washing machine, or obviously in other convenient locations for broadcasting voice prompts and collecting sound.

[0039] The weighing module can be, but is not limited to, a weighing sensor, a weighing meter, or other such device, and is installed inside the washing drum to obtain the weight of the clothes to be washed inside the drum.

[0040] First, refer to Figure 1 This invention describes the control method of the garment processing equipment. Among them, Figure 1 This is a main flowchart of a control method for a garment processing device according to an embodiment of the present invention.

[0041] like Figure 1 As shown, in one possible implementation, the control method of the present invention includes:

[0042] Step S10: Acquire the user's image through the image acquisition module;

[0043] In step S10, the user's image is acquired through the image acquisition module.

[0044] Step S20: Based on the image, determine whether the user has clothing in their hands; if not, proceed to step S30; if yes, proceed to step S40.

[0045] In step S20, image analysis is performed based on the user image obtained in step S10, and the analysis results are used to determine whether the user has clothing in their hands. The specific steps of the image analysis are detailed below. If the user does not have clothing in their hands, step S30 is executed. If the user has clothing in their hands, step S40 is executed.

[0046] Step S30: Close the image acquisition module.

[0047] In step S30, based on the judgment result in step S20, if the user has no clothes in their hands, it means that the user is not going to do laundry and may just be passing by the washing machine. In this case, the image acquisition module is turned off, and only the human body detection module is controlled to continue to detect whether clothes have entered the preset area, thus saving power.

[0048] Step S40: If there are clothes, further determine whether the weight of the clothes to be washed in the washing drum exceeds the threshold.

[0049] Step S50: Based on the judgment result, selectively activate the voice module to provide washing reminders or activate the weighing module to weigh the clothes.

[0050] In step S40, based on the judgment result in step S20, if the user has clothes in hand, it means that the user intends to wash clothes, and then it is further determined whether the weight of the clothes to be washed in the washing drum exceeds the threshold.

[0051] In step S50, based on the judgment result in step S40, the voice module is activated to provide a laundry reminder, or the weighing module is activated to weigh the clothes. This allows the voice module to be activated without any user intervention, achieving seamless activation and improving the user experience. Alternatively, the weighing module can be activated without any user intervention to obtain the weight of the clothes in the washing drum. This weight can be used for the next judgment, comparing the current weight of the clothes with a threshold, and then further determining whether to activate the voice module based on the judgment result, thus better achieving seamless activation of the voice module.

[0052] Specifically, if the weight of the laundry in the washing drum exceeds a threshold, it means there is enough laundry to wash. For example, if the weight of the laundry is 4.8 kg and the threshold is 4.5 kg, then the voice module will be activated to remind you to start washing.

[0053] It should be noted that the voice module has a pronunciation mode and a sound pickup mode. When the voice module enters pronunciation mode, it can issue a reminder such as "wash clothes." Obviously, it can also issue voice reminders such as "power on." Those skilled in the art can flexibly choose the appropriate mode based on the specific application scenario, as long as the voice module can provide washing reminders. When the voice module enters sound pickup mode, it can collect ambient sounds, such as various user commands, like washing instructions or power-on instructions.

[0054] Preferably, "activating the voice module to remind you to wash clothes" specifically includes: controlling the voice module to enter the speaking mode. After the step of "controlling the voice module to enter the speaking mode", the voice module is controlled to issue a reminder of "washing clothes". After hearing the reminder, the user knows that the clothes can be washed, thus providing a better reminder for the user.

[0055] Obviously, the voice module can also provide washing reminders in other ways, such as through a "beep beep beep" alarm sound, etc. Those skilled in the art can flexibly choose the specific reminder method.

[0056] If the weight of the laundry in the washing drum does not exceed the threshold, it means there is still relatively little laundry in the drum. You can continue to add laundry, for example, if the weight of the laundry is 3kg and the threshold is 4.5kg. At this point, the weighing module will be activated to weigh the laundry.

[0057] In one possible implementation, after the step of "starting the weighing module to weigh the clothes," the control method of the present invention further includes: acquiring the weight of the clothes to be washed in the washing drum through the weighing module and saving the weight. After acquiring the weight of the clothes to be washed, the weight is saved. The next time it is determined that the user has clothes in their hands, this weight is compared with a threshold as the current weight of the clothes to be washed in the washing drum, and then based on the determination result, it is further determined whether to activate the voice module, thereby better realizing the seamless activation of the voice module.

[0058] This control method allows the operation of the voice module or weighing module to be controlled based on the weight of the clothes to be washed in the washing drum, thus providing better service to users.

[0059] After the voice module enters the speaking mode or the weight of the clothes to be washed in the washing drum is obtained, the voice module enters the sound pickup mode to collect ambient sound and enable human-computer interaction. Specifically, see below. Figure 2 The control method of the garment processing equipment of the present invention will be further explained below. Among them, Figure 2 This is a flowchart of the voice module entering the sound pickup mode according to an embodiment of the present invention.

[0060] like Figure 2 As shown, in one possible implementation, after controlling the voice module to enter the speaking mode, or after obtaining the weight of the clothes to be washed in the washing drum, the control method of the present invention further includes:

[0061] Step S61: After controlling the voice module to enter the speech mode, or after obtaining the weight of the clothes to be washed in the washing drum, control the voice module to enter the sound pickup mode;

[0062] In step S61, after the voice module is put into voice mode, a washing reminder can be given to remind the user that it is time to wash clothes. Then, the voice module is put into sound pickup mode to collect ambient sounds, such as user commands.

[0063] Alternatively, after acquiring and saving the weight of the clothes in the washing drum, the voice control mode can be switched to a sound pickup mode to collect ambient sound. This way, when the weight of the clothes exceeds a threshold, the voice module will issue a washing reminder, and the user can then give the washing machine a voice command, such as "start washing." Even if the weight of the clothes is below the threshold, if the user still wants to wash the clothes, they can still give a voice command, such as "start washing."

[0064] With this control method, after the voice module enters the speech mode or obtains the weight of the clothes to be washed, the voice module is put into the sound pickup mode, thereby enabling human-computer interaction between the user and the washing machine, better control of the washing machine, and improved user experience.

[0065] Step S62: If the voice module does not receive a valid command within the preset time period of the voice module entering the pickup mode, then control the voice module to exit the pickup mode.

[0066] Valid commands include start washing command, stop washing command, power on command, and power off command. It should be noted that the types of valid commands listed above are only specific to the command type; they do not limit the specific content of the commands that the voice module can receive, as long as the valid commands received by the voice module can control the washing machine to start washing, stop washing, power on, and power off.

[0067] In step S62, after controlling the voice module to enter the pickup mode in step S61, the duration of the voice module entering the pickup mode is obtained. If no valid command is received within the preset duration of the voice module entering the pickup mode (e.g., if the preset duration is 5 minutes, meaning no valid command is received within 5 minutes of the voice module entering the pickup mode), it indicates that the user does not currently intend to wash the clothes. In this case, the voice mode is controlled to exit the pickup mode.

[0068] Step S63: Control the voice module to operate at the first power.

[0069] In step S63, after controlling the voice module to exit the pickup mode in step S62, the voice module is controlled to operate at a first power. It should be noted that this first power is lower than the normal operating power of the voice module. Specifically, the voice module may be controlled to enter a sleep state, or the voice module may operate at a very low first power. By controlling the voice module to operate at a lower first power, energy can be effectively saved.

[0070] In one possible implementation, a relay is provided on the power supply circuit of the voice module. After the voice module exits the pickup mode, or before determining whether the user has clothes in their hands in step S20, the relay is opened, thereby controlling the voice module to operate at a first power, such as when the voice module is in sleep mode or operating at a very low power. After determining whether the user has clothes in their hands and the determination result is yes, the relay is closed, thereby controlling the voice module to operate at a second power, which is greater than the first power, specifically, the voice module operates at its normal operating power. Through this control method, before determining whether the user has clothes in their hands or when the user does not have clothes in their hands, the voice module is controlled to operate at a lower first power, even when the voice module is in sleep mode, saving energy. After determining that the user has clothes in their hands, the voice module is controlled to operate at a higher second power, even when the voice module starts normally, the user can interact with the washing machine through the voice module, thereby achieving seamless start of the voice module.

[0071] Of course, the power supply circuit of the voice module may not have a relay. Instead, the voice module can be directly controlled by the control module to operate at a first power or a second power. Those skilled in the art can choose flexibly, as long as the voice module can be controlled to operate at a lower first power at an appropriate time to save power, or to operate at a higher second power to ensure the normal operation of the voice module.

[0072] To provide more accurate services to users, before acquiring the user's image in step S10 above, it is first detected whether a user has entered a preset area. The activation of the image acquisition module is determined based on whether a user has entered the preset area. Specifically, see below. Figure 3 The control method of the garment processing equipment of the present invention will be further explained below. Among them, Figure 3 This is a flowchart of the startup image acquisition module according to an embodiment of the present invention.

[0073] like Figure 3 As shown, in one possible implementation, before step S10 "acquiring the user's image through the image acquisition module", the control method of the present invention further includes:

[0074] Step S100: Detect whether a user has entered the preset area using the human body detection module;

[0075] Step S200: If a user enters the preset area, the image acquisition module is activated.

[0076] In this embodiment, the washing machine is also equipped with a human body detection module to detect whether a user has entered the preset area. This human body detection module can be installed on the front panel of the washing machine, or obviously, it can be installed in other convenient locations to detect whether a user has entered the preset area.

[0077] It should be noted that the human body detection module can be any device capable of detecting whether a user has entered the preset area, such as an infrared detection module or a radar detection module. Regardless of the method used to detect whether a user has entered the preset area, no specific detection method should limit the present invention.

[0078] In step S100, human detection modules such as infrared detection modules and radar detection modules are used to detect whether a user has entered the preset area.

[0079] It should be noted that the human detection module can perform real-time detection or detection at preset time intervals, such as 15 seconds, 30 seconds, 1 minute, 3 minutes, etc. Of course, these preset time intervals are merely illustrative and not restrictive. Those skilled in the art can flexibly adjust and set the preset time intervals in practical applications based on factors such as the frequency with which users enter the washing machine's placement area. Regardless of how the preset time intervals are adjusted and set, the goal is to accurately detect whether a user has entered the preset area.

[0080] It should be noted that the preset area can be the detection area when the human body detection module is working normally, or it can be an area preset by those skilled in the art based on experiments or experience. The preset area can refer to an area at a certain straight-line distance from the washing machine, such as 0.8m, 1.2m, or 1.5m, etc. Those skilled in the art can flexibly adjust and set the preset area.

[0081] In step S200, based on the detection results in step S100, if a user is detected entering the preset area, it indicates that the user may be washing clothes, or they may simply be passing by the washing machine. To further determine the user's purpose, the image acquisition module is activated to acquire the user's image.

[0082] After confirming that a user has entered the preset area, step S10 is executed to acquire the user's image. Based on this image, it is further determined whether the user is carrying clothing. Specifically, the following describes... Figures 4 to 6 The control method of the garment processing equipment of the present invention will be further explained below. Among them, Figure 4 This is a flowchart of an embodiment of the present invention that calls a preset model to analyze an image and determine whether the user has clothing in their hands. Figure 5 This is a flowchart illustrating an embodiment of the present invention that utilizes the ResNet18 model to analyze images. Figure 6 This is a flowchart of an embodiment of the present invention, which uses the analysis results of the ResNet18 model to determine whether a user has clothing in their hands.

[0083] like Figure 4 As shown, in one possible implementation, step S20, "determining whether the user has clothing in their hands based on the image," further includes:

[0084] Step S201: Call the preset model to analyze the image;

[0085] Step S202: Based on the analysis results, determine whether the user has any clothing in their hands.

[0086] In step S201, the preset model is pre-stored on the washing machine. The preset model can be, but is not limited to, a CNN model, a ResNet18 model, a ResNet101 model, a DeeplabV3+ model, a ResNeXt model, and an HRNet model.

[0087] Preferably, the preset model is the ResNet18 model, and the network structure of the ResNet18 model is shown in Table 1 below.

[0088] Table 1 Network structure of ResNet18 model

[0089]

[0090] The ResNet18 model uses non-linear connections between layers; therefore, the ResNet18 model as a whole is also non-linearly connected. It should be noted that the computational methods and operating principles of the ResNet18 model are common knowledge in the field and will not be elaborated upon here. Of course, other models such as ResNet50 and ResNet101 can also be used to analyze a user's image to determine whether the user has clothing on their hands.

[0091] The following reference Figure 5 The specific method of "calling the preset model to analyze the image" in step S201 is illustrated using the preset model as the ResNet18 model.

[0092] Step S2011: Extract multiple sub-images from the image according to a preset method;

[0093] Step S2012: Input all sub-images into the ResNet18 model;

[0094] Step S2013: The ResNet18 model calculates and obtains the feature values ​​of the image based on all sub-images.

[0095] One preset method could be to set different active frames, extract the image from each active frame, and use the extracted image as a sub-image. Alternatively, a preset method could be to divide the user's image into N parts based on its size, such as 5, 10, 15, or 20 parts, where N is a positive integer, and extract the image from each part, using the extracted image as a sub-image. Of course, preset methods are not limited to those listed above; any method that allows for the extraction of multiple sub-images from the image is acceptable.

[0096] like Figure 6 As shown, step S202, "determining whether the user has clothing in their hands based on the analysis results," specifically includes:

[0097] S2021: Determine whether the feature value is greater than the preset value;

[0098] S2022: If the feature value is greater than the preset value, it is determined that the user has clothing in his / her hands;

[0099] S2023: If the feature value is less than or equal to the preset value, it is determined that the user has no clothes in his / her hands.

[0100] In step S2021, the feature value calculated in step S2013 is compared with the preset value, and the user is finally determined to have clothing in their hands based on the comparison result between the feature value and the preset value.

[0101] In step S2022, if the feature value is greater than the preset value, for example, the preset value is 0.5, and the feature value calculated in step S2013 is 0.95, which is greater than the preset value, it means that the user has clothes in his / her hands, and it is determined that the user has clothes in his / her hands.

[0102] In step S2023, if the feature value is less than or equal to the preset value, for example, if the preset value is 0.5 and the feature value calculated in step S2013 is 0.05, which is less than the preset value, it means that the user has no clothes in his / her hands, and it is determined that the user has no clothes in his / her hands.

[0103] It should be noted that the preset values ​​listed above are merely illustrative and not restrictive. Those skilled in the art can flexibly adjust and set the preset values ​​according to the accuracy of judging whether the user has clothing in their hands. For example, the preset value can also be 0.7, 0.8, 0.9 or 1. No matter how the preset value is set, as long as it can accurately judge whether the user has clothing in their hands, it is acceptable.

[0104] It should also be noted that in the above process, steps S2022 and S2023 are not sequential but parallel, and are only related to the judgment result of whether the feature value is greater than the preset value. The corresponding steps can be executed according to different judgment results.

[0105] In summary, in the preferred embodiment of this invention, an image acquisition module acquires the user's image, analyzes it, and determines whether the user has clothes on their hands. If clothes are present, the system further determines whether the weight of the clothes in the washing drum exceeds a threshold. Based on this determination, the voice module is activated to provide a washing reminder, or the weighing module is activated to weigh the clothes. This allows the voice module to be activated without any user intervention, achieving seamless activation and improving user experience. If there are no clothes, the image acquisition module is turned off to save energy. If the weight of the clothes exceeds the threshold, the voice module is controlled to issue a "wash clothes" reminder; if the weight does not exceed the threshold, the weighing module acquires and saves the weight of the clothes in the washing drum. After the voice module enters the voice mode or acquires the weight of the clothes in the washing drum, it enters the voice pickup mode, enabling human-machine interaction between the user and the washing machine. If the voice module does not receive a valid command within a preset time in the voice pickup mode, it exits the voice pickup mode and operates at a first power level to save energy.

[0106] Although the steps in the above embodiments are described in the above order, those skilled in the art will understand that in order to achieve the effect of this embodiment, different steps do not need to be executed in such order. They can be executed simultaneously (in parallel) or in reverse order. These simple changes are all within the protection scope of this application.

[0107] The technical solution of the present invention has been described above with reference to the preferred embodiments shown in the accompanying drawings. However, it will be readily understood by those skilled in the art that the scope of protection of the present invention is obviously not limited to these specific embodiments. Without departing from the principles of the present invention, those skilled in the art can make equivalent changes or substitutions to the relevant technical features, and the technical solutions after such changes or substitutions will all fall within the scope of protection of the present invention.

Claims

1. A control method for a garment processing device, characterized in that, The garment processing equipment includes a garment processing drum for holding the garments to be processed, and is equipped with an image acquisition module, a voice module, and a weighing module. The control method includes: The user's image is acquired through the image acquisition module; Based on the image, determine whether the user has clothing in their hands; If there are clothes, then it is further determined whether the weight of the clothes to be processed in the current clothes processing drum exceeds the threshold. Based on the judgment result, the voice module can be selectively activated to provide washing reminders or the weighing module can be activated to weigh the clothes. The step of "selectively activating the voice module to provide washing reminders or activating the weighing module to weigh the clothes based on the judgment result" further includes: If the weight of the clothing to be processed does not exceed the threshold, the weighing module is activated to weigh the clothing. The voice module has a pronunciation mode and a sound pickup mode. After the step of "starting the weighing module", the control method further includes: Obtain the weight of the garments to be processed in the garment processing drum and save the weight; Following the step of "obtaining the weight of the garments to be processed in the garment processing drum", the control method further includes: Control the voice module to enter the sound pickup mode.

2. The control method according to claim 1, characterized in that, The step of "selectively activating the voice module to provide washing reminders or activating the weighing module to weigh the clothes based on the judgment result" further includes: If the weight of the clothes to be processed exceeds the threshold, the voice module will be activated to provide a washing reminder.

3. The control method according to claim 2, characterized in that, The step of "starting the voice module" further includes: Control the voice module to enter the pronunciation mode.

4. The control method according to claim 3, characterized in that, After the step of "controlling the voice module to enter the pronunciation mode", the control method further includes: The voice module is controlled to issue a reminder to "wash clothes".

5. The control method according to claim 3, characterized in that, After the step of "controlling the voice module to enter the pronunciation mode", the control method further includes: Control the voice module to enter the sound pickup mode.

6. The control method according to claim 5, characterized in that, The control method further includes: If the voice module does not receive a valid instruction within a preset time period after entering the sound pickup mode, the voice module is controlled to exit the sound pickup mode. The valid commands include start washing command, stop washing command, power on command, and power off command.

7. The control method according to claim 6, characterized in that, After the step of "controlling the voice module to exit the pickup mode", the control method further includes: Control the voice module to operate at a first power.

8. The control method according to claim 1, characterized in that, The control method further includes: If there is no clothing, then the image acquisition module is turned off.

9. The control method according to claim 1, characterized in that, The garment processing equipment is also equipped with a human body detection module. Prior to the step of "acquiring the user's image through the image acquisition module", the control method further includes: The human detection module detects whether a user has entered the preset area. If a user enters the preset area, the image acquisition module is activated.

Citation Information

Patent Citations

  • Clothes treatment apparatus and method for controlling the same

    CN111727280A

  • Communication robot and method for operating the same

    KR1020190090745A