Control method for clothing processing equipment

Abstract

This invention relates to the field of smart home appliance technology, specifically providing a control method for a clothing handling device, aiming to solve the problem that existing clothing handling devices cannot seamlessly activate the voice module. To this end, the control method of this invention includes the following steps: when a user is detected to have clothing in their hands, acquiring the user's historical washing and care data; acquiring historical information about the clothing in the clothing handling drum; acquiring the current weather; determining a first preset weight based on the historical washing and care data, historical information, and current weather; determining whether the existing weight of the clothing in the clothing handling drum has reached the first preset weight; and, based on the determination result, selectively activating the voice module to provide a voice reminder or activating the weighing module to weigh the clothing. This allows the voice module to be activated without any user intervention, achieving seamless activation and improving the user experience.

Description

Technical Field

[0001] This invention relates to the field of smart home appliance technology, specifically providing a control method for clothing processing equipment. Background Technology

[0002] Washing machines are common household laundry appliances. Based on washing methods, they can be broadly categorized into top-loading washing machines and front-loading washing machines. Taking front-loading washing machines as an example, to meet user needs, they are equipped with voice interaction functions, allowing for human-machine interaction via voice commands, making it more convenient for users to operate the washing machine.

[0003] However, existing drum washing machines require a wake-up keyword, such as "Xiaoyou," before activating the voice module. The drum washing machine can only activate the voice module after receiving the activation command, or the voice module's activation button can only be pressed or touched. It cannot be activated seamlessly, which affects the user experience.

[0004] Therefore, there is a need in the art for a new control method for garment processing equipment to solve the above problems. Summary of the Invention

[0005] The present invention aims to solve the above-mentioned technical problem, namely, to solve the problem that existing clothing processing equipment cannot seamlessly start the voice module.

[0006] This invention provides a control method for a clothing processing device, the clothing processing device including a clothing processing drum, an image acquisition module, a voice module, and a weighing module; the control method includes the following steps: when a user is detected to have clothing in their hands, acquiring the user's historical washing and care data; acquiring historical information of the clothing in the clothing processing drum; acquiring the current weather; determining a first preset weight based on the historical washing and care data, the historical information, and the current weather; determining whether the existing weight of the clothing in the clothing processing drum has reached the first preset weight; and, based on the determination result, selectively activating the voice module to provide a voice reminder or activating the weighing module to weigh the clothing.

[0007] In the preferred embodiment of the above control method, the step of "selectively activating the voice module to provide a voice reminder or activating the weighing module to weigh the clothing according to the judgment result" specifically includes: if the existing weight reaches the first preset weight, then the voice module is activated to provide a voice reminder.

[0008] In the preferred embodiment of the above control method, the step of "starting the voice module to provide voice reminders" specifically includes: obtaining the user's age; comparing the age with a first preset age and a second preset age respectively; wherein the first preset age is less than the second preset age; and, based on the comparison result, causing the voice module to send different voice reminder information.

[0009] In the preferred embodiment of the above control method, the step of "selectively activating the voice module to provide a voice reminder or activating the weighing module to weigh the clothing according to the judgment result" further includes: if the existing weight has not reached the first preset weight, then after a first preset time, activating the weighing module to weigh the clothing; obtaining the current weight of the clothing in the clothing processing tube and saving the current weight; determining whether the current weight has reached the second preset weight, wherein the second preset weight is greater than the first preset weight; and selectively activating the voice module to provide a voice reminder according to the judgment result.

[0010] In the preferred embodiment of the above control method, the step of "selectively activating the voice module to provide voice reminders based on the judgment result" specifically includes: if the current weight reaches the second preset weight, then the voice module is activated to provide an overweight reminder.

[0011] In the preferred embodiment of the above control method, the voice module has a pronunciation mode and a sound recognition mode; the step of "starting the voice module" specifically includes: controlling the voice module to enter the pronunciation mode.

[0012] In a preferred embodiment of the above control method, after "controlling the voice module to enter the pronunciation mode", or when it is determined that the current weight has not reached the second preset weight, the control method further includes: controlling the voice module to enter the sound recognition mode.

[0013] In a preferred embodiment of the above control method, the voice module further has an energy-saving mode; the control method further includes: within a second preset time period after the voice module enters the voice recognition mode, determining whether the voice module receives a valid control command; if the voice module does not receive the valid control command, controlling the voice module to exit the voice recognition mode and enter the energy-saving mode; and / or if the voice module receives the valid control command, causing the clothing processing device to operate according to the valid control command; wherein the valid control command includes at least a start washing command, a stop washing command, a power-on command, a power-off command, a standby command, and a sleep command.

[0014] In a preferred embodiment of the above control method, the clothing handling device further includes a human body detection module and an image acquisition module; before "acquiring the user's historical washing and care data", the control method further includes: detecting whether a user has entered a preset range through the human body detection module; if a user has entered the preset range, activating the image acquisition module; acquiring the user's image through the image acquisition module; determining whether the user has clothing in their hands based on the image; if the user has clothing in their hands, performing the operation of acquiring the historical washing and care data; and / or if the user does not have clothing in their hands, turning off the image acquisition module.

[0015] In a preferred embodiment of the above control method, the control method further includes: determining whether the clothes have been removed after the clothes handling equipment has finished washing and after a third preset time interval; and selectively sending a clothes removal reminder based on the age if it is determined that the clothes have not been removed.

[0016] In a preferred embodiment of the control method of the present invention, when it is detected that the user has clothes in his / her hands, the user's historical washing and care data is obtained; the historical information of the clothes in the washing drum is obtained; the current weather is obtained; a first preset weight is determined based on the historical washing and care data, the historical information and the current weather; it is determined whether the existing weight of the clothes in the washing drum has reached the first preset weight; based on the determination result, the voice module is selectively activated to provide voice reminders or the weighing module is activated to weigh the clothes.

[0017] Compared to existing technologies that require activation commands such as wake-up keywords to start the voice module, this invention determines whether the user has clothes in their hands based on an image, thus accurately judging the user's intention. If clothes are present, indicating an intention to add more, the system checks if the weight of the clothes in the tub reaches a first preset weight. Based on this, it selectively activates either the voice module to provide a voice prompt or the weighing module to weigh the clothes. This process requires no user intervention, achieving seamless voice module activation and improving user experience. Furthermore, the first preset weight is determined based on the user's historical washing data, clothing history, and current weather, making it more aligned with the user's washing habits and usage needs, and enabling more accurate decision-making regarding voice module activation.

[0018] In addition, it can also seamlessly start the weighing module to obtain the weight of the clothes in the washing drum, and use this weight as the weight of the clothes for the next time to determine whether to start the voice module, thus better achieving the goal of seamlessly starting the voice module.

[0019] Furthermore, if the existing weight has reached the first preset weight, it means that there are already a lot of clothes in the washing drum and it is ready to be washed. Adding more clothes may cause the drum to become overweight, which may affect the washing effect. In this case, the voice module is activated to provide a voice reminder to prevent the user from adding more clothes, thus achieving the purpose of activating the voice module without being noticed.

[0020] Furthermore, the user's age is obtained; the age is compared with a first preset age and a second preset age; based on the comparison results, the voice module sends different voice reminders, enabling targeted delivery of different voice reminders to users of different age groups, thus better meeting the washing needs of users of different age groups.

[0021] Furthermore, if the existing weight has not reached the first preset weight, it means that there are few clothes in the washing drum and more clothes can be added. Then, after the first preset time, that is, after the user puts the clothes into the washing drum, the weighing module is activated to weigh the clothes; the current weight of the clothes in the washing drum is obtained and saved; based on the current weight, the voice module is selectively activated to provide voice reminders, thereby better achieving the purpose of seamlessly activating the voice module.

[0022] Furthermore, if the current weight reaches the second preset weight, it means that there are too many clothes in the washing drum and it is overweight, which may affect the washing effect. At this time, the voice module will be activated to remind the user to take out some clothes, thus achieving the purpose of seamlessly activating the voice module.

[0023] Furthermore, after "controlling the voice module to enter the speech mode" or "obtaining the current weight of the clothes in the washing drum", the voice module can enter the voice recognition mode, allowing users to interact with the washing machine via voice, further improving the user experience. Attached Figure Description

[0024] The control method of the present invention will now be described with reference to the accompanying drawings and in conjunction with a washing machine, in which:

[0025] Figure 1 This is the flow chart of the control method of the present invention. Figure 1 ;

[0026] Figure 2 This is a flowchart of the control method for selectively activating the voice module or the weighing module according to the present invention;

[0027] Figure 3 This is a flowchart of the method for activating the voice module to perform voice reminder control according to the present invention;

[0028] Figure 4 This is a flowchart of the control method for selectively activating the voice module according to the present invention;

[0029] Figure 5 This is the flow chart of the control method of the present invention. Figure 2 ;

[0030] Figure 6 This is the flow chart of the control method of the present invention. Figure 3 ;

[0031] Figure 7 This is the flow chart of the control method of the present invention. Figure 4 ;

[0032] Figure 8 This invention describes the flow of a control method for determining whether a user has clothing in their hands. Figure 1 ;

[0033] Figure 9 This is a flowchart of the control method for calling a deep learning model to analyze images according to the present invention;

[0034] Figure 10 This invention describes the flow of a control method for determining whether a user has clothing in their hands. Figure 2 ;

[0035] Figure 11 This is a logic diagram of the control method of the present invention. Detailed Implementation

[0036] Preferred embodiments of the present invention will now be described with reference to the accompanying drawings. Those skilled in the art should understand that these embodiments are merely illustrative of the technical principles of the present invention and are not intended to limit the scope of protection of the present invention. For example, although this application is described in conjunction with a washing machine, the technical solution of the present invention is not limited thereto, and this control method can obviously also be applied to other clothing handling equipment such as dryers, garment care machines, and washer-dryer combos, without departing from the principles and scope of the present invention.

[0037] It should be noted that in the description of this invention, the terms "first," "second," and "third" are used for descriptive purposes only and should not be construed as indicating or implying relative importance.

[0038] Furthermore, it should be noted that, in the description of this invention, unless otherwise explicitly specified and limited, the term "setup" should be interpreted broadly. For example, it can refer to a fixed connection, a detachable connection, or an integral connection; it can refer to a mechanical connection or an electrical connection; it can refer to a direct connection or an indirect connection through an intermediate medium; it can refer to the internal connection of two components. Those skilled in the art can understand the specific meaning of the above terms in this invention according to the specific circumstances.

[0039] Based on the technical problems mentioned in the background art, this invention provides a control method for a washing machine. The method aims to determine whether a user has clothes in their hands based on an image, thereby accurately determining the user's intention. If the user is found to have clothes, indicating an intention to add clothes to the washing drum, the method then determines whether the existing weight of the clothes in the drum reaches a first preset weight. Based on the determination result, the method selectively activates either a voice module to provide a voice prompt or a weighing module to weigh the clothes. During this process, the voice module can be activated without any user intervention, achieving seamless activation and improving the user experience. Furthermore, the first preset weight is determined based on the user's historical washing and care data, the historical information of the clothes, and the current weather, making the first preset weight more aligned with the user's washing habits and usage needs, and enabling more accurate determination of whether to activate the voice module.

[0040] In addition, it can also seamlessly start the weighing module to obtain the weight of the clothes in the washing drum, and use this weight as the weight of the clothes for the next time to determine whether to start the voice module, thus better achieving the goal of seamlessly starting the voice module.

[0041] First, the washing machine of the present invention will be described.

[0042] The washing machine of the present invention includes a cabinet, a washing drum and a weighing module disposed within the cabinet, and an image acquisition module, a voice module, a human body detection module and a control module disposed on the cabinet. The washing drum includes an outer drum disposed within the cabinet and an inner drum rotatably disposed within the outer drum. The outer drum is used to hold washing water, and the inner drum is used to hold clothes.

[0043] The image acquisition module, voice module, weighing module, and human body detection module are all connected to the control module. The image acquisition module is used to acquire images of the user; the voice module is used to send voice prompts and interact with the user; the weighing module weighs the clothes inside the drum; the human body detection module detects whether there is a user within a preset range of the washing machine; the control module controls the image acquisition module to capture images of the user based on the detection results of the human body detection module, and controls the preset model to analyze the user's images. Based on the analysis results, it determines whether the user has clothes in their hands, and selectively activates the voice module to provide voice prompts or activates the weighing module to weigh the clothes based on the determination results.

[0044] Preferably, the image acquisition module can be, but is not limited to, a camera or a webcam.

[0045] Preferably, the voice module can be, but is not limited to, an SDK module, an NV020S module, a YQ5969 module, an NRK10B module, etc.

[0046] Preferably, the weighing module can be, but is not limited to, a weighing sensor, a weighing meter, etc.

[0047] Preferably, the human body detection module is an infrared sensor, which can accurately detect the user's location information. Of course, the human body detection module can also be a radar sensor or a laser sensor. Regardless of the sensor used to detect the user's location information, the specific detection method corresponding to any sensor should not constitute a limitation on this invention.

[0048] See next. Figure 1 The control method of the present invention will be described below. Figure 1 This is the flow chart of the control method of the present invention. Figure 1 .

[0049] like Figure 1 As shown, the control method of the present invention includes the following steps:

[0050] S100: Acquire the user's image through the image acquisition module;

[0051] S200: Based on the image, determine whether the user has clothing in their hands;

[0052] S300: If it is determined that the user has clothes in their hands, obtain the user's historical washing and care data;

[0053] S400: Obtain historical information about the clothes in the washing drum;

[0054] S500: Get the current weather;

[0055] S600: Determine the first preset weight based on historical washing and care data, historical information, and current weather.

[0056] S700: Determine whether the existing weight of the garment inside the garment processing tube has reached the first preset weight;

[0057] S800: Based on the judgment result, selectively activate the voice module to provide voice prompts or activate the weighing module to weigh the clothing.

[0058] In step S100, the washing machine captures images of the user through image acquisition modules such as cameras and camcorders.

[0059] If it is determined that the user has clothes in hand, it indicates that the user intends to add clothes to the washing drum. Then, steps S300 to S600 are executed to determine the first preset weight based on the user's historical washing and care data, the historical information of the clothes, and the current weather.

[0060] In step S300, the washing machine has a database pre-stored, and the user's historical washing and care data is retrieved from the database based on the user's ID account; the historical washing and care data includes historical washing programs, historical preset weight, historical water level, historical water temperature, historical washing time, historical washing quantity, and other washing and care data.

[0061] In step S400, the clothes in the washing drum are the clothes that have already been placed in the washing drum; the existing clothes in the washing drum are captured by an image acquisition module such as a camera; the existing clothes images are compared with standard clothes images stored in the database; the standard clothes image corresponding to the existing clothes image is determined based on the comparison result; the historical information of the existing clothes is found based on the determined standard clothes image, wherein the historical information includes the number of historical washes and the historical color depth.

[0062] Preferably, a deep learning model can be used to compare the existing clothing image with each standard clothing image, calculate the cosine distance between the existing clothing image and each standard clothing image, and determine the standard clothing image corresponding to the existing clothing image through the cosine distance. For example, when the calculated cosine distance between the existing clothing image and the first standard clothing image is 0.95, which is greater than the preset distance of 0.9, the first standard clothing image can be considered as the standard clothing image corresponding to the existing clothing image.

[0063] The deep learning model can also use other algorithms such as CNN, ResNet18, ResNet101, DeeplabV3+, ResNeXt and HRNet to compare existing clothing images with standard clothing images. Regardless of the algorithm used by the deep learning model, the specific method for calculating the similarity between images corresponding to any algorithm should not constitute any limitation on this invention.

[0064] In step S500, the washing machine is equipped with a weather forecast module, which can obtain the current weather; alternatively, the washing machine can obtain the current weather through a server, terminal device, or other device connected to it. The terminal device can be a mobile smart terminal such as a mobile phone, tablet, smart bracelet, or smartwatch, or a non-mobile smart terminal such as a computer or smart speaker, all of which are equipped with a weather forecast module.

[0065] The current weather includes sunny, cloudy, overcast, snowy, rainy, foggy, and sandstorm weather.

[0066] In step S600, a first preset weight is determined based on historical washing data, historical information, and current weather. For example, the user's historical preset weight is corrected based on the number of times the clothes have been washed and the color difference of the clothes to obtain a corrected first preset weight. That is to say, based on the user's historical preset weight, the historical information such as the number of times the clothes have been washed and the color difference of the clothes is taken into account. In particular, the first preset weight can be appropriately reduced when the clothes have been washed many times, are severely worn, or have a large color difference or severe fading, so as to avoid damage to the clothes. Or, when the clothes have been washed few times, have little wear, or have a small color difference or not severe fading, the first preset weight can be appropriately increased to meet the user's need to wash more clothes, so that the corrected first preset weight is more accurate and better meets the user's needs.

[0067] Furthermore, after obtaining the corrected first preset weight, the system further determines whether to adjust the corrected first preset weight based on the current weather conditions. For example, if the current weather is sunny and the humidity is low, making it convenient to dry clothes and wash more items, the corrected first preset weight will be increased by one level, and this increased preset weight will be set as the final first preset weight, thus meeting the user's need to wash more clothes.

[0068] For example, if the current weather is rainy or snowy with high humidity, making it inconvenient to dry clothes, in order to improve the drying effect, the modified first preset weight is lowered by one level, and the lowered preset weight is set as the final first preset weight, thus meeting the user's needs for drying clothes.

[0069] For example, if the current weather is cloudy and the humidity is moderate, there is no need to adjust the corrected first preset weight; simply set the corrected first preset weight as the final first preset weight.

[0070] Of course, the methods for determining the first preset weight based on historical washing and care data, historical information, and current weather are not limited to the situations listed above. The method for determining the first preset weight under different situations can be adjusted according to the specific weather conditions and historical washing and care data and historical information. Regardless of the method used, as long as the first preset weight can be determined based on historical washing and care data, historical information, and current weather, it is acceptable.

[0071] Furthermore, if it is determined that the user does not have any clothing, step S900 is executed;

[0072] S900, disable the image acquisition module.

[0073] If it is determined that the user has no clothes in their hands, it means that the user is not going to do laundry and may just be passing by the washing machine. In this case, the image acquisition module is turned off to save power.

[0074] It should be noted that the execution order of steps S300 to S500 in the above process is not limited to the order listed above. Step S400 can be executed first, followed by steps S300 and S500, or steps S300 to S500 can be executed simultaneously. Those skilled in the art can flexibly adjust and set the execution order of steps S300 to S500. Steps S300 and S900 have no sequential order; they are parallel and only related to the judgment result of whether the user has clothing in their hands. The corresponding steps are executed according to different judgment results.

[0075] It should also be noted that although the above embodiments are described in conjunction with steps S100, S200, and S900, not all of these steps are mandatory. Those skilled in the art will understand that, provided the control method operates normally, the above steps can be appropriately reduced to create new embodiments. For example, steps S100, S200, and S900 can be removed from the above embodiments to create new control methods.

[0076] The following reference Figures 2 to 4 The present invention describes a control method for selectively activating the voice module or the weighing module. Wherein, Figure 2 This is a flowchart of the control method for selectively activating the voice module or the weighing module according to the present invention; Figure 3 This is a flowchart of the method for activating the voice module to perform voice reminder control according to the present invention; Figure 4 This is a flowchart of the control method for selectively activating the voice module according to the present invention.

[0077] like Figure 2 As shown, step S800, "selectively activating the voice module to provide voice prompts or activating the weighing module to weigh the clothing based on the judgment result," specifically includes:

[0078] If the weight has already reached the first preset weight, then proceed to step S811;

[0079] If the existing weight has not reached the first preset weight, then proceed to step S812;

[0080] S811, Activate the voice module to provide voice prompts;

[0081] S812. After the first preset time, start the weighing module to weigh the clothing;

[0082] S813. Obtain the current weight of the garment inside the garment processing tube and save the current weight;

[0083] S814. Determine whether the current weight has reached the second preset weight, wherein the second preset weight is greater than the first preset weight;

[0084] S815. Based on the judgment result, selectively activate the voice module to provide voice reminders.

[0085] In step S811, if the existing weight has reached the first preset weight, for example, the first preset weight is 3.5kg and the detected existing weight is 3.6kg, which is slightly greater than the first preset weight, it means that there are already a lot of clothes in the washing drum and it can be washed. If more clothes are added, it may exceed the weight limit and thus affect the washing effect. At this time, the voice module is activated to provide a voice reminder to prevent the user from adding more clothes, thus achieving the purpose of activating the voice module without being noticed.

[0086] Preferably, the step of "starting the voice module" specifically includes: controlling the voice module to enter the speech mode, and further controlling the voice module to issue a "wash clothes" reminder, which can promptly remind the user to start washing clothes to prevent the user from adding more clothes and ensure the washing effect. Of course, the voice module can also send different prompts through different ringtones or other means, and those skilled in the art can flexibly choose the specific reminder method.

[0087] Furthermore, such as Figure 3 As shown, step S811, the step of "starting the voice module to provide voice reminders" specifically includes:

[0088] S821, Obtain the user's age;

[0089] S822. Compare the age with the first preset age and the second preset age respectively; wherein the first preset age is less than the second preset age;

[0090] S823. Based on the comparison results, the voice module sends different voice reminder messages.

[0091] In step S821, the user's age can be determined based on the user's image. For example, a classification model can be called to recognize the user's image and identify the user's age. The identified age can be stored in the ID account corresponding to the user. When the user washes clothes again, the user's age can be retrieved directly. The classification model can use algorithms such as SENet, Keras, VGG, and AtoC to identify the user's age. Regardless of the algorithm used, the specific method for identifying the user's age should not constitute any limitation on this invention.

[0092] Alternatively, the user's age can be retrieved from the database based on their ID account; or the user can input their age via voice module or smart terminal. Whichever method is used, as long as the user's age can be determined, it is acceptable.

[0093] Preferably, the user's age is divided into multiple stages, such as infancy, adolescence, youth, adulthood, middle age, and old age. Of course, the division of age stages is not limited to the above-listed methods. Those skilled in the art can flexibly adjust and set them in practical applications. For example, age stages can be divided into minors, adults, and the elderly. Those skilled in the art can flexibly adjust and set the division of age stages according to the needs of activating the voice module.

[0094] Furthermore, the age range for the infant stage is 0-6 years; the age range for the adolescent stage is 6-12 years; the age range for the youth stage is 12-18 years; the age range for the young adult stage is 18-40 years; the age range for the middle-aged stage is 40-65 years; and the age range for the elderly stage is 65 years and above.

[0095] In steps S822 and S823, the following will be further explained using the first preset age of 18 years old and the second preset age of 65 years old as examples.

[0096] For example, if the user's age detected in step S821 is 15 years old, which is less than the first preset age, it means that the user is young and a teenager, and may not be able to operate the washing machine well. In this case, the voice module reminds the user to pay attention to washing precautions so that the user can operate the washing machine well. It also reminds the user to inform their parents or other elders of the washing machine's status in a timely manner to avoid accidents and improve the safety of the washing machine's operation.

[0097] For example, if the user's age detected in step S821 is 33 years old, which is greater than the first preset age and less than the second preset age, it means that the user is of a suitable age, a young person, and can operate the washing machine well. In this case, the voice module can remind the user to do the laundry in time.

[0098] For example, if the user's age detected in step S821 is 66 years old, which is greater than the second preset age, it means that the user is older and is an elderly person. Although the user can operate the washing machine well, the elderly are more forgetful and may forget to take out the clothes. Therefore, the voice module will remind the user to do the laundry in time and take out the clothes in time to prevent the clothes from being left in the washing machine for a long time to breed bacteria and wrinkles.

[0099] In step S812, after a first preset time, such as 20s, 30s or 40s, the weighing module is started to weigh the clothes, so that the user has enough time to put the clothes in the inner drum, and the weighing module weighs the weight after the clothes are added.

[0100] In step S813, the current weight of the clothes in the garment processing tube is obtained and saved. This provides accurate data for determining whether to start the voice module in step S814, thereby achieving the goal of seamlessly starting the voice module more accurately.

[0101] like Figure 4 As shown, step S815, "selectively activating the voice module to provide voice reminders based on the judgment result," specifically includes:

[0102] If the current weight reaches the second preset weight, then proceed to step S831;

[0103] If the current weight has not reached the second preset weight, proceed to step S832;

[0104] S831, Activate the voice module to provide an overweight reminder;

[0105] S832, Do not start the voice module.

[0106] In step S831, if the current weight reaches the second preset weight, for example, if the first preset weight is 3.5kg, then the second preset weight is 4kg. If the detected current weight is 4.3kg, which is greater than the second preset weight, it means that there are a lot of clothes in the washing drum and it is overweight, which may affect the washing effect. At this time, the voice module is activated to remind the user to take out some clothes, thus better achieving the purpose of activating the voice module without being noticed.

[0107] Furthermore, the steps of "activating the voice module" specifically include: controlling the voice module to enter the speech mode, and further controlling the voice module to issue a "clothes are too heavy" reminder to remind the user to remove some of the clothes. Of course, the voice module can also send different prompts through different ringtones or other means, and those skilled in the art can flexibly choose the specific reminder method.

[0108] In step S832, if the current weight does not reach the second preset weight (for example, if the first preset weight is 3.5kg and the second preset weight is 4kg), and the detected current weight is 3.6kg, although greater than the first preset weight, it is less than the second preset weight. The current weight of the clothes is simply excessive and will not affect the washing effect, so there is no need to activate the voice model to provide a reminder. This current weight can be used as a reference to determine whether the existing weight of the clothes in the washing drum has reached the first preset weight when the user's hands are detected again. Then, based on the determination result, it is further determined whether to activate the voice module, thereby better achieving seamless activation of the voice module.

[0109] Alternatively, if the detected current weight is 3.3kg, which is less than the second preset weight and less than the first preset weight, it means that the current weight of the clothes is small and will not affect the washing effect, so there is no need to activate the voice model to remind you.

[0110] It should be noted that in the above process, steps S811 and S812 are not sequential but parallel, and are only related to the judgment result of whether the existing weight has reached the first preset weight. The corresponding steps are executed according to different judgment results. Similarly, steps S831 and S832 are not sequential but parallel, and are only related to the judgment result of whether the current weight has reached the second preset weight. The corresponding steps are executed according to different judgment results.

[0111] The following reference Figure 5 The control method of the present invention is further described below. Figure 5 This is the flow chart of the control method of the present invention. Figure 2 .

[0112] The voice module also has an energy-saving mode; such as Figure 5 As shown, the control method also includes:

[0113] S1011. After “controlling the voice module to enter the pronunciation mode”, or when it is determined that the current weight has not reached the second preset weight, control the voice module to enter the sound recognition mode.

[0114] S1012. Within the second preset time period after the voice module enters the voice recognition mode, determine whether the voice module has received a valid control command; if not, proceed to step S1013; if yes, proceed to step S1014.

[0115] S1013. Control the voice module to exit voice recognition mode and enter energy-saving mode;

[0116] S1014. Make the washing machine operate according to effective control commands;

[0117] The effective control commands include at least the following: start washing command, stop washing command, power on command, power off command, standby command, and sleep command. It should be noted that the types of effective commands listed above are only specific to the command types; they do not limit the specific content of the commands that the voice module can receive. As long as the effective commands received by the voice module can control the washing machine to start washing, stop washing, power on, power off, standby, or sleep, it is acceptable.

[0118] In step S1011, after “controlling the voice module to enter the voice mode”, a washing reminder or overload reminder is given. Then, the voice module is controlled to enter the voice recognition mode, and the user can give commands to the washing machine by voice, such as start washing command or stop washing command.

[0119] Alternatively, if the current weight is determined to be below the second preset weight, the voice module can be put into voice recognition mode, allowing the user to give commands to the washing machine via voice, such as the command to start washing.

[0120] In step S1013, if the voice module does not receive a valid control command, for example, if the second preset time is 5 minutes and no valid control command is received within 5 minutes of the reservation module entering the voice recognition mode, it means that the user does not intend to wash clothes at this time, or the user has a hearing impairment and has not received the voice prompt information, or the user forgot to send the control command, etc. In any of the above situations, even if it continues to be in the voice recognition mode, it is unlikely to collect a valid control command. Therefore, the voice mode is controlled to exit the sound pickup mode and enter the energy saving mode.

[0121] Among them, the power consumption of the energy-saving mode is much lower than that of the voice module when it is running normally. The voice module is controlled to operate at low power, which effectively reduces power consumption even when the voice module is in sleep mode.

[0122] In step S1014, if the voice module receives a valid control command, for example, if the second preset time is 5 minutes and a valid control command is received 1 minute after the reservation module enters the voice recognition mode, such as a start washing command, then the washing machine can be controlled to start executing the washing program.

[0123] It should be noted that steps S1013 and S1014 are not sequential but parallel, and are only related to the judgment result of whether a valid control command is received within the second preset time. The corresponding steps can be executed according to different judgment results.

[0124] The following reference Figure 6 The control method of the present invention is further described below. Figure 6 This is the flow chart of the control method of the present invention. Figure 3 .

[0125] like Figure 6 As shown, before step S100, the control method further includes:

[0126] S010. Detect whether a user has entered the preset range using the human body detection module; if yes, proceed to step S020; if no, proceed to step S030.

[0127] S020, Start the image acquisition module;

[0128] S030, Do not start the image acquisition module.

[0129] In step S010, the human body detection module can detect in real time whether a user has entered the preset range; or the human body detection module can detect whether a user has entered the preset range at preset time intervals.

[0130] The preset time interval can be 1 minute, 2 minutes, or 3 minutes, etc. The above preset time interval is only an example and not a limitation. In practical applications, those skilled in the art can flexibly adjust and set the preset time interval according to the frequency of users entering the washing machine placement position, etc. No matter how the preset time interval is adjusted and set, as long as it can accurately detect whether a user enters the preset range, it is acceptable.

[0131] The preset range can be the detection range of the detection module, such as 1.2m, 1.5m or 2.0m; the preset range can also be a range set by those skilled in the art based on experiments or experience, such as 1.0m, 1.3m or 1.6m. Those skilled in the art can flexibly adjust and set the preset range.

[0132] If a user enters the preset range, the user may be washing clothes and holding clothes to be washed. Of course, the user may also be passing by the washing machine. In order to determine the user's purpose, the image acquisition module is activated so that it can acquire the user's image and determine whether the user has clothes in their hands based on the image, thereby determining the user's purpose.

[0133] If no user enters the preset range, it means that no user wants to wash clothes. There is no need to determine the washing program based on the user's image. Therefore, the image acquisition module will not be started, and the system will continue to detect whether a user has entered the preset range until a user is detected. At this time, only the human body detection module is running, which further reduces energy consumption.

[0134] It should be noted that in the above process, steps S020 and S030 are not sequential but parallel, and are only related to the judgment result of whether a user has entered the preset range. The corresponding steps can be executed according to different judgment results.

[0135] The following reference Figure 7 The control method of the present invention is further described below. Figure 7 This is the flow chart of the control method of the present invention. Figure 4 .

[0136] like Figure 7 As shown, the control method also includes:

[0137] S1101, Washing and conditioning completed;

[0138] S1102. After a third preset time interval, determine whether the clothing has been taken out; if not, proceed to step S1103; if yes, proceed to step S1104.

[0139] S1103. Send clothing pickup reminders selectively based on age;

[0140] S1104, Do not send a notification message.

[0141] In step S1101, the washing and care of the washing machine can be completed by the completion of other washing and care programs such as the standard program, quick wash program, wool program, children's program with sterilization function, shirt program with shaking function, and home textile program with drying function, but the washing machine has not yet finished running.

[0142] In step S1102, after the washing machine has finished washing and after a third preset time interval, such as 20 minutes, 30 minutes or 40 minutes, it is determined whether the clothes have been taken out, so as to give the user enough time to take the clothes out of the washing machine.

[0143] Preferably, the specific method for determining whether the clothes have been taken out is as follows: determine whether the washing machine door has been opened; if the washing machine door has been opened, then it is determined that the clothes have been taken out; if the washing machine door has not been opened, then it is determined that the clothes have not been taken out.

[0144] Alternatively, the current weight of the clothing can be obtained, and it can be determined whether the current weight of the clothing is less than the weight of the clothing obtained last time. The weight of the clothing obtained last time can be the existing weight obtained in step S700 or the current weight obtained in step S813, which can be determined based on whether the clothing in the user's hand has been added to the washing drum. If the current weight of the clothing is equal to the weight of the clothing obtained last time, it is determined that the clothing has not been removed. If the current weight of the clothing is less than the weight of the clothing obtained last time, it is determined that the clothing has been removed.

[0145] Of course, the methods for determining whether clothing has been removed are not limited to those listed above. Whatever method is used, as long as it can determine whether clothing has been removed, it is acceptable.

[0146] In step S1103, if the clothes are not retrieved, it may be because an older or younger user forgot to retrieve them, or a user of the middle age may be busy with other things and not have time to retrieve them. In this case, a retrieval reminder will be sent selectively based on age.

[0147] For example, if the user's age detected in step S821 is 15 years old, it means that the user is young, a teenager, and not very clear about the operation of the washing machine. The user may not know whether the clothes should be taken out, so a clothes removal reminder is sent.

[0148] For example, if the user's age detected in step S821 is 66 years old, it means that the user is relatively old, an elderly person, and has a greater tendency to forget. The user is very likely to forget to take out the clothes, so a reminder to take out the clothes is sent.

[0149] Furthermore, prompts can be sent to smart terminals in the form of text, images, animations, etc.; voice prompts can also be sent via the voice module.

[0150] For example, if the user's age detected in step S821 is 33 years old, it means that the user is of a suitable age and is a young person. The user may be busy with other things (such as cooking, working, etc.) and does not have time to take out the clothes. In this case, no prompt message is sent and the washing machine can be controlled to stop running.

[0151] In step S1104, if the clothes are removed, there is no need to send a prompt message; the washing machine can simply be controlled to stop running.

[0152] The following reference Figures 8 to 10 The present invention describes a control method for determining whether a user has clothing in their hands. Figure 8 This invention describes the flow of a control method for determining whether a user has clothing in their hands. Figure 1 ; Figure 9 This is a flowchart of the control method for calling a deep learning model to analyze images according to the present invention; Figure 10 This invention describes the flow of a control method for determining whether a user has clothing in their hands. Figure 2 .

[0153] like Figure 8 As shown, a deep learning model is pre-stored on the washing machine; in step S200, the step of "determining whether the user has clothes in their hands based on the image" specifically includes:

[0154] S210. Use a deep learning model to analyze the image;

[0155] S220. Based on the analysis results, determine whether the user has any clothing in their hands.

[0156] The deep learning model can employ the shuffleNetV2 and FCOS algorithms to analyze images and determine whether a user has clothing in their hands. Of course, the deep learning model can also use other algorithms such as CNN, ResNet18, ResNet101, DeeplabV3+, ResNeXt, and HRNet to analyze images and determine whether a user has clothing in their hands. Regardless of the algorithm used by the deep learning model, the specific method for determining whether a user has clothing should not constitute any limitation on this invention.

[0157] like Figure 9 As shown, step S210, "calling a deep learning model to analyze the image," specifically includes:

[0158] S211. Extract multiple sub-images from the image according to a preset method;

[0159] S212. Input all sub-images into the deep learning model;

[0160] S213. The deep learning model calculates and obtains the feature values ​​of the image based on all sub-images.

[0161] One preset method could be to set different sliding boxes, extract the image from each sliding box, and use the extracted image as a sub-image. Alternatively, a preset method could be to divide the user's image into N parts based on its size, such as 5, 10, 15, or 20 parts, where N is a positive integer, and extract the image from each part, using the extracted image as a sub-image. Of course, preset methods are not limited to those listed above; any method that allows for the extraction of multiple sub-images from the image is acceptable.

[0162] like Figure 10 As shown, step S220, "determining whether the user has clothing based on the analysis results," specifically includes:

[0163] S221. Determine whether the feature value is greater than the preset value; if yes, proceed to step S222; if no, proceed to step S223.

[0164] S222, Determines that the user has clothing in their possession;

[0165] S223, Determines that the user does not have any clothing in their possession.

[0166] In step S222, if the feature value is greater than the preset value, for example, if the preset value is 0.5 and the feature value calculated in step S213 is 0.95, which is greater than the preset value, it means that the user has clothes in his / her hand, and it is determined that the user has clothes in his / her hand.

[0167] In step S223, if the feature value is less than or equal to the preset value, for example, if the preset value is 0.5 and the feature value calculated in step S213 is 0.05, which is less than the preset value, it means that the user has no clothes in his / her hands, and it is determined that the user has no clothes in his / her hands.

[0168] It should be noted that the preset values ​​listed above are merely illustrative and not restrictive. Those skilled in the art can flexibly adjust and set the preset values ​​according to the accuracy of determining whether the user has clothing in their hands. For example, the preset value can also be 0.7, 0.8, 0.9 or 1. No matter how the preset value is set, as long as it can accurately determine whether the user has clothing in their hands, it is acceptable.

[0169] It should also be noted that in the above process, steps S222 and S223 are not sequential but parallel, and are only related to the judgment result of whether the feature value is greater than the preset value. The corresponding steps can be executed according to different judgment results.

[0170] Furthermore, in the above process, classification models, object detection models, and deep learning models are used to analyze the images to determine the user's age, identity, and whether they are carrying clothing. In practical applications, only one or two models can be used to analyze the images to determine the user's age, identity, and whether they are carrying clothing. Those skilled in the art can flexibly adjust and set these models according to actual usage needs.

[0171] The following reference Figure 11 This paper describes one possible control flow of the present invention. Figure 11 This is a logic diagram of the control method of the present invention. Figure 11 Taking the human body detection module as an infrared sensor and the image acquisition module as a camera as an example, the control method of the present invention will be further described.

[0172] like Figure 11 As shown, a possible complete flow of the control method of the present invention is as follows:

[0173] S1201, Turn on the infrared sensor;

[0174] S1202, The infrared sensor detects whether a user has entered the preset range; if yes, proceed to step S1203; if no, continue to proceed to step S1202 until the infrared sensor detects that a user has entered the preset range.

[0175] S1203. Start the camera and acquire the user's image using the camera;

[0176] S1204. Call the deep learning model to analyze the image;

[0177] S1205. Based on the analysis results, determine whether the user has clothing in their hands; if not, proceed to step S1206 and return to step S1202 until the infrared sensor detects again that a user has entered the preset range and the user has clothing in their hands; if yes, proceed to step S1207.

[0178] S1206. Turn off the camera;

[0179] S1207. Obtain the user's historical washing and care data, historical information of the clothes in the washing drum, and the current weather;

[0180] S1208. Determine the first preset weight m based on historical washing and care data, historical information, and current weather. 01 ;

[0181] After step S1208, step S1209 is executed;

[0182] S1209. Determine whether the existing weight m1 of the clothing in the garment processing tube has reached m 01 If yes, proceed to step S1210; otherwise, proceed to step S1215.

[0183] S1210. Determine the user's age A based on the user's image;

[0184] S1211, Compare A with the first preset age A 01 Second preset age A 02 A comparison is made; where the first preset age A 01 Less than the second preset age A 02 ;

[0185] If A < A 01 Then proceed to step S1212;

[0186] If A 01 ≤A≤A 02 Then proceed to step S1213;

[0187] If A 02 If <A, then proceed to step S1214;

[0188] S1212: Control the voice module to enter the voice mode, and give reminders and timely notifications to the elders about the status of the washing machine;

[0189] S1213. Control the voice module to enter the voice mode to provide timely laundry reminders;

[0190] S1214. Control the voice module to enter the voice mode to provide timely reminders for washing and picking up clothes;

[0191] S1215. After 1 minute, start the weighing module to weigh the clothes, obtain the current weight m2 of the clothes in the garment processing tube, and save m2.

[0192] S1216. Determine whether m2 has reached the second preset weight m. 02 If yes, proceed to step S1217; if no, proceed to step S1218; where m 02 >m 01 ;

[0193] S1217. Control the voice module to enter the pronunciation mode and provide an overweight reminder;

[0194] After steps S1212 to S1214 and step S1217, step S1218 is executed.

[0195] S1218, Control the voice module to enter voice recognition mode;

[0196] S1219. Within 5 minutes of the voice module entering the voice recognition mode, determine whether the voice module has received a valid control command; if not, proceed to step S1220; if yes, proceed to step S1221.

[0197] S1220: Control the voice module to exit voice recognition mode and enter energy-saving mode;

[0198] S1221. Make the washing machine operate according to the effective control command;

[0199] After the washing machine has finished washing and the interval is 30 minutes, proceed to step S1222;

[0200] S1222. Determine whether the clothing has been removed; if not, proceed to step S1223; if yes, proceed to step S1225.

[0201] S1223, Determine A 01 ≤A≤A 02 Is it true? If not, proceed to step S1224; if yes, proceed to step S1225.

[0202] S1224. Send a reminder to the smart terminal to pick up clothes;

[0203] S1225, Do not send a notification message.

[0204] It should be noted that the above embodiments are merely preferred embodiments of the present invention, used only to illustrate the principle of the method of the present invention, and are not intended to limit the scope of protection of the present invention. In practical applications, those skilled in the art can allocate the above functions to different steps as needed, that is, further decompose or combine the steps in the embodiments of the present invention. For example, the steps in the above embodiments can be combined into one step, or further divided into multiple sub-steps to complete all or part of the functions described above. The names of the steps involved in the embodiments of the present invention are merely for distinguishing the various steps and are not considered as limitations on the present invention.

[0205] The technical solution of the present invention has been described above with reference to the preferred embodiments shown in the accompanying drawings. However, it will be readily understood by those skilled in the art that the scope of protection of the present invention is obviously not limited to these specific embodiments. Without departing from the principles of the present invention, those skilled in the art can make equivalent changes or substitutions to the relevant technical features, and the technical solutions after such changes or substitutions will all fall within the scope of protection of the present invention.

Claims

1. A control method for a garment processing device, characterized in that, The clothing processing device includes a clothing processing drum, an image acquisition module, a voice module, and a weighing module. The image acquisition module can acquire the user's image and determine whether the user has clothing in their hands based on the image. The control method includes the following steps: If the system detects that a user has clothes in their hands, it retrieves the user's historical washing and care data. Obtain historical information about the clothing inside the clothing processing drum; Get the current weather; The first preset weight is determined based on the historical washing and care data, the historical information, and the current weather. Determine whether the existing weight of the clothing in the garment processing tube has reached the first preset weight; Based on the judgment result, the voice module can be selectively activated to provide voice prompts, or the weighing module can be activated to weigh the clothing. The step of "selectively activating the voice module to provide a voice prompt or activating the weighing module to weigh the clothing based on the judgment result" specifically includes: If the existing weight reaches the first preset weight, the voice module is activated to provide a voice reminder, so as to prevent the user from adding more clothes, thus achieving the purpose of activating the voice module without being noticed.

2. The control method according to claim 1, characterized in that, The steps for "activating the voice module to provide voice reminders" specifically include: Get the user's age; The age is compared with a first preset age and a second preset age, respectively; wherein the first preset age is less than the second preset age; Based on the comparison results, the voice module sends different voice reminder messages.

3. The control method according to claim 1, characterized in that, The step of "selectively activating the voice module to provide voice prompts or activating the weighing module to weigh the clothing based on the judgment result" further includes: If the existing weight does not reach the first preset weight, the weighing module will be activated to weigh the clothing after a first preset time. Obtain the current weight of the garment in the garment processing tube and save the current weight; Determine whether the current weight has reached a second preset weight, wherein the second preset weight is greater than the first preset weight; Based on the judgment result, the voice module is selectively activated to provide voice reminders.

4. The control method according to claim 3, characterized in that, The step of "selectively activating the voice module to provide voice reminders based on the judgment result" specifically includes: If the current weight reaches the second preset weight, the voice module is activated to provide an overweight reminder.

5. The control method according to claim 4, characterized in that, The voice module has a pronunciation mode and a sound recognition mode; The steps for "starting the voice module" specifically include: Control the voice module to enter the pronunciation mode.

6. The control method according to claim 5, characterized in that, After "controlling the voice module to enter the pronunciation mode", or when it is determined that the current weight has not reached the second preset weight, the control method further includes: Control the voice module to enter the voice recognition mode.

7. The control method according to claim 6, characterized in that, The voice module also has an energy-saving mode; the control method further includes: Within a second preset time period after the voice module enters the voice recognition mode, it is determined whether the voice module has received a valid control command; If the voice module does not receive the valid control command, then the voice module is controlled to exit the voice recognition mode and enter the energy-saving mode; and / or If the voice module receives the valid control command, it causes the clothing processing device to operate according to the valid control command; The effective control commands include at least the start washing command, stop washing command, power on command, power off command, standby command, and hibernation command.

8. The control method according to claim 1, characterized in that, The clothing processing equipment also includes a human body detection module; Before "acquiring the user's historical hair care data", the control method further includes: The human detection module detects whether a user has entered the preset range. If a user enters the preset range, the image acquisition module is activated; The user's image is acquired through the image acquisition module; Based on the image, determine whether the user has clothing in their hands; If the user has clothing in hand, then the operation of retrieving the historical washing and care data is performed; and / or If the user does not have any clothing, the image acquisition module will be turned off.

9. The control method according to claim 2, characterized in that, The control method further includes: After the garment processing equipment has finished washing and after a third preset time interval, it is determined whether the garment has been removed. If it is determined that the clothing has not been retrieved, a clothing retrieval reminder will be selectively sent based on the stated age.

Images