Clothes processing equipment, and control method, equipment and system of smart home system

Abstract

The invention relates to the technical field of smart home, in particular to a clothes processing device, a control method of a smart home system, a device and a system, and aims to solve the problem that a washing program of a current clothes processing device needs to be manually set by a user according to clothes to be washed. In order to achieve the purpose, the method comprises the steps that the category of a target object in an image is obtained based on analysis of the collected image within the preset range away from the clothes processing equipment, and then the clothes processing equipment is controlled to execute corresponding operation, for example, the clothes processing equipment is controlled to set a currently recommended washing program; according to the application of the method, the clothes processing equipment is controlled in the intelligent home system, so that the intelligent function of the clothes processing equipment better meets the use requirement of a user, and more convenient, time-saving and labor-saving experience is brought to the user.

Description

Technical Field

[0001] The present invention relates to the field of smart home, and specifically provides a clothing processing device, a control method and device, and a system for a smart home system. Background Art

[0002] With the continuous development of smart home devices and the continuous improvement of living standards, people's requirements for intelligence are getting higher and higher. Clothes processing equipment (such as washing machines) is an indispensable smart home device in daily life. Its usage rate is getting higher and higher, and users have higher and higher requirements for the convenience and intelligence of laundry. In the existing smart home application environment, there is no solution that can achieve precise control of clothing processing equipment based on the surrounding environment of the clothing processing equipment. The control of clothing processing equipment is mostly based on user selection or factory settings. This control method is relatively passive. On the one hand, the user experience is not good, and on the other hand, it is impossible to control the clothing processing equipment to make real-time safety settings according to environmental changes. If the advantages of the smart home system can be brought into play and the clothing processing equipment can be intelligently controlled based on the environment to perform corresponding operations, this will make the intelligent functions of the clothing processing equipment more in line with the user's usage needs.

[0003] Therefore, there is a need in the art for a solution that can realize intelligent control of a clothing processing device in a smart home system and intelligent control of the entire smart home system to solve the above problems. Summary of the invention

[0004] In order to overcome the above-mentioned defects, the present invention proposes a control scheme for a clothing processing device and a smart home system to solve or at least partially solve the technical problem of how to more accurately and intelligently control the clothing processing device and the smart home system in the smart home system.

[0005] In a first aspect, the present invention provides a method for controlling a laundry processing device, comprising:

[0006] Acquire an image within a preset range from the clothing processing device;

[0007] Analyzing the image to obtain the category of the target object in the image;

[0008] controlling the laundry processing device to perform a corresponding operation based on the category of the target object;

[0009] The categories of the target objects include at least one of objects to be washed, objects commonly used by users, and objects for safety warnings.

[0010] The above-mentioned obtaining of images within a preset range from the clothing processing device includes: obtaining images within a preset range from the clothing processing device collected by the clothing processing device itself, and / or obtaining images within a preset range from the clothing processing device collected by a smart home device that interacts with the clothing processing device.

[0011] The above-mentioned analyzing the image to obtain the category of the target object in the image includes:

[0012] Analyzing the image collected by the smart home device to obtain a first analysis result, and / or analyzing the image collected by the clothing processing device itself to obtain a second analysis result;

[0013] The category of the target object in the image is determined based on the first analysis result and / or the second analysis result.

[0014] Preferably, analyzing the image to obtain the category of the target object in the image specifically includes: if the image contains a preset user gesture, the category of the target object is an object to be washed;

[0015] If the image does not contain a preset user posture but contains character features of a common user, the category of the target object is a common user object;

[0016] If the image does not contain the preset user posture but contains the character features of a child or the living features of a pet, the category of the target object is a safety warning object.

[0017] Correspondingly, if the category of the target object is an object to be washed, the performing of the corresponding operation includes extracting feature data of the object to be washed, and setting a currently recommended washing program according to the feature data;

[0018] If the category of the target object is a common user object, the performing of the corresponding operation includes obtaining a common washing program of the common user and setting it as the currently recommended washing program;

[0019] If the category of the target object is a safety warning object, the performing of the corresponding operation includes setting the machine door lock to a locked state, and / or turning on the child lock function, and / or issuing a warning message.

[0020] In a second aspect, the present invention provides a smart home device, comprising a control device, the control device comprising a processor and a storage device, the storage device being suitable for storing a plurality of program codes, the program codes being suitable for being loaded and run by the processor to execute the method described in any one of the technical solutions of the above-mentioned control method of the clothing processing device.

[0021] In a third aspect, the present invention provides a server comprising a processor and a storage device, wherein the storage device is suitable for storing multiple program codes, and the program codes are suitable for being loaded and run by the processor to execute the method described in any one of the technical solutions of the above-mentioned clothing processing device control method.

[0022] In a fourth aspect, the present invention provides a control method for a smart home system, the system comprising a clothing processing device and a terminal device for information interaction with the clothing processing device, the terminal device comprising a smart home device, or a smart home device and a server, the method comprising:

[0023] The smart home device acquires a first image within a preset range from the laundry processing device, and sends the first image to the laundry processing device and / or a server; and / or the laundry processing device acquires a second image within a preset range from the laundry processing device;

[0024] The clothes processing device or the server analyzes the first image and / or the second image to obtain the category of the target object in the first image and / or the second image, and controls the clothes processing device to perform corresponding operations based on the category of the target object;

[0025] The categories of the target objects include at least one of objects to be washed, objects commonly used by users, and objects for safety warnings.

[0026] In a fifth aspect, the present invention provides a smart home system, the system comprising a clothes processing device and a terminal device for information interaction with the clothes processing device, the terminal device comprising a smart home device, or a smart home device and a server;

[0027] The smart home device is configured to acquire a first image within a preset range from the laundry processing device, and send the first image to the laundry processing device and / or the server;

[0028] The laundry processing device is configured to obtain a second image within a preset range of the laundry processing device, and / or analyze the first image and / or the second image to obtain a category of a target object in the first image and / or the second image, and control the laundry processing device to perform a corresponding operation based on the category of the target object;

[0029] Alternatively, the server is configured to analyze the first image and / or the second image to obtain the category of the target object in the first image and / or the second image, and control the clothing processing device to perform corresponding operations based on the category of the target object;

[0030] The categories of the target objects include at least one of objects to be washed, objects commonly used by users, and objects for safety warnings.

[0031] In a sixth aspect, the present invention provides a computer-readable storage medium storing a plurality of program codes, characterized in that the program codes are suitable for being loaded and run by a processor to execute the method described in any one of the technical solutions of the control method of the above-mentioned clothing processing device or the control method of the above-mentioned smart home system.

[0032] The above one or more technical solutions of the present invention have at least one or more of the following beneficial effects:

[0033] In the technical solution of the present invention, the clothing processing device is controlled to perform corresponding operations according to the category of the target object identified in the collected image within the preset range of the clothing processing device, which can more accurately control the clothing processing device and make the intelligent functions of the clothing processing device more in line with the user's usage needs, bringing users a more convenient, time-saving and labor-saving experience. Furthermore, by controlling the clothing processing device to set the currently recommended washing program for the user based on the collected image, the user saves the operation of manually setting the washing program according to the characteristics of the laundry to be washed. When the collected image recognizes that a child or pet is approaching, the clothing processing device is controlled to set the machine door lock to a locked state, and a warning message can be sent to the user, making the use of the clothing processing device more intelligent while ensuring safe and reliable use. BRIEF DESCRIPTION OF THE DRAWINGS

[0034] The disclosure of the present invention will become more easily understood with reference to the accompanying drawings. It is easy for those skilled in the art to understand that these drawings are only for illustrative purposes and are not intended to limit the scope of protection of the present invention. In addition, similar numbers in the figures are used to represent similar components, among which:

[0035] Figure 1 is a flow chart of a control method for a clothes processing device according to an embodiment of the present invention;

[0036] Figure 2 is a schematic flow chart of main steps of a control method for a clothes processing device according to another embodiment of the present invention;

[0037] Figure 3 is a schematic diagram of a main structural block diagram of a control device according to an embodiment of the present invention;

[0038] Figure 4 is a schematic diagram of a main structural block diagram of a smart home system according to an embodiment of the present invention;

[0039] Figure 51 is a flow chart of a control method for a smart home system according to an embodiment of the present invention. DETAILED DESCRIPTION

[0040] Some embodiments of the present invention are described below with reference to the accompanying drawings. It should be understood by those skilled in the art that these embodiments are only used to explain the technical principles of the present invention and are not intended to limit the protection scope of the present invention.

[0041] In the description of the present invention, "module" and "processor" may include hardware, software or a combination of the two. A module may include hardware circuits, various suitable sensors, communication ports, and memories, and may also include software parts, such as program codes, or a combination of software and hardware. The processor may be a central processing unit, a microprocessor, an image processor, a digital signal processor, or any other suitable processor. The processor has data and / or signal processing functions. The processor may be implemented in software, hardware, or a combination of the two. Non-temporary computer-readable storage media include any suitable medium that can store program codes, such as a magnetic disk, a hard disk, an optical disk, a flash memory, a read-only memory, a random access memory, and the like. The term "A and / or B" means all possible combinations of A and B, such as only A, only B, or A and B. The term "at least one A or B" or "at least one of A and B" has a similar meaning to "A and / or B", and may include only A, only B, or A and B. The singular terms "one" and "the" may also include plural forms.

[0042] Example 1

[0043] See attached Figure 1 , Figure 1: is a flow chart of the main steps of the control method of a clothing processing device according to an embodiment of the present invention. The control method of the clothing processing device in the embodiment of the present invention can be applied to any application scenario of a smart home system that can perform image acquisition, wherein the smart home system includes a clothing processing device and a smart home device that can exchange information with the clothing processing device, wherein the smart home device can be an intelligent robot, such as a sweeping robot, or other smart home devices with image acquisition functions. In this application scenario, the steps involved in the control method of the clothing processing device can be executed by a single subject, such as: a clothing processing device, a smart home device that exchanges information with the clothing processing device, or a server. Specifically, the clothing processing device may directly collect and / or obtain images within a preset range of the clothing processing device collected by a smart home device that interacts with the clothing processing device, and then the clothing processing device analyzes the images and controls the clothing processing device to perform corresponding operations based on the analysis results; or the smart home device that interacts with the clothing processing device may directly collect images within a preset range of the clothing processing device and / or obtain images within a preset range of the clothing processing device collected by the clothing processing device itself, and analyze them, and control the clothing processing device to perform corresponding operations based on the analysis results; or the server may obtain images collected by the clothing processing device and / or the smart home device that interacts with the clothing processing device, analyze the images, and then control the clothing processing device to perform corresponding operations.

[0044] In this application scenario, the control steps involved in the control method for the clothing processing device can also be respectively executed by the clothing processing device and multiple subjects such as the smart home device and / or the server, and then the control of the clothing processing device is realized through information interaction between the multiple subjects. Specifically, the smart home device can obtain a first image within a preset range of the clothing processing device, and send the first image to the clothing processing device and / or the server, the clothing processing device or the server analyzes the first image to obtain the category of the target object in the first image, and controls the clothing processing device to perform a corresponding operation based on the category of the target object; the clothing processing device can also obtain a second image within a preset range of the clothing processing device, the server analyzes the second image to obtain the category of the target object in the second image, and controls the clothing processing device to perform a corresponding operation based on the category of the target object; the smart home device can also obtain a first image within a preset range of the clothing processing device and send the first image to the clothing processing device and / or the server, the clothing processing device obtains a second image within a preset range of the clothing processing device, the clothing processing device or the server analyzes the first image and the second image to obtain the category of the target object, and controls the clothing processing device to perform a corresponding operation based on the category of the target object.

[0045] The following is combined with Figure 1 , and further elaborate on the specific control steps. Figure 1 The implementation of the method shown mainly includes the following steps S101 to S103.

[0046] Step S101: acquiring an image within a preset range from a clothes processing device;

[0047] In this embodiment, this step includes acquiring an image within a preset range from the clothing processing device collected by the clothing processing device itself, and / or acquiring an image within a preset range from the clothing processing device collected by a smart home device that interacts with the clothing processing device. In this embodiment, the image within a preset range from the clothing processing device generally refers to an image within a certain distance range directly in front of the clothing processing device. For example, the clothing processing device itself has an image acquisition function, and an image collector is installed directly in front of the clothing processing device body, and the image acquisition range of the image collector is pre-set to be an image less than two meters from directly in front of the clothing processing device.

[0048] For another example, another smart home device for capturing images is a movable smart robot that can interact with a clothing processing device. The range of images around the clothing processing device that the smart robot needs to capture is set in advance, for example, it is set to only capture images within three meters directly in front of the clothing processing device.

[0049] Furthermore, the clothes processing device or another smart home device that has collected the image can also send the collected image to a server that can exchange information with it. In the smart home system, the information exchange method between the clothes processing device and another smart home device can be wireless networking or Bluetooth pairing. As long as it is a method that can realize information transmission in the prior art, it will not be repeated here.

[0050] Step S102: analyzing the image to obtain the category of the target object in the image, wherein the category of the target object includes at least one of an object to be washed, an object commonly used by users, and a safety warning object;

[0051] In one implementation, step S102 may specifically be that the clothing processing device analyzes an image obtained from another smart home device or an image obtained from a server to obtain a category of a target object in the image.

[0052] In one embodiment, step S102 may be specifically as follows: the clothing processing device analyzes the image obtained from another smart home device or server to obtain a first analysis result, the clothing processing device analyzes the image collected by itself to obtain a second analysis result, and determines the category of the target object in the image by combining the first analysis result and / or the second analysis result.

[0053] In this embodiment, analyzing the image to obtain the category of the target object specifically includes: analyzing the image to determine whether it contains a preset user gesture, and if so, determining that the image contains the object to be washed, otherwise determining that the image does not contain the object to be washed.

[0054] If the image contains a preset user posture, the category of the target object is an object to be washed;

[0055] If the image does not contain a preset user posture but contains the character features of a common user, the category of the target object is a common user object;

[0056] If the image does not contain the preset user posture but contains the character features of a child or the living features of a pet, the category of the target object is a safety warning object.

[0057] In one embodiment, the preset user posture refers to any posture that can be identified as the user preparing to put the clothes to be washed into the clothes processing device. For example, the preset user posture can specifically be the user holding clothes and walking towards the clothes processing device, or the user carrying a dirty clothes basket and walking towards the clothes processing device, or the user putting clothes into the clothes processing device, etc. As long as the user posture can identify the user's washing intention, it will not be repeated here.

[0058] Furthermore, if the image does not contain the object to be washed but the image contains human features, it is determined whether the user is a frequent user based on the human features. If so, the frequent washing program of the frequent user is obtained and set as the currently recommended washing program; otherwise, the user is prompted to manually select a washing program and set it as the currently recommended washing program.

[0059] In this embodiment, the character features may be facial features, height features, body features, etc. In actual applications, due to different ranges of the images collected around the clothing processing device, the collected images may contain a human head from which facial features or height features can be extracted, or may not contain a face and only body features can be extracted, such as leg or foot features. Judging whether a user is a frequent user based on the character features may specifically include comparing the character features with feature data of a pre-set frequent user, and identifying whether the user is a frequent user based on the comparison results. The clothing processing device may also obtain the frequent washing program corresponding to the frequent user from the stored association table based on the determined frequent user, and set the corresponding frequent washing program as the currently recommended washing program.

[0060] If the image does not contain the object to be washed but contains human features, it can also include safety detection for children: determine whether the user is a child based on the human features, and if so, set the machine door lock to a locked state. For smart clothing processing equipment, the child lock function can also be turned on at the same time, and a warning message can be issued to prevent accidental touch and danger.

[0061] Specifically, when the character features include facial features, the user's age can be identified based on the facial features to determine whether the user's age is less than a preset age threshold. If so, the user is a child, otherwise, the user is not a child;

[0062] Specifically, when the character feature includes a height feature, the user's height can be determined based on the height feature to determine whether the user's height is less than a preset height threshold. If so, the user is a child, otherwise, the user is not a child.

[0063] If the image does not contain the object to be washed, it may also include determining whether the image contains pet living features, and if so, the category of the target object is a safety warning object.

[0064] Step S103: controlling the laundry processing device to perform corresponding operations based on the category of the target object.

[0065] In this embodiment, if the category of the target object is an object to be washed, the performing of the corresponding operation includes extracting feature data of the object to be washed, and setting a currently recommended washing program according to the feature data;

[0066] If the category of the target object is a common user object, the performing of the corresponding operation includes obtaining a common washing program of the common user and setting it as the currently recommended washing program;

[0067] If the category of the target object is a safety warning object, the performing of the corresponding operation includes setting the machine door lock to a locked state, and / or turning on the child lock function, and / or issuing a warning message.

[0068] The characteristic data of the object to be washed include surface cleanliness, color, and material.

[0069] In one embodiment, after extracting the characteristic data of the objects to be washed, it also includes judging whether there are clothes that are not suitable for mixed washing or machine washing based on the extracted characteristic data of the objects to be washed, and if so, reminding the user that the clothes need to be washed separately; if not, further adaptively selecting a corresponding washing program based on the characteristic data, and setting the selected washing program as the currently recommended washing program.

[0070] For example, if the colors of some clothes are not suitable for mixed washing (such as light and dark colors cannot be mixed), or the materials of some clothes are not suitable for machine washing, the clothes processing equipment can be linked to control the intelligent robot to issue a reminder to the user. The method of this embodiment can receive washing prompt information such as whether the clothes can be mixed or machine washed before the user puts the clothes into the barrel of the clothes processing equipment, and can classify or otherwise process the clothes before putting them into the barrel. Compared with the prior art, which generally collects images of the clothes in the barrel for identification and processing and issues prompts, the present invention can provide users with a more convenient user experience.

[0071] In this embodiment, based on images collected by the clothing processing device itself or by another smart home device within a preset range from the clothing processing device, the clothing processing device is controlled to set a currently recommended washing program. When the clothing processing device detects an operation instruction, it runs according to the currently recommended washing program that has been set. The application of this method starts image detection and analysis when the user is ready to put the laundry into the clothing processing device, and then controls the clothing processing device to set the currently recommended washing program. When the user runs the laundry program, it runs directly according to the set recommended washing program, so that the control and use of the clothing processing device brings a more convenient, time-saving and labor-saving experience to the user.

[0072] It should be pointed out that although the various steps in the above embodiments are described in a specific order, those skilled in the art can understand that in order to achieve the effects of the present invention, different steps do not have to be performed in such an order. They can be performed simultaneously (in parallel) or in other orders. These changes are within the scope of protection of the present invention.

[0073] Example 2

[0074] Taking an intelligent robot as an example, an application scenario of the present invention is described below, and the application scenario specifically involves the linkage between the intelligent robot and the intelligent washing machine. Figure 2 As shown, the control method of this embodiment specifically involves the linkage control of an intelligent robot and a washing machine. First, the intelligent robot or the washing machine may collect images within a preset range from the washing machine. Second, the intelligent robot may analyze the collected images, or the intelligent robot may send the collected images to the washing machine for analysis, or the washing machine may analyze the images collected by itself at the same time, or the collected images may be sent to a server for analysis. Finally, the intelligent robot or the server may control the washing machine to perform corresponding operations according to the analysis results, or the washing machine may perform corresponding operations according to the analysis results.

[0075] In this embodiment, the image within the preset range from the washing machine can also be referred to as the surrounding image of the washing machine. Figure 2 A control method for a washing machine is provided, and its specific execution steps are described as follows:

[0076] Step 101: Analyze the acquired surrounding images to obtain image recognition results;

[0077] In one embodiment, this step specifically includes the washing machine obtaining a surrounding image of the washing machine collected by another smart home device, or the washing machine obtaining the surrounding image from a server, and analyzing the obtained surrounding image to obtain an image recognition result.

[0078] In one embodiment, this step specifically includes, on the one hand, the washing machine obtains the surrounding image of the washing machine collected by another smart home device or obtains the surrounding image from the server, and the washing machine analyzes the obtained surrounding image to obtain a first analysis result, and on the other hand, the washing machine analyzes the surrounding image collected by itself to obtain a second analysis result, and combines the first analysis result and / or the second analysis result to determine the image recognition result and the category of the target object in the image. For example, according to the actual test situation, it can be set that when the first analysis result is consistent with the second analysis result, the first analysis result or the second analysis result is directly used as the image recognition result, and when the first analysis result is inconsistent with the second analysis result, the second analysis result is used as the image recognition result.

[0079] Step 102: determine whether the image recognition result contains the object to be washed, if yes, execute step 103, otherwise execute step 104;

[0080] In one embodiment, whether the image recognition result includes the object to be washed is determined based on a preset user posture. Specifically, the surrounding image is analyzed to determine whether it includes the preset user posture. If so, it is determined that the image recognition result includes the object to be washed. Otherwise, it is determined that the image recognition result does not include the object to be washed.

[0081] The preset user posture is specifically that the user carries clothes and walks towards the washing machine.

[0082] Step 103: extracting characteristic data of the object to be washed, setting a currently recommended washing program according to the characteristic data, and ending;

[0083] In this embodiment, the characteristic data of the object to be washed includes the surface cleanliness of the clothes, the color, material and type of the clothes. For example, if the material and type of the clothes indicate that they include down clothes, the down washing program is set as the currently recommended washing program.

[0084] Step 104: Determine whether the image recognition result contains human features, if yes, execute step 105, otherwise execute step 106;

[0085] In this embodiment, the character features may be facial features, height features, body part features, etc.

[0086] Step 105: Determine whether the user is a child, if yes, execute step 107, otherwise execute step 108;

[0087] In this embodiment, whether the user is a child may be determined based on facial features or height features.

[0088] Step 106: Determine whether the image recognition result is a pet, if yes, execute step 107, otherwise, no response, end;

[0089] In this embodiment, whether it is a pet can be determined based on the pet's living body characteristics, or the image recognition result can be compared with a preset pet image to determine whether it is a pet.

[0090] Step 107: Set the machine door lock to a locked state, and send a warning message to the user, and then end;

[0091] In this embodiment, when the image recognition result identifies a child or a pet, this step will be executed, the machine door lock of the washing machine will be set to a locked state, and the child lock function can also be turned on, and a warning message will be sent to the user, so as to prevent the danger of accidental touch through multiple safety measures.

[0092] Step 108: Determine whether the user is a frequent user, if yes, execute step 109, otherwise execute step 110;

[0093] In this embodiment, this step may specifically be to compare the character features with the feature data of pre-set common users, and identify whether the person is a common user based on the comparison result.

[0094] Step 109: Obtain the frequently used washing program of the frequently used user and set it as the currently recommended washing program, and then end.

[0095] Step 110: Prompt the user to manually select a washing program and set it as the currently recommended washing program, and then end.

[0096] In this embodiment, the category of the target object in the surrounding image can be determined based on the image recognition result. Specifically, if the image recognition result is that it contains an object to be washed, then the category of the target object is an object to be washed; if the image recognition result is that it contains the character features of a common user, then the category of the target object is a common user object; if the image recognition result is that it contains the character features of a child or the living features of a pet, then the category of the target object is a safety warning object.

[0097] Example 3

[0098] The present invention also provides a smart home device, for example, the smart home device may be a clothing processing device, a smart robot, etc. in a smart home system, and the smart home device includes a control device to implement the control method of the above method embodiment. Figure 3 As shown, the control device included in the smart home device provided in this embodiment specifically includes the following modules:

[0099] An image acquisition module 201 is used to acquire an image within a preset range from the laundry processing device;

[0100] The image analysis module 202 is used to analyze the acquired image to obtain the category of the target object in the image; the category of the target object includes at least one of an object to be washed, a commonly used object, and a safety warning object.

[0101] The control module 203 is used to control the clothing processing device to perform corresponding operations based on the category of the target object.

[0102] Furthermore, when the smart home device of this embodiment is specifically a washing machine, the washing machine may also include an image acquisition module for acquiring images within a preset range from the washing machine. Double detection of images is achieved through the images acquired by the image acquisition module of the washing machine itself and the images acquired by the image acquisition module, thereby achieving the purpose of improving image recognition accuracy, and then accurately controlling the washing machine to perform program settings.

[0103] The control device in the embodiment of the present invention mainly includes an image acquisition module 201, an image analysis module 202 and a control module 203. In some embodiments, one or more of the image acquisition module 201, the image analysis module 202 and the control module 203 can be combined into one module. In one implementation, the description of the specific functions implemented by each module can be referred to the description of steps S101 to S103.

[0104] The control device is used to execute Figure 1 or Figure 2 The control method embodiments shown in the figure are similar in their technical principles, technical problems solved and technical effects produced. Those skilled in the art can clearly understand that for the convenience and brevity of description, the specific working process and related instructions of the device can refer to the contents described in the method embodiments and will not be repeated here.

[0105] Example 4

[0106] The present invention also provides a smart home system and a control method thereof, wherein the smart home system is Figure 4 As shown, it includes a clothing processing device 400 and a terminal device 300 for interacting with the clothing processing device, the terminal device 300 includes a smart home device 301, or a smart home device 301 and a server 302. The control method of the smart home system is as follows Figure 5 As shown, the following steps are included:

[0107] Step S500: the smart home device acquires a first image within a preset range from the clothes processing device, and sends the first image to the clothes processing device and / or the server; and / or the clothes processing device acquires a second image within a preset range from the clothes processing device;

[0108] Step S600: the clothes processing device or the server analyzes the first image and / or the second image to obtain the category of the target object in the first image and / or the second image, and controls the clothes processing device to perform corresponding operations based on the category of the target object;

[0109] The categories of the target objects include at least one of objects to be washed, objects commonly used by users, and objects for safety warnings.

[0110] In one embodiment, the smart home device 301 is configured to obtain a first image within a preset range from the laundry processing device, and send the first image to the laundry processing device 400 and / or the server 302;

[0111] The laundry processing device 400 is configured to acquire a second image within a preset range from the laundry processing device, and / or analyze the first image and / or the second image to obtain a category of a target object in the first image and / or the second image, and control the laundry processing device to perform a corresponding operation based on the category of the target object;

[0112] Alternatively, the server 302 is configured to analyze the first image and / or the second image to obtain the category of the target object in the first image and / or the second image, and control the clothing processing device to perform corresponding operations based on the category of the target object;

[0113] The categories of the target objects include at least one of objects to be washed, objects commonly used by users, and objects for safety warnings.

[0114] In one embodiment, the smart home device 301 or the clothing processing device 400 may also be configured to include the control device described in Example 3.

[0115] It is understood by those skilled in the art that the present invention implements all or part of the processes in the method of the above embodiment, and can also be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a computer-readable storage medium, and the computer program can implement the steps of the above-mentioned various method embodiments when executed by the processor. Among them, the computer program includes computer program code, and the computer program code can be in source code form, object code form, executable file or some intermediate form. The computer-readable storage medium may include: any entity or device, medium, U disk, mobile hard disk, disk, optical disk, computer memory, read-only memory, random access memory, electric carrier signal, telecommunication signal and software distribution medium that can carry the computer program code. It should be noted that the content contained in the computer-readable storage medium can be appropriately increased or decreased according to the requirements of legislation and patent practice in the jurisdiction. For example, in some jurisdictions, according to legislation and patent practice, computer-readable storage media do not include electric carrier signals and telecommunication signals.

[0116] Furthermore, the present invention also provides a smart home device, including a control device, the control device including a processor and a storage device, the storage device can be configured to store a program for executing the control method of the clothing processing device of the above method embodiment, and the processor can be configured to execute the program in the storage device, the program including but not limited to the program for executing the control method of the above method embodiment. The control device can be a control device device formed by various electronic devices.

[0117] Furthermore, the present invention also provides a server, including a processor and a storage device, wherein the storage device can be configured to store a program for executing the control method of the clothing processing device and the control method of the smart home system in the above-mentioned embodiments, and the processor can be configured to execute the program in the storage device, which includes but is not limited to the program for executing the control method in the above-mentioned embodiments.

[0118] Furthermore, the present invention also provides a computer-readable storage medium. In a computer-readable storage medium embodiment according to the present invention, the computer-readable storage medium can be configured to store a program for executing the control method of the clothing processing device and the control method of the smart home system in the above-mentioned embodiment, and the program can be loaded and run by the processor to implement the above-mentioned control method. For ease of explanation, only the parts related to the embodiment of the present invention are shown. For specific technical details not disclosed, please refer to the method part of the embodiment of the present invention. The computer-readable storage medium can be a storage device formed by various electronic devices. Optionally, the computer-readable storage medium in the embodiment of the present invention is a non-temporary computer-readable storage medium.

[0119] Further, it should be understood that since the setting of each module is only for illustrating the functional units of the device of the present invention, the physical devices corresponding to these modules may be the processor itself, or a part of the software in the processor, a part of the hardware, or a part of the combination of software and hardware. Therefore, the number of each module in the figure is only schematic.

[0120] Those skilled in the art will appreciate that the modules in the device can be adaptively split or merged. Such splitting or merging of specific modules will not cause the technical solution to deviate from the principle of the present invention, and therefore, the technical solutions after splitting or merging will fall within the protection scope of the present invention.

[0121] So far, the technical solutions of the present invention have been described in conjunction with the preferred embodiments shown in the accompanying drawings. However, it is easy for those skilled in the art to understand that the protection scope of the present invention is obviously not limited to these specific embodiments. Without departing from the principle of the present invention, those skilled in the art can make equivalent changes or substitutions to the relevant technical features, and the technical solutions after these changes or substitutions will fall within the protection scope of the present invention.

Claims

1. A control method for a clothes processing device, characterized in that: The method comprises: Acquire an image within a preset range from the clothing processing device; Analyzing the image to obtain the category of the target object in the image; controlling the laundry processing device to perform a corresponding operation based on the category of the target object; The categories of the target objects include at least one of objects to be washed, objects commonly used by users, and objects for safety warnings.

2. The control method according to claim 1, characterized in that: The acquiring of images within a preset range from the clothing processing device includes: acquiring images within a preset range from the clothing processing device collected by the clothing processing device itself, and / or acquiring images within a preset range from the clothing processing device collected by a smart home device that interacts with the clothing processing device.

3. The control method according to claim 2, characterized in that: The analyzing the image to obtain the category of the target object in the image comprises: Analyzing the image collected by the smart home device to obtain a first analysis result, and / or analyzing the image collected by the clothing processing device itself to obtain a second analysis result; The category of the target object in the image is determined based on the first analysis result and / or the second analysis result.

4. The control method according to claim 1, characterized in that: Analyzing the image to obtain the category of the target object in the image specifically includes: if the image contains a preset user gesture, the category of the target object is an object to be washed; If the image does not contain a preset user posture but contains the character features of a common user, the category of the target object is a common user object; If the image does not contain the preset user posture but contains the character features of a child or the living features of a pet, the category of the target object is a safety warning object.

5. The control method according to any one of claims 1 to 4, characterized in that: If the category of the target object is an object to be washed, the performing of the corresponding operation includes extracting feature data of the object to be washed and setting a currently recommended washing program according to the feature data; If the category of the target object is a common user object, the performing of the corresponding operation includes obtaining the common washing program of the common user and setting it as the currently recommended washing program; If the category of the target object is a safety warning object, the performing of the corresponding operation includes setting the machine door lock to a locked state, and / or turning on the child lock function, and / or issuing a warning message.

6. A smart home device, comprising a control device, the control device comprising a processor and a storage device, the storage device being suitable for storing a plurality of program codes, characterized in that: The program code is suitable for being loaded and run by the processor to execute the control method according to any one of claims 1 to 5.

7. A server comprising a processor and a storage device, wherein the storage device is suitable for storing a plurality of program codes, characterized in that: The program code is suitable for being loaded and run by the processor to execute the control method according to any one of claims 1 to 5.

8. A control method for a smart home system, the system comprising a clothes processing device and a terminal device for information exchange with the clothes processing device, the terminal device comprising a smart home device, or a smart home device and a server, characterized in that: The smart home device acquires a first image within a preset range from the laundry processing device, and sends the first image to the laundry processing device and / or a server; and / or the laundry processing device acquires a second image within a preset range from the laundry processing device; The clothes processing device or the server analyzes the first image and / or the second image to obtain the category of the target object in the first image and / or the second image, and controls the clothes processing device to perform corresponding operations based on the category of the target object; The categories of the target objects include at least one of objects to be washed, objects commonly used by users, and objects for safety warnings.

9. A smart home system, comprising a clothes processing device and a terminal device for information exchange with the clothes processing device, wherein the terminal device comprises a smart home device, or a smart home device and a server, characterized in that: The smart home device is configured to acquire a first image within a preset range from the laundry processing device, and send the first image to the laundry processing device and / or the server; The laundry processing device is configured to obtain a second image within a preset range of the laundry processing device, and / or analyze the first image and / or the second image to obtain a category of a target object in the first image and / or the second image, and control the laundry processing device to perform a corresponding operation based on the category of the target object; Alternatively, the server is configured to analyze the first image and / or the second image to obtain the category of the target object in the first image and / or the second image, and control the clothing processing device to perform corresponding operations based on the category of the target object; The categories of the target objects include at least one of objects to be washed, objects commonly used by users, and objects for safety warnings.

10. A computer-readable storage medium storing a plurality of program codes, characterized in that: The program code is suitable for being loaded and run by a processor to execute the control method according to any one of claims 1 to 5, or the control method according to claim 8.

Images