Steam care method, control device and clothing treatment equipment

Abstract

The present invention relates to a steam care method based on image recognition, which is used in a clothing treatment device. The steam care method includes: during the rotation of a clothing treatment drum, obtaining multiple clothing images at different times when the clothing treatment drum rotates one circle; processing the multiple clothing images using a pre-trained recognition model to identify the distribution status of the clothing in the multiple clothing images within a first preset area; and determining whether the current rotation speed of the clothing treatment drum has reached an ideal rotation speed for dispersing the clothing based on the distribution status of the clothing within the first preset area. The present invention determines whether the current rotation speed of the clothing treatment drum has reached an ideal rotation speed based on the distribution status of the clothing. During the rotation speed design stage, the present invention allows technicians to more clearly determine the rationality of the rotation speed design of the clothing treatment drum, and during the use stage, the user can adjust the rotation speed or automatically adjust the rotation speed to obtain a better steam care effect.

Description

Technical Field

[0001] The present invention relates to the technical field of clothing processing equipment, and in particular to a steam care method, a control device and clothing processing equipment. Background Art

[0002] Steam care technology uses high-temperature steam to clean and condition clothing. Its advantages lie in its ability to effectively clean clothing while preventing fading, preserving its original color and texture. It also effectively kills bacteria and removes stains, keeping clothes clean. Furthermore, steam care effectively prevents deformation, preserving the original shape of clothing.

[0003] During the steam care process of clothes, the set speed of the clothes treatment drum of the clothes treatment equipment does not match the weight of the clothes, and the clothes cannot be thrown into a state. Therefore, the set speed may be too fast, causing the clothes to stick to the drum, or the set speed may be too slow, causing the clothes to fall prematurely before reaching the top, affecting the steam care effect. Summary of the Invention

[0004] The present invention provides a steam care method, a control device and a clothing treatment device for a clothing treatment device, so as to at least solve the technical problem that the set speed of the clothing treatment drum in the current steam care process does not match the weight of the clothes, causing the clothes to stick to the wall or fall off prematurely.

[0005] A first aspect of the present invention provides a steam care method based on image recognition and a clothing treatment device, the steam care method comprising:

[0006] During the rotation of the laundry processing drum, a plurality of laundry images at different times are acquired when the laundry processing drum rotates one circle;

[0007] Processing the plurality of clothing images using a pre-trained recognition model to identify distribution states of clothing in the plurality of clothing images within a first preset area;

[0008] determining, based on the distribution state of the laundry in the first preset area, whether the current rotation speed of the laundry processing drum reaches an ideal rotation speed for causing the laundry to be in a scattered state;

[0009] The first preset area includes: four quadrants into which the cross section of the laundry treatment drum is divided by a two-dimensional coordinate system established with the horizontal center line of the cross section of the laundry treatment drum as the abscissa and the vertical center line as the ordinate;

[0010] The distribution status includes the distribution position and distribution area of ​​the clothes in the four quadrants.

[0011] In some embodiments, determining whether the current rotation speed of the laundry processing drum reaches an ideal rotation speed for causing the laundry to be in a scattered state based on the distribution state of the laundry in the first preset area includes:

[0012] determining whether the plurality of clothing images include a first clothing image, wherein clothing in the first clothing image is at least partially located in two upper quadrants of the four quadrant areas;

[0013] When the plurality of clothing images include the first clothing image, determining a first clothing area of ​​the clothing in each first clothing image within the two upper quadrants, and determining whether a current rotational speed of the clothing processing drum reaches the ideal rotational speed based on the first clothing area of ​​each first clothing image;

[0014] In a case where the plurality of laundry images do not include the first laundry image, it is determined that the current rotation speed of the laundry treating tub is lower than the ideal rotation speed.

[0015] In some embodiments, determining whether the current rotation speed of the laundry processing drum reaches the ideal rotation speed based on the first laundry area of ​​each first laundry image includes:

[0016] determining a first ratio of the first clothing area in each first clothing image to the total clothing area of ​​the four quadrants;

[0017] determining a second clothing area of ​​each first clothing image within a second preset area when the first ratio in at least one first clothing image is greater than or equal to a first set value, and determining whether a current rotational speed of the laundry processing drum reaches the ideal rotational speed based on the second clothing area of ​​each first clothing image;

[0018] When the first ratio in all first laundry images is less than a first set value, determining that the current rotation speed of the laundry processing tub is lower than the ideal rotation speed;

[0019] The center of the second preset area coincides with the center of the cross section of the laundry processing tub, and the area of ​​the second preset area is smaller than half of the cross section of the laundry processing tub.

[0020] In some embodiments, determining whether the current rotation speed of the laundry processing drum reaches the ideal rotation speed based on the second laundry area of ​​each first laundry image includes:

[0021] determining a second ratio of the second clothing area of ​​each first clothing image to the total area of ​​the second preset region;

[0022] determining that the current rotation speed of the laundry processing drum reaches the ideal rotation speed when the second ratio of at least one of the first laundry images is greater than or equal to a second set value;

[0023] When the second ratio of all first clothing images is less than the second set value, the distribution status of the remaining clothing outside the second preset area in each first clothing image is determined, and whether the current rotational speed of the clothing processing drum reaches the ideal rotational speed is determined based on the distribution status of the remaining clothing.

[0024] In some embodiments, determining whether the current rotation speed of the laundry processing drum reaches the ideal rotation speed according to the distribution state of the remaining laundry includes:

[0025] determining a third area of ​​the remaining clothes in the two right quadrants, a fourth area in the two left quadrants, and a total area of ​​the remaining clothes in each first clothing image;

[0026] The rotation direction of the laundry processing drum is determined, and whether the current rotation speed of the laundry processing drum reaches the ideal rotation speed is determined based on the rotation direction, the third area, the fourth area, and the total area of ​​the remaining laundry.

[0027] In some embodiments, determining whether the current rotation speed of the laundry processing drum reaches the ideal rotation speed based on the rotation direction, the third area, the fourth area, and the total area of ​​the remaining laundry includes:

[0028] When the laundry processing drum rotates in a clockwise direction, if the third area of ​​at least one of the first laundry images is larger than the fourth area, or a third ratio of the third area to the total area of ​​the remaining laundry is larger than a third set value, it is determined that the current rotational speed of the laundry processing drum is higher than the ideal rotational speed; if the fourth area of ​​all the first laundry images is larger than the third area, and the third ratio of the fourth area to the total area of ​​the remaining laundry is larger than a third set value, it is determined that the current rotational speed of the laundry processing drum is lower than the ideal rotational speed;

[0029] When the clothing processing drum rotates counterclockwise, if the fourth area of ​​at least one of the first clothing images is larger than the third area, or the third ratio of the fourth area to the total area of ​​the remaining clothing is larger than a third set value, it is determined that the current rotational speed of the clothing processing drum is higher than the ideal rotational speed; if the third area of ​​all of the first clothing images is larger than the fourth area, and the third ratio of the third area to the total area of ​​the remaining clothing is larger than a third set value, it is determined that the current rotational speed of the clothing processing drum is lower than the ideal rotational speed.

[0030] In some embodiments, after determining whether the current rotation speed of the laundry treatment drum reaches an ideal rotation speed for placing the laundry in a throwing state, the steam care method further comprises:

[0031] reducing the rotation speed of the laundry processing drum according to the current rotation speed of the laundry processing drum being higher than the ideal rotation speed;

[0032] increasing the rotation speed of the laundry processing drum according to the current rotation speed of the laundry processing drum being lower than the ideal rotation speed;

[0033] According to the current rotation speed of the laundry processing drum reaching the ideal rotation speed, the rotation speed of the laundry processing drum is maintained.

[0034] In some embodiments, the training process of the recognition model includes:

[0035] Acquire a training data set, wherein the training data set includes a plurality of clothing image samples in a clothing treatment drum, each clothing image sample having a state label for marking a distribution state of the clothing in the clothing treatment drum;

[0036] The initial recognition model is trained a preset number of times using the training data set, and after each training, the training results are compared with the state labels;

[0037] If the comparison result does not meet the preset training conditions, the model parameters of the initial recognition model are adjusted to obtain an updated initial recognition model, and the initial recognition model is trained again for a preset number of times using the training data set;

[0038] When the comparison result meets the preset training conditions or the number of training times reaches the preset number, the training of the initial recognition model is completed, and a recognition model is obtained that can output the distribution state of the clothes in the input image after learning based on the input image.

[0039] The second aspect of the present invention proposes a control device, which includes one or more processors and a non-transitory computer-readable storage medium storing program instructions. When the one or more processors execute the program instructions, the one or more processors are used to implement any image recognition-based steam care method proposed in the first aspect of this application.

[0040] The third aspect of the present invention proposes a clothing processing device, which operates according to any of the image recognition-based steam care methods proposed in the first aspect of the present application, or includes the control device proposed in the second aspect of the present application.

[0041] The technical solution of the present invention may include the following beneficial effects: the present invention analyzes multiple clothing images taken during a rotation cycle of the clothing treatment drum to determine the distribution status of the clothing in the multiple clothing images, and determines whether the clothing is in a wall-adhering state, a scattered state, or an early falling state during the current rotation cycle based on the clothing distribution status, and then determines whether the current rotation speed of the clothing treatment drum reaches the ideal speed based on different states. During the speed design stage, the present invention can provide technicians with a clearer determination of the rationality of the speed design of the clothing treatment drum, and during the use stage, the present invention can provide users with the ability to adjust the speed or automatically adjust the speed to obtain better steam care effects. BRIEF DESCRIPTION OF THE DRAWINGS

[0042] Figure 1 This is one of the control flow charts of steam care according to an exemplary embodiment.

[0043] Figure 2 FIG. 4 is a diagram showing the positional relationship between a first preset area and a second preset area according to an exemplary embodiment.

[0044] Figure 3 This is the second control flow chart of steam care according to an exemplary embodiment. DETAILED DESCRIPTION

[0045] In order to enable those skilled in the art to better understand the present invention, the following will clearly and completely describe the technical solutions in the embodiments of the present invention in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments in the present invention, all other embodiments obtained by ordinary technicians in this field without making creative efforts should fall within the scope of protection of this application.

[0046] It should be noted that the terms "first", "second", etc. in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects and are not necessarily used to describe a specific order or sequential order. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present application described herein can be implemented in a sequence other than those illustrated or described herein. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device comprising a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0047] According to an embodiment of the present application, an embodiment of a method for controlling the drum speed of a laundry appliance is provided. It should be noted that the steps shown in the flowchart of the accompanying drawings can be executed in a computer system such as a set of computer-executable instructions, and although a logical order is shown in the flowchart, in some cases, the steps shown or described can be executed in an order different from that shown here.

[0048] According to an exemplary embodiment, this embodiment proposes a steam care method based on image recognition, which is used for a clothing treatment device. The clothing treatment device may have only a steam care function, and may also have a clothing washing function and / or a clothing drying function. Figure 1 is one of the steam care flow charts shown according to an exemplary embodiment, referring to Figure 1 , the steam care method includes the following steps:

[0049] S11 . During the rotation of the laundry processing drum, a plurality of laundry images at different times are acquired when the laundry processing drum rotates one circle.

[0050] Specifically, the clothing processing device includes at least one camera device, and the at least one camera device is used to capture images of clothing in the clothing processing drum. There can be one camera device, and the shooting range of the camera device covers the inside of the clothing processing drum. There can be multiple cameras, and the sum of the shooting ranges of each camera device covers the drum. As for the position of the camera device, it can be set according to actual conditions and is not limited here. For example, at least one camera device is set at the door position of the clothing processing drum, and / or, is set on the rear wall of the clothing processing drum. During the steam care process, the clothing processing drum is first controlled to rotate at a preset speed. During the rotation of the clothing processing drum, multiple images of clothing at different times when the clothing processing drum rotates one circle are obtained in real time, so that the clothing images can be processed later, and the distribution state of clothing in the clothing processing drum during the rotation of the clothing processing drum is determined according to the processing results.

[0051] S12: Process the plurality of clothing images using a pre-trained recognition model to identify distribution states of the clothing in the plurality of clothing images within a first preset area.

[0052] Specifically, the recognition model is used to identify the state of clothing in the drum based on clothing images. The recognition model can be a Mobile-Unet recognition model, and of course, it can also be other recognition models. The first preset area includes four quadrants divided by a two-dimensional coordinate system using the horizontal center line of the clothing processing drum cross section as the horizontal coordinate and the vertical center line as the vertical coordinate. The distribution state includes the distribution position and distribution area of ​​the clothing in the four quadrants. By identifying the distribution state of clothing in multiple clothing images in the first preset area, it can be determined whether the clothing is in a scattered state, a wall-adhering state, or a prematurely falling state during one rotation of the clothing processing drum, so as to subsequently determine whether the current rotation speed of the clothing processing drum has reached the ideal rotation speed for the clothing processing drum.

[0053] S13. Determine, based on the distribution state of the clothes in the first preset area, whether the current rotation speed of the clothes processing drum reaches an ideal rotation speed for causing the clothes to be thrown into a state.

[0054] Specifically, during the rotation of the laundry treatment drum, if the speed reaches the ideal speed that matches the current laundry weight, the laundry will be in a scattered state within the laundry treatment drum; if the speed is higher than the ideal speed that matches the current laundry weight, the laundry will be in a wall-adhering state within the laundry treatment drum; if the speed is lower than the ideal speed that matches the current laundry weight, the laundry will not reach the top of the laundry treatment drum and will fall prematurely. The positions and distribution areas of the scattered, wall-adhering, and prematurely falling states are different in the four quadrants. Therefore, after determining the distribution state of the laundry in each clothing image in the four quadrants, the distribution position and distribution area of ​​the laundry in each image in the four quadrants are analyzed to determine whether the laundry is in a scattered state, wall-adhering state, or prematurely falling state, and further determine whether the current speed of the laundry treatment drum has reached the ideal speed. This allows technicians to more clearly determine the rationality of the speed design of the laundry treatment drum during the speed design stage, and allows users to adjust the speed during use, or the laundry treatment device can automatically adjust the speed of the laundry treatment drum to achieve a better steam care effect.

[0055] In some embodiments, determining whether the current rotational speed of the laundry processing drum has reached an ideal rotational speed for distributing the laundry based on the distribution of the laundry within a first preset area includes: first determining whether the plurality of laundry images includes a first laundry image, wherein the laundry in the first laundry image is at least partially located in two upper quadrants of four quadrants. If the plurality of laundry images includes the first laundry image, determining a first laundry area within the two upper quadrants of each of the first laundry images, and determining whether the current rotational speed of the laundry processing drum has reached the ideal rotational speed based on the first laundry area of ​​each of the first laundry images. If the plurality of laundry images does not include the first laundry image, determining that the current rotational speed of the laundry processing drum is lower than the ideal rotational speed.

[0056] Specifically, after acquiring multiple images of clothing during one rotation of the clothing processing drum, this embodiment first determines whether the multiple clothing images include the first image located in the two upper quadrants (i.e., the first quadrant and the second quadrant). If the first image is included, it indicates that the clothing may be in a scattered state, and the first clothing image is then taken out for further analysis. The first clothing image can be one or multiple images. When there is only one first clothing image, only this one first clothing image needs to be analyzed. When there are multiple first clothing images, multiple first clothing images need to be analyzed. Then, the area of ​​the first clothing located in the two upper quadrants in the first image is further used to confirm whether the clothing is in a scattered state. If the first image is not included in the multiple clothing images, it indicates that the clothing is not in a scattered state. At this time, the rotation speed is too low to move the clothing to the area where the two upper quadrants are located, and the current rotation speed of the clothing is less than the theoretical rotation speed.

[0057] In some embodiments, determining whether the current rotational speed of the laundry processing drum has reached the ideal rotational speed based on the first laundry area of ​​each first laundry image includes: determining a first ratio of the first laundry area in each first laundry image to the total laundry area of ​​the four quadrants. If the first ratio in at least one first laundry image is greater than or equal to a first set value, determining a second laundry area within a second preset area of ​​each first laundry image, and determining whether the current rotational speed of the laundry processing drum has reached the ideal rotational speed based on the second laundry area of ​​each first laundry image. If the first ratio in all first laundry images is less than the first set value, determining that the current rotational speed of the laundry processing drum is lower than the ideal rotational speed.

[0058] Specifically, first determine the first ratio of the first clothing area in each first clothing image to the total clothing area in the four quadrants. When the first ratio in at least one of the first clothing images is greater than or equal to the first set value, it means that during one rotation of the clothing processing drum, more clothing appears in the two upper quadrants, and the clothing may be in a scattered state. It is necessary to further confirm whether the clothing is in a scattered state through the second area in the second preset area of ​​multiple first clothing images. The center of the second preset area coincides with the center of the cross section of the clothing processing drum, and the area of ​​the second preset area is less than half of the cross section of the clothing processing drum. For example, Figure 2As shown, the second area is a circular area with the center of the cross section of the laundry treatment drum as the center, and the radius of the circular area is less than half of the radius of the cross section of the laundry treatment drum. When the first ratio in all the first clothing images is less than the first set value, it means that during one rotation of the laundry treatment drum, more clothes appear in the two lower quadrants (the third and fourth quadrants), which means that the clothes are not in a scattered state, the clothing speed is low, and most of the clothes cannot be moved to the area where the two upper quadrants are located. The current speed of the clothes is less than the theoretical speed. The range of the first set value is, for example, 1 / 2 to 2 / 3. For example, the first set value is 2 / 3.

[0059] In some embodiments, determining whether the current rotational speed of the laundry processing drum has reached the ideal rotational speed based on the second laundry area of ​​each first laundry image includes: determining a second ratio of the second laundry area of ​​each first laundry image to the total area of ​​a second preset area. If the second ratio of at least one first laundry image is greater than or equal to a second set value, determining that the current rotational speed of the laundry processing drum has reached the ideal rotational speed. If the second ratio of all first laundry images is less than the second set value, determining the distribution of remaining laundry outside the second preset area in each first laundry image, and determining whether the current rotational speed of the laundry processing drum has reached the ideal rotational speed based on the distribution of the remaining laundry.

[0060] Specifically, because the second area is located at the center of the cross-section of the laundry treatment drum, if the laundry is in a scattered state, a large amount of laundry will be located in the second area. Therefore, when it is determined that the first ratio of the first laundry area of ​​the first laundry image to the total laundry area of ​​the four quadrants is greater than a first set value, the laundry is then determined to be scattered by determining whether a large amount of laundry is located in the second area after one rotation of the laundry treatment drum. Specifically, when the second ratio of the second laundry area of ​​at least one first laundry image in the second area to the total laundry area of ​​the second area is greater than or equal to the second set value, it indicates that a large amount of laundry is located in the second area during one rotation of the laundry treatment drum. In this case, the laundry is determined to be scattered and the current rotation speed of the laundry treatment drum has reached the ideal rotation speed. When the second ratio of the second laundry area of ​​all first laundry images in the second area to the total laundry area of ​​the second area is less than the second set value, it indicates that the laundry is not scattered. Further determination is made based on the distribution of the remaining laundry outside the second area to determine whether the laundry is in a high-speed, wall-attached state or a low-speed, prematurely falling state. The second set value can be in the range of 1 / 3 to 1 / 2, with the second set value being 1 / 2 as an example.

[0061] In some embodiments, determining whether the current rotational speed of the laundry processing drum has reached the ideal rotational speed based on the distribution of the remaining laundry includes: determining a third area of ​​the remaining laundry in the two right quadrants, a fourth area in the two left quadrants, and the total area of ​​the remaining laundry in each first laundry image; determining a rotational direction of the laundry processing drum; and determining whether the current rotational speed of the laundry processing drum has reached the ideal rotational speed based on the rotational direction, the third area, the fourth area, and the total area of ​​the remaining laundry.

[0062] Specifically, after determining that the laundry is not scattered, the remaining laundry outside the second area of ​​the first laundry image is then distributed in the two left quadrants (the second and third quadrants) and the two right quadrants (the first and fourth quadrants). The distribution of the remaining laundry outside the second area in the two left quadrants and the two right quadrants under different rotational directions of the laundry treatment drum reflects the different rotational speeds of the laundry treatment drum. For example, when the laundry treatment drum rotates clockwise, if the third area of ​​at least one first laundry image is greater than the fourth area, or the third ratio of the third area to the total area of ​​the remaining laundry is greater than a third set value, and a large amount of laundry is located in the two right quadrants, it indicates that the laundry in the laundry treatment drum is in a wall-adhering state, and the current rotational speed of the laundry treatment drum is determined to be higher than the ideal rotational speed. If the fourth area of ​​all first laundry images is greater than the third area, and the third ratio of the fourth area to the total area of ​​the remaining laundry is greater than a third set value, and a large amount of laundry is located in the two left quadrants, it indicates that the laundry in the laundry treatment drum has fallen prematurely before reaching the top, and the current rotational speed of the laundry treatment drum is determined to be lower than the ideal rotational speed. When the laundry processing drum rotates counterclockwise, if the fourth area of ​​at least one first laundry image is larger than the third area, or the third ratio of the fourth area to the total area of ​​the remaining laundry is larger than a third set value, and a large amount of laundry is located in the two left quadrants, it indicates that the laundry in the laundry processing drum is in a wall-adhering state, and the current rotation speed of the laundry processing drum is determined to be higher than the ideal rotation speed. If the third area of ​​all first laundry images is larger than the fourth area, and the third ratio of the third area to the total area of ​​the remaining laundry is larger than a third set value, and a large amount of laundry is located in the two right quadrants, it indicates that the laundry in the laundry processing drum has fallen prematurely before reaching the top, and the current rotation speed of the laundry processing drum is determined to be lower than the ideal rotation speed. The third set value ranges from 1 / 3 to 1 / 2, and illustratively, the second set value is 1 / 2.

[0063] In some embodiments, after the step of determining whether the current rotation speed of the clothes processing drum has reached the ideal rotation speed for putting the clothes in a scattering state, the control method further includes: reducing the rotation speed of the clothes processing drum based on the current rotation speed of the clothes processing drum being higher than the ideal rotation speed; increasing the rotation speed of the clothes processing drum based on the current rotation speed of the clothes processing drum being lower than the ideal rotation speed; and maintaining the rotation speed of the clothes processing drum based on the current rotation speed of the clothes processing drum reaching the ideal rotation speed. In this embodiment, if it is determined that the current rotation speed of the clothes has not reached the ideal rotation speed, the rotation speed of the clothes processing drum is automatically adjusted so that the rotation speed of the clothes drum reaches the ideal rotation speed. After adjusting the rotation speed of the clothes processing drum, multiple images of clothes after the clothes processing drum rotates one circle are acquired again after a set time interval, and the multiple re-acquired clothing images are analyzed to determine whether the adjusted rotation speed has reached the ideal rotation speed, until the clothes in the clothes processing drum reach the ideal rotation speed for putting the clothes in a scattering state, thereby improving the steam care effect.

[0064] In some embodiments, a recognition model training process includes: obtaining a training dataset, wherein the training dataset includes a plurality of clothing image samples within a laundry treatment drum, each clothing image sample having a state label for marking the distribution state of the clothing within the laundry treatment drum; training an initial recognition model using the training dataset a preset number of times, and comparing the training results with the state labels after each training; if the comparison results do not meet preset training conditions, adjusting model parameters of the initial recognition model to obtain an updated initial recognition model, and training the initial recognition model again using the training dataset a preset number of times; when the comparison results meet the preset training conditions or the number of training times reaches a preset number, completing the training of the initial recognition model, and obtaining a recognition model capable of learning from an input image and outputting the distribution state of the clothing in the input image. In this embodiment, a large number of clothing images within a laundry treatment drum during a steam care process, labeled with the clothing distribution state, are formed into a training dataset, and then trained in a recognition model such as a Mobile-Unet model. After training, the Mobile-Unet model can recognize the distribution state of clothing in actual clothing images taken during the steam care process, thereby achieving accurate recognition of the distribution state of clothing within the laundry treatment drum.

[0065] Figure 3 This is a second control flow chart of steam care according to an exemplary embodiment, referring to Figure 3 The steam care method of this embodiment includes the following steps:

[0066] S31, acquiring multiple pictures of clothes at different times when the clothes processing drum rotates clockwise one circle;

[0067] S32, determining whether the plurality of clothing images include a first clothing image in which at least part of the clothing is in the two upper quadrants; if yes, proceeding to S33; if no, determining that the current clothing rotation speed is lower than an ideal rotation speed for scattering the clothing;

[0068] S33: Determine whether a first ratio of the first clothing area located in the two upper quadrants of each first clothing image to the total clothing area of ​​the four quadrants is greater than or equal to a first set value. If the determination result is yes, proceed to S34. If the determination result is no, determine that the current clothing rotation speed is lower than the ideal rotation speed for scattering the clothing.

[0069] S34, determining whether a second ratio of the area of ​​the second clothing in the second preset area to the total area of ​​the second area in each first clothing image is greater than or equal to a second set value; if so, determining that the current clothing rotation speed reaches the ideal rotation speed for scattering the clothing; if not, proceeding to S34;

[0070] S35. Determine whether the third clothing area of ​​the remaining clothes outside the second preset area, which is located in the two right quadrants, is larger than the fourth clothing area of ​​the two left quadrants, or whether a third ratio of the third clothing area to the total clothing area of ​​the remaining clothes is larger than a third set value; if the judgment result is yes, determine that the current rotation speed of the clothes processing drum is higher than the ideal rotation speed for causing the clothes to be scattered; if the judgment result is no, determine that the current rotation speed of the clothes processing drum is lower than the ideal rotation speed for causing the clothes to be scattered.

[0071] According to an exemplary embodiment, this embodiment proposes a control device, which includes one or more processors and a non-transitory computer-readable storage medium storing program instructions. When the one or more processors execute the program instructions, the one or more processors are used to implement any of the image recognition-based steam care methods proposed in the above embodiments.

[0072] According to an exemplary embodiment, this embodiment proposes a clothes treating device, which operates according to any of the image recognition-based steam care methods proposed in the above embodiments, or includes the control device proposed in the above embodiments.

[0073] In the description of this specification, the description with reference to the terms "one embodiment", "some embodiments", "example", "specific example", or "some examples" means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present application. In this specification, the schematic representations of the above terms do not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described can be combined in any one or more embodiments or examples in a suitable manner. In addition, those skilled in the art can combine and combine different embodiments or examples described in this specification and features of different embodiments or examples without contradiction.

[0074] Furthermore, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of the technical features being referred to. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one of such features. Throughout the description of this application, "plurality" means at least two, for example, two, three, etc., unless otherwise specifically defined.

[0075] Any process or method description in a flowchart or otherwise described herein may be understood to represent a module, segment or portion of code comprising one or more executable instructions for implementing the steps of a custom logical function or process, and the scope of the preferred embodiments of the present application includes alternative implementations in which functions may be performed out of the order shown or discussed, including performing functions in a substantially simultaneous manner or in the reverse order depending on the functions involved, which should be understood by those skilled in the art to which the embodiments of the present application belong.

[0076] The logic and / or steps represented in the flowcharts or otherwise described herein, for example, can be considered as a sequenced list of executable instructions for implementing the logical functions, and can be embodied in any computer-readable medium for use by, or in conjunction with, an instruction execution system, apparatus, or device (e.g., a computer-based system, a system including a processor, or other system that can fetch and execute instructions from an instruction execution system, apparatus, or device). For purposes of this specification, a "computer-readable medium" can be any device that can contain, store, communicate, propagate, or transport a program for use by, or in conjunction with, an instruction execution system, apparatus, or device. More specific examples (a non-exhaustive list) of computer-readable media include the following: an electrical connection with one or more wires (electronic devices), a portable computer disk cartridge (magnetic device), random access memory (RAM), read-only memory (ROM), erasable and programmable read-only memory (EPROM or flash memory), fiber optic devices, and a portable compact disc read-only memory (CDROM). Furthermore, the computer-readable medium may even be paper or other suitable medium on which the program is printed, since the program may be obtained electronically, for example, by optically scanning the paper or other medium and then editing, interpreting or processing it in another suitable manner if necessary, and then storing it in a computer memory.

[0077] It should be understood that various parts of the present application can be implemented using hardware, software, firmware, or a combination thereof. In the above embodiments, multiple steps or methods can be implemented using software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented using hardware, as in another embodiment, any one of the following technologies known in the art or a combination thereof can be used to implement: a discrete logic circuit having a logic gate circuit for implementing a logic function on a data signal, an application-specific integrated circuit having a suitable combination of logic gate circuits, a programmable gate array (PGA), a field programmable gate array (FPGA), etc.

[0078] Those skilled in the art will understand that all or part of the steps in the method of the above embodiment can be completed by instructing related hardware through a program, and the program can be stored in a computer-readable storage medium. When the program is executed, it includes one or a combination of the steps of the method embodiment.

[0079] In addition, the functional units in the various embodiments of the present application may be integrated into a processing module, or each unit may exist physically separately, or two or more units may be integrated into a module. The above-mentioned integrated module may be implemented in the form of hardware or in the form of a software functional module. If the integrated module is implemented in the form of a software functional module and sold or used as an independent product, it may also be stored in a computer-readable storage medium.

[0080] The storage medium mentioned above may be a read-only memory, a magnetic disk, or an optical disk, etc. Although the embodiments of the present application have been shown and described above, it is understood that the above embodiments are exemplary and should not be construed as limiting the present application. Persons skilled in the art may make changes, modifications, substitutions, and variations to the above embodiments within the scope of the present application.

Claims

1. A steam care method based on image recognition, used in clothing treatment equipment, characterized in that: The steam care method comprises: During the rotation of the laundry processing drum, a plurality of laundry images at different times are acquired when the laundry processing drum rotates one circle; Processing the plurality of clothing images using a pre-trained recognition model to identify distribution states of clothing in the plurality of clothing images within a first preset area; determining, based on the distribution state of the laundry in the first preset area, whether the current rotation speed of the laundry processing drum reaches an ideal rotation speed for causing the laundry to be in a scattered state; The first preset area includes: four quadrants into which the cross section of the laundry treatment drum is divided by a two-dimensional coordinate system established with the horizontal center line of the cross section of the laundry treatment drum as the abscissa and the vertical center line as the ordinate; The distribution state includes the distribution position and distribution area of ​​the clothes in the four quadrants; The determining, based on the distribution state of the clothes in the first preset area, whether the current rotation speed of the clothes processing drum reaches an ideal rotation speed for causing the clothes to be thrown into the state includes: determining whether the plurality of clothing images include a first clothing image, wherein clothing in the first clothing image is at least partially located in two upper quadrants of the four quadrant areas; When the plurality of clothing images include the first clothing image, determining a first clothing area of ​​the clothing in each first clothing image within the two upper quadrants, and determining whether a current rotational speed of the clothing processing drum reaches the ideal rotational speed based on the first clothing area of ​​each first clothing image; In a case where the plurality of laundry images do not include the first laundry image, it is determined that the current rotation speed of the laundry treating tub is lower than the ideal rotation speed.

2. The steam care method based on image recognition according to claim 1, characterized in that: The determining, based on the first clothing area of ​​each first clothing image, whether the current rotation speed of the clothing processing drum reaches the ideal rotation speed includes: determining a first ratio of the first clothing area in each first clothing image to the total clothing area of ​​the four quadrants; determining a second clothing area of ​​each first clothing image within a second preset area when the first ratio in at least one first clothing image is greater than or equal to a first set value, and determining whether a current rotational speed of the laundry processing drum reaches the ideal rotational speed based on the second clothing area of ​​each first clothing image; When the first ratio in all first laundry images is less than a first set value, determining that the current rotation speed of the laundry processing tub is lower than the ideal rotation speed; The center of the second preset area coincides with the center of the cross section of the laundry processing tub, and the area of ​​the second preset area is smaller than half of the cross section of the laundry processing tub.

3. The steam care method based on image recognition according to claim 2, characterized in that: The determining, based on the second clothing area of ​​each first clothing image, whether the current rotation speed of the clothing processing drum reaches the ideal rotation speed includes: determining a second ratio of the second clothing area of ​​each first clothing image to the total area of ​​the second preset region; determining that the current rotation speed of the laundry processing drum reaches the ideal rotation speed when the second ratio of at least one of the first laundry images is greater than or equal to a second set value; When the second ratio of all first clothing images is less than the second set value, the distribution status of the remaining clothing outside the second preset area in each first clothing image is determined, and whether the current rotational speed of the clothing processing drum reaches the ideal rotational speed is determined based on the distribution status of the remaining clothing.

4. The steam care method based on image recognition according to claim 3, characterized in that: The determining, based on the distribution state of the remaining laundry, whether the current rotation speed of the laundry processing tub reaches the ideal rotation speed includes: determining a third area of ​​the remaining clothes in the two right quadrants, a fourth area in the two left quadrants, and a total area of ​​the remaining clothes in each first clothing image; The rotation direction of the laundry processing drum is determined, and whether the current rotation speed of the laundry processing drum reaches the ideal rotation speed is determined based on the rotation direction, the third area, the fourth area, and the total area of ​​the remaining laundry.

5. The steam care method based on image recognition according to claim 4, characterized in that: The determining, based on the rotation direction, the third area, the fourth area, and the total area of ​​the remaining laundry, whether the current rotation speed of the laundry processing drum reaches the ideal rotation speed includes: When the laundry processing drum rotates in a clockwise direction, if the third area of ​​at least one of the first laundry images is larger than the fourth area, or a third ratio of the third area to the total area of ​​the remaining laundry is larger than a third set value, it is determined that the current rotational speed of the laundry processing drum is higher than the ideal rotational speed; if the fourth area of ​​all the first laundry images is larger than the third area, and the third ratio of the fourth area to the total area of ​​the remaining laundry is larger than a third set value, it is determined that the current rotational speed of the laundry processing drum is lower than the ideal rotational speed; When the clothing processing drum rotates counterclockwise, if the fourth area of ​​at least one of the first clothing images is larger than the third area, or the third ratio of the fourth area to the total area of ​​the remaining clothing is larger than a third set value, it is determined that the current rotational speed of the clothing processing drum is higher than the ideal rotational speed; if the third area of ​​all of the first clothing images is larger than the fourth area, and the third ratio of the third area to the total area of ​​the remaining clothing is larger than a third set value, it is determined that the current rotational speed of the clothing processing drum is lower than the ideal rotational speed.

6. The steam care method based on image recognition according to claim 1, characterized in that: After determining whether the current rotation speed of the laundry treatment drum reaches an ideal rotation speed for placing the laundry in a throwing state, the steam care method further includes: reducing the rotation speed of the laundry processing drum according to the current rotation speed of the laundry processing drum being higher than the ideal rotation speed; increasing the rotation speed of the laundry processing drum according to the current rotation speed of the laundry processing drum being lower than the ideal rotation speed; According to the current rotation speed of the laundry processing drum reaching the ideal rotation speed, the rotation speed of the laundry processing drum is maintained.

7. The steam care method based on image recognition according to claim 1, characterized in that: The training process of the recognition model includes: Acquire a training data set, wherein the training data set includes a plurality of clothing image samples in a clothing treatment drum, each clothing image sample having a state label for marking a distribution state of the clothing in the clothing treatment drum; The initial recognition model is trained a preset number of times using the training data set, and after each training, the training results are compared with the state labels; If the comparison result does not meet the preset training conditions, the model parameters of the initial recognition model are adjusted to obtain an updated initial recognition model, and the initial recognition model is trained again for a preset number of times using the training data set; When the comparison result meets the preset training conditions or the number of training times reaches the preset number, the training of the initial recognition model is completed, and a recognition model is obtained that can output the distribution state of the clothes in the input image after learning based on the input image.

8. A control device, characterized in that: It includes one or more processors and a non-transitory computer-readable storage medium storing program instructions. When the one or more processors execute the program instructions, the one or more processors are used to implement the steam care method based on image recognition according to any one of claims 1 to 7.

9. A clothes processing device, characterized in that: The laundry treatment device operates according to the image recognition-based steam care method according to any one of claims 1 to 7, or includes the control device according to claim 8.

Images