Full-automatic control method and device for laundry treatment, laundry treating machine

By collecting and processing images within the garment processing machine and combining them with sensor information, intelligent control of the garment processing process is achieved, solving the problem of poor washing effect caused by fixed washing parameters in existing technologies, and improving the accuracy and speed of image comparison.

CN115704152BActive Publication Date: 2025-12-12GUANGZHOU EZVALO TECH CO LTD
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
CN202110919624.3
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-08-11
Publication Date
2025-12-12
Estimated Expiration
2041-08-11

AI Technical Summary

Technical Problem

Existing fully automatic garment processing machines fix washing parameters based on sensor information before washing, resulting in poor washing performance.

Method used

Images are captured inside the garment processing machine, and image processing technology is used to determine whether the garment processing process meets the standards. This includes image segmentation, stitching, and feature analysis, combined with sensor information for a comprehensive judgment.

Benefits of technology

It improves the image contrast accuracy and speed in the garment processing process, avoids inaccurate contrast caused by garment folding, and ensures optimized washing results.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115704152B_ABST
    Figure CN115704152B_ABST
Patent Text Reader

Abstract

The application provides a full-automatic control method for clothes treatment, which comprises the following steps: collecting images of clothes in a treatment process; calling stored images before clothes treatment; and judging whether the clothes treatment meets a standard according to the images of the clothes in the treatment process and the stored images before the clothes treatment. The application judges whether the clothes in each treatment process meets the standard according to the images, and takes the images of the clothes after the treatment as the basis for judging whether the treatment meets the standard, thereby providing a new direction for an intelligent control method. In addition, the application also judges whether there is a fold in the image unit, and compares the image unit after splicing with the stored images, so that the inaccuracy caused by the fold of the clothes in the comparison is avoided, and the precision and speed of the image comparison are improved. The application provides a control device and a clothes treatment machine.
Need to check novelty before this filing date? Find Prior Art

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of household appliances, in particular to a full-automatic control method and device for clothes processing and a clothes processing machine. BACKGROUND

[0002] At present, full-automatic clothes processing machines use information provided by sensors to make logical inference, for example, using a mass sensor to determine the weight degree of clothes, using a turbidity sensor to automatically determine the dirt degree of clothes, so as to automatically select the best washing time, water inflow, rinsing times, dehydration time, and display the amount of detergent, so as to achieve automatic washing time, energy saving and water saving. However, the prior art collects information before clothes washing, and automatically selects washing parameters according to the information before washing, but the solidification of washing parameters can easily cause poor washing effect.

[0003] Therefore, it is necessary to provide a control method to solve the above technical problems. SUMMARY

[0004] In view of the deficiencies of the prior art, the purpose of the present application is to provide a full-automatic control method and device for clothes processing, a clothes processing machine and a storage medium.

[0005] The technical scheme of the present application is as follows:

[0006] In one aspect, the present application provides a full-automatic control method for clothes processing, comprising:

[0007] Collecting images of clothes in the processing process; wherein the device for collecting images of clothes in the processing process is installed inside the clothes processing machine;

[0008] Retrieving stored images before clothes processing;

[0009] Determining whether the clothes processing meets the standard according to the images in the clothes processing process and the stored images before clothes processing.

[0010] Further, the category of the processing process includes at least washing, rinsing and drying.

[0011] The retrieval of stored images before clothes processing includes: according to the category of the processing process, retrieving stored images of clothes before the corresponding processing process.

[0012] Further, the determination of whether the clothes processing meets the standard according to the images in the clothes processing process and the stored images before clothes processing includes:

[0013] According to the category of the clothes treatment process, the image in the clothes treatment process and the stored image before the clothes treatment are compared to determine whether the clothes treatment is up to standard.

[0014] Further, the image of the clothes in the treatment process is collected, including:

[0015] The image of the clothes in the treatment process is obtained, and the image is divided into a plurality of image units;

[0016] According to the features in the image unit, it is determined whether there is a fold in the image unit;

[0017] Adjacent image units without folds are spliced to obtain a spliced image.

[0018] Further, the stored image before the clothes treatment is retrieved, including:

[0019] Based on the spliced image, the stored image matching the spliced image is retrieved.

[0020] Further, the features in the image unit are determined according to the features in the image unit, including:

[0021] Based on the feature vector generated by the filter, the sharpness of the image unit is determined according to the Laplace filter feature in the feature vector;

[0022] It is determined whether the sharpness of the image unit exceeds a threshold value;

[0023] When the sharpness of the image unit does not exceed the threshold value, there is no fold in the image unit; when the sharpness of the image unit exceeds the threshold value, there is a fold in the image unit.

[0024] Further, the image in the clothes treatment process and the stored image before the clothes treatment are compared to determine whether the clothes treatment is up to standard, including:

[0025] The spliced image obtained from the image in the clothes treatment process and the stored image before the clothes treatment are compared to determine whether the clothes treatment is up to standard.

[0026] On the other hand, the present application also provides a full-automatic control device for clothes treatment, including:

[0027] The collection module is used to collect the image of the clothes in the treatment process; wherein the device for collecting the image of the clothes in the treatment process is installed inside the clothes treatment machine;

[0028] The retrieval module is used to retrieve the stored image before the clothes treatment;

[0029] a judging module, configured to judge whether the clothes are treated up to standard according to the image in the clothes treatment process and the stored image before the clothes treatment.

[0030] In another aspect, the present application also provides a clothes treatment machine, which adopts the full-automatic control method of clothes treatment according to any one of the above.

[0031] In the last aspect, the present application also provides a computer readable storage medium, which stores a computer program, and the computer program is configured to run the full-automatic control method of clothes treatment according to any one of the above.

[0032] Compared with the prior art, the present application has the beneficial effects that the full-automatic control method of clothes treatment provided by the present application judges whether the clothes are treated up to standard in each treatment process according to the image, takes the image after the clothes treatment as the basis for judging whether the treatment is up to standard, and provides a new direction for the intelligent control method. The present application also stores the corresponding image for each treatment process, compares the image in each treatment process with the stored image in the treatment process, and judges whether the clothes are treated up to standard. Moreover, according to the particularity of the clothes image comparison, the present application also judges whether there is a fold in the image unit according to the sharpness in the image, compares the image unit without fold after splicing with the stored image, avoids the inaccuracy of comparison caused by the fold of the clothes, and improves the precision and rate of image comparison.

[0033] The above description is only a summary of the technical scheme of the present application, in order to more clearly understand the technical means of the present application and can be implemented according to the content of the description, the following is a preferred embodiment of the present application and the detailed description of the drawings. The specific embodiments of the present application are given in detail by the following examples and their drawings. BRIEF DESCRIPTION OF DRAWINGS

[0034] The drawings described herein are used to provide further understanding of the present application, and form a part of the present application. The schematic embodiments of the present application and their description are used to explain the present application, and do not constitute an improper limitation on the present application. In the drawings:

[0035] Figure 1 the flow chart of the embodiment one of the full-automatic control method of clothes treatment in the present application;

[0036] Figure 2 the flow chart of the embodiment two of the full-automatic control method of clothes treatment in the present application;

[0037] Figure 3 the flow chart of the embodiment four of the full-automatic control method of clothes treatment in the present application;

[0038] Figure 4It is a schematic view of the control device corresponding to the first embodiment of the present application. BRIEF DESCRIPTION OF DRAWINGS

[0040] 1, acquisition module; 2, call module; 3, judgment module. DETAILED DESCRIPTION

[0041] The foregoing and other objects, features, aspects and advantages of the present application will become more apparent from the following detailed description of the present application when taken in conjunction with the accompanying drawings. The detailed description of the present application is provided with reference to the accompanying drawings. In the drawings, for the purpose of clarity, the shapes and dimensions of the components can be exaggerated and the same reference numbers can be used throughout different drawings to designate the same or similar components. In the following description, terms such as front, rear, top, bottom, up, down, right, left, and the like are used based on the orientation or positional relationship shown in the drawings. In particular, "height" corresponds to the dimension from the top to the bottom, "width" corresponds to the dimension from the left to the right, and "depth" corresponds to the dimension from the front to the back. These relative terms are for convenience of explanation and are not intended to necessarily require a specific orientation. Terms related to attachment, coupling, and the like (e.g., "connected" and "attached") refer to a relationship in which structures are fixed or attached to each other directly or indirectly through an intermediate structure, as well as movable or rigid attachment or relationship, unless otherwise explicitly stated.

[0042] Next, the present application will be further described in conjunction with the accompanying drawings and the detailed description, and it should be noted that the following described embodiments or technical features can be combined to form new embodiments without conflict. It should be understood that the terms such as "have", "contain" and "include" used herein do not exclude the presence or addition of one or more other elements or combinations thereof.

[0043] Embodiment one:

[0044] As shown in the drawings, a full-automatic control method for clothes treatment of the present application comprises: Figure 1

[0045] S1, acquiring images of clothes in the treatment process; wherein the device for acquiring images of clothes in the treatment process is installed inside the clothes treatment machine;

[0046] S2, calling stored images before clothes treatment;

[0047] S3, judging whether the clothes treatment meets the standard according to the images in the clothes treatment process and the stored images before clothes treatment.

[0048] The category of the treatment process includes at least washing, rinsing, and drying. Therefore, step S1 comprises: S11, acquiring images of clothes in the treatment process and marking the treatment process;​

[0049] The step S2 of calling the stored image before the clothes are treated comprises: S21, calling the stored image before the clothes are treated corresponding to the treatment process according to the category of the treatment process.

[0050] The step S3 of judging whether the clothes are treated up to the standard according to the image during the treatment of the clothes and the stored image before the clothes are treated comprises:

[0051] S31, comparing the image during the treatment of the clothes and the stored image before the clothes are treated corresponding to the treatment process according to the category of the treatment process, and judging whether the clothes are treated up to the standard during the treatment of the clothes.

[0052] It can be understood that in the embodiment, the stored image before the clothes are treated corresponding to each treatment process is used as the basis for judging whether the clothes are treated up to the standard.

[0053] Embodiment two:

[0054] As shown in Figure 2 A full-automatic control method of clothes treatment provided by the present application comprises:

[0055] S1, collecting the image of the clothes during the treatment process; wherein the device for collecting the image of the clothes during the treatment process is installed inside the clothes treatment machine;

[0056] S2, calling the stored image before the clothes are treated;

[0057] S3, judging whether the clothes are treated up to the standard according to the image during the treatment of the clothes and the stored image before the clothes are treated.

[0058] Specifically, the embodiment based on the embodiment one can further comprise:

[0059] S4, when the clothes are treated up to the standard, judging whether the treatment process is up to the standard according to the information obtained by the sensor; the information obtained by the sensor comprises at least one of the temperature and humidity information, the turbidity information of the water quality, and the information of the foam state in the washing drum obtained by the sensor.

[0060] S5, when the information obtained by the sensor meets the standard, the treatment process is up to the standard.

[0061] It can be understood that in the step S3 of judging whether the clothes are treated up to the standard according to the image during the treatment of the clothes and the stored image before the clothes are treated, the image during the treatment of the clothes and the stored image before the clothes are treated corresponding to the treatment process can be compared according to the category of the treatment process; whether the clothes are treated up to the standard during the treatment of the clothes can be judged according to the RGB value, the brightness, the outline and other data of the two.

[0062] Specifically, the temperature and humidity sensor is used to obtain the temperature and humidity information in the washing drum, and the turbidity sensor is used to obtain the turbidity information of the water quality and the foam state information in the washing drum.

[0063] Therefore, the embodiment takes the image contrast to judge whether the clothes treatment meets the standard as one of the judgment standards on the basis of the embodiment one, and judges the information obtained by the sensor on the basis of the image contrast, so as to judge whether the treatment process meets the standard.

[0064] Embodiment three:

[0065] The clothes treatment full-automatic control method comprises the following steps:

[0066] S1, collecting the image of the clothes in the treatment process; wherein the device for collecting the image of the clothes in the treatment process is installed in the clothes treatment machine;

[0067] S2, calling the stored image before the clothes treatment;

[0068] S3, judging whether the clothes treatment meets the standard according to the image of the clothes in the treatment process and the stored image before the clothes treatment.

[0069] Specifically, the embodiment can further comprise the judgment of whether the collected image is folded before the contrast. Considering that the folding shadow exists on the image collected when the clothes are folded, which cannot be distinguished from the shadow caused by the stain.

[0070] Therefore, in the embodiment, S1 collects the image of the clothes in the treatment process, comprising: S12, obtaining the image of the clothes in the treatment process, and dividing the image into a plurality of image units;

[0071] S13, judging whether there is folding in the image unit according to the features in the image unit;

[0072] S14, splicing the adjacent image units without folding to obtain a spliced image.

[0073] S2 calls the stored image before the clothes treatment, comprising:

[0074] S22, calling the stored image matched with the spliced image based on the spliced image.

[0075] Further, S13 comprises:

[0076] S131, determining the sharpness of the image unit based on the feature vector generated by the filter and according to the Laplace filter feature in the feature vector.

[0077] S132, judging whether the sharpness of the image unit exceeds the sharpness threshold.

[0078] S133, when the sharpness of the image unit does not exceed the sharpness threshold, then there is no fold in the image unit. When the sharpness of the image unit exceeds the sharpness threshold, then there is a fold in the image unit.

[0079] Specifically, the sharpness of the image unit is an indicator of the sharpness of the image edge. When the sharpness changes abruptly, it can be determined that the change does not correspond to the pattern of the original image or the stain. It may be caused by lens stains or shadows caused by clothing folding.

[0080] In addition, the present application can also determine whether the clothing has a fold according to the depth data collected by the camera. Further, S13 can further comprise:

[0081] Based on the depth data collected by the camera, it is determined whether the depth data exceeds the depth threshold.

[0082] When the depth data does not exceed the depth threshold, then there is no fold in the image unit. When the depth data exceeds the depth threshold, then there is a fold in the image unit.

[0083] S3 determines whether the clothing treatment meets the standard according to the image during the clothing treatment and the stored image before the clothing treatment, comprising:

[0084] S32 compares the stitching image obtained from the image during the clothing treatment with the stored image before the clothing treatment to determine whether the clothing treatment meets the standard during the clothing treatment.

[0085] Specifically, S14 stitches the adjacent image units without folds, which can be stitched according to the edge features.

[0086] It can be understood that the present embodiment mainly considers the influence of the shadow caused by the clothing folding on the stain judgment result, introduces the judgment of whether there is a fold, stitches the part without fold, and then compares and judges with the stored image, thereby improving the accuracy of the image judgment result.

[0087] Embodiment four:

[0088] Reference Figure 3 The present application provides a full-automatic control method for clothing treatment, comprising:

[0089] S1, collecting images of the clothing during the treatment process; wherein the device for collecting images of the clothing during the treatment process is installed inside the clothing treatment machine;

[0090] S2, retrieving a stored image before the clothing treatment;

[0091] S3, determining whether the clothing treatment meets the standard according to the image during the clothing treatment and the stored image before the clothing treatment.

[0092] The embodiment fuses embodiment one and embodiment three, and considers the diversity of the clothes processing process and the large image contrast error caused by clothes folding. Different clothes processing processes store corresponding images before clothes processing.

[0093] The category of the processing process at least includes washing, rinsing, and drying.

[0094] Specifically, step S1 includes:

[0095] S11, collect the image of the clothes in the processing process, and label the processing process;

[0096] S12, divide the image of the clothes in the processing process into a plurality of image units;

[0097] S13, determine whether there is folding in the image unit according to the features in the image unit;

[0098] S14, splice the adjacent image units without folding to obtain a spliced image.

[0099] Further, S13 includes:

[0100] S131, determine the sharpness of the image unit based on the feature vector generated by the filter and according to the Laplacian filter feature in the feature vector;

[0101] S132, determine whether the sharpness of the image unit exceeds a threshold value;

[0102] S133, when the sharpness of the image unit does not exceed the threshold value, there is no folding in the image unit; when the sharpness of the image unit exceeds the threshold value, there is folding in the image unit.

[0103] Specifically, step S2 includes:

[0104] S21, according to the category of the processing process, and based on the spliced image, retrieve the stored image matched with the spliced image; the stored image is an image before clothes processing corresponding to the processing process.

[0105] Specifically, step S3 includes:

[0106] S31, according to the category of the clothes processing process, compare the spliced image obtained from the image of the clothes in the clothes processing process with the stored image before clothes processing, and determine whether the clothes in the clothes processing process meet the standard.

[0107] It can be understood that the embodiment considers that the clothes processing process usually includes multiple processes, and a corresponding stored image before clothes processing is matched in each process. The embodiment labels the processing process and segments the image, respectively judges whether the clothes exist folding, and splices the image unit without folding; according to the category of the processing process and the spliced image, the image matched and stored is called and compared to judge whether the processing process meets the standard.

[0108] Embodiment five:

[0109] Reference Figure 4 The application also provides a full-automatic control device for clothes processing, comprising:

[0110] The acquisition module 1 is used for acquiring images of clothes in the processing process; wherein the device for acquiring images of clothes in the processing process is installed in the clothes processing machine;

[0111] The calling module 2 is used for calling stored images before clothes processing;

[0112] The judgment module 3 is used for judging whether the clothes processing meets the standard according to the images of the clothes in the processing process and the stored images before clothes processing.

[0113] Embodiment six:

[0114] The application also provides a clothes processing machine, which adopts the full-automatic control method for clothes processing in the above-mentioned embodiments. In addition, the clothes processing machine in the application is not limited to a washing machine, a dryer or a washing-drying integrated machine.

[0115] When the clothes processing machine is a washing machine, whether the clothes washing, rinsing and other steps meet the standard can be judged according to the images of the clothes processing process and the stored images before clothes processing.

[0116] When the clothes processing machine is a dryer or a washing-drying integrated machine, whether the clothes drying step meets the standard can also be judged according to the images of the clothes drying process and the stored images before clothes processing.

[0117] In addition, the clothes processing machine provided by the application considers the influence of the shadow caused by clothes folding on the judgment result of stains, introduces the judgment of whether there is folding, splices the part without folding, and then compares and judges with the stored image, so as to improve the accuracy of the image judgment result.

[0118] Embodiment seven:

[0119] The application also provides a computer-readable storage medium, wherein the storage medium stores a computer program, and the computer program is set to run as the full-automatic control method for clothes processing in the above-mentioned embodiments.

[0120] The full-automatic control method of clothes processing provided by the application judges whether the clothes in each processing process is processed up to standard according to the image, takes the image after the clothes processing as the basis for judging whether the processing is up to standard, and provides a new direction for the intelligent control method. The application also stores the corresponding image for each processing process, compares the image in each processing process with the stored image in the processing process, and judges whether the clothes is processed up to standard. And according to the particularity of the comparison of the clothes image, the application also judges whether there is folding in the image unit according to the sharpness in the image, splices the image unit without folding and then compares it with the stored image, avoids the inaccuracy of comparison caused by the folding of the clothes, and improves the precision and rate of image comparison.

[0121] It should be noted that the above-mentioned sequence of the embodiments of the application is only for description, and does not represent the advantages and disadvantages of the embodiments. The above-mentioned specific embodiments of the present application are described. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recorded in the claims can be executed in an order different from that in the embodiments and still achieve the desired results. In addition, the processes depicted in the drawings do not necessarily require the specific order or continuous order shown to achieve the desired results. In some embodiments, multi-task processing and parallel processing are possible or can be advantageous.

[0122] Each embodiment in the specification is described in a progressive manner, and the same or similar parts between each embodiment can be referred to each other. Each embodiment focuses on the difference from other embodiments. Especially, the device and electronic equipment embodiments are described simply because they are basically similar to the method embodiments. The relevant parts can be referred to the part of the method embodiment.

[0123] The above description has fully disclosed the specific embodiments of the application. It should be noted that any modification of the specific embodiments of the application by those skilled in the art does not deviate from the scope of the claims of the application. Accordingly, the scope of the claims of the application is not limited to the above-mentioned specific embodiments.

Claims

1. A method for full automatic control of laundry treatment, characterized in that, The method comprises: acquiring images of the clothes during the treatment process, wherein the device for acquiring the images of the clothes during the treatment process is installed inside the clothes treatment machine; retrieving stored images before the clothes treatment; judging whether the clothes treatment is up to standard according to the images of the clothes during the treatment process and the stored images before the clothes treatment; the acquisition of the images of the clothes during the treatment process comprises: acquiring the images of the clothes during the treatment process, and dividing the images into a plurality of image units; judging whether there is folding in the image units according to the features in the image units; splicing adjacent image units without folding to remove folding shadows in the images and obtain spliced images; the judgment of whether there is folding in the image units according to the features in the image units comprises: determining the sharpness of the image units based on the feature vectors generated by the filter and according to the Laplacian filter features in the feature vectors; judging whether the sharpness of the image units exceeds a threshold value; when the sharpness of the image units does not exceed the threshold value, there is no folding in the image units; when the sharpness of the image units exceeds the threshold value, there is folding in the image units.

2. The full-automatic control method of laundry processing according to claim 1, wherein, the category of the treatment process at least includes washing, rinsing and drying; the retrieval of the stored images before the clothes treatment comprises: retrieving the stored images before the clothes treatment corresponding to the category of the treatment process.

3. The full-automatic control method of laundry processing according to claim 2, wherein, the judgment of whether the clothes treatment is up to standard according to the images of the clothes during the treatment process and the stored images before the clothes treatment comprises: comparing the images of the clothes during the treatment process and the stored images before the clothes treatment corresponding to the category of the treatment process to judge whether the clothes treatment is up to standard.

4. The full-automatic control method of laundry processing according to claim 1, wherein, the retrieval of the stored images before the clothes treatment comprises: retrieving the stored images matching the spliced images based on the spliced images.

5. The full-automatic control method of laundry processing according to claim 1, wherein, the judgment of whether the clothes treatment is up to standard according to the images of the clothes during the treatment process and the stored images before the clothes treatment comprises: comparing the spliced images obtained from the images of the clothes during the treatment process and the stored images before the clothes treatment to judge whether the clothes treatment is up to standard.

6. A full-automatic control device for laundry treatment, characterized in that, The full-automatic control device is used to execute the full-automatic control method of clothes treatment according to any one of claims 1-5, comprising: an acquisition module for acquiring images of the clothes during the treatment process, wherein the device for acquiring the images of the clothes during the treatment process is installed inside the clothes treatment machine; a retrieval module for retrieving stored images before the clothes treatment; a judgment module for judging whether the clothes treatment is up to standard according to the images of the clothes during the treatment process and the stored images before the clothes treatment.

7. A laundry treating machine characterized in that, The clothes treatment machine adopts the full-automatic control method of clothes treatment according to any one of claims 1-5.

8. A computer readable storage medium, characterized in that, The storage medium stores a computer program, and the computer program is set to execute the full-automatic control method of clothes treatment according to any one of claims 1-5 when running.

Citation Information

Patent Citations

  • Washing machine drying control method, system and device based on image recognition

    CN112726166A