Control method for a laundry treatment apparatus

By segmenting regions and judging change values ​​in the changing images acquired by the image acquisition device of the clothing processing equipment, the problem of low accuracy in the existing technology is solved, and more accurate tapping command recognition and cost control are achieved.

CN116837578BActive Publication Date: 2026-06-16QINGDAO HAIER WASHING MASCH CO LTD +1

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
QINGDAO HAIER WASHING MASCH CO LTD
Filing Date
2022-03-25
Publication Date
2026-06-16

AI Technical Summary

Technical Problem

Existing garment processing equipment, which relies on multiple frames of changing images to determine whether a tapping command has been received, has low accuracy, impacting the user experience.

Method used

By dividing each frame of the acquired image into multiple regions according to a preset method, it is determined whether the image change value of each region relative to the image reference region is greater than a preset value, and the tapping command is determined based on the judgment result.

🎯Benefits of technology

It improves the accuracy of determining whether a tap command has been received, reduces equipment production costs, and enhances the user experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN116837578B_ABST
    Figure CN116837578B_ABST
Patent Text Reader

Abstract

The present application relates to the technical field of smart home, and particularly provides a control method for a clothes processing device, aiming at solving the problem of low accuracy of the clothes processing device in judging whether a knocking instruction is received according to multiple frames of change images in the prior art. To this end, the control method comprises the following steps: obtaining multiple frames of change images successively changed in a preset time, which are collected by an image collection device; each frame of change image is divided into multiple regions according to a first preset method; judging whether an image change value of each region relative to an image reference region corresponding to the region is greater than a preset value; according to the judgment result, whether the image change of different regions of each frame of change image is caused by knocking can be accurately determined, so that whether a knocking instruction is received can be accurately judged, the knocking instruction is received by using the existing image collection device and the image collected by the device, the production cost is reduced, and the flexibility of receiving the knocking instruction is improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This invention relates to the field of smart home technology, and specifically provides a control method for clothing processing equipment. Background Technology

[0002] In daily life, with the improvement of living standards, washing machines, dryers, and other clothing processing equipment play a very important role and are essential household or commercial appliances. Taking washing machines as an example, they use piezoelectric sensors to acquire the impact signals generated by tapping in specific areas. The washing machine is then controlled to perform corresponding operations based on the acquired impact signals. However, this method is inflexible and costly.

[0003] To address the aforementioned issues, existing technologies directly determine whether a tap command has been received by acquiring multiple frames of continuously changing images. However, this method can only determine whether a tap command has been received if the image change is solely caused by a tap. In practical use, however, image changes may be caused by multiple factors, leading to inaccurate judgments and impacting the user experience.

[0004] Therefore, there is a need in the art for a new control method for garment processing equipment to solve the above problems. Summary of the Invention

[0005] The present invention aims to solve the above-mentioned technical problems, namely, to solve the problem that the accuracy of clothing processing equipment in the prior art in determining whether a tapping command has been received based on multiple frames of changing images is not high.

[0006] This invention provides a control method for a garment processing device, the garment processing device including an image acquisition device; the control method includes the following steps: acquiring multiple frames of continuously changing images acquired by the image acquisition device within a preset time; wherein each frame of the changing image is divided into multiple regions according to a first preset method; determining whether the image change value of each region relative to its corresponding image reference region is greater than a preset value; and determining whether a tapping command is received based on the determination result.

[0007] In the preferred embodiment of the above control method, the step of "determining whether a tapping command has been received based on the judgment result" specifically includes: if the image change value of the region relative to its corresponding image reference region is greater than the preset value, then the region is determined as the target region; the position of the target region relative to its corresponding changed image is obtained; and based on the position, it is determined whether the tapping command has been received.

[0008] In the preferred embodiment of the above control method, the step of "determining whether the tapping command has been received based on the position" specifically includes: if the target area is located at a first position relative to its corresponding changed image, then determining whether the first image change range of the non-target area relative to its corresponding image reference area is within a first preset range; if the first image change range is within the first preset range, then determining that the tapping command has been received; and / or if the first image change range is not within the first preset range, then determining that the tapping command has not been received.

[0009] In the preferred embodiment of the above control method, the step of "determining whether the tapping command is received based on the position" further includes: if the target area is located at a second position relative to its corresponding changed image, then the target area is divided into multiple sub-regions according to a second preset method; the image reference area corresponding to the target area is divided into multiple sub-reference areas according to the second preset method; it is determined whether the second image change range of each sub-region relative to its corresponding sub-reference area is within a second preset range; based on the determination result, it is determined whether a tapping command is received.

[0010] In the preferred embodiment of the above control method, the step of "determining whether a tapping command has been received based on the judgment result" specifically includes: if the range of change of the second image is within the second preset range, then count the number of sub-regions within the second preset range; calculate the ratio between the counted number and the total number of sub-regions; determine whether the ratio is greater than or equal to a preset ratio; if the ratio is greater than or equal to the preset ratio, then determine that the tapping command has been received; and / or if the ratio is less than the preset ratio, then determine that the tapping command has not been received.

[0011] In the preferred embodiment of the above control method, the step of "determining whether a tapping command has been received based on the judgment result" further includes: if the range of change of each of the second images is not within the second preset range, then it is determined that the tapping command has not been received.

[0012] In the preferred embodiment of the above control method, the step of "determining whether a tapping command has been received based on the determination result" further includes: if the image change value of each region relative to its corresponding image reference region is less than or equal to the preset value, then determining whether the third image change range of each region relative to its corresponding image reference region is within a third preset range; if the third image change range is within the third preset range, then determining that the tapping command has been received; and / or if the third image change range is not within the third preset range, then determining that the tapping command has not been received.

[0013] In a preferred embodiment of the above control method, before "determining whether the image change value of each region relative to its corresponding image reference region is greater than a preset value", the control method further includes: determining whether the image acquisition object of the changed image is the same as the image acquisition object of the reference image; if the image objects are the same, then performing the step of determining whether the image change value is greater than the preset value; and / or if the image objects are different, then determining that the tapping command has not been received, and not performing the step of determining whether the image change value is greater than the preset value.

[0014] In the preferred embodiment of the above control method, the step of "determining whether the image acquisition object of the changed image is the same as the image acquisition object of the reference image" specifically includes: acquiring the changed image of the last frame; and determining whether the image acquisition object of the changed image of the last frame is the same as the image acquisition object of the reference image.

[0015] In a preferred embodiment of the above control method, the reference image is divided into multiple image reference regions according to the first preset method.

[0016] In a preferred embodiment of the control method of the present invention, multiple frames of continuously changing images acquired by an image acquisition device within a preset time period are obtained; wherein each frame of changing image is divided into multiple regions according to a first preset method; it is determined whether the image change value of each region relative to its corresponding image reference region is greater than a preset value; based on the determination result, it is determined whether a tapping command has been received.

[0017] Compared to existing technologies that directly determine whether a tapping command has been received based on multiple frames of continuously changing images, this invention divides each frame of the acquired changing image into multiple regions according to a first preset method, and determines whether the image change value of each region relative to its corresponding image reference region is greater than a preset value. Based on the determination results, it can accurately determine whether the image changes in different regions of each frame are caused by a tap, thereby accurately determining whether a tapping command has been received. Moreover, in the above process, the existing image acquisition device of the washing machine can be used to receive tapping commands through the acquired images, eliminating the need for additional structures, reducing the production cost of the washing machine, improving the flexibility of receiving tapping commands, and thus enhancing the user experience.

[0018] Furthermore, if the image change value of any region relative to its corresponding image reference region is greater than a preset value, it indicates that the image change in that region is relatively large, while the image change caused by the tap is relatively small. However, there may be small image changes within a large range of image changes. In this case, the region is identified as the target region, and the position of the target region relative to its corresponding changed image is obtained. Based on the position, it is possible to further determine whether a tap command has been received, thus avoiding misjudgment and further improving the accuracy of determining whether a tap command has been received.

[0019] Furthermore, if the image change value of each region relative to its corresponding image reference region is less than or equal to a preset value, it indicates that the image change in that region is relatively small, and it may be an image change caused by a tap. Then, it is further determined whether the third image change range of each region relative to its corresponding image reference region is within the third preset range. If so, it indicates that the image change in that region is caused by a tap, and it is determined that a tap command has been received. If not, it indicates that the image change in that region is not caused by a tap, and it is determined that a tap command has not been received. This improves the accuracy of determining whether a tap command has been received and avoids misjudgment. Attached Figure Description

[0020] The control method of the present invention will now be described with reference to the accompanying drawings and in conjunction with a washing machine, in which:

[0021] Figure 1 This is the flow chart of the control method of the present invention. Figure 1 ;

[0022] Figure 2 This is the process of determining whether a tap command has been received according to the present invention. Figure 1 ;

[0023] Figure 3 This is the process of determining whether a tap command has been received according to the present invention. Figure 2 ;

[0024] Figure 4 This is the process of determining whether a tap command has been received according to the present invention. Figure 3 ;

[0025] Figure 5 This is the flow chart of the control method of the present invention. Figure 2 ;

[0026] Figure 6 This is a logic diagram of the control method of the present invention. Detailed Implementation

[0027] Preferred embodiments of the present invention will now be described with reference to the accompanying drawings. Those skilled in the art should understand that these embodiments are merely illustrative of the technical principles of the present invention and are not intended to limit the scope of protection of the present invention. For example, although this application is described in conjunction with a washing machine, the technical solution of the present invention is not limited thereto. This control method can obviously also be applied to other clothing processing equipment such as washer-dryer combos, shoe washing machines, clothes dryers, and garment care machines, and such modifications do not depart from the principles and scope of the present invention.

[0028] It should be noted that in the description of this invention, terms such as "inner," "outer," "horizontal," "vertical," "left," and "right," indicating directional or positional relationships, are based on the directional or positional relationships shown in the accompanying drawings. These terms are used merely for ease of description and do not indicate or imply that the device or element must have a specific orientation, or be constructed and operated in a specific orientation. Therefore, they should not be construed as limitations on this invention. Furthermore, the terms "first," "second," and "third" are used for descriptive purposes only and should not be construed as indicating or implying relative importance.

[0029] Furthermore, it should be noted that, in the description of this invention, unless otherwise explicitly specified and limited, the terms "connection" and "setup" should be interpreted broadly. For example, they can refer to a fixed connection, a detachable connection, or an integral connection; they can be a mechanical connection or a direct connection. Those skilled in the art can understand the specific meaning of the above terms in this invention according to the specific circumstances.

[0030] Based on the technical problems mentioned in the background art, the present invention provides a control method for a washing machine. The method involves dividing each frame of a changed image into multiple regions according to a first preset method, and determining whether the image change value of each region relative to its corresponding image reference region is greater than a preset value. Based on the determination result, it can accurately determine whether the image change in different regions of each frame of a changed image is caused by a tap, thereby accurately determining whether a tap command has been received. Furthermore, in the above process, the existing image acquisition device of the washing machine can be used to receive tap commands through the acquired images, eliminating the need for additional structures, reducing the production cost of the washing machine, improving the flexibility of receiving tap commands, and thus enhancing the user experience.

[0031] First see Figure 1 The control method for a washing machine according to the present invention will be described. Figure 1 This is the flow chart of the control method of the present invention. Figure 1 .

[0032] like Figure 1 As shown, the control method of the present invention includes the following steps:

[0033] S100: Acquire multiple frames of continuously changing images acquired by the image acquisition device within a preset time period; wherein each frame of changing image is divided into multiple regions according to a first preset method.

[0034] S200: Determine whether the image change value of each region relative to its corresponding image reference region is greater than a preset value;

[0035] S300: Based on the judgment result, determine whether a tap command has been received.

[0036] In step S100, the image acquisition device can be used to capture images of the inside of the washing machine drum or the outside of the washing machine. For example, it can be a wide-angle camera, a binocular camera, a wireless camera, or a zoom camera. It should be noted that although the term "drum" is used, it is not limited to a front-loading washing machine; it can also be a top-loading washing machine.

[0037] Furthermore, the image acquisition device includes multiple cameras, which can be installed in the inner drum at different orientations and angles to ensure that the acquired image frames cover the entire working area. When the image acquisition device is capturing images of the inside of the drum, it can be activated simultaneously with the washing machine receiving the power-on command, and then capture multiple frames of images in real time until a series of continuously changing images (e.g., 2, 5, 15, or 30 frames) are acquired within 10 seconds. Alternatively, when the image acquisition device is capturing images of the outside of the washing machine, it can be activated simultaneously with the washing machine receiving the power-on command, and then capture multiple frames of continuously changing images within a 1-meter radius of the washing machine in real time until 10 seconds have elapsed.

[0038] Of course, the preset time and setting range are not limited to the times listed above. The preset time can also be 1 second, 5 seconds, 15 seconds, or other times. Those skilled in the art can flexibly adjust and set these times, as long as the time range of multiple frames of continuously changing images can be defined. The setting range can also be other ranges such as 1.5 meters or 2 meters near the washing machine. Those skilled in the art can flexibly adjust and set these times, and this invention does not impose any limitations on this.

[0039] The first preset method can be to divide each changing image into two regions (upper and lower) or three regions (upper, middle and lower) along the horizontal direction (i.e., along the length of the changing image). Preferably, the dividing line can be a straight line, a diagonal line, or a curve or other shapes to correspond to different image feature requirements. Alternatively, the image can be automatically segmented according to the object region. For example, after capturing an image of clothing inside the inner drum, since the clothing is usually located at the lower part of the inner drum and the upper part of the inner drum is the drum wall, the image can be divided into the clothing region and the drum wall region, etc.

[0040] In step S200, it is determined whether the image change value of each region of each frame image relative to its corresponding image reference region is greater than a preset value.

[0041] Each region corresponds to one of multiple image reference regions segmented from a reference image using a first preset method. Preferably, the number of image reference regions matches the number of segments in each frame of the changing image.

[0042] The reference image can be an image captured by the image acquisition device when the washing machine is turned on; it can also be a frame of a multi-frame stable image that has not undergone continuous image changes and was recently captured by the image acquisition device before the first frame of the multi-frame changing image; or it can be a multi-frame stable image after the clothes have been loaded during the user's operation of loading clothes. Since the multi-frame stable image no longer changes, any image in the multi-frame stable image can be updated as the reference image.

[0043] Image change refers to the changes that occur due to image jitter.

[0044] The following reference Figures 2 to 4 Taking the division of a changing image into upper and lower regions along the horizontal direction as an example, the method for determining whether a tapping command has been received according to the present invention is described. Figure 2 This is the process of determining whether a tap command has been received according to the present invention. Figure 1 ; Figure 3 This is the process of determining whether a tap command has been received according to the present invention. Figure 2 ; Figure 4 This is the process of determining whether a tap command has been received according to the present invention. Figure 3 .

[0045] like Figure 2 As shown, step S300, "determining whether a tap command has been received based on the judgment result," specifically includes:

[0046] S311. If the image change value of a region relative to its corresponding image reference region is greater than a preset value, then the region is determined as the target region.

[0047] S312. Obtain the position of the target region relative to its corresponding changed image;

[0048] S313. Determine whether a tapping command has been received based on the location.

[0049] In step S311, for example, the preset value is 1cm. The image change values ​​of the two regions of the first frame of the changed image relative to their corresponding image reference regions are 2.3cm and 0.15cm, respectively. Among them, 2.3cm is greater than 1cm, while 0.15cm is less than 1cm. This indicates that the image change of the region corresponding to the image change value of 2.3cm is relatively large, while the image change of the region corresponding to the image change value of 0.15cm is relatively small. Therefore, the region corresponding to the image change value of 2.3cm is determined as the target region.

[0050] For example, if the preset value is 1cm, and the image changes of two regions in the second frame of the changed image relative to their corresponding image reference regions are 2cm and 1.2cm respectively, both of which are greater than 1cm, it indicates that the image changes of the two regions are relatively large, so both regions are determined as target regions.

[0051] In step S312, since each frame of the changing image is divided into multiple regions according to the first preset method, the position of each region relative to its corresponding changing image is determined. Therefore, after the target region is determined, the position of the target region relative to its corresponding changing image can be determined.

[0052] like Figure 3 As shown, step S313, "determining whether a tapping command has been received based on the location," specifically includes:

[0053] S321. If the target region is located at a first position relative to its corresponding changed image, determine whether the first image change range of the non-target region relative to its corresponding image reference region is within a first preset range; if yes, proceed to step S322; if no, proceed to step S323.

[0054] S322, Determine that a tapping command has been received;

[0055] S323, It is determined that no tap command was received.

[0056] The first position is the upper-middle part of the changing image. For example, if the changing image is divided into two regions, the first position is located in the upper region of the changing image; if the changing image is divided into three regions, the first position is located in the upper and middle regions of the changing image, and so on. These will not be listed one by one here.

[0057] In step S321, for example, if the target area is located in the upper region (i.e., the first position) relative to its corresponding change image, it means that the image change of the target area is mainly caused by adding clothes into the inner drum and the clothes falling down. If the washing machine also receives a knocking command at this time, the lower region (i.e., the non-target area) of the change image corresponding to the target area will also change. Then, it can be determined whether a knocking command has been received based on the non-target area, eliminating the interference caused by the falling clothes, avoiding misjudgment, and further improving the accuracy of determining whether a knocking command has been received.

[0058] In step S322, for example, the first preset range is 0.1 to 0.3 cm, and the detected first image change range is 0.15 cm to 0.2 cm. If it is within the first preset range, it means that the user has knocked on the washing machine. The washing machine receives the knocking command and makes the washing machine run based on the knocking command, such as controlling the door of the washing machine to open, or starting and running the clothes processing program, etc.

[0059] In step S323, for example, if the first preset range is 0.1 to 0.3 cm, and the detected first image change range is 0.05 cm, which is not within the first preset range, the first image change range is too small and may simply be a measurement deviation; or, if the detected first image change range is 0.4 cm, which is also not within the first preset range, the first image change range is slightly larger than the image change caused by the tap, which may be caused by the shaking of the washing machine drum. In any case, it can be considered that the user did not tap the washing machine and did not obtain a tapping command, and the process returns to step S100 to acquire the multi-frame change images of continuous image changes acquired by the image acquisition device within the preset time.

[0060] It should be noted that in the above process, steps S322 and S323 are not sequential but parallel, and are only related to the judgment result of whether the change range of the first image is within the first preset range. The corresponding steps can be executed according to different judgment results.

[0061] Continue reading Figure 3 In step S313, the step of "determining whether a tapping command has been received based on the location" further includes:

[0062] S324. If the target region is located at a second position relative to its corresponding changed image, the target region is divided into multiple sub-regions according to a second preset method.

[0063] S325. Divide the image reference region corresponding to the target region into multiple sub-reference regions according to the second preset method;

[0064] S326. Determine whether the range of change of the second image of each sub-region relative to its corresponding sub-reference region is within a second preset range;

[0065] S327. Based on the judgment result, determine whether a tap command has been received.

[0066] In this context, the second position is located below the first position. For example, if the changing image is divided into two regions, the first position is located in the upper region of the changing image, and the second position is located in the lower region of the changing image. If the changing image is divided into three regions, the first position is located in the upper and middle regions of the changing image, and the second position is located in the lower region of the changing image, and so on. These will not be listed one by one here.

[0067] The second preset method can be to divide the target area into three sub-regions from left to right or four sub-regions from left to right along the vertical direction (i.e., along the width direction of the target area). That is, the division direction of the second preset method is basically perpendicular to the division direction of the first preset method, and the division is carried out along the horizontal and vertical dimensions respectively.

[0068] Accordingly, the image reference region corresponding to the target region is divided into multiple sub-reference regions according to a second preset method. Preferably, the number of sub-reference regions matches the number of segments in the target region.

[0069] The following example, which divides the target area vertically into three sub-regions from left to right, further illustrates this point.

[0070] like Figure 4 As shown, step S327, "based on the judgment result, determine whether a tap command has been received," specifically includes:

[0071] S331. If the range of change of the second image is within the second preset range, then count the number of sub-regions whose range of change of the second image is within the second preset range.

[0072] S332. Calculate the ratio between the statistically calculated quantity and the total quantity in the sub-region;

[0073] S333. Determine whether the ratio is greater than or equal to the preset ratio; if yes, proceed to step S334; if no, proceed to step S335.

[0074] S334. Determine that a tapping command has been received;

[0075] S335, It is determined that no tap command was received.

[0076] Furthermore, if the range of change of the second image is not within the second preset range, then step S335 is executed.

[0077] In step S331, if at least one second image change range is detected to be within the second preset range, the number of sub-regions whose second image change range is within the second preset range needs to be counted. For example, if the second preset range is 0.1 to 0.3 cm, and the detected second image change ranges of the three sub-regions are 0.13 cm to 0.16 cm, 0.18 cm to 0.21 cm, and 1.1 cm to 1.4 cm, two are within the second preset range and one is not; or, if the detected second image change ranges of the three sub-regions are 0.11 cm to 0.14 cm, 1.3 cm to 1.5 cm, and 2.1 cm to 2.2 cm, one is within the second preset range and two are not.

[0078] In step S332, the total number of sub-regions is the number of multiple sub-regions that the target region is divided into according to the second preset method, for example, three. If the counted number is 2, the ratio is 2 / 3; if the counted number is 1, the ratio is 1 / 3.

[0079] In step S334, for example, if the preset ratio is 2 / 3 and the calculated ratio is 2 / 3, which is equal to the preset ratio, it means that the second image change range of most sub-regions of the target area is within the second preset range. It can be assumed that the user has knocked on the washing machine, the washing machine has received the knocking command, and the washing machine runs based on the knocking command, such as controlling the door of the washing machine to open, or starting and running the clothes processing program, etc.

[0080] In step S335, for example, if the preset ratio is 2 / 3 and the calculated ratio is 1 / 3, which is less than the preset ratio, it means that the second image change range of a small sub-region of the target area is within the second preset range. It can be assumed that the user did not hit the washing machine and did not receive a hitting command, thus avoiding misjudgment. Then, return to step S100 to acquire the multi-frame change images of continuous image changes acquired by the image acquisition device within the preset time.

[0081] Of course, the preset ratio is not limited to the values ​​listed above, but can also be other values ​​such as 3 / 4, 4 / 5, 5 / 6, etc. Those skilled in the art can flexibly adjust and set the preset ratio according to the judgment accuracy, etc.

[0082] Furthermore, if the range of change in the second image is not within the second preset range, for example, the second preset range is 0.1 to 0.3 cm, and the ranges of change in the second image of the three detected sub-regions are 0.01 cm to 0.06 cm, 1.5 cm to 2.1 cm, and 1.1 cm to 1.4 cm respectively, all of which are not within the first preset range, it can be considered that the image change is caused by adding clothes into the inner drum and the clothes falling down. Since the user did not knock on the washing machine and no knocking command was obtained, the process returns to step S100 to acquire the multi-frame change images of continuous image changes acquired by the image acquisition device within the preset time.

[0083] It should be noted that in the above process, steps S331 and S334 are parallel and have no sequential order. They are only related to the judgment result of whether the range of change of the second image is within the second preset range. The corresponding steps are executed according to different judgment results. Similarly, steps S334 and S335 are parallel and have no sequential order. They are only related to the judgment result of whether the calculated ratio is greater than or equal to the preset ratio. The corresponding steps are executed according to different judgment results.

[0084] Alternatively, in an alternative implementation, when the range of change of the second image is within a second preset range, the number of sub-regions within the range of change of the second image is counted; it is determined whether the counted number is greater than or equal to a preset number; if so, it is determined that a tapping command has been received; otherwise, it is determined that no tapping command has been received.

[0085] See again Figure 2 In step S300, the step of "determining whether a tapping command has been received based on the judgment result" further includes:

[0086] S314. If the image change value of each region relative to its corresponding image reference region is less than or equal to a preset value, then determine whether the third image change range of each region relative to its corresponding image reference region is within the third preset range; if yes, then proceed to step S315; if no, then proceed to step S316.

[0087] S315. Determine that a tapping command has been received;

[0088] S316. It is determined that no tap command was received.

[0089] In step S314, for example, if the preset value is 1cm, the image change values ​​of the two regions of the first frame of the changed image relative to their corresponding image reference regions are 0.2cm and 0.3cm, respectively, both less than 1cm. This indicates that the image change of each region of the first frame of the changed image is relatively small, indicating that the image change of the target region is not caused by adding clothes into the inner drum and the clothes falling down, but may be caused by the user hitting the washing machine. Then, it is further determined whether the third image change range of each region relative to its corresponding image reference region is within the third preset range.

[0090] In step S315, for example, the third preset range is 0.1 to 0.3 cm. The third image change ranges of the two detected areas are 0.14 cm to 0.17 cm and 0.19 cm to 0.22 cm, respectively. Both are within the third preset range. It can be assumed that the user has knocked on the washing machine. The washing machine receives the knocking command and makes the washing machine run based on the knocking command. For example, it controls the door of the washing machine to open, or starts and runs the clothes processing program, etc.

[0091] In step S316, for example, if the third preset range is 0.1 to 0.3 cm, and the detected third image change ranges of the two regions are 0.04 cm to 0.07 cm and 0.31 cm to 0.35 cm respectively, neither of which is within the third preset range; or if the detected third image change ranges of the two regions are 0.06 cm to 0.09 cm and 0.26 cm to 0.29 cm respectively, and one of them is not within the third preset range, then in either case, it can be considered that the user did not tap the washing machine and no tapping command was obtained. The process then returns to step S100 to acquire the multi-frame change images of continuous image changes acquired by the image acquisition device within the preset time.

[0092] It should be noted that in the above process, steps S311 and S314 are not sequential but parallel, and are only related to the judgment result of whether the image change value of each region relative to its corresponding image reference region is greater than a preset value. The corresponding steps are executed according to different judgment results. Similarly, steps S315 and S316 are not sequential but parallel, and are only related to the judgment result of whether the third image change range of each region relative to its corresponding image reference region is within a third preset range. The corresponding steps are executed according to different judgment results.

[0093] Furthermore, it should be noted that the preset values, first preset range, second preset range, and third preset range listed above are merely illustrative and not restrictive. Those skilled in the art can flexibly adjust and set them according to the product structure of different washing machines and the striking force of different users. Moreover, although the first preset range, second preset range, and third preset range listed above are the same, in actual use, any two or three of the first preset range, second preset range, and third preset range can be set to be different.

[0094] The following reference Figure 5 The control method of the present invention is further described below. Figure 5 This is the flow chart of the control method of the present invention. Figure 2 .

[0095] like Figure 5 As shown, before step S200, the control method further includes:

[0096] S101. Determine whether the image acquisition object of the changed image is the same as the image acquisition object of the reference image; if yes, proceed to step S200; if no, proceed to step S102.

[0097] S102. If it is determined that no tapping command has been received, the step of determining whether the image change value is greater than the preset value is not executed.

[0098] In step S101, taking the first frame image captured by the image acquisition device when the washing machine is turned on as a reference image as an example, after acquiring multiple frames of changing images, the last frame of changing images is determined, and it is determined whether the image acquisition object of the last frame of changing images is the same as the image acquisition object of the first frame image; alternatively, it can be determined whether the image acquisition object of the first frame of changing images is the same as the image acquisition object of the first frame image; alternatively, it can be determined whether the image acquisition object of the second frame of changing images is the same as the image acquisition object of the first frame image. That is, the image acquisition object of any frame in the multiple changing images can be compared with the image acquisition object of the reference image.

[0099] In step S102, for example, if the image acquisition object of the changing image is the home environment and the image acquisition object of the reference image is the current user, it is determined that the image acquisition object of the changing image is different from the image acquisition object of the reference image. This means that the user did not hit the washing machine, and the changes in the multiple frames of changing images are not caused by shaking due to hitting the washing machine. Therefore, it is determined that no hitting instruction was received, and the step of judging whether the image change value is greater than the preset value is not executed. Instead, the process returns to step S100 to acquire the multiple frames of changing images that have continuously changed within the preset time period.

[0100] For example, if the image acquisition target of the changing image is the current user, and the image acquisition target of the reference image is also the current user, then it is determined that the image acquisition target of the changing image and the image acquisition target of the reference image are the same, both being the current user. If the user might knock on the washing machine, then the step of judging whether the image change value is greater than a preset value is executed in order to determine whether a knocking command has been received.

[0101] It should be noted that in the above process, steps S102 and S200 are not sequential but parallel, and are only related to the judgment result of whether the image acquisition objects are the same. The corresponding steps can be executed according to different judgment results.

[0102] The following reference Figure 6 This paper describes one possible control flow of the present invention. Figure 6 This is a logic diagram of the control method of the present invention.

[0103] like Figure 6 As shown, a possible complete flow of the control method of the present invention is as follows:

[0104] S401. Acquire multiple frames of continuously changing images acquired by the image acquisition device within 3 seconds; wherein each frame of changing image is divided into 2 regions according to a first preset method;

[0105] S402. Determine whether the image acquisition object of the last frame of the changed image is the same as the image acquisition object of the reference image; if yes, proceed to step S403; if no, proceed to step S412.

[0106] S403. Determine whether the image change value M of each region relative to its corresponding image reference region is greater than 2cm; if yes, proceed to step S404; if no, proceed to step S414.

[0107] S404. Designate this area as the target area;

[0108] S405. Obtain the position L of the target region relative to its corresponding changed image;

[0109] If the target region is located at the first position relative to its corresponding changed image, then proceed to step S413;

[0110] If the target region is located at a second position relative to its corresponding changed image, then proceed to step S406;

[0111] S406. Divide the target region into N0 sub-regions according to the second preset method, and divide the image reference region corresponding to the target region into N0 sub-reference regions according to the second preset method, for example, N0 = 3;

[0112] S407. Determine whether the change range of the second image of each sub-region relative to its corresponding sub-reference region is within the range of 0.1 to 0.3 cm; if yes, proceed to step S408; if no, proceed to step S412.

[0113] S408. Count the number N1 of sub-regions whose change range of the second image is within the second preset range;

[0114] S409. Calculate the ratio C1 between N1 and N0;

[0115] S410. Determine whether C1≥2 / 3 is true; if yes, proceed to step S411; if no, proceed to step S412.

[0116] S411. Determine that a tap command has been received;

[0117] S412. Determine that no tapping command has been received; and return to step S100 until a tapping command is determined to be received.

[0118] S413. Determine whether the change range of the non-target region relative to its corresponding image reference region is within the range of 0.1 to 0.3 cm; if yes, proceed to step S411; if no, proceed to step S412.

[0119] S414. Determine whether the variation range of each region relative to its corresponding image reference region in the third image is within the range of 0.1 to 0.3 cm; if yes, proceed to step S411; if no, proceed to step S412.

[0120] It should be noted that the above embodiments are merely preferred embodiments of the present invention, used only to illustrate the principle of the method of the present invention, and are not intended to limit the scope of protection of the present invention. In practical applications, those skilled in the art can allocate the above functions to different steps as needed, that is, further decompose or combine the steps in the embodiments of the present invention. For example, the steps in the above embodiments can be combined into one step, or further divided into multiple sub-steps to complete all or part of the functions described above. The names of the steps involved in the embodiments of the present invention are merely for distinguishing the various steps and are not considered as limitations on the present invention.

[0121] The technical solution of the present invention has been described above with reference to the preferred embodiments shown in the accompanying drawings. However, it will be readily understood by those skilled in the art that the scope of protection of the present invention is obviously not limited to these specific embodiments. Without departing from the principles of the present invention, those skilled in the art can make equivalent changes or substitutions to the relevant technical features, and the technical solutions after such changes or substitutions will all fall within the scope of protection of the present invention.

Claims

1. A control method for a garment processing device, characterized in that, The garment processing equipment includes an image acquisition device; the control method includes the following steps: The image acquisition device acquires multiple frames of continuously changing images within a preset time period; wherein each frame of the changing image is divided into multiple regions according to a first preset method. Determine whether the image change value of each region relative to its corresponding image reference region is greater than a preset value; Based on the judgment result, determine whether a tap command has been received; The steps for "determining whether a tap command has been received based on the judgment result" specifically include: If the image change value of the region relative to its corresponding image reference region is greater than the preset value, then the region is determined as the target region; Obtain the position of the target region relative to its corresponding changed image; Based on the location, determine whether the tapping command has been received; The step of "determining whether the tapping command has been received based on the location" specifically includes: If the target region is located at a first position relative to its corresponding changed image, then it is determined whether the first image change range of the non-target region relative to its corresponding image reference region is within a first preset range; If the range of change in the first image is within the first preset range, then it is determined that the tapping command has been received; and / or If the range of change of the first image is not within the first preset range, it is determined that the tapping command has not been received.

2. The control method according to claim 1, characterized in that, The step of "determining whether the tapping command has been received based on the location" further includes: If the target region is located at a second position relative to its corresponding changed image, then the target region is divided into multiple sub-regions according to a second preset method; The image reference region corresponding to the target region is divided into multiple sub-reference regions according to the second preset method; Determine whether the range of second image change of each sub-region relative to its corresponding sub-reference region is within a second preset range; Based on the judgment result, determine whether a tap command has been received.

3. The control method according to claim 2, characterized in that, The steps of "determining whether a tap command has been received based on the judgment result" specifically include: If the range of change of the second image is within the second preset range, then count the number of sub-regions whose range of change of the second image is within the second preset range; Calculate the ratio between the statistically calculated quantity and the total quantity in the sub-region; Determine whether the ratio is greater than or equal to a preset ratio; If the ratio is greater than or equal to the preset ratio, it is determined that the tapping command has been received; and / or If the ratio is less than the preset ratio, it is determined that the tapping command was not received.

4. The control method according to claim 2, characterized in that, The step of "determining whether a tap command has been received based on the judgment result" also includes: If the range of change of each of the second images is not within the second preset range, it is determined that the tapping command has not been received.

5. The control method according to claim 1, characterized in that, The step of "determining whether a tap command has been received based on the judgment result" also includes: If the image change value of each region relative to its corresponding image reference region is less than or equal to the preset value, then it is determined whether the third image change range of each region relative to its corresponding image reference region is within the third preset range. If the range of change in the third image is within the third preset range, then it is determined that the tapping command has been received; and / or If the range of change of the third image is not within the third preset range, it is determined that the tapping command has not been received.

6. The control method according to claim 1, characterized in that, Before "determining whether the image change value of each region relative to its corresponding image reference region is greater than a preset value", the control method further includes: Determine whether the image acquisition object of the changed image is the same as the image acquisition object of the reference image; If the image objects are the same, then the step of determining whether the image change value is greater than the preset value is performed; and / or If the image object is different, it is determined that the tapping command has not been received, and the step of determining whether the image change value is greater than the preset value is not executed.

7. The control method according to claim 6, characterized in that, The step of "determining whether the image acquisition object of the changed image is the same as the image acquisition object of the reference image" specifically includes: Get the changed image of the last frame; Determine whether the image acquisition object of the changed image in the last frame is the same as the image acquisition object of the reference image.

8. The control method according to claim 6, characterized in that, The reference image is divided into multiple image reference regions according to the first preset method.