Laundry detecting method, device, apparatus and storage medium of washing machine

Abstract

The present application belongs to the technical field of intelligent washing machines, and particularly relates to a washing machine clothes detection method, device, equipment and storage medium. The present application aims to solve the problem of inaccurate clothes detection result. The embodiment of the present application obtains first image information by image collection of the clothes to be washed in the washing machine inner drum; controls the rotation of the washing machine inner drum according to the first image information to adjust the position of the clothes to be washed in the washing machine inner drum; collects the image of the clothes to be washed in the rotated washing machine inner drum to obtain second image information, and performs clothes detection according to the second image information. Since the clothes condition in the washing machine inner drum is analyzed through the first image information, and the washing machine inner drum is controlled to rotate, the second image information which can better represent the clothes characteristics is obtained, and the clothes detection is performed according to the second image information, so that the recognition rate of the clothes in the washing machine can be improved, and the recognition effect can be improved.

Description

TECHNICAL FIELD

[0001] The present application belongs to the technical field of intelligent household appliances, and particularly relates to a laundry detection method, device, equipment and storage medium for a washing machine. BACKGROUND

[0002] With the popularization of intelligent household appliances, more and more users begin to use intelligent household appliance devices. With the iteration and upgrading of product functions, the functions of intelligent household appliance devices are also becoming more and more perfect. At present, in order to realize a full-automatic washing operation process, the intelligent washing machine needs to detect the laundry to be washed in the inner drum of the washing machine before starting the washing operation, so as to determine the safety of the operation environment and match a suitable washing program.

[0003] However, when there is a large amount of laundry to be washed in the intelligent washing machine, the laundry detection result will be inaccurate, which will lead to a washing program matching error, affect the washing effect, and even cause a use safety problem.

[0004] Correspondingly, there is a need in the art for a new laundry detection method, device, equipment and storage medium for a washing machine to solve the above problems. SUMMARY

[0005] In order to solve the above problems in the prior art, i.e. to solve the problem of inaccurate laundry detection result of the existing washing machine, the present application provides a laundry detection method, device, equipment and storage medium for a washing machine.

[0006] According to a first aspect of the embodiments of the present application, the present application provides a laundry detection method for a washing machine, comprising: collecting images of laundry to be washed in an inner drum of the washing machine to obtain first image information; controlling the inner drum of the washing machine to rotate according to the first image information, so as to adjust the position of the laundry to be washed in the inner drum of the washing machine; collecting images of the laundry to be washed in the inner drum of the washing machine after rotation to obtain second image information, and performing laundry detection according to the second image information.

[0007] In the preferred technical solution of the above laundry detection method for a washing machine, the step of controlling the inner drum of the washing machine to rotate according to the first image information comprises: determining occlusion information of the laundry to be washed according to the first image information, the occlusion information being used to represent the occlusion degree between each piece of laundry; determining an inner drum rotation program according to the occlusion information; and controlling the inner drum of the washing machine to rotate according to the inner drum rotation program.

[0008] In the preferred technical solution of the above laundry detection method for a washing machine, the inner drum rotation program is used to control at least one of the following: inner drum rotation speed, inner drum rotation angle.

[0009] In the preferred technical solutions of the laundry detection method of the washing machine, the method further comprises: acquiring weight information of the laundry to be washed in the washing machine inner drum; and determining a washing machine inner drum rotation program according to the shielding information, comprising: determining the washing machine inner drum rotation program according to the shielding information of the laundry to be washed and the weight information of the laundry to be washed.

[0010] In the preferred technical solutions of the laundry detection method of the washing machine, the laundry detection according to the second image information comprises: performing image recognition on the second image information to determine a clothing color and / or a clothing type corresponding to each piece of clothing in the laundry to be washed.

[0011] In the preferred technical solutions of the laundry detection method of the washing machine, the method further comprises: enabling a corresponding washing program according to the clothing color and / or the clothing type corresponding to each piece of clothing in the laundry to be washed.

[0012] In the preferred technical solutions of the laundry detection method of the washing machine, the laundry detection according to the second image information comprises: performing image recognition on the second image information to determine whether there is a living organism in the washing machine inner drum.

[0013] According to a second aspect of the embodiments of the present application, the present application provides a laundry detection device of a washing machine, comprising:

[0014] In the preferred technical solutions of the laundry detection device of the washing machine, the control module is specifically configured to: determine shielding information of the laundry to be washed according to the first image information, the shielding information being used to represent a shielding degree between each piece of clothing in the laundry to be washed; determine a washing machine inner drum rotation program according to the shielding information; and control the washing machine inner drum to rotate according to the washing machine inner drum rotation program.

[0015] In the preferred technical solutions of the laundry detection device of the washing machine, the washing machine inner drum rotation program is used to control at least one of a rotation speed of the inner drum and a rotation angle of the inner drum.

[0016] In the preferred technical solutions of the laundry detection device of the washing machine, the laundry detection device of the washing machine further comprises a weight acquisition module configured to: acquire weight information of the laundry to be washed in the washing machine inner drum; and determine a washing machine inner drum rotation program according to the shielding information, comprising: determining the washing machine inner drum rotation program according to the shielding information of the laundry to be washed and the weight information of the laundry to be washed.

[0017] In the preferred technical solutions of the laundry detection device of the washing machine, the detection module is specifically configured to: perform image recognition on the second image information to determine a clothing color and / or a clothing type corresponding to each piece of clothing in the laundry to be washed.

[0018] In the preferred technical solution of the laundry detection device of the washing machine, the control module is further configured to: according to the corresponding laundry color and / or laundry type of each laundry in the laundry to be washed, enable a corresponding washing program.

[0019] In the preferred technical solution of the laundry detection device of the washing machine, the detection module is further configured to: perform image recognition on the second image information to determine whether there is a living organism in the inner drum of the washing machine.

[0020] According to a third aspect of the embodiments of the present application, an electronic device is provided, comprising: a memory, a processor and a computer program;

[0021] The computer program is stored in the memory and configured to be executed by the processor to implement the laundry detection method of any one of the first aspect of the embodiments of the present application.

[0022] According to a fourth aspect of the embodiments of the present application, a computer readable storage medium is provided, the computer readable storage medium stores computer execution instructions, and the computer execution instructions are executed by the processor to implement the laundry detection method of any one of the first aspect of the embodiments of the present application.

[0023] Those skilled in the art can understand that the laundry detection method, device, equipment and storage medium of the washing machine provided by the present application can obtain first image information by image acquisition of the laundry to be washed in the inner drum of the washing machine; control the rotation of the inner drum of the washing machine according to the first image information to adjust the position of the laundry to be washed in the inner drum of the washing machine; image acquisition of the laundry to be washed in the rotated inner drum of the washing machine to obtain second image information, and perform laundry detection according to the second image information. Since the first image information is pre-acquired before the laundry in the washing machine is detected, the situation of the laundry in the inner drum of the washing machine is analyzed, and the inner drum of the washing machine is controlled to rotate to adjust the position of the laundry in the washing machine, so that the second image information which can better represent the characteristics of the laundry is obtained, and the laundry detection is performed according to the second image information, which can improve the recognition rate of the laundry in the washing machine, improve the recognition effect, and further better guarantee the safety function of the washing machine and accurately match the washing program. BRIEF DESCRIPTION OF DRAWINGS

[0024] The preferred embodiments of the laundry detection method, device and equipment of the washing machine of the present application will be described below with reference to the accompanying drawings. The drawings are as follows:

[0025] Figure 1 An application scenario diagram of the laundry detection method of the washing machine provided by the embodiments of the present application is shown in the figure;

[0026] Figure 2A flow chart of the laundry detecting method provided by an embodiment of the present application is shown in the following figure;

[0027] Figure 3 A process diagram of image acquisition of the laundry to be washed provided by an embodiment of the present application is shown in the following figure;

[0028] Figure 4 A flow chart of the laundry detecting method provided by another embodiment of the present application is shown in the following figure;

[0029] Figure 5 A structure diagram of the laundry detecting device provided by an embodiment of the present application is shown in the following figure;

[0030] Figure 6 A structure diagram of the laundry detecting device provided by another embodiment of the present application is shown in the following figure;

[0031] Figure 7 A schematic diagram of the electronic device provided by an embodiment of the present application is shown in the following figure. DETAILED DESCRIPTION

[0032] First of all, those skilled in the art should understand that these embodiments are only used to explain the technical principles of the present application, and are not intended to limit the protection scope of the present application. Those skilled in the art can make adjustments as needed in order to adapt to specific application occasions.

[0033] In addition, it should be noted that, in the description of the present application, unless otherwise explicitly specified and limited, the terms "connected", "connected" should be understood broadly, for example, it can be fixedly connected, or it can be detachably connected, or integrally connected; it can be mechanically connected, or it can be electrically connected; it can be directly connected, or it can be indirectly connected through an intermediate medium, or it can be the communication inside two components. Those skilled in the art can understand the specific meaning of the above terms in the present application according to the specific circumstances.

[0034] First, the terms involved in the present application are explained:

[0035] 1) Intelligent home appliance, refers to the home appliance product formed after introducing microprocessor, sensor technology, network communication technology into home appliance, which has the characteristics of intelligent control, intelligent perception and intelligent application. The operation process of intelligent home appliance often depends on the application and processing of modern technologies such as Internet of Things, Internet and electronic chips. For example, intelligent home appliance can realize remote control and management of intelligent home appliance by connecting electronic devices.

[0036] 2) terminal device, refers to an electronic device with wireless connection function, the terminal device can be connected with the smart home appliance device as above through connecting the Internet, and can also be connected with the smart home appliance device as above directly through Bluetooth, wifi and the like. In some embodiments, the terminal device is, for example, a mobile device, a computer, or a built-in vehicle device in a hovercar, or any combination thereof. The mobile device may, for example, include a mobile phone, a smart home device, a wearable device, a smart mobile device, a virtual reality device, or any combination thereof, wherein the wearable device may, for example, include a smart watch, a smart bracelet, a pedometer, and the like.

[0037] 3) "multiple" refers to two or more, and other quantifiers are similar. "And / or" describes the association between the associated objects, which means that there can be three relationships, for example, A and / or B, which can mean that A exists alone, A and B exist together, and B exists alone. The character " / " generally represents that the associated objects before and after are in an "or" relationship.

[0038] 4) "corresponding" can refer to an association or binding relationship. A and B correspond to each other means that A and B have an association or binding relationship.

[0039] The application scenarios of the embodiments of the present application are explained as follows:

[0040] Figure 1 An application scenario diagram of the laundry detection method provided by the embodiments of the present application is shown in FIG. 1. Figure 1 As shown in the figure, in this use scenario, the user puts the laundry into the smart washing machine, selects and starts the "automatic washing" function of the smart washing machine to perform the washing operation. After receiving the starting instruction sent by the user through the washing machine face or the terminal device, the smart washing machine detects the laundry and matches the best washing program according to the detection result to perform the washing operation.

[0041] In the related art, in order to realize fully automatic washing operation and improve the quality of laundry cleaning, the smart washing machine needs to detect the laundry, distinguish different types and colors of laundry, and match the best washing program. However, in the case that a large number of laundry to be washed is put into the washing machine, the laundry will be blocked between different laundry. It is difficult to accurately identify all the laundry through the camera arranged outside the drum to collect the image of the laundry. Therefore, the traditional method of detecting the laundry in the drum through image recognition can only realize the automatic washing operation of laundry detection, washing program matching for one to two pieces of laundry to be washed.

[0042] Therefore, for the above reasons, the intelligent washing machine in the prior art usually configures the washing parameters such as the amount of water, the amount of detergent and the washing time required for washing according to the detection results after detecting the clothes by image recognition technology, and determines the corresponding washing program according to such washing parameters. Because such washing parameters do not need to accurately determine the type, color and other information of each piece of clothing, they can be determined only by identifying the general type, volume and quantity of the clothes. However, for more accurate washing programs, such as the "sweater washing" program for washing sweaters and the "underwear washing" program for washing underwear, more accurate detection of the clothes is required. For example, in a specific example, the user accidentally mixed a sweater into the clothes to be washed in the washing machine, and because the sweater cannot be washed using the regular washing program and must be washed using the "sweater washing" program, otherwise the sweater will be damaged. In this case, the method of detecting clothes by image recognition technology in the prior art cannot accurately identify the type of each piece of clothing, so it cannot guarantee that the washing machine matches the correct "sweater washing" washing program, resulting in damage to the sweater mixed in the clothes to be washed during the washing process. Therefore, there is an urgent need for a more accurate clothes detection method that can accurately detect multiple pieces of clothes to be washed, thereby accurately matching special washing programs such as "sweater washing" and "underwear washing", and improving the washing effect of the clothes.

[0043] The technical solutions of the present application and how the technical solutions of the present application solve the above technical problems will be described in detail below with specific examples. The following specific examples can be combined with each other, and the same or similar concepts or processes may not be described again in some examples. The embodiments of the present application will be described below with reference to the accompanying drawings.

[0044] Figure 2 The flowchart of the clothes detection method provided by an embodiment of the present application is applied to an intelligent washing machine, as shown in the figure, the clothes detection method provided by the embodiment includes the following steps: Figure 2

[0045] Step S101, image acquisition is performed on the clothes to be washed in the washing machine drum to obtain first image information.

[0046] Exemplarily, a drum washing machine is taken as an example, a drum for containing and washing clothes, i.e. a washing machine drum, is provided in the intelligent washing machine, and the controller of the intelligent washing machine can control the rotation of the washing machine drum, thereby realizing the washing, dehydration and other processes of the clothes in the washing machine drum. In a possible implementation manner, an image acquisition unit, for example a camera, is provided in the intelligent washing machine, and the camera faces the inside of the washing machine drum to realize image acquisition of the clothes to be washed in the washing machine drum.​

[0047] Specifically, the timing of image collection of the laundry in the inner drum of the washing machine can be before the smart washing machine receives a user input indicating an instruction for the smart washing machine to perform a laundry operation, or before the smart washing machine performs a laundry operation according to a preset laundry plan, which is not limited here. The first image information obtained by image collection of the laundry in the inner drum of the washing machine is used to represent the characteristics of the laundry in the inner drum of the washing machine, for example, a picture or a video. Optionally, the number of times of image collection of the laundry in the inner drum of the washing machine by the smart washing machine can be one or multiple times.

[0048] In step S102, the position of the laundry in the inner drum of the washing machine is adjusted by rotating the inner drum of the washing machine according to the first image information.

[0049] Further, the first image information can be used to represent the shape characteristics and position characteristics of the laundry. Taking a photo of the laundry in the inner drum as an example, the first image information is used for image recognition to determine whether there is an occlusion between the laundry. If there is an occlusion between the laundry, the inner drum of the washing machine is controlled to rotate to change the position of the laundry. In one possible implementation, the occlusion between the laundry refers to the inability to locate the position of a piece of laundry. For example, according to the user input of the laundry parameters, it is determined that the total number of the laundry is 5, but after image recognition of the first image information, only 4 pieces of laundry are located, and it is determined that there is an occlusion between the laundry. In another possible implementation, the occlusion between the laundry refers to the ability to locate the position of the laundry, but the inability to identify the type of the laundry. The above two occlusion state implementation manners can be used as a condition for determining whether the laundry is in an occlusion state, which is not described here.

[0050] In step S103, the second image information is obtained by image collection of the laundry in the inner drum of the washing machine after rotation, and the laundry is detected according to the second image information.

[0051] Figure 3 A process diagram for image collection of the laundry is provided for the embodiments of the present application, as shown in Figure 3Exemplarily, after determining that the clothes are in the shielding state, the control of the washing machine inner drum is performed to rotate, so as to change the positions between the clothes. The image acquisition of the clothes in the washing machine inner drum is performed again at the same time or after the rotation of the washing machine inner drum, and the second image information is obtained. Exemplarily, the second image information is the picture of the clothes in the washing machine inner drum acquired by the camera. It is determined whether the clothes are still in the shielding state. If it is determined that the clothes are not in the shielding state, the type of the clothes can be directly determined according to the second image information, and the detection of the clothes is completed. If the clothes are in the shielding state, the rotation of the washing machine inner drum is continuously controlled, and the second image information is obtained. In the process of continuous rotation, the shape features of new clothes are provided in the second image information acquired each time. Through the continuous acquisition of the second image information, the extraction and fusion of the shape features of the clothes are performed, and the type information of all the clothes to be washed can be gradually recognized, that is, the clothes are in the non-shielding state. It should be noted that the non-shielding state referred to herein does not mean that the clothes in the clothes to be washed are completely separated in the physical space, but means that through the acquisition of one or more second image information, the superposition of the shape features of the clothes from different angles is used to make the clothes in a recognizable state, and finally, the accurate detection of the clothes in the clothes to be washed is realized.

[0052] In the embodiment, the first image information is obtained by image acquisition of the clothes to be washed in the washing machine inner drum. The rotation of the washing machine inner drum is controlled according to the first image information, so as to adjust the position of the clothes to be washed in the washing machine inner drum. The second image information is obtained by image acquisition of the clothes to be washed in the rotated washing machine inner drum, and the clothes detection is performed according to the second image information. Since the first image information is acquired by pre-acquisition before the detection of the clothes in the washing machine, the situation of the clothes in the washing machine inner drum is analyzed, and the rotation of the washing machine inner drum is controlled to adjust the position of the clothes in the washing machine, so as to obtain the second image information which can better represent the features of the clothes. According to the second image information, the recognition rate of the clothes in the washing machine can be improved, the recognition effect can be improved, and the safety of the washing machine can be better ensured, and the washing program can be accurately matched.

[0053] Figure 4 The flow chart of the washing machine clothes detection method provided by another embodiment of the present application is shown in Figure 4 The washing machine clothes detection method provided by the embodiment is based on the washing machine clothes detection method provided by the embodiment shown in Figure 2 The washing machine clothes detection method provided by the embodiment includes the following steps:

[0054] In step S201, the first image information is obtained by image acquisition of the clothes to be washed in the washing machine inner drum.

[0055] In step S202, occlusion information of the laundry to be washed is determined according to the first image information, the occlusion information being used to represent the occlusion degree between each piece of laundry.

[0056] For example, the occlusion information is information describing the occlusion state between each piece of laundry, and the occlusion information includes, for example, an occlusion coefficient. The higher the occlusion coefficient, the greater the occlusion degree between each piece of laundry, i.e., the more difficult it is to identify the laundry to be washed. Correspondingly, the smaller the occlusion coefficient, the smaller the occlusion degree between each piece of laundry, i.e., the easier it is to identify the laundry to be washed. Further, the occlusion coefficient can be determined by the result of image recognition. For example, the higher the confidence of the recognition result of a target object in the first image information, the smaller the occlusion coefficient, and vice versa.

[0057] In step S203, the rotation program of the inner drum of the washing machine is determined according to the occlusion information.

[0058] In step S204, the rotation of the inner drum of the washing machine is controlled according to the rotation program of the inner drum of the washing machine.

[0059] Specifically, the occlusion information is used to represent the occlusion degree between each piece of laundry. When the occlusion degree between each piece of laundry is large, it corresponds to the situation in the real scene, i.e., the laundry in the inner drum of the washing machine is intertwined together, and it is impossible to separate the seriously intertwined laundry by simply controlling the inner drum to rotate by a certain angle, so as to realize the identification of the laundry. Therefore, when the occlusion degree between each piece of laundry is large, i.e., the pieces of laundry are seriously intertwined, the inner drum of the washing machine needs to be rotated at high speed or variable speed, so as to separate the intertwined laundry and expose more features of each piece of laundry, thereby improving the identification speed and identification accuracy of the laundry.

[0060] Further, exemplarily, the washing machine inner drum rotation program is used to control the inner drum rotation speed and / or the inner drum rotation angle. Specifically, according to the occlusion information, the smart washing machine determines the corresponding washing machine inner drum rotation program, so that the washing machine inner drum rotates at different rotation speeds and rotates different angles. In a more specific embodiment, the occlusion coefficient in the occlusion information has a preset mapping relationship with the washing machine inner drum rotation program. For example, when the occlusion coefficient is 0.2, according to the preset mapping table, the washing machine inner drum rotation program A is determined, and the washing machine inner drum is controlled to rotate at a speed of 0.3 revolutions per second and rotate 90 degrees; when the occlusion coefficient is 0.8, according to the preset mapping table, the washing machine inner drum rotation program B is determined, and the washing machine inner drum is controlled to rotate at a speed of 3 revolutions per second and rotate 90 degrees, then stop for 0.5 seconds, and repeat the process 5 times. Wherein, the mapping relationship between different washing machine inner drum rotation programs and occlusion information is related to different inner drum structures, which can be preset by the smart washing machine when it is shipped, or can be set by the user according to needs, which will not be described here.

[0061] In this embodiment, by determining the corresponding washing machine inner drum rotation program according to the occlusion information, and controlling the washing machine inner drum to rotate at a matching inner drum rotation angle and inner drum rotation speed, the rotation of the inner drum can better expose the shape features of the clothes, and improve the efficiency and accuracy of clothes detection.

[0062] In a possible implementation, determining the washing machine inner drum rotation program further includes:

[0063] Obtaining the weight information of the clothes to be washed in the washing machine inner drum; determining the washing machine inner drum rotation program according to the occlusion information of the clothes to be washed and the weight information of the clothes to be washed.

[0064] Exemplarily, the purpose of the washing machine inner drum rotation is to change the position of the clothes in the washing machine inner drum, so as to better collect image information and identify the type of clothes. When there are more clothes in the inner drum, the occlusion between the clothes is more complex. Therefore, in order to better identify the type of each clothes, the weight information of the clothes to be washed is collected to determine the amount of clothes. When the weight of the clothes to be washed is large, a larger rotation speed and rotation angle can be used to make the washing machine inner drum rotate fully, so that the position of the clothes can change obviously, thereby more shape features of the clothes are exposed, and the second image information collected can include more shape features of the clothes, thereby improving the speed and accuracy of clothes identification.

[0065] In the embodiment, the weight information of the laundry is acquired, and the rotation program of the inner drum of the washing machine is determined according to the occlusion information of the laundry and the weight information of the laundry, so that the rotation program of the inner drum of the washing machine can be matched with the appropriate weight of the laundry, the rotation of the inner drum of the washing machine is more sufficient, the number of effective shape features of the laundry collected in the second image information is increased, the number of times of collecting the second image information is reduced, and the effect of improving the detection efficiency of the laundry is achieved.

[0066] In step S205, the image of the laundry in the rotated inner drum of the washing machine is collected to obtain second image information, and the second image information is subjected to image recognition to determine the corresponding color and / or type of each piece of laundry.

[0067] Specifically, the position of the laundry in the rotated inner drum of the washing machine has changed, so that the shape features of the laundry that cannot be obtained when the laundry is in the occlusion state between the clothes before can be obtained through the collected second image information. Further, the image recognition using the second image information can realize the recognition of the laundry, specifically including the recognition of the color and type of the laundry.

[0068] In step S206, a corresponding washing program is enabled according to the corresponding color and / or type of each piece of laundry.

[0069] Specifically, the intelligent washing machine is provided with some special washing programs designed for specific types and colors of laundry. For example, a "sweater washing" program specially used for washing sweaters to prevent deformation and shrinkage of the sweaters; and for example, a "colored laundry washing" program specially used for washing easily-fading clothes. The "sweater washing" program needs to be called after determining the type of the laundry, and the "colored laundry washing" program needs to be called after determining the color of the laundry.

[0070] In this embodiment, by recognizing the clothes, determining the clothes type and clothes color, accurate matching of special washing programs can be realized. Since special washing programs are often for specific washing scenarios and specific clothes types, such as the "sweater cleaning" program and the "colored clothes cleaning" program in the above examples, if the clothes type and clothes color of each piece of clothes in the clothes to be washed cannot be accurately detected, and the clothes are detected by the conventional image detection technology in the prior art, if a sweater is missed and the "sweater cleaning" program is not used, the sweater will be damaged, and if a colored clothes is missed and the "colored clothes cleaning" program is not used, all clothes will be dyed. Therefore, in this embodiment, the technical feature of controlling the rotation of the inner drum of the washing machine by the first image information is combined with the collection of the second image information for image recognition to obtain the clothes type and clothes color, and a special washing program is determined for clothes cleaning accordingly, realizing truly automatic clothes washing operation, avoiding the process of manual pre-selection of clothes to be washed by the user due to the inability to accurately detect each piece of clothes, and improving the washing efficiency and washing effect.

[0071] In step S207, the second image information is subjected to image recognition to determine whether there is a living organism in the inner drum of the washing machine.

[0072] Specifically, the intelligent washing machine is a commonly used household appliance. In a family with pets and babies, if a pet or a baby or other living organisms enter the inner drum of the washing machine, the washing machine will cause great harm to the above-mentioned living organisms and trigger a safety accident after starting to fill water and perform washing operation. Therefore, before the washing machine performs a washing program for operation, the intelligent washing machine can detect the hidden living organisms in the clothes to be washed by image recognition based on the second image information. In some special scenarios, for example, in a room with low temperature, pets and other living organisms will enter the clothes in the inner drum of the washing machine for rest due to the purpose of warming, so in this scenario, the traditional clothes detection method based on image detection is difficult to find the living organisms hidden under the clothes because it is a static image acquisition, resulting in missed detection of the living organisms. In this embodiment, since the inner drum of the washing machine is rotated by the first image information in the above-mentioned step, the living organisms hidden in the clothes will be alerted and move out of the clothes, so that such living organisms hidden in the clothes can be better found, and the detection effect of the living organisms is improved.

[0073] In this embodiment, the implementation manner of step S201 is the same as that of step S101 in the embodiment of the present application Figure 2 shown in the embodiment of the present application, which will not be described one by one here.

[0074] Figure 5 The structure diagram of the clothes detection device of the washing machine provided in an embodiment of the present application is applied to an intelligent washing machine, such asFigure 5 As shown in the method embodiment, the laundry detection device 3 provided by the embodiment includes:

[0075] The image acquisition module 31 is configured to acquire images of the laundry in the inner drum of the washing machine to obtain first image information.

[0076] The control module 32 is configured to control rotation of the inner drum of the washing machine according to the first image information to adjust the position of the laundry in the inner drum of the washing machine.

[0077] The image acquisition module 31 is further configured to acquire images of the laundry in the inner drum of the washing machine after rotation to obtain second image information.

[0078] The detection module 33 is configured to perform laundry detection according to the second image information.

[0079] The image acquisition module 31, the control module 32, and the detection module 33 are sequentially connected. The laundry detection device 3 provided by the embodiment can perform the technical solutions of the method embodiment as shown in the method embodiment, and the implementation principles and technical effects are similar, which will not be described herein again. Figure 2

[0080] As shown in the structural diagram of the laundry detection device of another embodiment of the present application, the laundry detection device 4 provided by the embodiment is based on the laundry detection device of the washing machine as shown in the laundry detection device of the washing machine, and the weight acquisition module 41 is added as shown in the laundry detection device of the washing machine. Figure 6 Figure 5 Figure 6

[0081] In a possible implementation manner, the control module 32 is specifically configured to: determine occlusion information of the laundry to be washed according to the first image information, the occlusion information being used to represent the occlusion degree between each piece of laundry; determine a rotation program of the inner drum of the washing machine according to the occlusion information; and control rotation of the inner drum of the washing machine according to the rotation program of the inner drum of the washing machine.

[0082] In a possible implementation manner, the rotation program of the inner drum of the washing machine is used to control at least one of the following: a rotation speed of the inner drum, and a rotation angle of the inner drum.

[0083] In a possible implementation manner, the laundry detection device 4 further includes the weight acquisition module 41, which is configured to: acquire weight information of the laundry in the inner drum of the washing machine; and determine the rotation program of the inner drum of the washing machine according to the occlusion information, including: determining the rotation program of the inner drum of the washing machine according to the occlusion information of the laundry to be washed and the weight information of the laundry to be washed.

[0084] In a possible implementation manner, the detection module 33 is specifically configured to: perform image recognition on the second image information to determine the corresponding laundry color and / or the laundry type of each piece of laundry.​​​

[0085] In a possible implementation, the control module 32 is further configured to: according to the clothes color and / or the clothes type of each clothes in the clothes to be washed, enable a corresponding clothes washing program.

[0086] In a possible implementation, the detection module 33 is further configured to: perform image recognition on the second image information, and determine whether there is a living organism in the inner drum of the washing machine.

[0087] The image acquisition module 31, the control module 32 and the detection device 33 are connected in sequence. The washing machine clothes detection device 3 provided in the embodiment can perform the technical solutions of the method embodiments as shown in Figure 2 The implementation principles and technical effects are similar, and will not be repeated here.

[0088] The weight acquisition module 41 is connected with the control module 32. The washing machine clothes detection device 4 provided in the embodiment can perform the technical solutions of the method embodiments as shown in Figures 2-4 The implementation principles and technical effects are similar, and will not be repeated here.

[0089] Figure 7 The schematic diagram of the electronic device provided in an embodiment of the present application is shown in Figure 7 The electronic device provided in the embodiment includes a memory 51, a processor 52 and a computer program.

[0090] The computer program is stored in the memory 51 and is configured to be executed by the processor 52 to implement the washing machine clothes detection method provided in any one of the embodiments of the present application. Figures 2-4

[0091] The memory 51 and the processor 52 are connected through a bus 53.

[0092] The related description can be understood in correspondence with the related description and effects of the steps in the embodiments of the present application, and will not be repeated here. Figures 2-4 The related description can be understood in correspondence with the related description and effects of the steps in the embodiments of the present application, and will not be repeated here.

[0093] An embodiment of the present application provides a computer readable storage medium, which stores a computer program, and the computer program is executed by a processor to implement the washing machine clothes detection method provided in any one of the embodiments of the present application. Figures 2-4

[0094] The computer readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk and an optical data storage device, etc.

[0095] ​​In several embodiments provided by the present application, it should be understood that the disclosed apparatus and method can be implemented in other manners. For example, the division of the above-described apparatus embodiments is merely a logical function division, and there can be another division manner for the actual implementation, for example, multiple modules or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the displayed or discussed mutual couplings or direct couplings or communication connections between different modules can be indirect couplings or communication connections through some interfaces, devices or modules, and can be in electrical, mechanical or other forms.

[0096] Other embodiments of the application will be apparent to those skilled in the art from consideration of the specification and practice of the application disclosed herein. It is intended that the present application cover any and all variations of the application that come within the scope of the present application, including custom and practice of the art known to those of ordinary skill in the art, or any subsequent development within the art. The specification and examples are to be construed as merely illustrative of the present application and not limitative of the true scope and spirit of the application, which is measured by the claims.

[0097] It is to be understood that the application is not limited to the precise construction herein described and as shown in the attached drawings, and that various modifications and changes can be made by those skilled in the art without departing from the scope of the present application. The scope of the application is to be defined by the claims appended hereto.

[0098] So far, the technical solutions of the present application have been described in combination with the preferred embodiments shown in the drawings, but it is easy for those skilled in the art to understand that the protection scope of the present application is obviously not limited to these specific embodiments. Those skilled in the art can make equivalent changes or replacements to the related technical features without departing from the principles of the present application, and the technical solutions after the changes or replacements will all fall within the protection scope of the present application.

Claims

1. A laundry detecting method for a laundry machine, characterized by, The method comprises: image acquisition of the laundry in the washing machine inner drum to obtain first image information; controlling the rotation of the washing machine inner drum according to the first image information to adjust the position of the laundry in the washing machine inner drum; image acquisition of the laundry in the rotated washing machine inner drum to obtain second image information; determining whether the laundry is in a shielding state, if it is determined that the laundry is in a shielding state, continuing to control the rotation of the washing machine inner drum and image acquisition of the laundry in the rotated washing machine inner drum to obtain second image information; until the laundry is in a non-shielding state; performing laundry detection according to the second image information; wherein the non-shielding state refers to that through acquisition of one or more second image information, the superposition of the shape characteristics of each angle of the laundry is used to make each laundry in the laundry identifiable; controlling the rotation of the washing machine inner drum according to the first image information comprises: determining shielding information of the laundry according to the first image information, the shielding information being used to represent the shielding degree between each laundry in the laundry; determining a washing machine inner drum rotation program according to the shielding information; controlling the rotation of the washing machine inner drum according to the washing machine inner drum rotation program; obtaining weight information of the laundry in the washing machine inner drum; determining a washing machine inner drum rotation program according to the shielding information comprises: determining a washing machine inner drum rotation program according to the shielding information of the laundry and the weight information of the laundry.

2. The method of claim 1, wherein, The washing machine inner drum rotation program is used to control at least one of the following: inner drum rotation speed, inner drum rotation angle.

3. The method according to claim 1 or 2, characterized in that, performing laundry detection according to the second image information comprises: performing image recognition on the second image information to determine the corresponding laundry color and / or laundry type of each laundry in the laundry.

4. The method of claim 3, wherein, The method further comprises: enabling a corresponding washing program according to the corresponding laundry color and / or laundry type of each laundry in the laundry.

5. The method according to claim 1 or 2, characterized in that, performing laundry detection according to the second image information comprises: performing image recognition on the second image information to determine whether there is a living organism in the washing machine inner drum.

6. A laundry detecting device for a laundry machine, characterized by, The device comprises: an image acquisition module for image acquisition of the laundry in the washing machine inner drum to obtain first image information; a control module for controlling the rotation of the washing machine inner drum according to the first image information to adjust the position of the laundry in the washing machine inner drum; The image acquisition module is further configured to acquire images of the laundry in the rotating washing machine inner drum to obtain second image information; determine whether the laundry is in a shielding state, and if it is determined that the laundry is in the shielding state, continue to control the washing machine inner drum to rotate and acquire images of the laundry in the rotating washing machine inner drum to obtain second image information; and until the laundry is in a non-shielding state; wherein the non-shielding state refers to that through acquisition of one or more second image information, the laundry in the laundry is in a recognizable state by superposition of the shape features of each angle of the laundry; The detection device is configured to detect the laundry according to the second image information; The control module is specifically configured to: determine shielding information of the laundry according to the first image information, wherein the shielding information is used to represent the shielding degree between each piece of laundry in the laundry; determine a washing machine inner drum rotation program according to the shielding information; and control the washing machine inner drum to rotate according to the washing machine inner drum rotation program. The laundry detection device of the washing machine further includes a weight acquisition module configured to: acquire weight information of the laundry in the washing machine inner drum; determine a washing machine inner drum rotation program according to the shielding information, including: determine a washing machine inner drum rotation program according to the shielding information and the weight information of the laundry.

7. An electronic device, comprising: including: a memory, a processor and a computer program; wherein the computer program is stored in the memory and is configured to be executed by the processor to implement the laundry detection method of the washing machine according to any one of claims 1 to 5.

8. A computer-readable storage medium, characterized in that, The computer readable storage medium stores computer execution instructions, and the computer execution instructions are executed by the processor to implement the laundry detection method of the washing machine according to any one of claims 1 to 5.

Images