A washing machine and a method, device, equipment and medium for controlling the washing machine

Abstract

The embodiment of the present invention provides a washing machine and a control method, device, equipment, and medium for the washing machine, wherein the washing machine at least comprises: an inner drum, and the inner drum is arranged inside the washing machine; a front door, and the front door is arranged at the clothing entrance of the washing machine; a main camera module, and the camera module is arranged on the side of the front door close to the inner drum; wherein the camera module at least comprises a main camera and a light strip, and the light strip is arranged in the central area of ​​the front door and the light strip is annular, and the main camera is arranged in the central area of ​​the light strip; an auxiliary camera, and the auxiliary camera is arranged at one end of the front door away from the main camera module; and an inner drum reflective surface, which is arranged at the bottom of the inner drum and is a fan-shaped reflective surface. Not only can the light strip arranged around the camera be used to fill in the light for the camera, thereby improving the clarity of the image captured by the camera, but the auxiliary camera can also promptly confirm the occlusion of the main camera, and can promptly process the occlusion, thereby improving the quality and efficiency of data collection.

Description

Technical Field

[0001] The present invention relates to the technical field of washing machine control, and in particular to a washing machine and a control method, device, equipment and medium for the washing machine. Background Art

[0002] With the improvement of people's living standards and the continuous development of related technologies, washing machines have become an indispensable household appliance in people's lives and have brought great convenience to daily life.

[0003] With the rapid development of smart homes, washing machines are also developing rapidly in the direction of intelligence. Many high-end washing machines have come into being. Technologies such as artificial intelligence, image recognition, and edge learning are increasingly being used in various smart home appliance washing machines.

[0004] The above technology generally collects data through a camera, but the environment inside the washing machine drum is complex and dim, the image collected by the camera has the disadvantage of low clarity, and the camera can be easily blocked by various objects inside the washing machine, seriously affecting the quality of data collection. Summary of the invention

[0005] In view of the above problems, a washing machine and a control method, device, equipment, and medium for washing machine are proposed to overcome the above problems or at least partially solve the above problems, including:

[0006] A washing machine, comprising at least:

[0007] An inner drum, the inner drum being arranged inside the washing machine;

[0008] A front door, the front door being arranged at the clothing entrance of the washing machine;

[0009] A main camera module, the camera module is arranged on a side of the front door close to the inner tube; wherein the camera module at least includes a main camera and a light strip, the light strip is arranged in the central area of ​​the front door and the light strip is annular, and the main camera is arranged in the central area of ​​the light strip;

[0010] An auxiliary camera, the auxiliary camera is arranged at one end of the front door away from the main camera module;

[0011] The inner cylinder reflective surface is arranged at the bottom of the inner cylinder, and the inner cylinder reflective surface is a fan-shaped reflective surface; wherein, the number of the inner cylinder reflective surfaces is 3, and the fan-shaped angle of the inner cylinder reflective surface is 120°.

[0012] Optionally, the washing machine further comprises:

[0013] An outer cylinder, the outer cylinder is arranged around the outer side of the inner cylinder;

[0014] A spray pipe is connected to the outer cylinder, and a spray direction of the spray pipe is the direction of the main camera module.

[0015] Optionally, the camera module further includes:

[0016] A light strip reflector, the light strip reflector is arranged between the light strip and the main camera:

[0017] The mounting plate, the light strip reflector, the light strip and the main camera are connected to the front door through the mounting plate.

[0018] A method for controlling a washing machine, the washing machine at least comprising: an inner drum, the inner drum being arranged inside the washing machine; a front door, the front door being arranged at the entrance of clothes of the washing machine; a main camera module, the camera module being arranged on a side of the front door close to the inner drum; wherein the camera module at least comprises a main camera and a light belt, the light belt being arranged in a central area of ​​the front door and being annular, the main camera being arranged in the central area of ​​the light belt; an auxiliary camera, the auxiliary camera being arranged at an end of the front door away from the main camera module; the method comprising:

[0019] In response to the operation of putting clothes in, turning on the main camera and the light strip, and controlling the inner drum to rotate at a preset speed;

[0020] Controlling the main camera to capture images of the clothing according to a first preset time to obtain a first image capture result;

[0021] Determining whether the main camera is blocked according to the first image acquisition result;

[0022] When it is determined that the main camera is blocked, the auxiliary camera is turned on, and the auxiliary camera is used to shoot the main camera and the surrounding position of the main camera to obtain a shooting result;

[0023] Determining, according to the shooting result, a reason why the main camera is blocked, and controlling the washing machine according to the reason for the blockage;

[0024] When it is determined that the main camera is not blocked, controlling the main camera to capture an image of the clothing according to a second preset time to obtain a second image capture result;

[0025] The washing machine is controlled according to the second image acquisition result.

[0026] Optionally, the washing machine further includes: an outer drum, the outer drum is arranged around the outer side of the inner drum; a spray pipe, the spray pipe is connected to the outer drum, and the spray direction of the spray pipe is the direction of the main camera module; the controlling of the washing machine according to the blocking reason includes:

[0027] When the occlusion is caused by foam occlusion, controlling the spray pipe to spray the main camera module;

[0028] Determine whether the water level in the washing machine is higher than the main camera, and activate the drainage function of the washing machine when the water level is higher than the main camera;

[0029] When the water level is lower than that of the main camera, the step of controlling the main camera to capture images of the clothing according to the first preset time to obtain a first image capture result is performed again.

[0030] Optionally, the method further includes:

[0031] When the obstruction is caused by water, the drainage function of the washing machine is turned on, and when the water level is lower than that of the main camera, the step of controlling the main camera to capture images of the clothes according to the first preset time is performed again to obtain a first image capture result.

[0032] Optionally, the method further includes:

[0033] When the occlusion is caused by clothing, the dehydration function of the washing machine is turned on, and after the dehydration is completed, the step of controlling the main camera to capture images of the clothing according to the first preset time is performed again to obtain a first image capture result.

[0034] Optionally, the method further includes:

[0035] When the blocking reason does not include any one or more of clothing blocking, water blocking and foam blocking, the washing machine is controlled to issue an alarm prompt message.

[0036] A washing machine control device, the washing machine at least comprising: an inner drum, the inner drum being arranged inside the washing machine; a front door, the front door being arranged at the clothing entrance of the washing machine; a main camera module, the camera module being arranged on a side of the front door close to the inner drum; wherein the camera module at least comprises a main camera and a light belt, the light belt being arranged in a central area of ​​the front door and being annular, the main camera being arranged in the central area of ​​the light belt; an auxiliary camera, the auxiliary camera being arranged at one end of the front door away from the main camera module; the device comprising:

[0037] An inner drum rotation module, used for turning on the main camera and the light strip in response to a clothing putting-in operation, and controlling the inner drum to rotate at a preset speed;

[0038] A first image acquisition result acquisition module, used to control the main camera to acquire images of the clothing according to a first preset time to obtain a first image acquisition result;

[0039] An occlusion judgment module, used to judge whether the main camera is blocked according to the first image acquisition result;

[0040] A shooting result acquisition module, used to turn on the auxiliary camera when it is determined that the main camera is blocked, and shoot the main camera and the surrounding position of the main camera through the auxiliary camera to obtain the shooting result;

[0041] a first washing machine control module, configured to determine a reason why the main camera is blocked according to the shooting result, and control the washing machine according to the reason;

[0042] A second image acquisition result acquisition module is used to control the main camera to acquire an image of the clothing according to a second preset time to obtain a second image acquisition result when it is determined that the main camera is not blocked;

[0043] The second washing machine control module is used to control the washing machine according to the second image acquisition result.

[0044] Optionally, the washing machine further includes: an outer drum, the outer drum is arranged around the outer side of the inner drum; a spray pipe, the spray pipe is connected to the outer drum, and the spray direction of the spray pipe is the direction of the main camera module; the first washing machine control module includes:

[0045] A spray processing submodule, used for controlling the spray pipe to spray the main camera module when the occlusion cause is foam occlusion;

[0046] a first drainage function activation submodule, used to determine whether the water level in the washing machine is higher than the main camera, and activate the drainage function of the washing machine when the water level is higher than the main camera;

[0047] The re-execution submodule is used to re-execute the step of controlling the main camera to capture images of the clothes according to the first preset time to obtain the first image capture result when the water level is lower than the main camera.

[0048] Optionally, the first washing machine control module further includes:

[0049] The second drainage function submodule is used to turn on the drainage function of the washing machine when the obstruction is caused by water, and when the water level is lower than that of the main camera, again execute the step of controlling the main camera to capture images of the clothes according to the first preset time to obtain the first image capture result.

[0050] Optionally, the first washing machine control module further includes:

[0051] The dehydration function activation submodule is used to activate the dehydration function of the washing machine when the occlusion reason is due to clothing occlusion, and after the dehydration is completed, execute again the step of controlling the main camera to capture images of the clothing according to the first preset time to obtain the first image capture result.

[0052] Optionally, the first washing machine control module further includes:

[0053] The alarm prompt submodule is used to control the washing machine to issue an alarm prompt message when the blocking reason does not include any one or more of clothing blocking, water blocking and foam blocking.

[0054] An electronic device comprises a processor, a memory and a computer program stored in the memory and capable of running on the processor, wherein the computer program implements the washing machine control method as described above when executed by the processor.

[0055] A computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the washing machine control method described above is implemented.

[0056] The embodiments of the present invention have the following advantages:

[0057] The present invention provides a washing machine, which at least comprises: an inner drum, which is arranged inside the washing machine; a front door, which is arranged at the entrance of the clothes of the washing machine; a main camera module, which is arranged on the side of the front door close to the inner drum; wherein the camera module at least comprises a main camera and a light belt, which is arranged in the central area of ​​the front door and is annular, and the main camera is arranged in the central area of ​​the light belt; an auxiliary camera, which is arranged at one end of the front door away from the main camera module; an inner drum reflective surface, which is arranged at the bottom of the inner drum and is a fan-shaped reflective surface; wherein the number of the inner drum reflective surfaces is 3 and the fan angle of the inner drum reflective surface is 120°. Not only can the camera be supplemented with light by the light belt arranged around the camera to improve the clarity of the image collected by the camera, but also the actual occlusion of the main camera can be confirmed in time by the auxiliary camera, so that the occlusion can be processed in time, thereby improving the data collection quality and efficiency of the camera, and thus improving the laundry experience of the user. BRIEF DESCRIPTION OF THE DRAWINGS

[0058] In order to more clearly illustrate the technical solution of the present invention, the accompanying drawings required for use in the description of the present invention will be briefly introduced below. Obviously, the accompanying drawings in the following description are only some embodiments of the present invention. For ordinary technicians in this field, other accompanying drawings can be obtained based on these accompanying drawings without paying creative labor.

[0059] Figure 1 is a schematic diagram of the overall structure of a washing machine provided by some embodiments of the present invention;

[0060] Figure 2 is a schematic diagram of overall control relationship of a washing machine provided by some embodiments of the present invention;

[0061] Figure 3 is a schematic diagram of camera-related structures provided by some embodiments of the present invention;

[0062] Figure 4 is a schematic diagram of the auxiliary camera judgment process provided by some embodiments of the present invention;

[0063] Figure 5 is a schematic diagram of the bottom structure of the inner drum of a washing machine provided by some embodiments of the present invention;

[0064] Figure 6 is a flowchart of steps of a washing machine control method provided by some embodiments of the present invention;

[0065] Figure 7 is a schematic diagram of the overall execution flow of the washing machine control method of the present invention provided by some embodiments of the present invention;

[0066] Figure 8It is a structural schematic diagram of a washing machine control device provided by some embodiments of the present invention. DETAILED DESCRIPTION

[0067] In order to make the above-mentioned purposes, features and advantages of the present invention more obvious and easy to understand, the present invention is further described in detail below in conjunction with the accompanying drawings and specific embodiments. Obviously, the described embodiments are part of the embodiments of the present invention, rather than all the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0068] In the embodiments of the present application, words such as "first" and "second" are used to distinguish between identical or similar items with basically the same functions and effects. This is only for the purpose of clearly describing the technical solutions of the embodiments of the present application, and shall not be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features.

[0069] In the embodiments of the present application, the terms "upper", "lower", etc. indicate orientations or positional relationships based on the orientations or positional relationships shown in the accompanying drawings, and are only for the convenience of describing the present application and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore should not be understood as a limitation on the present application.

[0070] With the improvement of people's living standards and the continuous development of related technologies, washing machines have become an indispensable household appliance in people's lives and have brought great convenience to daily life.

[0071] With the rapid development of smart homes, washing machines are also developing rapidly in the direction of intelligence. Many high-end washing machines have come into being. Technologies such as artificial intelligence, image recognition, and edge learning are increasingly being used in various smart home appliance washing machines.

[0072] The above technology generally collects data through a camera, but the environment inside the washing machine drum is complex and dim, the image collected by the camera has the disadvantage of low clarity, and the camera can be easily blocked by various objects inside the washing machine, seriously affecting the quality of data collection.

[0073] In order to solve the above problems, the present invention improves the washing machine in the related art based on the core technical concept of using a main camera in combination with an auxiliary camera. The present invention will be described in detail below with reference to the accompanying drawings:

[0074] Reference Figure 1 , shows a schematic diagram of the overall structure of a washing machine provided by some embodiments of the present invention, the washing machine at least comprising:

[0075] An inner drum 2, wherein the inner drum 2 is arranged inside the washing machine;

[0076] A front door 3, wherein the front door 3 is arranged at the clothing entrance of the washing machine;

[0077] A main camera module 4, the camera module 4 is arranged on a side of the front door 3 close to the inner tube 2; wherein the camera module 4 at least includes a main camera 41 and a light strip 42, the light strip 42 is arranged in the central area of ​​the front door 3 and the light strip 42 is annular, and the main camera 41 is arranged in the central area of ​​the light strip 42;

[0078] An auxiliary camera 10, wherein the auxiliary camera 10 is disposed at an end of the front door 3 away from the main camera module 4;

[0079] The inner tube reflective surface 6 is arranged at the bottom of the inner tube 2, and the inner tube reflective surface 6 is a fan-shaped reflective surface; wherein the number of the inner tube reflective surfaces 6 is 3, and the fan-shaped angle of the inner tube reflective surface 6 is 120°.

[0080] In the specific implementation, Figure 2 The figure shows the overall control relationship diagram of the washing machine provided by the embodiment of the present invention. The control module of the washing machine may include an image recognition algorithm module, a logic storage module, a data recording module and a motor control module. The image recognition algorithm module may be used to receive the clothing position picture information taken by the camera, perform image analysis to obtain the clothing image situation, and send it to the data recording module; the data recording module may be used to store the clothing position picture, and transmit the picture to the logic control module for processing in sequence, and store information such as the motor speed and the washing process; the logic storage module may be used to store the washing machine control program, including basic logic such as washing and drying, and the motor control algorithm. After receiving the clothing image acquisition situation sent by the data recording module, it may decide whether to turn on the auxiliary camera to execute the relevant process, and control the main camera and the light strip switch.

[0081] Further, such as Figure 1As shown, the overall structure of the washing machine may include: an outer drum 1, which may be connected to the outer shell of the washing machine through an outer drum support 7; an inner drum 2, which is the main washing component inside the washing machine, and whose front end is supported by the outer drum 1, and whose rear end is connected to the motor M by a hub through a belt; a front door 3, which may be arranged at the clothing entrance of the washing machine, and may be installed with a main camera module 4 and its connecting arm to make an electrical connection between the main camera module 4 and the washing machine; a main camera module 4, which may be fixed to a side of the front door 3 close to the inner drum 2 through a connecting arm, and be electrically connected to the washing machine; a front panel 5, which has an opening for loading and unloading clothing, and may be connected to the front end of the inner drum 2 of the washing machine; an inner drum reflective surface 6, the bottom of the inner drum 2 is polished with three inner drum reflective surfaces at 120°, so that it can be used to fill in the light for the camera and provide an environment for collecting multi-angle clothing pictures at a single time; an outer drum support 7, which is used to reduce the vibration of the outer drum 1 and is hinged to the base of the washing machine. The spray pipe 8 is installed on the outer tube 1, and the spray direction can be directly facing the main camera module 4, which can be used for washing water replenishment and cleaning the main camera module 4; the water inlet valve 9 can be used to control the main wash water inlet and the spray pipe 8 switch, and the water inlet valve 9 can be connected to the faucet and the spray pipe 8 on the rear panel of the washing machine.

[0082] Further, such as Figure 3 The figure shows a schematic diagram of the camera structure provided by some embodiments of the present invention; wherein the main camera module 4 is installed in the center of the front door glass bowl (i.e., the front door 3) through a connecting arm, and the connecting arm can be used for fixing and electrical connection, and the main camera module 4 can be used to collect images of the inner drum clothes and the reflective surface of the inner drum; the main camera module 4 structure can include a main camera 41, a light belt 42, a light belt reflector 43 and a mounting plate 44; wherein the light belt reflector 6 can be a tin-surface reflector, which can be arranged around the main camera 41 to prevent the light belt from being too bright and directly acting on the camera to cause overexposure, and play a role in reflecting light into the inner drum 2 of the washing machine. The light belt 42 can be installed on the periphery of the light belt reflector 6, also in the central area of ​​the front door 3, and the light belt 42 can be set in a ring shape; the auxiliary camera 10 and its electrical components can be installed on the top of the front door 3, i.e., at the end away from the main camera module 4, and the auxiliary camera 10 can be used to collect image information of the main camera and the surrounding environment.

[0083] On this basis, after the user puts clothes in and starts the washing machine, the main camera 41 of the washing machine and the surrounding light strip 42 can be turned on through the control module to prepare for image acquisition. The inner drum 2 can be controlled to rotate at a certain speed (the speed can be set to 60rpm in this embodiment) to capture the image of the clothes. Three pictures can be collected per second and for 5 seconds, that is, 15 pictures are collected and sent to the image recognition algorithm module. It should be noted that this process can occur in all stages where image analysis is required for adjusting the rotation speed or executing special processes, such as clothing classification and weighing. After the main camera 41 captures the image and sends it to the image recognition algorithm module, a preliminary image segmentation and analysis can be performed to determine whether the main camera 41 is blocked, that is, whether the collected image is valid. If the collected image is invalid, an invalid acquisition signal can be sent to the control module. After receiving the invalid acquisition signal sent by the image recognition algorithm module, the control module can execute the following steps. Figure 4 The auxiliary camera judgment sub-process shown, that is, the auxiliary camera 10 can be turned on, and the auxiliary camera 10 can be used to shoot the main camera 41 and the surrounding positions of the main camera 41 to obtain the shooting results, and then the shooting results are sent to the image analysis algorithm module for processing to obtain the analysis results, and the image analysis algorithm module sends the analysis results to the logic processing module to determine the reason for the obstruction of the main camera 41, so as to perform subsequent control of the washing machine according to the obstruction reason.

[0084] Specifically, Figure 4 The auxiliary camera judgment sub-process in the figure can be summarized as follows. The shooting described in the following steps are all static shooting, and the shooting amount is 10 pictures:

[0085] S401 control module turns on the auxiliary camera;

[0086] S402 The auxiliary camera takes pictures of the main camera and the surrounding position, and sends them to the image analysis algorithm module for processing. The image analysis algorithm module sends the analysis results to the logic processing module. The reasons for the main camera occlusion can be divided into three states: S403: First, the volume of the clothing load exceeds the preset value or other unknown situations that cannot be processed, and step S404 is executed; S405: Second, water and foam block the main camera, and step S406 is executed; S411: Third, the clothing is unfolded to block the camera, and step S412 is executed;

[0087] S404 If the volume of the clothing load exceeds the preset value or other unknown situations cannot be handled, the logic control module sends information to the user interface to remind the user to clean the area around the main camera and reserve the acquisition space, and then executes step S414;

[0088] S406 Water and foam block the main camera, determine whether the main camera is blocked by foam, if there is foam, execute S407, otherwise execute S409;

[0089] The S407 control module opens the water inlet valve and the spray pipe, and the water is sprayed on the front door glass cover to wash away the foam;

[0090] S408: Spray continuously for 30 seconds;

[0091] S409: Determine whether the water level is below the camera. If it is higher than the main camera, open the drain valve / pump to drain water until the water level is below the main camera, and execute S410;

[0092] S410: Turn on the main camera to shoot, send the picture to the image analysis algorithm module, determine whether the main camera is blocked by foam, if blocked, send an invalid instruction for this image acquisition to the control module, if the acquisition is valid, send a valid instruction for this image acquisition to the control module, and execute S414;

[0093] S412 The clothes are unfolded and block the camera. The control module sends a speed increase command to the motor module to increase the speed of the inner drum to 800 rpm for 2 minutes to dehydrate the clothes until they stick to the drum.

[0094] S413: Turn on the main camera to shoot, send the picture to the image analysis algorithm module, determine whether the main camera is blocked by clothes, if blocked, send an invalid instruction to the control module, if valid, send a valid instruction to the control module, and execute S414;

[0095] S414 The image analysis algorithm module sends an invalid acquisition instruction to the control module.

[0096] Further, such as Figure 5 The figure shows a schematic diagram of the bottom structure of the inner drum of a washing machine provided by some embodiments of the present invention. Three symmetrical and equal-sized inner drum reflective surfaces 6 can be polished at the bottom of the inner drum 2. The angle of the inner drum reflective surface 6 can be 120°. The bottom of the inner drum reflective surface 6 can be tilted outward by 10°~15° with the drum diameter as the center, so that each reflective surface image can be focused on the main camera 41. When the main camera 41 turns on image recognition, the inner drum rotates at a speed of 60rpm, and the main camera 41 can collect images three times per second (that is, the inner drum 2 is collected once each time it rotates about 120°). Each collection can collect images of 1~2 reflective surfaces. Compared with the traditional direct collection method, it provides more clothing features for machine learning and shortens the entire image collection and analysis cycle; the brightness in the drum can also be increased by reflecting the drum light to create a light environment suitable for collecting images. In addition, by reflecting images of clothing at different angles to the camera through multiple reflective surfaces, clothing pictures from multiple directions can be collected in a single acquisition, which is equivalent to obtaining clothing information from multiple angles in one acquisition. By combining a small number of reflective surfaces with a rotating inner drum, the required image information can be obtained, shortening the image acquisition time.

[0097] In some embodiments of the present invention, the camera module 4 further includes:

[0098] A light strip reflector 43, wherein the light strip reflector 43 is disposed between the light strip 42 and the main camera 41:

[0099] The mounting plate 44 , the light strip reflector 43 , the light strip 42 and the main camera 41 are connected to the front door 3 via the mounting plate 44 .

[0100] In actual applications, as mentioned above, the main camera module 4 structure may include a main camera 41, a light strip 42, a light strip reflector 43 and a mounting plate 44; wherein, the light strip reflector 6 may be a tin-surface reflector, which may be arranged around the periphery of the main camera 41 to prevent the light strip from being too bright and directly acting on the camera, causing overexposure, and to reflect light into the inner drum 2 of the washing machine. The light strip 42 can be installed on the periphery of the light strip reflector 6, and is also located in the central area of ​​the front door 3, and the light strip 42 can be set in a ring shape; the light strip reflector 43, the light strip 42 and the main camera 41 can be connected to the front door 3 through the mounting plate 44; the auxiliary camera 10 and its electrical components can be installed on the top of the front door 3, that is, the end away from the main camera module 4, and the auxiliary camera 10 can be used to collect image information of the main camera and the surrounding environment; wherein, the main function of the light strip reflector 43 and the light strip 42 structure is to cooperate with the reflective surface of the inner tube to avoid camera reflection and fill light at the same time, so that the exposure of the camera during shooting is increased, the clarity of the captured picture is increased, and it is used to shoot foam, water, clothing, etc., and shorten the time of image analysis.

[0101] In some embodiments of the present invention, the washing machine further comprises:

[0102] An outer cylinder 1, the outer cylinder 1 is arranged around the outer side of the inner cylinder 2;

[0103] A spray pipe 8 is connected to the outer tube 1 , and a spray direction of the spray pipe 8 is the direction where the main camera module 4 is located.

[0104] In practical applications, as mentioned above, the overall structure of the washing machine may include: an outer drum 1, which may be connected to the outer shell of the washing machine through an outer drum support 7; an inner drum 2, which is the main washing component inside the washing machine, and its front end is supported by the outer drum 1, and its rear end is connected to the motor M by a hub through a belt; a front door 3, which may be arranged at the clothing entrance of the washing machine, and may be installed with a main camera module 4 and its connecting arm to make an electrical connection between the main camera module 4 and the washing machine; a main camera module 4, which may be fixed to a side of the front door 3 close to the inner drum 2 through a connecting arm, and be electrically connected to the washing machine; a front panel 5, which has an opening for loading and unloading clothing, and may be connected to the front end of the inner drum 2 of the washing machine; an inner drum reflective surface 6, the bottom of the inner drum 2 is polished with three inner drum reflective surfaces at 120°, so that it can be used to fill in the light for the camera and provide an environment for collecting multi-angle clothing pictures at a single time; an outer drum support 7, which is used to reduce the vibration of the outer drum 1 and is hinged to the base of the washing machine. The spray pipe 8 is installed on the outer tube 1, and the spray direction can be directly facing the main camera module 4, which can be used for washing water replenishment and cleaning the main camera module 4; the water inlet valve 9 can be used to control the main wash water inlet and the spray pipe 8 switch, and the water inlet valve 9 can be connected to the faucet and the spray pipe 8 on the rear panel of the washing machine.

[0105] On this basis, when the reason for the occlusion determined in the above step is foam occlusion, the water inlet valve 9 and the spray pipe 8 can be opened by the control module, and water can be sprayed on the front door 3 to wash away the foam, and the spraying can be continued for 30 seconds to ensure complete flushing;

[0106] After the spraying is completed, it can be determined whether the water level in the washing machine is below the main camera 41. If the water level is higher than the main camera 41, the drain valve / pump of the washing machine can be opened to drain until the water level drops below the main camera; if the water level in the washing machine is already below the main camera 41 after the spraying is completed or the water level drops below the main camera after the drain valve / pump of the washing machine is opened to drain, the inner drum 2 can be controlled to rotate at a constant speed (in this embodiment, the speed can be set to 60rpm) to capture clothing images. Three pictures can be captured per second and the collection time is 5 seconds, that is, 15 pictures are collected and sent to the image recognition algorithm module to confirm whether the main camera 41 is still blocked.

[0107] Furthermore, when the cause of the obstruction determined in the aforementioned step is water obstruction, the drain valve / pump of the washing machine can be directly opened to drain the water until the water level drops below the main camera; if the water level has dropped below the main camera after the drain valve / pump of the washing machine is opened to drain the water, the inner drum 2 can be controlled to rotate at a constant speed (the speed can be set to 60rpm in this embodiment) to capture images of the clothes. Three pictures can be captured per second and the collection time is 5 seconds, that is, 15 pictures are collected and sent to the image recognition algorithm module to confirm whether the main camera 41 is still blocked.

[0108] Furthermore, when the obstruction reason determined in the aforementioned step is obstruction by clothing, the control module can send a speed-up instruction to the motor module M to start the dehydration function, and the speed of the inner drum 2 can be increased to 800 rpm and rotated for 2 minutes. After the clothes are dehydrated to the state of sticking to the barrel, it can be considered that the dehydration operation has reached the end state, and then the inner drum 2 can be controlled again to rotate at a constant speed (the speed can be set to 60 rpm in this embodiment) to collect clothing images. Three pictures can be collected per second and collected for 5 seconds, that is, 15 pictures are collected and sent to the image recognition algorithm module to confirm whether the main camera 41 is still blocked.

[0109] Furthermore, when the reasons for the occlusion determined in the aforementioned steps do not include any one or more of clothing occlusion, water occlusion, and foam occlusion, it can be considered that the reason for the occlusion is that the volume of the clothing load exceeds the preset value or other unknown situations that cannot be handled, such as the volume of the clothing load exceeds the preset value, the weight of the clothing load exceeds the preset value, the camera is damaged, the camera has serious stains, etc.; an alarm prompt message can be issued to remind the user to pay attention to cleaning the periphery of the main camera and reserve the acquisition space; at this time, the inner drum 2 can be controlled again to rotate at a constant speed (the speed can be set to 60rpm in this embodiment) to collect clothing images, and 3 pictures can be collected per second and collected for 5 seconds, that is, 15 pictures are collected and sent to the image recognition algorithm module to confirm whether the main camera 41 is still blocked.

[0110] Reference Figure 6 , showing a flow chart of steps of a washing machine control method provided by some embodiments of the present invention, the washing machine at least comprises: an inner drum 2, the inner drum 2 is arranged inside the washing machine; a front door 3, the front door 3 is arranged at the clothing entrance of the washing machine; a main camera module 4, the camera module 4 is arranged on a side of the front door 3 close to the inner drum 2; wherein the camera module 4 at least comprises a main camera 41 and a light strip 42, the light strip 42 is arranged in the central area of ​​the front door 3 and the light strip 42 is annular, and the main camera 41 is arranged in the central area of ​​the light strip 42; an auxiliary camera 10, the auxiliary camera 10 is arranged at one end of the front door 3 away from the main camera module 4; specifically, the following steps may be included:

[0111] Step 601, in response to the operation of putting clothes in, turning on the main camera 41 and the light strip 42, and controlling the inner drum 2 to rotate at a preset speed;

[0112] Step 602, controlling the main camera 41 to capture images of the clothing according to a first preset time to obtain a first image capture result;

[0113] Step 603: judging whether the main camera 41 is blocked according to the first image acquisition result;

[0114] Step 604, when it is determined that the main camera 41 is blocked, the auxiliary camera 10 is turned on, and the main camera 41 and the surrounding position of the main camera 41 are photographed by the auxiliary camera 10 to obtain a photographing result;

[0115] Step 605, determining the reason why the main camera 41 is blocked according to the shooting result, and controlling the washing machine according to the reason;

[0116] Step 606, when it is determined that the main camera 41 is not blocked, controlling the main camera 41 to capture an image of the clothing according to a second preset time to obtain a second image capture result;

[0117] Step 607: Control the washing machine according to the second image acquisition result.

[0118] In the specific implementation, Figure 1 As shown, the overall structure of the washing machine may include: an outer drum 1, which may be connected to the outer shell of the washing machine through an outer drum support 7; an inner drum 2, which is the main washing component inside the washing machine, and whose front end is supported by the outer drum 1, and whose rear end is connected to the motor M by a hub through a belt; a front door 3, which may be arranged at the clothing entrance of the washing machine, and may be installed with a main camera module 4 and its connecting arm to make an electrical connection between the main camera module 4 and the washing machine; a main camera module 4, which may be fixed to a side of the front door 3 close to the inner drum 2 through a connecting arm, and be electrically connected to the washing machine; a front panel 5, which has an opening for loading and unloading clothing, and may be connected to the front end of the inner drum 2 of the washing machine; an inner drum reflective surface 6, the bottom of the inner drum 2 is polished with three inner drum reflective surfaces at 120°, so that it can be used to fill in the light for the camera and provide an environment for collecting multi-angle clothing pictures at a single time; an outer drum support 7, which is used to reduce the vibration of the outer drum 1 and is hinged to the base of the washing machine. The spray pipe 8 is installed on the outer tube 1, and the spray direction can be directly facing the main camera module 4, which can be used for washing water replenishment and cleaning the main camera module 4; the water inlet valve 9 can be used to control the main wash water inlet and the spray pipe 8 switch, and the water inlet valve 9 can be connected to the faucet and the spray pipe 8 on the rear panel of the washing machine.

[0119] Further, such as Figure 3The figure shows a schematic diagram of the camera structure provided by some embodiments of the present invention; wherein the main camera module 4 is installed in the center of the front door glass bowl (i.e., the front door 3) through a connecting arm, and the connecting arm can be used for fixing and electrical connection, and the main camera module 4 can be used to collect images of the inner drum clothes and the reflective surface of the inner drum; the main camera module 4 structure can include a main camera 41, a light belt 42, a light belt reflector 43 and a mounting plate 44; wherein the light belt reflector 6 can be a tin-surface reflector, which can be arranged around the main camera 41 to prevent the light belt from being too bright and directly acting on the camera to cause overexposure, and play a role in reflecting light into the inner drum 2 of the washing machine. The light belt 42 can be installed on the periphery of the light belt reflector 6, also in the central area of ​​the front door 3, and the light belt 42 can be set in a ring shape; the auxiliary camera 10 and its electrical components can be installed on the top of the front door 3, i.e., at the end away from the main camera module 4, and the auxiliary camera 10 can be used to collect image information of the main camera and the surrounding environment.

[0120] On this basis, after the user puts clothes in and starts the washing machine, the main camera 41 of the washing machine and the surrounding light strip 42 can be turned on through the control module to prepare for image acquisition. The inner drum 2 can be controlled to rotate at a certain speed (the speed can be set to 60rpm in this embodiment) to capture the image of the clothes. Three pictures can be collected per second and for 5 seconds (i.e., the first preset time, which can be set and adjusted according to actual needs), that is, 15 pictures are collected and sent to the image recognition algorithm module. It should be noted that this process can occur in all stages such as clothing classification and weighing that require image analysis to adjust the rotation speed or execute special processes. After the main camera 41 collects the image and sends it to the image recognition algorithm module, a preliminary image segmentation analysis can be performed to determine whether the main camera 41 is blocked, that is, whether the collected picture is valid. If the collected picture is invalid, an invalid collection signal can be sent to the control module. After receiving the invalid collection signal sent by the image recognition algorithm module, the control module can execute the following steps. Figure 4 The auxiliary camera judgment sub-process shown, that is, the auxiliary camera 10 can be turned on, and the auxiliary camera 10 can be used to shoot the main camera 41 and the surrounding positions of the main camera 41 to obtain the shooting results, and then the shooting results are sent to the image analysis algorithm module for processing to obtain the analysis results, and the image analysis algorithm module sends the analysis results to the logic processing module to determine the reason for the obstruction of the main camera 41, so as to perform subsequent control of the washing machine according to the obstruction reason.

[0121] When it is determined that the main camera 41 is not blocked, the inner drum 2 can be controlled to rotate at a constant speed (which can be set to 60 rpm in this embodiment), and a clothing photo is collected every 333 milliseconds, that is, the inner drum rotates 120°, and the collection is continued for 1 minute (that is, the second preset time, which can be adjusted according to actual needs). The collected clothing picture group (180 pictures, that is, the second image collection result) is sent to the image recognition algorithm module, and the image recognition algorithm module performs image segmentation and analysis, and sends the current clothing state to the logic control module for further control processing. For example, a washing parameter adjustment process can be executed, or a corresponding clothing protection process can be executed; for example, in the washing process, parameters such as water level, water temperature, rotation speed, and washing time can be adjusted according to the image recognition results; in the dehydration process, the inner drum rotation speed can be adjusted according to the results to balance the load; in the rinsing process, the rinsing water level and time can be adjusted according to the image recognition results, or a defoaming step can be performed; in the drying process, the drying temperature, rotation speed and duration can be adjusted according to the results; based on the image recognition results, the user's laundry habits can be analyzed through deep learning to recommend a laundry plan to the user.

[0122] In some embodiments of the present invention, the washing machine further includes: an outer drum 1, the outer drum 1 is arranged around the outer side of the inner drum 2; a spray pipe 8, the spray pipe 8 is connected to the outer drum 1, and the spray direction of the spray pipe 8 is the direction of the main camera module 4; the controlling of the washing machine according to the blocking reason includes:

[0123] When the blocking reason is foam blocking, controlling the spray pipe 8 to spray the main camera module 4;

[0124] Determine whether the water level in the washing machine is higher than the main camera 41, and if the water level is higher than the main camera 41, start the drainage function of the washing machine;

[0125] When the water level is lower than the main camera 41, the step of controlling the main camera 41 to capture images of the clothing according to the first preset time to obtain a first image capture result is performed again.

[0126] In practical applications, as mentioned above, the overall structure of the washing machine may include: an outer drum 1, which may be connected to the outer shell of the washing machine through an outer drum support 7; an inner drum 2, which is the main washing component inside the washing machine, and its front end is supported by the outer drum 1, and its rear end is connected to the motor M by a hub through a belt; a front door 3, which may be arranged at the clothing entrance of the washing machine, and may be installed with a main camera module 4 and its connecting arm to make an electrical connection between the main camera module 4 and the washing machine; a main camera module 4, which may be fixed to a side of the front door 3 close to the inner drum 2 through a connecting arm, and be electrically connected to the washing machine; a front panel 5, which has an opening for loading and unloading clothing, and may be connected to the front end of the inner drum 2 of the washing machine; an inner drum reflective surface 6, the bottom of the inner drum 2 is polished with three inner drum reflective surfaces at 120°, so that it can be used to fill in the light for the camera and provide an environment for collecting multi-angle clothing pictures at a single time; an outer drum support 7, which is used to reduce the vibration of the outer drum 1 and is hinged to the base of the washing machine. The spray pipe 8 is installed on the outer tube 1, and the spray direction can be directly facing the main camera module 4, which can be used for washing water replenishment and cleaning the main camera module 4; the water inlet valve 9 can be used to control the main wash water inlet and the spray pipe 8 switch, and the water inlet valve 9 can be connected to the faucet and the spray pipe 8 on the rear panel of the washing machine.

[0127] On this basis, when the reason for the occlusion determined in the above step is foam occlusion, the water inlet valve 9 and the spray pipe 8 can be opened by the control module, and water can be sprayed on the front door 3 to wash away the foam, and the spraying can be continued for 30 seconds to ensure complete flushing;

[0128] After the spraying is completed, it can be determined whether the water level in the washing machine is below the main camera 41. If the water level is higher than the main camera 41, the drain valve / pump of the washing machine can be opened to drain until the water level drops below the main camera; if the water level in the washing machine is already below the main camera 41 after the spraying is completed or the water level drops below the main camera after the drain valve / pump of the washing machine is opened to drain, the inner drum 2 can be controlled to rotate at a constant speed (in this embodiment, the speed can be set to 60rpm) to capture clothing images. Three pictures can be captured per second and the collection time is 5 seconds, that is, 15 pictures are collected and sent to the image recognition algorithm module to confirm whether the main camera 41 is still blocked.

[0129] In some embodiments of the present invention, the method further comprises:

[0130] When the cause of the obstruction is water obstruction, the drainage function of the washing machine is turned on, and when the water level is lower than the main camera (41), the step of controlling the main camera (41) to capture images of the clothes according to the first preset time is performed again to obtain a first image capture result.

[0131] In actual applications, when the cause of the obstruction determined in the aforementioned steps is water obstruction, the drain valve / pump of the washing machine can be directly opened to drain the water until the water level drops below the main camera; if the water level has dropped below the main camera after the drain valve / pump of the washing machine is opened to drain the water, the inner drum 2 can be controlled to rotate at a constant speed (the speed can be set to 60rpm in this embodiment) to capture clothing images. Three pictures can be captured per second and the collection time is 5 seconds, that is, 15 pictures are collected and sent to the image recognition algorithm module to confirm whether the main camera 41 is still blocked.

[0132] In some embodiments of the present invention, the method further comprises:

[0133] When the occlusion is caused by clothing, the dehydration function of the washing machine is turned on, and after the dehydration is completed, the step of controlling the main camera (41) to capture images of the clothing according to a first preset time is performed again to obtain a first image capture result.

[0134] In actual applications, when the reason for the obstruction determined in the aforementioned steps is clothing obstruction, the control module can send a speed-up instruction to the motor module M to start the dehydration function, and the speed of the inner drum 2 can be increased to 800 rpm and rotated for 2 minutes. After the clothes are dehydrated to the state of sticking to the barrel, it can be considered that the dehydration operation has reached the end state, and then the inner drum 2 can be controlled to rotate at a constant speed (the speed can be set to 60 rpm in this embodiment) to collect clothing images. Three pictures can be collected per second and collected for 5 seconds, that is, 15 pictures are collected and sent to the image recognition algorithm module to confirm whether the main camera 41 is still blocked.

[0135] In some embodiments of the present invention, the method further comprises:

[0136] When the blocking reason does not include any one or more of clothing blocking, water blocking and foam blocking, the washing machine is controlled to issue an alarm prompt message.

[0137] In actual applications, when the reasons for occlusion determined in the aforementioned steps do not include any one or more of clothing occlusion, water occlusion, and foam occlusion, it can be considered that the reason for occlusion is that the volume of the clothing load exceeds the preset value or other unknown situations that cannot be handled, such as the volume of the clothing load exceeds the preset value, the weight of the clothing load exceeds the preset value, the camera is damaged, the camera has serious stains, etc.; an alarm prompt message can be issued to remind the user to pay attention to cleaning the surroundings of the main camera and reserve the acquisition space; at this time, the inner drum 2 can be controlled again to rotate at a certain speed (the speed can be set to 60rpm in this embodiment) to collect clothing images. 3 pictures can be collected per second and collected for 5 seconds, that is, 15 pictures are collected and sent to the image recognition algorithm module to confirm whether the main camera 41 is still blocked.

[0138] The following will be combined Figure 7 The embodiments of the present invention are further described as follows:

[0139] Reference Figure 7 The overall execution process of the washing machine control method provided by the present invention can be summarized as follows:

[0140] S701 The user puts in clothes and the washing machine starts;

[0141] S702 control module turns on the washing machine's main camera and surrounding light strips to prepare for image acquisition;

[0142] S703 The inner drum rotates at a certain speed (e.g. 60 rpm) to collect clothing images. The collection takes 5 seconds, i.e. 15 pictures are sent to the image recognition algorithm module. This process can occur in all stages where image analysis is required to adjust the rotation speed or execute special processes, such as clothing classification and weighing.

[0143] S704: The main camera collects an image and sends it to the image recognition algorithm module for preliminary image segmentation and analysis to determine whether the camera is blocked, that is, whether the collected image is valid. If the collected image is valid, execute step S708; otherwise, execute step S705.

[0144] S705 The control module receives the acquisition invalid signal sent by the image recognition algorithm module and executes step S706;

[0145] S706: The control module executes the auxiliary camera judgment sub-process, and then executes step S707;

[0146] S707 The control module receives the identification signal sent by the image recognition algorithm module. If the main camera occlusion has been released, step S708 is executed; otherwise, step S709 is executed;

[0147] S708 The inner drum rotates at a constant speed (such as 60rpm), and collects clothing photos every 333 milliseconds, that is, when the inner drum rotates 120°. The collection continues for 1 minute, and the collected clothing picture group (180 pictures) is sent to the image recognition algorithm module, which performs image segmentation and analysis, and sends the current clothing status to the logic control module for further control processing, such as executing the identified clothing type process, or executing the corresponding clothing protection process.

[0148] The S709 control module turns off the main camera, auxiliary camera and light strip, and stops the acquisition process.

[0149] The present invention provides a washing machine, which at least comprises: an inner drum, which is arranged inside the washing machine; a front door, which is arranged at the entrance of the clothes of the washing machine; a main camera module, which is arranged on the side of the front door close to the inner drum; wherein the camera module at least comprises a main camera and a light belt, which is arranged in the central area of ​​the front door and is annular, and the main camera is arranged in the central area of ​​the light belt; and an auxiliary camera, which is arranged at one end of the front door away from the main camera module. Not only can the light belt arranged around the camera be used to fill in the light for the camera, thereby improving the clarity of the image captured by the camera, but also the actual occlusion of the main camera can be confirmed in time through the auxiliary camera, so that the occlusion can be processed in time, thereby improving the data acquisition quality and efficiency of the camera, and thereby improving the user's laundry experience. More clothing features can be collected in the same time, the accuracy of image recognition can be improved, the time of image recognition can be shortened, the requirements for the laundry environment of image acquisition can be reduced, and the application scenarios of image recognition can be expanded.

[0150] It should be noted that, for the sake of simplicity, the method embodiments are described as a series of action combinations, but those skilled in the art should be aware that the embodiments of the present invention are not limited by the order of the actions described, because according to the embodiments of the present invention, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions involved are not necessarily required by the embodiments of the present invention.

[0151] Reference Figure 8 , shows a schematic structural diagram of a washing machine control device provided by some embodiments of the present invention; the washing machine at least comprises: an inner drum, the inner drum is arranged inside the washing machine; a front door, the front door is arranged at the clothing entrance of the washing machine; a main camera module, the camera module is arranged on a side of the front door close to the inner drum; wherein the camera module at least comprises a main camera and a light strip, the light strip is arranged in the central area of ​​the front door and the light strip is annular, and the main camera is arranged in the central area of ​​the light strip; an auxiliary camera, the auxiliary camera is arranged at one end of the front door away from the main camera module; specifically, it may include the following modules:

[0152] The inner drum rotation module 801 is used to turn on the main camera and the light strip in response to the clothing insertion operation, and control the inner drum to rotate at a preset speed;

[0153] A first image acquisition result acquisition module 802, used to control the main camera to acquire images of the clothing according to a first preset time to obtain a first image acquisition result;

[0154] An occlusion judgment module 803 is used to judge whether the main camera is blocked according to the first image acquisition result;

[0155] The shooting result acquisition module 804 is used to turn on the auxiliary camera when it is determined that the main camera is blocked, and use the auxiliary camera to shoot the main camera and the surrounding position of the main camera to obtain the shooting result;

[0156] A first washing machine control module 805, configured to determine a reason why the main camera is blocked according to the shooting result, and control the washing machine according to the reason;

[0157] A second image acquisition result acquisition module 806 is used to control the main camera to acquire an image of the clothing according to a second preset time to obtain a second image acquisition result when it is determined that the main camera is not blocked;

[0158] The second washing machine control module 807 is used to control the washing machine according to the second image acquisition result.

[0159] In some embodiments of the present invention, the washing machine further includes: an outer drum, the outer drum is arranged around the outer side of the inner drum; a spray pipe, the spray pipe is connected to the outer drum, and the spray direction of the spray pipe is the direction of the main camera module; the first washing machine control module 805 includes:

[0160] A spray processing submodule, used for controlling the spray pipe to spray the main camera module when the occlusion cause is foam occlusion;

[0161] a first drainage function activation submodule, used to determine whether the water level in the washing machine is higher than the main camera, and activate the drainage function of the washing machine when the water level is higher than the main camera;

[0162] The re-execution submodule is used to re-execute the step of controlling the main camera to capture images of the clothes according to the first preset time to obtain the first image capture result when the water level is lower than the main camera.

[0163] In some embodiments of the present invention, the first washing machine control module 805 further includes:

[0164] The second drainage function submodule is used to turn on the drainage function of the washing machine when the obstruction is caused by water, and when the water level is lower than that of the main camera, again execute the step of controlling the main camera to capture images of the clothes according to the first preset time to obtain the first image capture result.

[0165] In some embodiments of the present invention, the first washing machine control module 805 further includes:

[0166] The dehydration function activation submodule is used to activate the dehydration function of the washing machine when the occlusion reason is due to clothing occlusion, and after the dehydration is completed, execute again the step of controlling the main camera to capture images of the clothing according to the first preset time to obtain the first image capture result.

[0167] In some embodiments of the present invention, the first washing machine control module 805 further includes:

[0168] The alarm prompt submodule is used to control the washing machine to issue an alarm prompt message when the blocking reason does not include any one or more of clothing blocking, water blocking and foam blocking.

[0169] Some embodiments of the present invention further provide an electronic device, which may include a processor, a memory, and a computer program stored in the memory and capable of running on the processor, and when the computer program is executed by the processor, the above washing machine control method is implemented.

[0170] Some embodiments of the present invention further provide a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the above-mentioned washing machine control method is implemented.

[0171] Some embodiments of the present invention further provide a computer program product, including a computer program, which implements the above washing machine control method when executed by a processor.

[0172] As for the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.

[0173] The various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the various embodiments can be referenced to each other.

[0174] Those skilled in the art will appreciate that the embodiments of the present invention may be provided as methods, devices, or computer program products. Therefore, the embodiments of the present invention may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the embodiments of the present invention may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program codes.

[0175] The embodiments of the present invention are described with reference to the flowcharts and / or block diagrams of the methods, terminal devices (systems), and computer program products according to the embodiments of the present invention. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of the processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing terminal device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing terminal device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0176] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing terminal device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce a manufactured product including an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0177] These computer program instructions can also be loaded onto a computer or other programmable data processing terminal device so that a series of operating steps are executed on the computer or other programmable terminal device to produce a computer-implemented process, thereby providing instructions for executing on the computer or other programmable terminal device to implement the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0178] Although the preferred embodiments of the present invention have been described, those skilled in the art may make additional changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of the embodiments of the present invention.

[0179] Finally, it should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or terminal device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or terminal device. In the absence of further restrictions, the elements defined by the sentence "including one..." do not exclude the existence of other identical elements in the process, method, article or terminal device including the above elements.

[0180] The above provides a detailed introduction to a washing machine and a control method, device, equipment, and medium for the washing machine. Specific examples are used herein to illustrate the principles and implementation methods of the present invention. The description of the above embodiments is only used to help understand the method of the present invention and its core idea. At the same time, for a person skilled in the art, according to the idea of ​​the present invention, there will be changes in the specific implementation method and application scope. In summary, the content of this specification should not be understood as a limitation on the present invention.

Claims

1. A washing machine control method, characterized in that: The washing machine comprises at least: an inner drum (2), the inner drum (2) being arranged inside the washing machine; a front door (3), the front door (3) being arranged at a clothing entrance of the washing machine; and a main camera module (4), the main camera module (4) being arranged on a side of the front door (3) close to the inner drum (2); wherein the main camera module (4) comprises at least a main camera (41) and a light strip (42), the light strip (42) being arranged in a central area of ​​the front door (3) and being annular in shape. The main camera (41) is arranged in the central area of ​​the light strip (42); the auxiliary camera (10) is arranged at one end of the front door (3) away from the main camera module (4); the inner tube reflective surface (6) is arranged at the bottom of the inner tube (2), and the inner tube reflective surface (6) is a fan-shaped reflective surface; wherein the number of the inner tube reflective surfaces (6) is 3, and the fan angle of the inner tube reflective surface (6) is 120°; the method comprises: In response to a clothing inserting operation, the main camera (41) and the light strip (42) are turned on, and the inner drum (2) is controlled to rotate at a preset speed; Controlling the main camera (41) to capture images of the clothing according to a first preset time, and obtaining a first image capture result; Determining whether the main camera (41) is blocked according to the first image acquisition result; When it is determined that the main camera (41) is blocked, the auxiliary camera (10) is turned on, and the main camera (41) and the peripheral position of the main camera (41) are photographed by the auxiliary camera (10) to obtain a photographing result; Determining the reason why the main camera (41) is blocked according to the shooting result, and controlling the washing machine according to the reason for the blockage; When it is determined that the main camera (41) is not blocked, controlling the main camera (41) to capture images of the clothing according to a second preset time to obtain a second image capture result; The washing machine is controlled according to the second image acquisition result.

2. The method according to claim 1, characterized in that The washing machine also includes: An outer cylinder (1), the outer cylinder (1) being arranged around the outer side of the inner cylinder (2); A spray pipe (8), the spray pipe (8) being connected to the outer cylinder (1), and the spraying direction of the spray pipe (8) being the direction in which the main camera module (4) is located.

3. The method according to claim 1, characterized in that The main camera module (4) further includes: A light strip reflector (43), wherein the light strip reflector (43) is arranged between the light strip (42) and the main camera (41): A mounting plate (44), wherein the light strip reflector (43), the light strip (42) and the main camera (41) are connected to the front door (3) via the mounting plate (44).

4. The method according to claim 2, characterized in that: The controlling the washing machine according to the shielding reason includes: When the occlusion is caused by foam occlusion, controlling the spray pipe (8) to spray the main camera module (4); determining whether the water level in the washing machine is higher than the main camera (41), and activating the drainage function of the washing machine when the water level is higher than the main camera (41); When the water level is lower than the main camera (41), the step of controlling the main camera (41) to capture images of the clothing according to the first preset time is performed again to obtain a first image capture result.

5. The method according to claim 4, characterized in that The method further comprises: When the cause of the obstruction is water obstruction, the drainage function of the washing machine is turned on, and when the water level is lower than the main camera (41), the step of controlling the main camera (41) to capture images of the clothes according to the first preset time is performed again to obtain a first image capture result.

6. The method according to claim 4, characterized in that The method further comprises: When the occlusion is caused by clothing, the dehydration function of the washing machine is turned on, and after the dehydration is completed, the step of controlling the main camera (41) to capture images of the clothing according to a first preset time is performed again to obtain a first image capture result.

7. The method according to claim 4, characterized in that The method further comprises: When the blocking reason does not include any one or more of clothing blocking, water blocking and foam blocking, the washing machine is controlled to issue an alarm prompt message.

8. A washing machine control device, characterized in that: The washing machine comprises at least: an inner drum (2), the inner drum (2) being arranged inside the washing machine; a front door (3), the front door (3) being arranged at a clothing entrance of the washing machine; and a main camera module (4), the main camera module (4) being arranged on a side of the front door (3) close to the inner drum (2); wherein the main camera module (4) comprises at least a main camera (41) and a light strip (42), the light strip (42) being arranged in a central area of ​​the front door (3) and being annular in shape. The main camera (41) is arranged in the central area of ​​the light strip (42); the auxiliary camera (10) is arranged at one end of the front door (3) away from the main camera module (4); the inner tube reflective surface (6) is arranged at the bottom of the inner tube (2), and the inner tube reflective surface (6) is a fan-shaped reflective surface; wherein the number of the inner tube reflective surfaces (6) is 3, and the fan angle of the inner tube reflective surface (6) is 120°; the device comprises: An inner drum rotation module, used for turning on the main camera (41) and the light strip (42) in response to a clothing insertion operation, and controlling the inner drum (2) to rotate at a preset speed; A first image acquisition result acquisition module, used to control the main camera (41) to acquire images of the clothing according to a first preset time, to obtain a first image acquisition result; an occlusion judgment module, used to judge whether the main camera (41) is blocked according to the first image acquisition result; a shooting result acquisition module, for, when it is determined that the main camera (41) is blocked, turning on the auxiliary camera (10), and photographing the main camera (41) and the surrounding position of the main camera (41) through the auxiliary camera (10), to obtain a shooting result; a first washing machine control module, used to determine, based on the shooting result, a reason why the main camera (41) is blocked, and to control the washing machine based on the reason for the blockage; A second image acquisition result acquisition module, for controlling the main camera (41) to acquire an image of the clothing at a second preset time to obtain a second image acquisition result when it is determined that the main camera (41) is not blocked; The second washing machine control module is used to control the washing machine according to the second image acquisition result.

9. An electronic device, characterized in that: The invention comprises a processor, a memory and a computer program stored in the memory and capable of running on the processor, wherein when the computer program is executed by the processor, the washing machine control method according to any one of claims 1 to 7 is implemented.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the washing machine control method according to any one of claims 1 to 7 is implemented.

Images