Control method of clothing processing equipment and clothing processing equipment

Abstract

The embodiment of the present application discloses a control method for a clothing processing device and a clothing processing device, which belongs to the field of device control technology. The control method of the clothing processing device includes obtaining a foot image in a video stream shot for a user's feet; determining the movement path of the user's feet based on the foot image; and controlling the clothing processing device to perform corresponding actions based on the shape of the movement path. The embodiment of the present application has the technical effect that when a user needs to control the clothing processing device, he only needs to ensure that his feet can be photographed, and there is no need to control the clothing processing device through hand movements such as pressing buttons or touching a control screen, making it easier for people with armless disabilities to operate the clothing processing device, thereby improving the convenience of using the clothing processing device.

Description

Technical Field

[0001] The present application relates to the field of equipment control, and in particular, to a control method for a clothing processing equipment and the clothing processing equipment. Background Art

[0002] Clothes handling devices are essential everyday appliances. Current devices are highly intelligent and can meet the needs of most users. However, for people with disabilities, especially those without arms, the control methods of current devices are cumbersome, making them difficult to operate and less convenient to use. Summary of the Invention

[0003] The embodiments of the present application provide a control method for a clothing processing device and a clothing processing device, so as to at least solve the technical problem that the clothing processing device is less convenient to use.

[0004] According to a first aspect of an embodiment of the present application, a method for controlling a laundry processing device is provided, the method comprising:

[0005] Obtain a foot image from a video stream shot at the user's feet;

[0006] determining a movement path of the user's foot according to the foot image;

[0007] The laundry treating device is controlled to perform corresponding actions according to the shape of the motion path.

[0008] By adopting this embodiment, the action control of the clothing processing device can be completed by obtaining the user's footsteps image, so that when the user needs to control the clothing processing device, he only needs to ensure that the feet can be photographed, and there is no need to control the clothing processing device through hand movements such as pressing buttons or touching the control screen. This makes it easier for armless disabled people to operate the clothing processing device, thereby improving the convenience of using the clothing processing device.

[0009] In conjunction with the first aspect, in an optional implementation of the embodiment of the present application, determining the movement path of the user's foot according to the foot image includes:

[0010] Based on the multiple foot images in the video stream, target features of the user's feet are connected according to the time sequence of the multiple foot images to obtain the motion path.

[0011] By adopting this implementation method, target features are connected according to the time sequence of multiple footstep images to obtain a motion path, which is simple to calculate, helps to save computing resources and reduce computing costs.

[0012] In combination with the first aspect, in an optional implementation of the embodiment of the present application, the target feature includes a big toe in the foot image;

[0013] Connecting target features of the user's feet according to the time sequence of the multiple foot images to obtain the motion path includes:

[0014] According to the time sequence of the plurality of foot images, the big toe position in each of the foot images is identified one by one, and the big toe positions are connected to obtain the motion path.

[0015] By adopting this implementation method, the recognition of the big toe is higher. By identifying the position of the big toe and connecting the lines, the motion path is obtained, which helps to improve the accuracy of the motion path recognition, thereby reducing the number of times the user has to re-control the foot movement due to recognition failure, which is conducive to improving the user's convenience in using the clothing processing equipment.

[0016] In combination with the first aspect, in an optional implementation of the embodiment of the present application, controlling the clothing processing device to perform a corresponding action according to the shape of the motion path includes:

[0017] Retrieving a control instruction corresponding to the shape from a preset control relationship according to the shape, wherein the control relationship includes an association between the shape of the motion path and the control instruction, different shapes are associated with different control instructions, and different control instructions are used to control the clothing processing device to perform different actions;

[0018] The clothes processing device is controlled to perform corresponding actions according to the control instruction.

[0019] When using this implementation method, when controlling the clothing processing device to perform actions, it is implemented according to a preset control relationship, so that different users can control the actions of the clothing processing device more conveniently by modifying the control relationship, thereby improving the convenience of using the clothing processing device.

[0020] In combination with the first aspect, in an optional implementation of the embodiment of the present application, the control relationship includes a default control relationship and a custom control relationship;

[0021] Before calling a control instruction corresponding to the shape from a preset control relationship according to the shape, the method further includes:

[0022] determining feature information of the user's foot based on the foot image;

[0023] The default control relationship or the customized control relationship is selectively used according to the pre-stored condition of the characteristic information to call the control instruction.

[0024] By adopting this implementation method, before controlling the clothing processing device to perform an action, it will first determine whether to use the default control relationship or the customized control relationship based on the characteristic information of the user's feet, thereby improving the accuracy of the retrieved control instructions, thereby reducing the number of times the user re-controls the foot movements, and improving the convenience of using the clothing processing device.

[0025] In conjunction with the first aspect, in an optional implementation of the embodiment of the present application, the step of retrieving a control instruction corresponding to the shape from a preset control relationship based on the shape includes:

[0026] If a custom control relationship associated with the feature information is pre-stored, then according to the shape, the control instruction corresponding to the shape is retrieved from the associated custom control relationship;

[0027] If there is no pre-stored custom control relationship associated with the feature information, then according to the shape, the control instruction corresponding to the shape is retrieved from the default control relationship;

[0028] The control instruction includes at least one of a door opening instruction, a door closing instruction, a mode switching instruction, a parameter switching instruction, a parameter adjustment instruction, a selection instruction and a shutdown instruction.

[0029] With this implementation, users can set custom control relationships so that when using the clothing handling device, they can simply control their feet to perform movements according to the custom control relationships they set, reducing the difficulty of controlling the clothing handling device. For users who have not set custom control relationships, control instructions will be called according to the default control relationship to activate the clothing handling device, improving the convenience of using the clothing handling device.

[0030] In conjunction with the first aspect, in an optional implementation of the embodiment of the present application, determining feature information of the user's foot based on the foot image includes:

[0031] Identifying the length of the big toe, the length of the little toe, and the length of the foot in the foot image, and / or identifying the width of the big toe and the width of all toes in the foot image, and / or identifying the angle between the side of the big toe away from the little toe and the inner side of the foot in the foot image;

[0032] The ratio of the length of the big toe, the length of the little toe to the length of the foot and / or the ratio of the width of the big toe to the width of all toes and / or the angle is used as the feature information.

[0033] This implementation method helps to improve the accuracy of user identification using feature information.

[0034] In conjunction with the first aspect, in an optional implementation of the embodiment of the present application, after determining the feature information of the user's foot based on the foot image, the method further includes:

[0035] Determining whether the characteristic information is pre-stored;

[0036] If not pre-stored, pre-store the characteristic information and generate corresponding new user information;

[0037] If the characteristic information is pre-stored or the corresponding new user information is generated, it is determined whether the characteristic information is pre-associated with a custom program;

[0038] If the custom program is pre-associated, controlling the clothes processing device to preferentially display the custom program;

[0039] If the custom program is not pre-associated, determining whether the user information corresponding to the characteristic information has run the program;

[0040] If the program has been run, the clothes processing device is controlled to preferentially display the program that the user information last ran;

[0041] If no program has been run, the clothes processing device is controlled to display the preset target program first.

[0042] This implementation method helps reduce user actions and improves the ease of use of the clothing processing device.

[0043] In conjunction with the first aspect, in an optional implementation of the embodiment of the present application, the method further includes:

[0044] If the shape of the motion path is the target shape, then enter the custom setting process;

[0045] The custom setting process includes:

[0046] Get the custom motion path of the user's foot and get the custom shape;

[0047] The selected control instruction is associated with the custom shape according to the control instruction selected by the user.

[0048] With this implementation, when a user needs to customize the association between control instructions and custom shapes, he or she can enter the custom setting process by moving the target shape with his or her feet without the assistance of others, thereby improving the ease of use of the clothing processing equipment.

[0049] According to a second aspect of an embodiment of the present application, a control method for a clothing processing device is provided. The clothing processing device includes a housing, a display screen is provided on an upper side of the housing to replace a touch module, and a camera is further provided on the housing for photographing an area in front of the housing. The display screen is used to display an image of a foot within a target area photographed by the camera. The method further includes:

[0050] If a foot is detected entering the target area, the clothes processing device is controlled to enter a standby state, otherwise the clothes processing device remains in a shutdown state;

[0051] After the laundry processing device enters a standby state, the movement paths of the user's feet are sequentially identified according to the program running order of the laundry processing device;

[0052] The clothes treating device is controlled to perform actions that can be performed in the current program according to the shape of the motion path.

[0053] In conjunction with the second aspect, in an optional implementation of the embodiment of the present application, sequentially identifying the movement path of the user's foot according to the program running order of the clothing processing device includes:

[0054] When the clothes processing device runs a current program, obtaining a foot image in a video stream captured of a user's feet during the running of the current program;

[0055] determining a motion path corresponding to the current program according to the foot image corresponding to the current program;

[0056] When the clothing processing device runs a next program, obtaining a foot image in a video stream captured of the user's feet during the running of the next program;

[0057] A motion path corresponding to the next program is determined according to the foot image corresponding to the next program.

[0058] In conjunction with the second aspect, in an optional implementation of the embodiment of the present application, when the laundry processing device runs different programs, the actions that can be performed are all associated with reference shapes;

[0059] The controlling of the clothes treating device to execute actions that can be performed in the current program according to the shape of the motion path includes:

[0060] determining whether a shape of the motion path is identical to at least one reference shape associated with the current program;

[0061] If they are the same, controlling the clothes treating device to perform an action associated with the reference shape;

[0062] The program run by the clothes processing device includes at least one of a door opening program, a mode selection program, a parameter selection program, a parameter assignment program and a shutdown program.

[0063] According to a third aspect of an embodiment of the present application, a clothing processing device is provided, which is controlled by the control method of the clothing processing device described above.

[0064] In combination with the third aspect, in an optional implementation of an embodiment of the present application, the clothing processing device includes a casing, a display screen replacing the touch module is provided on the upper side of the casing, and a camera for photographing the front area of ​​the casing is also provided on the casing, and the display screen is used to display the image of the feet in the target area photographed by the camera.

[0065] In combination with the third aspect, in an optional implementation of the embodiment of the present application, the clothing processing device includes at least one of a washing machine, a washer-dryer, and a washer-dryer-in-one machine.

[0066] The technical effects obtained in the above-mentioned second to third aspects are similar to the technical effects obtained by the corresponding technical means in the first aspect, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0067] Figure 1 This is a flow chart of a control method for a clothes processing device provided by an embodiment of the present application;

[0068] Figure 2 is a front view of a clothes processing device provided by an embodiment of the present application;

[0069] Figure 3 is a side view of a clothes processing device provided by an embodiment of the present application;

[0070] Figure 4 is a flow chart of another method for controlling a clothes processing device provided by an embodiment of the present application;

[0071] Figure 5 This is a flow chart of a control method for a clothes processing device provided by an embodiment of the present application in a specific application;

[0072] Figure 6 It is a diagram of the toe lengths p and r and the entire foot length q;

[0073] Figure 7 It is a diagram of the width of the big toe m and the width of all toes n;

[0074] Figure 8 is a schematic diagram of the growth angle α of the big toe;

[0075] Figure 9 This is a schematic diagram of the movement path for lifting the left foot;

[0076] Figure 10 It is a schematic diagram of the motion path of the circle;

[0077] Figure 11 It is a schematic diagram of the motion path of left swipe / right swipe;

[0078] Figure 12 This is a flow chart of adding a custom action path in a specific application of a control method for a clothing processing device provided by an embodiment of the present application;

[0079] Figure 13 A control method for a clothing processing device provided in an embodiment of the present application is a flowchart that preferentially displays user-related programs in a specific application.

[0080] Marking instructions: 1. Casing; 2. Display; 3. Camera; 4. Door. DETAILED DESCRIPTION

[0081] In order to enable those skilled in the art to better understand the present invention, the following will clearly and completely describe the technical solutions in the embodiments of the present invention in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments in the present invention, all other embodiments obtained by ordinary technicians in this field without making creative efforts should fall within the scope of protection of this application.

[0082] It should be understood that the “plurality” mentioned herein refers to two or more than two. In the description of the embodiments of the present application, unless otherwise specified, “ / ” means or, for example, A / B can mean A or B; “and / or” in this article is merely a description of the association relationship of associated objects, indicating that there can be three relationships, for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, in order to facilitate a clear description of the technical solutions of the embodiments of the present application, in the embodiments of the present application, words such as “first” and “second” are used to distinguish between identical or similar items with substantially the same functions and effects. Those skilled in the art can understand that words such as “first” and “second” do not limit the quantity and execution order, and words such as “first” and “second” do not limit certain different

[0083] In addition, the terms "comprises" and "having" and any variations thereof are intended to cover a non-exclusive inclusion. For example, a process, method, system, product or apparatus that includes a series of steps or elements is not necessarily limited to those steps or elements expressly listed but may include other steps or elements not expressly listed or inherent to such process, method, product or apparatus.

[0084] In modern society, while most people with disabilities rely on others for their daily needs, they can also demonstrate remarkable adaptability, overcoming physical limitations and living independently. For example, people without arms can skillfully use their feet to successfully complete many daily activities, such as washing and drying clothes.

[0085] However, the operation design of current home appliances lacks special consideration for people with disabilities.

[0086] For example, washing machines often require multiple buttons to operate, including but not limited to turning the machine on and off, selecting wash modes, selecting parameters and other auxiliary functions, and starting a program. Furthermore, the control panels on current washing machines are located at the top, requiring people without arms to lift their feet to select programs and start the machine, which is extremely inconvenient.

[0087] Based on this, the embodiments of the present application provide a control method for a clothing processing device and a clothing processing device, which are intended to solve the problems that it is difficult for disabled people without arms to operate the panel, the laundry process is cumbersome for ordinary users, the buttons of the washing machine are insensitive due to long-term touch, and the panel of the washing machine is dirty, the paint is peeled, and the panel is corroded due to long-term contact. This solution removes the panel control module of the washing machine and only retains the display module. A camera is installed on the front shell of the washing machine, and the camera can capture a certain area on the ground in front of the washing machine and establish a three-dimensional coordinate system. The area can capture the user's feet, and the user makes an action in the shooting area of ​​the washing machine camera, and the washing machine records and generates a video, and then decomposes the video into frame pictures, and connects the toes of each picture to form a path shape. The washing machine matches pre-recorded default path commands based on the shape of the stroking path. For example, lifting a toe is recognized as opening the door, swiping left or right on the ground switches modes, and drawing a circle on the ground is recognized as starting the machine. Innovative interactive solutions also allow users to customize common programs and parameters and record the foot gesture paths that match each program. After turning on the washing machine, the user simply swipes to perform this path, and the washing machine will directly run the program, eliminating the process of selecting modes and adjusting parameters and functions. Another solution is to identify and record various proportional parameters based on a photo of the user's feet and store them as independent user data. The solution that recognizes the user at startup and automatically switches to their common program, eliminating the tedious process of adjusting parameters when different users use different programs, at least solves the above problem.

[0088] Next, the control method of the clothes processing device provided by the embodiment of the present application is described in detail. Figure 1 The flowchart of the control method of the clothes processing device shown in FIG. 1 includes the following processing procedures.

[0089] S100: Acquire a foot image in a video stream shot for a user's feet.

[0090] In one embodiment, the foot image refers to an image containing feet, which can be a frame image in a video stream. The foot image can be obtained by capturing the video stream by a camera 3 installed on the clothing processing device.

[0091] S102: Determine a movement path of the user's foot according to the foot image.

[0092] The video stream includes multiple time-sequential foot images. Tongguoh can determine the movement path of the user's feet by identifying multiple footstep images.

[0093] The motion path refers to the running route of the user's feet, which may have length, direction, and shape.

[0094] S104: Control the clothes processing device to perform corresponding actions according to the shape of the motion path.

[0095] In one embodiment, the shapes of the motion paths are different, and the actions performed by the clothes treating apparatus are different.

[0096] By adopting this embodiment, the action control of the clothing processing device can be completed by obtaining the user's footsteps image, so that when the user needs to control the clothing processing device, he only needs to ensure that the feet can be photographed, and there is no need to control the clothing processing device through hand movements such as pressing buttons or touching the control screen. This makes it easier for armless disabled people to operate the clothing processing device, thereby improving the convenience of using the clothing processing device.

[0097] In a possible embodiment of the present application, determining the movement path of the user's foot according to the foot image includes:

[0098] Based on multiple foot images in the video stream, target features of the user's feet are connected according to the time sequence of the multiple foot images to obtain a motion path.

[0099] It should be noted that the multiple footstep images can be continuous footstep images in a time sequence, that is, multiple continuous frame images in a video stream, or can be intermittent footstep images in a time sequence, and this embodiment does not make any specific limitation on this.

[0100] When connecting the target features, all positions of the target features in multiple footstep images may be connected. For example, after all positions of the target features in multiple footstep images are connected, a circle is formed to obtain a motion path.

[0101] By adopting this implementation method, target features are connected according to the time sequence of multiple footstep images to obtain a motion path, which is simple to calculate, helps to save computing resources and reduce computing costs.

[0102] Optionally, in one implementation of this embodiment, the target feature includes a big toe in the foot image;

[0103] Connect the target features of the user's feet according to the time sequence of multiple foot images to obtain the motion path, including:

[0104] According to the time sequence of the plurality of foot images, the big toe position in each foot image is identified one by one, and the big toe positions are connected to obtain a motion path.

[0105] Specifically, the big toe position refers to the position of the tip of the big toe.

[0106] By adopting this implementation method, the recognition of the big toe is higher. By identifying the position of the big toe and connecting the lines, the motion path is obtained, which helps to improve the accuracy of the motion path recognition, thereby reducing the number of times the user has to re-control the foot movement due to recognition failure, which is conducive to improving the user's convenience in using the clothing processing equipment.

[0107] Optionally, in an implementation of this embodiment, controlling the laundry processing device to perform corresponding actions according to the shape of the motion path includes:

[0108] According to the shape, the control instruction corresponding to the shape is retrieved from the preset control relationship.

[0109] In one embodiment, the control relationship includes an association relationship between the shape of the motion path and the control instruction, different shapes are associated with different control instructions, and different control instructions are used to control the clothing processing device to perform different actions.

[0110] The clothes processing device is controlled to perform corresponding actions according to the control instructions.

[0111] In one embodiment, the actions performed by the clothing processing device include opening and closing the door, turning on and off the machine, switching modes, switching parameters, selecting parameter values, etc., which are not specifically limited in this embodiment.

[0112] When using this implementation method, when controlling the clothing processing device to perform actions, it is implemented according to a preset control relationship, so that different users can control the actions of the clothing processing device more conveniently by modifying the control relationship, thereby improving the convenience of using the clothing processing device.

[0113] Optionally, in an implementation of this embodiment, the control relationship includes a default control relationship and a custom control relationship;

[0114] Before calling the control instruction corresponding to the shape from the preset control relationship based on the shape, the method further includes:

[0115] determining feature information of the user's foot based on the foot image;

[0116] The default control relationship or the customized control relationship is selectively used according to the pre-stored characteristic information to call the control instruction.

[0117] In one embodiment, characteristic information refers to information that can identify a user. In other words, different users can be distinguished based on the characteristic information. The characteristic information can be local information of the foot or information calculated using the foot information, which is not specifically limited in this embodiment.

[0118] By adopting this implementation method, before controlling the clothing processing device to perform an action, it will first determine whether to use the default control relationship or the customized control relationship based on the characteristic information of the user's feet, thereby improving the accuracy of the retrieved control instructions, thereby reducing the number of times the user re-controls the foot movements, and improving the convenience of using the clothing processing device.

[0119] Optionally, in an implementation of this embodiment, calling a control instruction corresponding to the shape from a preset control relationship based on the shape includes:

[0120] If a custom control relationship associated with the feature information is pre-stored, the control instruction corresponding to the shape is retrieved from the associated custom control relationship according to the shape;

[0121] If there is no pre-stored custom control relationship associated with the feature information, the control instruction corresponding to the shape is retrieved from the default control relationship according to the shape;

[0122] The control instruction includes at least one of a door opening instruction, a door closing instruction, a mode switching instruction, a parameter switching instruction, a parameter adjustment instruction, a selection instruction and a shutdown instruction.

[0123] With this implementation, users can set custom control relationships so that when using the clothing handling device, they can simply control their feet to perform movements according to the custom control relationships they set, reducing the difficulty of controlling the clothing handling device. For users who have not set custom control relationships, control instructions will be called according to the default control relationship to activate the clothing handling device, improving the convenience of using the clothing handling device.

[0124] Optionally, in an implementation of this embodiment, determining feature information of the user's foot based on the foot image includes:

[0125] Identifying the length of the big toe, the length of the little toe, and the length of the foot in the foot image, and / or identifying the width of the big toe and the width of all toes in the foot image, and / or identifying the angle between the side of the big toe away from the little toe and the inner side of the foot in the foot image;

[0126] The ratio of the length of the big toe, the length of the little toe to the length of the foot and / or the ratio of the width of the big toe to the width of all toes and / or the angle are used as feature information.

[0127] This implementation method helps to improve the accuracy of user identification using feature information.

[0128] Optionally, in an implementation of this embodiment, after determining feature information of the user's foot based on the foot image, the method further includes:

[0129] Determining whether feature information is pre-stored;

[0130] If not pre-stored, the feature information is pre-stored and corresponding new user information is generated;

[0131] If the characteristic information is pre-stored or the corresponding new user information is generated, it is determined whether the characteristic information is pre-associated with a custom program;

[0132] If a custom program is pre-associated, the clothing processing device is controlled to display the custom program first;

[0133] If no custom program is pre-associated, determine whether the user information corresponding to the characteristic information has run the program;

[0134] If the program has been run, the clothes processing device is controlled to preferentially display the program that the user information last ran;

[0135] If no program has been run, the clothes processing device is controlled to display the preset target program first.

[0136] This implementation method helps reduce user actions and improves the ease of use of the clothing processing device.

[0137] Optionally, in an implementation of this embodiment, the method further includes:

[0138] If the shape of the motion path is the target shape, the process will enter the custom setting process;

[0139] The custom setting process includes:

[0140] Get the custom motion path of the user's foot and get the custom shape;

[0141] The selected control instruction is associated with the custom shape according to the control instruction selected by the user.

[0142] With this implementation, when a user needs to customize the association between control instructions and custom shapes, he or she can enter the custom setting process by moving the target shape with his or her feet without the assistance of others, thereby improving the ease of use of the clothing processing equipment.

[0143] The present application also provides a method for controlling a clothes processing device, which is applied to Figure 2 and 3 The clothes processing device shown in the figure comprises a housing 1, a display screen 2 replacing the touch module is provided on the upper side of the housing 1, a camera 3 for photographing the front area of ​​the housing 1 is also provided on the housing 1, and the display screen 2 is used to display the foot image in the target area photographed by the camera 3. Figure 4 As shown, the control method of the clothes processing device includes:

[0144] S200: If it is recognized that a foot enters the target area, the clothes processing device is controlled to enter the standby state; otherwise, the clothes processing device remains in the off state.

[0145] S202: After the laundry processing device enters a standby state, the movement paths of the user's feet are sequentially identified according to the program running sequence of the laundry processing device.

[0146] S204: Control the clothes treating device to execute actions that can be performed in the current program according to the shape of the motion path.

[0147] Optionally, in an implementation of this embodiment, identifying the movement path of the user's foot in sequence according to the program running order of the clothes processing device includes:

[0148] When the clothing processing device runs a current program, obtaining a foot image from a video stream captured of a user's feet during the running of the current program;

[0149] determining a motion path corresponding to the current program based on the foot image corresponding to the current program;

[0150] When the clothing processing device runs a next program, obtaining a foot image in a video stream captured of the user's feet during the running of the next program;

[0151] A motion path corresponding to the next program is determined according to the foot image corresponding to the next program.

[0152] Optionally, in an implementation of this embodiment, when the clothes processing device runs different programs, the actions that can be performed are all associated with reference shapes;

[0153] Controlling the laundry processing device to perform actions that can be performed in the current program according to the shape of the motion path includes:

[0154] determining whether the shape of the motion path is identical to at least one reference shape associated with the current program;

[0155] If they are the same, controlling the clothes processing device to perform an action associated with the reference shape;

[0156] The program run by the clothes processing device includes at least one of a door opening program, a mode selection program, a parameter selection program, a parameter assignment program and a shutdown program.

[0157] An embodiment of the present application also provides a clothing processing device that is controlled using the above-mentioned control method for clothing processing devices.

[0158] Optionally, in one implementation of this embodiment, the clothing processing device includes a housing 1, a display screen 2 replacing the touch module is provided on the upper side of the housing 1, and a camera 3 for photographing the front area of ​​the housing 1 is also provided on the housing 1, and the display screen 2 is used to display the image of the feet in the target area photographed by the camera 3.

[0159] Optionally, in an implementation of this embodiment, the clothing processing device includes at least one of a washing machine, a washer-dryer, and an all-in-one washer-dryer.

[0160] In the above embodiments of the present application, the descriptions of the various embodiments have their own emphasis. For parts that are not described in detail in a certain embodiment, please refer to the relevant descriptions of other embodiments. The steps shown in the relevant flow charts can be executed in a computer system such as a set of computer-executable instructions, and although a logical order is shown in the flow charts, in some cases, the steps shown or described can be executed in an order different from that shown here. In other words, the order of steps described in the foregoing embodiments is only an example, and reasonable adjustment of the order of steps based on the content of the embodiments of the present application is also within the scope of protection of the embodiments of the present application.

[0161] In a specific implementation of the embodiment of the present application, the control method of the clothing processing device includes the following processing steps:

[0162] like Figure 3-12 As shown, the user enters the shooting area of ​​the washing machine camera 3 (as shown in FIG. Figure 3 As shown), the washing machine recognizes that a foot or shoe has entered the target area (S1), and turns on and enters the standby state (S2), otherwise it remains in the off state (S28). After the washing machine enters the standby state, it determines whether the user has customized the door opening action (S3). Before making the judgment, the user's identity needs to be identified. The identification process includes: photographing the user's feet through the camera 3, identifying the foot image, and entering the identified foot image into the information database: recording the ratio information of the toe length p, r and the entire foot length q (as shown in FIG. Figure 5 Record the ratio of the width of the big toe m to the width of all toes n (as shown in Figure 6 Record the growth angle α of the big toe (as shown); Figure 7 The user identity is determined based on the ratio information and the angle α. If a corresponding stored user identity is found, a new user identity a is established.

[0163] After obtaining the user identity, it can be determined whether the user has customized the door opening action. If the user has customized the door opening action, it is then determined whether the user's toe movement path matches the customized door opening action (S5). If it matches the customized door opening action, the door 4 is controlled to open (S7). If it does not match the customized door opening action, it is then determined whether the user's toe movement path is the default door opening action (S4), such as lifting the left toe (such as Figure 8 If the default door opening action is set, the door 4 is opened. Otherwise, it is prompted that the door opening action is not recognized (S5), and the user's footsteps are collected again to determine whether the user has customized the door opening action. If the user has not customized the door opening action, step S4 is executed.

[0164] After the door 4 is opened, the user can put clothes and detergent in. After putting in, the user closes the door 4 (S8), and the washing machine enters the waiting stage (S9).

[0165] During the startup phase, the camera 3 continuously collects the user's foot movements and determines whether the user has customized the startup action of the dedicated program (S10). If so, it identifies whether the user's toe movement path matches the startup action of the customized dedicated program (S12). Otherwise, it identifies whether the user's toe movement path is the default startup action (S11), such as drawing a circle (e.g. Figure 9 shown).

[0166] If the user has customized a special program startup action and the user's toe movement path is identified as matching the customized special program startup action, the washing machine starts the customized special program (S13). If the user has not customized a special program startup action but the user's toe movement path is identified as matching the default startup action, the washing machine is controlled to start the program and parameters selected on the panel (S22). When the operation is completed, the washing machine automatically opens the door 4 (S23). After the user collects the clothes, the door 4 is closed (S24). If no foot enters the recognition area within 15 seconds (S25), the washing machine shuts down (S26).

[0167] If the user has not customized a startup action for a dedicated program, and the user has not controlled the foot movement according to the default startup action, it is then identified whether the user's toe movement path is the default switching mode action (S14), such as left swipe / right swipe (e.g. Figure 10As shown), if so, the washing machine switches modes (S19), otherwise it is determined whether the user's toe motion path is the default setting switching parameter action (S15), such as lifting the right toe, if so, the selected mode switches the parameter to be adjusted (S20), if not, it is determined whether the user's toe motion path is the default setting adjustment parameter action (S16), such as moving forward / backward, if so, the selected parameter of the selected mode is switched to the value (S21), otherwise it is determined whether the user's toe motion path is the default setting opening door action (S17), if so, step S7 is executed, otherwise it is determined whether the user's toe motion path is the default setting shutdown action (S18), such as drawing a cross, if so, step S26 is executed, otherwise it is prompted that the relevant action instruction is not recognized (S27) and step S9 is executed.

[0168] This means that before starting a program, users can also modify the mode or parameters. For example, they can draw a "left / right swipe" to switch modes; draw a "right toe lift" to switch the selected parameter; and draw a "forward / backward" to adjust the value of the selected parameter. Users can also draw an "open door" gesture to continue adding clothes. If they don't want to use the washing machine, they can draw a "cross" to turn it off.

[0169] Users can customize common modes and set parameters to form special programs. Figure 11 As shown, the user first "draws a cross" to enter the custom module (S29). After entering the module, the user first draws the path of the dedicated program (S30). If this path has been saved and recorded (S31), the user decides whether to overwrite and delete the old path (S33). If not, the customization is canceled (S35). Otherwise, the original path and its associated instructions are deleted (S34). If the path has not been saved, a new recorded path is directly generated (S32). Then the user selects the instruction that matches the path. The user can draw the action path of "swipe left / right" and "move forward / backward" to switch the selected instruction (S36) ( Figure 9 If the command is already associated with an old action path (S37), the user can choose whether to overwrite and delete the original path (S38). If so, the original path is deleted (S39). If the command is not associated with an old action path, matching is performed for 3 seconds without any operation, and the new custom path is successfully associated (S40).

[0170] like Figure 12, when user a uses the washing machine next time (S41), user a enters the shooting area of ​​the washing machine camera 3. The washing machine recognizes that a foot has entered the shooting area, and identifies user a by comparing the above parameter data (S42). Determine whether user a has a customized program (S44). If so, the mode sorting of display screen 2 is prioritized to the mode program customized by user a (S45). Otherwise, determine whether the user has run a program (S46). If the user has not recorded a customized program, the mode sorting of display screen 2 is prioritized to the program used by the user last time (S47). If the user is using the washing machine for the first time, the mode sorting of display screen 2 is prioritized to the default "mixed" program (S48), and the program is run (S49). If the foot parameters identified at startup are not in the database, the washing machine starts to identify and enter the proportional parameters of this foot and save it as a new user (S43).

[0171] It should be noted that the information (including but not limited to user device information, user personal information, etc.), data (including but not limited to data used for analysis, stored data, displayed data, etc.) and signals involved in the embodiments of this application are all authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with the relevant laws, regulations and standards of the relevant countries and regions. For example, the scene data of the current frame in the three-dimensional virtual scene, the client's device information, and the scene interaction information involved in the embodiments of this application are all obtained with full authorization.

[0172] The above is only a preferred embodiment of the present application. It should be pointed out that for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the principles of the present application. These improvements and modifications should also be regarded as the scope of protection of the present application.

Claims

1. A method for controlling a clothes processing device, characterized in that: The method comprises: Obtain a foot image from a video stream shot at the user's feet; determining a movement path of the user's foot according to the foot image; controlling the clothes treating device to perform corresponding actions according to the shape of the motion path; The controlling the laundry processing device to perform a corresponding action according to the shape of the motion path includes: Retrieving a control instruction corresponding to the shape from a preset control relationship according to the shape, wherein the control relationship includes an association between the shape of the motion path and the control instruction, different shapes are associated with different control instructions, and different control instructions are used to control the clothing processing device to perform different actions; controlling the clothes processing device to perform corresponding actions according to the control instruction; The control relationship includes a default control relationship and a custom control relationship; Before calling a control instruction corresponding to the shape from a preset control relationship according to the shape, the method further includes: determining feature information of the user's foot based on the foot image; selectively using the default control relationship or the customized control relationship according to the pre-stored condition of the characteristic information to call the control instruction; The step of retrieving a control instruction corresponding to the shape from a preset control relationship according to the shape includes: If a custom control relationship associated with the feature information is pre-stored, then according to the shape, the control instruction corresponding to the shape is retrieved from the associated custom control relationship; If there is no pre-stored custom control relationship associated with the feature information, then according to the shape, the control instruction corresponding to the shape is retrieved from the default control relationship; The control instruction includes at least one of a door opening instruction, a door closing instruction, a mode switching instruction, a parameter switching instruction, a parameter adjustment instruction, a selection instruction and a shutdown instruction.

2. The control method of the clothes processing device according to claim 1, characterized in that: The determining the movement path of the user's foot according to the foot image includes: Based on the multiple foot images in the video stream, target features of the user's feet are connected according to the time sequence of the multiple foot images to obtain the motion path.

3. The control method of the clothes processing device according to claim 2, characterized in that: The target feature includes a big toe in the foot image; Connecting target features of the user's feet according to the time sequence of the multiple foot images to obtain the motion path includes: According to the time sequence of the plurality of foot images, the big toe position in each of the foot images is identified one by one, and the big toe positions are connected to obtain the motion path.

4. The control method of the clothes processing device according to claim 1, characterized in that: The determining feature information of the user's foot based on the foot image includes: Identifying the length of the big toe, the length of the little toe, and the length of the foot in the foot image, and / or identifying the width of the big toe and the width of all toes in the foot image, and / or identifying the angle between the side of the big toe away from the little toe and the inner side of the foot in the foot image; The ratio of the length of the big toe, the length of the little toe to the length of the foot and / or the ratio of the width of the big toe to the width of all toes and / or the angle is used as the feature information.

5. The control method of the clothes processing device according to claim 4, characterized in that: After determining the feature information of the user's foot based on the foot image, the method further includes: Determining whether the characteristic information is pre-stored; If not pre-stored, pre-store the characteristic information and generate corresponding new user information; If the characteristic information is pre-stored or the corresponding new user information is generated, it is determined whether the characteristic information is pre-associated with a custom program; If the custom program is pre-associated, controlling the clothes processing device to preferentially display the custom program; If the custom program is not pre-associated, determining whether the user information corresponding to the characteristic information has run the program; If the program has been run, the clothes processing device is controlled to preferentially display the program that the user information last ran; If no program has been run, the clothes processing device is controlled to display the preset target program first.

6. The control method of the clothes processing device according to claim 5, characterized in that: The method further comprises: If the shape of the motion path is the target shape, then enter the custom setting process; The custom setting process includes: Get the custom motion path of the user's foot and get the custom shape; The selected control instruction is associated with the custom shape according to the control instruction selected by the user.

7. The control method of the clothes processing device according to claim 1, characterized in that: The laundry processing device includes a housing, a display screen replacing a touch module is provided on an upper side of the housing, a camera for photographing an area in front of the housing is further provided on the housing, and the display screen is used to display an image of a foot within a target area photographed by the camera. The method further includes: If a foot is detected entering the target area, the clothes processing device is controlled to enter a standby state, otherwise the clothes processing device remains in a shutdown state; After the laundry processing device enters a standby state, the movement paths of the user's feet are sequentially identified according to the program running order of the laundry processing device; The clothes treating device is controlled to perform actions that can be performed in the current program according to the shape of the motion path.

8. The control method of the clothes processing device according to claim 7, characterized in that: The step of sequentially identifying the movement paths of the user's feet according to the program running order of the laundry processing device includes: When the clothes processing device runs a current program, obtaining a foot image in a video stream captured of a user's feet during the running of the current program; determining a motion path corresponding to the current program according to the foot image corresponding to the current program; When the clothing processing device runs a next program, obtaining a foot image in a video stream captured of the user's feet during the running of the next program; A motion path corresponding to the next program is determined according to the foot image corresponding to the next program.

9. The control method of the clothes processing device according to claim 8, characterized in that: When the laundry processing device runs different programs, the actions that can be performed are all associated with reference shapes; The controlling of the clothes treating device to execute actions that can be performed in the current program according to the shape of the motion path includes: determining whether a shape of the motion path is identical to at least one reference shape associated with the current program; If they are the same, controlling the clothes treating device to perform an action associated with the reference shape; The program run by the clothes processing device includes at least one of a door opening program, a mode selection program, a parameter selection program, a parameter assignment program and a shutdown program.

10. A clothes processing device, characterized in that: The control method of the clothing processing device according to any one of claims 1 to 9 is used for control.

11. The clothes treating device according to claim 10, characterized in that: The clothing processing device includes a casing, a display screen replacing the touch module is provided on the upper side of the casing, a camera for photographing the front area of ​​the casing is also provided on the casing, and the display screen is used to display the foot image in the target area photographed by the camera.

12. The clothes treating device according to claim 11, characterized in that: The laundry processing device includes at least one of a washing machine, a washer-dryer and an all-in-one washer-dryer.

Images