Intelligent prompting method of washing machine, storage medium and electronic device

Abstract

The invention discloses an intelligent prompting method of a washing machine, a storage medium and an electronic device, and relates to the technical field of intelligent clothes washing, the intelligent prompting method of the washing machine comprises the following steps: respectively carrying out image identification on washing mark images and clothes images of a plurality of to-be-washed clothes collected by an image collection device; washing information in the washing standard image of each piece of to-be-washed clothes and clothes attribute information of the to-be-washed clothes are obtained; determining whether a washing conflict exists or not according to washing information in the washing standard image of each piece of to-be-washed clothes and clothes attribute information of the to-be-washed clothes, and if yes, performing washing feedback according to the washing conflict; the clothes washing feedback comprises suggestions, prompts or warnings; and determining washing machine washing mode information of each piece of to-be-washed clothes according to the clothes washing feedback. According to the invention, different types of clothes can be distinguished, and appropriate clothes washing prompts are given.

Description

Technical Field

[0001] The present application relates to the technical field of intelligent washing machines, and particularly relates to an intelligent prompting method, a storage medium, and an electronic device for a washing machine. Background Art

[0002] With the continuous progress of smart home technology and the improvement of users' living standards, users' demands for the intelligence of laundry equipment and the user experience have increased.

[0003] Due to the large capacity of existing washing machines, and washing multiple pieces of clothes together saves water, electricity, and time, with high efficiency, people often choose to accumulate clothes in the dirty clothes basket and wash them together. However, different clothes require different washing methods and procedures. Many users, due to knowledge level or habits, often directly put all clothes into the washing machine without any distinction. If all clothes are washed together, it may cause some clothes to be damaged or the washing effect to be poor. Even some clothes may be damaged during the washing process due to material, color, etc., resulting in unnecessary losses.

[0004] Since different clothes have different requirements for washing, people often need to manually classify the clothes before washing and wash the same type of clothes together. This classification process will take users a lot of energy and time. If not careful, losses such as clothes bleeding and clothes damage are likely to occur.

[0005] Existing washing machines in the market only have passive washing functions and do not have the function of intelligently classifying clothes for washing, and often cannot solve the above problems. Summary of the Invention

[0006] The present application provides an intelligent prompting method, a storage medium, and an electronic device for a washing machine, which are used to solve the defect in the prior art that the washing machine does not have intelligent classification and affects the washing effect during the washing process, realizes the distinction of different types of clothes, and gives appropriate washing prompts.

[0007] In view of the problems existing in the prior art, an embodiment of the present invention provides an intelligent prompting method for a washing machine, including:

[0008] Performing image recognition on the washing label images and clothing images of a plurality of clothes to be washed collected by an image acquisition device respectively, so as to obtain the washing information in the washing label image of each piece of clothing to be washed and the clothing attribute information of the clothing to be washed;

[0009] Determine whether there is a laundry conflict based on the washing information in the washing label image of each piece of laundry to be washed and the clothing attribute information of the laundry to be washed. If so, provide a laundry feedback based on the laundry conflict; the laundry feedback includes suggestions, reminders, or warnings.

[0010] Determine the washing method information of the washing machine for each piece of laundry to be washed according to the laundry feedback.

[0011] According to an intelligent prompting method for a washing machine provided by the present application, the washing information includes washing type and washing temperature; the clothing attribute information includes clothing color and clothing type. Determine the laundry conflict according to the washing information in the washing label image of each piece of laundry to be washed and the clothing attribute information of the laundry to be washed, and provide a laundry feedback based on the laundry conflict. Specifically, it includes: obtaining the clothing colors of different pieces of laundry to be washed, judging the color systems to which different clothing colors belong. If the laundry to be washed belongs to different color systems, provide a laundry feedback for clothing color conflict; obtaining the washing types of different pieces of laundry to be washed, judging whether there is a conflict in the washing types between the laundry to be washed. If so, provide a laundry feedback for washing type conflict; obtaining the washing temperature ranges of different pieces of laundry to be washed, taking the intersection of the temperature ranges of different pieces of laundry to be washed. If the obtained intersection is empty, provide a laundry feedback for laundry temperature conflict; obtaining the clothing types of different pieces of laundry to be washed, judging whether there is a conflict in the clothing types between the laundry to be washed. If so, provide a laundry feedback for clothing type conflict.

[0012] According to an intelligent prompting method for a washing machine provided by the present application, perform image recognition on the washing label images and clothing images of multiple pieces of laundry to be washed collected by the image acquisition device respectively to obtain the washing information in the washing label image of each piece of laundry to be washed and the clothing attribute information of the laundry to be washed. Specifically, it includes: obtaining the clothing image and the washing label image of the laundry to be washed through the image acquisition device, and uploading the clothing image and the washing label image to the terminal; recognizing the washing label image through a pre-trained washing label detection model to determine the washing information of the laundry to be washed; the pre-trained washing label detection model is obtained by training according to a training set, and the training set is a washing label image with labels; recognizing the laundry to be washed image through a pre-trained clothing recognition model to obtain the clothing attribute information of the laundry to be washed; the pre-trained clothing recognition model is obtained by training according to a training set, and the training set is a clothing image with labels; determining the label of the laundry to be washed according to the washing information and the clothing attribute information, and storing the identifier of the laundry to be washed in the database according to the label.

[0013] An intelligent prompting method for a washing machine provided by the present application. The method includes identifying the image of the laundry to be washed through a pre-trained clothing recognition model to obtain the clothing attribute information of the laundry to be washed, which specifically includes: performing region segmentation on the image of the laundry to be washed through the pre-trained clothing recognition model; obtaining the average RGB value of each segmented region, calculating the Euclidean distance between the average RGB value and the preset RGB value of the color category, and taking the category with the smallest Euclidean distance from the average RGB value as the color category corresponding to the laundry to be washed, which is used as the clothing color; obtaining the clothing features in each segmented region, outputting the clothing type corresponding to the maximum probability value of each segmented region according to the clothing features, and determining the clothing type to which the segmented region with the largest number belongs as the clothing type of the laundry to be washed.

[0014] An intelligent prompting method for a washing machine provided by the present application. After obtaining the washing information and clothing attribute information of the selected laundry to be washed, the method further includes: searching for clothes with the same label as the label of the laundry to be washed, and recommending the found clothes as the clothes suitable for washing together with the laundry to be washed.

[0015] An intelligent prompting method for a washing machine provided by the present application. When determining the laundry to be washed selected by the user, it further includes: obtaining the image of the laundry to be washed, and querying whether the information of the laundry to be washed already exists in the database according to the identified clothing attribute information; if it exists, obtaining the washing information and clothing attribute information of the laundry to be washed already stored in the database; if it does not exist, identifying the washing information and clothing attribute information of the laundry to be washed through the corresponding model, and storing the washing information and clothing attribute information of the laundry to be washed in the database.

[0016] The present application also provides an intelligent prompting device for a washing machine, including:

[0017] A module for obtaining laundry attribute information, which is used to perform image recognition on the washing label images and clothing images of multiple laundries to be washed collected by an image acquisition device respectively, so as to obtain the washing information in the washing label image of each laundry to be washed and the clothing attribute information of the laundry to be washed;

[0018] A laundry prompting module, which is used to determine whether there is a laundry conflict according to the washing information in the washing label image of each laundry to be washed and the clothing attribute information of the laundry to be washed. If so, perform laundry feedback according to the laundry conflict; the laundry feedback includes suggestions, reminders or warnings; determine the washing method information of each laundry to be washed according to the laundry feedback.

[0019] An intelligent prompting device for a washing machine provided by the present application, wherein the washing information includes the washing type and the washing temperature; the clothing attribute information includes the clothing color and the clothing type; the laundry conflict is determined according to the washing information in the washing label image of each to-be-washed clothing and the clothing attribute information of the to-be-washed clothing, and laundry feedback is performed according to the laundry conflict, which specifically includes: obtaining the clothing colors of different to-be-washed clothes, judging the color systems to which different clothing colors belong, if the to-be-washed clothes belong to different color systems, then performing laundry feedback for clothing color conflict; obtaining the washing types of different to-be-washed clothes, judging whether there is a conflict in the washing types between the to-be-washed clothes, if so, then performing laundry feedback for washing type conflict; obtaining the washing temperature ranges of different to-be-washed clothes, taking the intersection of the temperature ranges of different to-be-washed clothes, if the obtained intersection is empty, then performing laundry feedback for laundry temperature conflict; obtaining the clothing types of different to-be-washed clothes, judging whether there is a conflict in the clothing types between the to-be-washed clothes, if so, then performing laundry feedback for clothing type conflict.

[0020] The present application also provides an electronic device, including a memory and a processor, wherein a computer program is stored in the memory, and the processor is configured to execute to implement the intelligent prompting method of the washing machine as described in any one of the above.

[0021] The present application also provides a computer-readable storage medium, wherein the computer-readable storage medium includes a stored program, and when the program runs, it executes to implement the intelligent prompting method of the washing machine as described in any one of the above.

[0022] The present application also provides a computer program product, including a computer program, and when the computer program is executed by a processor, it implements the intelligent prompting method of the washing machine as described in any one of the above.

[0023] The intelligent prompting method, storage medium and electronic device of the washing machine provided by the present application can identify by collecting photos of to-be-washed clothes, obtain clothing attribute information and washing information, analyze and classify according to the clothing attribute information and washing information, and can give feedback on clothes that are not suitable to be washed together, avoiding the color bleeding problem caused by washing multiple different-colored clothes together, avoiding the problem of clothing damage caused by washing clothes of different materials together, and avoiding the hygiene problem caused by washing different types of clothes together; it can also give clothes that can be washed together through feedback suggestions to help users with clothing co-washing recommendations, saving the time for users to manually classify by themselves, providing an active and intelligent interaction experience for users, and thus giving professional suggestions and high-risk wrong operations before washing, avoiding risks and reducing losses for users. Description of the Drawings

[0024] The accompanying drawings here are incorporated into and form a part of this specification, showing embodiments consistent with this application and, together with the specification, are used to explain the principles of this application.

[0025] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the following will briefly introduce the accompanying drawings required for use in the description of the embodiments or the prior art. Obviously, for those of ordinary skill in the art, without creative efforts, other drawings can also be obtained based on these drawings.

[0026] Figure 1 is a schematic diagram of the hardware environment of an intelligent prompting method for a washing machine according to an embodiment of this application;

[0027] Figure 2 is a schematic diagram of the washing label provided by this application;

[0028] Figure 3 is one of the schematic flowcharts of the intelligent prompting method for the washing machine provided by this application;

[0029] Figure 4a is a schematic diagram of the washing label indicating that the water temperature should not exceed 30°C provided by this application;

[0030] Figure 4b is a schematic diagram of the washing label indicating that it is not washable provided by this application;

[0031] Figure 5 is another schematic flowchart of the intelligent prompting method for the washing machine provided by this application;

[0032] Figure 6 is a schematic diagram of the structure of an electronic device provided by this application. Detailed implementation manners

[0033] To enable those skilled in the art to better understand the solutions of this application, the following will clearly and completely describe the technical solutions in the embodiments of this application with reference to the accompanying drawings in the embodiments of this application. Obviously, the described embodiments are only a part of the embodiments of this application, rather than all of them. Based on the embodiments in this application, all other embodiments obtained by those of ordinary skill in the art without creative efforts should fall within the scope of protection of this application.

[0034] It should be noted that the terms "first", "second", etc. in the description, claims and above-mentioned drawings of this application are used to distinguish similar objects, and do not necessarily describe a specific order or sequence. It should be understood that the data used in this way can be interchanged under appropriate circumstances, so that the embodiments of this application described here can be implemented in an order different from those illustrated or described here. In addition, the terms "comprising" and "having" and any variations thereof are intended to cover non-exclusive inclusion. For example, a process, method, system, product or device comprising a series of steps or units does not necessarily limit to those clearly listed steps or units, but may include other steps or units not clearly listed or inherent to these processes, methods, products or devices.

[0035] According to one aspect of the embodiments of the present application, a smart prompting method for a washing machine is provided. The smart prompting method for the washing machine is widely applied to whole-house intelligent digital control application scenarios such as Smart Home, smart home, intelligent household device ecosystem, Intelligence House ecosystem, etc. Optionally, in this embodiment, the smart prompting method for the above-mentioned washing machine can be applied to, for example Figure 1 the hardware environment composed of the terminal device 102 and the server 104 as shown. As Figure 1 shown, the server 104 is connected to the terminal device 102 through the network, and can be used to provide services (such as application services, etc.) for the terminal or the client installed on the terminal. A database can be set on the server or independently of the server, and is used to provide data storage services for the server 104. Cloud computing and / or edge computing services can be configured on the server or independently of the server, and are used to provide data operation services for the server 104.

[0036] The above-mentioned network can include but is not limited to at least one of the following: wired network, wireless network. The above-mentioned wired network can include but is not limited to at least one of the following: wide area network, metropolitan area network, local area network. The above-mentioned wireless network can include but is not limited to at least one of the following: WIFI (Wireless Fidelity), Bluetooth. The terminal device 102 is not limited to a PC, mobile phone, tablet computer, smart air conditioner, smart range hood, smart refrigerator, smart oven, smart stove, smart washing machine, smart water heater, smart washing equipment, smart dishwasher, smart projection device, smart TV, smart clothes hanger, smart curtain, smart audio and video, smart socket, smart speaker, smart sound box, smart fresh air device, smart kitchen and bathroom equipment, smart bathroom equipment, smart floor sweeping robot, smart window cleaning robot, smart mopping robot, smart air purification device, smart steam box, smart microwave oven, smart kitchen treasure, smart purifier, smart water dispenser, smart door lock, etc.

[0037] The washing label refers to the label (usually white) on the edge of the clothes and pants that people usually buy. Generally, the words "Washing Instructions" or "Certificate of Conformity" are written at the top of the label. Then, there will be an explanation of the raw material composition of the clothes and pants, as well as patterns and written explanations about the washable and non-washable methods of the clothes and pants.

[0038] Washing label recognition refers to automatically detecting and recognizing all the washing label patterns in the picture of the clothing washing label taken, and obtaining the types of clothing washing marks, such as Figure 2 shown.

[0039] Although washing label recognition can identify the washable or non-washable methods of a certain piece of clothing, this is only one consideration in washing. For the color and material of the clothing during washing, there are two other factors that must be considered. For color, if light-colored and dark-colored clothes are washed without distinction, it is very likely to cause staining and make the clothes scrapped; for styles, certain specific categories of clothes are not suitable for washing, such as suits, silk clothes, etc.

[0040] By taking pictures of the clothing washing label to recognize the washable or non-washable methods of the clothing, distinguishing the light and dark color categories of the clothing through clothing color recognition, obtaining the information on whether the clothing can be washed or not and the information on the need to wash it separately from other types of clothing through clothing type recognition, and then integrating the relevant logics of these three types of information, automatically screening out different levels of opinions on washing a pile of clothes at the same time and actively prompting the user.

[0041] Figure 3 The flow chart of an intelligent prompting method for a washing machine provided by the present invention may include the following steps:

[0042] S310: Perform image recognition on the washing label images and clothing images of multiple pieces of clothing to be washed collected by the image acquisition device respectively, so as to obtain the washing information in the washing label image of each piece of clothing to be washed and the clothing attribute information of the clothing to be washed.

[0043] The image acquisition device can be set in a mobile terminal or on an intelligent device with a camera such as a washing machine.

[0044] An intelligent prompting method for a washing machine provided by the present application respectively performs image recognition on the washing label images and clothing images of multiple items of laundry collected by an image acquisition device to obtain the washing information in the washing label image of each item of laundry and the clothing attribute information of the item of laundry, specifically including: obtaining the clothing image and the washing label image of the item of laundry through the image acquisition device, and uploading the clothing image and the washing label image to the terminal; recognizing the washing label image through a pre-trained washing label detection model to determine the washing information of the item of laundry; the pre-trained washing label detection model is obtained by training according to a training set, and the training set is a washing label image with labels; recognizing the item of laundry image through a pre-trained clothing recognition model to obtain the clothing attribute information of the item of laundry; the pre-trained clothing recognition model is obtained by training according to a training set, and the training set is a clothing image with labels; determining the label of the item of laundry according to the washing information and the clothing attribute information, and storing the identifier of the item of laundry in the database according to the label.

[0045] Specifically, bind the developed laundry-related APP to the washing machine, and then start the washing program of the APP. It is required that each item of laundry to be washed uploads two pictures, one is a picture of the washing label, and the other is a picture of the clothing laid flat.

[0046] Using the washing label detection model, all the washing labels in the washing label picture are detected, and at the same time, each label corresponds to the description of the washing type method or non-washable type it represents. For example Figure 4a means it can be washed by water but the washing temperature cannot exceed 30 °C, while Figure 4b means it cannot be washed by water.

[0047] According to an intelligent prompting method for a washing machine provided by the present application, the washing information includes the washing type and the washing temperature; the clothing attribute information includes the clothing color and the clothing type.

[0048] Specifically, the washing information may include the washing type, the washing temperature, the washing time, the washing water level, the number of rinses, the dehydration speed, the dehydration time, etc.; the clothing attribute information may include the clothing use (such as upper garment, trousers, underwear, etc.), the clothing type (such as wool, silk, cotton and linen, denim, etc.), and the clothing color (red, white, black, etc.).

[0049] An intelligent prompting method for a washing machine provided by the present application recognizes an image of laundry to be washed through a pre-trained laundry recognition model, and obtains the laundry attribute information of the laundry to be washed, specifically including: performing region segmentation on the image of the laundry to be washed through the pre-trained laundry recognition model; obtaining the average RGB value of each segmented region, calculating the Euclidean distance between the average RGB value and the preset RGB value of the color category, and taking the category with the smallest Euclidean distance from the average RGB value as the color category corresponding to the laundry to be washed, as the laundry color.

[0050] Specifically, a laundry segmentation model or a laundry recognition model is used to segment the laundry area. For laundry color recognition, the average RGB pixel value within the laundry area is calculated, and then the Euclidean distance from the average RGB value of the laundry to the RGB value of each category is calculated. The category with the smallest Euclidean distance is taken as its corresponding color category.

[0051] Obtain the laundry features in each segmented region, output the laundry type corresponding to the maximum probability value of each segmented region according to the laundry features, and determine the laundry type to which the segmented region with the largest number belongs as the laundry type of the laundry to be washed. Or

[0052] Take the maximum circumscribed rectangle of the laundry area, cut it out, and send it into the laundry recognition model to obtain the type of the laundry.

[0053] In an embodiment of the present application, the washing information and laundry information of the laundry to be washed are pre-stored in a database. When the target laundry to be washed selected by the user is determined, the washing information and laundry information of the selected target laundry to be washed are obtained from the database;

[0054] Specifically, when the user uploads the information of the laundry to be washed to the database, the information of the laundry can be recorded in the APP. When washing clothes next time, there is no need to take pictures and recognize again. Just select the laundry directly from the APP, and the information of the laundry can be directly queried from the database.

[0055] Each recognized piece of laundry will be labeled with a corresponding label according to the recognition result to facilitate querying the corresponding laundry according to the label. For example, if the recognized color category of the laundry is white, a white label is attached and the identifier of the laundry is recorded in the data table under the white category; if the recognized type of the laundry is wool, a wool label is attached and the identifier of the laundry is recorded in the data table under the wool category; if the recognized laundry is machine washable, a machine washable label is attached and the identifier of the laundry is recorded in the data table under the machine washable category; if the recognized washing temperature of the laundry is 30°C to 40°C, a label with the washing temperature range of 30°C to 40°C is attached and the identifier of the laundry is recorded in the data table under the category with a temperature range of 30°C to 40°C.

[0056] Tag-based storage facilitates users to screen and find clothes.

[0057] According to an intelligent prompting method for a washing machine provided by the present application, when determining the clothes to be washed selected by the user, it further includes: obtaining an image of the clothes to be washed, and querying whether there is information of the clothes to be washed in the database according to the recognized clothes attribute information; if it exists, obtaining the washing information and clothes attribute information of the clothes to be washed stored in the database; if it does not exist, identifying the washing information and clothes attribute information of the clothes to be washed through a corresponding model, and storing the washing information and clothes attribute information of the clothes to be washed in the database.

[0058] Specifically, when the user buys new clothes, since the clothes attribute information is not stored in the database, it is necessary to take a photo of the clothes for identification at this time, and store the recognized clothes attribute information and washing information in the database.

[0059] Due to a large number of clothes, when the user cannot find the clothes to be washed on the APP for a while and forgets that the image of the clothes has been uploaded, the user can identify the clothes attribute information by taking a photo of the clothes, and then match according to the recognized information in the database to query the stored clothes and return them to the user.

[0060] Through the above pre-storage in the database, the time resources and computing resources wasted by the user after each photo identification can be reduced, and multiple ways for the user to query clothes are provided, giving the user more personalized choices.

[0061] S320: Determine whether there is a laundry conflict according to the washing information in the washing label image of each piece of clothes to be washed and the clothes attribute information of the clothes to be washed. If so, give a laundry feedback according to the laundry conflict; the laundry feedback includes suggestions, reminders or warnings; determine the washing machine washing method information of each piece of clothes to be washed according to the laundry feedback.

[0062] Specifically, there are three modes of feedback in the mobile APP: suggestions, reminders, and warnings. Suggestions are a positive feedback, that is, how to wash better; reminders are a mild negative feedback, reminding the user to pay attention, such as some cashmere sweaters are easy to pill or shrink when washed with water; warnings are a strong negative feedback, close to prohibition, such as suits cannot be washed with water.

[0063] The laundry feedback can be obtained according to a single piece of clothes to be washed, or the washing information and clothes attribute information between different pieces of clothes to be washed can be compared to obtain the laundry feedback.

[0064] An intelligent prompting method for a washing machine provided by the present application determines laundry conflicts based on the washing information in the water-wash label images of each laundry item to be washed and the clothing attribute information of the laundry items to be washed, and performs laundry feedback based on the laundry conflicts, specifically including: obtaining the clothing colors of different laundry items to be washed, determining the color systems to which different clothing colors belong, and if the laundry items to be washed belong to different color systems, performing laundry feedback for clothing color conflicts; obtaining the washing types of different laundry items to be washed, determining whether there are conflicts in the washing types between the laundry items to be washed, and if so, performing laundry feedback for washing type conflicts; obtaining the washing temperature ranges of different laundry items to be washed, taking the intersection of the temperature ranges of different laundry items to be washed, and if the obtained intersection is empty, performing laundry feedback for laundry temperature conflicts; obtaining the clothing types of different laundry items to be washed, determining whether there are conflicts in the clothing types between the laundry items to be washed, and if so, performing laundry feedback for clothing type conflicts.

[0065] Specifically, if there is a non-water-washable category among the laundry items selected by the user, the user will be directly warned on the APP side, for example, by broadcasting "Warning: The current item of clothing is not suitable for water washing. It is recommended to use other methods"; if the laundry items selected by the user can be water washed but there are conflicts in the water washing temperature, for example, the washing temperature of some clothes is higher than 40°C and the water washing temperature of some clothes does not exceed 30°C, a warning prompt will be given, for example, by broadcasting "There are conflicts in the suitable water washing temperatures of the current laundry items to be washed. Among them, the water washing temperature of the shirt is not lower than 40°C, and the water washing of the woolen sweater cannot exceed 30°C. These two pieces of clothing are not very suitable for washing together. It is recommended to wash the two pieces of clothing separately"; if there are no warning-type conflicts, the next step can be carried out.

[0066] Regarding the colors of multiple laundry items selected, if the color categories conflict severely, the user will be directly warned on the APP side and a reminder prompt will be used. For example, if the first item is a black coat and the second item is a white shirt, it will be broadcast "Reminder: The color of the first piece of clothing, which is black, conflicts with the color of the second piece of clothing, which is white. It is recommended to wash the two pieces of clothing separately".

[0067] Different clothing types will also affect washing. For example, if clothing A is made of silk and the other mixed one is made of linen, the two types of clothing are not suitable for washing together. Then a warning prompt should be taken, for example, by broadcasting "Warning: The silk clothing you put in now and the linen clothing put in the previous time are not suitable for washing together. Linen is easy to break the silk. It is recommended to wash them separately".

[0068] Different clothing uses will also be considered in classification. For example, if clothing A is an outer garment and clothing B is an undergarment, obviously they are not suitable for washing together. Then a suggestion prompt can be taken, for example, by broadcasting "Suggestion: You have washed the undergarment and the outer garment together. For the sake of personal hygiene, this is not good. You can wash the undergarment and the outer garment separately".

[0069] Through the above prompt feedback, it can help users better understand the properties and status of clothes, the washing process and results, so as to better select the appropriate washing method and program. At the same time, it can also help users better manage and maintain their clothes.

[0070] According to an intelligent prompting method of a washing machine provided by the present application, obtain recommendations for clothes that can be washed together according to the labels of the clothes to be washed selected.

[0071] After obtaining the washing information and clothing attribute information of the clothes to be washed selected, search for clothes with the same labels as the labels of the clothes to be washed, and use the found clothes as recommendations for clothes suitable to be washed together with the clothes to be washed.

[0072] Specifically, according to the identified clothing types, the washable types, non-washable types, types of clothes that can be washed together, and types of other clothes that cannot be washed together of this piece of clothing can be obtained.

[0073] For example, if the result given is "The white shirt needs to be washed with water at 50 - 60 °C", then based on the labels of the clothing such as "white" and "washing temperature range of 50 - 60 °C", conduct a temperature check, and query the clothes in the clothes to be washed with a suitable water washing temperature between 50 - 60 °C; then screen out light-colored clothes according to the clothing color label; then screen out clothes of the same material as the white shirt; after a series of label screenings of the same type, give the suggestion that the currently recommended clothes can be washed together with the white shirt.

[0074] Through the above intelligent laundry recommendations, the washing efficiency can be improved, the clothes can be protected, and resources can be saved.

[0075] After the first recommendation of clothes that can be washed together according to the clothes, record the recommendation information. When it is necessary to recommend clothes that can be washed together with this piece of clothing again next time, directly retrieve the record of the first time. To avoid untimely update of the recommendation record, when adding a new piece of clothing, update the recommendation record.

[0076] Figure 5 The figure shows a flowchart of an intelligent prompting method provided by the present application.

[0077] After starting the washing program of the APP, through photographing the washing label for washing label recognition, obtain the washing types and methods of the clothes and non-washable types, etc.; through photographing the clothes for clothing recognition, after segmenting the clothing image, recognize the clothing color and clothing type, and after comparing with the clothing types in the database, obtain the washing types and methods, non-washable types, types of other clothes that can be washed together, types of other clothes that cannot be washed together, etc., and give active prompts to the user based on the above recognition results to help the user achieve intelligent laundry.

[0078] After the user finishes classifying the clothes, the washing mode can be automatically determined according to the information parameters of the clothes to be washed.

[0079] Specifically, after determining the clothes to be washed that will ultimately be washed together, obtain the color system to which they belong, and choose whether to add a color fixative. If it is white, do not add a color fixative. If it is colored, you can choose to add a color fixative; select the washing method according to the type of clothing. For example, if the clothing type is denim, wash it using the strong mode. If it is silk, wash it using the gentle mode and choose to add a fabric softener. If it is polyester, choose normal washing, etc.; according to the allowable water washing temperature of the clothes to be washed, choose to add water at the corresponding temperature.

[0080] Wash the sorted clothes according to the selected washing mode. During the washing process, it is necessary to strictly control the water temperature, washing time, and the amount of washing liquid to ensure that the clothes can be washed correctly.

[0081] After the washing is completed, the smart washing machine can also provide functions such as intelligent perception, intelligent dosing, and intelligent drying. Recommend suitable drying and ironing methods according to the material and type of the clothes. For example, cotton clothes can choose the conventional drying method, while silk clothes should choose the gentle drying method. At the same time, according to the style and needs of the clothes, ironing and finishing can be carried out. After the clothes are washed, the recommendations can be presented to the user, enabling the user to enjoy a more intelligent and user-friendly laundry experience.

[0082] Record the detailed information of each wash, including the type of clothing, detergent, washing time, etc. Allow the user to view the historical washing records and conduct statistical analysis. Optimize the subsequent washing suggestions based on the user's washing records and feedback. It is also possible to form a user-customized washing mode by recording the user's personal habits, so that the user can choose a washing program and method suitable for themselves according to their personal preferences and needs.

[0083] An online community platform can also be provided, allowing users to post laundry experiences, evaluations, and suggestions; allowing users to like, comment on, and share other users' posts; regularly share laundry knowledge online to improve users' laundry skills and awareness.

[0084] By directly obtaining the information on the attributes of the laundry items to be washed from the database, it is possible to avoid re - photographing the laundry items every time and then identifying them based on the photos, thus saving computing resources and time. By analyzing and classifying the selected laundry items to be washed, feedback on clothes that are not suitable to be washed together can be given, avoiding color bleeding problems caused by washing multiple differently - colored clothes together, avoiding damage to the laundry items caused by washing clothes of different materials together, and avoiding hygiene problems caused by washing different types of clothes together. By providing feedback suggestions on clothes that can be washed together, it helps users with laundry co - washing recommendations, saving the time for users to manually classify, providing an active and intelligent interaction experience for users, and thus giving professional suggestions and high - risk wrong operation warnings before washing, avoiding risks and reducing losses for users.

[0085] The intelligent prompting device of the washing machine provided by the present application will be described below. The intelligent prompting device of the washing machine described below can be mutually referred to corresponding to the intelligent prompting method of the washing machine described above.

[0086] The laundry item attribute information acquisition module is used to perform image recognition on the washing label images and clothing images of multiple laundry items to be washed collected by the image acquisition device respectively, so as to obtain the washing information in the washing label image of each laundry item and the clothing attribute information of the laundry item to be washed.

[0087] The laundry prompt module is used to determine whether there is a laundry conflict according to the washing information in the washing label image of each laundry item and the clothing attribute information of the laundry item to be washed. If so, perform laundry feedback according to the laundry conflict; the laundry feedback includes suggestions, reminders or warnings; determine the washing machine washing method information of each laundry item according to the laundry feedback.

[0088] The conflict feedback unit is used to obtain the clothing colors of different laundry items to be washed, judge the color systems to which different clothing colors belong. If the laundry items to be washed belong to different color systems, perform laundry feedback on the clothing color conflict; obtain the washing types of different laundry items to be washed, judge whether there is a conflict in the washing types between the laundry items to be washed. If so, perform laundry feedback on the washing type conflict; obtain the washing temperature ranges of different laundry items to be washed, take the intersection of the temperature ranges of different laundry items to be washed. If the obtained intersection is empty, perform laundry feedback on the laundry temperature conflict; obtain the clothing types of different laundry items to be washed, judge whether there is a conflict in the clothing types between the laundry items to be washed. If so, perform laundry feedback on the clothing type conflict.

[0089] An information recognition unit is configured to upload the collected clothing image and the washing label image to the terminal; recognize the washing label image through a pre-trained washing label detection model to determine the washing information of the clothing to be washed; the pre-trained washing label detection model is obtained by training according to a training set, and the training set is a washing label image with labels; recognize the clothing image of the clothing to be washed through a pre-trained clothing recognition model to obtain the clothing attribute information of the clothing to be washed; the pre-trained clothing recognition model is obtained by training according to a training set, and the training set is a clothing image with labels; determine the label of the clothing to be washed according to the washing information and the clothing attribute information, and store the identifier of the clothing to be washed in the database according to the label.

[0090] The clothing recognition model unit is configured to perform region segmentation on the clothing image to be washed; obtain the average RGB value of each segmented region, calculate the Euclidean distance between the average RGB value and the preset RGB value of the color category, and take the category with the smallest Euclidean distance from the average RGB value as the color category corresponding to the clothing to be washed, which is used as the clothing color; obtain the clothing features in each segmented region, output the clothing type corresponding to the maximum probability value of each segmented region according to the clothing features, and determine the clothing type to which the segmented region with the largest number belongs as the clothing type of the clothing to be washed.

[0091] The recommended washing module is configured to find the clothing with the same label as the label of the clothing to be washed, and recommend the found clothing as the clothing suitable to be washed together with the clothing to be washed.

[0092] The unit for obtaining the attribute information of the clothing to be washed is configured to obtain the image of the clothing to be washed, and query whether the information of the clothing to be washed already exists in the database according to the recognized clothing attribute information; if it exists, obtain the washing information and the clothing attribute information of the clothing to be washed already stored in the database; if it does not exist, recognize the washing information and the clothing attribute information of the clothing to be washed through the corresponding model, and store the washing information and the clothing attribute information of the clothing to be washed in the database.

[0093] Figure 6 FIG. shows a schematic physical structure diagram of an electronic device, such as Figure 6As shown, the electronic device may include: a processor 610, a communications interface 620, a memory 630, and a communication bus 640. Among them, the processor 610, the communications interface 620, and the memory 630 complete communication with each other through the communication bus 640. The processor 610 can call the logical instructions in the memory 630 to execute the intelligent prompting method for the washing machine. The method includes: respectively performing image recognition on the washing label images and clothing images of a plurality of to-be-washed clothes collected by the image acquisition device to obtain the washing information in the washing label image of each to-be-washed clothes and the clothing attribute information of the to-be-washed clothes; determining whether there is a laundry conflict according to the washing information in the washing label image of each to-be-washed clothes and the clothing attribute information of the to-be-washed clothes. If so, performing laundry feedback according to the laundry conflict; the laundry feedback includes suggestions, reminders, or warnings; determining the washing machine washing mode information of each to-be-washed clothes according to the laundry feedback.

[0094] In addition, when the logical instructions in the above-mentioned memory 630 are implemented in the form of software functional units and sold or used as an independent product, they can be stored in a computer-readable storage medium. Based on such an understanding, the technical solution of the present application, in essence, or the part that contributes to the prior art, or a part of the technical solution, can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods in the various embodiments of the present application. The foregoing storage medium includes: various media such as USB flash drives, mobile hard disks, read-only memories (ROM, Read-Only Memory), random access memories (RAM, Random Access Memory), magnetic disks, or optical discs that can store program codes.

[0095] On the other hand, the present application also provides a computer program product. The computer program product includes a computer program. The computer program can be stored on a computer-readable storage medium. When the computer program is executed by a processor, the computer can execute the intelligent prompting method for the washing machine provided by the above-mentioned various methods. The method includes: respectively performing image recognition on the washing label images and clothing images of a plurality of to-be-washed clothes collected by the image acquisition device to obtain the washing information in the washing label image of each to-be-washed clothes and the clothing attribute information of the to-be-washed clothes; determining whether there is a laundry conflict according to the washing information in the washing label image of each to-be-washed clothes and the clothing attribute information of the to-be-washed clothes. If so, performing laundry feedback according to the laundry conflict; the laundry feedback includes suggestions, reminders, or warnings; determining the washing machine washing mode information of each to-be-washed clothes according to the laundry feedback.

[0096] In another aspect, the present application also provides a computer-readable storage medium. The computer-readable storage medium includes a stored program, wherein when the program runs, it executes the intelligent prompting method for a washing machine provided by each of the above methods. The method includes: respectively performing image recognition on the washing label images and clothing images of a plurality of to-be-washed clothes collected by an image acquisition device to obtain the washing information in the washing label image of each to-be-washed clothes and the clothing attribute information of the to-be-washed clothes; determining whether there is a laundry conflict according to the washing information in the washing label image of each to-be-washed clothes and the clothing attribute information of the to-be-washed clothes, and if so, performing laundry feedback according to the laundry conflict; the laundry feedback includes suggestions, reminders or warnings; determining the washing machine washing mode information of each to-be-washed clothes according to the laundry feedback.

[0097] The device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed to multiple network units. Some or all of the modules can be selected according to actual needs to achieve the purpose of the solution of this embodiment. Those of ordinary skill in the art can understand and implement it without creative efforts.

[0098] Through the description of the above embodiments, those skilled in the art can clearly understand that each embodiment can be implemented by means of software plus a necessary general hardware platform, and of course, it can also be implemented by hardware. Based on this understanding, the essence of the above technical solution, or the part that contributes to the prior art, can be embodied in the form of a software product. The computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, magnetic disk, optical disk, etc., and includes several instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods of each embodiment or some parts of the embodiments.

[0099] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, and not to limit them; although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that they can still modify the technical solutions recorded in the foregoing embodiments, or perform equivalent replacements on some of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of each embodiment of the present application.

Claims

1. An intelligent prompting method for a washing machine, characterized in that, Including: Performing image recognition on the washing label images and clothing images of multiple items of laundry to be washed collected by an image acquisition device, so as to obtain the washing information in the washing label image of each item of laundry to be washed and the clothing attribute information of the item of laundry to be washed; Determining whether there is a laundry conflict according to the washing information in the washing label image of each item of laundry to be washed and the clothing attribute information of the item of laundry to be washed, and if so, giving a laundry feedback according to the laundry conflict; the laundry feedback includes suggestions, reminders or warnings; Determining the washing method information of the washing machine for each item of laundry to be washed according to the laundry feedback.

2. The intelligent prompting method for a washing machine according to claim 1, characterized in that, The washing information includes the washing type and the washing temperature; the clothing attribute information includes the clothing color and the clothing type; Determining a laundry conflict according to the washing information in the washing label image of each item of laundry to be washed and the clothing attribute information of the item of laundry to be washed, and giving a laundry feedback according to the laundry conflict, specifically including: Obtaining the clothing colors of different items of laundry to be washed, judging the color systems to which the different clothing colors belong, and if the items of laundry to be washed belong to different color systems, giving a laundry feedback for the clothing color conflict; Obtaining the washing types of different items of laundry to be washed, judging whether there is a conflict in the washing types between the items of laundry to be washed, and if so, giving a laundry feedback for the washing type conflict; Obtaining the washing temperature ranges of different items of laundry to be washed, taking the intersection of the temperature ranges of different items of laundry to be washed, and if the obtained intersection is empty, giving a laundry feedback for the laundry temperature conflict; Obtaining the clothing types of different items of laundry to be washed, judging whether there is a conflict in the clothing types between the items of laundry to be washed, and if so, giving a laundry feedback for the clothing type conflict.

3. The intelligent prompting method of the washing machine according to claim 1, wherein, The performing image recognition on the washing label images and clothing images of multiple items of laundry to be washed collected by an image acquisition device, so as to obtain the washing information in the washing label image of each item of laundry to be washed and the clothing attribute information of the item of laundry to be washed, specifically includes: Obtaining the clothing image and the washing label image of the laundry to be washed through an image acquisition device, and uploading the clothing image and the washing label image to a terminal; Identifying the washing label image through a pre-trained washing label detection model to determine the washing information of the laundry to be washed; the pre-trained washing label detection model is obtained by training according to a training set, and the training set is a washing label image with labels; Identifying the laundry to be washed image through a pre-trained clothing recognition model to obtain the clothing attribute information of the laundry to be washed; the pre-trained clothing recognition model is obtained by training according to a training set, and the training set is a clothing image with labels; Determining the label of the laundry to be washed according to the washing information and the clothing attribute information, and storing the identifier of the laundry to be washed in a database according to the label.

4. The intelligent prompting method of the washing machine according to claim 3, wherein, The identifying the laundry to be washed image through a pre-trained clothing recognition model to obtain the clothing attribute information of the laundry to be washed, specifically includes: Performing region segmentation on the laundry to be washed image through a pre-trained clothing recognition model; Obtain the average RGB value of each segmented area, calculate the Euclidean distance between the average RGB value and the preset RGB values of color categories, and take the category with the minimum Euclidean distance from the average RGB value as the color category corresponding to the laundry to be washed, which is used as the clothing color; Obtain the clothing features in each segmented area, output the clothing type corresponding to the maximum probability value of each segmented area according to the clothing features, and determine the clothing type to which the segmented area with the largest number belongs as the clothing type of the laundry to be washed.

5. The intelligent prompting method of the washing machine according to claim 3, characterized in that, After obtaining the washing information and clothing attribute information of the selected laundry to be washed, the method further includes: Search for clothes with the same label as the label of the laundry to be washed, and recommend the found clothes as clothes suitable to be washed together with the laundry to be washed.

6. The intelligent prompting method of the washing machine according to claim 3, characterized in that, When determining the laundry to be washed selected by the user, it further includes: Obtain an image of the laundry to be washed, and query whether the information of the laundry to be washed already exists in the database according to the recognized clothing attribute information; If it exists, obtain the washing information and clothing attribute information of the laundry to be washed already stored in the database; If it does not exist, identify the washing information and clothing attribute information of the laundry to be washed through a corresponding model, and store the washing information and clothing attribute information of the laundry to be washed in the database.

7. An intelligent prompting device for a washing machine, characterized in that, It includes: A laundry to be washed attribute information acquisition module, which is used to perform image recognition on the washing label images and clothing images of multiple laundries to be washed collected by an image acquisition device respectively, so as to obtain the washing information in the washing label image of each laundry to be washed and the clothing attribute information of the laundry to be washed; A washing prompt module, which is used to determine whether there is a laundry conflict according to the washing information in the washing label image of each laundry to be washed and the clothing attribute information of the laundry to be washed. If so, perform a laundry feedback according to the laundry conflict; the laundry feedback includes suggestions, reminders or warnings; determine the washing machine washing method information of each laundry to be washed according to the laundry feedback.

8. The intelligent prompting device of the washing machine according to claim 7, wherein, The washing information includes the washing type and washing temperature; the clothing attribute information includes clothing color and clothing type; The laundry prompt module is specifically used for: Obtain the clothing colors of different laundries to be washed, judge the color systems to which different clothing colors belong. If the laundries to be washed belong to different color systems, perform a laundry feedback for clothing color conflict; Obtain the washing types of different laundries to be washed, judge whether there is a conflict in the washing types between the laundries to be washed. If so, perform a laundry feedback for washing type conflict; Obtain the washing temperature ranges of different laundries to be washed, take the intersection of the temperature ranges of different laundries to be washed. If the obtained intersection is empty, perform a laundry feedback for laundry temperature conflict; Obtain the clothing types of different laundries to be washed, judge whether there is a conflict in the clothing types between the laundries to be washed. If so, perform a laundry feedback for clothing type conflict.

9. A computer-readable storage medium, characterized in that, The computer-readable storage medium includes a stored program, wherein the program executes the method according to any one of claims 1 to 7 when running.

10. An electronic device, comprising a memory and a processor, characterized in that, A computer program is stored in the memory, and the processor is configured to execute the method according to any one of claims 1 to 7 through the computer program.

Images