Food management method, device, refrigerator and storage medium

Abstract

The embodiment of the present application relates to a food management method, device, refrigerator and storage medium, the method comprising: determining food to be placed in the refrigerator; determining a target container corresponding to the food from containers contained in the refrigerator; controlling the refrigerator door to open, and controlling the target container to move to a target position, so as to prompt the subject to place the food in the target container. Thus, the refrigerator door can be controlled to open automatically, reducing the operation steps when the subject places food in the container in the refrigerator, and providing convenience for the subject.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of artificial intelligence technology, and in particular to a food management method, device, refrigerator, and storage medium. Background Art

[0002] With the continuous development of household appliances, more and more appliances are used by people. Among them, refrigerators are a kind of refrigeration equipment that keeps a constant low temperature, and are also a product that keeps food or other items at a constant low temperature. Due to its refrigeration and preservation functions, it is widely used by people.

[0003] Currently, when a subject uses a refrigerator and puts food into the refrigerator, the subject needs to manually open the refrigerator door, then open the containers in the refrigerator, and put the food into the containers in the refrigerator. This is cumbersome and very inconvenient for the subject. Summary of the invention

[0004] In view of this, in order to solve the technical problem that when the above-mentioned subject uses a refrigerator and puts food into the refrigerator, it is necessary to manually open the refrigerator door and then open the containers in the refrigerator to put the food into the containers in the refrigerator, which is cumbersome and very inconvenient for the subject, the embodiments of the present application provide a food management method, device, refrigerator and storage medium.

[0005] In a first aspect, an embodiment of the present application provides a food management method, which is applied to a refrigerator, and the method includes:

[0006] Determining food to be placed in the refrigerator;

[0007] Determining a target container corresponding to the food from containers contained in the refrigerator;

[0008] The refrigerator door of the refrigerator is controlled to open, and the target container is controlled to move to a target position, so as to prompt the subject to put the food into the target container.

[0009] In an optional embodiment, determining the food to be placed in the refrigerator includes:

[0010] Acquire voice information input by the subject, analyze the voice information, and determine the food information contained in the voice information;

[0011] Determining that the food corresponding to the food information is the food to be placed in the refrigerator;

[0012] or,

[0013] The refrigerator is provided with a food selection module, and when a preset operation of the subject on the food selection module is detected, food information in a preset food table of the refrigerator is obtained, and the food information in the preset food table is displayed to the subject;

[0014] In the case where a selection operation of the object on the food information in the preset food table is monitored, it is determined that the food corresponding to the food information selected by the object is the food to be put into the refrigerator.

[0015] In an optional embodiment, determining the target container corresponding to the food from the containers contained in the refrigerator includes:

[0016] Acquiring the storage habits of the subject for the food;

[0017] According to the storage habit, a target container corresponding to the food is determined from containers contained in the refrigerator.

[0018] In an optional embodiment, determining the target container corresponding to the food from the containers contained in the refrigerator includes:

[0019] Determining the type of food corresponding to the food;

[0020] According to the type of the food, a target container corresponding to the food is determined from containers contained in the refrigerator.

[0021] In an optional embodiment, determining the target container corresponding to the food from the containers contained in the refrigerator according to the type of the food includes:

[0022] Determining at least one container corresponding to the food from the containers contained in the refrigerator according to the type of the food;

[0023] Showing the subject all the utensils corresponding to the ingredients;

[0024] In the case where the object's selection operation on all containers corresponding to the food is monitored, the container selected by the object is determined to be the target container corresponding to the food.

[0025] In an optional embodiment, before controlling the refrigerator door to open, the method further includes:

[0026] determining a first target distance between an object and a refrigerator door of the refrigerator;

[0027] If a first target distance between the object and the refrigerator door of the refrigerator is greater than or equal to a preset first distance, the step of controlling the refrigerator door to open is performed.

[0028] In an optional embodiment, the method further comprises:

[0029] If a first target distance between the object and the refrigerator door of the refrigerator is less than a preset first distance, a first alarm message is sent to the object indicating that the first target distance is less than the preset first distance.

[0030] In an optional embodiment, before controlling the target vessel to move to the target position, the method further includes:

[0031] determining a second target distance between the object and a target container corresponding to the food;

[0032] If a second target distance between the object and the target container corresponding to the food is greater than or equal to a preset second distance, the step of controlling the target container to move to the target position is performed.

[0033] In an optional embodiment, the method further comprises:

[0034] If the second target distance between the object and the target container corresponding to the food is smaller than a preset second distance, a second warning message that the second target distance is smaller than the preset second distance is sent to the object.

[0035] In an optional embodiment, a touch detection module is provided on the refrigerator door, and before the refrigerator door of the refrigerator is controlled to be opened, the method further includes:

[0036] detecting, by the touch detection module, whether the refrigerator door of the refrigerator is touched by an object;

[0037] If the refrigerator door of the refrigerator is touched by the object, the step of controlling the refrigerator door to open is performed.

[0038] In an optional embodiment, the method further comprises:

[0039] If the refrigerator door of the refrigerator is not touched by the object, the refrigerator door is controlled to be in a closed state.

[0040] In a second aspect, an embodiment of the present application provides a food management device, which is applied to a refrigerator, and the device includes:

[0041] An ingredient determination module, used to determine ingredients to be placed in the refrigerator;

[0042] a target container determination module, configured to determine a target container corresponding to the food from containers contained in the refrigerator;

[0043] The control module is used to control the refrigerator door of the refrigerator to open, and control the target container to move to a target position, so as to prompt the subject to put the food into the target container.

[0044] In a third aspect, an embodiment of the present application provides a refrigerator, comprising: a processor and a memory, wherein the processor is used to execute a food management program stored in the memory to implement any food management method in the first aspect.

[0045] In a fourth aspect, an embodiment of the present application provides a storage medium, which stores one or more programs, and the one or more programs can be executed by one or more processors to implement any food management method in the first aspect.

[0046] The technical solution provided by the embodiment of the present application determines the food to be placed in the refrigerator; determines the target vessel corresponding to the food from the vessels contained in the refrigerator; controls the refrigerator door to open, and controls the target vessel to move to the target position, so as to prompt the subject to place the food into the target vessel. By determining the food to be placed in the refrigerator, determining the target vessel corresponding to the food to be placed in the refrigerator from the vessels contained in the refrigerator, controlling the refrigerator door to open, and controlling the target vessel in the refrigerator to move to the target position, prompting the first item to place the food into the target vessel, the automatic determination of opening the refrigerator and moving the target vessel is realized, and the subject does not need to manually open the refrigerator and move the target vessel, which reduces the operation steps of the subject and provides convenience for the subject. BRIEF DESCRIPTION OF THE DRAWINGS

[0047] Figure 1 A schematic diagram of an implementation process of a food management method provided in an embodiment of the present application;

[0048] Figure 2 A schematic diagram of an implementation flow of another food management method provided in an embodiment of the present application;

[0049] Figure 3 A schematic diagram of an implementation flow of another food management method provided in an embodiment of the present application;

[0050] Figure 4 A schematic diagram of an implementation flow of another food management method provided in an embodiment of the present application;

[0051] Figure 5 A schematic diagram of an implementation flow of another food management method provided in an embodiment of the present application;

[0052] Figure 6 A schematic diagram of an implementation flow of a target vessel determination method provided in an embodiment of the present application;

[0053] Figure 7A schematic diagram of an implementation flow of another food management method provided in an embodiment of the present application;

[0054] Figure 8 A schematic diagram of an implementation flow of another food management method provided in an embodiment of the present application;

[0055] Fig. 9 A schematic diagram of an implementation flow of another food management method provided in an embodiment of the present application;

[0056] Fig.10 A structural schematic diagram of a food management device provided in an embodiment of the present application;

[0057] Fig.11 A schematic structural diagram of a refrigerator provided in an embodiment of the present application. DETAILED DESCRIPTION

[0058] In order to make the purpose, technical solution and advantages of the embodiments of the present application clearer, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of this application.

[0059] Figure 1 A schematic diagram of an implementation flow of a food management method provided in an embodiment of the present application, which is applied to a refrigerator, may include the following steps:

[0060] S101: Determine the ingredients to be put into the refrigerator.

[0061] In the embodiment of the present application, when the subject puts food into the refrigerator, the refrigerator determines the food to be put into the refrigerator. The food to be put into the refrigerator includes but is not limited to pork, eggs, milk, etc., and the present application does not limit this.

[0062] S102: Determine a target container corresponding to the food from the containers contained in the refrigerator.

[0063] In the embodiment of the present application, the refrigerator includes multiple containers, such as drawers, etc., and the target container corresponding to the food to be placed in the refrigerator is determined. For example, when the food to be placed in the refrigerator is eggs, there is a drawer with an egg slot corresponding to the eggs, and the drawer with the egg slot is determined as the target container corresponding to the eggs.

[0064] S103: Controlling the refrigerator door to open, and controlling the target container to move to a target position, so as to prompt the subject to put the food into the target container.

[0065] In the embodiment of the present application, the refrigerator door reset structure of the refrigerator is driven by a motor and can be automatically opened or closed, and the target container is driven by a motor and can move along the slide rail. After the target container corresponding to the food is determined, the refrigerator door is driven by the motor controlling the refrigerator door to open, and the target container is driven by the motor controlling the target container to move along the slide rail to the target position. After the target container moves to the target position, the subject puts the food into the target container.

[0066] In an embodiment of the present application, after the subject places the food into the target container, images of the food can be captured and the food can be identified to determine whether the food is the food to be placed in the refrigerator as determined above. If not, a prompt is issued to the subject, and instructions given by the subject are received. The food to be placed in the refrigerator is re-determined according to the instructions given by the subject, or the current food and the target container are recorded so that the subject can find the location of the food when taking the food from the refrigerator.

[0067] Through the above description of the technical solution provided in the embodiment of the present application, in the present application, when the subject puts food into the refrigerator, the refrigerator door can be controlled to open automatically, and the target container corresponding to the food can be moved to the target position to prompt the subject to put the food into the target container, thereby reducing the operating steps when the subject puts food into the refrigerator and providing convenience for the subject.

[0068] In order to further improve the automation of the refrigerator, a voice receiving module is set on the refrigerator so that the refrigerator can automatically determine the ingredients to be placed in the refrigerator. Figure 2 A schematic diagram of an implementation flow of another food management method provided in an embodiment of the present application, the method may include the following steps:

[0069] S201: Acquire voice information input by the subject, analyze the voice information, and determine the food information contained in the voice information.

[0070] S202: Determine that the ingredients corresponding to the ingredient information are ingredients to be placed in the refrigerator.

[0071] In the embodiment of the present application, the voice receiving module set on the refrigerator can receive the voice information of the object after the refrigerator is turned on, and parse the received voice information to obtain the food information contained in the voice information. For example, the voice information received by the refrigerator is "put in apples". When the voice receiving module of the refrigerator receives the voice information of "put in", it triggers the function of parsing the voice and determining the food. The refrigerator parses the voice information after "put in" and obtains the food information corresponding to the voice information as "apple", and then determines that "apple" is the food to be put into the refrigerator.

[0072] S203: Determine a target container corresponding to the food from the containers contained in the refrigerator.

[0073] S204: Controlling the refrigerator door to open, and controlling the target container to move to the target position, so as to prompt the subject to put the food into the target container.

[0074] In the embodiment of the present application, S203 and S204 have been described in detail in S102 and S103, and will not be repeated here.

[0075] Through the above description of the technical solution provided by the embodiment of the present application, in the present application, a voice receiving module is set on the refrigerator to receive the voice of the object, and the received voice is analyzed to determine the food information in the voice information, thereby determining the food to be put into the refrigerator by the object. The object does not need to operate manually, but only needs to issue instructions, which provides convenience for the object.

[0076] Another way to determine the ingredients to be put into the refrigerator is to Figure 3 In order to further improve the automation of the refrigerator, a food selection module is provided on the refrigerator so that the refrigerator can automatically determine the food to be placed in the refrigerator. Figure 3 A schematic diagram of an implementation flow of another food management method provided in an embodiment of the present application, the method may include the following steps:

[0077] S301: when a preset operation of the subject on the food selection module is detected, obtaining food information in a preset food table of the refrigerator, and displaying the food information in the preset food table to the subject.

[0078] In an embodiment of the present application, the food selection module provided on the refrigerator includes a touch screen. When a preset operation of the subject on the touch screen is detected, the food information in the preset food table of the refrigerator is obtained and displayed to the subject. The preset operation includes the subject clicking the touch screen, the subject sliding the touch screen, etc., which is not limited in the present application.

[0079] The preset ingredient list includes a list of ingredients pre-stored in the memory corresponding to the refrigerator. The types of ingredients are first displayed to the subject, including: meat, vegetables, fruits, milk, etc. After the subject selects the type of ingredient, the ingredient information corresponding to the type is displayed to the subject. For example, when the subject selects meat, pork, beef, chicken, etc. are displayed to the subject. It should be noted that the preset ingredient list can also be saved in other forms, for example, it can be divided into cooked food, fresh food, etc., and this application does not limit this.

[0080] When the subject cannot find the ingredients that he wants to put in the refrigerator in the preset ingredient table, the subject can select ingredients similar to the ingredient, for example, ingredients of similar type and size to the ingredient, and this application does not limit this.

[0081] S302: When a selection operation of the subject on the food information in the preset food table is detected, it is determined that the food corresponding to the food information selected by the subject is the food to be put into the refrigerator.

[0082] In an embodiment of the present application, the object views the food information in the preset food table displayed by the refrigerator to the object, and performs a selection operation on the food information. Specifically, the object clicks on the food information in the touch display screen, and determines that the food information clicked by the object is the food information selected by the object, and determines that the food information selected by the object is the food that the object wants to put into the refrigerator.

[0083] S303: Determine a target container corresponding to the food from the containers contained in the refrigerator.

[0084] S304: Controlling the refrigerator door to open, and controlling the target container to move to the target position, so as to prompt the subject to put the food into the target container.

[0085] In the embodiment of the present application, S303 and S304 have been described in detail in S102 and S103, and will not be repeated here.

[0086] Through the above description of the technical solution provided by the embodiment of the present application, in the present application, a food list is preset in the refrigerator, and when the subject puts food into the refrigerator, the subject can directly select the food information to be put in from the food list displayed to the subject by the refrigerator, thereby determining the food to be put in. This avoids the situation where the voice information is not clearly received and the food to be put in cannot be parsed, and when the food to be put in the refrigerator does not exist in the preset food list, the subject can select food similar to the food to be put in the refrigerator based on experience, so as to achieve the purpose of better preservation of food.

[0087] Figure 4 A schematic diagram of an implementation flow of another food management method provided in an embodiment of the present application, the method may include the following steps:

[0088] S401: Determine the ingredients to be put into the refrigerator.

[0089] In the embodiment of the present application, S401 has been described in detail in S101 and will not be repeated here.

[0090] S402: Acquire the storage habits of the subject for food.

[0091] In the embodiment of the present application, the storage habit of the object for food is pre-stored, and the storage habit is the corresponding relationship between food and container.

[0092] In a possible embodiment, when the collection object independently selects containers to put food in, the storage containers corresponding to each type of food are stored in the server as the object's storage habits for each type of food. After determining the food to be put into the refrigerator, the storage habits corresponding to the food are obtained.

[0093] In another possible embodiment, the storage habits for various types of food materials pre-entered by the object are acquired, such as shown in Table 1. After the food materials to be placed in the refrigerator are determined, the storage habits corresponding to the food materials are acquired.

[0094] Utensils Ingredients Vessel 1 Apples, pears Vessel 2 Grape Vessel 3 Tomatoes, cucumbers …… ……

[0095] Table 1

[0096] S403: Determine the target container corresponding to the food from the containers in the refrigerator according to the storage habits.

[0097] In an embodiment of the present application, after determining the storage habits corresponding to the food to be placed in the refrigerator, the target container corresponding to the food can be determined. For example, if it is determined that the food to be placed in the refrigerator is apple, the target container can be determined to be container 1 according to the above Table 1.

[0098] S404: Controlling the refrigerator door to open, and controlling the target container to move to the target position, so as to prompt the subject to put the food into the target container.

[0099] In the embodiment of the present application, S404 has been described in detail in S103 and will not be repeated here.

[0100] Through the above description of the technical solution provided in the embodiment of the present application, in the present application, the target container corresponding to the food can be determined according to the storage habits of the food, focusing on the habits of the object and improving the object's experience.

[0101] Figure 5 A schematic diagram of an implementation flow of another food management method provided in an embodiment of the present application, the method may include the following steps:

[0102] S501: Determine the ingredients to be put into the refrigerator.

[0103] In the embodiment of the present application, S501 has been described in detail in S101 and will not be repeated here.

[0104] S502: Determine the ingredient type corresponding to the ingredient.

[0105] In an embodiment of the present application, after determining the ingredients to be placed in the refrigerator, the types of ingredients corresponding to the ingredients are determined. The types of ingredients can be divided into cooked food, fresh food, fruits, vegetables, etc., and the present application does not limit this.

[0106] S503: Determine a target container corresponding to the food from the containers in the refrigerator according to the type of food.

[0107] In the embodiment of the present application, different types of food correspond to different containers, as shown in the following Table 2. After the type of food is determined, the target container corresponding to the food can be determined according to the corresponding relationship between the type of food and the container contained in the refrigerator.

[0108] Utensils Types of Ingredients Vessel 1 Delicatessen Vessel 2 Fresh Vessel 3 fruit Container 4 vegetable …… ……

[0109] Table 2

[0110] Based on S503, after the type of food is determined, the type of food may correspond to multiple containers. Figure 6 A schematic diagram of an implementation flow of a method for determining a target vessel provided in an embodiment of the present application, the method may include the following steps:

[0111] S601: Determine at least one container corresponding to the food from the containers in the refrigerator according to the type of food.

[0112] In an embodiment of the present application, the subject has a large storage capacity of a certain food ingredient. For example, the subject prefers to eat fruit, so there are two containers in the refrigerator to store fruit ingredients. After determining that the type of ingredient is fruit, the two containers corresponding to the fruit can be determined from the containers contained in the refrigerator.

[0113] S602: Display all containers corresponding to the ingredients to the subject.

[0114] In the embodiment of the present application, all containers corresponding to the food are displayed to the object through the display screen of the refrigerator. For example, after the food type is determined to be fruit, two containers corresponding to the fruit can be determined from the containers contained in the refrigerator, and the two containers can be displayed to the object. Only the name or location of the container can be displayed, and the present application does not limit this.

[0115] S603: When it is detected that the object performs a selection operation on all containers corresponding to the food, the container selected by the object is determined to be a target container corresponding to the food.

[0116] In an embodiment of the present application, all containers corresponding to the ingredients are displayed to the object for the object to select, and the object's selection operation is received. Specifically, the object can click on the container in which the ingredient is to be stored, thereby selecting the container, and determining that the container selected by the object is the target container corresponding to the ingredient.

[0117] In another possible implementation, a container storing less food among all containers may be determined as the target container without the need for object selection, which is not limited in the present application.

[0118] S504: Control the refrigerator door to open, and control the target container to move to the target position, so as to prompt the subject to put the food into the target container.

[0119] In the embodiment of the present application, S504 has been described in detail in S103 and will not be repeated here.

[0120] Through the above description of the technical solution provided in the embodiment of the present application, in the present application, the corresponding containers for the ingredients are determined according to the types of ingredients, which is convenient for the sorting and preservation of the ingredients.

[0121] Figure 7 A schematic diagram of an implementation flow of another food management method provided in an embodiment of the present application, the method may include the following steps:

[0122] S701: Determine the ingredients to be put into the refrigerator.

[0123] S702: Determine a target container corresponding to the food from the containers contained in the refrigerator.

[0124] In the embodiment of the present application, S701 and S702 have been described in detail in S101 and S102 and will not be repeated here.

[0125] S703: Determine a first target distance between the object and a refrigerator door of the refrigerator.

[0126] In an embodiment of the present application, a distance detection module is provided on the refrigerator door of the refrigerator, which can detect the distance between the object and the refrigerator door. After determining the target container corresponding to the food, the first target distance between the object and the refrigerator door is first determined, and the first target distance is compared with the preset first distance.

[0127] S704: If the first target distance between the object and the refrigerator door is greater than or equal to the preset first distance, the step of controlling the refrigerator door to open is executed.

[0128] In the embodiment of the present application, when the first target distance between the object and the refrigerator door of the refrigerator is greater than or equal to the preset first distance, S705 is executed. The preset first distance can be set according to the width of the refrigerator door. For example, the width of the refrigerator door is 70 cm, and the preset first distance is set to 80 cm. When it is detected that the distance between the object and the refrigerator door is greater than or equal to 80 cm, S705 is executed to control the refrigerator door to open.

[0129] S705: Control the refrigerator door to open, and control the target container to move to the target position, so as to prompt the subject to put the food into the target container.

[0130] In the embodiment of the present application, S705 has been described in detail in S103 and will not be repeated here.

[0131] S706: If the first target distance between the object and the refrigerator door is less than the preset first distance, a first alarm message is sent to the object that the first target distance is less than the preset first distance.

[0132] In an embodiment of the present application, when the first target distance between the object and the refrigerator door is less than the preset first distance, a first warning message that the first target distance is less than the preset first distance is sent to the object. For example, a voice prompt "You are too close to the refrigerator door" is sent to the object, which is not limited in the present application.

[0133] Through the above description of the technical solution provided in the embodiment of the present application, in the present application, a first target distance between the object and the refrigerator door is determined before opening the refrigerator door, and the first target distance is compared with a preset first distance. The refrigerator door is controlled to open only when the first target distance is greater than or equal to the preset first distance, thereby avoiding the situation where the object is too close to the refrigerator door and is collided with when the refrigerator door is opened.

[0134] Figure 8 A schematic diagram of an implementation flow of another food management method provided in an embodiment of the present application, the method may include the following steps:

[0135] S801: Determine the ingredients to be put into the refrigerator.

[0136] S802: Determine a target container corresponding to the food from the containers contained in the refrigerator.

[0137] S803: Control the refrigerator door to open.

[0138] In the embodiment of the present application, S801 to S803 have been described in detail in S101 to S103 and will not be repeated here.

[0139] S804: Determine a second target distance between the object and the target container corresponding to the food.

[0140] In an embodiment of the present application, a distance detection module is provided on the vessel contained in the refrigerator, which can detect the distance between the object and the vessel. After the refrigerator door is controlled to open, a first target distance between the object and the refrigerator door is determined, and a second target distance is compared with a preset second distance.

[0141] S805: If the second target distance between the object and the target container corresponding to the food is greater than or equal to the preset second distance, a step of controlling the target container to move to a target position is executed.

[0142] In the embodiment of the present application, when the second target distance between the object and the target vessel is greater than or equal to the preset first distance, S806 is executed. The preset second distance can be set according to the length of the target vessel. For example, the length of the target vessel is 50 cm. Since the target vessel will not be completely moved out when the target vessel is controlled to move to the target position, the preset second distance is set to 50 cm. When it is detected that the distance between the object and the target vessel is greater than or equal to 50 cm, S806 is executed to control the target vessel to move to the target position.

[0143] S806: Control the target container to move to the target position to prompt the subject to put the food into the target container.

[0144] In the embodiment of the present application, S806 has been described in detail in S103 and will not be repeated here.

[0145] S807: If the second target distance between the object and the target container corresponding to the food is less than the preset second distance, a second alarm message is sent to the object that the second target distance is less than the preset second distance.

[0146] In an embodiment of the present application, when the first target distance between the object and the target vessel is less than the preset second distance, a second warning message is sent to the object that the second target distance is less than the preset second distance. For example, a voice prompt "You are too close to the target vessel" is sent to the object, which is not limited in the present application.

[0147] Through the above description of the technical solution provided in the embodiment of the present application, in the present application, the second target distance between the object and the target vessel is determined before controlling the target vessel to move to the target position, and the second target distance is compared with the preset second distance. The target vessel is controlled to move to the target position only when the second target distance is greater than or equal to the preset second distance, thereby avoiding the situation where the object is too close to the target vessel and collides with it when controlling the target vessel to move to the target position.

[0148] In order to further improve the intelligence of the refrigerator, a touch detection module is set on the refrigerator door. Fig. 9 A schematic diagram of an implementation flow of another food management method provided in an embodiment of the present application, the method may include the following steps:

[0149] S901: Determine the ingredients to be put into the refrigerator.

[0150] S902: Determine a target container corresponding to the food from the containers contained in the refrigerator.

[0151] In the embodiment of the present application, S901 and S902 have been described in detail in S101 and S102 and will not be repeated here.

[0152] S903: Detecting whether the refrigerator door of the refrigerator is touched by an object through a touch detection module.

[0153] In the embodiment of the present application, a touch detection module is provided on the refrigerator door of the refrigerator. The touch detection module can be provided at any position on the refrigerator door to facilitate the object to touch. After the target container corresponding to the food is determined, the object needs to touch the touch detection module. Among them, the touch detection module can make the refrigerator open at a touch.

[0154] S904: If the refrigerator door of the refrigerator is touched by the object, a step of controlling the refrigerator door to open is executed.

[0155] In the embodiment of the present application, if it is detected that the refrigerator door of the refrigerator is touched by an object, S905 is executed to control the refrigerator door to open.

[0156] S905: Control the refrigerator door to open, and control the target container to move to the target position, so as to prompt the subject to put the food into the target container.

[0157] In the embodiment of the present application, S905 has been described in detail in S103 and will not be repeated here.

[0158] S906: If the refrigerator door of the refrigerator is not touched by the object, the refrigerator door is controlled to be in a closed state.

[0159] In the embodiment of the present application, it is determined whether the refrigerator door of the refrigerator is touched by an object within a preset time period after the target container corresponding to the food is determined. If the refrigerator door of the refrigerator is not touched by the object, the refrigerator door is controlled to be in a closed state, and all previously determined information is cleared. For example, if the preset time period is 3 minutes, it is determined whether the refrigerator door of the refrigerator is touched by an object within 3 minutes after the target container corresponding to the food is determined. If the refrigerator door is not touched by the object within 3 minutes, the refrigerator door is controlled to remain in a closed state.

[0160] In one possible implementation, if the refrigerator door is not touched by the subject within a preset time period, a prompt is given to the subject, prompting whether the subject needs to put in food. If there is no response within the target preset time, or if an indication is received from the subject that no food needs to be put in, the refrigerator door is controlled to be in a closed state, and all previously determined information is cleared.

[0161] Through the above description of the technical solution provided in the embodiment of the present application, the present application sets a touch detection module on the refrigerator door to determine whether an object has touched the refrigerator door before opening the refrigerator door. Only when the object touches the refrigerator door will the refrigerator door be controlled to open to prevent false triggering.

[0162] Fig.10A structural schematic diagram of a food management device provided in an embodiment of the present application, which is applied to a refrigerator, includes: a food determination module 1001, a target container determination module 1002, and a control module 1003.

[0163] The food material determination module 1001 is used to determine the food material to be put into the refrigerator;

[0164] The target container determination module 1002 is used to determine the target container corresponding to the food from the containers contained in the refrigerator;

[0165] The control module 1003 is used to control the refrigerator door to open, and control the target container to move to the target position, so as to prompt the subject to put the food into the target container.

[0166] In an optional implementation, the ingredient determination module 1001 is specifically configured to:

[0167] Acquire voice information input by the subject, analyze the voice information, and determine the food information contained in the voice information;

[0168] Determining that the food corresponding to the food information is the food to be placed in the refrigerator;

[0169] or,

[0170] The refrigerator is provided with a food selection module, and when a preset operation of the subject on the food selection module is detected, food information in a preset food table of the refrigerator is obtained, and the food information in the preset food table is displayed to the subject;

[0171] In the case where a selection operation of the object on the food information in the preset food table is monitored, it is determined that the food corresponding to the food information selected by the object is the food to be put into the refrigerator.

[0172] In an optional implementation, the target vessel determination module 1002 is specifically configured to:

[0173] Acquiring the storage habits of the subject for the food;

[0174] According to the storage habit, a target container corresponding to the food is determined from containers contained in the refrigerator.

[0175] In an optional implementation, the target vessel determination module 1002 includes:

[0176] An ingredient type determination unit (not shown in the figure), used to determine the ingredient type corresponding to the ingredient;

[0177] A target container determination unit (not shown in the figure) is used to determine a target container corresponding to the ingredient from the containers contained in the refrigerator according to the type of the ingredient.

[0178] In an optional implementation, the target vessel determination unit is specifically configured to:

[0179] Determining at least one container corresponding to the food from the containers contained in the refrigerator according to the type of the food;

[0180] Showing the subject all the utensils corresponding to the ingredients;

[0181] In the case where the object's selection operation on all containers corresponding to the food is monitored, the container selected by the object is determined to be the target container corresponding to the food.

[0182] In an optional embodiment, the device further includes a first target distance determination module (not shown in the figure), and the first target distance determination module is specifically configured to:

[0183] determining a first target distance between an object and a refrigerator door of the refrigerator;

[0184] If a first target distance between the object and the refrigerator door of the refrigerator is greater than or equal to a preset first distance, the step of controlling the refrigerator door to open is performed.

[0185] In an optional implementation, the first target distance determination module is further configured to:

[0186] If a first target distance between the object and the refrigerator door of the refrigerator is less than a preset first distance, a first alarm message is sent to the object indicating that the first target distance is less than the preset first distance.

[0187] In an optional embodiment, the device further includes a second target distance determination module (not shown in the figure), and the second target distance determination module is specifically configured to:

[0188] determining a second target distance between the object and a target container corresponding to the food;

[0189] If a second target distance between the object and the target container corresponding to the food is greater than or equal to a preset second distance, the step of controlling the target container to move to the target position is performed.

[0190] In an optional implementation, the second target distance determination module is further configured to:

[0191] If the second target distance between the object and the target container corresponding to the food is smaller than a preset second distance, a second warning message that the second target distance is smaller than the preset second distance is sent to the object.

[0192] In an optional embodiment, a touch detection module is provided on the refrigerator door, and the device further comprises a touch detection module (not shown in the figure), and the touch detection module is specifically used for:

[0193] detecting, by the touch detection module, whether the refrigerator door of the refrigerator is touched by an object;

[0194] If the refrigerator door of the refrigerator is touched by the object, the step of controlling the refrigerator door to open is performed.

[0195] In an optional implementation, the touch detection module is further used for:

[0196] If the refrigerator door of the refrigerator is not touched by the object, the refrigerator door is controlled to be in a closed state.

[0197] Fig.11 A schematic diagram of the structure of a refrigerator provided in an embodiment of the present application is shown in FIG. Fig.11 The refrigerator 1100 shown includes: at least one processor 1101, a memory 1102, at least one network interface 1104 and an object interface 1103. The various components in the refrigerator 1100 are coupled together via a bus system 1105. It is understood that the bus system 1105 is used to achieve connection and communication between these components. In addition to the data bus, the bus system 1105 also includes a power bus, a control bus and a status signal bus. However, for the sake of clarity, the bus system 1105 is not shown in FIG. Fig.11 Various buses are labeled as bus system 1105.

[0198] The object interface 1103 may include a display, a keyboard or a pointing device (eg, a mouse, a trackball), a touch pad or a touch screen, etc.

[0199] It can be understood that the memory 1102 in the embodiment of the present application can be a volatile memory or a non-volatile memory, or can include both volatile and non-volatile memories. Among them, the non-volatile memory can be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory can be a random access memory (RAM), which is used as an external cache. By way of example and not limitation, many forms of RAM are available, such as static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDRSDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM), and direct memory bus random access memory (DRRAM). The memory 1102 described herein is intended to include, but is not limited to, these and any other suitable types of memory.

[0200] In some embodiments, the memory 1102 stores the following elements, executable units or data structures, or a subset thereof, or an extended set thereof: an operating system 11021 and an application program 11022 .

[0201] Among them, the operating system 11021 includes various system programs, such as a framework layer, a core library layer, a driver layer, etc., which are used to implement various basic services and process hardware-based tasks. The application 11022 includes various application programs, such as a media player (Media Player), a browser (Browser), etc., which are used to implement various application services. The program for implementing the method of the embodiment of the present application can be included in the application 11022.

[0202] In the embodiment of the present application, by calling the program or instruction stored in the memory 1102, specifically, the program or instruction stored in the application 11022, the processor 1101 is used to execute the method steps provided by each method embodiment, for example, including:

[0203] Determining food to be placed in the refrigerator;

[0204] Determining a target container corresponding to the food from containers contained in the refrigerator;

[0205] The refrigerator door of the refrigerator is controlled to open, and the target container is controlled to move to a target position, so as to prompt the subject to put the food into the target container.

[0206] The method disclosed in the above embodiment of the present application can be applied to the processor 1101, or implemented by the processor 1101. The processor 1101 may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above method can be completed by the hardware integrated logic circuit or software instructions in the processor 1101. The above processor 1101 can be a general processor, a digital signal processor (Digital Signal Processor, DSP), an application specific integrated circuit (Application Specific Integrated Circuit, ASIC), a field programmable gate array (Field Programmable Gate Array, FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components. The methods, steps and logic block diagrams disclosed in the embodiments of the present application can be implemented or executed. The general processor can be a microprocessor or the processor can also be any conventional processor, etc. The steps of the method disclosed in the embodiment of the present application can be directly embodied as a hardware decoding processor to execute, or the hardware and software units in the decoding processor can be executed. The software unit can be located in a mature storage medium in the field such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory or an electrically erasable programmable memory, a register, etc. The storage medium is located in the memory 1102, and the processor 1101 reads the information in the memory 1102 and completes the steps of the above method in combination with its hardware.

[0207] It is understood that the embodiments described herein may be implemented in hardware, software, firmware, middleware, microcode, or a combination thereof. For hardware implementation, the processing unit may be implemented in one or more application specific integrated circuits (ASIC), digital signal processors (DSP), digital signal processing devices (DSPD), programmable logic devices (PLD), field programmable gate arrays (FPGA), general purpose processors, controllers, microcontrollers, microprocessors, other electronic units for performing the functions of the present application, or a combination thereof.

[0208] For software implementation, the technology of this article can be implemented by a unit that performs the functions of this article. The software code can be stored in a memory and executed by a processor. The memory can be implemented in the processor or outside the processor.

[0209] The refrigerator provided in this embodiment can be Fig.11 The refrigerator shown in FIG. 1 may be executed as follows: Figures 1 to 9 All steps of the food management method in order to achieve Figures 1 to 9 For details, please refer to the technical effects of the food management method in Figures 1 to 9 For the sake of brevity, the relevant description is not repeated here.

[0210] The embodiment of the present application also provides a storage medium (computer-readable storage medium). The storage medium here stores one or more programs. The storage medium may include a volatile memory, such as a random access memory; the memory may also include a non-volatile memory, such as a read-only memory, a flash memory, a hard disk or a solid-state drive; the memory may also include a combination of the above-mentioned types of memory.

[0211] When one or more programs in the storage medium can be executed by one or more processors, the above-mentioned food management method executed on the refrigerator side can be implemented.

[0212] The processor is used to execute the food management program stored in the memory to implement the following steps of the food management method executed on the refrigerator side:

[0213] Determining food to be placed in the refrigerator;

[0214] Determining a target container corresponding to the food from containers contained in the refrigerator;

[0215] The refrigerator door of the refrigerator is controlled to open, and the target container is controlled to move to a target position, so as to prompt the subject to put the food into the target container.

[0216] The professionals should also be further aware that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented with electronic hardware, computer software, or a combination of the two. In order to clearly illustrate the interchangeability of hardware and software, the composition and steps of each example have been generally described in terms of function in the above description. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0217] The steps of the method or algorithm described in conjunction with the embodiments disclosed herein may be implemented using hardware, a software module executed by a processor, or a combination of the two. The software module may be placed in a random access memory (RAM), a memory, a read-only memory (ROM), an electrically programmable ROM, an electrically erasable programmable ROM, a register, a hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.

[0218] The specific implementation methods described above further illustrate the purpose, technical solutions and beneficial effects of the present application in detail. It should be understood that the above description is only the specific implementation method of the present application and is not intended to limit the scope of protection of the present application. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present application should be included in the scope of protection of the present application.

Claims

1. A food material management method, characterized in that: Applied to a refrigerator, the method comprises: Determining the food to be put into the refrigerator comprises: the refrigerator is provided with a food selection module, and when a preset operation of the subject on the food selection module is detected, food information in a preset food table of the refrigerator is obtained, and the food information in the preset food table is displayed to the subject; when a selection operation of the subject on the food information in the preset food table is detected, determining that the food corresponding to the food information selected by the subject is the food to be put into the refrigerator; wherein, when the subject cannot find the food that he wants to put into the refrigerator in the preset food table, the subject can select food that is similar to the food; Determining a target container corresponding to the food from containers contained in the refrigerator; Controlling the refrigerator door of the refrigerator to open, and controlling the target container to move to a target position, so as to prompt the subject to put the food into the target container; wherein, within a preset time period after the target container corresponding to the food is determined, it is determined whether the refrigerator door of the refrigerator is touched by the object; if the refrigerator door of the refrigerator is not touched by the object, the refrigerator door is controlled to be in a closed state, and all previously determined information is cleared; After the subject puts the ingredients into the target container, the ingredients are identified to determine whether the ingredients are the ingredients to be placed in the refrigerator. If not, a prompt is given to the subject, and instructions given by the subject are received. The ingredients to be placed in the refrigerator are re-determined according to the instructions given by the subject, or the current ingredients and the target container are recorded.

2. The method according to claim 1, characterized in that The step of determining the food to be placed in the refrigerator comprises: Acquire voice information input by the subject, analyze the voice information, and determine the food information contained in the voice information; Determine that the food corresponding to the food information is the food to be put into the refrigerator.

3. The method according to claim 1, characterized in that The step of determining a target container corresponding to the food from containers contained in the refrigerator includes: Acquiring the storage habits of the subject for the food; According to the storage habit, a target container corresponding to the food is determined from containers contained in the refrigerator.

4. The method according to claim 1, characterized in that The step of determining a target container corresponding to the food from containers contained in the refrigerator includes: Determining the type of food corresponding to the food; According to the type of the food, a target container corresponding to the food is determined from containers contained in the refrigerator.

5. The method according to claim 4, characterized in that The step of determining a target container corresponding to the food from containers contained in the refrigerator according to the type of the food includes: Determining at least one container corresponding to the food from the containers contained in the refrigerator according to the type of the food; Showing the subject all the utensils corresponding to the ingredients; In the case where the object's selection operation on all containers corresponding to the food is monitored, the container selected by the object is determined to be the target container corresponding to the food.

6. The method according to claim 1, characterized in that Before the refrigerator door of the refrigerator is controlled to be opened, the method further comprises: determining a first target distance between an object and a refrigerator door of the refrigerator; If a first target distance between the object and the refrigerator door of the refrigerator is greater than or equal to a preset first distance, the step of controlling the refrigerator door to open is performed.

7. The method according to claim 6, characterized in that The method further comprises: If a first target distance between the object and the refrigerator door of the refrigerator is less than a preset first distance, a first alarm message is sent to the object indicating that the first target distance is less than the preset first distance.

8. The method according to claim 1, characterized in that: Before controlling the target vessel to move to the target position, the method further includes: determining a second target distance between the object and a target container corresponding to the food; If a second target distance between the object and the target container corresponding to the food is greater than or equal to a preset second distance, the step of controlling the target container to move to a target position is performed.

9. The method according to claim 8, characterized in that The method further comprises: If the second target distance between the object and the target container corresponding to the food is smaller than a preset second distance, a second warning message that the second target distance is smaller than the preset second distance is sent to the object.

10. The method according to claim 1, characterized in that The refrigerator door is provided with a touch detection module, and before the refrigerator door of the refrigerator is opened, the control further includes: detecting, by the touch detection module, whether the refrigerator door of the refrigerator is touched by an object; If the refrigerator door of the refrigerator is touched by the object, the step of controlling the refrigerator door to open is performed.

11. The method according to claim 10, characterized in that The method further comprises: If the refrigerator door of the refrigerator is not touched by the object, the refrigerator door is controlled to be in a closed state.

12. A food material management device, characterized in that: Applied to a refrigerator, the device comprises: The food determination module is used to determine the food to be put into the refrigerator, including: the food selection module is provided on the refrigerator, and when the preset operation of the subject on the food selection module is detected, the food information in the preset food table of the refrigerator is obtained, and the food information in the preset food table is displayed to the subject; when the selection operation of the subject on the food information in the preset food table is detected, the food corresponding to the food information selected by the subject is determined to be the food to be put into the refrigerator; wherein, when the subject cannot find the food that he wants to put into the refrigerator in the preset food table, the subject can select food similar to the food; a target container determination module, configured to determine a target container corresponding to the food from containers contained in the refrigerator; A control module, used for controlling the refrigerator door of the refrigerator to open, and controlling the target container to move to a target position, so as to prompt the subject to put the food into the target container; wherein, within a preset time period after the target container corresponding to the food is determined, it is determined whether the refrigerator door of the refrigerator is touched by the object; if the refrigerator door of the refrigerator is not touched by the object, the refrigerator door is controlled to be in a closed state, and all previously determined information is cleared; After the subject puts the ingredients into the target container, the ingredients are identified to determine whether the ingredients are the ingredients to be placed in the refrigerator. If not, a prompt is given to the subject, and instructions given by the subject are received. The ingredients to be placed in the refrigerator are re-determined according to the instructions given by the subject, or the current ingredients and the target container are recorded.

13. A refrigerator, characterized in that: include: A processor and a memory, wherein the processor is used to execute a food management program stored in the memory to implement any one of the food management methods of claims 1 to 11.

14. A storage medium, characterized in that: The storage medium stores one or more programs, and the one or more programs can be executed by one or more processors to implement any food management method in claims 1 to 11.

Images