Smart refrigerator reminder method, device, smart refrigerator and storage medium

Abstract

The embodiment of the present invention relates to a smart refrigerator reminder method, device, smart refrigerator and storage medium, the method comprising: obtaining the item information of the items to be stored and the storage position to be stored in the smart refrigerator; obtaining the item information of the stored items associated with the storage position to be stored; determining the deterioration information of the items to be stored according to the item information of the items to be stored, and determining the deterioration information of the stored items according to the item information of the stored items; judging whether the deterioration information of the items to be stored is consistent with the deterioration information of the stored items; if the deterioration information of the items to be stored is inconsistent with the deterioration information of the stored items, reminding the items to be stored. In this way, it is possible to achieve the technical effect of pre-reminding the placed items, reminding the user to store the items with large differences in deterioration time separately, reducing the influence of perishable items on non-perishable items, and extending the freshness time of the items.

Description

Technical Field

[0001] The embodiments of the present invention relate to the technical field of smart home, and in particular to a smart refrigerator reminder method, device, smart refrigerator and storage medium. Background Art

[0002] Under the same storage environment, different ingredients have different spoilage curves. For example, when stored in a refrigerator, apples can be stored for several weeks without spoiling, while melons and other melons can generally only be kept for a few days without spoiling. If these ingredients are placed together when stored in the refrigerator, the spoiled substances in the spoiled ingredients will easily affect the non-perishable ingredients, causing the non-perishable ingredients to deteriorate faster.

[0003] Therefore, how to solve the impact of perishable ingredients on non-perishable ingredients and reduce the shelf life of ingredients has become a problem that needs to be solved urgently. Summary of the invention

[0004] In view of this, in order to solve the technical problem of the impact of the above-mentioned perishable food on non-perishable food and reduce the shelf life of food, the embodiments of the present invention provide a smart refrigerator reminder method, device, smart refrigerator and storage medium.

[0005] In a first aspect, an embodiment of the present invention provides a smart refrigerator reminder method, comprising:

[0006] Obtaining item information and storage locations of items to be stored in the smart refrigerator;

[0007] Acquire item information of stored items associated with the to-be-stored location;

[0008] Determining the deterioration information of the to-be-stored items according to the item information of the to-be-stored items, and determining the deterioration information of the stored items according to the item information of the stored items;

[0009] Determining whether the deterioration information of the item to be stored is consistent with the deterioration information of the stored item;

[0010] If the deterioration information of the item to be stored is inconsistent with the deterioration information of the stored item, a reminder is given to the item to be stored.

[0011] In a possible implementation, the obtaining of item information and storage locations of items to be stored in the smart refrigerator includes:

[0012] When it is detected that a new item to be stored is added to the smart refrigerator, the storage location is determined according to the movement trajectory of the item to be stored;

[0013] The object information of the object to be stored is determined based on the collected appearance image of the object to be stored.

[0014] In a possible implementation manner, the acquiring the item information of the stored item associated with the to-be-stored location includes:

[0015] collecting an item image of the item associated with the to-be-stored location;

[0016] 0According to the item image, obtain the item attributes of the item, the item attributes include item type

[0017] Category, item freshness characteristic information, packaging information and / or item parameters;

[0018] The acquired item attributes are used as item information of the stored items.

[0019] In a possible implementation manner, the determining of the storage location according to the item information of the item to be stored

[0020] The method comprises: determining the deterioration information of the to-be-stored items, and determining the deterioration information of the stored items according to the item information of the stored items, comprising:

[0021] Determining whether the item information includes item parameters;

[0022] When the item information includes item parameters, the item parameters are used as the deterioration information.

[0023] In a possible implementation manner, when the item information includes item parameters,

[0024] The item parameters as the deterioration information include: 0 obtaining item packaging information and item packaging type in the item information;

[0025] Determining a parameter type of the item parameter;

[0026] According to the object packaging type and the parameter type, deterioration information of the object to be stored and the stored object are generated respectively.

[0027] In a possible implementation, the method further includes: 5. when the item information does not include item parameters, sending the item packaging information to a server;

[0028] Receive the deterioration information of the to-be-stored item and the deterioration information of the stored item fed back by the server.

[0029] In a possible implementation manner, determining the deterioration information of the to-be-stored item according to the item information of the to-be-stored item, and determining the deterioration information of the stored item according to the item information of the stored item, includes:

[0030] According to the item category and the item freshness characteristic information of the item information, obtaining a deterioration curve corresponding to the item category;

[0031] The deterioration time of the to-be-stored object and the deterioration time of the stored object are determined according to the deterioration curve and the object freshness characteristic information.

[0032] In a possible implementation manner, the determining whether the deterioration information of the item to be stored is consistent with the deterioration information of the stored item includes:

[0033] According to the deterioration curve, determining whether the item fitting degree between the deterioration curve of the item to be stored and the deterioration curve of the stored item satisfies a preset fitting range;

[0034] When the object fitting degree satisfies the fitting range, determining that the deterioration information of the object to be stored is consistent with that of the stored object;

[0035] When the object fitting degree does not satisfy the fitting range, it is determined that the deterioration information of the object to be stored is inconsistent with that of the stored object.

[0036] In a possible implementation, the method further includes:

[0037] According to the deterioration curve, determining whether a first time difference corresponding to a peak value of the deterioration curve of the object to be stored and the stored object is within a preset range;

[0038] When the first time difference satisfies the preset range, determining that the deterioration information of the object to be stored is consistent with that of the stored object;

[0039] When the first time difference does not satisfy the preset range, it is determined that the deterioration information of the object to be stored is inconsistent with the deterioration information of the stored object.

[0040] In a possible implementation, the method further includes:

[0041] According to the deterioration time, determining whether a second time difference between the deterioration time of the to-be-stored item and the stored item satisfies a preset range;

[0042] When the second time difference satisfies the preset range, determining that the deterioration information of the object to be stored is consistent with that of the stored object;

[0043] When the second time difference does not satisfy the preset range, it is determined that the deterioration information of the object to be stored is inconsistent with the deterioration information of the stored object.

[0044] In a possible implementation, if the deterioration information of the item to be stored is inconsistent with the deterioration information of the stored item, reminding the item to be stored includes:

[0045] Generating reminder information of the transfer location of the items to be stored;

[0046] The target location information of the item to be stored is displayed.

[0047] In a possible implementation, the method further includes:

[0048] Detecting whether the storage location of the object to be stored changes within a set time;

[0049] When it is detected that the storage location of the object to be stored has not changed, the step of reminding the object to be stored is performed again.

[0050] In a possible implementation, the method further includes:

[0051] Determining whether the deterioration information of the item to be stored and the deterioration information of the stored item exceed a deterioration threshold;

[0052] When the deterioration information of the item to be stored is less than the deterioration threshold, a reminder for timely use of the item to be stored is displayed;

[0053] When the deterioration information of the stored items is less than the deterioration threshold, a reminder for timely use of the stored items is displayed.

[0054] In a second aspect, an embodiment of the present invention provides a smart refrigerator reminder method, comprising:

[0055] An acquisition module, used to acquire item information and storage locations of items to be stored in the smart refrigerator;

[0056] The acquisition module is further used to acquire item information of the stored items associated with the to-be-stored location;

[0057] a determination module, configured to determine the deterioration information of the to-be-stored items according to the item information of the to-be-stored items, and to determine the deterioration information of the stored items according to the item information of the stored items;

[0058] A judgment module, used to judge whether the deterioration information of the item to be stored is consistent with the deterioration information of the stored item;

[0059] The reminder module is used to remind the item to be stored if the deterioration information of the item to be stored is inconsistent with the deterioration information of the stored item.

[0060] In a third aspect, an embodiment of the present invention provides a smart refrigerator, comprising: a processor and a memory, wherein the processor is used to execute a smart refrigerator reminder program stored in the memory to implement any smart refrigerator reminder method described in the first aspect.

[0061] In a fourth aspect, an embodiment of the present invention provides a storage medium, wherein the storage medium stores one or more programs, and the one or more programs can be executed by one or more processors to implement any of the smart refrigerator reminder methods described in the first aspect.

[0062] The smart refrigerator reminder scheme provided by the embodiment of the present invention obtains the item information of the items to be stored and the storage location, obtains the item information of the stored items relative to the storage location, obtains the deterioration information of the two, and judges the similarity of the deterioration information of the two to determine the difference in the degree of deterioration of the two. When the deterioration information of the two is inconsistent, indicating that the difference in the deterioration information of the two is relatively large, the items to be stored are reminded; this scheme can achieve the technical effect of pre-reminding the placed items, reminding the user to store items with a large difference in deterioration time separately, reducing the influence of perishable items on non-perishable items, and extending the shelf life of the items. BRIEF DESCRIPTION OF THE DRAWINGS

[0063] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and, together with the description, serve to explain the principles of the invention.

[0064] Figure 1 A schematic diagram of a flow chart of a smart refrigerator reminder method provided by an embodiment of the present invention;

[0065] Figure 2 A schematic diagram of a flow chart of another smart refrigerator reminder method provided by an embodiment of the present invention;

[0066] Figure 3 A schematic diagram of a flow chart of another smart refrigerator reminder method provided by an embodiment of the present invention;

[0067] Figure 4 A schematic diagram of the deterioration fitness of stored items provided by an embodiment of the present invention;

[0068] Figure 5 A schematic diagram of a deterioration curve of a stored item provided by an embodiment of the present invention;

[0069] Figure 6 A schematic diagram of the structure of a smart refrigerator reminder device provided by an embodiment of the present invention;

[0070] Figure 7 A schematic structural diagram of a smart refrigerator provided in an embodiment of the invention. DETAILED DESCRIPTION

[0071] In order to make the purpose, technical solution and advantages of the embodiments of the present invention clearer, the technical solution in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0072] The terms "including" and "having" in the embodiments of the present invention are used to express an open-ended inclusive meaning, and mean that in addition to the listed elements / components / etc., there may be other elements / components / etc.; the terms "first" and "second" etc. are used only as labels and are not intended to limit the quantity of their objects. In addition, the different elements and regions in the drawings are only schematically shown, so the present invention is not limited to the sizes or distances shown in the drawings.

[0073] To facilitate understanding of the embodiments of the present invention, specific embodiments will be further explained below in conjunction with the accompanying drawings. The embodiments do not constitute a limitation on the embodiments of the present invention.

[0074] Figure 1 A flowchart of a smart refrigerator reminder method provided by an embodiment of the present invention. The executor of the present invention is a smart refrigerator. Figure 1 The diagram provided, the smart refrigerator reminder method specifically includes:

[0075] S101, obtaining item information and storage locations of items to be stored in the smart refrigerator.

[0076] The execution subject of the embodiment of the present invention is a smart refrigerator, and an information collection device is provided on the smart refrigerator to obtain the shape, packaging information or appearance color information of the items placed in the smart refrigerator. When a new item is detected to be placed in the smart refrigerator, a reasonable storage location is determined according to the deterioration of the item. If the storage is unreasonable, the user is reminded to change the current storage location to a reasonable location, so that a pre-reminder of the placed items can be achieved. By reminding the user to store items with a large difference in deterioration time separately, the impact of perishable items on non-perishable items is reduced, and the technical effect of extending the freshness time of the items can be achieved.

[0077] The items to be stored mentioned here can be understood as the items to be stored in the smart refrigerator. The items to be stored here can be vegetables, fruits, seasonings or wine and other foods placed in the smart refrigerator. The item information mentioned here can be understood as information that characterizes the characteristics of the item, such as: packaging information with production date, the appearance color of the item or the moisture content of the item. The location to be stored here can be understood as the location information detected when the item is randomly placed in the smart refrigerator.

[0078] Furthermore, when the smart refrigerator is working normally, the pre-reminder function of the storage location of the items is turned on. When it is detected that an item to be stored is randomly placed in the smart refrigerator, the detailed information of the item to be stored and the corresponding random storage location are obtained through image detection, and the item information and the data information corresponding to the storage location are uploaded to the server to prepare for the next step of analysis.

[0079] S102: Acquire item information of stored items associated with the location to be stored.

[0080] The association mentioned here can be understood as the adjacent side, which can be the adjacent surrounding position, or the same layer, same grid or same box area in the smart refrigerator. The stored items mentioned here can be understood as the items that have been assigned a reasonable storage location relative to the first storage. The item information mentioned here can be understood as the item information of the stored items collected in advance.

[0081] Furthermore, the stored items around the location of the to-be-stored items are determined by a device disposed inside the smart refrigerator, and item information corresponding to the stored items is collected.

[0082] S103: Determine deterioration information of the items to be stored according to the item information of the items to be stored, and determine deterioration information of the stored items according to the item information of the stored items.

[0083] The spoilage information mentioned here can be understood as performance indicators used to reflect whether an item is rotten and spoiled and cannot be eaten, such as the degree of odor caused by decay, expiration date, spoilage time, deterioration curve, degree of surface decay or freshness, and other characteristic information.

[0084] Furthermore, the deterioration rate and freshness of the current items are known by referring to the item information of the items to be stored, and the deterioration degree of the items to be stored is determined. Similarly, the deterioration degree of the stored items is determined based on the deterioration rate and freshness contained in the item information of the stored items, so as to prepare for the next step of determining the storage location of the items to be stored.

[0085] S104: Determine whether the deterioration information of the item to be stored is consistent with the deterioration information of the stored item.

[0086] The consistency mentioned here can be understood as similarity, and whether the degree of deterioration of the items to be stored and the stored items is similar can be reflected in the form of similarity or difference.

[0087] Furthermore, the obtained deterioration information of the items to be stored is judged with the deterioration information of the stored items to determine the similarity between the two, and then determine whether the storage location of the current items to be stored is correct.

[0088] S105: If the deterioration information of the item to be stored is inconsistent with the deterioration information of the stored item, a reminder is given to the item to be stored.

[0089] The reminder mentioned here can be understood as directly reminding the user through the smart refrigerator. The smart refrigerator can also send the recommended storage location of the material to be stored to the server or application terminal for display.

[0090] Furthermore, when it is detected that the deterioration information of the items to be stored is very different from the deterioration information of the stored items, it is determined that the deterioration information of the two is inconsistent. It is determined that the storage location of the current items to be stored is unreasonable, which will affect the deterioration speed of the surrounding items. The smart refrigerator directly displays a message reminding the user to transfer the location in the form of voice or flashing lights to remind the user that the current storage location of the items to be stored is unreasonable. The detection results can also be sent to the server or control terminal to display the recommended storage location for the items to be stored. A pre-reminder when storing items is realized to remind the user to store items with large differences in deterioration time separately, reduce the impact of perishable items on non-perishable items, and extend the shelf life of the items.

[0091] An intelligent refrigerator reminder method provided by an embodiment of the present invention obtains item information of items to be stored and a storage location, as well as item information of stored items around the storage location, obtains deterioration information of the two, and judges the similarity of the deterioration information of the two to determine the difference in the degree of deterioration of the two. When the deterioration information of the two is inconsistent, indicating that the deterioration information of the two is quite different, a reminder is given to the items to be stored, thereby pre-reminding the placed items and reminding the user to store items with a large difference in deterioration time separately, thereby reducing the influence of perishable items on non-perishable items and extending the shelf life of the items.

[0092] Figure 2 A schematic flow chart of another smart refrigerator reminder method provided by an embodiment of the present invention. Figure 2 This is introduced based on the previous embodiment. Figure 2 , the smart refrigerator reminder method specifically further includes:

[0093] S201. When it is detected that a new item to be stored is added to the smart refrigerator, the storage location is determined according to the moving trajectory of the item to be stored.

[0094] The execution subject of the embodiment of the present invention is a smart refrigerator, and an information collection device is provided on the smart refrigerator to obtain the shape of the items placed inside the smart refrigerator, the concentration of the odor released by the items, the packaging information or the appearance color information. When a new item is detected to be placed in the smart refrigerator, whether the current storage location is reasonable is determined according to the deterioration of the item. If the storage is unreasonable, the user is reminded to change the current storage location and a recommended reasonable location is given, so that the placed items can be pre-reminded. By reminding the user to store items with a large difference in deterioration time separately, the impact of perishable items on non-perishable items is reduced, and the freshness of the items can be extended.

[0095] The items to be stored mentioned here can be understood as the corresponding storage items when the items are placed in the smart refrigerator. The items to be stored here can be vegetables, fruits, seasonings or wine and other foods placed in the smart refrigerator. The location to be stored mentioned here can be understood as the specific location information of the storage detected when the item is randomly placed in the smart refrigerator for the first time. The movement trajectory mentioned here can be understood as the movement route of the image acquisition device (such as infrared detection device) set in the smart refrigerator before the items to be stored are placed in the storage location in the smart refrigerator.

[0096] Furthermore, when the smart refrigerator is working normally, the pre-reminder function of the storage location of the items is turned on. When it is detected that items to be stored are randomly placed in the smart refrigerator, the storage trajectory of the items to be stored is obtained through image detection, and then the random storage location corresponding to the items to be stored is determined.

[0097] S202: Determine the item information of the item to be stored based on the collected appearance image of the item to be stored.

[0098] The item information mentioned here can be understood as information that characterizes the characteristics of the item, such as packaging information with a production date, the appearance color of the item, or the moisture content of the item, etc. Optionally, the odor concentration released by the item can be detected by an odor sensor as the item information.

[0099] Furthermore, the smart refrigerator is provided with an image acquisition device, which acquires the outer images of the 5 items to be stored at the storage positions to obtain the item information such as the packaging information, the freshness of the items or the appearance color of the items to be stored.

[0100] S203: Collecting an object image of the object associated with the location to be stored.

[0101] The items mentioned here can be understood as stored items or other items to be stored adjacent to the location to be stored.

[0102] 0 Further, after the image acquisition device inside the smart refrigerator obtains the storage location,

[0103] The appearance images of the items corresponding to adjacent positions (the same layer, the same grid, and the adjacent positions in the same box) are collected.

[0104] S204: Acquire item attributes of the item according to the item image, where the item attributes include item category, item freshness feature information, packaging information and / or item parameters.

[0105] The item attributes mentioned here can be understood as parameters that characterize the characteristics of the item. The item category 5 mentioned here can be understood as food such as fruits, vegetables, meat, eggs, milk, seasonings or wine stored in the smart refrigerator.

[0106] The freshness characteristics of the items mentioned here can be understood as the freshness of vegetables or fruits, the color and wilting degree of leaves; the redness of the surface of meat. The packaging information mentioned here can be understood as the production date and shelf life information on the outer packaging of seasonings, etc. The item parameters mentioned here can be understood as

[0107] The data of each food material from being put into the smart refrigerator to being rotten and spoiled, which is pre-stored in the server, is a deterioration curve of fruit.

[0108] Furthermore, the image of the stored items is collected by the image acquisition device in the smart refrigerator, and the attributes of the items are determined according to the attribute information corresponding to the image of the items, so as to prepare for the next step of determining the deterioration information of the stored items.

[0109] S205: Use the acquired item attributes as item information of the stored items.

[0110] 5 Further, by obtaining the item attributes of the stored items, the shelf life of the stored items is obtained.

[0111] In this case, the item attributes are used as the item information of the stored items.

[0112] In a possible example scenario, a tomato is placed in a smart refrigerator. The storage location of the tomato is captured by an image sensor in the smart refrigerator. The food information of other food in the same layer around the tomato is detected by an infrared sensor, including the food name, type, freshness and shelf life.

[0113] S206: Determine deterioration information of the items to be stored according to the item information of the items to be stored, and determine deterioration information of the stored items according to the item information of the stored items.

[0114] The spoilage information mentioned here can be understood as performance indicators used to reflect whether an item is rotten and spoiled and cannot be eaten, such as the degree of odor caused by decay, expiration date, spoilage time, deterioration curve, degree of surface decay or freshness, and other characteristic information.

[0115] Furthermore, the deterioration rate and freshness of the current item are known by referring to the item information of the item to be stored, and the deterioration degree of the item to be stored is determined. Similarly, the deterioration rate and freshness of the stored items at the adjacent positions to be stored are included in the item information, and the deterioration degree of the stored items is determined, so as to prepare for the next step of determining the storage position of the item to be stored.

[0116] S207: Determine whether the deterioration information of the item to be stored is consistent with the deterioration information of the stored item.

[0117] The consistency mentioned here can be understood as similarity, and whether the degree of deterioration of the items to be stored and the stored items is similar can be reflected in the form of similarity or difference.

[0118] Furthermore, the obtained deterioration information of the items to be stored is judged with the deterioration information of the stored items to determine the similarity between the two, and then determine whether the current storage location of the items to be stored is reasonable.

[0119] S208: If the deterioration information of the item to be stored is inconsistent with the deterioration information of the stored item, a reminder is given to the item to be stored.

[0120] The reminder mentioned here can be understood as directly reminding the user through the smart refrigerator, by reminding the user of the name or image information of the specific ingredients that need to change the storage location, or reminding the user of the specific locations corresponding to the ingredients to be stored that need to change the location and the ingredients that conflict with the storage location; the recommended storage location of the materials to be stored can also be sent to the server or application terminal for display through the smart refrigerator.

[0121] Furthermore, when it is detected that the deterioration information of the items to be stored is very different from the deterioration information of the stored items, it is determined that the deterioration information of the two is inconsistent. It is determined that the storage location of the current items to be stored is unreasonable, which will affect the deterioration speed of the surrounding items. The smart refrigerator directly displays a message reminding the user to transfer the location in the form of voice, image or flashing lights to remind the user that the current storage location of the items to be stored is unreasonable. The detection results can also be sent to the server or control terminal to display the recommended storage location for the items to be stored. A pre-reminder is implemented when storing items to remind users to store items with large differences in deterioration time separately, reduce the impact of perishable items on non-perishable items, and extend the shelf life of items.

[0122] In a possible example scenario, it is detected that the tomatoes just placed are in a fresh state, but it is detected that the leaves of the spinach placed around the tomatoes have wilted and are about to deteriorate. By comparing the deterioration time of the two vegetables, tomatoes and spinach, it is found that the difference in the deterioration time of the two vegetables, which characterizes the deterioration information, is large, then it is determined that the current storage location of the tomatoes does not comply with the same storage principle, and a reminder message for changing the storage location of the tomatoes is generated. The reminder message can be sent to the user's mobile phone, and the visual interface of the corresponding application software on the mobile phone prompts that the storage location of the tomatoes does not meet the requirements, and the recommended location is displayed above the interface of the mobile phone application software, prompting the user to change the storage location of the tomatoes to prevent the deterioration of spinach from affecting the storage time of the tomatoes.

[0123] S209: Generate reminder information on the transfer location of the items to be stored.

[0124] The transfer location mentioned here can be understood as the operation of changing the current storage location.

[0125] Furthermore, when the deterioration information of the items to be stored is inconsistent with the deterioration information of the stored items, it is determined that the storage location of the food to be stored is unreasonable and the location of the food to be stored needs to be adjusted. A reminder message is generated to remind the user to operate to change the storage location.

[0126] S210: Display target location information of items to be stored.

[0127] The display mentioned here can be understood as a direct display reminder through the smart refrigerator, or a reminder message sent by the smart refrigerator to a server or smart terminal (mobile phone, control application software) for reminder. The target location mentioned here can be understood as a designated location recommended for the items to be stored that meet the requirements.

[0128] Furthermore, after generating a reminder message for changing the current storage location of the items to be stored, the reminder message of the target location of the items to be stored is displayed through the voice function, visual interface or flashing light and other devices on the smart refrigerator; or the recommended reminder message is sent to the server or the Zhongneng terminal device through the smart refrigerator, and the reminder message of the target location of the items to be stored is displayed on the server or the smart terminal.

[0129] S211, detecting whether the storage location of the items to be stored has changed within a set time.

[0130] The set time mentioned here can be understood as the periodic detection time set after the reminder message of the item to be stored is generated.

[0131] Furthermore, after a reminder message is generated to remind the user to change the storage location of the items to be stored, if the smart refrigerator does not detect that the user has changed the storage location of the items to be stored within the set time, the storage location of the items to be stored will be periodically detected to determine whether the storage location of the items to be stored has changed, to facilitate the user who did not notice or heard the first message reminder.

[0132] S212: When it is detected that the storage location of the item to be stored has not changed, the step of reminding the item to be stored is performed again.

[0133] Furthermore, when the storage location of the items to be stored is periodically detected and still has not changed, a reminder of the items to be stored is sent through the smart refrigerator, or a reminder message is sent to the server or terminal device through the smart refrigerator again, reminding the user again to change the storage location of the items to be stored as soon as possible.

[0134] S213: Determine whether the deterioration information of the item to be stored and the deterioration information of the stored item exceed a deterioration threshold.

[0135] The deterioration threshold mentioned here can be understood as the shelf life or best consumption time of the item.

[0136] Further, when it is detected that the deterioration information of the items to be stored is consistent with the deterioration information of the stored items, it is determined that the storage location of the current items to be stored meets the requirements. Further, it is determined whether the items to be stored and / or the stored items adjacent to the materials to be stored have exceeded the deterioration threshold (best consumption time).

[0137] S214: When the deterioration information of the item to be stored is less than the deterioration threshold, a reminder for timely use of the item to be stored is displayed.

[0138] Furthermore, when it is detected that the best consumption time of the food to be stored is less than the deterioration threshold, it is determined that the current item to be stored has passed the best consumption time, and a message reminder to consume it as soon as possible is displayed to remind the user to consume it as soon as possible or throw it away as soon as possible.

[0139] S215: When the deterioration information of the stored items is less than the deterioration threshold, a reminder for timely use of the stored items is displayed.

[0140] Furthermore, when it is detected that the best consumption time of the stored food adjacent to the storage location is less than the deterioration threshold, it is determined that the current stored items have passed the best consumption time, and a message reminder to consume as soon as possible is displayed to remind the user to consume or throw away the stored items as soon as possible.

[0141] The smart refrigerator reminder method provided by the embodiment of the present invention detects the item information and storage location of the items to be stored, as well as the item information of the stored items in the adjacent storage location; determines the deterioration information of the two items according to the item information. According to the difference in the deterioration information of the two items, it is judged whether the storage location of the current item to be stored meets the conditions. When the deterioration information of the item to be stored and the stored items are inconsistent, a reminder message is generated; a reminder message for changing the target location is further generated; and the deterioration information of the two items is compared with the deterioration threshold to determine whether the items to be stored and / or the stored items have exceeded the best consumption time, and remind the user to consume them in time; realizes the pre-reminder when storing items, reminds the user to store items with large differences in deterioration time separately, reduces the impact of perishable items on non-perishable items, and extends the freshness of the items.

[0142] Figure 3 A flowchart of another smart refrigerator reminder method provided by an embodiment of the present invention. Figure 3 The invention is introduced on the basis of the first embodiment. Figure 3 According to the provided diagram, the smart refrigerator reminder method specifically includes:

[0143] S301, obtaining item information and storage locations of items to be stored in the smart refrigerator.

[0144] The execution subject of the embodiment of the present invention is a smart refrigerator, and an information collection device is provided on the smart refrigerator to obtain the shape, packaging information or appearance color information of the items placed in the smart refrigerator. When a new item is detected to be placed in the smart refrigerator, a reasonable storage location is determined according to the deterioration of the item. If the storage is unreasonable, the user is reminded to change the current storage location to a reasonable location, so that a pre-reminder of the placed items can be achieved. By reminding the user to store items with a large difference in deterioration time separately, the impact of perishable items on non-perishable items is reduced, and the technical effect of extending the freshness time of the items can be achieved.

[0145] The items to be stored mentioned here can be understood as the items to be stored in the smart refrigerator. The items to be stored here can be vegetables, fruits, seasonings or wine and other foods placed in the smart refrigerator. The item information mentioned here can be understood as information that characterizes the characteristics of the item, such as: packaging information with production date, the appearance color of the item or the moisture content of the item. The location to be stored here can be understood as the location information detected when the item is randomly placed in the smart refrigerator.

[0146] Furthermore, when the smart refrigerator is working normally, the pre-reminder function of the storage location of the items is turned on. When it is detected that an item to be stored is randomly placed in the smart refrigerator, the detailed information of the item to be stored and the corresponding random storage location are obtained through image detection, and the item information and the data information corresponding to the storage location are uploaded to the server to prepare for the next step of analysis.

[0147] S302: Acquire item information of stored items associated with the location to be stored.

[0148] The association mentioned here can be understood as the adjacent side, which can be the adjacent surrounding position, or the same layer, same grid or same box area in the smart refrigerator. The stored items mentioned here can be understood as the items that have been assigned a reasonable storage location relative to the first storage. The item information mentioned here can be understood as the item information of the stored items collected in advance.

[0149] Furthermore, the stored items around the location of the to-be-stored items are determined by a device disposed inside the smart refrigerator, and item information corresponding to the stored items is collected.

[0150] S303: Determine deterioration information of the items to be stored according to the item information of the items to be stored, and determine deterioration information of the stored items according to the item information of the stored items.

[0151] The spoilage information mentioned here can be understood as performance indicators used to reflect whether an item is rotten and spoiled and cannot be eaten, such as the degree of odor caused by decay, expiration date, spoilage time, deterioration curve, degree of surface decay or freshness, and other characteristic information.

[0152] Furthermore, the deterioration rate and freshness of the current items are known by referring to the item information of the items to be stored, and the deterioration degree of the items to be stored is determined. Similarly, the deterioration degree of the stored items is determined based on the deterioration rate and freshness contained in the item information of the stored items, so as to prepare for the next step of determining the storage location of the items to be stored.

[0153] S304: Determine whether the item information contains item parameters.

[0154] S305: When the item information includes item parameters, the item parameters are used as deterioration information.

[0155] The item parameters mentioned here can be understood as information such as the characteristic curve or shelf life of the stored items.

[0156] Furthermore, after obtaining the deterioration information of the items to be stored and the stored items, it is determined whether there are item parameters in the deterioration information. When it is determined that there are item parameters in the item information of the items to be stored and the stored items, the item parameters of the items to be stored are used as the deterioration information of the items to be stored, and the item parameters of the stored items are used as the deterioration information of the stored items.

[0157] In a possible practical scenario, when a tomato placed in a refrigerator and an apple in an adjacent position are detected, the image acquisition device collects the freshness information, appearance color and shelf life of the apple, and the appearance color, freshness information and shelf life of the tomato are obtained at the same time, and the shelf life of the apple and the shelf life of the tomato are judged as deterioration characteristics.

[0158] S306: Acquire item packaging information and item packaging type in the item information.

[0159] S307: Determine the parameter type of the item parameter.

[0160] The packaging information mentioned here can be understood as the specific information of the outer packaging of the food, such as bottled, plastic insurance film packaging, etc. The packaging type mentioned here can be understood as the unpacking status of the outer packaging of the food. The parameter type mentioned here can be understood as the reference standard for characterizing the deterioration speed of the food, such as the deterioration curve of the food stored in the database, the maturity change rate and other information.

[0161] Further, after determining the deterioration information of the food to be stored and the deterioration information of the stored food, the packaging information and packaging type of the two food are obtained. At the same time, the parameter types of the two food are determined according to the item parameters of the two food (such as the shelf life of the food).

[0162] S308: Generate deterioration information of the items to be stored and the stored items respectively according to the item packaging type and parameter type.

[0163] Further, based on the item packaging types and parameter types corresponding to the items to be stored and the stored items, deterioration information of the items to be stored and the stored items is generated, which includes two types of data information, the item packaging type and the parameter type. The differences in the item packaging type and the parameter type are used to determine whether the storage locations of the items to be stored and the stored items meet the requirements.

[0164] In a possible example scenario, the item information includes item parameters (shelf life), and the shelf life is directly used as the spoilage information; further, the item information includes packaging information (whether it is unpacked) and multiple shelf life (unpacked shelf life, unpacked shelf life), and a shelf life is selected as the spoilage information according to the unpacking situation. When the shelf life of the food is used as the spoilage information, the spoilage information of the two food ingredients can be directly compared through the shelf life time on the food packaging to obtain the corresponding comparison result.

[0165] S309: When the item information does not include item parameters, the item packaging information is sent to the server.

[0166] S310: Receive deterioration information of the to-be-stored items and the deterioration information of the stored items fed back by the server.

[0167] Furthermore, when it is detected that the characteristic data of the item parameter does not exist in the item information of the items to be stored and / or the stored items, the packaging information of the items captured by the image is sent to the cloud server, and the database of the deterioration characteristic data of the corresponding food is searched through the cloud server to obtain the deterioration characteristic data of the specified food, and send it to the smart refrigerator as deterioration information.

[0168] In a possible example scenario, when an apple is detected, the adjacent food is detected to be cabbage. By obtaining the outer packaging information of the two food ingredients, it can be known that there is no information such as production date or shelf life on the outer packaging. At this time, the images of the apple and cabbage are sent to the cloud server, and the generation curve or storage time curve for the apple and cabbage is retrieved through the cloud server, and fed back to the smart refrigerator as the deterioration characteristics of the two.

[0169] S311. Obtain a deterioration curve corresponding to the item category according to the item category and the item freshness characteristic information of the item information.

[0170] The deterioration curve mentioned here can be understood as the change curve between the freshness and time of each ingredient. For example, the change curve of the freshness of spinach leaves over time. Different ingredients have different deterioration curves. When two similar ingredients are at different consumption times, the corresponding deterioration curves have the same shape.

[0171] Furthermore, according to the item category and the item freshness characteristic information, a change curve of the effective edible time of the item is obtained as the deterioration curve of the food, which may be a change curve of the food to be stored and / or the food already stored.

[0172] S312: Determine the deterioration time of the items to be stored and the deterioration time of the stored items according to the deterioration curve and the item freshness characteristic information.

[0173] The spoilage time mentioned here can be understood as the length of time from the current time as the starting point to the time when the food cannot be eaten. Each food has a different spoilage speed, and each food has a corresponding spoilage time.

[0174] Furthermore, the deterioration law of the food can be obtained according to the deterioration curve of the food. According to the freshness characteristic information of the current food, the corresponding remaining use time is obtained, and then the deterioration time of the food is obtained.

[0175] S313: judging, based on the deterioration curve, whether the item fitting degree between the deterioration curve of the item to be stored and the deterioration curve of the stored item satisfies a preset fitting range.

[0176] The item fitting degree mentioned here can be understood as the curve fitting degree of the corresponding deterioration curves of two ingredients, and the fitting range mentioned here can be understood as the similarity of the deterioration rules of the set ingredients. For example, the deterioration curves of canned ingredients and fresh vegetables are very different, so the fitting degree of the deterioration curves is large.

[0177] Furthermore, according to the deterioration curve of the items to be stored and the deterioration curve of the stored items, the fitting results of the deterioration curves of the two ingredients are obtained by a curve fitting processing method, and the fitting results are compared with a reasonable fitting range to determine whether the fitting degree of the current deterioration curves of the two ingredients meets the requirements.

[0178] S314: When the item fitting degree satisfies the fitting range, it is determined that the deterioration information of the item to be stored is consistent with that of the stored item.

[0179] S315: When the item fitting degree does not satisfy the fitting range, it is determined that the deterioration information of the item to be stored is inconsistent with that of the stored item.

[0180] Furthermore, the item fitting degree is calculated according to the deterioration curves of the two ingredients to obtain a fitting result, and the fitting result is compared with the fitting range. When the item fitting degree meets the fitting range, it is determined that the deterioration curves of the two ingredients are highly similar, and it can be determined that the two ingredients are of the same type and can be stored together; when the item fitting degree does not meet the fitting range, it is determined that the similarity between the deterioration curves of the two ingredients is very different, and it can be determined that the two ingredients are of different types. It is determined that the current storage location of the item to be stored does not meet the conditions, and the location of the item to be stored needs to be adjusted.

[0181] In one possible example scenario, Figure 4A schematic diagram of the deterioration fitting degree of the stored items provided in the embodiment of the present invention. Among them, curve 1 represents the deterioration curve of spinach, curve 2 represents the deterioration curve of kiwi fruit, curve 3 represents the deterioration curve of fermented bean curd, and curve 4 represents the deterioration curve of oyster sauce. The intelligent refrigerator detects kiwi fruit at the adjacent position of spinach after it is placed in the refrigerator. By analyzing and calculating the fitting degree of curve 1 and curve 2, it is obtained that the fitting result exceeds the set fitting range [2 days, 10 days]. It is judged that the storage position of the currently placed spinach is unreasonable, and the storage position of spinach should be changed. Similarly, according to the fitting degree of the deterioration curve 3 of the fermented bean curd and the deterioration curve 4 of the oyster sauce placed adjacently, it can be directly determined that the fitting degree of the two is very high, meeting the set requirements, and it is determined that the two can be stored together.

[0182] S316: Determine, based on the deterioration curve, whether the first time difference corresponding to the peak value of the deterioration curve of the object to be stored and the stored object meets a preset range.

[0183] The peak of the deterioration curve mentioned here can be understood as the highest point of the deterioration curve, which represents the best consumption time of the food. The first time difference mentioned here can be understood as the difference in the time horizontal coordinates corresponding to the peaks of the two deterioration curves. The preset range mentioned here is the difference in the deterioration time of the two stored food ingredients.

[0184] Furthermore, peak values ​​are calculated based on the deterioration curves of the two ingredients to obtain the time horizontal coordinates corresponding to the peak values ​​of the two ingredients, the difference between the time horizontal coordinates of the two ingredients is obtained as the first time difference, and the first time difference is compared with a preset range to determine whether the conditions for storing them together are met.

[0185] S317: When the first time difference satisfies a preset range, it is determined that the deterioration information of the item to be stored is consistent with that of the stored item.

[0186] S318: When the first time difference does not satisfy a preset range, determine that the deterioration information of the item to be stored is inconsistent with that of the stored item.

[0187] Further, when it is analyzed that the first time difference meets the preset range, it is determined that the deterioration time of the two ingredients is not much different, and it can be determined that the two ingredients are of the same freshness and can be stored together; when it is analyzed that the first time difference does not meet the preset range, it is determined that the deterioration time of the two ingredients is very different, and it can be determined that the two ingredients are at different freshness, then it is determined that the storage position of the current items to be stored does not meet the conditions, and the position of the items to be stored needs to be adjusted to prevent the ingredients that are close to the deterioration time from affecting the ingredients that have reached the deterioration time.

[0188] In one possible example scenario, Figure 5 The deterioration curve of the stored items provided by the embodiment of the present invention

[0189] Schematic diagram of the curve. Among them, curve 1 represents the deterioration curve of green apples, and curve 2 represents the deterioration curve of red apples. The smart refrigerator detects that the green apple is placed in the refrigerator and the red apple is detected at the adjacent position.

[0190] The results are obtained by analyzing and calculating the peak values ​​of curve 1 and curve 2, and the peak value S1 of curve 1 and the peak value S2 of curve 2 are obtained. The deterioration time difference T is obtained according to the difference between the corresponding horizontal coordinates of the peak values ​​S1 and S2. If the deterioration time difference T exceeds the preset range [2 days, 5 days], it is determined that the green apples currently placed are

[0191] The spoilage time of red apples is too different, and the storage location is unreasonable. The storage location of green apples should be changed. 0S319, according to the spoilage time, determine the second spoilage time of the stored items and the stored items.

[0192] Whether the time difference meets the preset range.

[0193] The second time difference mentioned here can be understood as the specific time difference between the two ingredients when they are spoiled and rotted. The spoilage time mentioned here can be understood as the length of time from the current start of the object to be stored and the stored object adjacent to the storage location to expire and spoil.

[0194] 5S320. When the second time difference satisfies the preset range, it is determined that the deterioration information of the item to be stored is consistent with that of the stored item.

[0195] S321: When the second time difference does not satisfy a preset range, determine that the deterioration information of the item to be stored is inconsistent with that of the item already stored.

[0196] Furthermore, by detecting the time length of the items to be stored from the current time to the expiration date and the corresponding time length of the stored items, the deterioration time of the two ingredients can be obtained.

[0197] The spoilage time difference is compared with the preset range that can be placed together. When the spoilage time difference is within the preset range, it is determined that the time lengths of the two ingredients from spoilage are similar and can be placed together; when the spoilage time difference exceeds the preset range, it is determined that the time lengths of the two ingredients from spoilage are very different and cannot be placed together and need to be placed separately.

[0198] 5S322. If the deterioration information of the item to be stored is inconsistent with the deterioration information of the stored item,

[0199] Store items for reminders.

[0200] The reminder mentioned here can be understood as directly reminding the user through the smart refrigerator. The smart refrigerator can also send the recommended storage location of the material to be stored to the server or application terminal for display.

[0201] Furthermore, when it is detected that the deterioration information of the items to be stored is very different from the deterioration information of the stored items, it is determined that the deterioration information of the two is inconsistent. It is determined that the storage location of the current items to be stored is unreasonable, which will affect the deterioration speed of the surrounding items. The smart refrigerator directly displays a message reminding the user to transfer the location in the form of voice or flashing lights to remind the user that the current storage location of the items to be stored is unreasonable. The detection results can also be sent to the server or control terminal to display the recommended storage location for the items to be stored. A pre-reminder when storing items is realized to remind the user to store items with large differences in deterioration time separately, reduce the impact of perishable items on non-perishable items, and extend the shelf life of the items.

[0202] The embodiment of the present invention provides a smart refrigerator reminder method, which obtains the item information of the items to be stored and the storage location, and obtains the item information of the stored items around the storage location, and obtains the deterioration information of the two items. When the deterioration information is a deterioration curve, the similarity of the deterioration information of the two items is judged according to the fitting degree of the deterioration curve, and the size of the difference in the deterioration degree of the two items is determined. When the deterioration information of the two items is inconsistent, it is characterized that the difference in the deterioration information of the two items is relatively large, and the items to be stored are reminded; the deterioration time difference of the deterioration information of the two items is judged according to the difference between the peak values ​​of the deterioration curve, and the size of the difference in the deterioration degree of the two items is determined. When the difference in the deterioration time difference of the two items is large, it is characterized that the difference in the deterioration information of the two items is large, and the items to be stored are reminded, so as to achieve the technical effect of pre-reminding the placed items, reminding the user to store the items with large differences in deterioration time separately, reducing the influence of the perishable items on the non-perishable items, and extending the freshness time of the items.

[0203] Figure 6 A schematic diagram of the structure of a smart refrigerator reminder device provided by an embodiment of the present invention. Figure 6 The specific structure of the smart refrigerator reminder device includes:

[0204] An acquisition module 61 is used to acquire item information and a storage location of items to be stored in the smart refrigerator;

[0205] The acquisition module 61 is further used to acquire the item information of the stored items associated with the location to be stored;

[0206] A determination module 62, configured to determine deterioration information of the to-be-stored items based on the item information of the to-be-stored items, and to determine deterioration information of the stored items based on the item information of the stored items;

[0207] A judgment module 63, used to judge whether the deterioration information of the item to be stored is consistent with the deterioration information of the stored item;

[0208] The reminder module 64 is used to remind the item to be stored if the deterioration information of the item to be stored is inconsistent with the deterioration information of the stored item.

[0209] The smart refrigerator reminder device provided in this embodiment can be as follows Figure 6 The smart refrigerator reminder device shown in FIG. 1 can perform the following steps: Figure 1-5 All steps of the smart refrigerator reminder method, and then achieve Figure 1-5 For details, please refer to the technical effect of the smart refrigerator reminder method shown in Figure 1-5 For the sake of brevity, the relevant description is not repeated here.

[0210] Figure 7 A schematic diagram of the structure of a smart refrigerator provided by an embodiment of the present invention, Figure 7 The smart refrigerator 700 shown includes: at least one processor 701, a memory 702, at least one network interface 704 and other user interfaces 703. The various components in the smart refrigerator 700 are coupled together through a bus system 705. It is understood that the bus system 705 is used to achieve connection and communication between these components. In addition to the data bus, the bus system 705 also includes a power bus, a control bus and a status signal bus. However, for the sake of clarity, the bus system 705 is not described in detail. Figure 7 Various buses are labeled as bus system 705.

[0211] The user interface 703 may include a display, a keyboard, or a pointing device (eg, a mouse, a trackball, a touch pad, or a touch screen).

[0212] It can be understood that the memory 702 in the embodiment of the present invention can be a volatile memory or a non-volatile memory, or can include both volatile and non-volatile memories. Among them, the non-volatile memory can be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory can be a random access memory (RAM), which is used as an external cache. By way of example but not limitation, many forms of RAM are available, such as static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDRSDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM) and direct RAM bus random access memory (DRRAM). The memory 702 described herein is intended to include, but is not limited to, these and any other suitable types of memory.

[0213] In some implementations, the memory 702 stores the following elements, executable units or data structures, or a subset thereof, or an extended set thereof: an operating system 7021 and an application 7022 .

[0214] The operating system 7021 includes various system programs, such as a framework layer, a core library layer, a driver layer, etc., which are used to implement various basic services and process hardware-based tasks. The application 7022 includes various application programs, such as a media player (Media Player), a browser (Browser), etc., which are used to implement various application services. The program for implementing the method of the embodiment of the present invention can be included in the application 7022.

[0215] In the embodiment of the present invention, by calling the program or instruction stored in the memory 702, specifically, the program or instruction stored in the application 7022, the processor 701 is used to execute the method steps provided by each method embodiment, for example, including:

[0216] Obtain item information of items to be stored and the storage location in the smart refrigerator; obtain item information of stored items associated with the storage location; determine deterioration information of the items to be stored based on the item information of the items to be stored, and determine deterioration information of the stored items based on the item information of the stored items; determine whether the deterioration information of the items to be stored is consistent with the deterioration information of the stored items; if the deterioration information of the items to be stored is inconsistent with the deterioration information of the stored items, remind the items to be stored.

[0217] The method disclosed in the above embodiment of the present invention can be applied to the processor 701, or implemented by the processor 701. The processor 701 may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above method can be completed by the hardware integrated logic circuit in the processor 701 or the instruction in the form of software. The above processor 701 can be a general processor, a digital signal processor (Digital Signal Processor, DSP), an application specific integrated circuit (Application Specific Integrated Circuit, ASIC), a field programmable gate array (Field Programmable Gate Array, FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components. The methods, steps and logic block diagrams disclosed in the embodiments of the present invention can be implemented or executed. The general processor can be a microprocessor or the processor can also be any conventional processor, etc. The steps of the method disclosed in the embodiment of the present invention can be directly embodied as a hardware decoding processor to execute, or the hardware and software units in the decoding processor can be executed. The software unit can be located in a mature storage medium in the field such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory or an electrically erasable programmable memory, a register, etc. The storage medium is located in the memory 702, and the processor 701 reads the information in the memory 702 and completes the steps of the above method in combination with its hardware.

[0218] It is understood that the embodiments described herein may be implemented in hardware, software, firmware, middleware, microcode, or a combination thereof. For hardware implementation, the processing unit may be implemented in one or more application specific integrated circuits (ASIC), digital signal processors (DSP), digital signal processing devices (DSPDevice, DSPD), programmable logic devices (PLD), field programmable gate arrays (FPGA), general purpose processors, controllers, microcontrollers, microprocessors, other electronic units for performing the functions described in the present application, or a combination thereof.

[0219] For software implementation, the technology described herein can be implemented by a unit that performs the functions described herein. The software code can be stored in a memory and executed by a processor. The memory can be implemented in the processor or outside the processor.

[0220] The smart refrigerator provided in this embodiment can be Figure 7 The smart refrigerator shown in FIG. 1 can perform the following operations: Figure 1-5 All steps of the smart refrigerator reminder method, and then achieve Figure 1-5 For details, please refer to the technical effect of the smart refrigerator reminder method shown in Figure 1-5 For the sake of brevity, the relevant description is not repeated here.

[0221] The embodiment of the present invention also provides a storage medium (computer-readable storage medium). The storage medium here stores one or more programs. The storage medium may include a volatile memory, such as a random access memory; the memory may also include a non-volatile memory, such as a read-only memory, a flash memory, a hard disk or a solid-state drive; the memory may also include a combination of the above-mentioned types of memory.

[0222] When one or more programs in the storage medium can be executed by one or more processors to implement the above-mentioned smart refrigerator reminder method executed on the smart refrigerator device side.

[0223] The processor is used to execute the smart refrigerator reminder program stored in the memory to implement the following steps of the smart refrigerator reminder method executed on the smart refrigerator device side:

[0224] Obtain item information of items to be stored and the storage location in the smart refrigerator; obtain item information of stored items associated with the storage location; determine deterioration information of the items to be stored based on the item information of the items to be stored, and determine deterioration information of the stored items based on the item information of the stored items; determine whether the deterioration information of the items to be stored is consistent with the deterioration information of the stored items; if the deterioration information of the items to be stored is inconsistent with the deterioration information of the stored items, remind the items to be stored.

[0225] The professionals should further realize that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented by electronic hardware, computer software, or a combination of the two. In order to clearly illustrate the interchangeability of hardware and software, the composition and steps of each example have been generally described in the above description according to the function. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professionals and technicians can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the present invention.

[0226] The steps of the method or algorithm described in conjunction with the embodiments disclosed herein may be implemented using hardware, a software module executed by a processor, or a combination of the two. The software module may be placed in a random access memory (RAM), a memory, a read-only memory (ROM), an electrically programmable ROM, an electrically erasable programmable ROM, a register, a hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.

[0227] The specific implementation methods described above further illustrate the objectives, technical solutions and beneficial effects of the present invention in detail. It should be understood that the above description is only a specific implementation method of the present invention and is not intended to limit the scope of protection of the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present invention should be included in the scope of protection of the present invention.

Claims

1. A smart refrigerator reminder method, characterized in that: include: Obtaining item information and storage locations of items to be stored in the smart refrigerator; Acquiring the item information of the stored item associated with the to-be-stored location, comprising: collecting an item image of the item associated with the to-be-stored location; acquiring item attributes of the item according to the item image, the item attributes including item category, item freshness characteristic information, packaging information and / or item parameters; using the acquired item attributes as the item information of the stored item; Determining the deterioration information of the to-be-stored items according to the item information of the to-be-stored items, and determining the deterioration information of the stored items according to the item information of the stored items, including: acquiring a deterioration curve corresponding to the item category according to the item category and item freshness characteristic information of the item information; determining the deterioration time of the to-be-stored items, and determining the deterioration time of the stored items according to the deterioration curve and the item freshness characteristic information; Determining whether the deterioration information of the item to be stored is consistent with the deterioration information of the stored item; If the deterioration information of the item to be stored is inconsistent with the deterioration information of the stored item, a reminder is given to the item to be stored.

2. The method according to claim 1, characterized in that The obtaining of the item information and the storage location of the items to be stored in the smart refrigerator includes: When it is detected that a new item to be stored is added to the smart refrigerator, the storage location is determined according to the moving trajectory of the item to be stored; The object information of the object to be stored is determined based on the collected appearance image of the object to be stored.

3. The method according to claim 1, characterized in that The determining of the deterioration information of the to-be-stored items according to the item information of the to-be-stored items, and the determining of the deterioration information of the stored items according to the item information of the stored items, comprises: Determining whether the item information includes item parameters; When the item information includes item parameters, the item parameters are used as the deterioration information.

4. The method according to claim 3, characterized in that When the item information includes item parameters, using the item parameters as the deterioration information includes: Obtaining item packaging information and item packaging type from the item information; Determining a parameter type of the item parameter; According to the object packaging type and the parameter type, deterioration information of the object to be stored and the stored object are generated respectively.

5. The method according to claim 4, characterized in that The method further comprises: When the item information does not include item parameters, sending the item packaging information to the server; Receive the deterioration information of the to-be-stored item and the deterioration information of the stored item fed back by the server.

6. The method according to claim 1, characterized in that The determining whether the deterioration information of the item to be stored is consistent with the deterioration information of the stored item includes: According to the deterioration curve, determining whether the item fitting degree between the deterioration curve of the item to be stored and the deterioration curve of the stored item satisfies a preset fitting range; When the object fitting degree satisfies the fitting range, determining that the deterioration information of the object to be stored is consistent with that of the stored object; When the object fitting degree does not satisfy the fitting range, it is determined that the deterioration information of the object to be stored is inconsistent with that of the stored object.

7. The method according to claim 6, characterized in that The method further comprises: According to the deterioration curve, determining whether a first time difference corresponding to a peak value of the deterioration curve of the object to be stored and the stored object is within a preset range; When the first time difference satisfies the preset range, determining that the deterioration information of the object to be stored is consistent with that of the stored object; When the first time difference does not satisfy the preset range, it is determined that the deterioration information of the object to be stored is inconsistent with the deterioration information of the stored object.

8. The method according to claim 1, characterized in that The method further comprises: According to the deterioration time, determining whether a second time difference between the deterioration time of the to-be-stored item and the stored item satisfies a preset range; When the second time difference satisfies the preset range, determining that the deterioration information of the object to be stored is consistent with that of the stored object; When the second time difference does not satisfy the preset range, it is determined that the deterioration information of the object to be stored is inconsistent with the deterioration information of the stored object.

9. The method according to claim 1, characterized in that: If the deterioration information of the item to be stored is inconsistent with the deterioration information of the stored item, reminding the item to be stored includes: Generating reminder information of the transfer location of the items to be stored; The target location information of the item to be stored is displayed.

10. The method according to claim 1, characterized in that The method further comprises: Detecting whether the storage location of the object to be stored changes within a set time; When it is detected that the storage location of the object to be stored has not changed, the step of reminding the object to be stored is performed again.

11. The method according to claim 1, characterized in that: The method further comprises: Determining whether the deterioration information of the item to be stored and the deterioration information of the stored item exceed a deterioration threshold; When the deterioration information of the item to be stored is less than the deterioration threshold, a reminder for timely use of the item to be stored is displayed; When the deterioration information of the stored items is less than the deterioration threshold, a reminder for timely use of the stored items is displayed.

12. A smart refrigerator reminder method, characterized in that: include: An acquisition module, used to acquire item information and storage locations of items to be stored in the smart refrigerator; The acquisition module is further used to acquire the item information of the stored items associated with the to-be-stored location, including: collecting an item image of the item associated with the to-be-stored location; acquiring item attributes of the item according to the item image, the item attributes including item category, item freshness characteristic information, packaging information and / or item parameters; and using the acquired item attributes as the item information of the stored items; a determination module, configured to determine the deterioration information of the to-be-stored items according to the item information of the to-be-stored items, and to determine the deterioration information of the stored items according to the item information of the stored items, including: acquiring a deterioration curve corresponding to the item category according to the item category and item freshness characteristic information of the item information; determining the deterioration time of the to-be-stored items, and determining the deterioration time of the stored items according to the deterioration curve and the item freshness characteristic information; A judgment module, used to judge whether the deterioration information of the item to be stored is consistent with the deterioration information of the stored item; The reminder module is used to remind the item to be stored if the deterioration information of the item to be stored is inconsistent with the deterioration information of the stored item.

13. A smart refrigerator, characterized in that: include: A processor and a memory, wherein the processor is used to execute a smart refrigerator reminder program stored in the memory to implement the smart refrigerator reminder method according to any one of claims 1 to 11.

14. A storage medium, characterized in that: The storage medium stores one or more programs, and the one or more programs can be executed by one or more processors to implement the smart refrigerator reminder method according to any one of claims 1 to 11.

Images