Method for managing articles, refrigeration equipment and system for managing articles

Abstract

The invention relates to the technical field of intelligent household appliances, and discloses a method for managing articles, which comprises the following steps: acquiring an image of a target space, and obtaining information of articles stored in the target space; obtaining a replacement icon of the article according to the information of the article; and displaying the replacement icon of the article at the interaction end, or displaying the information of the article while displaying the replacement icon of the article. Compared with a real image, the replacement icon of the article is beautified and tidier, the user can check and / or click the corresponding article more conveniently, the accuracy of interaction between the user and the image is improved, and then the use feeling of the user is improved. The invention further discloses the refrigeration equipment and a system for managing the articles.

Description

Technical Field

[0001] The present application relates to the technical field of smart home appliances, for example, to a method for managing items, a refrigeration device, and a system for managing items. Background Art

[0002] Refrigerators are commonly used household appliances that are used to freeze and preserve items. With the development of technology, users have higher requirements for the intelligence of refrigerators. For example, users want to interact with refrigerators.

[0003] In order to realize the interaction between the refrigerator and the user, in the related art, the display screen of the refrigerator displays a real image, and after the user clicks on the real image, the display screen displays further information.

[0004] In the process of implementing the embodiments of the present disclosure, it is found that there are at least the following problems in the related art:

[0005] Although the related technology can realize the interaction between the refrigerator and the user, since the items in most users' refrigerators are placed in a messy manner, the user is prone to accidental clicks when clicking on the real image displayed on the display screen.

[0006] It should be noted that the information disclosed in the above background technology section is only used to enhance the understanding of the background of the present application, and therefore may include information that does not constitute the prior art known to ordinary technicians in the field. Summary of the invention

[0007] In order to provide a basic understanding of some aspects of the disclosed embodiments, a brief summary is given below. The summary is not an extensive review, nor is it intended to identify key / critical components or delineate the scope of protection of these embodiments, but rather serves as a prelude to the detailed description that follows.

[0008] The embodiments of the present disclosure provide a method for managing items, a refrigeration device, and a system for managing items to improve the accuracy of user interaction with an image.

[0009] In some embodiments, a method for managing items includes: capturing an image of a target space to obtain information about items stored in the target space; obtaining an alternative icon for the item based on the information about the item; and displaying an alternative icon for the item on an interactive end, or displaying the information of the item while displaying the alternative icon for the item.

[0010] In some embodiments, a refrigeration device includes: a cabinet and a door, wherein a target space for storing items is provided in the cabinet and / or the door; an image acquisition device, used to acquire an image of the target space; a first processor, used to analyze the image of the target space to obtain item information; obtain an alternative icon of the item based on the item information; an interactive terminal, used to display an alternative icon of the item; or display the item information while displaying the alternative icon of the item in response to a user's query command.

[0011] In some embodiments, a system for managing items includes: a refrigeration device including an image acquisition device, wherein the image acquisition device acquires an image of a target space and then sends the image of the target space to a cloud server; after the cloud server receives the image of the target space, it analyzes the image of the target space to obtain information about the item; an alternative icon for the item is obtained based on the information about the item; an interactive end of a remote interactive device displays the alternative icon for the item; or in response to a user's query command, displays the alternative icon for the item and the item information at the same time.

[0012] The method for managing items, the refrigeration equipment, and the system for managing items provided by the embodiments of the present disclosure can achieve the following technical effects:

[0013] First, the information of the item is obtained based on the image of the target space, and the alternative icon of the item is obtained according to the information of the item. Then, the alternative icon of the item is displayed on the interactive end, or the information of the item is displayed together with the alternative icon of the item. Compared with the real image, the alternative icon of the item is beautified and neater, which is more conducive to users to view and / or click the corresponding item, improves the accuracy of the user's interaction with the image, and thus improves the user's sense of use.

[0014] The above general description and the following description are exemplary and explanatory only and are not intended to limit the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] One or more embodiments are exemplarily described by corresponding drawings, which do not limit the embodiments. Elements with the same reference numerals in the drawings are shown as similar elements, and the drawings do not constitute a scale limitation, and wherein:

[0016] Figure 1 is a schematic diagram of a refrigeration device provided by an embodiment of the present disclosure;

[0017] Figure 2 is a schematic diagram of the interior of a refrigeration device provided by an embodiment of the present disclosure;

[0018] Figure 3 is a flow chart of a system for managing items provided by an embodiment of the present disclosure;

[0019] Figure 4 is a schematic diagram of a method for managing items provided by an embodiment of the present disclosure;

[0020] Figure 5 is a schematic diagram of an alternative icon of an item provided by an embodiment of the present disclosure;

[0021] Figure 6 is a schematic diagram of displaying information of an item on an interactive terminal in response to a user's query command for a replacement icon provided by an embodiment of the present disclosure;

[0022] Figure 7 is a schematic diagram of selecting a target object by using an alternative icon of a circled object provided by an embodiment of the present disclosure;

[0023] Figure 8 is a schematic diagram of selecting a target object by clicking on or encircling alternative icons of the objects, provided by an embodiment of the present disclosure;

[0024] Fig. 9 is a schematic diagram of selecting a target item by using an alternative icon of a connected item provided by an embodiment of the present disclosure;

[0025] Fig.10 is a schematic diagram of a query box provided by an embodiment of the present disclosure;

[0026] Fig.11 is a schematic diagram of displaying information of a target object on an interactive terminal provided by an embodiment of the present disclosure;

[0027] Fig.12 is a schematic diagram of another method for managing items provided by an embodiment of the present disclosure;

[0028] Fig.13 is a schematic diagram of an interactive terminal displaying third prompt information provided by an embodiment of the present disclosure;

[0029] Fig.14 is a schematic diagram of an interactive terminal displaying fourth prompt information provided by an embodiment of the present disclosure;

[0030] Fig.15 is a schematic diagram of an interactive terminal displaying fifth prompt information provided by an embodiment of the present disclosure;

[0031] Fig.16 is a schematic diagram of another method for managing items provided by an embodiment of the present disclosure;

[0032] Fig.17 is a schematic diagram of the interaction process between the refrigeration device and the user provided by the embodiment of the present disclosure;

[0033] Figure 18-1is a schematic diagram of a real-time image of an object in a target space provided by an embodiment of the present disclosure;

[0034] Figure 18-2 It is a schematic diagram that the position of the replacement icon of the object provided by the embodiment of the present disclosure is consistent with the position of the object in the real-time image, and the replacement icon of the object is proportional to the real size of the object;

[0035] Fig.19 It is a device for managing items provided by an embodiment of the present disclosure.

[0036] Reference numerals:

[0037] 10. Refrigeration equipment; 11. Box body; 12. Box door; 13. Image acquisition device; 14. Drawer; 15. Shelf; 20. Interactive terminal; 21. Display screen; 30. Remote interactive device; 40. Cloud server;

[0038] 190. Device for managing items; 191. Second processor; 192. Memory; 193. Communication interface; 194. Bus. DETAILED DESCRIPTION

[0039] In order to be able to understand the features and technical contents of the embodiments of the present disclosure in more detail, the implementation of the embodiments of the present disclosure is described in detail below in conjunction with the accompanying drawings. The attached drawings are for reference only and are not used to limit the embodiments of the present disclosure. In the following technical description, for the convenience of explanation, a full understanding of the disclosed embodiments is provided through multiple details. However, one or more embodiments can still be implemented without these details. In other cases, to simplify the drawings, well-known structures and devices can be simplified for display.

[0040] The terms "first", "second", etc. in the specification and claims of the embodiments of the present disclosure and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the terms used in this way can be interchanged where appropriate, so that the embodiments of the embodiments of the present disclosure described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions.

[0041] Unless otherwise stated, the term "plurality" means two or more.

[0042] In the embodiment of the present disclosure, the character " / " indicates that the preceding and following objects are in an "or" relationship. For example, A / B indicates: A or B.

[0043] The term "and / or" is a description of the association relationship between objects, indicating that three relationships can exist. For example, A and / or B means: A or B, or, A and B.

[0044] The term "correspondence" may refer to an association relationship or a binding relationship. The correspondence between A and B means that there is an association relationship or a binding relationship between A and B.

[0045] Combination Figure 1 and Figure 2 As shown, an embodiment of the present disclosure provides a refrigeration device 10, including: a box body 11, a door 12, an image acquisition device 13, a first processor and an interactive terminal 20. A storage space for storing food is provided inside the box body 11. For example, one or more drawers 14 are provided inside the box body 11, and the internal space of a drawer 14 is a storage space. For another example, one or more shelves 15 are provided inside the box body 11, and the space formed between the multiple shelves 15 and between the shelves 15 and the box body 11 is a storage space. The door 12 is openably provided in the box body 11. The image acquisition device 13 is provided in the box body 11, and is used to capture images of the target space. The target space is a storage space that the user needs to monitor, and can be the internal space of one or more drawers 14, the storage space of the door 12, or the internal space of the refrigeration device 10 as a whole. The user interacts with the refrigeration device 10 through the interactive terminal 20.

[0046] Optionally, the image acquisition device 13 includes: a camera or an imaging sensor. The camera includes: one or more of an RGB (Red-Green-Blue) camera, a spectral camera, an infrared camera, and a TOF (Time of Flight) camera.

[0047] Optionally, the target space is the storage space of the drawer 14, and the image acquisition device 13 is set at the inner top of the box body 11, the inner side of the door 12, the inner side of the box body 11, the top of the drawer 14, etc., where the storage space image of the drawer 14 can be acquired.

[0048] Optionally, the interactive terminal 20 includes: a display screen 21 arranged on the outside of the door 12 of the refrigeration device 10, and / or a display screen arranged on the front panel of the drawer 14. When the display screen is arranged on the outside of the door 12, the user can interact with the display screen and view the content displayed on the display screen without opening the door 12, which is convenient and quick. When the display screen is arranged on the front panel of the drawer 14, the storage space of the drawer 14 is the target space. In this way, the position of the display screen corresponds to the target space, and the user can view the corresponding target space on the interactive terminal 20, which is more targeted.

[0049] The first processor is used to receive the image of the target space captured by the image acquisition device 13, and analyze the image of the target space to obtain the information of the object. Then, a replacement icon is generated according to the information of the object. Then, the replacement icon is sent to the interactive terminal 20, and the interactive terminal 20 displays the replacement icon of the object, or displays the information of the object while displaying the replacement icon of the object. When the interactive terminal displays the replacement icon of the object and does not display the information of the object, the first processor is also used to receive a query command for the replacement icon sent by the interactive terminal 20 or the voice device, and generates the information of the object according to the query command, and then controls the interactive terminal 20 to display the information of the object.

[0050] Combination Figure 3 As shown, an embodiment of the present disclosure provides a system for managing items, including: a refrigeration device 10 and a remote interaction device 30. Optionally, the refrigeration device 10 includes: an image acquisition device 13, and the image acquisition device 13 is used to acquire an image of a target space. The remote interaction device 30 includes: an interaction terminal 20. The cloud server 40 is communicatively connected with the refrigeration device 10 and the interaction terminal 20. Specifically, the image acquisition device 13 acquires an image of the target space, and sends the image of the target space to the cloud server 40. The cloud server 40 analyzes the image of the target space to obtain information about the item. Then, an alternative icon of the item is obtained based on the information of the item, and the alternative icon of the item is sent to the interaction terminal 20. The interaction terminal 20 displays an alternative image of the item, or displays the information of the item while displaying the alternative icon of the item, so as to interact with the user.

[0051] When the interactive terminal displays an alternative icon of an item and does not display the information of the item, the cloud server 40 is also used to respond to the user's query command for the alternative icon of the item, obtain the information of the item, and send the information of the item to the interactive terminal 20. The interactive terminal 20 displays the information of the item. Optionally, the interactive terminal 20 includes: a smart mobile device, and / or a smart home appliance. The smart mobile device includes: a smart phone, a smart home device, a wearable device, a smart mobile device, a virtual reality device, etc., or any combination thereof. In this way, the user can remotely interact with the refrigeration device 10 through the interactive terminal 20, which is more convenient.

[0052] Optionally, the user may send a query command by touch, voice, etc. Touch includes: single click, long press, slide, circle, etc.

[0053] Optionally, the refrigeration device 10 is a device such as a refrigerator or a freezer.

[0054] Combination Figure 4 As shown, the present disclosure provides a method for managing items, including:

[0055] S401, an image acquisition device acquires an image of a target space to obtain information about items stored in the target space.

[0056] S402: The first processor obtains a replacement icon for the item according to information about the item.

[0057] S403, displaying an alternative icon of the item on the interactive end, or displaying the information of the item while displaying the alternative icon of the item.

[0058] The image of the target space is captured by an image acquisition device disposed in the refrigeration equipment box, thereby obtaining the information of the item. Optionally, the information of the item includes: name, location and related information. The related information includes: quantity and / or real image and / or freshness and / or storage date and / or shelf life and / or packaging form and / or recipe. The first processor obtains an alternative icon of the item based on the information of the item, and then sends the alternative icon of the item to the interactive end. The interactive end displays the alternative icon of the item, or displays the information of the item while displaying the alternative icon of the item. The alternative icon of the item is a non-real, virtual icon, and the name of the item corresponding to the alternative icon is consistent with the name of the item stored in the target space.

[0059] The method for managing items provided by the embodiment of the present disclosure first obtains item information based on the image of the target space, and obtains an alternative icon of the item based on the item information. Then, the alternative icon of the item is displayed on the interactive end, or the item information is displayed while the alternative icon of the item is displayed. Compared with the real image, the alternative icon of the item is beautified, more neat, and more conducive to the user to view and / or click the corresponding item, thereby improving the accuracy of the user's interaction with the image and thus improving the user's sense of use.

[0060] Optionally, when an alternative icon of an item is displayed on the interactive end and the item information is not displayed, the item information is displayed on the interactive end in response to a user's query command for the alternative icon.

[0061] When the interactive end displays an alternative image of an item and does not display the information of the item, the first processor displays the information of the item on the interactive end in response to the user's query command for the alternative icon. Optionally, the user forms a query command by touching the interactive end, or forms a query command by sending a voice to the voice end. The query command includes a query object, and the query object includes one or more items corresponding to the alternative icons displayed on the interactive end, which are selected by the user. The first processor sends the information of the item to the interactive end, so that the interactive end displays the information of the item to the user. In this way, the user interacts with the alternative icons of the item, and the user queries the items corresponding to one or more of the alternative icons. The alternative icons are neater, so the accuracy of the user's interaction with the alternative icons can be improved, so that the information of the displayed item, that is, the query result, is more accurate, thereby improving the user's experience.

[0062] Optionally, S402, displaying an alternative icon of the item on the interactive end includes:

[0063] The alternative icons displayed on the interactive terminal are arranged according to preset rules; among them,

[0064] The preset rules include: the position of the alternative icon of the item corresponds to the actual position of the item, and the size of the alternative icon of the item is positively correlated with the actual size of the item; or, the alternative icons of the item are evenly distributed and displayed.

[0065] Alternative icons of items arranged according to preset rules are displayed on the interactive end for user convenience.

[0066] For alternative icons for items, see Figure 5 . The preset rules include: the position of the alternative icon of the item corresponds to the actual position of the item, and the size of the alternative icon of the item is positively correlated with the real size of the item. Optionally, the size of the alternative icon of the item is proportional to the real size of the item. In this way, the position of the item in the target space and the relative size of the item are truly reproduced by the alternative icon, which is convenient for users to understand the storage situation of the items in the target space. Alternatively, the preset rules include: the alternative icons of the item are evenly distributed and displayed. In this way, the various alternative icons are regularly and evenly distributed to adapt to the display screen of the interactive end, which is more beautiful and convenient for users to view.

[0067] Optionally, combined Figure 6 As shown, the first processor displays information of the item on the interactive end in response to the user's query command for the replacement icon, including:

[0068] S601, the first processor determines a target item according to a query command of a user; the target item is an item corresponding to one or more of the alternative icons of the displayed item.

[0069] S602, displaying information of the target item on the interactive end.

[0070] The first processor analyzes the user's query command, and then determines the target item of the user's query. The target item is an item corresponding to one or more of the alternative icons of the item displayed on the interactive end. Then the information of the target item is displayed on the interactive end. As can be seen from the foregoing, the information of the item includes: name, location and related information, and the related information includes one or more information, then the name and location of the target item, and one or more information in the related information can be displayed on the interactive end. Optionally, when the user's query command is a touch query / air operation query, if the user clicks / long presses / slides / circles / connects the alternative icon and clicks the query window, the item corresponding to the alternative icon clicked / long pressed / slides / circles / connects by the user is determined as the target item. Optionally, the click includes single click, double click and other forms, which can be set by the user. When the user's query command is a voice query, the item corresponding to the user's voice is determined as the target item.

[0071] When the user selects the target item by touching it, if there is only one target item, the user can select the target item by clicking the alternative icon of the item. If there are multiple target items, if the alternative icons of these items are adjacent, see Figure 7 , the user can circle these alternative icons together to select the target item. If the alternative icons of these items are not adjacent, see Figure 8 , the user can click or circle these alternative icons to select the target item, or, see Fig. 9 , users can connect these alternative icons with lines to select the target item.

[0072] Optionally, when the user selects the target item by touching and then clicks a query button displayed on the interactive end, the first processor determines that the user's query command is to query the quantity and / or real image and / or freshness and / or storage date and / or shelf life and / or packaging form of the target item.

[0073] When the user selects the target item by touching, and then clicks a recipe button displayed on the interactive end, the first processor determines that the user's query command is to query the recipe of the target item.

[0074] Alternatively, see Fig.10 , a query box is displayed on the interactive end. When the user selects the alternative icon corresponding to the target item, the name of the corresponding item is displayed in the query box.

[0075] Optionally, a real image of the target object is displayed on the interactive end, including:

[0076] Display the real image of the target object at the interactive end, and do not display or blur the non-target objects; or

[0077] The real image of the target object is displayed on the interactive end, non-target objects are not displayed or blurred, and the information label of the target object is displayed on one side of the real image of the target object.

[0078] Among them, the position of the real image corresponds to the real position of the object.

[0079] When the real image of the target object is displayed on the interactive end, the real image of the target object is displayed, and the images of non-target objects are not displayed or blurred. For example, the interactive end displays alternative icons of objects such as tomatoes, cucumbers, carrots, and eggs. When the target object selected by the user is carrots, the nearest real image of carrots in the target space is displayed, and non-target objects such as tomatoes and cucumbers are not displayed or blurred, so that the user can quickly lock the target object and understand the real storage status of the target object. Alternatively, the real image of the target object is displayed, and the icons of non-target objects are not displayed or blurred. At the same time, the information label of the corresponding target object is displayed on one side of the real image of the target object. For example, see Fig.11 When the target item selected by the user is carrot, the nearest real image of carrot in the target space is displayed, and non-target items such as tomatoes and cucumbers are not displayed or are blurred. At the same time, a virtual information label corresponding to the carrot is displayed on one side of the real image of the carrot. Optionally, when the interactive end displays the target item, the display position of the target item on the interactive end corresponds to the real position of the target item in the target space, so that the user can further understand the real storage location of the target item. Optionally, the information label displays the name, quantity, freshness, storage date, shelf life and other related information of the target item (such as carrots) so that the user can understand the information of the target item.

[0080] Optionally, when displaying recipes of target items on the interactive end, if the user selects multiple target items, recipes for cooking multiple target items together are displayed on the interactive end. For example, if the user selects tomatoes and eggs as target items, the interactive end displays the recipes for scrambled eggs with tomatoes. If the user selects one target item, the interactive end displays recipes containing the target item. For example, if the user selects cucumber as the target item, the interactive end displays recipes for cold cucumber salad, scrambled eggs with cucumber, or stir-fried meat with cucumber. In this way, recipes related to the target items are recommended to the user to meet the user's needs.

[0081] Combination Fig.12 As shown, the embodiment of the present disclosure provides another method for managing items, including:

[0082] S401, an image acquisition device acquires an image of a target space to obtain information about items stored in the target space.

[0083] S402: The first processor obtains a replacement icon for the item according to information about the item.

[0084] S403, displaying an alternative icon of the item on the interactive end, or displaying the information of the item while displaying the alternative icon of the item.

[0085] S404: After executing S401, the first processor sends a prompt message according to the change of the information of the item.

[0086] As mentioned above, the information of the item includes: name, location and related information. After the first processor obtains the information of the item, it sends a prompt message to the user according to the change of the information of the item to remind the user to pay attention to the change of the item. Optionally, the prompt information includes: voice prompt information issued by a voice device, text and / or icon prompt information displayed on a display screen, etc. Optionally, the prompt method of the voice prompt information includes: voice broadcast, sound effect, etc. Optionally, the prompt method of the icon prompt information includes: displaying a preset mark, differentiated color, etc.

[0087] Optionally, at S404, the first processor sends prompt information according to the change of the information of the item, including:

[0088] The first processor issues a first prompt message when the position of the object changes; and / or,

[0089] The first processor sends a second prompt message when there are items in the target space that meet the common storage conditions; and / or,

[0090] The first processor issues a third prompt message when the type of the object is not suitable for storage in the target space; and / or,

[0091] The first processor issues a fourth prompt message when the freshness of the item changes; and / or,

[0092] When the packaging of the article does not meet the packaging requirement of the target space, the first processor issues a fifth prompt message.

[0093] The first processor determines whether the position of the object in the target space has changed. If the position of the object has changed, for example, the object has moved from one drawer to another drawer, or from one shelf to another shelf, or from a drawer to a partition, a first prompt message is issued to prompt the user of the position change of the corresponding object to prevent the user from being unable to find the object.

[0094] The first processor also determines whether the conditions for storing various types of items in the target space at the same time are suitable. If not, a second prompt message is issued. Optionally, when items can ripen each other, affect each other's shelf life, are prone to cross-flavoring and / or are mixed with raw and cooked items, the first processor determines that the corresponding items are not suitable for being stored in the target space at the same time. Optionally, the second prompt message includes marking the alternative icons of the corresponding items. Optionally, the marking is in the form of circling the corresponding alternative icon with lines of the same color. Optionally, the marking is in the form of generating a virtual prompt label on one side of the corresponding alternative icon, and the virtual prompt label displays text reminders of other items that are not suitable for storage together with the corresponding item. Optionally, the virtual prompt label is in a preset color, such as yellow, to give the user a clear prompt.

[0095] The first processor also determines whether the various types of items in the target space are suitable for storage in the target space. If not, a third prompt message is issued. For example, see Fig.13 , when bananas (not suitable for refrigeration) are stored in the target space, the first processor determines that the bananas are not suitable for storage in the target space, and then issues a third prompt message. Optionally, the third prompt message includes marking the alternative icon of the corresponding item. Optionally, the marking is in the form of circling the corresponding alternative icon with a line of a preset color. Optionally, the marking is in the form of generating a virtual prompt label on one side of the corresponding alternative icon, and the virtual prompt label displays a text reminder that the corresponding item is not suitable for storage in the target space and the correct storage method. Optionally, the virtual prompt label is in a preset color, such as yellow, to give the user a clear prompt.

[0096] In this way, when the user views the alternative icons of the items, he can intuitively understand through the marks whether the items are suitable to be stored in the target space at the same time, and / or whether the items are suitable to be stored in the target space, so as to assist the user to manage the items more intelligently.

[0097] The first processor further determines the change of the freshness of the item, and issues a fourth prompt message according to the change of the freshness of the item. Optionally, the fourth prompt message includes marking a replacement icon for the corresponding item. Fig.14 Different freshness corresponds to different color marks. Optionally, the mark is in the form of a circle around the item. For example, using a red line to circle the alternative icon of the item indicates that the corresponding item has expired. For another example, using a yellow line to circle the alternative icon of the item indicates that the corresponding item is about to expire. In this way, when the user views the alternative icon of the item, the user can intuitively understand the change in the freshness of the item through the mark.

[0098] Optionally, when the mark is in the form of a circle replacing an icon, a line circle replacing an icon with a different line type is used to distinguish whether the circle mark represents the freshness of the item, the item is not suitable for being stored in the same target space, or the item is not suitable for being stored in the target storage space. For example, when the circle mark represents the freshness of the item, the circle line is a curve. When the circle mark represents that the item is not suitable for being stored in the same target space, the circle line is a wavy line. When the circle mark represents that the item is not suitable for being stored in the target space, the circle line is a dotted line. In this way, it is easy for users to distinguish.

[0099] The first processor also determines whether the packaging of the item meets the packaging requirements of the target space. If not, a fifth prompt message is issued. Optionally, the fifth prompt message includes marking an alternative icon for the corresponding item. For example, see Fig.15 When it is identified that the fruit is not suitable for bagging, the alternative icon of the fruit is marked. Optionally, the marking is in the form of generating a virtual reminder label on one side of the corresponding alternative icon, and the virtual reminder label displays a text reminder that the corresponding item is not suitable for bagging and the correct storage method. Optionally, the virtual reminder label is in a preset color, such as yellow, to give the user a clear reminder.

[0100] Combination Fig.16 As shown, the embodiment of the present disclosure provides another method for managing items, including:

[0101] S401, an image acquisition device acquires an image of a target space to obtain information about items stored in the target space.

[0102] S402: The first processor obtains a replacement icon for the item according to information about the item.

[0103] S403, displaying an alternative icon of the item on the interactive end, or displaying the information of the item while displaying the alternative icon of the item.

[0104] S404: After executing S401, the first processor sends a prompt message according to the change of the information of the item.

[0105] S405, after executing S401, the first processor determines the target environment parameters of the target space according to the information of the object.

[0106] S406, the first processor controls the target space to operate according to the target environment parameters, and displays the target environment parameters on the interactive end and / or notifies the user of the target environment parameters by voice.

[0107] After obtaining the information of the item, the target environmental parameters of the target space are determined according to the information of the item. In this way, the environmental parameters suitable for storing the item can be determined according to the name (type) and freshness of the item. Then the target space is controlled to operate according to the target environmental parameters so that the environmental parameters of the target space reach the environmental parameters suitable for storing the item. At the same time, the target environmental parameters are displayed on the interactive end, and / or the target environmental parameters are notified to the user by voice, so that the user can understand the adjustment of the environmental parameters of the target space.

[0108] Optionally, the environmental parameters of the target space include one or more parameters such as temperature, humidity, oxygen concentration, sterilization parameters, etc.

[0109] Optionally, when the target space stores multiple items, the first processor sets a priority based on the quantity, price, freshness, etc. of the items to determine the target environment parameters. For example, the target environment parameters of the target space are determined based on the type and freshness of the items with the largest number of the same type. For another example, the target environment parameters of the target space are determined based on the type and freshness of the most expensive items. The specific priority can be set by the user.

[0110] The following will be combined Fig.17 Taking the example of a refrigeration device having a touch-type interactive terminal and an image acquisition device acquiring an image in a drawer, the interaction process between the refrigeration device and the user provided by the embodiment of the present disclosure is described in detail:

[0111] S1701, the user clicks on the drawer screen displayed on the interactive end.

[0112] S1702: The interactive terminal sends a request to the first processor of the refrigeration device to view the storage status of the drawer, wherein the request includes: a real-time image of the storage status of the drawer captured by the image capture device.

[0113] S1703: The first processor of the refrigeration device obtains a replacement icon of the item according to the real-time image of the storage status in response to the viewing request.

[0114] S1704: The first processor of the refrigeration device sends a replacement icon of the item to the interaction terminal.

[0115] S1705, the replacement icons of the items are evenly distributed on the display screen of the interactive terminal, such as Figure 5 Or the position of the substitute icon of the item is consistent with the position of the item in the real-time image, and the substitute icon of the item is proportional to the real size of the item, such as Figure 18-1 and Figure 18-2 shown.

[0116] S1706, the first processor of the refrigeration equipment marks the alternative icon of the corresponding item when the position of the item changes, the item is about to expire, has expired, is not suitable for storage in the current drawer, is not suitable for storage with other items in the current drawer, is not suitable for storage in a bag, etc., and generates a virtual prompt label on one side of the alternative icon of the corresponding item.

[0117] S1707: The first processor of the refrigeration device sends the replacement icon with the mark and the virtual prompt label to the interaction end.

[0118] S1708, the user clicks on a replacement icon of an item displayed on the interactive terminal.

[0119] S1709, the interaction end sends a query request for querying information about the item to the first processor of the refrigeration device.

[0120] S1710, the first processor of the refrigeration device generates a real image of the target object, non-target objects are not displayed or are blurred, and an object display image of a virtual information tag of the target object is generated on one side of the real image of the target object.

[0121] S1711, the first processor of the refrigeration device sends an item display image to the interactive end.

[0122] S1712, the user clicks, circles or connects an alternative icon of the item on the interactive terminal.

[0123] S1713, the interaction end sends a query request for querying the recipe of the item to the first processor of the refrigeration device.

[0124] S1714, the first processor of the refrigeration device sends a recipe to the interaction end.

[0125] S1715, the first processor of the refrigeration device determines the target environmental parameters of the drawer according to information such as the type, quantity and freshness of the items.

[0126] S1716, the drawer of the refrigeration equipment operates according to the target environmental parameters.

[0127] S1717: The first processor of the refrigeration device sends the target environment parameter to the interaction end.

[0128] The following takes the example of setting an image acquisition device in a refrigeration device and the image acquisition device acquiring images in a drawer as an example to describe in detail the remote interaction process between the cloud server, the refrigeration device and the user provided by the embodiment of the present disclosure:

[0129] The user clicks on the drawer screen displayed on the interactive end.

[0130] The interactive terminal sends a request to the cloud server to view the storage status of the drawer, wherein the request includes: a real-time image of the storage status of the drawer captured by the image capture device.

[0131] In response to the viewing request, the cloud server obtains an alternative icon of the item based on the real-time image of the storage state.

[0132] The cloud server sends an alternative icon of the item to the interactive terminal;

[0133] The alternative icons of items are evenly distributed on the display screen of the interactive terminal, such as Figure 5 Or the position of the substitute icon of the item is consistent with the position of the item in the real-time image, and the substitute icon of the item is proportional to the real size of the item, such as Figure 18-1 and Figure 18-2 shown.

[0134] When the location of an item changes, the item is about to expire, has expired, is not suitable for storage in the current drawer, is not suitable for storage with other items in the current drawer, is not suitable for storage in a bag, etc., the cloud server marks the alternative icon of the corresponding item and generates a virtual prompt label on one side of the alternative icon of the corresponding item.

[0135] The first processor of the refrigeration device sends the replacement icon with the mark and the virtual prompt label to the interaction terminal.

[0136] The user clicks on an alternative icon for an item displayed on the interactive terminal.

[0137] The interactive end sends a query request to the cloud server for information related to the item.

[0138] The cloud server generates a real image of the target object, non-target objects are not displayed or blurred, and an object display image with a virtual information tag of the target object is generated on one side of the real image of the target object.

[0139] The cloud server sends the item display image to the interactive end.

[0140] Alternative icons for items that the user taps, circles, or connects to on the interactive terminal.

[0141] The interactive end sends a query request for the recipe of an item to the cloud server.

[0142] The cloud server sends the recipe to the interactive end.

[0143] The cloud server determines the target environmental parameters of the drawer based on information such as the type, quantity, and freshness of the items.

[0144] The cloud server sends the target storage environment parameters to the refrigeration equipment and the interactive end.

[0145] The drawers of the refrigeration equipment operate according to the target environmental parameters.

[0146] The following will take the image acquisition device collecting the full-space image of the refrigeration device as an example to explain in detail the interaction process between the refrigeration device and the user provided by the embodiment of the present disclosure:

[0147] The user sends a request to view the full space of the refrigeration equipment by voice or by clicking on the function displayed on the interactive terminal. The full space of the refrigeration equipment includes storage spaces such as shelf storage space, drawer storage space, and door storage space.

[0148] The interactive terminal displays a replacement image of the entire space of the refrigeration equipment, wherein the replacement image of the entire space is a non-real, virtual image.

[0149] The user clicks on a space in the alternative image of the entire space displayed on the interactive end.

[0150] The interactive end displays an enlarged alternative image of the space clicked by the user, wherein the enlarged alternative image includes alternative icons of items stored in the corresponding space, or includes alternative icons of items stored in the corresponding space and information about the stored items.

[0151] Afterwards, the interaction process between the user and the replacement icon of the object in the enlarged replacement image of the space can be referred to the examples listed above, which will not be repeated here.

[0152] In this way, users can remotely interact with the refrigerator through smart devices such as smartphones and smart appliances.

[0153] Combination Fig.19 As shown, the embodiment of the present disclosure provides a device 190 for managing items, including a second processor 191 and a memory 192. Optionally, the device 190 may also include a communication interface 193 and a bus 194. The second processor 191, the communication interface 193, and the memory 192 may communicate with each other through the bus 194. The communication interface 193 may be used for information transmission. The second processor 191 may call the logic instructions in the memory 192 to execute the method for managing items of the above embodiment.

[0154] In addition, the logic instructions in the above-mentioned memory 192 can be implemented in the form of software functional units and can be stored in a computer-readable storage medium when sold or used as an independent product.

[0155] The memory 192 is a computer-readable storage medium that can be used to store software programs and computer executable programs, such as program instructions / modules corresponding to the method in the embodiment of the present disclosure. The second processor 191 executes the program instructions / modules stored in the memory 192 to execute functional applications and data processing, that is, to implement the method for managing items in the above embodiment.

[0156] The memory 192 may include a program storage area and a data storage area, wherein the program storage area may store an operating system and an application required for at least one function; the data storage area may store data created according to the use of the terminal device, etc. In addition, the memory 192 may include a high-speed random access memory and may also include a non-volatile memory.

[0157] An embodiment of the present disclosure provides a computer-readable storage medium storing computer-executable instructions, wherein the computer-executable instructions are configured to execute the above-mentioned method for managing items.

[0158] The technical solution of the embodiment of the present disclosure can be embodied in the form of a software product, which is stored in a storage medium and includes one or more instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the method described in the embodiment of the present disclosure. The aforementioned storage medium may be a non-transient storage medium, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a disk or an optical disk, and other media that can store program codes.

[0159] The above description and the accompanying drawings fully illustrate the embodiments of the present disclosure so that those skilled in the art can practice them. Other embodiments may include structural, logical, electrical, process and other changes. The embodiments represent only possible changes. Unless explicitly required, separate components and functions are optional, and the order of operation may vary. The parts and features of some embodiments may be included in or replace the parts and features of other embodiments. Moreover, the words used in this application are only used to describe the embodiments and are not used to limit the claims. As used in the description of the embodiments and the claims, unless the context clearly indicates, the singular forms of "a", "an" and "the" are intended to include plural forms as well. Similarly, the term "and / or" as used in this application refers to any and all possible combinations of listings containing one or more associated ones. In addition, when used in the present application, the term "comprise" and its variants "comprises" and / or comprising refer to the presence of stated features, wholes, steps, operations, elements, and / or components, but do not exclude the presence or addition of one or more other features, wholes, steps, operations, elements, components and / or groups thereof. In the absence of further restrictions, the elements defined by the sentence "comprising a ..." do not exclude the presence of other identical elements in the process, method or device comprising the elements. In this article, each embodiment may focus on the differences from other embodiments, and the same and similar parts between the various embodiments may refer to each other. For the methods, products, etc. disclosed in the embodiments, if they correspond to the method part disclosed in the embodiments, then the relevant parts can refer to the description of the method part.

[0160] Those skilled in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software may depend on the specific application and design constraints of the technical solution. The technicians may use different methods for each specific application to implement the described functions, but such implementations should not be considered to exceed the scope of the embodiments of the present disclosure. The technicians may clearly understand that, for the convenience and simplicity of description, the specific working processes of the systems, devices and units described above may refer to the corresponding processes in the aforementioned method embodiments, and will not be repeated here.

[0161] In the embodiments disclosed herein, the disclosed methods and products (including but not limited to devices, equipment, etc.) can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the units can be only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the coupling or direct coupling or communication connection between each other shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms. The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the units may be selected according to actual needs to implement this embodiment. In addition, each functional unit in the embodiment of the present disclosure may be integrated in a processing unit, or each unit may exist physically alone, or two or more units may be integrated in one unit.

[0162] The flowchart and block diagram in the accompanying drawings show the possible architecture, function and operation of the system, method and computer program product according to the embodiment of the present disclosure. In this regard, each box in the flowchart or block diagram can represent a module, a program segment or a part of the code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. In some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two consecutive boxes can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, which can depend on the functions involved. In the description corresponding to the flowchart and the block diagram in the accompanying drawings, the operations or steps corresponding to different boxes can also occur in a different order from the order disclosed in the description, and sometimes there is no specific order between different operations or steps. For example, two consecutive operations or steps can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, which can depend on the functions involved. Each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, may be implemented by a dedicated hardware-based system that performs the specified functions or actions, or may be implemented by a combination of dedicated hardware and computer instructions.

Claims

1. A method for managing items, characterized in that: include: Collect images of the target space and obtain information about items stored in the target space; Get the alternative icon of the item according to the item's information; Display an alternative icon of an item on the interactive side, or display an alternative icon of an item and information about the item at the same time.

2. The method according to claim 1, characterized in that When a replacement icon of an item is displayed on the interactive end, and the item information is not displayed, the item information is displayed on the interactive end in response to a user's query command for the replacement icon.

3. The method according to claim 1, characterized in that: The alternative icons displayed on the interactive terminal are arranged according to preset rules, which include: The position of the alternative icon of the item corresponds to the actual position of the item, and the size of the alternative icon of the item is positively correlated with the actual size of the item; or, Alternative icons for items are now evenly spaced.

4. The method according to claim 2, characterized in that: In response to a user's query command for a replacement icon, information about the item is displayed on the interactive end, including: Determine a target item according to a query command of the user; the target item is an item corresponding to one or more of the alternative icons of the displayed item; Displays the target item's information on the interactive side.

5. The method according to any one of claims 1 to 4, characterized in that The information of the item includes: name, location and related information; The relevant information includes, among others: quantity and / or real image and / or freshness and / or storage date and / or shelf life and / or packaging form and / or recipe.

6. The method according to claim 5, characterized in that Send prompt information according to the changes in the item information.

7. The method according to claim 6, characterized in that Send prompt information according to the changes of item information, including: When the position of the object changes, issuing a first prompt message; and / or, If there are items in the target space that are not suitable for common storage, a second prompt message is issued; and / or, If the type of the object is not suitable for storage in the target space, a third prompt message is issued; and / or, When the freshness of the item changes, a fourth prompt message is issued; and / or, When the packaging of the article does not meet the packaging requirement of the target space, a fifth prompt message is issued.

8. The method according to any one of claims 1 to 4, characterized in that Determine target environment parameters of the target space according to the information of the object; Control the target space to operate according to the target environment parameters, and display the target environment parameters and / or notify the user of the target environment parameters by voice.

9. A refrigeration device, characterized in that: include: The box body and the box door, the box body and / or the box door are both provided with a target space for storing items; An image acquisition device, used for acquiring an image of a target space; The first processor is used to analyze the image of the target space to obtain information about the object; and obtain an alternative icon of the object according to the object information; The interactive terminal is used to display an alternative icon of an item; or in response to a user's query command, display an alternative icon of an item and display the item information at the same time.

10. The refrigeration device according to claim 9, characterized in that: The image acquisition device includes: a camera or an imaging sensor.

11. The refrigeration device according to claim 9 or 10, characterized in that: The target space is the storage space of the drawer; The image acquisition device is arranged on the inner top of the box body, the inner side of the box door, the inner side surface of the box body or the top of the drawer, so as to be able to acquire the image of the storage space of the drawer.

12. A system for managing items, characterized in that: include: The refrigeration equipment includes an image acquisition device, which acquires an image of the target space and then sends the image of the target space to a cloud server; After receiving the image of the target space, the cloud server analyzes the image of the target space to obtain information about the object; and obtains an alternative icon of the object based on the information about the object; The interactive end of the remote interactive device displays an alternative icon of the item; or in response to a user's query command, displays the information of the item while displaying the alternative icon of the item.

13. The system according to claim 12, characterized in that Remote interaction devices include: smart mobile devices, and / or smart home appliances.

Images