Method for displaying items, refrigeration device and item display system

Abstract

The present application relates to the technical field of smart home appliances. Disclosed is a method for displaying items. The method comprises: collecting an image of a visible area in a target space and a storage / retrieval operation of a user for storing / retrieving an item in / from the target space, and acquiring information of each item stored in the target space; on the basis of the image of the visible area in the target space and the information of each item stored in the target space, determining the visibility of each item in the target space; when the visibility represents that an item is occluded, reconstructing the occluded item to obtain a virtual image; and displaying, at an interaction end, a real image of a visible item and a virtual image of an occluded item, which items are stored in the target space.

Description

Method for article display, refrigeration device and article display system

[0001] The present application is based on and claims priority to Chinese Patent Application No. 202411303813.8, filed on September 18, 2024, the entire contents of which are incorporated herein by reference. TECHNICAL FIELD

[0002] The present application relates to the technical field of smart home appliances, for example to a method for article display, a refrigeration device and an article display system. BACKGROUND

[0003] At present, users tend to operate refrigeration devices more intelligently and conveniently, and often hope to be able to master the storage conditions in the refrigeration device without manually opening the door body.

[0004] The related art generally sets up a camera inside the storage space of the refrigeration device to take internal photos to monitor the storage conditions of the refrigeration device. Then, the type, quantity, position, storage time and other related information of the stored food are determined through recognition algorithms.

[0005] In the process of implementing the embodiments of the present disclosure, it is found that at least the following problems exist in the related art:

[0006] Due to the shooting angle and user usage habits, there is often a problem that the entire storage space cannot be completely photographed, i.e., there is an occlusion problem. For example, the user pulls out a drawer by a distance of half, and the other half is in the barrel, and the lower food is occluded, so the camera cannot photograph the part of the food. For another example, the food is mutually occluded (the lower food is completely occluded by the upper food). These situations will all cause information loss when displaying the food information.

[0007] It should be noted that the information disclosed in the above BACKGROUND section is only used to strengthen the understanding of the background of the present application, and therefore can include information that does not constitute prior art known to those of ordinary skill in the art. SUMMARY

[0008] To provide a simple overview of some aspects of the disclosed embodiments the following is a brief summary. The summary is not an extensive overview of all of the embodiments discussed in the present application. It is not intended to identify key / critical elements of the embodiments or to delineate the scope of the embodiments, but to present some aspects of the embodiments in a simplified form as a prelude to the more detailed description of the embodiments presented later.

[0009] The embodiments of the present disclosure provide a method for article display, a refrigeration device and an article display system to improve the integrity of the display picture.

[0010] In some embodiments, the method for displaying items includes: collecting an image of a visible area of a target space and an access action of a user accessing an item in the target space, obtaining item information stored in the target space; determining a visibility condition of the item in the target space according to the image of the visible area of the target space and the item information stored in the target space; in a case where the visibility condition represents that the item is blocked, restoring the blocked item into a virtual image; and displaying, on an interactive terminal, a real image of a visible item and the virtual image of the blocked item stored in the target space.

[0011] In some embodiments, the refrigeration device includes: a cabinet and a cabinet door, and the cabinet and / or the cabinet door is / are provided with a target space for storing items; an image collection device configured to collect an image of the target space; a processor configured to determine a visibility condition of the item in the target space according to the image of the visible part of the target space and an access action of a user accessing the item in the target space; in a case where the visibility condition represents that the item is blocked, restore the blocked item into a virtual image; and an interactive terminal configured to display, to the user, a real image of a visible item and a virtual image of a blocked item stored in the target space.

[0012] In some embodiments, the item display system includes: a refrigeration device including an image collection device configured to collect an image of a visible part of a target space and an access action of a user accessing an item in the target space, and transmit the image of the visible part and the access action to a cloud server; the cloud server is configured to determine a visibility condition of the item in the target space after receiving the image of the visible part of the target space and the access action; in a case where the visibility condition represents that the item is blocked, restore the blocked item into a virtual image; and an interactive terminal of a remote interactive device configured to display, to the user, a real image of a visible item and a virtual image of a blocked item stored in the target space.

[0013] The method for displaying items, the refrigeration device and the item display system provided by the embodiments of the present disclosure can achieve the following technical effects:

[0014] First, an image of a visible region of the target space and an access action of the user to the target space are collected, information of the articles stored in the target space is acquired, and then based on the image of the visible region and the information of the articles stored in the target space, a visibility condition of the articles in the target space is determined. If the visibility condition represents that the articles are shielded, a virtual image of the shielded articles is restored. Then, a real image of the visible articles stored in the target space and a virtual image of the shielded articles are displayed on the interactive terminal. In this way, it can be determined whether the articles in the target space are shielded, and the shielded articles are restored as virtual images when the articles are shielded. When the interactive terminal displays the picture to the user, the real image of the visible articles stored in the target space and the virtual image of the shielded articles are displayed. In this way, the user can be shown the images of all the articles stored in the target space, and the completeness of the display picture is improved. Moreover, it is convenient for the user to understand the storage condition of the articles in the target space, and the use experience of the user is improved.

[0015] The foregoing general description and the following description are only exemplary and explanatory, and are not used to limit the present application. BRIEF DESCRIPTION OF DRAWINGS

[0016] One or more embodiments are exemplarily illustrated by corresponding drawings, which are not used to limit the embodiments, elements with the same reference numerals in the drawings are shown as similar elements, the drawings do not constitute a proportional limit, and wherein:

[0017] FIG. 1 is a schematic diagram of a refrigeration device according to an embodiment of the present disclosure;

[0018] FIG. 2 is a schematic diagram of the inside of a refrigeration device according to an embodiment of the present disclosure;

[0019] FIG. 3 is a schematic diagram of an article display system according to an embodiment of the present disclosure;

[0020] FIG. 4 is a schematic diagram of a method for article display according to an embodiment of the present disclosure;

[0021] FIG. 5 is a schematic diagram of another method for article display according to an embodiment of the present disclosure;

[0022] FIG. 6 is a schematic diagram of articles being shielded after a drawer is pulled out according to an embodiment of the present disclosure;

[0023] FIG. 7 is a schematic diagram of a real image of visible articles stored in a drawer and a virtual image of shielded articles displayed on an interactive terminal according to an embodiment of the present disclosure;

[0024] FIG. 8 is a schematic diagram of a virtual storage space of a target space displayed on an interactive terminal according to an embodiment of the present disclosure;

[0025] FIG. 9 is a schematic diagram of another method for article display according to an embodiment of the present disclosure;

[0026] FIG. 10 is a schematic diagram of a method for selecting a target object by using a real image and a virtual image of a circled object according to an embodiment of the present disclosure;

[0027] FIG. 11 is a schematic diagram of a method for selecting a target object by using a real image and a virtual image of a clicked object according to an embodiment of the present disclosure;

[0028] FIG. 12 is a schematic diagram of a method for selecting a target object by using a real image and a virtual image of a connected object according to an embodiment of the present disclosure;

[0029] FIG. 13 is a schematic diagram of a query box according to an embodiment of the present disclosure;

[0030] FIG. 14 is a schematic diagram of a display of information of a target object on an interactive terminal according to an embodiment of the present disclosure;

[0031] FIG. 15 is a schematic diagram of another method for object display according to an embodiment of the present disclosure;

[0032] FIG. 16 is a schematic diagram of a display of a third prompt information on an interactive terminal according to an embodiment of the present disclosure;

[0033] FIG. 17 is a schematic diagram of a display of a fourth prompt information on an interactive terminal according to an embodiment of the present disclosure;

[0034] FIG. 18 is a schematic diagram of a display of a fifth prompt information on an interactive terminal according to an embodiment of the present disclosure;

[0035] FIG. 19 is a schematic diagram of another method for object display according to an embodiment of the present disclosure;

[0036] FIG. 20-1 is a schematic diagram of a real image of an object in a target space according to an embodiment of the present disclosure;

[0037] FIG. 20-2 is a schematic diagram of a display of a real image and a virtual image of an object on an interactive terminal according to an embodiment of the present disclosure, wherein the real image and the virtual image of the object are in the same position as the object in the target space and are in the same scale as the real size of the object;

[0038] FIG. 21 is a device for object display according to an embodiment of the present disclosure.

[0039] FIG. 21 is a device for object display according to an embodiment of the present disclosure. DETAILED DESCRIPTION

[0040] In order to enable a more detailed understanding of the features and technical content of the embodiments of the present disclosure, the implementation of the embodiments of the present disclosure is described in detail below, and the accompanying drawings are used for reference only and do not limit the embodiments of the present disclosure. In the following technical description, in order to facilitate explanation, through multiple details, a sufficient understanding of the disclosed embodiments is provided. However, one or more embodiments can still be implemented without these details. In other cases, in order to simplify the drawings, well-known structures and devices can be simplified.

[0041] Any reference in the specification to any prior art is not, and should not be taken as, an acknowledgment or any form of suggestion that this prior art forms part of the common general knowledge in the field of the application or in any other field, or that this prior art could be practiced or be considered to be common knowledge as at the priority date of this application.

[0042] The terms "first", "second", and the like in the description of the embodiments of the present disclosure and the claims and the above drawings are used to distinguish similar objects, and do not necessarily have to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged under appropriate circumstances, so that the embodiments of the present disclosure described herein can be implemented. In addition, the terms "include" and "have" and any variations thereof are intended to cover non-exclusive inclusion.

[0043] Unless otherwise specified, the term "a plurality of" means two or more.

[0044] In the embodiments of the present disclosure, the character " / " represents a "or" relationship between the objects before and after. For example, A / B represents: A or B.

[0045] The term "and / or" is a description of the association between objects, which means that there can be three relationships. For example, A and / or B, which means: A or B, or, A and B, three kinds of relationship.

[0046] The term "corresponding" can refer to an association or binding relationship, A corresponds to B means that there is an association or binding relationship between A and B.

[0047] With reference to FIGS. 1 and 2, the present disclosure provides a refrigeration appliance 10, which comprises a cabinet 11, a cabinet door 12, an image acquisition device 13, a processor, and an interactive terminal 20. The cabinet 11 is internally provided with a storage space for storing food. For example, the cabinet 11 is internally provided with one or more drawers 14, and the internal space of one drawer 14 is a storage space. For another example, the cabinet 11 is internally provided with one or more shelves 15, and the space formed between the shelves 15 and between the shelf 15 and the cabinet 11 is a storage space. The cabinet door 12 is movably arranged on the cabinet 11. The image acquisition device 13 is arranged in the cabinet 11 and is configured to acquire an image of a target space. The target space is a storage space that a user needs to monitor, which can be the internal space of one or more drawers 14, the storage space of the cabinet door 12, or the internal space of the entire refrigeration appliance 10. The user interacts with the refrigeration appliance 10 through the interactive terminal 20.

[0048] Optionally, the image acquisition device 13 comprises a camera or an imaging sensor. The camera comprises one or more of an RGB (Red-Green-Blue) camera, a spectral camera, an infrared camera, and a TOF (Time of Flight) camera.

[0049] Optionally, the target space is the storage space of the drawer 14, and the image acquisition device 13 is arranged at a position capable of acquiring an image of the storage space of the drawer 14, such as the inner top of the cabinet 11, the inner side of the cabinet door 12, the inner side of the cabinet 11, and the top of the drawer 14.

[0050] Optionally, the interactive terminal 20 comprises a display screen 21 arranged on the outer side of the cabinet door 12 of the refrigeration appliance 10 and / or a display screen arranged on the front end panel of the drawer 14. When the display screen is arranged on the outer side of the cabinet door 12, the user can interact with the display screen and view the content displayed on the display screen without opening the cabinet door 12, which is convenient and fast. When the display screen is arranged on the front end panel of the drawer 14, the storage space of the drawer 14 is the target space, and the display screen can automatically adjust the angle of inclination according to the height of the installation position to facilitate the user to view. In this way, the position of the display screen corresponds to the target space, and the user can view the corresponding target space at the interactive terminal 20, which is more targeted.

[0051] The processor is configured to receive an image of a visible region of the target space collected by the image collection device 13 and an access action of the user accessing the article in the target space, and obtain article information stored in the target space. Then, according to the image of the visible region of the target space and the article information stored in the target space, the visibility of the article in the target space is determined, that is, whether the article stored in the target space is blocked. If the visibility indicates that the article is blocked, a virtual image of the blocked article is restored. Then, the real image of the visible article and the virtual image of the blocked article are sent to the interactive terminal 20, and the interactive terminal 20 displays the real image of the visible article and the virtual image of the blocked article stored in the target space. When the interactive terminal displays the real image of the visible article and the virtual image of the blocked article, the processor is further configured to receive a query command of the user to the real image and the virtual image sent by the interactive terminal 20 or the voice device, and generate information of the article according to the query command, and then control the interactive terminal 20 to display the information of the article.

[0052] In combination with FIG. 3, the embodiment of the present disclosure provides an article display system, which comprises a refrigeration device 10 and a remote interactive device 30. Optionally, the refrigeration device 10 comprises an image collection device 13 configured to collect an image of a target space. The remote interactive device 30 comprises an interactive terminal 20. A cloud server 40 is in communication connection with the refrigeration device 10 and the interactive terminal 20. Specifically, the image collection device 13 collects an image of a visible region of the target space and an access action of the user accessing the article in the target space, and sends the image of the visible region of the target space and the access action to the cloud server 40. The cloud server 40 analyzes the image of the target space, and according to the image of the visible region of the target space and the article information stored in the target space, determines the visibility of the article in the target space, that is, whether the article stored in the target space is blocked. If the visibility indicates that the article is blocked, a virtual image of the blocked article is restored. Then, the real image of the visible article and the virtual image of the blocked article are sent to the interactive terminal 20. The interactive terminal 20 displays the real image of the visible article and the virtual image of the blocked article.

[0053] When the interactive terminal displays the real image of the visible article and the virtual image of the blocked article, the cloud server 40 is further configured to obtain information of the article in response to a query command of the user to the real image and the virtual image, and send the information of the article to the interactive terminal 20. The interactive terminal 20 displays the information of the article. Optionally, the interactive terminal 20 comprises a smart mobile device and / or a smart home appliance. The smart mobile device comprises a smart phone, a smart home device, a wearable device, a smart mobile device, a virtual reality device, or any combination thereof. In this way, the user can remotely interact with the refrigeration device 10 through the interactive terminal 20, which is more convenient.

[0054] Optionally, the user can send a query command in the form of touch, voice, etc. Touch includes single click, long press, sliding, circling, etc.

[0055] Optionally, the refrigeration device 10 is a refrigerator, a freezer or the like.

[0056] In combination with FIG. 4, the present disclosure provides a method for displaying articles, comprising:

[0057] S401, collecting an image of a visible area of a target space and an access action of a user accessing an article in the target space, and obtaining article information stored in the target space.

[0058] S402, determining a visibility condition of the article in the target space according to the image of the visible area of the target space and the article information stored in the target space.

[0059] S403, restoring the occluded article to a virtual image in a case where the visibility condition represents that the article is occluded.

[0060] S404, displaying a real image of a visible article and a virtual image of an occluded article stored in the target space on an interaction terminal.

[0061] The image of the visible area of the target space and the access action of the user accessing the article in the target space are collected by the image collection device arranged in the refrigeration device, and the article stored in the target space is obtained. The processor / cloud server determines the visibility condition of the article in the target space according to the image of the visible area of the target space and the article information stored in the target space. If the visibility condition represents that the article stored in the target space is occluded, the occluded article is restored to a virtual image. Then, the real image of the visible article and the virtual image of the occluded article are sent to the interaction terminal. The interaction terminal displays the real image of the visible article and the virtual image of the occluded article stored in the target space. The virtual image of the occluded article is a non-real, virtual image that can reflect the complete appearance of the occluded article, and the name of the article corresponding to the virtual image of the occluded article is consistent with the name of the article stored in the target space.

[0062] The method for displaying the articles provided by the embodiment of the present disclosure first collects the image of the visible region of the target space and the access action of the user accessing the articles in the target space, obtains the article information stored in the target space, and then determines the visibility of the articles in the target space based on the image of the visible region and the article information stored in the target space. If the visibility indicates that the articles are blocked, the virtual image of the blocked articles is restored. Then, the real image of the visible articles and the virtual image of the blocked articles stored in the target space are displayed on the interactive terminal. In this way, it can be determined whether the articles in the target space are blocked, and the blocked articles are restored to virtual images when the articles are blocked. When the interactive terminal displays the picture to the user, the real image of the visible articles and the virtual image of the blocked articles stored in the target space are displayed. In this way, the user can be shown the images of all the articles stored in the target space, and the completeness of the display picture is improved. Moreover, it is convenient for the user to understand the storage condition of the articles in the target space, and the user experience is improved.

[0063] Optionally, the information of the articles is displayed on the interactive terminal while the real image of the visible articles and the virtual image of the blocked articles stored in the target space are displayed. Optionally, the information of the articles includes the name, the position, and the related information. The related information includes the quantity, the real image, the freshness, the storage date, the shelf life, the packaging form, and the recipe.

[0064] Optionally, the real image and the virtual image displayed on the interactive terminal are two-dimensional (2D) images or three-dimensional (3D) images.

[0065] Optionally, in S402, the visibility of the articles in the target space is determined based on the image of the visible region of the target space and the article information stored in the target space, including:

[0066] The visible articles in the target space are determined based on the image of the visible region.

[0067] In the case that the visible articles include the stored complete articles, it is determined that all the articles in the target space are visible.

[0068] In the case that the visible articles include a part of the stored articles or do not include the stored articles, it is determined that the stored articles are blocked in the target space.

[0069] The processor / cloud server analyzes the image of the visible region to determine the visible items in the target space shown in the image of the visible region. If the visible items include all the complete stored items, it is determined that all the items in the target space are visible, i.e., no items in the target space are blocked. If the visible items include a part of the stored items, it indicates that a part of the items is blocked. Or, if the visible items do not include the stored items, it indicates that the items are completely blocked. In both cases, it can be determined that the stored items in the target space are blocked. In this way, by determining the visible items in the target space through the image of the visible region and comparing the visible items with the stored items, it can be determined whether the items in the target space are blocked.

[0070] In combination with FIG. 5, the embodiment of the present disclosure provides another method for item display, which includes:

[0071] S401, collecting an image of a visible region of a target space and an access action of a user accessing items to the target space, and obtaining item information stored in the target space.

[0072] S402, determining a visible condition of the items in the target space according to the image of the visible region of the target space and the item information stored in the target space.

[0073] S413, if the items are completely blocked, obtaining a complete virtual image of the items.

[0074] S423, if the items are partially blocked, obtaining a virtual image of the blocked part, and splicing a real image of the unblocked part and the virtual image of the blocked part into a complete image of the items.

[0075] S404, displaying a real image of the visible items stored in the target space and a virtual image of the blocked items on an interactive terminal.

[0076] The blocking of the items includes complete blocking and partial blocking. If all the items are completely blocked, a complete virtual image of the blocked items is obtained according to the type of the blocked items. For example, as shown in FIG. 6, after the drawer is pulled open, the celery stored in the drawer is completely blocked, and the tomatoes, kiwis, lettuce and grapes are visible. The display screen of the interactive terminal is shown in FIG. 7, which displays the real images of the originally visible tomatoes, kiwis, lettuce and grapes, and the complete virtual image of the blocked celery. In this way, even if the items are completely blocked, the user can also understand the complete information of the blocked items through the complete virtual image of the restored items.

[0077] If the object is partially blocked, a virtual image of the blocked part is obtained according to the type of the blocked object. Then the real image of the unblocked part and the virtual image of the blocked part are spliced into a complete object image. In this way, only the image of the blocked part is obtained, which can reduce the amount of calculation of the processor / cloud server, so that the processor / cloud server can quickly feedback, thereby improving the user experience.

[0078] Optionally, S404 displays the real image of the visible object and the virtual image of the blocked object stored in the target space on the interactive terminal, comprising:

[0079] The real image and the virtual image are arranged according to a preset rule, and the preset rule comprises:

[0080] The real image and the virtual image correspond to the actual position of the object, and the size of the virtual image is positively correlated with the real size of the object; or,

[0081] The real image and the virtual image are uniformly distributed.

[0082] The real image and the virtual image of the object are displayed on the interactive terminal according to the preset rule, so as to facilitate the user to view.

[0083] The real image and the virtual image of the object are shown in FIG. 7. The preset rule comprises: the real image and the virtual image correspond to the actual position of the object, and the size of the virtual image is positively correlated with the real size of the object. Optionally, the size of the virtual image of the object is in proportion to the real size of the object. In this way, the virtual image of the object is used to reproduce the position of the object in the target space and the relative size of the object, so as to facilitate the user to understand the storage condition of the object in the target space. Alternatively, the preset rule comprises: the real image and the virtual image are uniformly distributed. In this way, each real image and virtual image is regularly and uniformly distributed according to the display screen of the interactive terminal, which is more beautiful and convenient for the user to view.

[0084] Optionally, if the blocking object of the blocked object is a part of the refrigeration equipment, when the virtual image of the blocked object is displayed on the interactive terminal, the virtual image of the blocked object is displayed floating on the corresponding blocking object. If the blocking object of the blocked object is other objects stored in the target space, when the virtual image of the blocked object is displayed on the interactive terminal, the virtual image of the blocked object is displayed in a preset blank position. In this way, the blocked object and the blocking object are displayed separately, so that the user can clearly see the restored virtual image of the blocked object.

[0085] Optionally, referring to FIG. 8, a virtual storage space of the target space is displayed on the interactive terminal, and the real image of the corresponding visible object and the virtual image of the blocked object are displayed in each area of the virtual storage space.

[0086] Optionally, the size of the display screen of the interaction terminal corresponds to the size of the target space, and the display positions of the real image of the visible article and the virtual image of the hidden article on the display screen correspond to the actual storage positions of the visible article and the hidden article in the target space. Alternatively, the information of the article corresponding to the position of each article is displayed on the display screen, and the information of the article includes the type, position, time, and the like.

[0087] In combination with FIG. 9, the embodiment of the present disclosure provides another method for article display, which comprises the following steps:

[0088] S401, collecting the image of the visible region of the target space and the access action of the user to the target space to obtain the article information stored in the target space.

[0089] S402, determining the visibility of the article in the target space according to the image of the visible region of the target space and the article information stored in the target space.

[0090] S403, restoring the hidden article to a virtual image in the case that the visibility indicates that the article is hidden.

[0091] S404, displaying the real image of the visible article and the virtual image of the hidden article stored in the target space on the interaction terminal.

[0092] S405, displaying the information of the article on the interaction terminal in response to the query of the user to the real image and the virtual image.

[0093] When the interaction terminal displays the real image of the visible article and the virtual image of the hidden article, the processor / cloud server displays the information of the article on the interaction terminal in response to the query command of the user to the real image and the virtual image. Optionally, the user forms the query command by touching the interaction terminal, or forms the query command by sending a voice to the voice terminal. The query command includes a query object, and the query object includes the article corresponding to one or more of the real image and the virtual image displayed on the interaction terminal, which is selected by the user. The processor / cloud server sends the information of the article to the interaction terminal to enable the interaction terminal to show the information of the article to the user. In this way, the user interacts with the real image and the virtual image to query the article corresponding to one or more of the real image and the virtual image. The real image and the virtual image can show the information of all the articles stored in the target space, and thus the experience of the user interacting with the real image and the virtual image can be improved.

[0094] Optionally, the information of the article displayed on the interaction terminal in response to the query command of the user to the real image and the virtual image comprises:

[0095] According to the query command of the user, the target item is determined; the target item is the item corresponding to one or more of the displayed real image and virtual image.

[0096] The information of the target item is displayed on the interactive terminal.

[0097] The processor / cloud server analyzes the query command of the user, and then determines the target item queried by the user. The target item is the item corresponding to one or more of the real image and virtual image of the item displayed on the interactive terminal. Then, the information of the target item is displayed on the interactive terminal. As known from the foregoing, the information of the item includes the name, location and related information, and the related information includes one or more information. Therefore, on the interactive terminal, the name and location of the target item, one or more information of the related information, and the real image of the target item can be displayed. Alternatively, when the query command of the user is touch query / hand-free operation query, if the user clicks / long-presses / slides / circles / links the real image and / or virtual image, and clicks the query window, the item corresponding to the real image and / or virtual image clicked / long-pressed / slided / circled / linked by the user is determined as the target item. Alternatively, the clicking includes single click, double click and the like, which can be set by the user. When the query command of the user is voice query, the item corresponding to the voice of the user is determined as the target item.

[0098] When the user selects the target item by touch, if the target item is one kind, the user can select the target item by single clicking the real image or virtual image of the item. If the target item is multiple kinds, if the real images and / or virtual images of the items are adjacent, referring to FIG. 10, the user can enclose the real images and / or virtual images together, and then select the target item. If the real images and / or virtual images of the items are not adjacent, referring to FIG. 11, the user can click or enclose the real images and / or virtual images respectively to select the target item, or referring to FIG. 12, the user can connect the real images and virtual images by lines to select the target item.

[0099] Alternatively, after the user selects the target item by touch, the user clicks the query button displayed on the interactive terminal, and the processor / cloud server determines that the query command of the user is to query the quantity and / or real image and / or freshness and / or storage date and / or shelf life and / or packaging form of the target item.

[0100] After the user selects the target item by touch, the user clicks the recipe button displayed on the interactive terminal, and the processor / cloud server determines that the query command of the user is to query the recipe of the target item.

[0101] Optionally, referring to FIG. 13, a query box is displayed on the interactive terminal. When the user selects the real image and the virtual image corresponding to the target item, the name of the corresponding item is presented in the query box.

[0102] Optionally, the real image of the target item is displayed on the interactive terminal, including:

[0103] The real image of the target item is displayed on the interactive terminal, and the images of non-target items are not displayed or are blurred; or,

[0104] The real image of the target item is displayed on the interactive terminal, and the images of non-target items are not displayed or are blurred, and an information label of the target item is displayed on one side of the real image of the target item.

[0105] The position of the real image corresponds to the real position of the item.

[0106] When the real image of the target item is displayed on the interactive terminal, the real image of the target item is displayed, and the images of non-target items are not displayed or are blurred. For example, the interactive terminal displays the real images and the virtual images of items such as tomatoes, cucumbers, carrots, and eggs. When the user selects the target item as a carrot, the closest real image of the carrot in the target space is displayed, and the images of non-target items such as tomatoes and cucumbers are not displayed or are blurred, so that the user can quickly lock the target item and understand the real storage state of the target item. Alternatively, the real image of the target item is displayed, and the icons of non-target items are not displayed or are blurred, and an information label corresponding to the target item is displayed on one side of the real image of the target item. For example, referring to FIG. 14, when the user selects the target item as a carrot, the closest real image of the carrot in the target space is displayed, and the images of non-target items such as tomatoes and cucumbers are not displayed or are blurred, and an information label corresponding to the carrot is displayed on one side of the real image of the carrot. Optionally, when the target item is displayed on the interactive terminal, the display position of the target item on the interactive terminal corresponds to the real position of the target item in the target space, so that the user can further understand the real storage position of the target item. Optionally, the information label displays the name, quantity, freshness, storage date, shelf life, and other related information of the target item (such as a carrot), so that the user can understand the information of the target item.

[0107] Optionally, when displaying the recipe of the target item on the interactive terminal, if multiple target items are selected by the user, the recipe of cooking the multiple target items together is displayed on the interactive terminal. For example, if the user selects tomatoes and eggs as target items, the recipe of stir-fried eggs with tomatoes is displayed on the interactive terminal. If the user selects one target item, the recipe containing the target item is displayed on the interactive terminal. For example, if the user selects cucumbers as target items, the recipe of cucumber salad, stir-fried eggs with cucumbers, or stir-fried meat with cucumbers is displayed on the interactive terminal. In this way, the recipe related to the target item is recommended to the user to meet the user's needs.

[0108] In combination with FIG. 15, the embodiment of the present disclosure provides another method for displaying items, including:

[0109] S401, collecting an image of a visible area of a target space and an access action of a user accessing an item in the target space, and obtaining item information stored in the target space.

[0110] S402, determining a visibility condition of the item in the target space according to the image of the visible area of the target space and the item information stored in the target space.

[0111] S403, restoring the occluded item to a virtual image in a case where the visibility condition represents that the item is occluded.

[0112] S404, displaying a real image of a visible item and a virtual image of an occluded item stored in the target space on an interactive terminal.

[0113] S406, after S401 is performed, sending prompt information according to a change in the item information.

[0114] As described above, the item information includes a name, a location, and related information. After the processor / cloud server obtains the item information, the processor / cloud server sends prompt information to the user according to a change in the item information to remind the user to pay attention to the change in the item. Optionally, the prompt information includes voice prompt information issued by a voice device, text and / or icon prompt information displayed on a display screen, etc. Optionally, the prompt mode of the voice prompt information includes voice broadcast, sound effects, etc. Optionally, the prompt mode of the icon prompt information includes displaying a preset mark, a differentiated color, etc.

[0115] Optionally, S406, sending prompt information according to a change in the item information, includes:

[0116] in a case where the location of the item changes, issuing first prompt information; and / or,

[0117] in a case where the target space has items that are not suitable for being stored together, issuing second prompt information; and / or,

[0118] In the case that the category of the article is not suitable for storage in the target space, a third prompt information is sent; and / or,

[0119] In the case that the freshness of the article changes, a fourth prompt information is sent; and / or,

[0120] In the case that the packaging of the article does not meet the packaging requirements of the target space, a fifth prompt information is sent.

[0121] The processor / cloud server determines whether the article position of the target space changes. If the article position changes, for example, the article is moved from one drawer to another drawer, or from one shelf to another shelf, or from a drawer to a partition, a first prompt information is sent to prompt the user of the change of the position of the corresponding article, so as to avoid the user's inability to find the article.

[0122] The processor / cloud server also determines whether various categories of articles are suitable for simultaneous storage in the target space, and if not, a second prompt information is sent. Optionally, when the articles can ripen each other, affect each other's shelf life, easily mix flavors, and / or mix raw and cooked, the processor / cloud server determines the condition that the corresponding articles are not suitable for simultaneous storage in the target space. Optionally, the second prompt information includes marking the real image or virtual image of the corresponding article. Optionally, the form of marking is to enclose the corresponding real image or virtual image with a line of the same color. Optionally, the form of marking is to generate a virtual prompt label on one side of the corresponding real image or virtual image, and the virtual prompt label displays a text reminder of other articles that are not suitable for co-storage with the corresponding article. Optionally, the virtual prompt label is in a preset color, for example, yellow, to give the user a clear prompt.

[0123] The processor / cloud server also determines whether various categories of articles in the target space are suitable for storage in the target space. If not, a third prompt information is sent. For example, referring to FIG. 16, when bananas (not suitable for cold storage) are stored in the target space, the processor / cloud server determines the condition that the bananas are not suitable for storage in the target space, and then sends a third prompt information. Optionally, the third prompt information includes marking the real image or virtual image of the corresponding article. Optionally, the form of marking is to enclose the corresponding real image and / or virtual image with a line of a preset color. Optionally, the form of marking is to generate a virtual prompt label on one side of the corresponding real image and / or virtual image, and the virtual prompt label displays a text reminder of the correct storage method and the fact that the corresponding article is not suitable for storage in the target space. Optionally, the virtual prompt label is in a preset color, for example, yellow, to give the user a clear prompt.

[0124] In this way, when the user views the real image and / or the virtual image of the item, the user can intuitively know whether the item is suitable to be stored in the target space at the same time and / or whether the item is suitable to be stored in the target space through the mark, thereby assisting the user to manage the item more intelligently.

[0125] The processor / cloud server further determines a change in freshness of the item and issues a fourth prompt information according to the change in freshness of the item. Optionally, the fourth prompt information includes marking the real image or the virtual image of the corresponding item. Optionally, referring to FIG. 17, different freshness corresponds to different colors of the mark. Optionally, the form of the mark is to enclose the item. For example, the real image or the virtual image of the item is enclosed by a red line, indicating that the corresponding item has expired. For another example, the real image or the virtual image of the item is enclosed by a yellow line, indicating that the corresponding item is about to expire. In this way, when the user views the real image and / or the virtual image of the item, the user can intuitively know the change in freshness of the item through the mark.

[0126] Optionally, when the form of the mark is to enclose the real image or the virtual image, a line of different line type is used to enclose the real image or the virtual image, so as to distinguish the enclose mark representing the freshness of the item, the item being unsuitable to be stored in the same target space, or the item being unsuitable to be stored in the target storage space. For example, when the enclose mark represents the freshness of the item, the enclose line is a curve. When the enclose mark represents that the item is unsuitable to be stored in the same target space, the enclose line is a wavy line. When the enclose mark represents that the item is unsuitable to be stored in the target space, the enclose line is a dotted line. In this way, the user can distinguish.

[0127] The processor / cloud server further determines whether the packaging of the item meets the packaging requirement of the target space. If not, a fifth prompt information is issued. Optionally, the fifth prompt information includes marking the real image or the virtual image of the corresponding item. For example, referring to FIG. 18, when it is identified that the fruit is unsuitable to be stored in a bag, the real image and / or the virtual image of the fruit is marked. Optionally, the form of the mark is to generate a virtual prompt label on one side of the corresponding real image or virtual image, and the virtual prompt label displays a text prompt of the item being unsuitable to be stored in a bag and a correct storage method. Optionally, the virtual prompt label is in a preset color, for example, in yellow, to give a clear prompt to the user.

[0128] In combination with FIG. 19, the embodiment of the present disclosure provides another method for displaying items, including:

[0129] S401, acquiring an image of a visible area of a target space and an access action of a user accessing an item to the target space, and obtaining item information stored in the target space.

[0130] S402, determining a visible condition of the article in the target space according to the image of the visible region of the target space and the information of the article stored in the target space.

[0131] S403, in the case that the visible condition indicates that the article is blocked, restoring the blocked article as a virtual image.

[0132] S404, displaying the real image of the visible article and the virtual image of the blocked article stored in the target space on the interactive terminal.

[0133] S406, after S401 is performed, sending a prompt information according to the change of the information of the article.

[0134] S407, after S401 is performed, determining a target environment parameter of the target space according to the information of the article.

[0135] S408, controlling the target space to operate according to the target environment parameter, and displaying the target environment parameter on the interactive terminal and / or informing the user of the target environment parameter through voice.

[0136] After the information of the article is obtained, the target environment parameter of the target space is determined according to the information of the article. In this way, the environment parameter suitable for storing the article can be determined according to the name (category) and freshness of the article. Then the target space is controlled to operate according to the target environment parameter, so that the environment parameter of the target space reaches the environment parameter suitable for storing the article. At the same time, the target environment parameter is displayed on the interactive terminal, and / or the user is informed of the target environment parameter through voice, so as to facilitate the user to understand the adjustment of the environment parameter of the target space.

[0137] Optionally, the environment parameter of the target space includes one or more of temperature, humidity, oxygen concentration, sterilization parameter, etc.

[0138] Optionally, when the target space stores multiple articles, the processor / cloud server sets a priority according to the quantity, price, freshness, etc. of the articles to determine the target environment parameter. For example, the category and freshness of the article with the largest quantity of the same category are preferred to determine the target environment parameter of the target space. For another example, the category and freshness of the article with the highest price are preferred to determine the target environment parameter of the target space. The specific priority can be set by the user.

[0139] The following takes a refrigeration device with a touch interactive terminal and an image acquisition device to collect images in a drawer as an example to illustrate in detail the interaction process between the refrigeration device and the user provided by the embodiment of the present disclosure.

[0140] The user clicks the picture of the drawer displayed on the interactive terminal.

[0141] The interaction terminal sends a viewing request for viewing the storage state of the drawer to the processor of the refrigeration device. The viewing request includes an image of a visible area of the drawer captured by the image capturing device and a storage action of the user storing the item into the target space.

[0142] The processor of the refrigeration device obtains item information stored in the target space in response to the viewing request, and determines a visibility of the item in the target space according to the image of the visible area of the target space and the item information stored in the target space. In a case where the visibility indicates that the item is blocked, the blocked item is restored as a virtual image.

[0143] The processor of the refrigeration device sends the real image of the visible item and the virtual image of the blocked item to the interaction terminal.

[0144] The real image and the virtual image of the item are uniformly distributed on a display screen of the interaction terminal, as shown in FIG. 7. Alternatively, the real image and the virtual image of the item are located at positions consistent with the real positions of the item, and the real image and the virtual image of the item are in a ratio equal to the real size of the item, as shown in FIGS. 20-1 and 20-2.

[0145] The processor of the refrigeration device marks the real image or the virtual image of the corresponding item in a case where the position of the item changes, the item is about to expire, the item has expired, the item is not suitable for being stored in the current drawer, the item is not suitable for being stored in the current drawer together with other items, the item is not suitable for being stored in a bag, and the like, and generates a virtual prompt label on a side of the real image or the virtual image of the corresponding item.

[0146] The processor of the refrigeration device sends the real image or the virtual image with the mark and the virtual prompt label to the interaction terminal.

[0147] The user clicks the real image or the virtual image of a certain item displayed on the interaction terminal.

[0148] The interaction terminal sends a query request for querying information of the item to the processor of the refrigeration device.

[0149] The processor of the refrigeration device generates an item display image in which a real image of a target item is displayed, non-target items are not displayed or are blurred, and a virtual information label of the target item is generated on a side of the real image of the target item.

[0150] The processor of the refrigeration device sends the item display image to the interaction terminal.

[0151] The user clicks, encircles or connects the real image and / or the virtual image of the item on the interaction terminal.

[0152] The interaction terminal sends a query request for querying a recipe of the item to the processor of the refrigeration device.

[0153] The processor of the refrigeration device sends a recipe to the interactive terminal.

[0154] The processor of the refrigeration device determines the target environment parameter of the drawer according to the information such as the category, quantity and freshness of the items.

[0155] The drawer of the refrigeration device operates according to the target environment parameter.

[0156] The processor of the refrigeration device sends the target environment parameter to the interactive terminal.

[0157] The following takes the refrigeration device provided with an image acquisition device and the image acquisition device acquiring the image in the drawer as an example to illustrate the remote interaction process between the cloud server, the refrigeration device and the user provided by the embodiments of the present disclosure in detail:

[0158] The user clicks the picture of the drawer displayed on the interactive terminal.

[0159] The interactive terminal sends a viewing request for viewing the storage state of the drawer to the cloud server. The viewing request includes the image of the visible area of the drawer acquired by the image acquisition device and the storage action of the user to the target space.

[0160] The cloud server acquires the item information stored in the target space in response to the viewing request, and determines the visibility of the items in the target space according to the image of the visible area of the target space and the item information stored in the target space; and in the case that the visibility represents that the items are blocked, restores the blocked items to virtual images.

[0161] The cloud server sends the real images of the visible items and the virtual images of the blocked items to the interactive terminal.

[0162] The real images and the virtual images of the items are uniformly distributed on the display picture of the interactive terminal, as shown in FIG. 7. Or the positions of the real images and the virtual images of the items are consistent with the real positions of the items, and the real images and the virtual images of the items are in proportion to the real sizes of the items, as shown in FIGS. 20-1 and 20-2.

[0163] When the positions of the items change, the items are about to expire, have expired, are not suitable to be stored in the current drawer, are not suitable to be stored in the current drawer together with other items, are not suitable to be stored in a bag, etc., the cloud server marks the real images or the virtual images of the corresponding items, and generates a virtual prompt label on one side of the real images or the virtual images of the corresponding items.

[0164] The processor of the refrigeration device sends the real images or the virtual images with the marks and the virtual prompt labels to the interactive terminal.

[0165] The user clicks the real image or the virtual image of a certain item displayed on the interactive terminal.

[0166] The interaction terminal sends a query request for the related information of the item to the cloud server.

[0167] The cloud server generates an item display image in which a real image of the target item is displayed, non-target items are not displayed or are blurred, and a virtual information label of the target item is generated on one side of the real image of the target item.

[0168] The cloud server sends the item display image to the interaction terminal.

[0169] The user clicks, encircles, or connects the real image and / or virtual image of the item on the interaction terminal.

[0170] The interaction terminal sends a query request for the recipe of the item to the cloud server.

[0171] The cloud server sends the recipe to the interaction terminal.

[0172] The cloud server determines the target environmental parameters of the drawer according to the information such as the type, quantity, and freshness of the item.

[0173] The cloud server sends the target storage environmental parameters to the refrigeration equipment and the interaction terminal.

[0174] The drawer of the refrigeration equipment operates according to the target environmental parameters.

[0175] The following will take the image acquisition device collecting the image of the full space of the refrigeration equipment as an example to explain in detail the interaction process between the refrigeration equipment and the user provided by the embodiments of the present disclosure:

[0176] The user sends a viewing request for viewing the full space of the refrigeration equipment through voice or clicking the function displayed on the interaction terminal. The full space of the refrigeration equipment includes storage spaces such as the shelf storage space, the drawer storage space, and the box door storage space.

[0177] The interaction terminal displays a substitute image of the full space of the refrigeration equipment. The substitute image of the full space is a non-real and virtual image.

[0178] The user clicks a certain space in the substitute image of the full space displayed on the interaction terminal.

[0179] The interaction terminal displays an enlarged substitute image of the space clicked by the user. The enlarged substitute image includes the real image of the visible item and the virtual image of the obscured item in the corresponding space, or includes the real image of the visible item and the virtual image of the obscured item, as well as the information of the stored item.

[0180] After that, the interaction process between the user and the real image and virtual image of the item in the enlarged substitute image of the space can refer to the examples listed in the foregoing, which will not be repeated here.

[0181] In this way, the user can realize remote interaction with the refrigerator through a smart device such as a smart phone or a smart home appliance.

[0182] With reference to FIG. 21, the embodiment of the present disclosure provides a device 210 for displaying an article, which includes a processor 211 and a memory 212. Optionally, the device 210 can further include a communication interface 213 and a bus 214. The processor 211, the communication interface 213, and the memory 212 can communicate with each other through the bus 214. The communication interface 213 can be used for information transmission. The processor 211 can invoke the logical instructions in the memory 212 to execute the method for displaying an article in the above embodiment.

[0183] In addition, the logical instructions in the memory 212 described above can be implemented in the form of a software functional unit and sold or used as an independent product, which can be stored in a computer-readable storage medium.

[0184] The memory 212, as a computer-readable storage medium, can be used to store software programs, computer-executable programs, such as program instructions / modules corresponding to the method in the embodiment of the present disclosure. The processor 211 executes the function application and data processing by running the program instructions / modules stored in the memory 212, that is, implements the method for displaying an article in the above embodiment.

[0185] The memory 212 can include a program storage area and a data storage area. The program storage area can store an operating system and at least one application required by a function; the data storage area can store data created during use of the terminal device, etc. In addition, the memory 212 can include a high-speed random access memory, and can also include a non-volatile memory.

[0186] The embodiment of the present disclosure provides a computer-readable storage medium, which stores computer-executable instructions, and the computer-executable instructions are configured to execute the above method for displaying an article.

[0187] The embodiment of the present disclosure provides a computer-readable non-transitory storage medium, which stores program instructions, and the program instructions execute the following steps when running:

[0188] Collect an image of a visible area of a target space and an access action of a user accessing an article in the target space, and obtain article information stored in the target space;

[0189] According to the image of the visible region of the target space and the information of the article stored in the target space, the visibility of the article in the target space is determined;

[0190] In the case that the visibility represents that the article is blocked, the blocked article is restored as a virtual image;

[0191] The real image of the visible article and the virtual image of the blocked article stored in the target space are displayed on the interactive terminal.

[0192] The embodiment of the present disclosure provides a computer program, when the computer program is executed by a computer, the computer program enables the computer to implement the above-mentioned method for article display.

[0193] The embodiment of the present disclosure provides a computer program product, the computer program product comprises computer instructions stored on a computer readable storage medium, when the program instructions are executed by a computer, the computer instructions enable the computer to implement the above-mentioned method for article display.

[0194] The technical solution of the embodiment of the present disclosure can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes one or more instructions to enable a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the method described in the embodiment of the present disclosure. The aforementioned storage medium can be a non-transitory storage medium, such as a U disk, a mobile hard disk, a read-only memory (ROM, Read-Only Memory), a random access memory (RAM, Random Access Memory), a magnetic disk or an optical disk, and various media that can store program codes.

[0195] The foregoing description and accompanying drawings fully illustrate embodiments of this disclosure to enable those skilled in the art to practice them. Other embodiments may include structural, logical, electrical, procedural, and other changes. The embodiments represent only possible variations. Individual components and functions are optional unless explicitly required, and the order of operation may vary. Parts and features of some embodiments may be included in or replace parts and features of other embodiments. Moreover, the terminology used in this application is for describing embodiments only and is not intended to limit the claims. As used in the description of embodiments and claims, the singular forms “a,” “an,” and “the” are intended to equally include the plural forms unless the context clearly indicates otherwise. Similarly, the term “and / or” as used in this application means including one or more of the associated listed items and all possible combinations thereof. Additionally, when used in this application, the term "comprise" and its variations "comprises" and / or "comprising" refer to the presence of stated features, integrals, steps, operations, elements, and / or components, but do not exclude the presence or addition of one or more other features, integrals, steps, operations, elements, components, and / or groups thereof. Without further limitations, an element defined by the phrase "comprises a..." does not exclude the presence of other identical elements in the process, method, or apparatus that includes said element. In this document, each embodiment may focus on the differences from other embodiments, and similar or identical parts between embodiments can be referred to mutually. For methods, products, etc., disclosed in the embodiments, if they correspond to the method section disclosed in the embodiments, the relevant parts can be referred to the description of the method section.

[0196] Those skilled in the art will recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of the embodiments of this disclosure. Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the specific working processes of the systems, devices, and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here.

[0197] In the embodiments disclosed herein, the disclosed methods, products (including but not limited to apparatuses, devices, etc.), can be implemented in other manners. For example, the described apparatus embodiments can be implemented only in a form of a logical function, and can be implemented by using a manner such as software (for example, application program) or the like. In some embodiments, a plurality of units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the displayed or discussed coupling or direct coupling or indirect coupling between different units, or the coupling or direct coupling or indirect coupling between the displayed or discussed communication connections can be in a form of electrical, mechanical or other forms.

[0198] The flowcharts and block diagrams in the drawings show the possible implementation architectures, functions and operations of the system, method and computer program product according to the embodiments of the present disclosure. In this regard, each block in the flowcharts or block diagrams can represent a module, a program segment or a part of code containing one or more executable instructions for implementing a specified logical function. In some alternative implementations, the functions noted in the blocks can occur in an order different from that noted in the drawings. For example, two consecutive blocks can actually be executed substantially in parallel, and sometimes they can be executed in reverse order, depending on the functions involved. In the descriptions corresponding to the flowcharts and block diagrams in the drawings, the operations or steps corresponding to different blocks can also occur in an order different from that disclosed in the descriptions, and sometimes there is no specific order between different operations or steps. For example, two consecutive operations or steps can actually be executed substantially in parallel, and sometimes they can be executed in reverse order, depending on the functions involved. Each block in the block diagrams and / or flowcharts, and the combination of blocks in the block diagrams and / or flowcharts, can be implemented by a dedicated hardware-based system that performs the specified functions or actions, or can be implemented by a combination of dedicated hardware and computer instructions.

Claims

1. A method for displaying items, comprising: collecting images of a visible area of a target space and access actions of a user accessing items in the target space, and obtaining information of items stored in the target space; determining a visibility condition of the items in the target space according to the images of the visible area of the target space and the information of the items stored in the target space; in a case where the visibility condition indicates that the items are blocked, restoring the blocked items into virtual images; displaying real images of visible items and virtual images of blocked items stored in the target space on an interactive terminal.

2. The method of claim 1, wherein, in a case where the visibility condition indicates that the items are blocked, restoring the blocked items into virtual images, comprising: if the items are completely blocked, obtaining a complete virtual image of the items; if the items are partially blocked, obtaining a virtual image of the blocked part, and splicing a real image of the unblocked part and the virtual image of the blocked part into a complete image of the items.

3. The method of claim 1 or 2, wherein, displaying real images of visible items and virtual images of blocked items stored in the target space on an interactive terminal, comprising: the real images and the virtual images are arranged according to a preset rule, the preset rule comprising: the real images and the virtual images correspond to actual positions of the items, and a size of the virtual images is positively correlated with a real size of the items; or the real images and the virtual images are uniformly distributed. 4.The method according to any one of claims 1 to 3, further comprising, in response to a query of the user on the real images and the virtual images, displaying information of the items on the interactive terminal.

5. The method of claim 4, wherein, the information of the items comprises: a name, a position, and related information; the related information comprises: a quantity and / or a real image and / or freshness and / or a storage date and / or a shelf life and / or a packaging form and / or a recipe.

6. The method of claim 5, further comprising: sending a prompt message according to a change in the information of the items.

7. The method of claim 6, wherein, sending a prompt message according to a change in the information of the items, comprising: in a case where the position of the items changes, sending a first prompt message; and / or in a case where the items in the target space are not suitable for being stored together, sending a second prompt message; and / or in a case where a type of the items is not suitable for being stored in the target space, sending a third prompt message; and / or in a case where the freshness of the items changes, sending a fourth prompt message; and / or in a case where a packaging of the items does not meet a packaging requirement of the target space, sending a fifth prompt message. 8.The method according to any one of claims 1 to 7, further comprising: determining a target environmental parameter of the target space according to the information of the items; controlling the target space to operate according to the target environmental parameter, and displaying the target environmental parameter and / or informing the user of the target environmental parameter through voice. 9.An apparatus for displaying items, comprising a processor and a memory, the processor executing a method for displaying items according to any one of claims 1 to 8 stored in the memory. 10.A computer-readable non-transitory storage medium storing program instructions, the program instructions, when executed, performing the following steps: collecting images of a visible area of a target space and access actions of a user accessing items in the target space, and obtaining information of items stored in the target space; determine a visibility condition of the items in the target space according to the image of the visible part of the target space and the information of the items stored in the target space; restore the hidden items as virtual images in a case that the visibility condition represents that the items are hidden; display the real images of the visible items and the virtual images of the hidden items in the target space to the user via the interactive terminal. 11.A computer program, when executed by a computer, causing the computer to implement the method for displaying items according to any one of claims 1 to 8. 12.A computer program product, comprising computer instructions stored on a computer readable storage medium, when executed by a computer, causing the computer to implement the method for displaying items according to any one of claims 1 to 8. 13.A refrigeration device, comprising: a cabinet and a cabinet door, and a target space for storing items is arranged in the cabinet and / or the cabinet door; an image acquisition device configured to acquire an image of the target space; a processor configured to determine a visibility condition of the items in the target space according to the image of the visible part of the target space and the access action of the user to the target space, and restore the hidden items as virtual images in a case that the visibility condition represents that the items are hidden; an interactive terminal configured to display the real images of the visible items and the virtual images of the hidden items in the target space to the user.

14. The refrigeration appliance of claim 13, wherein, The image acquisition device comprises a camera or an imaging sensor. 15.The refrigeration device of claim 13 or 14, wherein, the target space is a storage space of a drawer or all storage spaces of the refrigeration device; the image acquisition device is arranged at an inner top of the cabinet, an inner side of the cabinet door, an inner side of the cabinet, or a top of the drawer, so as to acquire the image of the storage space of the drawer. 16.An item display system, comprising: a refrigeration device comprising an image acquisition device configured to acquire an image of a visible part of a target space and an access action of a user to the target space, and transmit the image of the visible part and the access action to a cloud server; the cloud server configured to determine a visibility condition of the items in the target space according to the image of the visible part of the target space and the access action, and restore the hidden items as virtual images in a case that the visibility condition represents that the items are hidden; a remote interactive device, and an interactive terminal of the remote interactive device is configured to display the real images of the visible items and the virtual images of the hidden items in the target space to the user. 17.The item display system of claim 16, wherein, the remote interactive device comprises a smart mobile device and / or a smart home appliance.

Images