Article display method, refrigeration equipment and article display system

Abstract

The invention relates to the technical field of intelligent household electrical appliances, and discloses an article display method, which comprises the following steps: acquiring an image of a visible area of a target space and an access action of a user for accessing an article to the target space, and acquiring information of the article stored in the target space; according to the image of the visual area of the target space and the information of the articles stored in the target space, determining the visual condition of the articles in the target space; under the condition that the visual condition represents that the article is shielded, restoring the shielded article into a virtual image; and displaying the real image of the visible article stored in the target space and the virtual image of the shielded article at the interaction end. In this way, the images of all articles stored in the target space can be displayed to the user, and the integrity of the display picture is improved. And moreover, the user can conveniently know the object storage condition in the target space, and the use experience of the user is improved. The invention further discloses refrigeration equipment and an article display system.

Description

Technical Field

[0001] The present application relates to the technical field of smart home appliances, for example, to a method for object display, a refrigeration device and an object display system. Background Art

[0002] At present, users' operation of refrigeration equipment is becoming more and more intelligent and convenient. Users often hope to know the storage situation in the refrigeration equipment without manually opening the door.

[0003] Related technologies usually install cameras inside the storage space of the refrigeration equipment to take internal photos to monitor the storage conditions of the refrigeration equipment, and then use recognition algorithms to determine the type, quantity, location, storage time and other related information of the stored food.

[0004] In the process of implementing the embodiments of the present disclosure, it is found that there are at least the following problems in the related art:

[0005] Due to shooting angles and user habits, the entire storage space is often not fully captured, that is, there is an occlusion problem. For example, when the user pulls out half of the drawer, the other half is still in the bucket, and the food below is blocked, so the camera cannot capture this part of the food; or when the food blocks each other (the food below is completely blocked by the food above). These situations will lead to incomplete information when displaying food information.

[0006] It should be noted that the information disclosed in the above background technology section is only used to enhance the understanding of the background of the present application, and therefore may include information that does not constitute the prior art known to ordinary technicians in the field. Summary of the invention

[0007] In order to provide a basic understanding of some aspects of the disclosed embodiments, a brief summary is given below. The summary is not an extensive review, nor is it intended to identify key / critical components or delineate the scope of protection of these embodiments, but rather serves as a prelude to the detailed description that follows.

[0008] The embodiments of the present disclosure provide a method for object display, a refrigeration device, and an object display system to improve the integrity of a display image.

[0009] In some embodiments, the method for displaying objects includes: collecting images of a visible area of ​​a target space and a user's access actions to and from the target space to obtain information about objects stored in the target space; determining the visibility of objects in the target space based on the images of the visible area of ​​the target space and the information about objects stored in the target space; restoring the obscured objects to virtual images when the visibility indicates that the objects are obscured; and displaying real images of visible objects stored in the target space and virtual images of obscured objects on an interactive end.

[0010] In some embodiments, the refrigeration equipment includes: a box body and a door, and a target space for storing items is provided in the box body and / or the door; an image acquisition device, used to acquire an image of the target space; a processor, used to determine the visibility of items in the target space based on the image of the visible part of the target space and the user's access action of accessing items to the target space; when the visibility indicates that the items are obscured, restoring the obscured items to virtual images; an interactive end, used to display to the user the real images of the visible items stored in the target space and the virtual images of the obscured items.

[0011] In some embodiments, the object display system includes: a refrigeration device, including an image acquisition device, which acquires an image of a visible portion of a target space and a user's access action to the target space, and then sends the image of the visible portion and the access action to a cloud server; after the cloud server receives the image of the visible portion of the target space and the access action, it determines the visibility of the objects in the target space; when the visibility indicates that the objects are obscured, the obscured objects are restored to virtual images; and the interactive end of the remote interactive device displays to the user the real images of the visible objects stored in the target space and the virtual images of the obscured objects.

[0012] The method for displaying items, the refrigeration equipment, and the item display system provided by the embodiments of the present disclosure can achieve the following technical effects:

[0013] First, the image of the visible area of ​​the target space and the access actions of the user to the target space are collected to obtain the information of the items stored in the target space. Then, based on the image of the visible area and the information of the items stored in the target space, the visual situation of the items in the target space is determined. If the visual situation indicates that the item is blocked, the virtual image of the blocked item is restored. Then, the real image of the visible item stored in the target space and the virtual image of the blocked item are displayed on the interactive end. In this way, it can be judged whether there are items blocked in the target space, and the blocked items are restored to virtual images when the items are blocked. When the interactive end displays the picture to the user, the real image of the visible item stored in the target space and the virtual image of the blocked item are displayed. In this way, the images of all items stored in the target space can be displayed to the user, which improves the integrity of the displayed picture. Moreover, it is also convenient for the user to understand the storage situation of the items in the target space, which improves the user's experience.

[0014] The above general description and the following description are exemplary and explanatory only and are not intended to limit the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] One or more embodiments are exemplarily described by corresponding drawings, which do not limit the embodiments. Elements with the same reference numerals in the drawings are shown as similar elements, and the drawings do not constitute a scale limitation, and wherein:

[0016] Figure 1 is a schematic diagram of a refrigeration device provided by an embodiment of the present disclosure;

[0017] Figure 2 is a schematic diagram of the interior of a refrigeration device provided by an embodiment of the present disclosure;

[0018] Figure 3 is a flow chart of a system for item display provided by an embodiment of the present disclosure;

[0019] Figure 4 is a schematic diagram of a method for displaying items provided by an embodiment of the present disclosure;

[0020] Figure 5 is a schematic diagram of another method for displaying items provided by an embodiment of the present disclosure;

[0021] Figure 6 is a schematic diagram of an object being blocked after a drawer is opened provided by an embodiment of the present disclosure;

[0022] Figure 7 The embodiment of the present disclosure provides a method for displaying real images of visible objects stored in a drawer and virtual images of obscured objects on an interactive end;

[0023] Figure 8is a schematic diagram of a virtual storage space of a target space displayed on an interactive terminal provided by an embodiment of the present disclosure;

[0024] Fig. 9 is a schematic diagram of another method for displaying items provided by an embodiment of the present disclosure;

[0025] Fig.10 is a schematic diagram of selecting a target object by using a real image and a virtual image of the enclosed object provided by an embodiment of the present disclosure;

[0026] Fig.11 is a schematic diagram of selecting a target object by respectively clicking on or respectively encircling a real image and a virtual image of the object provided by an embodiment of the present disclosure;

[0027] Fig.12 is a schematic diagram of selecting a target object by connecting a real image and a virtual image of an object provided by an embodiment of the present disclosure;

[0028] Fig.13 is a schematic diagram of a query box provided by an embodiment of the present disclosure;

[0029] Fig.14 is a schematic diagram of displaying information of a target object on an interactive terminal provided by an embodiment of the present disclosure;

[0030] Fig.15 is a schematic diagram of another method for displaying items provided by an embodiment of the present disclosure;

[0031] Fig.16 is a schematic diagram of an interactive terminal displaying third prompt information provided by an embodiment of the present disclosure;

[0032] Fig.17 is a schematic diagram of an interactive terminal displaying fourth prompt information provided by an embodiment of the present disclosure;

[0033] Fig.18 is a schematic diagram of an interactive terminal displaying fifth prompt information provided by an embodiment of the present disclosure;

[0034] Fig.19 is a schematic diagram of another method for managing items provided by an embodiment of the present disclosure;

[0035] Figure 20-1 is a schematic diagram of a real image of an object in a target space provided by an embodiment of the present disclosure;

[0036] Figure 20-2 It is a schematic diagram provided by an embodiment of the present disclosure that the positions of the real image and the virtual image of the object displayed on the interactive terminal are consistent with the position of the object in the target space, and the real image and the virtual image of the object are in proportion to the real size of the object;

[0037] Fig.21 It is a device for displaying items provided by an embodiment of the present disclosure.

[0038] Reference numerals:

[0039] 10. Refrigeration equipment; 11. Box body; 12. Box door; 13. Image acquisition device; 14. Drawer; 15. Shelf; 20. Interactive terminal; 21. Display screen; 30. Remote interactive device; 40. Cloud server;

[0040] 210. Device for managing items; 211. Processor; 212. Memory; 213. Communication interface; 214. Bus. DETAILED DESCRIPTION

[0041] In order to be able to understand the features and technical contents of the embodiments of the present disclosure in more detail, the implementation of the embodiments of the present disclosure is described in detail below in conjunction with the accompanying drawings. The attached drawings are for reference only and are not used to limit the embodiments of the present disclosure. In the following technical description, for the convenience of explanation, a full understanding of the disclosed embodiments is provided through multiple details. However, one or more embodiments can still be implemented without these details. In other cases, to simplify the drawings, well-known structures and devices can be simplified for display.

[0042] The terms "first", "second", etc. in the specification and claims of the embodiments of the present disclosure and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the terms used in this way can be interchanged where appropriate, so that the embodiments of the embodiments of the present disclosure described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions.

[0043] Unless otherwise stated, the term "plurality" means two or more.

[0044] In the embodiment of the present disclosure, the character " / " indicates that the preceding and following objects are in an "or" relationship. For example, A / B indicates: A or B.

[0045] The term "and / or" is a description of the association relationship between objects, indicating that three relationships can exist. For example, A and / or B means: A or B, or, A and B.

[0046] The term "correspondence" may refer to an association relationship or a binding relationship. The correspondence between A and B means that there is an association relationship or a binding relationship between A and B.

[0047] Combination Figure 1 and Figure 2As shown, an embodiment of the present disclosure provides a refrigeration device 10, including: a box body 11, a door 12, an image acquisition device 13, a processor and an interactive terminal 20. A storage space for storing food is provided inside the box body 11. For example, one or more drawers 14 are provided inside the box body 11, and the internal space of a drawer 14 is a storage space. For another example, one or more shelves 15 are provided inside the box body 11, and the space formed between the multiple shelves 15 and between the shelves 15 and the box body 11 is a storage space. The door 12 is openably provided in the box body 11. The image acquisition device 13 is provided in the box body 11, and is used to capture images of the target space. The target space is a storage space that the user needs to monitor, and can be the internal space of one or more drawers 14, the storage space of the door 12, or the internal space of the refrigeration device 10 as a whole. The user interacts with the refrigeration device 10 through the interactive terminal 20.

[0048] Optionally, the image acquisition device 13 includes: a camera or an imaging sensor. The camera includes: one or more of an RGB (Red-Green-Blue) camera, a spectral camera, an infrared camera, and a TOF (Time of Flight) camera.

[0049] Optionally, the target space is the storage space of the drawer 14, and the image acquisition device 13 is set at the inner top of the box body 11, the inner side of the door 12, the inner side of the box body 11, the top of the drawer 14, etc., where the storage space image of the drawer 14 can be acquired.

[0050] Optionally, the interactive terminal 20 includes: a display screen 21 arranged on the outside of the door 12 of the refrigeration device 10, and / or a display screen arranged on the front panel of the drawer 14. When the display screen is arranged on the outside of the door 12, the user can interact with the display screen and view the content displayed on the display screen without opening the door 12, which is convenient and quick. When the display screen is arranged on the front panel of the drawer 14, the storage space of the drawer 14 is the target space, and the display screen can automatically adjust the tilt angle according to the height of the installation position to facilitate user viewing. In this way, the position of the display screen corresponds to the target space, and the user can view the corresponding target space on the interactive terminal 20, which is more targeted.

[0051] The processor is used to receive the image of the visible area of ​​the target space collected by the image acquisition device 13 and the access action of the user to access the target space, and obtain the information of the items stored in the target space. Then, according to the image of the visible area of ​​the target space and the information of the items stored in the target space, the visual situation of the items in the target space is determined, that is, whether the items stored in the target space are blocked. If the visual situation indicates that the item is blocked, the virtual image of the blocked item is restored. Then the real image of the visible item and the virtual image of the blocked item are sent to the interactive terminal 20, and the interactive terminal 20 displays the real image of the visible item stored in the target space and the virtual image of the blocked item. When the interactive terminal displays the real image of the visible item and the virtual image of the blocked item, the processor is also used to receive the user's query command for the real image and the virtual image sent by the interactive terminal 20 or the voice device, and generate the information of the item according to the query command, and then control the interactive terminal 20 to display the information of the item.

[0052] Combination Figure 3 As shown, the embodiment of the present disclosure provides a system for managing items, including: a refrigeration device 10 and a remote interaction device 30. Optionally, the refrigeration device 10 includes: an image acquisition device 13, and the image acquisition device 13 is used to acquire an image of the target space. The remote interaction device 30 includes: an interaction terminal 20. The cloud server 40 is connected to the refrigeration device 10 and the interaction terminal 20 for communication. Specifically, the image acquisition device 13 acquires an image of the visible area of ​​the target space and an access action of a user to access items to the target space, and sends the image of the visible area of ​​the target space and the access action to the cloud server 40. The cloud server 40 analyzes the image of the target space, and determines the visibility of the items in the target space according to the image of the visible area of ​​the target space and the information of the items stored in the target space, that is, determines whether the items stored in the target space are blocked. If the visibility indicates that the item is blocked, the virtual image of the blocked item is restored. Then the real image of the visible item and the virtual image of the blocked item are sent to the interaction terminal 20. The interactive terminal 20 displays the real image of the visible object and the virtual image of the obscured object.

[0053] When the interactive terminal displays the real image of the visible object and the virtual image of the obscured object, the cloud server 40 is also used to respond to the user's query command for the real image and the virtual image, obtain the information of the object, and send the information of the object to the interactive terminal 20. The interactive terminal 20 displays the information of the object. Optionally, the interactive terminal 20 includes: a smart mobile device, and / or a smart home appliance. The smart mobile device includes: a smart phone, a smart home device, a wearable device, a smart mobile device, a virtual reality device, etc., or any combination thereof. In this way, the user can remotely interact with the refrigeration device 10 through the interactive terminal 20, which is more convenient.

[0054] Optionally, the user can send the query command by touch, voice, etc. Touch includes: single click, long press, slide, circle, etc.

[0055] Optionally, the refrigeration device 10 is a device such as a refrigerator or a freezer.

[0056] Combination Figure 4 As shown, the embodiment of the present disclosure provides a method for item display, comprising:

[0057] S401, an image acquisition device acquires an image of a visible area of ​​a target space and a user's access action of accessing an object to the target space, and obtains information of the object stored in the target space.

[0058] S402, the processor / cloud server determines the visibility of the objects in the target space according to the image of the visible area of ​​the target space and the object information stored in the target space.

[0059] S403, the processor / cloud server restores the obscured object into a virtual image when the visual situation indicates that the object is obscured.

[0060] S404, displaying the real images of the visible objects stored in the target space and the virtual images of the obscured objects on the interactive end.

[0061] The image acquisition device disposed in the refrigeration equipment box collects the image of the visible area of ​​the target space and the user's access actions to the target space, and obtains the items stored in the target space. The processor / cloud server determines the visibility of the items in the target space based on the image of the visible area of ​​the target space and the information of the items stored in the target space. If the visibility indicates that the items stored in the target space are obscured, the obscured items are restored to virtual images. Then the real image of the visible item and the virtual image of the obscured item are sent to the interactive end. The interactive end displays the real image of the visible item stored in the target space and the virtual image of the obscured item. The virtual image of the obscured item is a non-real, virtual image that can reflect the complete appearance of the obscured item. The name of the item corresponding to the virtual image of the obscured item is consistent with the name of the item stored in the target space.

[0062] The method for displaying items provided by the embodiment of the present disclosure first collects the image of the visible area of ​​the target space and the access action of the user to access items to the target space, obtains the information of the items stored in the target space, and then determines the visual situation of the items in the target space based on the image of the visible area and the information of the items stored in the target space. If the visual situation indicates that the item is blocked, the virtual image of the blocked item is restored. Then, the real image of the visible item stored in the target space and the virtual image of the blocked item are displayed on the interactive end. In this way, it can be judged whether there are items blocked in the target space, and when the items are blocked, the blocked items are restored to virtual images. When the interactive end displays the picture to the user, the real image of the visible item stored in the target space and the virtual image of the blocked item are displayed. In this way, the images of all items stored in the target space can be displayed to the user, which improves the integrity of the displayed picture. Moreover, it is also convenient for the user to understand the storage situation of the items in the target space, and improves the user's experience.

[0063] Optionally, while displaying the real image of the visible object stored in the target space and the virtual image of the obscured object on the interactive end, the object information is also displayed. Optionally, the object information includes: name, location and related information. The related information includes: quantity and / or real image and / or freshness and / or storage date and / or shelf life and / or packaging form and / or recipe.

[0064] Optionally, the real image and virtual image displayed on the interactive end are 2D (two-dimensional) images or 3D (three-dimensional) images.

[0065] Optionally, at S402, the processor / cloud server determines the visibility of the objects in the target space according to the image of the visible area of ​​the target space and the object information stored in the target space, including:

[0066] The processor / cloud server determines the visible objects in the target space based on the image of the visible area.

[0067] The processor / cloud server determines that all objects in the target space are visible when the visible objects include the completely stored objects.

[0068] The processor / cloud server determines that the deposited item is obscured in the target space when the visible item includes a portion of the deposited item or does not include the deposited item.

[0069] The processor / cloud server analyzes the image of the visible area to determine the visible items in the target space displayed in the image of the visible area. If the visible items include all complete deposited items, it is determined that all items in the target space are visible, that is, no items in the target space are blocked. If the visible items include a portion of the deposited items, it means that a portion of the items are blocked. Alternatively, if the visible items do not include the deposited items, it means that the items are completely blocked. In both cases, it can be determined that the deposited items are blocked in the target space. In this way, the visible items in the target space are determined by the image of the visible area, and the visible items are compared with the deposited items to determine whether the items in the target space are blocked.

[0070] Combination Figure 5 As shown, the embodiment of the present disclosure provides another method for item display, including:

[0071] S401, an image acquisition device acquires an image of a visible area of ​​a target space and a user's access action of accessing an object to the target space, and obtains information of the object stored in the target space.

[0072] S402, the processor / cloud server determines the visibility of the objects in the target space according to the image of the visible area of ​​the target space and the object information stored in the target space.

[0073] S413, if the object is completely blocked, the processor / cloud server obtains a complete virtual image of the object.

[0074] S423, if the object is partially blocked, the processor / cloud server obtains a virtual image of the blocked portion, and splices the real image of the unblocked portion and the virtual image of the blocked portion into a complete image of the object.

[0075] S404, displaying the real images of the visible objects stored in the target space and the virtual images of the obscured objects on the interactive end.

[0076] Object occlusion includes full occlusion and partial occlusion. If the object is completely occluded, a complete virtual image of the object is obtained according to the type of the occluded object. For example Figure 6 As shown in the figure, after the drawer is opened, the celery in the drawer is completely blocked, and the tomatoes, kiwi, lettuce and grapes are visible. Figure 7 As shown, the display screen shows the real images of tomatoes, kiwi fruit, lettuce and grapes that were originally visible, and the complete virtual image of the occluded celery. In this way, even if the object is completely occluded, the user can understand the complete information of the occluded object through the restored complete virtual image of the object.

[0077] If part of the object is blocked, a virtual image of the blocked part is obtained according to the type of the blocked object. Then the real image of the unblocked part and the virtual image of the blocked part are stitched together to form a complete image of the object. In this way, only the image of the blocked part is obtained, which can reduce the amount of computing of the processor / cloud server, so that the processor / cloud server can quickly feedback, thereby improving the user experience.

[0078] Optionally, the S404 processor / cloud server displays the real image of the visible object stored in the target space and the virtual image of the obscured object on the interactive end, including:

[0079] The real images and virtual images are arranged according to preset rules, which include:

[0080] The real image and the virtual image correspond to the actual position of the object, and the size of the virtual image is positively correlated with the real size of the object; or,

[0081] Real images and virtual images are displayed evenly.

[0082] Real images and virtual images arranged according to preset rules are displayed on the interactive end for user viewing.

[0083] Real and virtual images of objects Figure 7 . The preset rules include: the real image and the virtual image correspond to the actual position of the object, and the size of the virtual image is positively correlated with the real size of the object. Optionally, the size of the virtual image of the object is proportional to the real size of the object. In this way, the position of the object in the target space and the relative size of the object are truly reproduced through the virtual image of the object, which is convenient for users to understand the storage situation of the objects in the target space. Alternatively, the preset rules include: the real image and the virtual image are displayed evenly. In this way, each real image and virtual image is regularly and evenly distributed to adapt to the display screen of the interactive end, which is more beautiful and convenient for users to view.

[0084] Optionally, if the obstruction of the obstructed object is a component of a refrigeration device, when the virtual image of the obstructed object is displayed on the interactive end, the virtual image of the obstructed object is displayed suspended on the corresponding obstruction. If the obstruction of the obstructed object is another object stored in the target space, when the virtual image of the obstructed object is displayed on the interactive end, the virtual image of the obstructed object is displayed in a preset blank position. In this way, the obstructed object and the obstructing object are displayed separately, so that the user can see the restored virtual image of the obstructed object more clearly.

[0085] Alternatively, see Figure 8 , a virtual storage space of the target space is displayed on the interactive end, and corresponding real images of visible objects and virtual images of obscured objects are displayed in various areas of the virtual storage space.

[0086] Optionally, the size of the display screen of the interactive end corresponds to the size of the target space, and the display positions of the real images of the visible objects and the virtual images of the obscured objects on the display screen correspond to the actual storage positions of the visible objects and the obscured objects in the target space. Alternatively, on the display screen, the information of the objects is displayed at the positions of the objects corresponding to the objects, and the information of the objects includes information such as type, location, and time.

[0087] Combination Fig. 9 As shown, the embodiment of the present disclosure provides another method for item display, including:

[0088] S401, an image acquisition device acquires an image of a visible area of ​​a target space and a user's access action of accessing an object to the target space, and obtains information of the object stored in the target space.

[0089] S402, the processor / cloud server determines the visibility of the objects in the target space according to the image of the visible area of ​​the target space and the object information stored in the target space.

[0090] S403, the processor / cloud server restores the obscured object into a virtual image when the visual situation indicates that the object is obscured.

[0091] S404, displaying the real images of the visible objects stored in the target space and the virtual images of the obscured objects on the interactive end.

[0092] S405, the processor / cloud server displays the information of the object on the interactive end in response to the user's query on the real image and the virtual image.

[0093] When the interactive end displays the real image of the visible object and the virtual image of the obscured object, the processor / cloud server responds to the user's query command for the real image and the virtual image, and displays the information of the object on the interactive end. Optionally, the user forms a query command by touching the interactive end, or forms a query command by sending a voice to the voice end. The query command includes a query object, and the query object includes one or more objects corresponding to the real image and the virtual image displayed by the interactive end, which are selected by the user. The processor / cloud server sends the information of the object to the interactive end, so that the interactive end displays the information of the object to the user. In this way, the user interacts with the real image and the virtual image, and the user queries the objects corresponding to one or more of the real image and the virtual image. The real image and the virtual image can display the information of all objects stored in the target space, thereby improving the user's experience of interacting with the real image and the virtual image.

[0094] Optionally, the processor / cloud server displays information of the item on the interactive end in response to a user's query command for the real image and the virtual image, including:

[0095] The processor / cloud server determines the target object according to the user's query command; the target object is an object corresponding to one or more of the displayed real images and virtual images.

[0096] Displays the target item's information on the interactive side.

[0097] The processor / cloud server analyzes the user's query command to determine the target item of the user's query. The target item is an item corresponding to one or more of the real image and virtual image of the item displayed on the interactive end. Then the information of the target item is displayed on the interactive end. As can be seen from the foregoing, the information of the item includes: name, location and related information, and the related information includes one or more information. Then the name and location of the target item, as well as one or more information in the related information, can be displayed on the interactive end, and the real image of the target item can be displayed. Optionally, when the user's query command is a touch query / air operation query, if the user clicks / long presses / slides / circles / connects the real image and / or virtual image, and clicks the query window, the item corresponding to the real image and / or virtual image clicked / long pressed / slides / circles / connects by the user is determined as the target item. Optionally, the click includes single click, double click, etc., which can be set by the user. When the user's query command is a voice query, the item corresponding to the user's voice is determined as the target item.

[0098] In the case where the user selects the target item by touching, when there is only one target item, the user can select the target item by clicking the real image or virtual image of the item. When there are multiple target items, if the real images and / or virtual images of these items are adjacent, refer to Fig.10 , the user can circle these real images and / or virtual images together to select the target object. If the real images and / or virtual images of these objects are not adjacent, see Fig.11 , the user can click or circle these real images and / or virtual images to select the target object, or, see Fig.12 , users can connect these real images and virtual images with lines to select the target object.

[0099] Optionally, when the user selects the target item by touching and then clicks the query button displayed on the interactive end, the processor / cloud server determines that the user's query command is to query the quantity and / or real image and / or freshness and / or storage date and / or shelf life and / or packaging form of the target item.

[0100] When the user selects the target item by touching and then clicks the recipe button displayed on the interactive end, the processor / cloud server determines that the user's query command is to query the recipe of the target item.

[0101] Alternatively, see Fig.13 , a query box is displayed on the interactive end. When the user selects the real image and virtual image corresponding to the target object, the name of the corresponding object is displayed in the query box.

[0102] Optionally, a real image of the target object is displayed on the interactive end, including:

[0103] Display the real image of the target object at the interactive end, and do not display or blur the non-target objects; or

[0104] The real image of the target object is displayed on the interactive end, non-target objects are not displayed or blurred, and the information label of the target object is displayed on one side of the real image of the target object.

[0105] Among them, the position of the real image corresponds to the real position of the object.

[0106] When the real image of the target object is displayed on the interactive end, the real image of the target object is displayed, and the images of non-target objects are not displayed or blurred. For example, the interactive end displays real images and virtual images of objects such as tomatoes, cucumbers, carrots, and eggs. When the target object selected by the user is carrots, the nearest real image of carrots in the target space is displayed, and non-target objects such as tomatoes and cucumbers are not displayed or blurred, so that the user can quickly lock the target object and understand the real storage status of the target object. Alternatively, the real image of the target object is displayed, and the icons of non-target objects are not displayed or blurred. At the same time, the information label of the corresponding target object is displayed on one side of the real image of the target object. For example, see Fig.14 When the target item selected by the user is carrot, the nearest real image of carrot in the target space is displayed, and non-target items such as tomatoes and cucumbers are not displayed or are blurred. At the same time, a virtual information label corresponding to the carrot is displayed on one side of the real image of the carrot. Optionally, when the interactive end displays the target item, the display position of the target item on the interactive end corresponds to the real position of the target item in the target space, so that the user can further understand the real storage location of the target item. Optionally, the information label displays the name, quantity, freshness, storage date, shelf life and other related information of the target item (such as carrots) so that the user can understand the information of the target item.

[0107] Optionally, when displaying recipes of target items on the interactive end, if the user selects multiple target items, recipes for cooking multiple target items together are displayed on the interactive end. For example, if the user selects tomatoes and eggs as target items, the interactive end displays the recipes for scrambled eggs with tomatoes. If the user selects one target item, the interactive end displays recipes containing the target item. For example, if the user selects cucumber as the target item, the interactive end displays recipes for cold cucumber salad, scrambled eggs with cucumber, or stir-fried meat with cucumber. In this way, recipes related to the target items are recommended to the user to meet the user's needs.

[0108] Combination Fig.15 As shown, the embodiment of the present disclosure provides another method for managing items, including:

[0109] S401, an image acquisition device acquires an image of a visible area of ​​a target space and a user's access action of accessing items to the target space, and obtains information of items stored in the target space.

[0110] S402, the processor / cloud server determines the visibility of the objects in the target space according to the image of the visible area of ​​the target space and the object information stored in the target space.

[0111] S403, the processor / cloud server restores the obscured object into a virtual image when the visual situation indicates that the object is obscured.

[0112] S404, displaying the real images of the visible objects stored in the target space and the virtual images of the obscured objects on the interactive end.

[0113] S406, after executing S401, the processor / cloud server sends a prompt message according to the change of the information of the item.

[0114] As mentioned above, the information of the item includes: name, location and related information. After the processor / cloud server obtains the information of the item, it sends a prompt message to the user according to the change of the information of the item to remind the user to pay attention to the change of the item. Optionally, the prompt information includes: voice prompt information issued by the voice device, text and / or icon prompt information displayed on the display screen, etc. Optionally, the prompt method of the voice prompt information includes: voice broadcast, sound effect, etc. Optionally, the prompt method of the icon prompt information includes: displaying a preset mark, differentiated color, etc.

[0115] Optionally, at S406, the processor / cloud server sends a prompt message according to the change of the item information, including:

[0116] The processor / cloud server sends a first prompt message when the location of the object changes; and / or,

[0117] The processor / cloud server sends a second prompt message when there are items in the target space that are not suitable for common storage; and / or,

[0118] The processor / cloud server issues a third prompt message when the type of the object is not suitable for storage in the target space; and / or,

[0119] The processor / cloud server issues a fourth prompt message when the freshness of the item changes; and / or,

[0120] The processor / cloud server sends a fifth prompt message when the packaging of the item does not meet the packaging requirement of the target space.

[0121] The processor / cloud server determines whether the position of the object in the target space has changed. If the position of the object has changed, for example, the object has moved from one drawer to another drawer, or from one shelf to another shelf, or from a drawer to a partition, a first prompt message is issued to prompt the user of the position change of the corresponding object to prevent the user from being unable to find the object.

[0122] The processor / cloud server also determines whether various types of items are suitable for being stored in the target space at the same time. If not, a second prompt message is issued. Optionally, when items can ripen each other, affect each other's shelf life, are prone to cross-flavoring, and / or are mixed with raw and cooked items, the processor / cloud server determines the conditions under which the corresponding items are not suitable for being stored in the target space at the same time. Optionally, the second prompt message includes marking the real image or virtual image of the corresponding item. Optionally, the marking is in the form of circling the corresponding real image or virtual image with lines of the same color. Optionally, the marking is in the form of generating a virtual prompt label on one side of the corresponding real image or virtual image, and the virtual prompt label displays text reminders of other items that are not suitable for being stored together with the corresponding item. Optionally, the virtual prompt label is in a preset color, such as yellow, to give the user a clear prompt.

[0123] The processor / cloud server also determines whether the various types of items in the target space are suitable for storage in the target space. If not, a third prompt message is issued. For example, see Fig.16, when bananas (not suitable for refrigeration) are stored in the target space, the processor / cloud server determines that the bananas are not suitable for storage in the target space, and then issues a third prompt message. Optionally, the third prompt message includes marking the real image or virtual image of the corresponding object. Optionally, the marking is in the form of using a line of a preset color to circle the corresponding real image and / or virtual image. Optionally, the marking is in the form of generating a virtual prompt label on one side of the corresponding real image and / or virtual image, and the virtual prompt label displays a text reminder that the corresponding object is not suitable for storage in the target space and the correct storage method. Optionally, the virtual prompt label is in a preset color, such as yellow, to give the user a clear prompt.

[0124] In this way, when the user views the real image and / or virtual image of the item, he can intuitively understand through the marking whether the item is suitable to be stored in the target space at the same time, and / or whether the item is suitable to be stored in the target space, so as to assist the user to manage the items more intelligently.

[0125] The processor / cloud server also determines the change in the freshness of the item, and issues a fourth prompt message according to the change in the freshness of the item. Optionally, the fourth prompt message includes marking the real image or virtual image of the corresponding item. Fig.17 Different freshness corresponds to different colored marks. Optionally, the mark is in the form of a circle around the item. For example, a real image or virtual image of an item is circled with a red line, indicating that the corresponding item has expired. For another example, a real image or virtual image of an item is circled with a yellow line, indicating that the corresponding item is about to expire. In this way, when the user views the real image and / or virtual image of the item, the user can intuitively understand the change in the freshness of the item through the mark.

[0126] Optionally, when the mark is in the form of a circled real image or a virtual image, lines of different line types are used to circle the real image or the virtual image to distinguish whether the circled mark represents the freshness of the item, the item is not suitable for storage in the same target space, or the item is not suitable for storage in the target storage space. For example, when the circled mark represents the freshness of the item, the circled line is a curve. When the circled mark represents that the item is not suitable for storage in the same target space, the circled line is a wavy line. When the circled mark represents that the item is not suitable for storage in the target space, the circled line is a dotted line. In this way, it is convenient for users to distinguish.

[0127] The processor / cloud server also determines whether the packaging of the object meets the packaging requirements of the target space. If not, a fifth prompt message is issued. Optionally, the fifth prompt message includes marking the real image or virtual image of the corresponding object. For example, see Fig.18When it is identified that the fruit is not suitable for bagging, the real image and / or virtual image of the fruit is marked. Optionally, the marking is in the form of generating a virtual reminder label on one side of the corresponding real image or virtual image, and the virtual reminder label displays a text reminder that the corresponding item is not suitable for bagging and the correct storage method. Optionally, the virtual reminder label is in a preset color, such as yellow, to give the user a clear reminder.

[0128] Combination Fig.19 As shown, the embodiment of the present disclosure provides another method for managing items, including:

[0129] S401, an image acquisition device acquires an image of a visible area of ​​a target space and a user's access action of accessing items to the target space, and obtains information of items stored in the target space.

[0130] S402, the processor / cloud server determines the visibility of the objects in the target space according to the image of the visible area of ​​the target space and the object information stored in the target space.

[0131] S403, the processor / cloud server restores the obscured object into a virtual image when the visual situation indicates that the object is obscured.

[0132] S404, displaying the real images of the visible objects stored in the target space and the virtual images of the obscured objects on the interactive end.

[0133] S406, after executing S401, the processor / cloud server sends a prompt message according to the change of the information of the item.

[0134] S407, after executing S401, the processor / cloud server determines the target environment parameters of the target space according to the information of the object.

[0135] S408, the processor / cloud server controls the target space to operate according to the target environment parameters, and displays the target environment parameters on the interactive end and / or notifies the user of the target environment parameters by voice.

[0136] After obtaining the information of the item, the target environmental parameters of the target space are determined according to the information of the item. In this way, the environmental parameters suitable for storing the item can be determined according to the name (type) and freshness of the item. Then the target space is controlled to operate according to the target environmental parameters so that the environmental parameters of the target space reach the environmental parameters suitable for storing the item. At the same time, the target environmental parameters are displayed on the interactive end, and / or the target environmental parameters are notified to the user by voice, so that the user can understand the adjustment of the environmental parameters of the target space.

[0137] Optionally, the environmental parameters of the target space include one or more parameters such as temperature, humidity, oxygen concentration, sterilization parameters, etc.

[0138] Optionally, when the target space stores multiple items, the processor / cloud server sets a priority based on the quantity, price, freshness, etc. of the items to determine the target environment parameters. For example, the target environment parameters of the target space are determined based on the type and freshness of the items with the largest number of the same type. For another example, the target environment parameters of the target space are determined based on the type and freshness of the most expensive items. The specific priority can be set by the user.

[0139] The following takes the example of a refrigeration device having a touch-type interactive terminal and an image acquisition device acquiring an image in a drawer as an example, and describes in detail the interaction process between the refrigeration device and the user provided by the embodiment of the present disclosure:

[0140] The user clicks on the drawer screen displayed on the interactive end.

[0141] The interactive terminal sends a request to the processor of the refrigeration device to view the storage status of the drawer, wherein the request includes: an image of the visible area of ​​the drawer captured by the image capture device and a user's storage action of accessing an item to a target space.

[0142] The processor of the refrigeration equipment obtains the information of the items stored in the target space in response to the viewing request, and determines the visibility of the items in the target space based on the image of the visible area of ​​the target space and the information of the items stored in the target space; and when the visibility indicates that the object is obscured, the obscured object is restored to a virtual image.

[0143] The processor of the refrigeration device sends the real image of the visible object and the virtual image of the obscured object to the interactive end.

[0144] The real image and virtual image of the object are evenly distributed on the display screen of the interactive end, such as Figure 7 Or the positions of the real image and virtual image of the object are consistent with the real position of the object, and the real image and virtual image of the object are in proportion to the real size of the object, such as Figure 20-1 and Figure 20-2 shown.

[0145] The processor of the refrigeration equipment marks the real image or virtual image of the corresponding object and generates a virtual prompt label on one side of the real image or virtual image of the corresponding object when the position of the object changes, the object is about to expire, has expired, is not suitable for storage in the current drawer, is not suitable for storage with other objects in the current drawer, is not suitable for storage in bags, etc.

[0146] The processor of the refrigeration equipment sends the real image or virtual image with the mark and virtual prompt label to the interaction end.

[0147] The user clicks on the real image or virtual image of an object displayed on the interactive terminal.

[0148] The interactive end sends a query request for information about the item to the processor of the refrigeration device.

[0149] The processor of the refrigeration device generates a real image of the target object, non-target objects are not displayed or are blurred, and an object display image of a virtual information tag of the target object is generated on one side of the real image of the target object.

[0150] The processor of the refrigeration device sends the item display image to the interactive end.

[0151] The user clicks, circles, or connects the real and / or virtual images of the objects on the interactive terminal.

[0152] The interactive end sends a query request for querying the recipe of the item to the processor of the refrigeration device.

[0153] The processor of the refrigeration unit sends the recipe to the interactive end.

[0154] The refrigeration equipment's processor determines the target environmental parameters for the drawer based on information such as the type, quantity and freshness of the items.

[0155] The drawers of the refrigeration equipment operate according to the target environmental parameters.

[0156] The processor of the refrigeration device sends the target environment parameters to the interaction end.

[0157] The following takes the example of setting an image acquisition device in a refrigeration device and the image acquisition device acquiring images in a drawer as an example to describe in detail the remote interaction process between the cloud server, the refrigeration device and the user provided by the embodiment of the present disclosure:

[0158] The user clicks on the drawer screen displayed on the interactive end.

[0159] The interactive terminal sends a request to the cloud server to view the storage status of the drawer, wherein the request includes: an image of the visible area of ​​the drawer captured by the image capture device and a user's storage action of accessing items to the target space.

[0160] The cloud server responds to the viewing request, obtains the item information stored in the target space, and determines the visibility of the items in the target space based on the image of the visible area of ​​the target space and the item information stored in the target space; and when the visible situation indicates that the object is obscured, the obscured object is restored as a virtual image.

[0161] The cloud server sends the real image of the visible object and the virtual image of the occluded object to the interactive end;

[0162] The real image and virtual image of the object are evenly distributed on the display screen of the interactive end, such as Figure 7 Or the positions of the real image and virtual image of the object are consistent with the real position of the object, and the real image and virtual image of the object are in proportion to the real size of the object, such as Figure 20-1 and Figure 20-2 shown.

[0163] When the location of an item changes, the item is about to expire, has expired, is not suitable for storage in the current drawer, is not suitable for storage with other items in the current drawer, is not suitable for storage in a bag, etc., the cloud server marks the real image or virtual image of the corresponding item and generates a virtual prompt label on one side of the real image or virtual image of the corresponding item.

[0164] The processor of the refrigeration equipment sends the real image or virtual image with the mark and virtual prompt label to the interaction end.

[0165] The user clicks on the real image or virtual image of an object displayed on the interactive terminal.

[0166] The interactive end sends a query request to the cloud server for information related to the item.

[0167] The cloud server generates a real image of the target object, non-target objects are not displayed or blurred, and an object display image with a virtual information tag of the target object is generated on one side of the real image of the target object.

[0168] The cloud server sends the item display image to the interactive end.

[0169] The user clicks, circles, or connects the real and / or virtual images of the objects on the interactive terminal.

[0170] The interactive end sends a query request for the recipe of an item to the cloud server.

[0171] The cloud server sends the recipe to the interactive end.

[0172] The cloud server determines the target environmental parameters of the drawer based on information such as the type, quantity, and freshness of the items.

[0173] The cloud server sends the target storage environment parameters to the refrigeration equipment and the interactive end.

[0174] The drawers of the refrigeration equipment operate according to the target environmental parameters.

[0175] The following will take the image acquisition device collecting the full-space image of the refrigeration device as an example to explain in detail the interaction process between the refrigeration device and the user provided by the embodiment of the present disclosure:

[0176] The user sends a request to view the full space of the refrigeration equipment by voice or by clicking on the function displayed on the interactive terminal. The full space of the refrigeration equipment includes storage spaces such as shelf storage space, drawer storage space, and door storage space.

[0177] The interactive terminal displays a replacement image of the entire space of the refrigeration equipment, wherein the replacement image of the entire space is a non-real, virtual image.

[0178] The user clicks on a space in the alternative image of the entire space displayed on the interactive end.

[0179] The interactive end displays an enlarged alternative image of the space clicked by the user, wherein the enlarged alternative image includes a real image of the visible object in the corresponding space and a virtual image of the obstructed object, or includes a real image of the visible object in the corresponding space and a virtual image of the obstructed object, as well as information about the stored object.

[0180] Afterwards, the interaction process between the user and the real image and the virtual image of the object in the enlarged replacement image of the space can be referred to the examples listed above, which will not be repeated here.

[0181] In this way, users can remotely interact with the refrigerator through smart devices such as smartphones and smart appliances.

[0182] Combination Fig.21 As shown, the embodiment of the present disclosure provides a device 210 for managing items, including a processor 211 and a memory 212. Optionally, the device 210 may also include a communication interface 213 and a bus 214. The processor 211, the communication interface 213, and the memory 212 may communicate with each other through the bus 214. The communication interface 213 may be used for information transmission. The processor 211 may call the logic instructions in the memory 212 to execute the method for managing items of the above embodiment.

[0183] In addition, the logic instructions in the memory 212 can be implemented in the form of software functional units and can be stored in a computer-readable storage medium when sold or used as an independent product.

[0184] The memory 212 is a computer-readable storage medium that can be used to store software programs and computer executable programs, such as program instructions / modules corresponding to the method in the embodiment of the present disclosure. The processor 211 executes the function application and data processing by running the program instructions / modules stored in the memory 212, that is, implementing the method for managing items in the above embodiment.

[0185] The memory 212 may include a program storage area and a data storage area, wherein the program storage area may store an operating system and an application required for at least one function; the data storage area may store data created according to the use of the terminal device, etc. In addition, the memory 212 may include a high-speed random access memory and may also include a non-volatile memory.

[0186] An embodiment of the present disclosure provides a computer-readable storage medium storing computer-executable instructions, wherein the computer-executable instructions are configured to execute the above-mentioned method for displaying items.

[0187] The technical solution of the embodiment of the present disclosure can be embodied in the form of a software product, which is stored in a storage medium and includes one or more instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the method described in the embodiment of the present disclosure. The aforementioned storage medium may be a non-transient storage medium, such as: a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a disk or an optical disk, and other media that can store program codes.

[0188] The above description and the accompanying drawings fully illustrate the embodiments of the present disclosure so that those skilled in the art can practice them. Other embodiments may include structural, logical, electrical, process and other changes. The embodiments represent only possible changes. Unless explicitly required, separate components and functions are optional, and the order of operation may vary. The parts and features of some embodiments may be included in or replace the parts and features of other embodiments. Moreover, the words used in this application are only used to describe the embodiments and are not used to limit the claims. As used in the description of the embodiments and the claims, unless the context clearly indicates, the singular forms of "a", "an" and "the" are intended to include plural forms as well. Similarly, the term "and / or" as used in this application refers to any and all possible combinations of listings containing one or more associated ones. In addition, when used in the present application, the term "comprise" and its variants "comprises" and / or comprising refer to the presence of stated features, wholes, steps, operations, elements, and / or components, but do not exclude the presence or addition of one or more other features, wholes, steps, operations, elements, components and / or groups thereof. In the absence of further restrictions, the elements defined by the sentence "comprising a ..." do not exclude the presence of other identical elements in the process, method or device comprising the elements. In this article, each embodiment may focus on the differences from other embodiments, and the same and similar parts between the various embodiments may refer to each other. For the methods, products, etc. disclosed in the embodiments, if they correspond to the method part disclosed in the embodiments, then the relevant parts can refer to the description of the method part.

[0189] Those skilled in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software may depend on the specific application and design constraints of the technical solution. The technicians may use different methods for each specific application to implement the described functions, but such implementations should not be considered to exceed the scope of the embodiments of the present disclosure. The technicians may clearly understand that, for the convenience and simplicity of description, the specific working processes of the systems, devices and units described above may refer to the corresponding processes in the aforementioned method embodiments, and will not be repeated here.

[0190] In the embodiments disclosed herein, the disclosed methods and products (including but not limited to devices, equipment, etc.) can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the units can be only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the coupling or direct coupling or communication connection between each other shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms. The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the units may be selected according to actual needs to implement this embodiment. In addition, each functional unit in the embodiment of the present disclosure may be integrated in a processing unit, or each unit may exist physically alone, or two or more units may be integrated in one unit.

[0191] The flowchart and block diagram in the accompanying drawings show the possible architecture, function and operation of the system, method and computer program product according to the embodiment of the present disclosure. In this regard, each box in the flowchart or block diagram can represent a module, a program segment or a part of the code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. In some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two consecutive boxes can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, which can depend on the functions involved. In the description corresponding to the flowchart and the block diagram in the accompanying drawings, the operations or steps corresponding to different boxes can also occur in a different order from the order disclosed in the description, and sometimes there is no specific order between different operations or steps. For example, two consecutive operations or steps can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, which can depend on the functions involved. Each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, may be implemented by a dedicated hardware-based system that performs the specified functions or actions, or may be implemented by a combination of dedicated hardware and computer instructions.

Claims

1. A method for displaying an item, characterized in that: include: Collect images of the visible area of ​​the target space and the user's access actions of storing and retrieving items from the target space, and obtain information about the items stored in the target space; Determine the visibility of the objects in the target space according to the image of the visible area of ​​the target space and the object information stored in the target space; When the visible object is occluded, restore the occluded object to a virtual image; The real images of the visible objects stored in the target space and the virtual images of the occluded objects are displayed on the interactive end.

2. The method according to claim 1, characterized in that When a visible object is occluded, the occluded object is restored to a virtual image, including: If the object is completely occluded, obtain the complete virtual image of the object; If the object is partially blocked, a virtual image of the blocked part is obtained, and the real image of the unblocked part and the virtual image of the blocked part are spliced ​​into a complete image of the object.

3. The method according to claim 1, characterized in that The real image of the visible object stored in the target space and the virtual image of the occluded object are displayed on the interactive end, including: The real images and virtual images are arranged according to preset rules, which include: The real image and the virtual image correspond to the actual position of the object, and the size of the virtual image is positively correlated with the real size of the object; or, Real images and virtual images are displayed evenly.

4. The method according to claim 1, characterized in that: In response to a user's query on a real image and a virtual image, information about the item is displayed on an interactive end.

5. The method according to claim 4, characterized in that The information of the item includes: name, location and related information; The relevant information includes, among others: quantity and / or real image and / or freshness and / or storage date and / or shelf life and / or packaging form and / or recipe.

6. The method according to claim 5, characterized in that Send prompt information according to the changes in the item information.

7. The method according to claim 6, characterized in that Send prompt information according to the changes of item information, including: When the position of the object changes, issuing a first prompt message; and / or, If there are items in the target space that are not suitable for common storage, a second prompt message is issued; and / or, If the type of the object is not suitable for storage in the target space, a third prompt message is issued; and / or, When the freshness of the item changes, a fourth prompt message is issued; and / or, When the packaging of the article does not meet the packaging requirement of the target space, a fifth prompt message is issued.

8. The method according to any one of claims 1 to 7, characterized in that Determine target environment parameters of the target space according to the information of the object; Control the target space to operate according to the target environment parameters, and display the target environment parameters and / or notify the user of the target environment parameters by voice.

9. A refrigeration device, characterized in that: include: The box body and the box door, the box body and / or the box door are both provided with a target space for storing items; An image acquisition device, used for acquiring an image of a target space; A processor, configured to determine the visibility of the object in the target space according to the image of the visible part of the target space and the access action of the user to access the object in the target space; and restore the obscured object to a virtual image when the visibility indicates that the object is obscured; The interactive end is used to show the user the real images of the visible objects stored in the target space and the virtual images of the obscured objects.

10. The refrigeration device according to claim 9, characterized in that: The image acquisition device includes: a camera or an imaging sensor.

11. The refrigeration device according to claim 9 or 10, characterized in that: The target space is the storage space of the drawer or all the storage space of the refrigeration equipment; The image acquisition device is arranged on the inner top of the box body, the inner side of the box door, the inner side surface of the box body or the top of the drawer, so as to be able to acquire the image of the storage space of the drawer.

12. An item display system, characterized in that: include: The refrigeration equipment includes an image acquisition device, which acquires an image of a visible portion of a target space and a user's access action of accessing an item to the target space, and then sends the image of the visible portion and the access action to a cloud server; After receiving the image of the visible part of the target space and the access action, the cloud server determines the visibility of the objects in the target space; if the visibility indicates that the object is blocked, the blocked object is restored as a virtual image; The interactive end of the remote interactive device displays to the user the real images of the visible objects stored in the target space and the virtual images of the obscured objects.

13. The article display system according to claim 12, characterized in that: Remote interaction devices include: smart mobile devices, and / or smart home appliances.

Images