Article storage management method and device, article storage equipment and medium

Abstract

The invention discloses an article storage management method, device and equipment and a medium, and is applied to the technical field of household appliances, and the method comprises the steps: obtaining the article information of a first article through an image collection device if it is detected that the first article is put into an article recognition region; before a cabinet door of the article storage equipment is detected to be closed, if it is detected that a first article storage area is changed from a vacant state to a containing state, it is judged that a first article is stored in the first article storage area, and article information of the first article is bound with position information of the first article storage area; the first article storage area is any article storage area. According to the invention, the technical problem that the article storage equipment is inconvenient for a user to search articles in the related art is solved.

Description

Technical Field

[0001] The present invention belongs to the technical field of household appliances, and in particular relates to an article storage management method, an apparatus, an article storage device and a medium. Background Art

[0002] High-end wine lovers generally pursue quality and have high requirements for the red wine stored in the wine cabinet. In addition to requiring a constant storage environment, they also hope to know the number of wines and information about each wine in real time, such as the storage time, winery, and how to use it. However, users generally obtain this information through self-search, which is not convenient. In the related art, the camera installed at the top of the wine cabinet captures the image of the entire wine cabinet to identify the information of all the red wines stored in the wine cabinet. The recognition area of ​​each shelf below is limited, and the wine information on the label cannot be clearly seen. At most, it can identify the number of wines, but cannot manage the specific type of wine, winery, and other detailed information. It is not convenient for users to understand the storage location of each wine and the wine information of each storage location. Other item storage devices also have the same or similar situation. Therefore, the item storage devices in the related art are not convenient for users to find items. Summary of the Invention

[0003] The present invention provides an item storage management method, device, item storage equipment and medium, which are used to solve the technical problem in the related art that item storage equipment is inconvenient for users to find items.

[0004] In a first aspect of the present invention, a method for item storage management of an item storage device is provided, wherein the item storage device includes a cabinet body and a cabinet door, an item identification area and multiple item storage areas are provided in the cabinet body, and an image acquisition device is installed in the item identification area. The method includes: if it is detected that a first item is placed in the item identification area, obtaining item information of the first item through the image acquisition device; before it is detected that the cabinet door of the item storage device is closed, if it is detected that the first item storage area changes from an empty state to a contained state, determining that the first item is stored in the first item storage area, binding the item information of the first item with the location information of the first item storage area, and the first item storage area is any one of the multiple item storage areas.

[0005] In combination with the first aspect, in some embodiments, before binding the item information of the first item with the location information of the first item storage area, it also includes: sending an item replacement request for the first item storage area to the server based on the user's selection operation of the first item storage area, so that the server unbinds the original item information bound to the location information of the first item storage area.

[0006] In combination with the first aspect, in some embodiments, obtaining the item information of the first item through the image acquisition device includes: photographing the target position in the item identification area through the image acquisition device to obtain the item image of the first item, and the target position is the position of the first item in the item identification area; sending the item image of the first item to a server so that the server performs information recognition on the item image of the first item; and receiving the item information of the first item fed back by the server, where the item information of the first item is obtained by the server from the item image.

[0007] In combination with the first aspect, in some embodiments, obtaining the item information of the first item through the image acquisition device further includes: if control information sent by the server is received, outputting the control information, the control information is sent by the server when the item information of the first item is not identified from the item image, and the control information is used to adjust the first item within the item identification area; after detecting that the first item has been adjusted, returning to execute the step of photographing the target position in the first item storage area through the image acquisition device to re-acquire the item image of the first item.

[0008] In combination with the first aspect, in some embodiments, binding the item information of the first item with the location information of the first item storage area includes: sending a binding request to the server, so that the server binds the item information of the first item with the location information of the first item storage area according to the binding request; receiving a success prompt fed back by the server, wherein the success prompt is used to prompt that the item information of the first item and the location information of the first item storage area are successfully bound.

[0009] In combination with the first aspect, in some embodiments, sending a binding request to the server includes: outputting the item information of the first item and the location information of the first item storage area; and sending a binding request to the server based on the user's operation on the item information of the first item and / or the location information of the first item storage area.

[0010] In combination with the first aspect, in some embodiments, sending a binding request to the server based on the user's operation on the item information of the first item and / or the location information of the first item storage area includes: if a user confirmation operation is detected within a first preset time limit, sending a binding request to the server; if the user confirmation operation is not detected within the first preset time limit, sending a binding request to the server after the countdown of the first preset time limit ends.

[0011] In combination with the first aspect, in some embodiments, before sending the binding request to the server, it also includes: if a user editing operation is detected within the first preset time limit, updating the item information of the first item and / or the storage location of the first item according to the editing operation.

[0012] In combination with the first aspect, in some embodiments, it also includes: if it is detected that the second item is taken out from the second item storage area, detecting within a third time limit whether the third item storage area changes from an empty state to a contained state, the second item storage area being any one of the multiple item storage areas that is in a contained state; if so, it indicates that the second item is transferred to the third item storage area, and the item information of the second item is untied from the location information of the second item storage area, and the item information of the second item is bound to the location information of the third item storage area; if not, it indicates that the second item is taken out of the item storage device, and the item information of the second item is untied from the location information of the second item storage area.

[0013] In a second aspect of the present invention, an article storage management device of an article storage device is provided, which is applied to the article storage device, the article storage device including an article identification area and multiple article storage areas, an image acquisition device is installed in the article identification area, and the article storage management device includes: an information acquisition unit, for acquiring article information of the first article through the image acquisition device if it is detected that a first article is placed in the article identification area; a binding unit, for determining that the first article is stored in the first article storage area if it is detected that the first article storage area changes from an empty state to a contained state before detecting that a cabinet door of the article storage device is closed, and binding the article information of the first article with the location information of the first article storage area, the first article storage area being any one of the multiple article storage areas.

[0014] In a third aspect of the present invention, an article storage device is provided, comprising: a cabinet body and a cabinet door, wherein an article identification area and multiple article storage areas are provided in the cabinet body, an image acquisition device and a processor are installed in the article identification area; and a memory for storing instructions executable by the processor, wherein the processor is configured to execute the instructions to implement the article storage management method described in any of the above embodiments.

[0015] In a fourth aspect of the present invention, a computer-readable storage medium is provided, on which a computer program is stored, characterized in that when the program is executed by a processor, the item storage management method described in any of the above embodiments is implemented.

[0016] The one or more technical solutions provided by the embodiments of the present invention achieve at least the following technical effects or advantages:

[0017] If a first item is detected to be placed in an item identification area, the item information of the first item is acquired through an image acquisition device. Before the cabinet door of the item storage device is detected to be closed, if the first item storage area is detected to have changed from an empty state to an accommodated state, it is determined that the first item is stored in the first item storage area, and the item information of the first item is bound to the location information of the first item storage area, where the first item storage area is any one of multiple item storage areas. The above technical solution uses an acquisition device within a specific area of ​​the item identification area to identify the item information of the item placed therein, and binds the identified item information to the location information of the storage location, thereby facilitating the user's understanding of the specific information of the items stored in each storage area, thereby facilitating the user's search for items and improving user convenience. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following is a brief introduction to the drawings required for use in the description of the embodiments. Obviously, the drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0019] Figure 1 A schematic structural diagram of an article storage device provided by some embodiments of the present invention is shown;

[0020] Figure 2 A flowchart showing an article storage management method provided by some embodiments of the present invention is shown;

[0021] Figure 3 Shown Figure 1 Schematic diagram of the layout of the object identification area;

[0022] Figure 4 The system architecture of the article storage management method provided by some embodiments of the present invention is shown;

[0023] Figure 5 A schematic diagram showing the structure of an article storage management device provided by some embodiments of the present invention is shown;

[0024] Figure 6 A schematic structural diagram of an article storage device provided by some embodiments of the present invention is shown. DETAILED DESCRIPTION

[0025] The following will clearly and completely describe the technical solutions in the embodiments of the present invention in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments of the present invention without making any creative efforts shall fall within the scope of protection of the present invention.

[0026] In addition, in the present invention, descriptions such as "first" and "second" are for descriptive purposes only and should not be understood as indicating or implying their relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features defined as "first" and "second" may explicitly or implicitly include at least one of such features. In addition, the technical solutions between the various embodiments can be combined with each other, but this must be based on the fact that they can be implemented by ordinary technicians in this field. When the combination of technical solutions is contradictory or cannot be implemented, it should be deemed that such combination of technical solutions does not exist and is not within the scope of protection required by the present invention.

[0027] The embodiment of the present invention provides an article storage device, which can be a household appliance for storing a certain article or multiple articles, and the household appliance can be a refrigerator, a freezer, a vertical refrigerator, a wine cabinet, etc. Figure 1 As shown, the article storage device 10 includes a cabinet body 120 and a cabinet door 110 . An article identification area 121 and multiple article storage areas 122 are provided in the cabinet body 120 ; an image acquisition device 123 is installed in the article identification area 121 .

[0028] Based on the same inventive concept, the present invention also provides an article storage management method for an article storage device, which is applied to the above-mentioned article storage device 10, combined with Figure 1 and Figure 2 As shown, the article storage management method includes the following steps S101 to S103.

[0029] S101 : If it is detected that a first object is placed into the object identification area 121 , the image acquisition device 123 acquires object information of the first object.

[0030] In some embodiments, before step S101 , the process may further include detecting whether the cabinet door 110 of the object storage device 10 is opened. If the cabinet door 110 of the object storage device 10 is detected to be opened, a trigger is provided to start detecting whether a first object is placed into the object identification area 121 .

[0031] It should be noted that the item storage device 10 may be a wine cabinet, and the first item corresponds to the wine whose wine information needs to be identified, wherein the wine information may include the specific type of wine, winery, year, etc.

[0032] A sensing device for sensing whether the cabinet door 110 is open or closed relative to the cabinet body 120 may be provided between the cabinet door 110 and the cabinet body 120. The sensing device generates a sensing signal indicating that the cabinet door 110 is opened when the cabinet door 110 is opened, and generates a sensing signal indicating that the cabinet door 110 is closed when the cabinet door 110 is closed, so that the item storage device 10 can detect whether the cabinet door 110 is opened and whether the cabinet door 110 is closed.

[0033] like Figure 3 As shown, in some embodiments, a first presence sensing device 125 is installed within the item identification area 121 for sensing whether an item is placed within the item identification area 121. The first presence sensing device 125 may be a gravity sensor, an induction switch, or an infrared sensor. When a first item is placed within the item identification area 121, the first presence sensing device 125 generates a sensing signal indicating that an item has been placed within the item identification area 121, enabling the item storage device 10 to detect that the item identification area 121 has changed from an empty state to a contained state, that is, to detect that the first item has been placed within the item identification area 121. If the change from an empty state to a contained state is detected, the image capture device 123 captures a target position within the item identification area 121 to obtain an image of the first item, wherein the target position is the position of the first item within the item identification area 121.

[0034] In some embodiments, the target position is a pre-determined reasonable position, and the shooting direction of the image acquisition device 123 is pre-set to be fixed toward the target position. Each time the user puts an item in, the item needs to be kept in the target position, and even the marking area where the item is placed needs to be kept in the target position.

[0035] like Figure 3 As shown, in some embodiments, a positioning structure 124 is further provided in the item identification area 121, and the positioning structure 124 is used to limit the first item placed in the item identification area 121 to be in the target position. The image acquisition device 123 is provided in the item identification area 121, and the shooting angle of the image acquisition device 123 is toward the target position.

[0036] In other embodiments, the image acquisition device 123 is rotatable and / or movably arranged, and the target position in the object identification area 121 is photographed by the image acquisition device 123 to obtain an object image of the first object, including: controlling the image acquisition device 123 to rotate and / or move to capture the first object, and starting shooting after the image acquisition device 123 captures the first object to obtain an object image of the first object.

[0037] After the image of the first object is captured by the image acquisition device 123 , the object information of the first object is acquired according to the image of the first object.

[0038] In an application scenario with relatively high computing power, obtaining the item information of the first item based on the item image of the first item may include: the item storage device 10 itself performing information recognition on the item image of the first item to obtain the item information of the first item.

[0039] In the application scenario where the computing power of the item storage device 10 is relatively small, such as Figure 4 As shown, the item storage device 10 is communicatively connected to the server 20, or the server 20 is communicatively connected to both the item storage device 10 and the terminal device 30. Acquiring item information of the first item based on the item image of the first item may include: sending the item image of the first item to the server 20 so that the server 20 can perform information recognition on the item image of the first item; and receiving the item information of the first item fed back by the server 20, where the item information of the first item is obtained by performing information recognition on the item image of the first item by the server 20. It is understood that the server 20 may be a cloud server or a local server.

[0040] In some embodiments, after the server 20 identifies the item information of the first item from the item image of the first item, the server 20 may also record the item information of the first item on the server 20 and / or the server 20 pushes the identified item information of the first item to the terminal device 30, so that after the terminal device 30 receives the item information of the first item, the item information of the first item is displayed on the terminal device 30.

[0041] In some embodiments, the image acquisition device 123 includes a single camera, and the object image of the first object obtained by the current shooting may be a static picture or a dynamic video of the first object at a certain angle.

[0042] Due to factors such as differences in user operations, different types of items, different brands of similar items, different batches of similar items of the same brand, and different models, the identification area of ​​the first item may deviate from the shooting direction of the image acquisition device 123. For example, the identification area of ​​the first item may face away from the shooting direction of the image acquisition device 123, or part of the identification area of ​​the first item may not be captured by the image acquisition device 123. These situations will result in a static image taken at a current time or a video clip of the first item at a certain angle having no identifiable information or incomplete information, which will result in the item information of the first item not being successfully identified from this image or video clip at a single angle when actually identifying the item image of the first item. Therefore, the reliability of obtaining the item information of the first item is not high.

[0043] In some embodiments, in order to improve the reliability of obtaining the item information of the first item from the item image of the first item, the image acquisition device 123 includes multiple cameras, and the item image of the first item currently taken may include multiple pictures of the first item at different angles or video clips of the first item at multiple different angles, which can reduce the number of communication interactions between the item storage device 10 and the server 20.

[0044] In some embodiments, when the item storage device 10 or the server 20 performs information recognition on the image of the first item, optical character recognition (OCR) technology may be used to extract a marking area from the image of the first item and perform text recognition on the marking area to identify the item information of the first item. It should be noted that the marking area is an area carrying the item information of the first item, such as a label attached to the surface of the first item or an image area printed on the surface of the first item.

[0045] In some embodiments, the item management method provided by the present invention may further include: outputting control information for adjusting the first item within the item identification area 121, wherein the control information is output when the item information of the first item is not recognized from the item image of the first item; and after detecting that the first item has been adjusted, returning to the step of photographing a target location within the first item storage area using the image acquisition device 123 to reacquire the item image of the first item. After reacquiring the item image of the first item, the item information of the first item is again acquired based on the reacquired item image of the first item.

[0046] It can be understood that in an embodiment in which the server 20 performs information recognition on the item image of the first item, the control information is sent by the server 20 to the item storage device 10 when the item information of the first item is not recognized from the item image of the first item. After receiving the control information sent by the server 20, the item storage device 10 outputs the control information.

[0047] It is understandable that in the embodiment where the object storage device 10 performs information recognition on the object image of the first object, if the object storage device 10 fails to recognize the object information of the first object from the object image of the first object, control information is generated and output.

[0048] In some embodiments, the control information is a control instruction for controlling the item storage device 10 to output a second prompt information to the user, and the second prompt information is used to prompt the user to adjust the placement position and / or placement direction of the first item in the item identification area 121, and detect whether the placement position and / or placement direction of the first item is adjusted within a second preset time limit after the second prompt information is output to the user; if it is detected that the placement position and / or placement direction of the first item is adjusted, return to execute the step of photographing the target position in the item identification area 121 through the image acquisition device 123 to re-acquire the item image of the first item.

[0049] It is understood that a countdown to a second preset time limit may be initiated simultaneously with or after the second prompt message is output to the user, and detection of whether the placement position and / or placement orientation of the first object has been adjusted is continued until the countdown to the second preset time limit expires. The second preset time limit provides the user with time to adjust the placement position and / or orientation of the first object. The second prompt message prompts the user to move and / or rotate the first object to adjust the placement position and / or placement angle within the second preset time limit. If the time limit expires, the object information recognition attempt is deemed to have failed.

[0050] In other embodiments, the second preset time limit is not set, and after the second prompt information is output, the placement position and / or placement direction of the first object is continuously detected to determine whether it is adjusted until the placement position and / or placement direction of the first object is detected to be adjusted, and the process returns to the step of photographing the target position in the object identification area 121 through the image acquisition device 123 to reacquire the object image of the first object.

[0051] In yet other embodiments, the control information is a control instruction for automatically adjusting the placement position and / or placement orientation of the first object within the object identification area 121. The movement of a carrier within the object identification area 121 for the first object is controlled according to the control instruction to change the placement position and / or placement orientation of the first object within the object identification area 121. When the execution of the control instruction ends, indicating that adjustment of the first object has been detected, the process returns to the step of capturing a target location within the object identification area 121 using the image capture device 123 to recapture an image of the first object.

[0052] It can be understood that the specific implementation process of re-acquiring the item information of the first item based on the re-acquired item image of the first item is the same as or similar to the implementation process of first acquiring the item information of the first item based on the first acquired item image. For the sake of brevity of the specification, it will not be repeated here.

[0053] In some embodiments, the second prompt information may be a graphic or text displayed on the item storage device 10, or may be a sound or light prompt. The second prompt information may include the reason why the item information of the first item was not recognized from the item image of the first item (for example, various reasons such as incorrect placement of the first item, blurred identification area, and unclear lens of the image acquisition device 123 may result in the inability to recognize the item information of the first item) and / or graphic or text content and / or voice prompts guiding the user to correctly place the first item in the item identification area 121.

[0054] S102: Before detecting that the cabinet door 110 of the item storage device 10 is closed, if it is detected that the first item storage area changes from an empty state to a contained state, it is determined that the first item is stored in the first item storage area, and the item information of the first item is bound to the location information of the first item storage area. The first item storage area is any item storage area.

[0055] In some embodiments, each item storage area 122 provided in the cabinet 120 is equipped with a second presence sensing device 126 for sensing whether an item is placed in the item storage area 122, that is, the second presence sensing device 126 is used to sense whether the item storage area is in an empty state or a contained state, wherein the second presence sensing device 126 can be a gravity sensor, an induction switch or an infrared sensor.

[0056] In some embodiments, in step S102, before obtaining a sensing signal indicating that the cabinet door 110 of the item storage device 10 is closed, if a sensing signal indicating that an item has been placed in the first item storage area is obtained, then it indicates that the first item storage area has changed from an empty state to a contained state.

[0057] In some embodiments, in order to more accurately identify whether the item placed in the first item storage area is the first item previously located in the item identification area 121, step S102 may include: before obtaining the sensing signal indicating that the cabinet door 110 of the item storage device 10 is closed, if it is detected that the first item storage area changes from an empty state to a contained state, and the item identification area 121 changes from a contained state to an empty state, it is determined that the first item is taken out of the item identification area 121 and stored in the first item storage area, and the item information of the first item is bound to the location information of the first item storage area.

[0058] In some embodiments, before binding the item information of the first item with the location information of the first item storage area, the process further includes: sending an item replacement request for the first item storage area to server 20 based on the user's selection of the first item storage area, so that server 20 unbinds the original item information bound to the location information of the first item storage area. After unbinding the original item information from the location information of the first item storage area, step S102 is then executed to bind the item information of the first item with the location information of the first item storage area, thereby updating the item information bound to the location information of the first item storage area.

[0059] In some embodiments, if it is detected that the user has performed a selection operation on the first item storage area on the human-computer interaction device (such as a touch screen) of the item storage device 10, a request for item replacement for the first item storage area is initiated to the server 20. In other embodiments, a selection result is received from the terminal device 30, and a request for item replacement for the first item storage area is initiated to the server 20. The selection result is generated based on the user's selection operation on the first item storage area on the terminal device 30.

[0060] The above selection operation is that the user selects an item storage area where items need to be replaced from various item storage areas where items are placed as the first item storage area and clicks the item replacement option for the first item storage area. The above selection operation can be performed after the user takes out the items originally stored in the first item storage area.

[0061] In an embodiment in which the item storage device 10 itself performs information recognition on the item image of the first item, correspondingly, binding the item information of the first item with the location information of the first item storage area in step S102 may include: the item storage device 10 locally binds the item information of the first item with the location information of the first item storage area.

[0062] In an embodiment in which the server 20 performs information recognition on the item image of the first item, correspondingly, binding the item information of the first item with the location information of the first item storage area in step S102 may include: sending a binding request to the server 20, so that the server 20 binds the item information of the first item with the location information of the first item storage area according to the binding request; and receiving a success prompt fed back by the server 20, wherein the success prompt is used to prompt that the item information of the first item and the location information of the first item storage area are successfully bound.

[0063] In some embodiments, sending a binding request to the server 20 includes: outputting the item information of the first item and the location information of the first item storage area to the user; and sending a binding request to the server 20 based on the user's operation on the item information of the first item and / or the location information of the first item storage area.

[0064] In some embodiments, the operations that the user can perform include a confirmation operation, wherein the confirmation operation indicates that the user does not need to modify the above-mentioned location information and item information. Therefore, based on the user's operation on the item information of the first item and / or the location information of the first item storage area, a binding request is sent to the server 20, including: if the user's confirmation operation is detected within the first preset time limit, sending a binding request to the server 20; if the user's confirmation operation is not detected within the first preset time limit, sending a binding request to the server 20 after the countdown of the first preset time limit ends.

[0065] In some embodiments, in addition to outputting the item information of the first item and the location information of the first item storage area to the user, first prompt information is also output to the user, and the first prompt information is used to prompt the user to operate on the item information of the first item and / or the location information of the first item storage area.

[0066] In some embodiments, the operations that the user can perform on the item information of the first item and the location information of the first item storage area also include editing operations, which are operations used to modify the item information of the first item and / or the location information of the first item storage area.

[0067] In some embodiments, the item storage management method may further include: after outputting the item information of the first item and the location information of the first item storage area to the user, if a user editing operation is detected within a first preset time limit, updating the item information of the first item and / or the location information of the first item storage according to the editing operation, wherein the editing operation includes: correcting erroneous information, adding remarks information, deleting unnecessary information, etc. Updating the location information of the first item storage may be changing the location information of the first item storage area to the location information of other item storage areas to achieve correction of the location information.

[0068] It will be appreciated that, in the embodiment where the item storage device 10 itself performs information recognition on the item image of the first item, the item information of the first item and / or the location information of the first item is updated locally on the item storage device 10 based on the edit operation. In the embodiment where the server 20 performs information recognition on the item image of the first item, an update request is initiated to the server 20 based on the edit operation, so that the server 20 updates the item information of the first item and / or the location information of the first item.

[0069] In some embodiments, the item storage management method provided by the present invention may further include: if it is detected that the second item is taken out from the second item storage area, detecting within a third time limit whether a third item storage area has changed from an empty state to an accommodated state, where the second item storage area is any one of the multiple item storage areas that is in an accommodated state; if so, it indicates that the second item has been transferred to the third item storage area, and then the item information of the second item is unbound from the location information of the second item storage area, and the item information of the second item is bound to the location information of the third item storage area; if not, it indicates that the second item has been taken out of the item storage device 10, and the item information of the second item is unbound from the location information of the second item storage area. Through the above process, when the storage location of an item in the item storage device 10 changes or is taken out, the location information bound to the item information of the item is automatically updated.

[0070] It can be understood that in an embodiment in which the server 20 performs information recognition on the item image of the first item, the item storage device 10 sends a binding and unbinding request to the server 20, so that the server 20 unbinds the item information of the second item from the location information of the second item storage area, and binds the item information of the second item with the location information of the third item storage area.

[0071] It can be understood that in an embodiment in which the item storage device 10 itself performs information recognition on the item image of the first item, the item storage device 10 locally unbinds the item information of the second item from the location information of the second item storage area, and locally binds the item information of the second item with the location information of the third item storage area.

[0072] To facilitate understanding of the article storage management method provided by the present invention, an interactive embodiment is provided below, taking an example in which the article management device is a wine cabinet for storing wine, and the wine cabinet is provided with a wine identification area and multiple wine storage areas:

[0073] Step S1: The wine cabinet detects whether its door is opened. After the door is opened, the user can put wine into the wine identification area;

[0074] Step S2: The first presence sensing device disposed in the wine identification area generates a sensing signal indicating that wine is located in the wine identification area, triggering the wine cabinet to execute step S3;

[0075] Step S3: The wine cabinet activates the image acquisition device installed in the wine recognition area to take a picture of the wine placed therein, obtains an image of the wine, and uploads the image of the wine to the server;

[0076] Step S4: The server identifies the wine image. If the wine information is successfully identified from the wine image, the process proceeds to step S5. If the wine information is not successfully identified from the wine image, the process proceeds to step S5′.

[0077] Step S5': The server feeds back a second prompt message to the wine cabinet, which then outputs a second prompt message to the user to indicate that the recognition was unsuccessful and to prompt the user to adjust the position of the wine within the wine recognition area. The wine cabinet detects within n time whether the wine has been adjusted. If so, the process returns to step S3.

[0078] Step S5: The server records the wine information of the wine and feeds back a prompt indicating successful recognition to the wine cabinet, and then proceeds to step S6;

[0079] Step S6: After the wine cabinet receives the prompt indicating successful recognition, it checks whether its cabinet door is closed. If not, it proceeds to steps S7 to S10. If so, the process ends.

[0080] Step S7: The wine cabinet detects whether any storage area has changed from an empty state to a storage state. If so, the wine cabinet feeds back the identified wine information and the location information of the storage area that has changed from an empty state to a storage state to the wine cabinet and / or the terminal device, prompts the user to bind the wine within m time, and starts a countdown of m time.

[0081] Step S8: The wine cabinet and / or terminal device detects whether the user performs a confirmation operation within the countdown of m time. If so, the process proceeds to step S9; if not, the process proceeds to step S10. If no user confirmation operation is detected within the m time, the process proceeds to step S9 after the countdown of m time ends.

[0082] Step S9: The wine cabinet or terminal device initiates a binding request to the server. The server binds the identified wine information and location information according to the binding request, and sends a successful notification to the terminal device and / or wine cabinet indicating that the binding is successful.

[0083] Step S10: The wine cabinet and / or terminal device detects whether the user performs an editing operation within the countdown of m time. If so, an update request is sent to the server based on the editing operation, so that the server updates the wine information and location information and returns to step S8.

[0084] Based on the same inventive concept, the present invention provides an article storage management device, which is applied to an article storage device. The article storage device includes an article identification area and multiple article storage areas. An image acquisition device is installed in the article identification area, such as Figure 5As shown, the article storage management device includes: an information acquisition unit 501, which is used to obtain the article information of the first article through the image acquisition device if it is detected that the first article is placed in the article identification area; a binding unit 502, which is used to determine that the first article is stored in the first article storage area if it is detected that the first article storage area changes from a vacant state to a contained state before the cabinet door of the article storage device is detected to be closed, and bind the article information of the first article with the location information of the first article storage area, where the first article storage area is any one of the multiple article storage areas.

[0085] In some embodiments, the item storage management device also includes an unbinding unit, which is used to: before binding the item information of the first item with the location information of the first item storage area, send an item replacement request for the first item storage area to the server based on the user's selection operation of the first item storage area, so that the server unbinds the original item information bound to the location information of the first item storage area.

[0086] In some embodiments, the information acquisition unit 501 includes: a first image acquisition unit, configured to photograph a target position within the item identification area through the image acquisition device to obtain an item image of the first item, where the target position is the position of the first item within the item identification area; an image sending unit, configured to send the item image of the first item to a server so that the server performs information recognition on the item image of the first item; and receive item information of the first item fed back by the server, where the item information of the first item is obtained by the server from the item image.

[0087] In some embodiments, the information acquisition unit 501 further includes: an information output unit, configured to output control information sent by the server upon receipt of the control information, wherein the control information is sent by the server when the item information of the first item is not identified from the item image, and the control information is used to adjust the first item within the item identification area; and a second image acquisition unit, configured to return to executing the step of photographing the target position within the first item storage area by the image acquisition device after detecting that the first item has been adjusted, so as to reacquire the item image of the first item.

[0088] In some embodiments, the binding unit 502 includes: a request sending unit, used to send a binding request to the server, so that the server binds the item information of the first item with the location information of the first item storage area according to the binding request; a success receiving unit, used to receive a success prompt fed back by the server, and the success prompt is used to prompt that the item information of the first item and the location information of the first item storage area are successfully bound.

[0089] In some embodiments, the request sending unit includes: an information output subunit, used to output the item information of the first item and the location information of the first item storage area; and a sending execution subunit, used to send a binding request to the server based on the user's operation on the item information of the first item and / or the location information of the first item storage area.

[0090] In some embodiments, the sending execution subunit is used to: if a user confirmation operation is detected within a first preset time limit, send a binding request to the server; if no user confirmation operation is detected within the first preset time limit, send a binding request to the server after the countdown of the first preset time limit ends.

[0091] In some embodiments, the item storage management device further includes: an updating unit, configured to update the item information of the first item and / or the storage location of the first item according to the editing operation if an editing operation of the user is detected within the first preset time limit.

[0092] In some embodiments, the item storage management device also includes: a status detection unit, which is used to detect whether there is a third item storage area that changes from an empty state to a contained state within a third time limit if it is detected that the second item is taken out from the second item storage area, and the second item storage area is any one of the multiple item storage areas that is in a contained state; a binding and unbinding unit, which is used to: if it exists, it indicates that the second item is transferred to the third item storage area, then the item information of the second item is unbound from the location information of the second item storage area, and the item information of the second item is bound to the location information of the third item storage area; if it does not exist, it indicates that the second item is taken out of the item storage device, and the item information of the second item is unbound from the location information of the second item storage area.

[0093] Based on the same inventive concept, the embodiment of the present invention further provides an article storage device 10, referring to Figure 1 As shown, the article storage device 10 includes: a cabinet 120 and a cabinet door 110, an article identification area 121 and multiple article storage areas 122 are set in the cabinet, and an image acquisition device 123 is installed in the article identification area 121. Figure 6 As shown, the item storage device 10 further includes: a processor 602; and a memory 604 for storing processor-executable instructions, wherein the processor 602 is configured to execute the instructions to implement the item storage management method described in any of the above embodiments.

[0094] Among them, Figure 6 In the embodiment of the present invention, a bus architecture (represented by bus 600) is shown. Bus 600 may include any number of interconnected buses and bridges, and bus 600 links various circuits including one or more processors represented by processor 602 and memory represented by memory 604. Bus 600 may also link various other circuits such as peripherals, voltage regulators, and power management circuits, which are well known in the art and therefore will not be described further herein. Bus interface 606 provides an interface between bus 600 and receiver 601 and transmitter 603. Receiver 601 and transmitter 603 may be the same component, namely a transceiver, which provides a unit for communicating with various other devices over a transmission medium. Processor 602 is responsible for managing bus 600 and general processing, while memory 604 may be used to store data used by processor 602 when performing operations.

[0095] Based on the same inventive concept, the present invention provides a computer-readable storage medium on which a computer program is stored, characterized in that when the program is executed by a processor, the item storage management method described in any embodiment of the first aspect is implemented.

[0096] The present invention is described with reference to flowcharts and / or block diagrams of methods, devices (systems), and computer program products according to embodiments of the present invention. It should be understood that each process and / or block in the flowcharts and / or block diagrams, as well as combinations of processes and / or blocks in the flowcharts and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowcharts and / or block diagrams. Figure 1 a process or multiple processes and / or boxes Figure 1 A device that performs the functions specified in one or more boxes.

[0097] These computer program instructions may also be stored in a computer readable memory that can direct a computer or other programmable data processing device to work in a specific manner, so that the instructions stored in the computer readable memory produce an article of manufacture including an instruction device, which implements the process Figure 1 a process or multiple processes and / or boxes Figure 1 The function specified in one or more boxes.

[0098] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operational steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing the instructions executed on the computer or other programmable device for implementing the process. Figure 1 a process or multiple processes and / or boxes Figure 1 A step that specifies a function in one or more boxes.

[0099] Although the preferred embodiments of the present invention have been described, those skilled in the art may make additional changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of the present invention.

[0100] Obviously, those skilled in the art may make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, if such changes and modifications fall within the scope of the claims and their equivalents, the present invention is intended to include such changes and modifications.

[0101] The foregoing description is merely an embodiment of the present invention and is not intended to limit the present invention. Those skilled in the art will readily appreciate that various modifications and variations of the present invention are possible. Any modifications, equivalent substitutions, or improvements made within the spirit and principles of the present invention are intended to be within the scope of the claims.

Claims

1. A method for managing the storage of items in an item storage device, characterized in that: The article storage device includes a cabinet body and a cabinet door, wherein an article identification area and a plurality of article storage areas are provided in the cabinet body, and an image acquisition device is installed in the article identification area. The method includes: If it is detected that a first object is placed in the object identification area, the object information of the first object is acquired by the image acquisition device; Before detecting that the cabinet door of the item storage device is closed, if it is detected that the first item storage area changes from an empty state to a contained state, it is determined that the first item is stored in the first item storage area, and the item information of the first item is bound to the location information of the first item storage area, and the first item storage area is any one of the multiple item storage areas.

2. The method according to claim 1, wherein Before binding the item information of the first item with the location information of the first item storage area, the method further includes: According to the user's selection operation on the first item storage area, an item replacement request for the first item storage area is sent to the server, so that the server unbinds the original item information bound to the location information of the first item storage area.

3. The method according to claim 1, wherein The acquiring the item information of the first item by the image acquisition device includes: photographing a target position in the object identification area by the image acquisition device to obtain an object image of the first object, wherein the target position is a position of the first object in the object identification area; sending the image of the first article to a server, so that the server can perform information recognition on the image of the first article; Receive item information of the first item fed back by the server, where the item information of the first item is obtained by the server from identifying the item image.

4. The method according to claim 3, wherein The acquiring the item information of the first item by the image acquisition device further includes: outputting, if receiving control information sent by the server, the control information being sent by the server when the server fails to recognize the object information of the first object from the object image, the control information being used to adjust the first object within the object recognition area; After detecting that the first article has been adjusted, the method returns to the step of photographing the target position in the first article storage area by the image acquisition device to reacquire the article image of the first article.

5. The method according to claim 3, wherein Binding the item information of the first item with the location information of the first item storage area includes: sending a binding request to the server, so that the server binds the item information of the first item with the location information of the first item storage area according to the binding request; A success prompt fed back by the server is received, where the success prompt is used to prompt that the item information of the first item is successfully bound to the location information of the first item storage area.

6. The method according to claim 5, wherein Sending a binding request to the server, including: outputting item information of the first item and location information of the first item storage area; A binding request is sent to the server according to the user's operation on the item information of the first item and / or the location information of the first item storage area.

7. The method according to claim 6, wherein The sending a binding request to the server according to the user's operation on the item information of the first item and / or the location information of the first item storage area includes: If a confirmation operation of the user is detected within a first preset time limit, a binding request is sent to the server; If no confirmation operation of the user is detected within the first preset time limit, a binding request is sent to the server after the countdown of the first preset time limit ends.

8. The method according to claim 7, wherein Before sending the binding request to the server, the method further includes: If an editing operation of the user is detected within the first preset time limit, the item information of the first item and / or the storage location of the first item are updated according to the editing operation.

9. The method according to any one of claims 1 to 8, wherein: Also includes: If it is detected that a second item is taken out from a second item storage area, detecting whether the third item storage area changes from an empty state to an accommodated state within a third time limit, the second item storage area being any item storage area in the plurality of items being accommodated; If so, it indicates that the second item has been transferred to the third item storage area, and the item information of the second item is unbound from the location information of the second item storage area, and the item information of the second item is bound to the location information of the third item storage area; If not, it indicates that the second item is taken out of the item storage device, and the item information of the second item is unbound from the location information of the second item storage area.

10. An article storage management device for an article storage device, characterized in that: The article storage device includes an article identification area and multiple article storage areas. An image acquisition device is installed in the article identification area. The article storage management device includes: an information acquisition unit, configured to acquire object information of the first object through the image acquisition device upon detecting that the first object is placed in the object identification area; A binding unit is used to determine that the first item is stored in the first item storage area if it is detected that the first item storage area changes from an empty state to a contained state before the cabinet door of the item storage device is detected to be closed, and to bind the item information of the first item with the location information of the first item storage area, where the first item storage area is any one of the multiple item storage areas.

11. An article storage device, characterized in that: include: The cabinet body and cabinet door are provided with an article identification area and multiple article storage areas in the cabinet body, and an image acquisition device is installed in the article identification area. A processor; a memory for storing instructions executable by the processor, wherein the processor is configured to execute the instructions to implement the article storage management method according to any one of claims 1 to 8.

12. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the article storage management method described in any one of claims 1 to 8 is implemented.

Images