Method for creating an inventory management system for a warehouse facility and data glasses

Abstract

The invention relates to a method for creating a merchandise management system for a storage facility (3), comprising the following steps using data glasses (1) and a digital camera (12): - Recording the process of putting a stored item (2) into the storage facility (3) using the digital camera (12) to create a putting-in video sequence, - Performing object recognition (6) of the stored goods (2) using the storage video sequence created during storage, - Determining a storage location where the identified stored item (2) is placed, based on the storage video sequence created during storage, - Inventory (7) of the stored goods (2) and their storage location, - Creating a video sequence of the removal of stored goods (2) from the storage facility (3) using the digital camera (12), - Performing object recognition (6) of the removed stored goods (2) using the removal video sequence, and - Inventory (7) of the removed stored goods (2). Furthermore, the invention relates to data glasses (1) with a control unit and a digital camera (12) which is configured and designed to perform a method according to one of the preceding claims.

Description

[0001] The invention relates to smart glasses and a method for creating an inventory management system for a storage facility. There is a need for an automatically reordering storage facility. This requires tracking which goods are stored in the facility and how much of each individual item is present. In particular, this information determines which goods need to be reordered. When implementing such an inventory management system using sensors, there are significant limitations due to masking effects on the stored goods. It is known to permanently integrate sensors into the storage facility for the inventory management system. However, it must be ensured that masking of stored goods does not cause the inventory management system to malfunction.However, this is problematic because goods stored in the second or third row of the storage facility are obscured by goods in front of them, making them impossible to detect using imaging sensors.

[0002] The invention thus addresses the problem of providing a method for creating a merchandise management system for a storage facility and a device designed for carrying out the method, with which the aforementioned problems are overcome.

[0003] According to the invention, this problem is solved by a method with the features of claim 1 and by data glasses with the features of claim 9. Advantageous embodiments and further developments of the invention are described in the dependent claims below.

[0004] The invention relates to a method for creating an inventory management system for a storage facility, comprising the following steps using data glasses and a digital camera: - Recording the process of putting goods into storage facilities using a digital camera to create a video sequence of the process, - Performing object recognition of the stored goods based on the storage video sequence created during the storage process, - Determining a storage location where the identified goods are placed, based on the storage video sequence created during the stocking process, - Inventorying the stored goods and their storage location, - Creating a video sequence of the process of removing stored goods from the warehouse using a digital camera, - Performing object recognition of the removed warehouse goods based on the removal video sequence, and - Inventorying the removed warehouse stock.

[0005] The advantages achievable with the invention are that the sensors for creating the inventory management system are located outside the storage facility, thus eliminating disadvantages due to obscuration effects, since the video stream from the smart glasses records and analyzes the loading and unloading of the stored goods. Furthermore, the storage facility does not become more expensive because no additional sensors are required. In addition, the setup of the inventory management system is automated, and it is also automatically updated when goods are removed from the storage facility.

[0006] During the process, a user of the storage facility wears smart glasses. The digital camera can be part of the smart glasses or a separate digital camera functionally connected to them. While stocking the storage facility, the user wears the smart glasses and records the stocking process via a video sequence. Object recognition is performed using the smart glasses. Furthermore, the smart glasses record where the identified stock is placed for storage. This maps the stocking process into the inventory management system. Checking out the stock from the inventory management system works similarly. Because the stock and its location are known, the user's smart glasses record the removal of the stock and identify the removed stock.In this way, the inventory management system for the warehouse facility is created.

[0007] In a preferred embodiment, while performing object recognition of the stored goods based on the storage video sequence, additional information about the stored goods is also determined. This allows for the registration of further relevant information. Preferably, this information includes the best-before date of the stored goods. Preferably, this information is also displayed to the user via smart glasses.

[0008] In a preferred embodiment, object recognition via voice input is also performed during the object recognition of the stored goods based on the loading or unloading video sequence. This embodiment is advantageous if an item to be loaded or unloaded is not recognized during object recognition. In such cases, the information can be quickly and easily supplemented and / or corrected using a voice assistant. Therefore, it is preferable to perform object recognition via voice input during the object recognition of the stored goods based on the loading or unloading video sequence if the object recognition of the loaded or unloaded goods based on the loading or unloading video sequence indicates that no item was recognized or that the user classifies this recognition as erroneous. The output can be audible and / or visual.Preferably, the output is displayed to the user via data glasses.

[0009] Preferably, the object recognition process involves a user initiating the process and positioning the item to be stored or removed in front of the smart glasses. This ensures that the user intends to initiate object recognition and wants to store or remove the item.

[0010] In a preferred embodiment, the method further includes displaying inventory information for the stored goods in the storage facility using smart glasses when a user wearing the smart glasses views the storage facility and its stored goods. Preferably, the inventory information is displayed via the smart glasses. This inventory information includes a description of each inventoried item. This allows the user to see the stock level of the storage facility, even if they do not intend to store or retrieve any goods.

[0011] In a preferred embodiment, the storage device is a refrigerator, a freezer, or a wine cabinet. The method can also be carried out using a pantry, a larder, or a storage cellar as the storage device.

[0012] Preferably, the stored goods consist of a foodstuff. The foodstuff can be packaged or unpackaged.

[0013] The invention further relates to smart glasses with a control unit and a digital camera, which are configured and designed to perform a method according to one or more of the embodiments described above. The digital camera is preferably integrated into the smart glasses.

[0014] An embodiment of the invention is shown schematically in the drawings and is described in more detail below. It is shown schematically and not to scale. Fig. 1 to 8 each individual step of a method according to the invention using data glasses according to the invention.

[0015] Fig. Figures 1 to 8 each show individual steps of a method according to the invention using data glasses according to the invention. The data glasses 1 have a digital camera 12 and are worn by a user 4, whose hand can be seen in some of the figures. The storage device 3 is a refrigerator.

[0016] In Fig. Figure 1 schematically shows the recording of the stocking process of a storage item 2, in the form of a strawberry yogurt with a best-before date of February 18, 2024, into a storage facility (not shown here) using a digital camera 12 to create a stocking video sequence and the performance of object recognition 6 of the stored item 2 based on the stocking video sequence created during stocking. The performance of object recognition 6 involves the user 4 initiating the object recognition process 6 and positioning the storage item 2 in front of the smart glasses 1. The performance of object recognition 6 is then displayed 9 via the smart glasses 1.

[0017] In Fig. Figure 2 depicts an inventory 7 of the stored goods 2 and their storage location. However, the determination of a storage location (not shown) where the recognized goods 2 are placed, based on the storage video sequence created during the storage process, is not shown. During object recognition 6 of the stored goods 2, the inventory 7 also includes information 8 on the goods 2, such as the best-before date (BBD). The inventory 7 is displayed 9 using the data glasses 1.

[0018] In Fig. 3 is a display 9 of inventory information 5 for the stored goods 2 in storage facility 3, shown using the data glasses 1, when the user (not shown) using the data glasses 1 looks at storage facility 3 including the stored goods 2. The user receives an inventory overview in the form of inventory information 5 and stored goods information 8. Inventory information 5 is the respective name of the stored goods 2 and stored goods information 8 is information about the stored goods 2 such as the best-before date (BBD). In particular, after the in Fig. In the inventory shown in Figure 2, the user wearing the data glasses 1 receives the inventory overview, which includes the inventory information 5 and information 8 about the inventoried stored goods 2, when the user 4 is standing in front of the open storage facility 3. Fig. 4 is a variant of the Fig. Figure 3 shows the information in list form.

[0019] Fig. Step 5 represents a step of object recognition 6, while the user holds the stored item 2 in front of the data glasses 1 with digital camera 12. The object recognition 6 is running and a display 9 of the object recognition 6 is carried out via the data glasses 1. In particular, if the object recognition 6 is unsuccessful, a subsequent step is carried out which is in Fig. Figure 6 is shown. During the object recognition process 6 of the stored goods 2 using the storage video sequence or the unloading video sequence, object recognition 6 is continued via voice input 10, particularly if the initial object recognition 6 is unsuccessful. For this purpose, a voice assistant (not shown) of the smart glasses 1 is trained, and object recognition 6 is performed via voice input from the user (not shown). The inventory is carried out as described in Figure 6. Fig. 2 described.

[0020] In Fig. Figure 7 shows the creation of a video sequence of the removal of stored goods 2 from storage unit 3 using the digital camera 12. The user 4 removes the stored goods 2, in the form of strawberry yogurt, from storage unit 3 as indicated by the arrow, while inventory information 5 and the stored goods information 8 are displayed using data glasses 1. Then, object recognition (not shown) of the removed stored goods 2 is performed based on the video sequence. Subsequently, as in Fig. 8 shows an inventory 7 of the cleared storage goods 2 including inventory information 5 and storage goods information 8 being carried out, with a display 9 being performed using the data glasses 1. Reference symbol list 1 data glasses 2. Stored goods 3 Storage facility 4 users 5 Inventory Information 6 Object Recognition 7. Inventory 8. Information about stored goods 9 ads 10 Voice input 12 Digital camera

Claims

[1] Method for creating a merchandise management system for a storage facility (3) comprising the following steps using data glasses (1) and a digital camera (12): - Recording the process of putting a stored item (2) into the storage facility (3) using the digital camera (12) to create a putting-in video sequence, - Performing object recognition (6) of the stored goods (2) using the storage video sequence created during storage, - Determining a storage location where the identified stored item (2) is placed, based on the storage video sequence created during storage, - Inventory (7) of the stored goods (2) and their storage location, - Creating a video sequence of the removal of stored goods (2) from the storage facility (3) using the digital camera (12), - Performing object recognition (6) of the removed stored goods (2) using the removal video sequence, and - Inventory (7) of the removed stored goods (2). [2] Method according to claim 1, characterized by , that during the performance of object recognition (6) of the stored goods (2), information about the stored goods (8) is further determined using the storage video sequence. [3] Method according to claim 2, characterized by , that the stored goods information (8) includes the minimum shelf life of the stored goods (2). [4] Method according to any of the preceding claims, characterized by , that while performing object recognition (6) of the stored goods (2) using the storage video sequence or the removal video sequence, object recognition (6) is also performed via voice input (10). [5] Method according to any of the preceding claims, characterized by, that performing object recognition (6) involves starting object recognition (6) by means of a user (4) and positioning the stored goods (2) to be put in or taken out in front of the data glasses (1). [6] Method according to any of the preceding claims, characterized by a display (9) of inventory information (5) of the stock (2) inventoried in the storage facility (3) using the data glasses (1) when a user (4) using the data glasses (1) looks at the storage facility (3) together with the stock (2). [7] Method according to any of the preceding claims, characterized by , that the inventory information (8) continues to be displayed. [8] Method according to any of the preceding claims, characterized by that the storage facility (3) is a refrigerator, a freezer or a wine cabinet and / or that the stored goods (2) comprise a foodstuff. [9] Data glasses (1) comprising a control unit and a digital camera (12) configured and designed to perform a method according to one of the preceding claims.

Images