Device comprising camera device

Abstract

The invention relates to a device for a logistics center, in particular an industrial cargo warehouse, comprising: a camera device for detecting a plurality of items placed on a placement surface throughout the field of view of the camera device; a projection device for projecting information related to the detection; and an electronic control device, which is in signal connection with the camera device and the projection device and is configured to individually detect the articles by means of image analysis and to display, by projection, the pickup of the respective articles from the placement surface and / or the detection of the placement of the respective articles onto the placement surface in a visually recognizable manner.

Description

Technical Field

[0001] The invention relates to a device for a logistics center, in particular an industrial goods warehouse, comprising a camera device for detecting a plurality of objects placed on a placement surface within the entire field of view of the camera device. Background Art

[0002] For example, in logistics centers, handheld scanners are often used to detect objects to be handled. If an object is moved to another location, this is usually registered with the aid of a handheld scanner. Thus, for example, the picking up of an object from a shelf or the placing of an object in a shelf can be recorded by warehouse software, whereby electronic tracking for determining the current location of the object can be achieved. However, such a process requires many handheld scanners and a large number of such registration processes. Furthermore, with known applications, the person moving the object cannot easily recognize whether the picking up or placing was actually also correctly detected. Summary of the invention

[0003] It is therefore an object of the present invention to provide a device which makes it possible to simplify the detection of objects while at the same time making it possible to increase the reliability.

[0004] This object is achieved by an apparatus having the features of an embodiment and in particular comprising: a projection device for projecting information related to the detection; and an electronic control device, which is signal-connected to the camera device and the projection device. The electronic control device is configured to detect the objects individually by means of image analysis and to display the detection of the picking up of the individual objects from the placement surface and / or the placement of the individual objects on the placement surface in a visually recognizable manner by projection.

[0005] The placement surface may comprise, for example, one or more tables and / or one or more shelves (e.g., multiple shelves, preferably at different heights) suitable for placement. The camera device comprises a plurality of individual cameras and is configured such that the entire field of view of the camera device covers the desired area depending on the application and the items therein. In a very simple version, generally only one camera can also be envisaged, wherein the device should already include at least two or three cameras to detect only one item. By using a plurality of cameras, a plurality of independent sensor data can be used for detection, whereby the device according to the invention enables the reliability of the detection to be increased. Since the items no longer have to be registered with a handheld scanner, but the pick-up and / or placement is automatically detected by means of the camera device, the device according to the invention also makes it possible to simplify the detection. Advantageously, a plurality of cameras, which are usually present in a logistics center anyway for example for security reasons, can be part of the camera device or form the camera device. Since no or only a few additional cameras need to be installed, the design of the device can be further simplified, and therefore the detection is simplified.

[0006] The items are detected individually by the electronic control device with the aid of a camera device. The detection of the picking up of the corresponding item from the placement surface and / or the placing of the corresponding item on the placement surface is displayed in a visually recognizable manner by projection. It will be appreciated that the projections may be appropriately different for the detection of picking up and putting down. Due to the projection, the person moving the item can immediately visually recognize whether the device has also actually correctly detected the picking up and / or placing. For example, if the item is placed on the placement surface and the corresponding projection is not displayed, it can be immediately recognized that the placement was not erroneously detected by the device. Therefore, erroneous detections can be directly identified and countermeasures can be taken immediately. Therefore, via the projection device and the camera device, ultimately only the interaction between the person and the device can be achieved, thereby improving the reliability of the device.

[0007] Advantageous embodiments of the invention emerge from the examples, the description and the drawings.

[0008] It can be provided that the projection device is configured, for example by its orientation and / or the electronic control device, to display the projection on a surface accessible to the projection within the entire field of view of the camera device. This makes it easy to reliably display the projection within the entire field of view of the camera device. In principle, any surface is accessible to the projection if there is nothing along the connecting line between the surface and the projection device that would prevent the projection from being displayed on the surface. The projection device and / or the electronic control device can also be configured to display the projection on an information label or price label of an item, in particular a corresponding pick-up and / or placement item, within the entire field of view of the camera device. Such labels are usually located in an easily visible position, for example on the visible edge of a shelf under the corresponding item. Therefore, when picking up and / or placing an item, the display of the projection on such a label is in the direct field of view, whereby it can be easily and reliably identified whether the pick-up and / or placement is correctly or incorrectly detected. If the picked-up item is not placed in the position where it was picked up, but is placed on the placement surface together with another item, the projection can, for example, occur on the label of the other item. Thus, for this case, it is also possible to reliably identify in a simple manner whether the placement is correctly or incorrectly detected. Alternatively or additionally, the projection can occur directly on the corresponding article. Here, when picking up and / or placing the article, the display of the projection is also in the direct field of view, so that it can be reliably identified in a simple manner whether the picking up and / or placing is correctly or incorrectly detected.

[0009] The projection preferably includes an image, a symbol, a logo and / or an item name. For example, the detection of picking up can be displayed by the projection of a first symbol (e.g., a plus sign), and / or the detection of placing can be displayed by the projection of a second symbol (e.g., a minus sign), and vice versa. With this projection, the detection of picking up and / or placing can thus be displayed in a simple, intuitive and reliably identifiable manner. Alternatively or additionally, the projection can also be color-coded. For example, the detection of picking up an item can be displayed by projecting the item name in green. The detection of placing can be displayed by projecting the item name in red. Therefore, on the one hand, it is reliably identifiable whether picking up or placing is correctly detected by color coding. With the aid of the displayed item name, it is further reliably identifiable whether the placement of the item actually placed is also correctly detected or whether the placement of another item is erroneously detected. This is particularly advantageous if, for example, the picked up item is not placed at the position where it is picked up, but is placed on the placement surface together with another item. Therefore, the detection of picking up and / or placing can also be displayed in a simple, intuitive and reliably identifiable manner by the corresponding display of the projection.

[0010] The electronic control device may preferably be configured to display the projection for a predetermined duration. In this respect, the duration is predetermined such that the projection can be identified within the duration. Accordingly, the projection can be reliably identified. For example, the duration may be 3 or 10 seconds.

[0011] Furthermore, the projection device can be designed as a laser projector and / or a video projector. The projection by means of a laser projector is generally clearly recognizable even under unfavorable conditions (for example in the case of dirt deposited on the projection surface) and on almost all surfaces (i.e., in particular independently of the surface material, the surface structure and the reflective behavior of the surface) (as long as the surface is accessible to the projection). Furthermore, with the aid of a laser projector, the projection can also be displayed in a clearly recognizable manner on accessible surfaces at a distance. With the aid of a video projector, the projection can easily be displayed in different colors. However, the projection device can also include a plurality of laser projectors and / or video projectors. Accordingly, in particular by appropriately arranging a plurality of laser projectors and / or video projectors, additional surfaces accessible to the projection can be obtained. By using a plurality of laser projectors, the projection can also be displayed in different colors.

[0012] Advantageously, the device has a force sensor device arranged at the placement surface, and the electronic control device is connected to the force sensor device by signal. Alternatively or additionally, the device may also include an RFID reading device, and the electronic control device is connected to the RFID reading device by signal. The electronic control device can be configured to also detect the picking up of the corresponding item from the placement surface and / or the placement of the corresponding item on the placement surface by means of the force sensor device and / or the RFID reading device. Since a large amount of independent sensor data can be used for detection accordingly, the reliability of the device can be further improved during detection. In the case of an RFID reading device, the item must have a corresponding RFID transponder, which can be read by the RFID reading device. The item usually has an RFID transponder anyway, in particular to prevent theft. These RFID transponders can be advantageously used for the described detection of the picking up of the corresponding item from the placement surface and / or the placement of the corresponding item on the placement surface, thereby further simplifying the detection.

[0013] The device is preferably configured as a device arranged in a fixed manner, i.e., permanently mounted, for example, on a building ceiling of a logistics center. Alternatively or additionally, the projection device can be arranged at the camera of the camera device, in particular forming a unit with the camera. If the projection device comprises a plurality of laser projectors and / or video projectors, these can, for example, be arranged at the respective cameras of the camera device, in particular forming a respective unit with the respective camera. According to this, the installation work of the device can be reduced, whereby the design of the device can be further simplified, and thus the detection can be simplified.

[0014] The electronic control device can be configured in particular to display navigation along the path leading to the corresponding item in a visually recognizable manner through the projection of the projection device. To this end, the electronic control device can have a signal input and can be configured to receive information about the corresponding item to be navigated via the signal input. For example, a person not shown can select the item that the person wants to locate by means of an application on a mobile terminal device. The electronic control device can receive information about the selected item via the signal input. In addition, the electronic control device can be configured to access information related to the corresponding placement position of the item present in the entire field of view. For example, the information can be retrieved from an external database by the electronic control device. In addition, the electronic control device can be configured to identify the person who has selected the item and wants to navigate to it by means of a camera device, and thus identify the current position of the person. The electronic control device can be additionally configured to identify the current position of the mobile terminal device, for example, via the GPS positioning function of the mobile terminal device, and thus identify the position of the person. Using the projection device, the electronic control device can navigate the person along the path to the selected item by, for example, the projection of one or more arrows. In this regard, the electronic control device can be configured to update the projection by continuously comparing the identified current position with the placement position of the item. The electronic control device can also be configured to highlight the selected item in a visually recognizable manner by means of a projection device if the position in front of the item being sought is identified as the current position, that is, if the person has reached the placement position of the item being sought. For example, the highlighting can be performed by projection in the form of an arrow pointing to the selected item or a circle around it. With the help of the projection navigation described, the device makes it easier and faster to locate the corresponding item. It should be understood that these embodiments themselves can also be considered as independent inventions.

[0015] According to a further aspect, the invention also relates to an apparatus for a logistics center, in particular an industrial goods warehouse, comprising: a camera device for identifying a person within the entire field of view of the camera device; a projection device for projecting information related to the identification; and an electronic control device, which is signal-connected to the camera device and the projection device. The electronic control device is configured to identify the person by means of image analysis and to display navigation along a path to a corresponding object of a plurality of objects placed on a placement surface in a visually recognizable manner by means of projection within the entire field of view of the camera device. The electronic control device has a signal input and is configured to receive information about the corresponding object to be navigated via the signal input. It is understood that the apparatus can also be advantageously further improved by the remaining disclosed features.

[0016] The electronic control device is preferably configured to display information about special offers and / or discounts on the price tag and / or directly on the item by projection in a visually recognizable manner within a predetermined time period. Thus, the latest information related to the item can be easily displayed. Thus, the risk of errors caused by expired information related to the item can also be reduced. Alternatively or additionally, the electronic control device can be configured to highlight the corresponding item in a visually recognizable manner by projection within a predetermined time period. For example, the highlighting can be performed by a projection in the form of an arrow pointing to the corresponding item or a circle around it. The device enables the corresponding item to be located simply and quickly by highlighting. In particular, items of frequently used item types can be highlighted. The device can have an electronic interface and can be configured to receive data required for projection from an external device (e.g., a memory device). For example, this can be data defining the item to be displayed for projection and / or predetermining the time period for the projection. In addition, the data can also relate to the content of the projection, such as a discount. It should be understood that these embodiments themselves can also be considered as independent inventions.

[0017] According to another aspect, the invention also relates to an apparatus for a logistics center, in particular an industrial goods warehouse, comprising: a camera device for detecting a plurality of objects placed on a placement surface within the entire field of view of the camera device; a projection device for projecting information related to the goods; and an electronic control device, which is signal-connected to the camera device and the projection device and is configured to detect the objects individually by means of image analysis and, within a predetermined time period, display information about special offers and / or discounts on price tags and / or directly on the objects by projection in a visually recognizable manner, and / or highlight the corresponding objects by projection in a visually recognizable manner. It is understood that the apparatus can also be advantageously further improved by the remaining disclosed features.

[0018] According to a further aspect, the invention relates to a method for a logistics center, in particular an industrial goods warehouse, for detecting a plurality of objects placed on a placement surface by means of a camera device within the entire field of view of the camera device and for projecting information related to the detection by means of a projection device. In the method, the objects are detected individually by means of image analysis. The detection of the picking up of the respective object from the placement surface and / or the placing of the respective object on the placement surface is displayed in a visually recognizable manner by projection.

[0019] The image analysis can usually be performed using an electronic control device according to a standard process. For this purpose, the electronic control device can be configured, for example, to process sensor data of a camera device, a force sensor device and / or an RFID reader device in order to detect and / or identify by means of sensor data fusion and computer vision combined with artificial intelligence.

[0020] Therefore, statements made about the device according to the invention generally apply to the method according to the invention; this applies in particular to the embodiments and advantages. Furthermore, it should be understood that all features mentioned herein can be combined with one another, unless explicitly stated otherwise.

[0021] Furthermore, it should be understood that the device and method according to the invention and its embodiments are explained only by the example of being used in a logistics center. Their use in industrial warehouses, manufacturing plants or supermarkets (especially those without cash registers) is also conceivable. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] The invention will now be described by way of example with reference to the accompanying drawings, in which a schematic outline sketch is shown.

[0023] Figure 1 is a first device according to the present invention;

[0024] Figure 2 is a second device according to the present invention; and

[0025] Figure 3 is a third device according to the present invention. DETAILED DESCRIPTION

[0026] Figure 1 A schematic outline sketch of a first device 11 for a logistics center according to the present invention is shown. The device 11 includes a camera device 13, which is used to detect a plurality of objects 17, 17' placed on a placement surface 15 of a table within the entire field of view 19 of the camera device 13 (illustrated by two dashed lines). In addition, the device 11 includes: a projection device 21 in the form of a laser projector, which is used to project information related to the detection; and an electronic control device 23. The electronic control device 23 is signal-connected to the camera device 13 and the laser projector 21. The signal connection can generally be designed to be wired and / or wireless. In addition, the electronic control device 23 is configured to detect the objects 17, 17' individually by means of image analysis, and to display the detection of the picking up of the individual objects 17, 17' from the placement surface 15 and the placement of the individual objects 17, 17' on the placement surface 15 in a visually recognizable manner through the corresponding projections 25.

[0027] In the exemplary embodiment shown, the camera device 13 comprises three individual cameras (not shown). The arrangement and number of the cameras are selected and implemented so that the entire field of view 19 of the camera device 13 covers the area illustrated by means of two dashed lines and the items 17, 17' therein. A laser projector 21 is arranged at one of the cameras of the camera device 13 and forms a unit therewith, wherein the device 11 is permanently installed at the building ceiling of the logistics center. Furthermore, the laser projector 21 is oriented so that the electronic control device 23 is configured to display a projection 25 on the corresponding information tags 27, 27' of the items 17, 17'.

[0028] The objects 17, 17' are detected individually by the electronic control device 23 via the camera device 13. The picking up of the object 17 from the placement surface 15 by a person not shown is illustrated by way of example, for example, by means of a dashed arrow. The picking up of the object 17 is also detected by the electronic control device 23. The electronic control device 23 is configured such that it displays a projection 25 in the form of a plus sign for a predetermined duration of five seconds on the information tag 27, 27' (i.e. on the information tag 27 of the object 17 in the example shown) by means of the laser projector 21, from which the corresponding object 17, 17' is picked up. In this respect, the display of the plus sign 25 on the information tag 27 is located within the direct field of view of the person when picking up the object 17, whereby the person can reliably recognize in a simple manner whether the picking up is correctly or incorrectly detected. However, if the plus sign 25 is not displayed during the picking up, the person can directly recognize the incorrect detection and immediately take countermeasures.

[0029] The electronic control device 23 is also configured so that - for Figure 1 In the case not shown in the figure - when the person places the picked-up object 17 on the placement surface 15 again, when the placement is detected, the electronic control device 23 displays a projection for a predetermined duration of five seconds in the form of a minus sign on the information tag 27, 27' on which the object 17 is placed by means of the laser projector 21. According to this, during the placement, the display of the minus sign is also in the direct field of view of the person, so that the person can also reliably recognize in a simple way whether the placement is detected correctly or incorrectly.

[0030] Furthermore, the device 11 can have a force sensor device (not shown) arranged at the placement surface 15, to which the electronic control device 23 is signal-connected. Alternatively or additionally, the device 11 can also include an RFID reading device (not shown), to which the electronic control device 23 is signal-connected. The electronic control device 23 can then be configured to detect the picking up of the respective object 17, 17' from the placement surface 15 and / or the placing of the respective object 17, 17' onto the placement surface 15, also by means of the force sensor device and / or the RFID reading device.

[0031] Figure 2 A schematic outline sketch of a second device 11 according to the invention is shown, which device may be generally configured similarly to Figure 1 Device 11. Figure 2 The device 11 shown comprises a camera device 13 for identifying a person within the entire field of view 19 of the camera device 13, a projection device 21 in the form of a laser projector for projecting information related to the identification, and an electronic control device 23. The electronic control device 23 is signal-connected to the camera device 13 and the projection device 21 and is configured to identify the person by means of image analysis. The electronic control device 23 is also configured to display navigation along a path to a respective object 17, 17' of a plurality of objects 17, 17' placed on the placement surface 15 in a visually recognizable manner within the entire field of view 19 of the camera device 13 by means of a projection 25 in the form of an arrow. In addition, the electronic control device 23 has a signal input (not shown) and is configured to receive information about the respective object 17, 17' to be navigated via the signal input.

[0032] For example, a person, not shown, can select an item 17 that the person wants to locate by means of an application on a mobile terminal device (not shown). The electronic control device 23 receives information about the selected item 17 via a signal input. In addition, the electronic control device 23 is configured to access information related to the respective placement positions B, C of the items 17, 17' present within the entire field of view 19. This information can be retrieved by the electronic control device 23 from an external database (not shown), for example.

[0033] Furthermore, the electronic control device 23 is configured to recognize, by means of the camera device 13, for example, a person who has selected the item 17 and wishes to navigate to it, and thus recognize the person's current position A. The electronic control device can additionally be configured to recognize the current position of the mobile terminal device, and thus recognize the person's position A, for example, via a GPS positioning function of the mobile terminal device.

[0034] By means of the laser projector 21, the electronic control device 23 can guide the person along the path to the selected object 17 by means of the projection of the arrow 25. In this respect, the electronic control device 23 can be configured to update the display of the arrow 25 by continuously comparing the current position A of the identified person with the placement position B of the object.

[0035] The electronic control device 23 may also be configured to highlight the selected item 17 in a visually recognizable manner by means of the laser projector 21 if the position in front of the sought item is identified as the current position A, i.e. if the person has reached the placement position B of the sought item 17. For example, the highlighting may be performed by projection in the form of an arrow pointing to the selected item 17 or a circle surrounding it.

[0036] Figure 3 A schematic outline sketch of a third device 11 according to the present invention is shown, which device may be generally configured similarly to Figure 1 or Figure 2 Device 11. Figure 3 The device 11 shown comprises a camera device 13 for detecting a plurality of objects 17, 17' placed on a placement surface 15 within the entire field of view 19 of the camera device 13, a projection device 21 in the form of a video projector for projecting information related to the objects 17, 17', and an electronic control device 23. The electronic control device 23 is signal-connected to the camera device 13 and the projection device 21 and is configured to detect the objects 17, 17' individually by means of image analysis. The electronic control device 23 is also configured to display information about discounts directly on the respective objects 17, 17' in a visually recognizable manner by means of a projection 25 within a predetermined time period.

[0037] The apparatus has an electronic interface (not shown) and is configured to receive from an external memory device the data required for projection 25. In this example, the data specifies that projection 25 should display the content "-20%" on item 17' for a period of eight hours.

[0038] Reference numerals list

[0039] 11 Installation

[0040] 13 Camera Equipment

[0041] 15 Place the surface

[0042] 17 Items

[0043] 17' Items

[0044] 19 Field of view

[0045] 21 Projection equipment

[0046] 23. Control Equipment

[0047] 25 Projection

[0048] 27 Information Tags

[0049] 27' Information Label

Claims

1. A device (11) for a logistics center, in particular an industrial goods warehouse, comprising: A camera device (13) for detecting a plurality of objects (17, 17') placed on a placement surface (15) within a whole field of view (19) of the camera device (13); A projection device (21) for projecting information related to the detection; as well as An electronic control device (23) is signal-connected to the camera device (13) and the projection device (21) and is configured to detect the objects (17, 17') individually by means of image analysis and to display the detection of the picking up of the corresponding object (17, 17') from the placement surface (15) and / or the placement of the corresponding object (17, 17') on the placement surface (15) in a visually recognizable manner by means of a projection (25).

2. The device (11) according to claim 1, wherein: The projection device (21) and / or the electronic control device (23) are configured to display the projection (25) on a surface accessible to the projection (25) within the entire field of view (19) of the camera device (13), preferably on an information tag (27, 27') or a price tag of an object, in particular the corresponding object (17, 17') and / or directly on the corresponding object (17, 17').

3. The device (11) according to claim 1 or 2, wherein: The projection (25) comprises an image, a symbol, a logo and / or an item name, and / or wherein the projection (25) is color-coded.

4. The device (11) according to claim 1 or 2, wherein: The electronic control device (23) is configured to display the projection (25) for a predetermined duration, preferably three seconds.

5. The device (11) according to claim 1 or 2, wherein: The projection device (21) is designed as a laser projector and / or a video projector.

6. The device (11) according to claim 1 or 2, wherein: The device (11) has a force sensor device arranged on the placement surface (15) and / or includes an RFID reading device, the electronic control device (23) is signal-connected to the force sensor device and / or the RFID reading device, and wherein the electronic control device (23) is configured to detect the picking up of the corresponding object (17, 17') from the placement surface (15) and / or the placement of the corresponding object (17, 17') on the placement surface (15) with the help of the force sensor device and / or the RFID reading device.

7. The device (11) according to claim 1 or 2, wherein: The device (11) is configured as a device (11) arranged in a fixed manner, and / or wherein, The projection device (21) is arranged at a camera of the camera arrangement (13), in particular forms a unit with the camera.

8. The device (11) according to claim 1 or 2, wherein: The electronic control device (23) is configured to display navigation along a path to a corresponding object (17, 17') in a visually recognizable manner by means of a projection (25), wherein the electronic control device (23) has a signal input and is configured to receive information about the corresponding object (17, 17') to be navigated via the signal input.

9. The device (11) according to claim 1 or 2, wherein: The electronic control device (23) is configured to display information about special offers and / or discounts on an information label (27, 27') or a price label and / or directly on the object (17, 17') in a visually recognizable manner by means of a projection (25) within a predetermined time period and / or to highlight the corresponding object (17, 17') in a visually recognizable manner by means of a projection (25).

10. A method for a logistics center, in particular an industrial goods warehouse, for detecting a plurality of objects (17, 17') placed on a placement surface (15) by means of a camera device (13) within the entire field of view (19) of the camera device (13) and for projecting information related to the detection by means of a projection device (21), wherein: The objects (17, 17') are detected individually by means of image analysis and the detection of the picking up of the respective object (17, 17') from the placement surface (15) and / or the placement of the respective object (17, 17') onto the placement surface (15) is displayed in a visually recognizable manner by means of a projection (25).

Images