METHOD FOR OPERATING A PICKING DEVICE FOR MEDICINES AND PICKING DEVICE FOR PERFORMING THE METHOD

DE502020010818D1Active Publication Date: 2025-04-30BECTON DICKINSON ROWA GERMANY GMBH
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
DE502020010818
Authority / Receiving Office
DE · DE
Patent Type
Patents
Current Assignee / Owner
Filing Date
2020-01-10
Publication Date
2025-04-30
Estimated Expiration
2040-01-10

AI Technical Summary

Technical Problem

Existing picking devices for medicinal products often experience downtimes due to collisions between the operating device and unintentionally left obstacles, which can lead to damage and require manual intervention.

Method used

A procedure for operating a picking device that utilizes an optical detection device to create images of the movement space, compare them to reference images, and detect obstacles, allowing the system to prevent collisions by blocking the operating device or bypassing the obstacle.

Benefits of technology

The solution effectively prevents collisions and associated downtimes by identifying and addressing obstacles within the picking device's movement space, ensuring continuous operation and minimizing damage.

✦ Generated by Eureka AI based on patent content.
Patent Text Reader
Need to check novelty before this filing date? Find Prior Art

Description

[0001] The present invention relates to a method for operating a picking device for pharmaceuticals and to a picking device that can be operated according to the method according to the invention.

[0002] In order-picking devices for pharmaceuticals known, for example, from DE 102 25 332 A1, which discloses the preamble of claims 1 and 11, at least one operating device is regularly installed, the gripper of which can be moved along corresponding guides in the longitudinal axis (X-direction or X-axis) and vertically (Z-direction or Z-axis) in order to reach different shelf compartments in the order-picking device as well as a storage device and an unloading device. Modern order-picking devices for pharmaceuticals operate largely automatically, i.e., entering the interior of the order-picking device is only necessary if, for example, parts within the order-picking device need to be cleaned or a malfunction requires operator intervention, for example if storage or removal of a pharmaceutical package could not be carried out properly.Whenever an operator intervenes, it is possible that they may inadvertently leave an object, such as a ladder used to reach higher sections of the picking device, in the picking device. Depending on the size and positioning of this inadvertently left object, it may constitute an obstacle for the operating device. In extreme cases, a normal movement of the operating device may result in a collision with the left-behind object, which may cause damage to the operating device. A collision may also result in pharmaceutical packages on one or more storage areas becoming so disorganized that manual retrieval is necessary. Depending on the obstacle and the collision, it is also possible for an obstacle to tip over as a result of the collision to completely destroy several shelf areas.In any case, a collision between the operator device and an obstacle left behind in the picking device requires intervention by an operator, which in turn leads to downtime of the picking device.

[0003] It is therefore an object of the invention to provide a method for operating a picking device in which downtimes caused by collisions of the operating device with obstacles are avoided. It is also an object of the present invention to provide a picking device with which a corresponding method can be carried out.

[0004] The object is achieved by a method for operating a picking device for pharmaceuticals according to patent claim 1. The picking device used to carry out the method comprises a plurality of storage locations for pharmaceutical bottles and / or packages, a conveyor belt arranged in front of the storage locations horizontally in an X direction or X axis and vertically in a Z direction orAn operating device having a gripper and movable along the Z-axis in a movement space, at least one storage device with which pharmaceutical bottles and / or packages can be moved into the picking device and from which the gripper can remove pharmaceutical bottles and / or packages, at least one identification device for identifying pharmaceutical bottles and / or packages, an unloading device to which pharmaceutical bottles and / or packages can be transferred from the operating device for removal from the picking device, and a control device coupled to the operating device and the identification device. Furthermore, the picking device comprises an optical detection device coupled to the control device and arranged in the picking device in such a way that it can create an image of the movement space.

[0005] In the method according to the invention, in a step a) after a predetermined event, which may be, for example, a routine cleaning of the interior of the order picking device, an image of the section of the movement space that can be captured by the optical detection device is created using at least one optical detection device. Whether this image covers the entire movement space depends, among other things, on the precise positioning of the optical detection device and the size of the movement space. If the optical detection device is arranged, for example, on an end face of the order picking device and the extension along the X-axis is not too large, it is conceivable that the entire movement space can be captured in one image using one optical detection device. However, it is also conceivable that the optical detection device is arranged in or on, for example, the gripper of the operating device.In such a case, whether one image is sufficient depends, among other things, on the positioning of the operating device within the picking device. For example, if the operating device is positioned in the center of the picking device with respect to the X-axis, it may be necessary for the operating device to capture one image "left" and one image "right." In such a case, with very long picking devices, it is also conceivable that several images will have to be created until the entire movement area has been checked. To do this, the operating device is then only moved in the X-direction as far as the movement area has been detected and recognized as clear.

[0006] In a subsequent process step b), predefined areas of the image of the movement space are compared with corresponding areas of a reference image. The "predefined areas" can be the entire recorded image. However, since the image of the movement space inevitably also includes areas that are irrelevant for subsequent analysis (areas of storage locations for medicine bottles and / or packages), it is also conceivable that only partial areas of the image of the movement space are compared with corresponding partial areas of the reference image. In a process step c), the comparison of the predefined areas of the image and the reference image is used to determine whether an obstacle is present in the captured section of the movement space.How exactly the detection of an obstacle is carried out is not relevant for the present invention; what is essential is that the comparison determines whether an obstacle is present that could potentially prevent movement of the operating device. There are various methods for this that are known to those skilled in the art, one of which is explained in the detailed description of the invention. In a final method step d), corresponding signals are provided based on the detection of the presence of an obstacle in the detected section of the movement space. In the simplest case, these signals prevent movement of the operating device, regardless of the positioning and size of the obstacle.Furthermore, it is conceivable that in such a case an operator is alerted to the presence of an obstacle, which can be done, for example, visually by means of a display device or acoustically.

[0007] In the simplest form of the method according to the invention, the movement of the operating device is simply blocked upon detection of an obstacle. In a preferred embodiment of the method according to the invention, in method step d) of the method according to the invention, after performing a comparison of predetermined areas of the image and the reference image, the position and size of an obstacle in the detected section of the movement space are determined. Knowing this information makes it possible to estimate whether blocking the movement of the operating device is even necessary. Depending on the processing algorithms used in the image analysis software, it may be necessary to install several reference points in the picking device, based on which the size and position can be determined.

[0008] Based on the aforementioned information, it is preferred that the determined position and size of the obstacle be used to determine whether the operator control device can avoid the obstacle. If this is the case, the user can be given the choice of removing the obstacle immediately or doing so at a later time and continuing to operate the picking device despite the obstacle. The operator control device is then naturally controlled in such a way that the existing obstacle is avoided and a collision is avoided.

[0009] The obstacle can be positioned and / or designed in such a way that no storage area of ​​the picking device is affected, i.e., despite the presence of the obstacle, all medicine bottles and / or packages can be accessed. For example, it is conceivable that the obstacle only blocks a portion of the unloading device, which may prevent medicine bottles and / or packages from being stored, but not from being retrieved. In such a case, it is entirely conceivable that the picking device continues to operate during a pharmacy's opening hours and that the obstacle is removed immediately after regular opening hours. In a preferred embodiment, if an obstacle can be bypassed, the area blocked by the obstacle is marked as inaccessible or impassable. This is particularly useful if medicine packages are stored in this area.If it is known which storage areas in the picking device cannot be reached due to the obstacle, it can be determined immediately if a retrieval request is made whether a pharmaceutical package that would otherwise be retrievable cannot be retrieved due to the obstacle.

[0010] If an obstacle is detected, it must be removed by a user immediately or, if necessary, at a later time. However, this only applies if the obstacle cannot be moved out of the way, for example by the operating device itself. In a preferred embodiment of the method according to the invention, it is therefore provided that the determined position and size of the obstacle are used to determine whether an obstacle can be moved with the operating device. If this is the case, an attempt can be made to grip the obstacle with the gripper of the operating device and place it at a predetermined location, which could be the unloading device, for example. For example, it is conceivable that if only a small obstacle is positioned, for example, on the X-guide of the operating device, it can be removed with the gripper and without any action from the operator.

[0011] To determine whether an obstacle is present within the movement space within the picking device, a comparison is performed between specified areas of the image and the reference image. To prevent the gripper of the operating device from obscuring any obstacle that may be present when capturing the image, a preferred embodiment of the method provides for the gripper of the operating device to be moved along the Z-axis to a maximum Z position before the image is captured.

[0012] Depending on the length of the picking device, i.e. along the X- Axis, it may be sufficient to use only an optical detection device. For picking devices that have a certain extension in X-direction, it may be necessary to use several optical detection devices. In such a case, it is preferred that the image and the reference image are composed of several individual images and that the obstacle is then determined on the basis of the composed images. Alternatively, it is conceivable that a comparison of the image and the reference image is carried out on the basis of partial images. If the optical detection device is arranged or implemented in or on the gripper, for example by a 2D or 3D camera, it may be necessary to repeat the method several times, with a section of the movement space being recorded and examined with each repetition, i.e. the method according to the invention is carried out per section.

[0013] The object is further achieved by a picking device for pharmaceuticals according to claim 11. The picking device according to the invention comprises a plurality of storage locations for pharmaceutical bottles and / or packages, wherein the storage locations can be provided by horizontal shelf surfaces with, if necessary, receptacles for bottles, depending on the pharmaceuticals to be stored (package or bottle). The picking device further comprises an operating device having a gripper, which can be moved horizontally in an X-direction (X-axis) and vertically in a Z-direction (Z-axis) in front of the storage locations, at least one storage device with which pharmaceutical bottles and / or packages can be moved into the picking device and from which the gripper can remove pharmaceutical bottles and / or packages, at least one identification device for identifying pharmaceutical bottles and / or packages,an unloading device to which pharmaceutical bottles and / or packages can be transferred from the operating device for removal from the order-picking device, and at least one optical detection device arranged in the order-picking device in such a way that it can create an overall image of the movement space, as well as a control device coupled to the operating device, the identification device and the optical detection device, which is designed to carry out the method steps of the method according to the invention described above.

[0014] In a preferred embodiment of the picking device, the optical detection device is a component of the gripper of the operating device. In this embodiment, a component that is typically present in every gripper is used to implement the method according to the invention. The additional costs for implementing the method are limited to necessary software adaptations in this case, since no new components need to be integrated into an existing picking device.

[0015] In the following, a preferred embodiment of the method according to the invention as well as a preferred embodiment of the order-picking device according to the invention are described with reference to the drawing, in which Figures 1a and 1b Oblique views of an embodiment of the order picking device according to the invention show, Figure 2 shows a top view of the picking device, Figure 3 shows a side sectional view in which one row of shelves is omitted, Figures 4 and 5 the Figures 2 and 3 show corresponding views, each with an obstacle arranged in the movement space of the order picking device, Figures 6a and 6b Show overall images of the movement area with obstacles arranged at different positions, and Figures 7a - 7d schematically illustrate the comparison between the overall image and the reference overall image, and Figure 8 a flow chart of a preferred embodiment of the method according to the invention.

[0016] The Figures 1a and 1bshow oblique views of an embodiment of the order-picking device 1 according to the invention for pharmaceutical packages, wherein in the embodiment shown, the outer paneling is omitted. In the embodiment shown, the order-picking device comprises a plurality of shelves 10, which form two parallel rows of shelves, between which a movement space 20 is formed, in which an operating device 30 having a gripper 31 can be moved horizontally in an X-direction and vertically in a Z-direction. For this purpose, the order-picking device comprises a horizontal or X-guide 32 and a vertical or Z-guide 33. The order-picking device further comprises two storage devices 41, 42, which in the embodiment shown are designed as conveyor belts. In the Figure 1aThese storage devices extend beyond the actual storage front side of the picking device by a section, and in these sections, an operator can place pharmaceutical packages to be stored. Above each storage device, in the storage front area of ​​the picking device, an identification device 51, 52 is arranged, with which the pharmaceutical packages to be stored are identified and, if necessary, measured. The picking device further comprises an unloading device 60, to which the gripper 31 of the operating device 30 can transfer pharmaceutical packages. The operating device 30 and the identification devices 51, 52 are coupled to a control device 80, which in the embodiment shown is also located in the storage front area (see Figure 1a). The picking device according to the invention has an optical detection device 70, which is arranged in the picking device in such a way that it can create an overall image of the movement space 20. In the embodiment shown, the optical detection device is also arranged at the storage end face. Alternatively, the optical detection device can also be arranged at the Figure 1b shown rear end face or centrally above the movement area, whereby the ideal arrangement of the optical detection device depends on the type of detection device used and the design of the movement area.

[0017] The Figure 2shows a plan view of the preferred embodiment of the order picking device according to the invention, wherein in this plan view, in particular, the movement space 20 formed between the rows of shelves for the operating device 30 can be seen. The movement space 20 is in Figure 2divided by a dashed line into a left movement space section 21 and a right movement space section 22. Due to the arrangement of the horizontal X-guide 32, the movement space section 21 is a "critical" movement space section, in which an obstacle will always lead to a collision with an operating device moving in the X direction, due to the fact that during a movement in the X direction, the Z-guide 33 is always moved in the X direction. The movement space section 22 is a "non-critical" movement space section, since obstacles arranged in this movement space section of the movement space 20 can, if necessary, be bypassed by a corresponding movement of the gripper of the operating device.

[0018] Figure 3shows a sectional view, in which the lower X-guide 32 of the operating device 30 is particularly visible. Furthermore, it is clear why the movement space section 21 is defined as the "critical" movement area. Even if the gripper 31 is moved upwards in the Z direction to move an obstacle, an obstacle in the critical movement space section 21 causes a collision between the obstacle and the operating device due to the movement of the Z-guide in the X direction. The gripper 31 of the operating device also features an optical detection device 34, for example, a 2D or 3D camera, which is regularly required for normal operation of the gripper. Furthermore, this optical detection device can be used in an alternative embodiment to capture an image of the movement space, as already described above.

[0019] Figures 4 and 5 show the views of the Figures 2 and 3 , where Figures 4 and 5An obstacle 5 is located in the non-critical movement space section 22. Due to the design of the control unit with the X-guide arranged on one side of the movement space, it is theoretically possible to bypass the obstacle with the control unit. Whether an obstacle is bypassed upon detection or whether movement of the control unit is prohibited depends on whether the position and size of the obstacle can be determined, and on the operator's instructions.

[0020] Figures 6a and 6b show schematically two images of the movement space 20 with differently arranged obstacles 5, whereby the images shown are intended to represent the entire movement space. Figure 6a In the situation shown, an obstacle 5 is located in the "non-critical" movement space section 22. As can be seen from the schematically shown X and Z guide, it is Figure 6a In the situation shown, it is possible for the operating device to avoid obstacle 5 without collision if the gripper 31 is aligned accordingly. However, such a procedure is only possible if the exact position and size of the obstacle 5 can be determined, which depends, among other things, on the size itself and the contrast between the obstacle and the background. Figure 6b In the situation shown, in which the obstacle 5 obstructs the X-guide 32, i.e., is located in the critical movement space section 21, continued operation of the picking device is impossible, at least if the entire length of the picking device extending in the X direction is to be used. If such a case is detected, intervention by an operator is unavoidable under the above-mentioned conditions.

[0021] In the following, with reference to the Figures 7a - 7d and Figure 8a preferred embodiment of the method according to the invention is described, wherein the Figures 7a - 7d schematically illustrate the detection of an obstacle based on the image and the reference image. In this case, too, the entire movement space is captured by the image and the reference image, and the optical detection device is arranged at the end of the picking device opposite the operating device. First, in a step 100, when a predetermined event occurs, for example, routine cleaning of the interior of the picking device, and in this embodiment, before the operating device 30 is moved along the X-axis, an image of the movement space 20 is created using the optical detection device 70 (not shown). Two schematic views of such an image are shown in the Figures 6a and 6b shown, where Figure 6a the obstacle in the non-critical movement space section 22 and at Figure 6bis arranged in the critical movement space section 21. Subsequently, in a step 110, predetermined areas of the image of the movement space are compared with corresponding areas of a reference image. In Figure 7a To explain the detection of an obstacle, a reference image is shown in the upper section and an image captured by the optical detection device is shown in the lower section. Due to the geometry of the interior of the picking device, the image of the movement space always includes not only the movement space itself, but also sections of the two opposite rows of shelves, which are in Figure 7a are indicated schematically.

[0022] According to a preferred embodiment, the following procedure is used to detect an obstacle. First, the reference image and the current image are subtracted from each other, so that only the objects remain that are present in the image but not in the reference image. Figure 7a In the example shown, these are a medicine package 6 and an obstacle 5; the result of the difference is in Figure 7b illustrated schematically.

[0023] Based on the comparison of the image and the reference image, it is now determined whether an obstacle is present in the movement area (step 120). Since the image (as well as the reference image) always includes areas that do not concern the movement area itself, but rather parts of the lateral shelf storage, the result of the subtraction between the image and the reference image is calculated with a Figure 7cThe mask 25 shown here hides those areas of the difference result that do not concern the movement space itself. The result of this combination of the difference image with the mask is shown in Figure 7d shown; only obstacle 5 remains, which is now processed further using the usual known processing methods. For this purpose, the Figure 7dThe indicated image is usually converted into a black-and-white image (binarized) and subsequently subjected to blob analysis. All areas that exceed a certain specified size are then classified as obstacles, and if possible and desired, their position and size are passed on to the control unit. Depending on the precise procedure, any movement of the control unit can be prohibited in the presence of an obstacle; alternatively, it is possible to specify that the obstacle be bypassed or, in the case of optimally positioned small obstacles, to initiate the removal of the obstacles using the control unit's gripper.

[0024] At the Figure 8In the embodiment shown, the size and position of the obstacle are determined in a step 130. For this purpose, it may be necessary to specify reference points in the order-picking device and / or to train the control device to determine the size and position using a plurality of reference overall images. Alternatively or additionally, it may also be provided to provide the floor of the movement area and / or the two movement space sections with special patterns and / or identification numbers. Knowing the mounting location of the optical detection device, the size and position can then be determined in a favorable case.

[0025] Based on the knowledge of the size and position of the obstacle, a step 140 determines whether the obstacle can be avoided based on the structural design of the movement space. If this is not the case, for example, because the obstacle is at least partially located within the critical movement space section, the control device is locked, thus preventing further movement (step 200) until an operator indicates that the obstacle has been removed.

[0026] If bypassing is possible (and desired), the storage locations that cannot be reached due to the obstacle are marked accordingly. For the continued operation of the picking system, this means that the pharmaceutical packages stored at these storage locations cannot be retrieved.

[0027] In alternative embodiments, it may be necessary to repeat the method described above for several sections of the order picking device (if the optical detection device is arranged or used at or on the gripper and not the entire movement space can be captured with one image) or to assemble the image from several partial images (if several optical detection devices are used).

Claims

1. A method for operating a picking device for medicaments, comprising a plurality of storage spaces for medicament bottles and / or packages (6), an operating device (30) having a gripper (31), wherein said operating device can be moved horizontally in an X-direction (X-axis) and vertically in a Z-direction (Z-axis) in front of the storage spaces in a movement space (20), at least one storage device (41, 42) with which medicament bottles and / or packages (6) can be moved into the picking device (1) and from which the gripper (31) can take medicament bottles and / or packages (6), at least one identification device (51, 52) for identifying medicament bottles and / or packages (6), an unloading device (60), to which medicament bottles and / or packages (6) can be transferred by the operating device for removal from the picking device (1), at least one optical detection device (34, 70), which is arranged in the picking device (1) such that it can create an image of the movement space (20), and a control device (80) coupled to the operating device (30), the identification device (51, 52) and the optical detection device (34, 70), characterized in that a) after a predetermined event an image of the movement space (20) detectable by an optical detection device is created with the at least one optical detection device (34, 70), b) predefined areas of the image of the movement space (20) are compared with corresponding areas of a reference image, c) it is determined, based on the comparison of predetermined areas of the image and the reference image, whether an obstacle is present in the detected portion of the movement space (20), and d) based on the detection of the presence of an obstacle, corresponding signals are provided.

2. The method for operating a picking device for medicaments according to claim 1, characterized in that the position and the size of an obstacle are determined in step d).

3. The method for operating a picking device for medicaments according to claim 2, characterized in that it is determined on the basis of the determined position and size of the obstacle, whether the obstacle can be bypassed by the operating device.

4. The method for operating a picking device for medicaments according to claim 3, characterized in that, when the obstacle can be bypassed, the storage area blocked by an obstacle is marked as unreachable or not accessible.

5. The method for operating a picking device for medicaments according to claim 2, characterized in that it is determined on the basis of the determined position and size of the obstacle, whether the obstacle is movable with the operating device.

6. The method for operating a picking device for medicaments according to any of claims 1-5, characterized in that the gripper (31) of the operating device (30) is moved into a maximum Z-position along the Z-axis before creating the overall image.

7. The method for operating a picking device for medicaments according to any of claims 1-6, characterized in that the overall image and the overall reference image are composed of a plurality of individual images.

8. The method for operating a picking device for medicaments according to any of claims 1-6, characterized in that a comparison of the overall image and the overall reference image is performed on the basis of partial images.

9. The method for operating a picking device for medicaments according to claim 1, characterized in that the provided signals temporarily prevent a movement of the operating device (30).

10. The method for operating a picking device for medicaments according to any of claims 1-9, characterized in that the presence of an obstacle is displayed to a user.

11. A picking device (1) for medicaments, comprising a plurality of storage spaces for medicament bottles and / or packages (6), an operating device (30) having a gripper (31), wherein said operating device can be moved horizontally in an X-direction (X-axis) and vertically in a Z-direction (Z-axis) in front of the storage spaces in a movement space (20), at least one storage device (41, 42) with which medicament bottles and / or packages (6) can be moved into the picking device (1) and from which the gripper (31) can take medicament bottles and / or packages (6), at least one identification device (51, 52) for identifying medicament bottles and / or packages (6), an unloading device (60), to which medicament bottles and / or packages (6) can be transferred by the operating device for removal from the picking device (1), at least one optical detection device (34, 70) arranged in the picking device (1) such that it can create an overall image of the movement space (20), and a control device (80) coupled to the operating device (30), the identification device (51, 52) and the optical detection device (34, 70), characterized in that the control device is configured to carry out the method steps according to claims 1-10.

12. The picking device (1) for medicaments according to claim 11, characterized in that the optical detection device (34) is a component of the gripper (31) of the operating device (30).