Method for operating a pharmaceutical picking device and a picking device for carrying out said method

Abstract

The present invention relates to a method for operating a pharmaceutical order-picking device and an order-picking device operable according to the method of the present invention. Known methods for operating an order-picking device are disadvantageous in that significant damage can occur in the event of a collision with an object that may be located inside. To prevent this, an optical detection device (34, 70) is provided that is used to create an image of the movement space inside the order-picking device (1) that is detectable by the optical detection device after a specific event. Designated regions of the image of the movement space (20) are compared with corresponding regions of a reference image based on a comparison of the specific region of the image with the reference image to determine whether an obstacle is present in the captured portion of the movement space (20). An appropriate signal is provided based on the identification of the presence of the obstacle, e.g., preventing action by the operating device and requesting removal of the obstacle by a user.

Description

[Technical Field]

[0001] The present invention relates to a method of operating a pharmaceutical picking machine and to a picking machine operating in accordance with the method of the present invention. [Background technology]

[0002] In known pharmaceutical picking devices, at least one handling device is regularly installed, the gripper of which is movable on guides corresponding to a longitudinal axis (X-direction or X-axis) and a height (Z-direction or Z-axis) so as to reach different shelves of the picking device as well as storage and removal devices. Modern pharmaceutical picking devices operate almost automatically; in other words, the interior of the picking device only needs to be entered if, for example, parts within the picking device need to be cleaned or if a malfunction requires operator intervention, such as if pharmaceutical packages have not been properly stored or removed. During any operator intervention, an object, such as a ladder used to reach higher parts of the picking device, may be unintentionally left inside the picking device. Depending on the size and position of this unintentionally left object, this may pose an obstacle to the handling device. In extreme cases, normal movement of the handling device may result in a collision with the left-behind object, resulting in damage to the handling device. A collision may also result in disorganization of pharmaceutical packages in one or more storage areas, requiring manual removal. Depending on the obstacle and the collision, the collision may cause the toppling obstacle to completely destroy some shelf surfaces. In either case, the collision between the operating device and the obstacle left behind by the picking device will trigger operator intervention and result in downtime for the picking device. Summary of the Invention [Problem to be solved by the invention]

[0003] It is therefore an object of the present invention to provide a method for operating a picking device in which downtime due to collisions between obstacles and the operating device is avoided.It is a further object of the present invention to provide a picking device capable of carrying out the corresponding method. [Means for solving the problem]

[0004] The object is achieved by a method for operating a pharmaceutical picking device according to claim 1. The picking device used to carry out the method comprises: a plurality of storage spaces for pharmaceutical bottles and / or packages; an operation device having a gripper, which is movable horizontally in the X direction or X axis and vertically in the Z direction or Z axis in a transfer space in front of the storage spaces; at least one storage device by which the pharmaceutical bottles and / or packages can be transferred into the picking device and from which the gripper can remove the pharmaceutical bottles and / or packages; at least one identification device for identifying the pharmaceutical bottles and / or packages; an ejection device that can be transported by the operation device to remove the pharmaceutical bottles and / or packages from the picking device; and a control device connected to the operation device and the identification device. Furthermore, the picking device comprises an optical detection device connected to the control device, which is arranged in the picking device so as to be able to generate an image of the transfer space.

[0005] In the method according to the present invention, in step a), after a predetermined event, which may be, for example, a routine cleaning of the interior of the picking device, an image of a portion of the movement space detectable by the optical detection device is created with at least one optical detection device. Whether this image covers the entire movement space depends, among other things, on the exact positioning of the optical detection device as well as the size of the movement space. If the optical detection device is, for example, located on the end face of the picking device and its range along the X axis is not very large, it is conceivable that the entire movement space can be captured by the optical detection device in a single image. However, it is also conceivable that the optical detection device is, for example, located inside or in contact with the gripper of the manipulation device. In such cases, whether one image is sufficient depends, among other things, on the position of the manipulation device within the picking device. For example, if the manipulation device is located in the center of the picking device relative to the X axis, it may be necessary to capture a "left" image and a "right" image from the manipulation device. In such cases, it is conceivable that with very long picking devices, several images must be created until the entire movement range is checked. For this purpose, the manipulation device is moved only in the X direction as far as the movement space is detected and recognized as free.

[0006] In the subsequent step b), a predetermined region of the image of the movement space is compared with a corresponding region of the reference image. The "predetermined region" may be a completely captured image. However, since the image of the movement space necessarily includes regions irrelevant to the subsequent evaluation (e.g., the storage space for pharmaceutical bottles and / or packages), it is also conceivable that only a partial region of the image of the movement space is compared with the corresponding partial region of the reference image. In step c), a determination is made based on a comparison between the predetermined region of the image and the detected portion of the movement space to determine whether an obstacle is present. The exact manner in which the obstacle determination is performed is not relevant to the present invention; what is important is only that the determination is based on a comparison to determine whether an obstacle that may prevent the movement of the control device is present. Various methods are known to those skilled in the art, one of which is described in the detailed description of the present invention. In the final step d), a corresponding signal is provided based on the determination of the presence of an obstacle in the detected portion of the movement space. In the simplest case, these signals inhibit the movement of the control device regardless of the obstacle's position and size. Furthermore, in such cases, the operator may be informed of the presence of an obstacle, for example, optically or acoustically by a display device.

[0007] In the simplest form of the method according to the invention, the movement of the manipulation device is simply blocked upon detection of an obstacle. In a preferred embodiment of the method according to the invention, after a comparison of a predetermined area of ​​the image with a reference image, the position and size of the obstacle in the detection part of the movement space are determined in step d) of the method according to the invention. Knowing this information, it can be estimated whether the movement of the manipulation device needs to be blocked. Depending on the processing algorithms of the image analysis software used, it may be necessary to attach several reference points to the picking device, which allow the size and position to be determined.

[0008] Based on the above information, it is preferable to determine whether the manipulation device can be driven around the obstacle based on the determined position and size of the obstacle. In this case, the user can choose to remove the obstacle immediately or remove it later and continue to operate the picking device regardless of the obstacle. The manipulation device is then of course controlled to drive around the existing obstacle and avoid collisions.

[0009] The obstacles are positioned and / or shaped so that the storage area of ​​the picking device is not affected, i.e., all pharmaceutical bottles and / or packages are accessible despite the existing obstacle. For example, it is conceivable that an obstacle blocks only a portion of the discharge device, which may prevent the storage of pharmaceutical bottles and / or packages but not their removal. In such cases, it is quite conceivable that the picking device continues to operate during the pharmacy's business hours and the obstacle is removed immediately after normal business hours. In a preferred embodiment, it is provided that when the obstacle can be moved around, the area blocked by the obstacle is marked as inaccessible or should not be driven through. This is particularly useful if pharmaceutical packages are stored in this area. Knowing which storage areas in the picking device cannot be reached due to the obstacle can immediately determine if a removable pharmaceutical package cannot be removed due to the obstacle in the presence of a removal request.

[0010] If an obstacle is detected, it must be removed by the user immediately or, if applicable, later. However, this only applies if the obstacle cannot be removed by the operating device itself, for example. Therefore, in a preferred embodiment of the method according to the invention, it is provided to determine whether the obstacle can be moved by the operating device based on the determined position and size of the obstacle. In this case, an attempt can be made to grip the obstacle with a gripper of the operating device and place it in a predetermined position, for example, on an unloading device. Thus, for example, if only a small-sized obstacle is placed, for example, on an X-guide of the operating device, it is conceivable that the obstacle can be removed by the gripper without operator intervention.

[0011] A comparison of a predetermined area of ​​the image with a reference image is performed to determine whether an obstacle is present in the movement space in the picking device. In order to avoid the gripper of the manipulation device covering a possibly present obstacle when taking the image, it is provided in a preferred embodiment of the method that before creating the image, the gripper of the manipulation device is moved along the Z axis to a maximum Z position.

[0012] Depending on the extent of the picking device in the vertical direction, i.e. along the X-axis, only one optical detection device may be used. However, for picking devices that exceed a certain extent in the X-direction, it may be necessary to use several optical detection devices. In this case, it is preferable that the image and the reference image are composed of several single images, and obstacles are detected on the basis of the composite image. Alternatively, it is also conceivable that the comparison of the image with the reference image is performed on the basis of partial images. If the optical detection device is arranged or realized in or on the gripper, for example by a 2D or 3D camera, the method will have to be repeated several times, with each repetition recording or examining a portion of the movement space, in other words, the method according to the invention is performed portion by portion.

[0013] The object is further achieved by a pharmaceutical picking apparatus according to claim 11. The picking apparatus according to the invention comprises a plurality of storage spaces for pharmaceutical bottles and / or packages, the storage spaces depending on the pharmaceuticals (packages or bottles) to be stored being provided by horizontal shelves possibly having receptacles for the bottles. The picking apparatus further comprises an operating device with a gripper, movable horizontally in an X-direction (X-axis) and vertically in a Z-direction (Z-axis), located in a transfer space in front of the storage spaces, at least one storage device by which pharmaceutical bottles and / or packages can be transferred into the picking apparatus and from which the gripper can remove the pharmaceutical bottles and / or packages, at least one identification device for identifying the pharmaceutical bottles and / or packages, an ejection device by which the pharmaceutical bottles and / or packages can be transferred from the operating device for removal, at least one optical detection device arranged in the picking apparatus so as to be able to generate an overall view of the transfer space, and a control device connected to the operating device, the identification device and the optical detection device, the operating device being designed to perform the steps of the method according to the invention.

[0014] In a preferred embodiment of the picking device, it is provided that the optical detection device is a component of the gripper of the handling device. In this embodiment, therefore, components that are normally included in all grippers are used to implement the method according to the invention. In this case, the additional costs for implementing the method are limited to the necessary software adaptations, since no new components are integrated into existing picking devices.

[0015] Hereinafter, preferred embodiments of the method according to the present invention and preferred embodiments of the picking device according to the present invention will be described with reference to the drawings. [Brief explanation of the drawings]

[0016] [Figure 1a] 1 shows a perspective view of an embodiment of a picking device according to the present invention; [Figure 1b] 1 shows a perspective view of an embodiment of a picking device according to the present invention; [Figure 2] FIG. [Figure 3] FIG. 10 is a side cross-sectional view omitting one row of shelves. [Figure 4] 3 shows a view corresponding to FIG. 2, where the obstacles are respectively arranged in the movement space of the picking device. [Figure 5] 4 shows a view corresponding to FIG. 3, where the obstacles are respectively positioned within the movement space of the picking device. [Figure 6a] 1 shows an overview of a moving space with obstacles placed at different positions. [Figure 6b] 1 shows an overview of a moving space with obstacles placed at different positions. [Figure 7a] 10 shows a schematic diagram of a comparison of a global image with a reference global image; [Figure 7b] 10 shows a schematic diagram of a comparison of a global image with a reference global image; [Figure 7c] 10 shows a schematic diagram of a comparison of a global image with a reference global image; [Figure 7d] 10 shows a schematic diagram of a comparison of a global image with a reference global image; [Figure 8] 1 shows a flow chart of a preferred embodiment of the method according to the present invention; DETAILED DESCRIPTION OF THE INVENTION

[0017] 1a and 1b show perspective views of an embodiment of a picking device 1 for pharmaceutical packages according to the present invention; in the embodiment shown, the outer housing is omitted. In the embodiment shown, the picking device comprises a plurality of shelves 10 forming two parallel rows of shelves, between which a movement space 20 is formed, and an operating device 30 with a gripper 31 can move horizontally in the X direction and vertically in the Z direction. For this purpose, the picking device comprises a horizontal or X-direction guide 32 and a vertical or Z-direction guide 33. The picking device further comprises two storage devices 41, 42, formed in the embodiment shown as conveyor belts. At the storage front side shown in FIG. 1a, these storage devices extend beyond the actual storage end face of the picking device, where an operator can place pharmaceutical packages to be stored. Above each storage device, an identification device 51, 52 is arranged in the storage end area of ​​the picking device, allowing the stored pharmaceutical packages to be identified and, if necessary, measured. The picking apparatus further comprises an ejection device 60, and the gripper 31 of the operating device 30 can transfer the pharmaceutical packages to the ejection device 60. The operating device 30 and the identification devices 51, 52 are connected to a control device 80, which in the illustrated embodiment is also arranged in the storage end area (see FIG. 1a). According to the present invention, the picking apparatus comprises an optical detection device 70, which is arranged within the picking apparatus and can generate an overall image of the movement space 20. In the illustrated embodiment, the optical detection device is also arranged at the storage end side. Alternatively, the optical detection device can be arranged at the rear end side as shown in FIG. 1b or in the center of the movement space; the ideal arrangement of the optical detection device depends on the type of detection device used and the design of the movement space.

[0018] 2 shows a plan view of a preferred embodiment of a picking device according to the present invention, in which the movement space 20 formed between the rows of shelves for the handling device 30 can be seen in particular. The movement space 20 is subdivided in FIG. 2 by dashed lines into a left movement space portion 21 and a right movement space portion 22. Due to the arrangement of the horizontal X-guide 32, the movement space portion 21 is a "critical" movement space portion, since the Z-guide 33 is always moving in the X-direction during movement in the X-direction, leading to a collision of an obstacle with the handling device moved in the X-direction. The movement space portion 22 is a "non-critical" movement space portion, since the corresponding movement of the gripper of the handling device allows it to drive around an obstacle located in this movement space portion of the movement space 20.

[0019] FIG. 3 shows a cross-sectional view of the manipulation device 30, particularly showing the lower X-guide 32. It is also clear why the movement space portion 21 is defined as the "critical" movement area. Even if the gripper 31 is moved upward to move an obstacle in the Z direction, an obstacle in the critical movement space portion 21 will cause a collision between the obstacle and the manipulation device due to the X-directional movement of the Z-guide. An optical detection device 34, such as a 2D or 3D camera, is also provided on the gripper 31 of the manipulation device, which is periodically required for normal operation of the gripper. Furthermore, in an alternative embodiment, this optical detection device can be used to capture images of the movement space, as described above.

[0020] 4 and 5 show the same perspectives as in FIGS. 2 and 3, and in FIGS. 4 and 5, an obstacle 5 is placed in the non-critical movement space portion 22. By configuring the operation device with an X-guide placed on one side of the movement space, it is theoretically possible to drive the operation device around the obstacle. Whether the obstacle is bypassed or the movement of the operation device is generally hindered when determining the obstacle depends on the ability to determine the position and size of the obstacle, on the one hand, and on the specifications of the operator, on the other hand.

[0021] 6a and 6b show two schematic images of the movement space 20 with differently positioned obstacles 5; each image is intended to represent the entire movement space. In the situation shown in FIG. 6a, the obstacle 5 is located in the "non-critical" movement space portion 22. As can be seen from the diagrammatically illustrated X- and Z-guides, in the situation shown in FIG. 6a, a manipulation device with a corresponding orientation of the gripper 31 can navigate around the obstacle 5 without a collision. However, the corresponding procedure is only possible if the exact location and size of the obstacle 5 can be determined, which depends, among other things, on the size of the obstacle 5 itself and the obstacle / background contrast. In the situation shown in FIG. 6b, the obstacle 5 obstructs the X-guide 32. Therefore, the obstacle is located in the critical movement space portion 21, and further operation of the picking device is impossible, provided that at least the entire length of the picking device extending in the X-direction is used. If such a case is detected, operator intervention is unavoidable under the above conditions.

[0022] A preferred embodiment of the method according to the present invention will be described below with reference to FIGS. 7a-7d and 8, which schematically illustrate the determination of an obstacle based on an image and a reference image. In this case, the entire movement range of the image and the reference image is detected, and the optical detection device is located at the end of the picking device opposite the manipulation device. First, in step 100, in the presence of a predetermined event, for example, routine cleaning of the interior of the picking device, and prior to the movement of the manipulation device 30 along the X-axis in this embodiment, an image of the movement space 20 is created using the optical detection device 70 (not shown). Two schematic views of such an image are shown in FIGS. 6a and 6b, where the obstacle is located in the non-critical movement space portion 22 in FIG. 6a and in the critical movement space portion 21 in FIG. 6b. In the subsequent step 110, a predetermined region of the image of the movement space is compared with a corresponding region of the reference image. In FIG. 7a, a reference image for illustrating the obstacle determination is shown schematically at the top, and an image recorded by the optical detection device is shown schematically at the bottom. Due to the internal geometry of the picking device, the image of the movement space always includes not only the movement space itself but also the opposite parts of the two rows of shelves shown diagrammatically in Figure 7a.

[0023] According to a preferred embodiment, the procedure for determining an obstacle is as follows: First, the reference image and the current image are subtracted from each other, leaving only the objects that are present in the image but not in the reference image. In the example shown in Figure 7a, this is a pharmaceutical package 6 and an obstacle 5, and the result of the difference formation is shown diagrammatically in Figure 7b.

[0024] Then, based on a comparison of the image with a reference image, it is determined whether there are any obstacles in the movement space (step 120). Because the image (as well as the reference image) also includes areas related to lateral shelf storage, not necessarily the movement space itself, the subtraction result between the image and the reference image is combined with a mask 25, as shown in FIG. 7c, which hides areas of the subtraction result that do not affect the movement space itself. The result of this combination of the subtraction image and the mask is shown in FIG. 7d, leaving only the obstacles 5, which are then processed using conventional, known processing methods. For this purpose, the image shown in FIG. 7d is typically converted to a black-and-white image (binarized) and subjected to subsequent blob analysis. All these areas exceeding a certain predetermined size are then classified as obstacles, and their location and size are passed to the control device, if possible and necessary. Depending on the exact procedure, any movement of the manipulation device can be suppressed in the presence of an obstacle, or the obstacle can be identified and maneuvered around, or in the case of an optimally positioned small obstacle, the manipulation device's gripper can be initiated to remove the obstacle.

[0025] In the embodiment shown in Fig. 8, the size and position of the obstacle are determined in step 130. For this purpose, it may be necessary to specify reference points in the picking device in connection with the determination of size and position and / or to teach the control device based on several overall reference images. Alternatively or additionally, it may also be provided to equip the floor of the movement area and / or the two movement space portions with special patterns and / or characteristic numbers. Knowing the mounting position of the optical detection device allows the size and position to be determined in appropriate circumstances.

[0026] Based on the knowledge of the size and position of the obstacle, it is determined whether the obstacle can be bypassed based on the structural design of the movement space in step 140. If this is not the case, for example because the obstacle is at least partially located in a critical movement space portion, the operating device is blocked and further movement is prohibited until the operator indicates removal of the obstacle (step 200).

[0027] If a detour is possible (and intended), storage spaces that cannot be reached due to obstacles are marked accordingly, which means that for further operations of the picking device that are then possible, pharmaceutical packages stored in these storage spaces cannot be retrieved.

[0028] In alternative embodiments, it may be necessary to repeat the above method for multiple portions of the picking apparatus (if an optical detection device is placed or used on the gripper and cannot capture the entire movement space in one image), or to construct an image of multiple partial images (if multiple optical detection devices are used).

Claims

1. A method for operating a pharmaceutical picking device, the picking device comprising: a plurality of storage spaces for medicine bottles and / or medicine packages (6); an operating device (30) having a gripper (31), which can move horizontally in an X-direction (X-axis) and vertically in a Z-direction (Z-axis) in front of the storage space in the transfer space (20); at least one storage device (41, 42) into which the medicine bottles and / or medicine packages (6) can be moved and from which the gripper (31) can pick up the medicine bottles and / or medicine packages (6); at least one identification device (51, 52) for identifying the medicine bottle and / or medicine package (6); an ejection device (60) capable of transferring medicine bottles and / or medicine packages (6) by means of the operating device for removal from the picking device (1); at least one optical detection device (34, 70) arranged on the picking device (1) so as to be able to generate an image of the movement space (20); a control device (80) connected to the operating device (30), the identification device (51, 52), and the optical detection device (34, 70); Equipped with a) after a predetermined event, an image of the movement space (20) detectable by an optical detection device is created with the at least one optical detection device (34, 70); b) a predetermined region of the image of the movement space (20) is compared with a corresponding region of a reference image; c) determining whether an obstacle is present in the detection portion of the movement space (20) based on a comparison between a predetermined area of ​​the image and the reference image; d) providing a corresponding signal upon detecting the presence of said obstacle; The location and size of the obstacle are determined in step d), and determining whether the obstacle is to be bypassed by the manipulation device based on the determined location and size of the obstacle, and when the obstacle is bypassed, marking a storage area blocked by the obstacle as unreachable or inaccessible.

2. 2. The method for operating a pharmaceutical picking device according to claim 1, wherein it is determined whether the obstacle can be moved by the operating device based on the determined position and size of the obstacle.

3. 3. A method for operating a pharmaceutical picking device according to claim 1, wherein the gripper (31) of the operating device (30) is moved along the Z axis to a maximum Z position before creating a full image.

4. 4. The method of claim 3, wherein the overall image and the overall reference image are comprised of a plurality of individual images.

5. 5. The method of operating a pharmaceutical picking device according to claim 4, wherein the comparison between the entire image and the entire reference image is performed based on a partial image.

6. 2. The method of claim 1, wherein the provided signal temporarily prevents movement of the manipulation device (30).

7. The method for operating a pharmaceutical picking device according to any one of claims 1 to 6, wherein the presence of the obstacle is displayed to a user.

8. A pharmaceutical picking device (1), a plurality of storage spaces for medicine bottles and / or medicine packages (6); an operating device (30) having a gripper (31), which can move horizontally in an X-direction (X-axis) and vertically in a Z-direction (Z-axis) in front of the storage space in the transfer space (20); at least one storage device (41, 42) into which the medicine bottles and / or medicine packages (6) can be moved and from which the gripper (31) can pick up the medicine bottles and / or medicine packages (6); at least one identification device (51, 52) for identifying the medicine bottle and / or medicine package (6); an ejection device (60) capable of transferring medicine bottles and / or medicine packages (6) by means of the operating device for removal from the picking device (1); at least one optical detection device (34, 70) arranged on the picking device (1) so as to be able to generate an image of the movement space (20); a control device (80) connected to the operating device (30), the identification device (51, 52) and the optical detection device (34, 70), and configured to perform the method according to any one of claims 1 to 7; A pharmaceutical picking device (1) comprising:

9. 9. The pharmaceutical picking apparatus (1) according to claim 8, characterized in that the optical detection device (34) is a component of the gripper (31) of the handling device (30).

Images