Packaging support system and packaging support program
Patent Information
- Application Number
- JP2023148324
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-09-13
- Publication Date
- 2025-03-26
AI Technical Summary
【0009】 本発明によれば、残薬のチェックの信頼性を向上し得る分包支援システム及び分包支援プログラムを提供することができる。
Smart Images

Figure 2025041184000001_ABST
Abstract
Description
[Technical field]
[0001] The present invention relates to a packaging support system and a packaging support program that support a part or all of a packaging task. [Background technology]
[0002] As a related technique, a packaging support system (medicine packaging device) that packages medicines using packaging paper has been proposed (see, for example, Patent Document 1). The packaging support system includes a medicine storage and dispensing unit that is a medicine supply unit that can store medicines by type and dispense the medicines one packet at a time according to packaging data created based on prescription information, a medicine guide unit that receives the medicines, a medicine storage unit that temporarily stores the medicines, and a packaging unit that packages the medicines that have passed through the medicine storage unit one packet at a time using the packaging paper. The packaging support system introduces the medicines in the medicine storage unit into the packaging paper through a packaging opening and a medicine packaging introduction member.
[0003] In addition, in the packaging support system, a residual medicine detection camera is located above the medicine discharge position where the packaging opening is formed. Based on the photographing results of the residual medicine detection camera, it is possible to photograph the inside of the opening of the packaging paper from the packaging opening and automatically check whether there are any residual medicines (medicines that should have been packaged in advance) or the like inside the opening of the packaging paper. [Prior art documents] [Patent documents]
[0004] [Patent Document 1] International Publication No. 2022 / 050371 Summary of the Invention [Problem to be solved by the invention]
[0005] The packaging support system according to the related art does not have a specific configuration for displaying images captured by the remaining medicine detection camera, and the reliability of the remaining medicine check may become an issue.
[0006] An object of the present invention is to provide a packaging support system and a packaging support program that can improve the reliability of checking remaining medicines. [Means for solving the problem]
[0007] A packaging support system according to one aspect of the present invention includes an acquisition processing unit and a display processing unit. The acquisition processing unit acquires a captured image obtained by capturing an image of at least a part of a discharge path from an outlet for discharging medicines to an opening of the packaging paper in a packaging device that packages medicines to be packaged in packaging paper. The display processing unit is capable of displaying a check image used for checking remaining medicines based on the captured image. The display processing unit displays the check image only when the medicines to be packaged satisfy a display condition.
[0008] A dispensing operation support program according to another aspect of the present invention is a program for causing a computer to execute an acquisition step and a display step. In the acquisition step, a captured image is acquired by capturing an image of at least a part of a discharge path from an outlet for discharging medicine to an opening of the packaging paper in a packaging device that packages medicines to be packaged in packaging paper. In the display step, a check image used for checking remaining medicine based on the captured image can be displayed only when the medicines to be packaged satisfy a display condition. Effect of the Invention
[0009] According to the present invention, it is possible to provide a packaging support system and a packaging support program that can improve the reliability of checking remaining medicines. [Brief description of the drawings]
[0010] [Figure 1]FIG. 1 is an explanatory diagram showing a schematic configuration of a packaging support system according to an embodiment of the present invention. [Diagram 2] FIG. 2 is a side view showing the periphery of a packaging unit of the packaging support system according to the embodiment of the present invention. [Diagram 3] FIG. 3 is an explanatory diagram showing a schematic configuration of a packaging support system according to an embodiment of the present invention. [Figure 4] FIG. 4 is a block diagram showing a schematic configuration of a packaging support system according to an embodiment of the present invention. [Diagram 5] FIG. 5 is a schematic perspective view showing a medicine storage unit and a medicine photographing device of the packaging support system according to the embodiment of the present invention. [Figure 6] FIG. 6 is a schematic perspective view of the packaging support system according to the embodiment of the present invention with the remaining detection camera and the like removed. [Figure 7] FIG. 7 is a schematic perspective view of a packaging assistance system according to an embodiment of the present invention with the top plate of the revolver removed. [Figure 8] FIG. 8 is a schematic enlarged perspective view of a revolver of the packaging support system according to the embodiment of the present invention. [Figure 9] FIG. 9 is a schematic perspective view of a medicine receiver bottom of a packaging support system according to an embodiment of the present invention. [Figure 10] FIG. 10 is a schematic diagram showing the shooting ranges of the two residue detection cameras of the packaging support system according to the embodiment of the present invention. [Figure 11] FIG. 11 is a schematic perspective view of a revolver of a packaging support system according to an embodiment of the present invention, as viewed from the bottom side. [Figure 12] FIG. 12 is an explanatory diagram showing an example of an inspection result screen displayed in the packaging support system according to an embodiment of the present invention. [Figure 13] FIG. 13 is an explanatory diagram showing an example of correction of a check image in the packing support system according to an embodiment of the present invention. [Figure 14] FIG. 14 is an explanatory diagram showing an example of an enlarged display of a check image in the packing support system according to an embodiment of the present invention. [Figure 15]FIG. 15 is an explanatory diagram showing another display mode of the check image in the packing support system according to the embodiment of the present invention. [Figure 16] FIG. 16 is a flowchart showing an example of the operation of the packaging support system according to the embodiment of the present invention. [Figure 17] FIG. 17 is a schematic perspective view of the packaging support system according to the embodiment of the present invention in a state where the upper plate portion is closed. [Figure 18] FIG. 18 is a schematic perspective view of the packaging support system according to the embodiment of the present invention with the upper plate portion open. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0011] Hereinafter, an embodiment of the present invention will be described with reference to the accompanying drawings to facilitate understanding of the present invention. Note that the following embodiment is an example of the present invention and is not intended to limit the technical scope of the present invention. In addition, the configurations and processing functions described in the following embodiment can be selected and combined as desired.
[0012] [Packaging Support System 10] As shown in Figures 1 to 4, the packaging support system 10 of this embodiment includes a packaging device 1 that packages medicines using packaging paper S, an inspection device 100 that inspects the packaged medicines, and a display device 101.
[0013] The packaging device 1 includes a medicine storage and dispensing unit 11, which is a medicine supplying section capable of storing medicines by type and dispensing the medicines one packet at a time according to packaging data created based on prescription information, a medicine guide section 12 that receives the medicines, a medicine storage unit 5 that temporarily stores the medicines, and a packaging unit 4 to which a packaging paper roll 400 and an ink ribbon cassette 401 are attached, which prints on packaging paper S supplied from the packaging paper roll 400 and uses the packaging paper S to package the medicines that have passed through the medicine storage unit 5 one packet at a time. The printing mechanism including the ink ribbon cassette is not necessarily required. The inspection device 100 includes a medicine photographing device 6 that takes still images of the medicines supplied to the medicine storage unit 5.
[0014] The medicine containing and dispensing unit 11 includes a medicine cassette containing various medicines and a universal cassette capable of containing medicines that are not suitable for being contained in the cassette. Specifically, the medicine cassette is a dedicated cassette prepared for each medicine, with the size of the medicine dispensing path corresponding to the shape and size of each medicine, and the universal cassette is a general-purpose cassette capable of dispensing medicines of various shapes and sizes by making the size and driving conditions of the medicine dispensing path adjustable as necessary. In addition, the prescription information usually includes, for example, the type of medicine and the number of pieces. However, information on the mark of the medicine (such as the presence or absence of a mark and information on the external shape of the mark), the size, shape, and color can be acquired by referring to a medicine master table described later based on the type of medicine.
[0015] The packaging device 1 also includes a manual distribution unit 13. This manual distribution unit 13 has boxes arranged in a lattice pattern, and medicines can be placed in each box. For example, if a day's worth of medicines is prescribed for morning, afternoon, and evening, the medicines will be placed in three boxes.
[0016] The medicines dispensed from the medicine accommodating and dispensing unit 11 and the medicines manually distributed by the manual distribution unit 13 reach the medicine storage unit 5 via the medicine guiding unit 12 etc. The medicines remaining in the medicine storage unit 5 are photographed as still images by the medicine photographing device 6 and then packaged in packet paper by the packaging unit 4. That is, in this embodiment, one packet of medicines is discharged by the joint operation of the medicine accommodating and dispensing unit 11 and the manual distribution unit 13. The route of the medicines discharged from the medicine accommodating and dispensing unit 11 and the manual distribution unit 13 to the medicine storage unit 5 will be described later with reference to FIG. 5 etc.
[0017] Fig. 2 is a diagram showing an example of the packaging unit 4 in a state in which the packet paper roll 400 and the ink ribbon cassette 401 are attached. Fig. 2 also shows the medicine packaging section 45 of the packaging unit 4. This medicine packaging section 45 introduces a medicine from an opening of the packet paper S, which is folded in half, and heat-seals the packet paper S to seal in the introduced medicine.
[0018] The packaging paper S is passed, for example, so as to be hung on three guide shafts 4a, pass between the backup roller 4b and the print head 4e, and further hang on the guide shaft 4c.
[0019] 2, for example, rotatable curved guide rollers 45b, 45c are disposed in the vicinity of guide shaft 4c that guides the packet paper S (downstream in the conveying direction of the packet paper S) to curve the conveying direction of the packet paper S immediately before unfolding guide 45a of the drug packaging section 45. The packet paper S folded in half is opened by passing over the guide surface (front surface) of unfolding guide 45a. A drug packaging introduction member 7 (see FIG. 3, etc.) that introduces a drug into the packet paper S is provided on the non-guide surface (back surface) of unfolding guide 45a, in other words above the opened portion of the packet paper S.
[0020] The medicinal packaging introduction member 7 has a shape that is narrower at the bottom. As described above, the folded packet paper S passes over the guide surface of the unfolding guide 45a, whereby the packet paper S is opened. As a result, an opening, which is the open portion of the packet paper S, is formed in a position close to the lower end of the medicinal packaging introduction member 7. The opening of the packet paper S is a location that receives the medicines that drop from the medicinal packaging introduction member 7.
[0021] The medicine packaging unit 45 also includes a heat seal member (e.g., a pair of heater rollers 45d, 45e) on the downstream side of the unfolding guide 45a in the conveying direction of the sachet paper S. Furthermore, a feed roller is provided on the downstream side of the heater rollers 45d, 45e in the conveying direction of the sachet paper S. These heater rollers 45d, 45e are rotated by a drive mechanism (not shown) including a motor, a linear gear, an intermittent gear, etc. The heater rollers 45d, 45e can move the sachet paper S at a predetermined speed. The heater rollers 45d, 45e also close the opening of the sachet paper S and seal the sachet paper S in the short side direction, so that one packet of medicine placed in the opening is individually packaged.
[0022] 3 shows a schematic configuration of the entire packaging support system 10. The medicine storing unit 5 and the medicine photographing device 6 are located between the medicine accommodating and dispensing unit 11 and the packaging unit 4.
[0023] The drug storage unit 5 has an upper plate portion 51 and a lower plate portion 52. The drug storage unit 5 also has a revolver 501 in the space between the upper plate portion 51 and the lower plate portion 52. The revolver 501 includes a disk-shaped turntable portion 5010, an upper plate 5011 fixed to the upper surface side of the turntable portion 5010, and a drug receiving bottom portion 5012 located on the lower surface side of the turntable portion 5010 and not fixed to the turntable portion 5010.
[0024] As shown in Fig. 5, the drug delivery section 2, the first camera 61, etc. are attached to the upper surface of the upper plate 51. As shown in Fig. 5, the turntable section 5010 and the upper plate 5011 in the revolver 501 can rotate in a horizontal plane around the axis 504 on the upper surface side (within the space) of the lower plate 52. The drug receiving bottom section 5012 is attached so as not to rotate on the lower plate 52, and is attached so as to be removable from the lower plate 52. Furthermore, the drug packaging introduction member 7 and the second camera 62, etc. are attached to the lower surface side of the lower plate 52.
[0025] As shown in FIG. 6, a gear portion 501a is formed on the outer circumferential surface of the turntable portion 5010 of the revolver 501, and a gear 503a is engaged with the gear portion 501a. The gear 503a is driven by the motor 503 to rotate the turntable portion 5010. The turntable portion 5010 can be rotated intermittently in the forward direction by a predetermined angle by controlling the driving of the motor 503. The turntable portion 5010 is rotated forward and backward by controlling the driving of the motor 503. Overlapping of medicines in the storage portion 50 can be eliminated by rotating the turntable portion 5010 forward and backward.
[0026] The revolver 501, which includes the turntable 5010 and the medicine receiving bottom 5012, has, for example, eight storage sections 50. Each storage section 50 temporarily stores the medicine before the medicine is packaged. The eight storage sections 50 are positioned at regular intervals on the same circumference centered on the axis 504. The medicine supplied to each storage section 50 is supported by the medicine receiving bottom 5012. The turntable 5010 is detachable from the medicine receiving bottom 5012.
[0027] As shown in Figs. 7 and 8, each storage section 50 is composed of a tube section (opening) 50a made of a transparent material (such as resin) that transmits light, and a portion of the medicine receiving bottom section 5012 that functions as the bottom section of the tube section 50a, and medicine is stored inside the tube section 50a. The medicine receiving bottom section 5012 is arranged horizontally, and the direction perpendicular to this is the vertical direction. The imaging optical axis of cameras 61, 62, and 66 described later is vertical toward the portion of the medicine receiving bottom section 5012 that functions as the bottom section of the tube section (opening) 50a. In addition, an inclined mirror section 6a that forms a frustum-shaped mirror surface that is spaced upward from the outer circumferential surface of the tube section 50a is arranged on the periphery side of the tube section 50a.
[0028] The cylinder 50a is located at the center of the inclined mirror 6a. The lower end of the inclined mirror 6a is in contact with the outer periphery of the lower end of the cylinder 50a. The upper end surface of the cylinder 50a is processed to a frosted glass surface (finely uneven surface) or a light-impermeable surface. In addition, a square opening that matches the planar shape of the cylinder 50a is formed in the upper plate 5011 at the location where the cylinder 50a is located, and the medicine can reach the inside of the cylinder 50a through the square opening. In addition, the upper plate 5011 is entirely transparent, or at least the portion located above the inclined mirror 6a is transparent.
[0029] The inner shape of the cylindrical portion 50a is a polygonal cylinder made up of a plurality of planes, and is, for example, a hexagonal shape in a plan view of the cylindrical portion 50a. The outer shape of the cylindrical portion 50a is a circle. In addition, the inclined mirror portion 6a reflects light from above toward the cylindrical portion 50a, so that the medicine inside the cylindrical portion 50a can be illuminated with side light (light in a direction intersecting with the photographing optical axis of the camera 61). If a large amount of side light is obtained, it is possible to preferably photograph marks such as markings on the medicine. In addition, instead of the inclined mirror portion 6a, a light-emitting element that emits light toward the side surface of the cylindrical portion 50a may be provided on the outer periphery of the cylindrical portion 50a.
[0030] The medicine receiving bottom 5012 is made of a transparent material (such as resin) that transmits light. In addition, a packaging opening 5012a is formed at a predetermined position of the medicine receiving bottom 5012, as shown in FIG. 9. The medicine packaging introduction member 7 is located below the packaging opening 5012a, and when the tubular portion 50a of the storage portion 50 is located above the packaging opening 5012a, the medicine in the storage portion 50 falls into the medicine packaging introduction member 7 and reaches the packaging paper S. That is, the packaging opening 5012a is located at a specific location in the area where the tubular portion (opening) 50a moves due to the rotation of the turntable portion 5010. An opening is also formed in the lower plate portion 52 at a position corresponding to the packaging opening 5012a.
[0031] When the turntable 5010 of the revolver 501 rotates on the medicine receiving bottom 5012, each storage section 50 moves sequentially to the first medicine receiving position P1, the second medicine receiving position P2, the third medicine receiving position P3, the non-processing position P4, the fourth medicine receiving position P5, the medicine photographing position P6, the medicine discharge position P7 (packaging position) where the packaging opening 5012a is formed, and the remaining medicine confirmation position P8, as shown in Figs. 6 and 7. A plurality of wheels 56 (see Fig. 11) are attached to the lower surface of the turntable 5010, and while the load of the turntable 5010 is received by the medicine receiving bottom 5012, a certain gap can be maintained between the upper surface of the medicine receiving bottom 5012 and the bottom surface of the turntable 5010 so that they do not slide against each other. This gap reduces the adverse effect on the rotation of the turntable 5010 caused by medicine powder (medicine waste), etc., and reduces the number of cleaning times. In addition, medicine receiving bottom portion 5012 is formed with medicine powder recovery groove 5012c (see FIG. 9) at a position inside the outer circumferential end thereof.
[0032] At the first medicine receiving position P1, the medicine transferred by the medicine transferring unit 2 falls into the storage unit 50 located at the position P1. The medicine transferring unit 2 has a hopper 21 located below the medicine guiding unit 12 and above the remaining medicine confirmation position P8. Furthermore, the medicine transferring unit 2 has a belt-driven transfer unit (not shown). This transfer unit is located between the lower part of the hopper 21 and the first medicine receiving position P1, and transfers the medicine received from the hopper 21 into the storage unit 50 at the first medicine receiving position P1. In addition, by providing an ionizer that emits ions toward the inside of the hopper 21, it is possible to suppress adhesion of the medicine to the inside of the hopper 21 due to static electricity.
[0033] To the second medicine receiving position P2, medicines are supplied from another medicine supply unit.
[0034] At the third medicine receiving position P3, the medicine supplied from the universal cassette is supplied into the storage section 50 located at the position P3 through the guide tube 201 and the supply opening 201a. The universal cassette can supply medicine regardless of the shape of the medicine, and automatically discharges the medicine instead of manually dispensing the medicine. As described above, the medicine containing and dispensing unit 11 includes a plurality of cassettes, some of which are universal cassettes. By providing an ionizer that emits ions toward the inside of the guide tube 201, it is possible to prevent the medicine from adhering to the inside of the guide tube 201 and the storage section 50 due to static electricity.
[0035] At the fourth medicine receiving position P5, the medicine supplied from the manual distribution unit 13 is supplied into the storage unit 50 located at the position P5 via a hopper and a supply opening 202 (not shown).
[0036] At the medicine photographing position P6, medicines (for example, a packet of a plurality of medicines) are temporarily stored in the storage section 50 located at the position P6. The medicine photographing device 6 is located near the medicine photographing position P6.
[0037] The drug photographing device 6 has a photographing section 60 for photographing a subject as a still image, as shown in Fig. 3. In this embodiment, the photographing section 60 includes a first camera 61 for photographing a drug in the storage section 50 located at the drug photographing position P6 in color from above, a second camera 62 for photographing a drug in the storage section 50 in color from below, an upper illumination section 63 for illuminating the drug in the storage section 50 from above, the inclined mirror section 6a (which may be a light-emitting element instead of the inclined mirror section 6a) for illuminating the drug in the storage section 50 from the side, and a lower illumination section 64 for illuminating the drug in the storage section 50 from below.
[0038] The photographing section 60 of the drug photographing device 6 is provided with a surface light emitting member 65 below the lower illumination section 64. The portion of the lower plate section 52 corresponding to the drug photographing position P6 is transparent or has an opening. The surface light emitting member 65 has, for example, a rectangular shape, and can be switched between a surface light emitting state and a transparent state. The surface light emitting member 65 may be located above the lower illumination section 64.
[0039] Then, under the control of the controller 8 shown in FIG. 4, the photographing unit 60 performs a first photographing process in which the upper illumination unit 63 is turned on and the drug in the storage unit 50 is photographed from above using the first camera 61 in a non-backlit state (either front light, side light, or a mixture of front light and side light), a second photographing process in which the surface light-emitting member 65 is turned on and the drug in the storage unit 50 is photographed from above using the first camera 61 in a backlit state, and a third photographing process in which the lower illumination unit 64 is turned on and the drug in the storage unit 50 is photographed from below using the second camera 62 in a non-backlit state (either front light, side light, or a mixture of front light and side light).
[0040] At the medicine discharge position P7, the packaging opening 5012a is formed, which leads to the medicine packaging introduction member 7. As a result, the medicine in the storage section 50 positioned at the medicine discharge position P7 (packaging position) is discharged from the packaging opening 5012a to the medicine packaging introduction member 7.
[0041] A first residual detection camera 601 and a second residual detection camera 602 are positioned above the medicine discharge position P7 (packaging position). That is, the medicine photographing device 6 is equipped with a plurality of (here, two) residual detection cameras including the first residual detection camera 601 and the second residual detection camera 602. Also, an illumination unit consisting of an LED or the like that illuminates the photographing range of each residual detection camera is provided.
[0042] 10, the first residual detection camera 601 has a deep depth of field and captures an image of an area (hereinafter referred to as an upper area) extending from the relay section 71 to an approximately midpoint of the shooter section 72 in the pharmaceutical packaging introduction member 7. From the image capture result, it is possible to confirm whether or not any pharmaceutical is attached to the upper area extending from the relay section 71 to an approximately midpoint of the shooter section 72 in the pharmaceutical packaging introduction member 7.
[0043] The second residue detection camera 602 also has a deep depth of field, and captures an image of the area (hereinafter referred to as the lower area) from approximately the middle position of the chute portion 72 of the pharmaceutical packaging introduction member 7 to the inside of the opening of the packet paper S. From the image capture result, the inside of the opening of the packet paper S can be captured from the packaging opening 5012a, making it possible to confirm whether or not a pharmaceutical is attached to the lower area, which is the final part of the pharmaceutical packaging introduction member 7, and whether or not a pharmaceutical (a pharmaceutical that should have been packaged in advance) or a foreign object is present inside the opening of the packet paper S.
[0044] The imaging ranges of the two residual detection cameras 601 and 602 overlap at approximately the center of the shooter unit 72.
[0045] As shown in FIG. 2, the illumination unit includes a first light-emitting unit 451, a second light-emitting unit 452, and a third light-emitting unit 453. For example, the first light-emitting unit 451 is disposed near the installation positions of the residual detection cameras 601, 602, and illuminates the inside of the medicine packaging introduction member 7 from a position above the medicine discharge position P7. The second light-emitting unit 452 is disposed in the packaging unit 4 (preferably the medicine packaging unit 45), and illuminates the vicinity of the position between the heater roller 45d and the heater roller 45e from a position to the side of the medicine packaging introduction member 7. The third light-emitting unit 453 is disposed on the non-guide surface (rear surface) side of the unfolding guide 45a, and illuminates the vicinity of the position between the heater roller 45d and the heater roller 45e in the same manner as the second light-emitting unit 452. The light emitted from the third light-emitting unit 453 reaches the opening of the packaging paper S without passing through the packaging paper S.
[0046] The brightness (amount of light) of the first light-emitting unit 451, the second light-emitting unit 452, and the third light-emitting unit 453 may be adjustable by a dimmer. Furthermore, the third light-emitting unit 453 is not limited to being positioned within a recess in the non-guide surface (back surface) of the unfolding guide 45a. The third light-emitting unit 453 itself may enter through the opening of the packaging paper S and be positioned within the opening to illuminate the inside of the opening. Such a third light-emitting unit 453 is supported by, for example, a thin rod-shaped or wire-shaped support member and enters through the opening of the packaging paper S and is positioned within the opening. The support source may be the non-guide surface (back surface) of the unfolding guide 45a or the tip of the shooter unit 72.
[0047] In one example of control in a configuration having the two residue detection cameras 601, 602, the first residue detection camera 601 photographs the upper region with only the first light emitting unit 451 turned on (first photographing operation). That is, in the first photographing operation, the upper region of the inner wall surface of the medicine packaging introduction member 7 is set as the photographing range, and the first photographing operation is used to determine whether or not the medicine is attached to the inner wall surface.
[0048] On the other hand, with all of the first light-emitting unit 451, the second light-emitting unit 452, and the third light-emitting unit 453 turned on, the upper and lower regions are photographed by the two residue detection cameras 601, 602 (second photographing operation). That is, in the second photographing operation, the entire inner wall surface of the medicine packaging introduction member 7 and the inside of the opening of the packaging paper S are set as the photographing range, and if it is determined that there is even one medicine grain in the entire inner wall surface of the medicine packaging introduction member 7 and in the opening of the packaging paper S at a stage where the medicine to be packaged has not yet started to be dropped into the opening of the packaging paper S, it is determined that there is a remaining medicine. In the second photographing operation, by emitting light not only from the first light-emitting unit 451 but also from the second light-emitting unit 452 and the third light-emitting unit 453, the total amount of illumination is increased and the inside of the opening of the packaging paper S can be illuminated from multiple directions, so that even if there is even one medicine grain in the opening of the packaging paper S, it can be accurately detected. It is also possible to adopt a mode in which the first light emitting portion 451 does not emit light in the second photographing operation.
[0049] Hereinafter, an example of remaining drug detection imaging for detecting remaining medicine by the first imaging operation and the second imaging operation will be described.
[0050] The inspection device 100 performs the second photographing operation with the Kth packet (K is a natural number with a maximum value of the set number of packets N) of medicine located at the medicine photographing position P6. When K=1, information can be obtained as to whether or not remaining medicine in a medicine package based on a previous prescription remains in the opening of the packaging paper S of the current prescription at the medicine discharge position P7. When K=2 or later, information can be obtained as to whether or not a medicine that should be packaged earlier in the current prescription remains in the opening of the packaging paper S in a subsequent package. Note that when several blank packets are generated between different prescriptions, the second photographing operation when K=1 may be omitted.
[0051] After the second photographing operation, when the turntable unit 5010 rotates 45 degrees, the Kth packet of medicine according to the current prescription is dropped from the medicine discharge position P7 through the medicine packaging introduction member 7 into the opening of the packet paper S. The state of this dropping is photographed by the first photographing operation. That is, with only the first light-emitting unit 451 turned on, the upper region is photographed by the first residual detection camera 601.
[0052] The photographing for detecting residual medicine for the Kth package of the current prescription starts from the first photographing operation. If the result of the first photographing operation indicates that no medicine is attached to the inner wall of the medicine packaging introduction member 7, and if the Kth package is packaged in a state in which part of the medicine to be packaged has moved to the position of the succeeding K+1th package while the package corresponding to the Kth medicine is being packaged, residual medicine present within the opening of the packet paper S will be detected in the next second photographing operation.
[0053] After the first photographing operation, a packaging operation for one package is executed. Next, K is incremented, and it is determined whether K has exceeded N. If K has not exceeded N, the second photographing operation for the subsequent package of medicine is executed, and if K has exceeded N, K is reset, and photographing processing for the package of the next prescription is executed.
[0054] In the above example, the two residue detection cameras 601, 602 are arranged above the medicine discharge position P7 (packaging position), but the present invention is not limited to this configuration. The medicine packaging introduction member 7 may be provided in whole or in part so as to be movable in the lateral direction, and the residue detection camera arranged at the moved position may photograph the inside of the medicine packaging introduction member 7 after the movement. This reduces the number of residue detection cameras arranged on the storage section 50, and avoids the complication of the structure due to the dense arrangement of cameras on the storage section 50. Alternatively, the medicine photographing device 6 may include three or more residue detection cameras. Sensors may be used instead of the residue detection cameras.
[0055] A third camera 66 (see FIG. 8, etc.) is positioned below the remaining medicine checking position P8. This third camera 66 takes an image of the inside of the storage section 50 which has moved to the remaining medicine checking position P8 after the medicine stored in the storage section 50 has been delivered to the medicine packaging section 45. The image captured by the third camera 66 makes it possible to check whether any medicine remains on the inner wall surface and in the inner space of the cylindrical section 50a.
[0056] 4, the inspection device 100 includes a storage unit 80 in addition to the medicine photographing device 6 and the controller 8. The controller 8 includes an acquisition processing unit 81, a medicine checking unit 82, a display processing unit 83, and a drive processing unit 84.
[0057] The storage unit 80 connected to the controller 8 stores a so-called master table (database of medicines, etc.), prescription information for each patient, image data captured by the first, second and third cameras 61, 62, 66 and the first and second residual detection cameras 601, 602, etc. The storage unit 80 includes a storage area in which a packaging support program for causing the controller 8 to execute various processes related to a packaging support method described below is stored. The storage unit 80 also stores programs such as an operating system (OS).
[0058] The acquisition processing unit 81 of the controller 8 performs processing to store images captured by the first, second and third cameras 61 , 62 , 66 and the first and second residual detection cameras 601 , 602 and the like in the storage unit 80 .
[0059] The medicine check unit 82 of the controller 8 checks the medicine in the storage unit 50 located on the medicine photographing position P6 based on the image photographed by the photographing unit 60. When the medicine check unit 82 does not determine that the number of medicines and medicine information of the medicine in the storage unit 50 located on the medicine photographing position P6 are correct by referring to the packaging data (characteristic data), the controller 8 may rotate the turntable unit 5010 of the revolver 501 forward and backward to roll the medicine in the storage unit 50, and perform the above-mentioned first, second, and third photographing processes again. Alternatively, an alert may be output as an error process.
[0060] On the other hand, when the medicine check unit 82 judges that the number of medicines in the storage unit 50 located on the medicine photographing position P6 and the medicine information described later are correct by referring to the packaging data (characteristic data), the controller 8 rotates the turntable unit 5010 of the revolver 501 forward by 45 degrees to move the storage unit 50 on the medicine photographing position P6 to the medicine discharge position P7 (packaging position) where the packaging opening 5012a is formed. As a result, the medicine in the storage unit 50 reaches the packaging paper S from the packaging opening 5012a through the medicine packaging introduction member 7.
[0061] Moreover, the drug check unit 82, as a determination unit, can determine the drug by recognizing marks such as stamps, which are drug information of the drug, in the photographed images photographed in the first photographing process and the third photographing process. Furthermore, the drug check unit 82 can automatically determine whether or not the drug specified in the prescription information (packaging data) is present in the storage unit 50 by determining whether the identified drug matches the drug mark indicated in the prescription information (packaging data) in the storage unit 80 (drug master table).
[0062] Furthermore, the display processing unit 83 of the controller 8 can read out the captured image, etc. from the storage unit 80 and display it as an inspection result screen G1 (see FIG. 12) on the display device 101. An inspector can inspect the medicine in the storage unit 50 by looking at the inspection result screen G1 displayed on the display device 101.
[0063] The inspection result screen G1 may be displayed on the display device 101 by, for example, processing by the controller 8, in which the upper image of the drug taken by the first camera 61 and the lower image of the drug taken by the second camera 62 are associated as front and back images for each drug that is presumed to be the same drug. The association of the front and back images is performed by arranging the images side by side or vertically. In addition, whether or not the drugs are the same can be estimated from the correspondence between the drug position in the image taken from above by the first photographing process and the drug position in the image taken from below by the third photographing process within the certain period of time. Furthermore, the association of the front and back images may be performed for all of the multiple images, or may be performed for a specific image taken from among the multiple images. The specific photographed image may be an image in which the drug check unit 82 recognizes an imprint or the like.
[0064] The inspection result screen G1 includes, for example, patient information, information on the medicine administered to the patient (medicine name and medicine image), and front and back images of each medicine cut out from the entire image of the inside of the reservoir taken for each package. The inspection result screen G1 will be described in detail later.
[0065] The drive processing unit 84 of the controller 8 controls the motor 503. This control includes not only the intermittent 45-degree rotation of the turntable unit 5010 of the revolver 501, but also the control of eliminating overlapping of the medicines in the storage unit 50 by rotating the turntable unit 5010 forward and backward at a speed faster than the speed of the 45-degree rotation.
[0066] Furthermore, the drive processing unit 84 controls the photographing timing of the first, second and third cameras 61, 62 and 66, the first and second residual detection cameras 601 and 602, the lighting timing of the upper illumination unit 63, the lower illumination unit 64 and the surface light emitting member 65, etc., in response to the rotational operation of the turntable unit 5010 of the revolver 501. Note that in this embodiment, still photography is simultaneously performed at the medicine photographing position P6 (the first and second cameras 61 and 62), the medicine discharge position P7 (the first and second residual detection cameras 601 and 602), and the remaining medicine confirmation position P8 (the third camera 66) every time the turntable unit 5010 of the revolver 501 rotates intermittently by 45 degrees.
[0067] As shown in FIG. 11, a cleaning member 55 for cleaning the medicine receiving bottom 5012 is provided on the bottom side of the turntable 5010 at a location not forming the storage section 50. The cleaning member 55 can prevent medicine powder (medicine scraps) on the medicine receiving bottom 5012 from being packaged together with the medicine. The cleaning member 55 includes, for example, a scraper 55a and a support section 55b for supporting the scraper 55a. The support section 55b may be movably supported on the turntable 5010 so that the scraper 55a can be brought into contact with and separated from the medicine receiving bottom 5012. Then, when the drug receiving bottom 5012 rotates around the axis 504 with the scraper 55a in contact with the drug receiving bottom 5012, the scraper 55a scrapes up the drug powder on the drug receiving bottom 5012 into the storage recess 5012b (see Figure 9) and the drug powder recovery groove 5012c (see Figure 9) described below.
[0068] In the cleaning member 55, a state in which the scraper 55a contacts the medicine receiving bottom 5012 and a state in which the scraper 55a is separated from the medicine receiving bottom 5012 are switched by, for example, a motor driven by the drive processing unit 84. During cleaning by the cleaning member 55, the scraper 55a is in contact with the medicine receiving bottom 5012. On the other hand, after cleaning is completed, the scraper 55a is in a state in which it is separated from the medicine receiving bottom 5012.
[0069] The scraper 55a extends from the outer periphery of the turntable 5010 to the center of the turntable 5010. The end of the scraper 55a located on the center side is eccentrically positioned on the delayed side with respect to the forward rotation direction of the turntable 5010 from the center of the turntable 5010. This allows the medicine powder scraped off on the medicine receiver bottom 5012 to be moved to the center of the medicine receiver bottom 5012 by the rotation of the turntable 5010.
[0070] In the configuration including the cleaning member 55, medicine powder is removed from the medicine receiving bottom 5012 when the turntable 5010 rotates. This eliminates the need for a user to clean the medicine receiving bottom 5012. Without this effort, it is possible to solve problems such as inappropriate illumination due to medicine powder in the storage unit 50 located at the medicine photographing position P6, and misidentifying a lump of medicine powder as a single medicine.
[0071] The medicine powder cleaning by the cleaning member 55 may be automatically performed each time the prescription target of the medicine is changed. Not limited to this, for example, the medicine powder cleaning may be automatically performed each time the packaging process for a set number of packets (for example, 10 packets) is completed. The medicine powder cleaning may be performed when dirt on the bottom of the storage unit 50 located at the medicine shooting position P6 is detected by a sensor or a camera image, or when the user presses a cleaning switch. However, when the dirt is detected, if the supply of the medicine related to the next prescription of the prescription being packaged has started to the storage unit 50, it is preferable to perform the medicine powder cleaning by the cleaning member 55 after the packaging operation related to the next prescription is completed and before the packaging operation related to the next prescription is started. When it is determined that cleaning is necessary, the supply of the medicine to the storage unit 50 may be stopped and all the medicines present in the storage unit 50 at that time may be packaged. However, if the morning, afternoon, and evening prescribed medications are of the same type (which can be determined from the prescription information), there is no problem if the medication and its powdered medicine are packaged together, so it is not necessary to determine whether cleaning is necessary.
[0072] The medicine powder scraped up by the cleaning member 55 may be stored in a storage recess 5012b (see FIG. 9) of the medicine receiving bottom portion 5012. Alternatively, the cleaning member 55 may be provided so as to drop the medicine powder from the packaging opening 5012a. The medicine powder that has dropped from the packaging opening 5012a may be packaged in a packaging paper S located below the packaging opening 5012a.
[0073] The timing at which the cleaning member 55 starts cleaning may be any timing other than the simultaneous timing of dropping the medicine from the packaging opening 5012a and dropping the medicine powder by the cleaning member 55. For example, the timing at which the cleaning member 55 starts cleaning is after the medicine is discharged from all of the storage sections 50 in which the medicine is stored, in other words, after all of the storage sections 50 in which the medicine is stored are moved to the medicine discharge position P7.
[0074] [Packaging support method] Next, an example of the packing support method will be described which is executed mainly by the controller 8. The controller 8 executes various processes related to the packing support method when a preset specific start operation for executing the packing support program is performed on the packing support system 10. Note that the present invention may be understood as an invention of a method (packing support method) in which a computer such as the controller 8 executes part or all of the processes of the packing support method.
[0075] Specifically, the inspection result screen G1 and other screens displayed on the display device 101 by the display processing unit 83 of the controller 8 will be described with reference to Figs. 12 to 15. In this disclosure, "screen" refers to an image (picture) displayed on the display device 101, etc., and includes icons, figures, photographs, text, videos, and the like. In the drawings showing the screens displayed on the display device 101, such as Figs. 12 to 15, the dashed dotted lines, leader lines, and reference symbols representing areas are added merely for the purpose of explanation, and are not actually displayed on the display device 101.
[0076] The display device 101 is, for example, an information processing device such as a personal computer, a laptop computer, a smartphone, a tablet terminal, or a wearable terminal. Therefore, the display device 101 has a keyboard and a pointing device (mouse, etc.) as an operation unit operated by a user (inspector, etc.) to input various information. The display device 101 may also include a touch panel that accepts touch operations on various operation screens displayed, or a voice input device that accepts input of various information by voice recognition.
[0077] The inspection result screen G1 includes, for example, an attribute area R11, a drug list area R12, and a drug package list area R13, as shown in FIG. 12. The attribute area R11 is an area where information such as patient information and prescription information is displayed. The drug list area R12 is an area where information about the drug administered to the patient (such as drug name) is displayed. The drug package list area R13 is an area where front and back images of each drug, which are cut out from an overall image of the inside of the storage section photographed for each package, are displayed. In addition, operation keys and buttons used to operate the inspection result screen G1 are also displayed on the inspection result screen G1.
[0078] The information displayed in the medicine list area R12 includes, for example, the name of the medicine to be packaged, as well as the medicine type, the number, and a normal image. The normal image is, for example, a reference image of the medicine to be packaged among reference images of medicines stored in advance in the storage unit 80. The normal image may be an image provided by a medicine manufacturer, an image taken in the photographing environment of the packaging device 1, or an image taken in a medicine room in which the packaging device 1 is installed.
[0079] In the medicine package list area R13, information about medicines packaged in multiple packets is displayed in a list arranged in the horizontal direction (left-right direction). In the example of Fig. 12, a total of nine packets of medicines, including the first packet, the second packet, the third packet, ..., and the ninth packet, are displayed in the medicine package list area R13 in order from the left. The medicine package list area R13 includes an item column R131, a remaining check column R132, and an inspection column R133. As an example, the item column R131, the remaining check column R132, and the inspection column R133 are arranged in order from top to bottom in the vertical direction (up-down direction).
[0080] The item column R131 displays information for identifying each of the multiple packets, such as "first packet, after breakfast" and "second packet, after breakfast." The inspection column R133 displays front and back images in which an upper image of the drug taken by the first camera 61 and a lower image of the drug taken by the second camera 62 are associated with each other for each drug that is presumed to be the same drug. The front and back images are displayed, for example, so that the upper image and the lower image are arranged side by side.
[0081] The remaining medicine check field R132 can display a check image G11 used for checking remaining medicine (checking remaining medicine). The check image G11 here is an image displayed based on at least one of the captured image of the upper region captured by the first remaining medicine detection camera 601 and the captured image of the lower region captured by the second remaining medicine detection camera 602. That is, the check image G11 is generated based on a captured image of at least one of the upper region from the relay section 71 to a substantially middle position of the shooter section 72 in the medicine packaging introduction member 7 and the lower region from a substantially middle position of the shooter section 72 in the medicine packaging introduction member 7 to the opening of the packet paper S.
[0082] In short, the packaging support system 10 according to this embodiment includes the acquisition processing unit 81 and the display processing unit 83. The acquisition processing unit 81 acquires a captured image obtained by capturing an image of at least a part of a discharge path from a discharge port for discharging medicines to be packaged to the opening of the packaging paper S in a packaging device 1 that packages medicines to be packaged in the packaging paper S. The display processing unit 83 is capable of displaying a check image G11 used for checking remaining medicines based on the captured image.
[0083] In this embodiment, the packaging opening 5012a formed in the medicine receiving bottom 5012 is an example of the discharge port. That is, the discharge path is a path from the packaging opening 5012a to the opening of the sachet paper S, and the acquisition processing unit 81 acquires a photographed image obtained by photographing at least a part of the discharge path as the photographing target. In this embodiment, as an example, the check image G11 based on the photographed image of the lower area photographed by the second remaining detection camera 602 is displayed in the remaining check field R132. That is, the acquisition processing unit 81 acquires a photographed image obtained by photographing the lower area of the discharge path (from the approximate middle position of the shooter part 72 of the medicine packaging introduction member 7 to the inside of the opening in the sachet paper S) as the photographing target from the second remaining detection camera 602. The display processing unit 83 can display the check image G11 used for the remaining medicine check based on the photographed image acquired by the acquisition processing unit 81 from the second remaining detection camera 602.
[0084] The checking image G11 allows a user (such as an appraiser) to check whether or not there is any medicine adhering to the inner wall of the medicine packaging introduction member 7, and whether or not there is any medicine (medicine that should have been packaged first) or foreign matter inside the opening of the packet paper S. In particular, the checking image G11 in this embodiment makes it possible to check whether or not there is any medicine adhering to the lower region (see FIG. 10) as the final part of the medicine packaging introduction member 7, and whether or not there is any medicine or foreign matter inside the opening of the packet paper S.
[0085] In this way, in the packaging support system 10 of this embodiment, images captured by the (first and second) residual detection cameras 601, 602 can be displayed on the display device 101, etc., which has the advantage of improving the reliability of checking for remaining medication (residual medicine).
[0086] In addition, in this embodiment, the display processing unit 83 displays the check image G11 on the inspection result screen G1 related to the same prescription. That is, the check image G11 used for checking the remaining medicine is displayed on the inspection result screen G1 on which a list of the inspection results for the packaging target of multiple packets related to the same prescription is displayed. Therefore, for example, a user such as an inspector can check the remaining medicine while checking the inspection results for the packaging target of multiple packets related to the same prescription on the inspection result screen G1.
[0087] Here, the inspection result screen G1 includes the inspection results related to a plurality of packages of medicine, and the display processing unit 83 displays the check image G11 for each package. In the example of Fig. 12, the medicine package list area R13 displays information related to medicines packaged in a plurality of packages side by side, and the check images G11 for a total of nine packages, ie, the first package, the second package, the third package, ..., and the ninth package, can be displayed in the medicine package list area R13 in a list format from the left. This makes it clear at a glance which package out of the plurality of packages contains remaining medicine (residual medicine), and can reduce the effort required for checking remaining medicine.
[0088] Furthermore, the check image G11 displayed in the remaining check column R132 may be the captured image itself acquired by the acquisition processing unit 81 from the second remaining detection camera 602, or may be an image obtained by performing some correction on the captured image. In other words, the check image G11 is not limited to the original captured image as long as it is based on the captured image.
[0089] 13, the display processing unit 83 performs correction to improve the brightness (luminosity) of the captured image and enlarge it. As a result, the check image G11 displayed in the remaining check field R132 becomes an image that is easier to visually check compared to the original captured image for image processing. However, the content of the image correction is not limited to improving brightness and enlargement, and may be, for example, adjusting contrast, etc.
[0090] Moreover, the check image G11 is stored in the storage unit 80. However, the check image G11 stored in the storage unit 80 may be an image before correction, that is, the original captured image.
[0091] In the present embodiment, the display processing unit 83 displays the check image G11 only when the drug to be packaged satisfies a display condition. In other words, the display processing unit 83 does not always display the check image G11 (on the inspection result screen G1), but displays the check image G11 only when a specific display condition is satisfied. This makes it possible to narrow down the number of check images G11 to be displayed, and to reduce the burden on the user (inspector, etc.) of checking the check images G11.
[0092] In this embodiment, as an example, the display conditions include conditions related to at least one of the color and transparency of the drug to be packaged. Specifically, a drug whose color is close to the background color of the captured image (here, "black") or a drug whose color is close to the transparency is difficult to detect even if it is captured in the check image G11. Therefore, the display conditions include a color condition related to the color of the drug to be packaged and a transparency condition related to the transparency of the drug to be packaged. As a result, the check image G11 is displayed only when a drug that is difficult to detect is the drug to be packaged.
[0093] For example, "color" is represented in the HSV system consisting of three elements: hue, saturation, and value. A threshold value of the HSV system is set for the color of the drug to be packaged, and the color condition is that the color of the drug to be packaged exceeds the threshold value. As a result, when the drug to be packaged is a drug whose color is close to the background color (black) of the captured image and is difficult to detect, the display condition (the color condition) is met. Also, a threshold value is set for the transparency of the drug to be packaged, and the transparency condition is that the transparency of the drug to be packaged exceeds the threshold value. As a result, when the drug to be packaged is a drug that is close to transparent and difficult to detect, the display condition (the transparency condition) is met.
[0094] The display processing unit 83 then performs a judgment on the display conditions for each package, and displays the check image G11 in the remaining check field R132 on the inspection result screen G1 only if at least one of the color condition and the transparency condition is satisfied. In other words, if the drug to be packaged does not satisfy either the color condition or the transparency condition, the display processing unit 83 does not display the check image G11 for the drug to be packaged. If the check image G11 is not displayed, the remaining check field R132 on the inspection result screen G1 becomes a black image (blackout).
[0095] If the display conditions are not satisfied for all of the multiple packages, that is, if there is no check image G11 to be displayed in the remaining check field R132, it is preferable that the display processing unit 83 omits the remaining check field R132 itself from the medicine package list area R13 of the inspection result screen G1. This makes it possible to expand the inspection field R133 by the amount of the remaining check field R132.
[0096] Here, the display processing unit 83 judges whether the medicine to be packaged satisfies the display condition based on at least one of the medicine master and the medicine photographed image obtained by photographing the medicine to be packaged. That is, in the medicine master (medicine master table) stored in the storage unit 80, flags are set in advance for medicines whose color is close to the background color (black) of the photographed image and for medicines whose color is close to transparent. Therefore, the display processing unit 83 refers to the medicine master, and when the flag is set for the medicine to be packaged, judges that the display condition (at least one of the color condition and the transparency condition) is satisfied. Alternatively, the display processing unit 83 refers to, for example, an image obtained by photographing the medicine to be packaged with the first camera 61 or the second camera 62 at the medicine photographing position P6, or the normal image (such as an image provided by a medicine manufacturer), as the medicine photographed image. In the present disclosure, even the normal image stored in the storage unit 80 in advance is considered to be a type of the medicine photographed image since it is an image obtained by photographing the medicine by some means. Then, the display processing unit 83 determines the display condition (at least one of the color condition and the transparency condition) based on the color or transparency of the medicine extracted from the medicine photographed image.
[0097] The display processing unit 83 can display the check image G11 for drugs that meet the display conditions regardless of the photographing conditions, etc., by determining the display conditions based on the drug master. Furthermore, the display processing unit 83 can display the check image G11 for drugs that meet the display conditions, even if a drug not included in the prescription is inserted by the universal cassette or manual preparation process, by determining the display conditions based on an image obtained by photographing the drug to be packaged with the first camera 61 or the second camera 62. Furthermore, the display processing unit 83 can display the check image G11 for drugs that meet the display conditions, even if the flag is not set in the drug master, by determining the display conditions based on the normal image.
[0098] In the present embodiment, as an example, the display processing unit 83 determines the display condition based on both the medicine master and the medicine photographed image, but the present invention is not limited to this example, and the display condition may be determined based on only one of the medicine master and the medicine photographed image. In addition, the threshold value set for color or transparency may be the same value or different values used for the medicine master and the medicine photographed image.
[0099] According to this configuration, it is possible to stably determine whether or not the medicine to be packaged satisfies the display condition, based on at least one of the medicine master and the medicine photographed image.
[0100] The display processing unit 83 can also enlarge and display the check image G11, as shown in Fig. 14. Here, the display processing unit 83 enlarges and displays the check image G11 in accordance with a user's enlargement operation. As an example, by selecting any of the check images G11 displayed in the remaining check field R132 of the inspection result screen G1 by an operation such as right-clicking with a pointing device such as a mouse of the display device 101, the display processing unit 83 enlarges and displays the check image G11. At this time, the enlarged check image G11 is superimposed on the inspection result screen G1 in a pop-up display.
[0101] Furthermore, since the information on the medicine package list area R13 regarding the medicine packaged in multiple packages is displayed in a horizontally arranged list, the check images G11 are also displayed in a horizontally arranged list for multiple packages. Therefore, the display processing unit 83 enlarges and displays any one of the check images G11 for the multiple packages selected by the user. For example, when the check image G11 for the "fourth package" is selected, the check image G11 for the "fourth package" is enlarged and displayed.
[0102] In this way, by enlarging and displaying the check image G11, the check image G11 displayed on the display device 101 becomes an image that is easy to visually confirm. Therefore, it becomes easier for a user (an inspector, etc.) to check the remaining medicine.
[0103] As shown in FIG. 14, the display processing unit 83 displays the check image G11 in a manner that allows comparison with the comparison image G12. That is, if the check image G11 is displayed alone, even if a remaining medicine (residual drug) is reflected in the check image G11, it may be difficult to distinguish it from, for example, characters printed on the packet paper S or the shadow of the fold of the packet paper. Therefore, by displaying the check image G11 in a manner that allows comparison with the comparison image G12 in a normal state where there is no remaining medicine, it becomes easier to detect the remaining medicine in the check image G11. In the example of FIG. 14, the enlarged check image G11 and the comparison image G12 are displayed on the inspection result screen G1 so that they are side by side and of the same size.
[0104] In this embodiment, the comparison image G12 corresponds to the captured image on which the check image G11 is based, and is an image acquired before packaging. Specifically, the comparison image G12 displayed in a manner comparable (e.g., side-by-side) with the check image G11 of the Kth packet (K is a natural number whose maximum value is the set number of packets N) is the check image G11 of the immediately preceding "K-1"th packet. In other words, each time medicine is dropped into the opening of the packet paper S and the opening is closed, the check image G11 is generated from the captured image captured by the second residue detection camera 602, and the check image G11 of the immediately preceding packet is used as the comparison image G12. However, only when K=1, the check image G11 for the "K-1" package does not exist, so the comparison image G12 is an image based on the image taken by the second residual detection camera 602 immediately before the first package of drugs to be packaged is discharged into the drug packaging introduction member 7.
[0105] As a result, the comparison image G12 is an image before the medicine is dropped into the packaging paper S, and by comparing it with the check image G11, it can be confirmed whether or not the medicine for this packaging remains in the discharge path (the path from the discharge port for discharging the medicine to the open opening of the packaging paper S) after the open opening is closed. For example, when a user such as an inspector checks the remaining medicine by visually inspecting an image, the remaining medicine check can be performed simply by displaying at least the check image G11 on the inspection result screen G1 or the like. In contrast, when the comparison image G12 is displayed in a manner that can be compared with the check image G11, the user can easily check the remaining medicine even in cases where the presence or absence of remaining medicine is not clear from the check image G11 alone.
[0106] Fig. 15 shows a display mode of the check image G11 that is different from the above. That is, the display processing unit 83 may display the check image G11, for example, in a mode as shown in Fig. 15. In the example of Fig. 15, the check image G11 and the comparison image G12 are arranged side by side in the vertical direction (up and down direction) with the check image G11 on the lower side.
[0107] Furthermore, in the example of FIG. 15, the check image G11 includes a first check image G111, a second check image G112, and a third check image G113. The first check image G111 is an image based on a photographed image of the relay section 71 of the pharmaceutical packaging introduction member 7 taken by the first residual detection camera 601. The second check image G112 is an image based on a photographed image of the shooter section 72 of the pharmaceutical packaging introduction member 7 taken by the second residual detection camera 602. The third check image G113 is an image based on a photographed image of the area from the approximate middle position of the shooter section 72 of the pharmaceutical packaging introduction member 7 to the opening of the packet paper S taken by the second residual detection camera 602. Similarly, the comparison image G12 includes a first comparison image G121, a second comparison image G122, and a third comparison image G123. The first comparison image G121, the second comparison image G122, and the third comparison image G123 correspond to the first check image G111, the second check image G112, and the third check image G113, respectively.
[0108] According to the check image G11 in such a display mode, the discharge path (the path from the discharge port for discharging the medicine to the opening of the packet paper S) can be checked for each part, which leads to improved accuracy in checking for remaining medicine. Furthermore, in the example of FIG. 15, the display processing unit 83 compares the check image G11 with the comparison image G12, and when there is a doubt about remaining medicine, also displays a message such as "There is remaining medicine". The decision to display the message is automatically made by the display processing unit 83 by extracting a difference image between the check image G11 and the comparison image G12 when the display condition is satisfied, for example.
[0109] [flowchart] An example of a procedure for processing the packing support method, particularly the display of the check image G11, will be described with reference to FIG.
[0110] <Step S1> In step S1, the acquisition processing unit 81 of the controller 8 acquires an image obtained by photographing at least a part of the discharge path as the photographing target (acquisition step). At this time, the acquisition processing unit 81 acquires, for example, an image obtained by photographing the lower region of the discharge path (from the approximate middle position of the chute part 72 of the medicine packaging introduction member 7 to the opening of the packet paper S) as the photographing target from the second residue detection camera 602.
[0111] <Step S2> In step S2, the display processing unit 83 judges whether the drug to be packaged is a drug whose color is close to the background color (black) of the captured image, making it difficult to detect, or whether the drug is nearly transparent. At this time, the display processing unit 83 judges whether the display conditions are met for the drug to be packaged, and if either the color condition or the transparency condition is met, it is judged that the judgment condition is met (S2: Yes), and the process proceeds to step S3. On the other hand, if the judgment condition is not met (S2: No), the display processing unit 83 ends a series of processes related to the display of the check image G11.
[0112] <Step S3> In the step S3, the display processing unit 83 generates the check image G11 from the captured image acquired in the step S1. Specifically, the display processing unit 83 generates the check image G11 by correcting the brightness of the captured image and enlarging it.
[0113] <Step S4> In step S4, the display processing unit 83 causes the display device 101 to display the check image G11 (display step). At this time, the display processing unit 83 displays the check image G11 in the remaining check field R132 of the inspection result screen G1.
[0114] <Step S5> In step S5, the display processing unit 83 determines whether or not a user has performed an enlargement operation on the check image G11 in the inspection result screen G1. For example, when an enlargement operation is performed by selecting any of the check images G11 displayed in the remaining check field R132 of the inspection result screen G1 by right-clicking or the like using a pointing device such as a mouse of the display device 101, the display processing unit 83 determines that an enlargement operation has been performed on the check image G11 (S5: Yes), and proceeds to step S6. On the other hand, if the enlargement operation has not been performed (S5: No), the display processing unit 83 ends the series of processes related to the display of the check image G11.
[0115] <Steps S6 and S7> In step S6, the display processing unit 83 enlarges and displays the check image G11 that was enlarged in step S5. In the following step S7, the display processing unit 83 displays the comparison image G12 corresponding to the check image G11 side by side with the check image G11. Here, the comparison image G12 is the check image G11 immediately before the check image G11.
[0116] It should be noted that the above flowchart is merely an example, and processes may be added or omitted as appropriate, and the order of processes may be changed as appropriate.
[0117] [Other configurations] As a first configuration, the medicine storage unit 5 includes a locking mechanism 53 as shown in Figures 17 and 18. The locking mechanism 53 is a mechanism for holding the upper plate portion 51 and the lower plate portion 52 in a closed state, and is, for example, a fastener (a so-called "snap lock").
[0118] Specifically, the rear ends of the upper plate 51 and the lower plate 52 are hinged together by a hinge 58 (see FIG. 18), and the front ends of the upper plate 51 and the lower plate 52 are configured to be openable and closable. That is, when a user holds a handle 54 provided on the front end of the upper plate 51 and lifts the front end of the upper plate 51 upward, the upper plate 51 rotates about the hinge 58 and opens relative to the lower plate 52. As a result, when the upper plate 51 is closed (the state of FIG. 17), the revolver 501 is sandwiched between the upper plate 51 and the lower plate 52. On the other hand, when the upper plate 51 is open (the state of FIG. 18), the revolver 501 on the lower plate 52 is released.
[0119] The locking mechanism 53 locks the front ends of the upper plate portion 51 and the lower plate portion 52 together. Here, the locking mechanism 53 has a pair of first fittings 531 provided on the upper plate portion 51 and a pair of second fittings 532 provided on the lower plate portion 52. The pair of first fittings 531 are arranged spaced apart in the left-right direction, and the pair of second fittings 532 are arranged spaced apart in the left-right direction. The pair of first fittings 531 can be locked in a state where they are hooked onto the pair of second fittings 532, thereby holding the upper plate portion 51 and the lower plate portion 52 in a closed state.
[0120] The lock mechanism 53 holds the upper plate 51 and the lower plate 52 in a closed state, so that the revolver 501 can be securely sandwiched between the upper plate 51 and the lower plate 52. This stabilizes the rotation of the revolver 501. In particular, as shown in FIG. 18, a plurality of pressure rollers 57 are provided at a portion of the lower surface of the upper plate 51 facing the revolver 501. When the upper plate 51 is closed, the plurality of pressure rollers 57 are pressed against the upper surface of the revolver 501, thereby suppressing the revolver 501 from floating, and the rotation of the revolver 501 is more stabilized. Furthermore, the provision of the lock mechanism 53 also suppresses the upper plate 51 from being opened by the reaction force received by the plurality of pressure rollers 57.
[0121] As a second configuration, the drug check unit 82 automatically determines whether or not the drug specified in the prescription information (packaging data) is present in the storage unit 50 by image-to-image matching (image collation) in which the captured image of the drug (drug information) is compared with an image of a reference image of each drug (characteristic data of each drug) previously stored in the storage unit 80 to determine the degree of agreement. The reference image (for image-to-image matching) used by the drug check unit 82 does not have to be the same as the correct image on the inspection result screen G1 described above.
[0122] Here, when two or more manually prepared drugs are included and the two or more drugs are similar to each other, the drug check unit 82 may output the two or more drugs as "unclassified" on the inspection result screen G1 without performing image matching (image collation). In this case, the display processing unit 83 displays the inspection result screen G1 as "unclassified" for the two or more drugs.
[0123] As a third configuration, the display processing unit 83 may combine the normal image with a part of the front and back images of the medicine displayed in the medicine package list area R13 of the inspection result screen G1 and display the combined image.
[0124] As a fourth configuration, the drug check unit 82 may adopt, for example, an image with the largest number of drug shadows (dark areas) among the multiple images obtained in the second photographing process, determine the number of drugs based on the adopted image, and determine whether the required number of drugs is present in the storage unit 50 by comparing the determined number with the number of drugs indicated in the prescription information (packaging data). Alternatively, the image with the largest total area of the drug shadows (dark areas) may be adopted. The drug check unit 82 may select, as an image for determining the type of drug, an image obtained in the first and third photographing processes at a time closest to the time of photographing the adopted image. It is preferable that the second photographing process is performed before the storage unit 50 stops on the drug photographing position P6 after the turntable unit 5010 of the revolver 501 rotates intermittently. After the stop, drugs may overlap each other, so it is preferable to perform the process as described above. Here, the photographing is preferably performed immediately after the delivery of the drug.
[0125] As a fifth configuration, when the number of drugs determined by the drug check unit 82 does not match the number of drugs indicated in the prescription information, the drive processing unit 84 of the controller 8 executes a first "swinging operation" of rotating the turntable unit 5010 of the revolver 501 forward and backward with an appropriate swing width. Then, when the number of drugs determined by the drug check unit 82 does not match the number of drugs indicated in the prescription information even after the first swinging operation, the drive processing unit 84 performs a second "swinging operation" by increasing the swing width of the turntable unit 5010 to swing it more strongly. Note that when the drugs to be packaged include drugs of a specific shape, it is preferable that the drive processing unit 84 swings it more strongly from the first time.
[0126] As a sixth configuration, the drive processing unit 84 of the controller 8 can rotate the turntable unit 5010 of the revolver 501 forward and backward with an appropriate swing width to roll the medicine (particularly the capsule) in the storage unit 50 and acquire multiple images of the peripheral surface of the medicine. Based on the multiple images of the peripheral surface of the medicine acquired in this manner, information related to printing can be acquired.
[0127] As a seventh configuration, the drive processing unit 84 of the controller 8 may rotate the turntable unit 5010 of the revolver 501 so as to temporarily return the storage unit 50, after dropping the medicine into the packet paper S at the medicine discharge position P7 (packaging position), to the medicine photographing position P6. In this case, the process may proceed to the next packet after confirming that the storage unit 50 is empty (i.e., there is no remaining medicine) from a photographed image obtained by photographing the storage unit 50 returned to the medicine photographing position P6.
[0128] As an eighth configuration, the controller 8 can set an inspection operation such as full inspection, partial inspection, photography only, no inspection, or conditional inspection for each prescription classification. The prescription classification is a classification related to the attributes of the prescription, and includes, for example, regular, temporary, or outpatient.
[0129] As a ninth configuration, the controller 8 can collectively set the on / off of fields indicating attributes in the medicine master.
[0130] As a tenth configuration, the controller 8 may register, for example, an image captured by the first camera 61 and / or the second camera 62, such as the front and back images, as a new normal image in the drug master for a drug for which a model such as a normal image is not registered in the drug master. Furthermore, when there are multiple drugs for which a model such as a normal image is not registered in the drug master, the controller 8 may be able to collectively register new normal images for a set of records for these multiple drugs in the drug master. Alternatively, the controller 8 may prompt the user to register a new normal image in the drug master.
[0131] As an eleventh configuration, it is preferable that, after the cleaning by the cleaning member 55 is completed, the controller 8 performs the operation of moving the scraper 55a away from the medicine receiving bottom portion 5012 at a position other than the medicine photographing position P6.
[0132] As a twelfth configuration, it is preferable that an identifier is provided near the storage section 50 on the upper surface of the revolver 501. The identifier is, for example, a number (digit) and is printed (including engraved) on the revolver 501. The identifiers are arranged near one of the storage sections 50 to such an extent that the corresponding relationship with the storage section 50 is immediately apparent. This makes it easier to distinguish between the multiple storage sections 50.
[0133] As a thirteenth configuration, the medicine receiver bottom 5012 may be rotatable about the axis 504 (see FIG. 5) so as to move at least between a normal position and a cleaning position. The normal position is the position of the medicine receiver bottom 5012 when the packaging opening 5012a is located above the medicine packaging introduction member 7, and the cleaning position is the position of the medicine receiver bottom 5012 when the packaging opening 5012a is located above a dust receptacle provided on the lower plate portion 52. The medicine receiver bottom 5012 is located at the normal position during normal operation, and allows the medicine in the storage portion 50 located at the medicine discharge position P7 to be discharged from the packaging opening 5012a to the medicine packaging introduction member 7. On the other hand, by rotating the medicine receiver bottom 5012 to move to the cleaning position, the medicine powder, etc., which the cleaning member 55 has collected on the medicine receiver bottom 5012 can be discharged from the packaging opening 5012a to the dust receptacle. Furthermore, it is preferable to provide a stopper 59 (see FIG. 18) that fixes the medicine receiving bottom 5012 to the stationary position at least when the medicine receiving bottom 5012 is located at the stationary position. The stopper 59 has, for example, a solenoid including a plunger that can extend upward from the lower plate 52, and by inserting the plunger into a hole provided in the medicine receiving bottom 5012, the medicine receiving bottom 5012 is prohibited from rotating and the medicine receiving bottom 5012 is fixed to the stationary position. This makes it possible to suppress the medicine receiving bottom 5012 from being displaced due to the rotation of the turntable 5010 of the revolver 501.
[0134] As a fourteenth configuration, the manner of the front and back images displayed in the inspection field R133 of the medicine package list area R13 in the inspection result screen G1 may be changed according to the display conditions. Specifically, the front and back images displayed in the inspection field R133 are changed depending on whether the transparency of the medicine to be packaged exceeds the threshold (satisfies the transparency condition). For example, for a medicine whose transparency is equal to or lower than the threshold (does not satisfy the transparency condition), the front and back images taken by the first camera 61 and the second camera 62 in a forward-lighting state are displayed in the inspection field R133. On the other hand, for a medicine whose transparency exceeds the threshold (satisfies the transparency condition), the front and back images taken by the first camera 61 and the second camera 62 in a back-lighting state are displayed in the inspection field R133. This makes it easier to see the front and back images of medicines with high transparency. Furthermore, for the front and back images of medicines whose transparency exceeds the threshold, it is preferable that the display processing unit 83 corrects the captured images to improve the brightness (luminosity). Whether or not the transparency condition is satisfied can be determined based on at least one of the medicine master and a medicine image obtained by photographing the medicine to be packaged.
[0135] As a fifteenth configuration, the controller 8 may have a function of detecting the presence or absence of dirt due to medicine powder (drug dust) or the like attached to the inner wall surface of the medicine packaging introduction member 7. As an example, the controller 8 compares the captured image of the medicine packaging introduction member 7 captured by the first residue detection camera 601 and the second residue detection camera 602 with an initial image captured in the same area as the captured image and stored in advance in the storage unit 80, and detects the presence or absence of the dirt based on the comparison result. When the dirt is present, it is preferable to issue a notification to the user to encourage cleaning. However, for example, when the user performs an operation to accept the dirt a predetermined number of times (for example, once, twice, or three times), the controller 8 may disable the notification thereafter. In this case, instead of the notification, the controller 8 may display the captured image used for detecting the dirt, for example, in the residue check field R132 of the medicine package list area R13 on the inspection result screen G1. As a result, in the remaining check field R132, at least one of an image display when the stain is detected and an image display when the display condition is satisfied is performed.
[0136] [Variations] Although the embodiment of the present invention has been described above with reference to the drawings, the present invention is not limited to the illustrated embodiment. Various modifications and variations can be made to the illustrated embodiment within the same scope as the present invention or within an equivalent scope.
[0137] The multiple components included in the packing support system 10 may be distributed across multiple housings. Conversely, the multiple components distributed across multiple housings in the above embodiment may be integrated into one housing.
[0138] Furthermore, it is not essential for the display processing unit 83 to display the check image G11 on the inspection result screen G1 relating to the same prescription, and the check image G11 may be displayed separately from the inspection result screen G1.
[0139] Furthermore, it is not essential that the display processing unit 83 displays the check image G11 only when the medicine to be packaged satisfies a display condition, and the check image G11 may be displayed at all times.
[0140] [Notes on the invention] The following will provide an overview of the invention extracted from the above-described embodiment. Note that the configurations and processing functions described in the following supplementary notes can be selected and combined as desired.
[0141] <Appendix 1> a packaging device that packages medicines to be packaged in packaging paper, the packaging device comprising: an acquisition processing unit that acquires a captured image obtained by capturing an image of at least a part of a discharge path from an outlet for discharging the medicines to an opening of the packaging paper; A display processing unit capable of displaying a check image used for a remaining medicine check based on the captured image. Packaging support system.
[0142] <Appendix 2> The display processing unit displays the check image on an inspection result screen related to the same prescription. A packaging support system as described in appendix 1.
[0143] <Appendix 3> The inspection result screen includes inspection results relating to multiple packages of medicine, The display processing unit displays the check image for each package. Attachment 2: A packaging support system.
[0144] <Appendix 4> The display processing unit displays the check image only when the medicine to be packaged satisfies a display condition. A packaging support system according to any one of appendix 1 to 3.
[0145] <Appendix 5> The display conditions include conditions regarding at least one of a color and a transparency of the medicine to be packaged. A packaging support system as described in Appendix 4.
[0146] <Appendix 6> The display processing unit determines whether or not the drug to be packaged satisfies the display condition based on at least one of a drug master and a drug image obtained by photographing the drug to be packaged. 6. A packaging support system according to claim 4 or 5.
[0147] <Appendix 7> The display processing unit is capable of enlarging and displaying the check image. A packaging support system according to any one of appendix 1 to 6.
[0148] <Appendix 8> the display processing unit displays the check image in a manner that allows comparison with a comparison image. A packaging support system according to any one of appendix 1 to 7.
[0149] <Appendix 9> The comparison image corresponds to the photographed image on which the check image is based, and is an image acquired before packaging. 9. A packaging support system as described in appendix 8.
Claims
1. a packaging device that packages medicines to be packaged in packaging paper, the packaging device comprising: an acquisition processing unit that acquires a captured image obtained by capturing an image of at least a part of a discharge path from an outlet for discharging the medicines to an opening of the packaging paper; A display processing unit capable of displaying a check image used for a remaining medicine check based on the captured image, The display processing unit displays the check image only when the medicine to be packaged satisfies a display condition. Packaging support system.
2. The display processing unit displays the check image on an inspection result screen related to the same prescription. The packaging support system according to claim 1 .
3. The inspection result screen includes inspection results relating to multiple packages of medicine, The display processing unit displays the check image for each package. The packaging support system according to claim 2.
4. The display conditions include conditions regarding at least one of a color and a transparency of the medicine to be packaged. The packaging support system according to any one of claims 1 to 3.
5. The display processing unit determines whether or not the drug to be packaged satisfies the display condition based on at least one of a drug master and a drug image obtained by photographing the drug to be packaged. The packaging support system according to any one of claims 1 to 3.
6. The display processing unit is capable of enlarging and displaying the check image. The packaging support system according to any one of claims 1 to 3.
7. the display processing unit displays the check image in a manner that allows comparison with a comparison image. The packaging support system according to any one of claims 1 to 3.
8. The comparison image corresponds to the photographed image on which the check image is based, and is an image acquired before packaging. The packaging support system according to claim 7.
9. an acquiring step of acquiring a photographed image obtained by photographing at least a part of a discharge path from a discharge port for discharging the medicine to an opening of the packet paper in a packaging device that packages medicines to be packaged in packet paper; a display step of displaying a check image used for checking remaining medicine based on the photographed image only when the medicine to be packaged satisfies a display condition; A packaging assistance program for causing a computer to execute the above.
Citation Information
Patent Citations
Drug imaging device and drug packaging device
WO2022050371A1