Type discrimination device

Abstract

To discriminate types of medicines to improve accuracy of the discrimination.SOLUTION: A computer (60) includes: a feature extraction part (64a) for extracting information indicating a reflection area of light irradiated to a target medicine from a captured image (82); and a collation part (64b) for collating the information extracted by the feature extraction part (64a) with information indicating a reflection area of light irradiated to a reference medicine, and discriminating the type of the target medicine based on a result of the collation.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to a type discrimination device that automatically discriminates the type of medicine, a medicine sorting device that sorts medicines, and the like. [Background technology]

[0002] Conventionally, multiple types of returned medicines were sorted by type by a pharmacist or doctor. The returned medicines are prescribed to various patients or are prescribed and dispensed medicines. Therefore, compared to the dispensing work of assembling (packaging) (one or multiple types) of medicines (tablets) for each dosing period from a group of medicines (medicine cassettes) that are previously grouped by medicine type in a dispensing device or the like based on prescription information for each patient, the types of medicines that are returned together as medicines prescribed for multiple patients are very large. Therefore, it is highly useful to automatically sort and reuse returned medicines. Note that the number of types of medicines dispensed for one dosing period is generally about 2 to 3, and at most about 10.

[0003] Some pharmacies or hospitals (or more accurately, their in-house pharmacy departments) simply dispose of returned medications to avoid the time and effort required for sorting, or the risk of misadministration due to incorrect sorting (putting medications back into the wrong medication cassette).

[0004] Patent Document 1 discloses a medicine sorting device that automatically recognizes and stores returned ampoules or vials. This medicine sorting device recognizes the orientation and posture of the ampule or vial, and the properties of the ampule or vial (e.g., shape, size, type, and expiration date). Then, the device associates the storage area set for each ampule or vial when storing according to the recognized size of the ampule or vial with the identification information of each ampule or vial, and arranges the ampule or vial individually, thereby storing each ampule or vial so that it can be removed. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] International Publication No. 2015 / 170761 (Published on November 12, 2015) Summary of the Invention [Problem to be solved by the invention]

[0006] The subject of return in Patent Document 1 is ampoules or vials, and not medicines such as tablets or capsules that are not contained in containers, etc., or medicines themselves that are not packaged, etc. Therefore, Patent Document 1 does not anticipate identifying such medicines (e.g., tablets or capsules) themselves, or even automatically sorting such medicines.

[0007] One aspect of the present invention aims to realize a type discrimination device, etc., that can discriminate the type of medicine that is not contained in a container, such as a tablet or capsule, and can improve the accuracy of such discrimination.

[0008] Another aspect of the present invention is to realize a medicine sorting device that can sort medicines that are not contained in containers, such as tablets or capsules, and can improve the efficiency of the sorting.

[0009] Another aspect of the present invention is to realize a type discrimination device or the like that can discriminate the type of medicine that is not contained in a container such as a tablet or capsule, and that can reduce the amount of image data required to create an image used to discriminate the type of the medicine. [Means for solving the problem]

[0010] In order to solve the above problems, a type discrimination device according to one embodiment of the present invention is a type discrimination device that discriminates the type of a target drug from an image of the target drug, and includes a feature extraction unit that extracts first feature information indicative of external characteristics of the target drug from the image, the first feature information including at least reflection area information indicating a reflection area of ​​light irradiated onto the target drug, and a discrimination unit that compares the first feature information with second feature information indicative of external characteristics of the reference drug, the second feature information including at least reflection area information indicating a reflection area of ​​light irradiated onto a reference drug, and discriminates the type of the target drug based on the result of the comparison.

[0011] Furthermore, a type discrimination device according to one embodiment of the present invention is a type discrimination device that discriminates the type of a target drug from an image of the target drug, and includes a feature extraction unit that extracts third feature information indicating appearance characteristics of the target drug from the image, the third feature information including at least reflection information indicating whether or not light irradiated to the target drug is reflected by the target drug, and a discrimination unit that compares the third feature information with fourth feature information indicating appearance characteristics of the reference drug, the fourth feature information including at least reflection information indicating whether or not light irradiated to a reference drug is reflected by the reference drug, and discriminates the type of the target drug based on the result of the comparison.

[0012] Furthermore, a type discrimination device according to one embodiment of the present invention is a type discrimination device that discriminates the type of a target drug from an image of the target drug, and includes a discrimination unit that compares fifth feature information indicating the appearance characteristics of the target drug, including target color information indicating the color of the target drug, extracted from the image, with sixth feature information including reference color information indicating the color of a reference drug, and discriminates the type of the target drug based on a result of the comparison, and an update unit that, if the discrimination unit fails to discriminate the type of the target drug, updates the target color information used for the discrimination as new reference color information after receiving an operation from a user.

[0013] In addition, a type discrimination device according to one embodiment of the present invention is a type discrimination device that discriminates the type of a target drug from an image of the target drug, and includes a feature extraction unit that extracts seventh feature information indicating appearance characteristics of the target drug from the image, the seventh feature information including at least identification information displayed on the surface of the target drug and first position information indicating the relative position of a display area of ​​the identification information with respect to an image of the target drug, and a discrimination unit that compares the seventh feature information with eighth feature information indicating appearance characteristics of the reference drug, the eighth feature information including at least specific drug information indicating whether a reference drug is a specific drug, the identification information displayed on the surface of the reference drug, and second position information indicating the relative position of a display area of ​​the identification information with respect to the image of the reference drug in the image of the reference drug, and discriminates the type of the target drug based on a result of the comparison. When the specific drug information indicates that the reference drug is a specific drug, the discrimination unit determines whether the discriminated target drug is the same type of drug as the reference drug without using the first position information and the second position information to discriminate the type of the target drug.

[0014] In addition, a drug sorting device according to one embodiment of the present invention includes a first storage unit that stores multiple types of drugs, a second storage unit that stores the drugs by type, a temporary storage unit that temporarily stores drugs that are not stored in the second storage unit, an imaging unit that images the target drugs removed from the first storage unit, a discrimination unit that discriminates the type of the target drugs from the captured image, a priority determination unit that determines a priority for each type of drug based on the frequency of discrimination in the discrimination history of the discrimination unit, and a sorting determination unit that determines to temporarily store the target drug in the temporary storage unit if the priority corresponding to the type of target drug discriminated by the discrimination unit is lower than a predetermined value.

[0015] Furthermore, a type discrimination device according to one embodiment of the present invention is a type discrimination device that discriminates the type of a target drug from an image of the target drug, and is equipped with an image processing unit that generates at least one of cut-out images obtained by cutting out a first region, which is the region of the image of the target drug, and a second region, which is the region of the image of a mounting table on which the target drug is placed and includes the first region, from an image including the image of the target drug, in order to generate an image of a reference drug for discriminating the type of the target drug.

[0016] Moreover, an image generation system according to one embodiment of the present invention is an image generation system including: (1) a type discrimination device that discriminates the type of a target drug from an image of the target drug; and (2) an information processing device that can be communicatively connected to the type discrimination device and generates an image of a reference drug for discriminating the type of the target drug, wherein the type discrimination device generates a cut-out image by cutting out a first region, which is the region of the image of the target drug, or a second region, which is the region of the image of a mounting table on which the target drug is placed, including the first region, from an image including the image of the target drug, and the information processing device generates the reference image based on the cut-out image generated by the type discrimination device.

[0017] Moreover, an image generation system according to one embodiment of the present invention is an image generation system including: (1) a type discrimination device that discriminates the type of a target drug from an image of the target drug; and (2) an information processing device that can be communicatively connected to the type discrimination device and that generates an image of a reference drug for discriminating the type of the target drug, wherein the type discrimination device generates at least one of cut-out images obtained by cutting out a first region, which is the region of the image of the target drug, and a second region, which is the region of the image of a mounting table on which the target drug is placed, including the first region, from an image including the image of the target drug, and the information processing device generates the reference image based on the cut-out image generated by the type discrimination device. Effect of the Invention

[0018] According to the type determination device according to one aspect of the present invention, it is possible to improve the accuracy of drug determination.

[0019] Furthermore, according to the medicine sorting device according to one aspect of the present invention, the efficiency of sorting medicines can be improved.

[0020] Furthermore, according to the type discrimination device according to one aspect of the present invention, it is possible to reduce the amount of image data required to create an image used to discriminate the type of medicine.

[0021] Furthermore, according to the image generating system according to one aspect of the present invention, it is possible to reduce the amount of image data required to generate an image used to identify the type of medicine. [Brief description of the drawings]

[0022] [Figure 1] 1 is a block diagram showing the overall configuration of a medicine sorting device. [Diagram 2] FIG. 1 is a diagram illustrating a configuration example of a medicine sorting device. [Diagram 3] FIG. 2 is a perspective view showing an overall configuration of an imaging unit and a perspective view showing an example of a medicine placing table. [Figure 4] FIG. 13 is a diagram for explaining the rotation of the imaging unit. [Diagram 5] FIG. 2 is a diagram illustrating a schematic configuration of an imaging unit. [Figure 6] FIG. 13 is a diagram showing an example of a reflection region of light reflected by a target drug in a captured image. [Figure 7] 10 is a flowchart illustrating an example of a discrimination process of a discrimination unit. [Figure 8] 13 is a diagram showing an example of the thickness of a target drug extracted by a feature extraction unit. FIG. [Figure 9] 13 is a flowchart showing an example of an update process of a medicine database update unit. [Figure 10] 10 is a flowchart illustrating an example of a discrimination process of a discrimination unit. [Figure 11]FIG. 13 is a diagram showing an example of the relative position of a display area of ​​identification information with respect to an image of a target drug or a reference drug. [Figure 12] 13 is a diagram showing an example of a comparison between the relative position of a display area of ​​identification information with respect to an image of a target drug and the relative position of a display area of ​​identification information with respect to an image of a reference drug. FIG. [Figure 13] 13 is a flowchart showing an example of a medicine sorting process of the sorting control unit. [Figure 14] 6 is a flowchart illustrating an example of a print control process of a print output control unit. [Figure 15] 13 is a flowchart showing an example of a malfunction determination process of the medicine sorting device. [Figure 16] FIG. 1 illustrates an example of an image generation system. [Figure 17] 13 is a flowchart showing an example of a cut-out process of an image generating unit. [Figure 18] FIG. 13 is a diagram showing an example of a cut-out image. [Figure 19] 13 is a diagram showing an example of a cutout process from a captured image performed by an image processing unit 73. FIG. [Figure 20] FIG. 2 is a block diagram showing an example of a configuration of a portion of the medicine sorting device. [Figure 21] 13 is a flowchart showing an example of a shape model generation process of a sorting cup performed by the medicine sorting device. [Figure 22] 1A and 1B are diagrams illustrating an example of a captured image of a sorting cup and a shape model of the sorting cup. [Diagram 23] 13 is a flowchart showing an example of a medicine detection process for checking remaining medicines by the medicine sorting device. [Figure 24] 1A to 1C are diagrams showing an example of a captured image of a sorting cup, an extracted image in which an image of the inside of the sorting cup is extracted, and an image of a shape model and a matching region in the extracted image. [Diagram 25] 13 is a flowchart showing an example of a printing process of the medicine sorting device. [Figure 26] FIG. 1 is a diagram illustrating an example of a drug discrimination system. [Figure 27]13 is a flowchart showing an example of a discrimination process of the medicine sorting device. [Figure 28] 13 is a diagram showing an example of identification information of a target drug, identification information of a reference drug in a user's adopted drug list, and identification information of a reference drug in a comprehensive drug database. FIG. [Figure 29] FIG. 4 is a diagram showing an example of a first storage section. [Diagram 30] FIG. 13 is a diagram showing an example of an initial image (initial screen) on which the medicine sorting results can be displayed. [Diagram 31] FIG. 13 is a diagram showing an example of a setting image (setting screen) for allowing a user to set a method of storing brought-to-medicines in a first storage section when the brought-to-medicines sorting mode is set. [Diagram 32] A figure showing an example of a sorting image for displaying the sorting status of brought-in medications when the brought-in medication sorting mode is set. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0023] [Embodiment 1] (Overview of the drug sorting device 1) First, an overview of the medicine sorting device 1 will be described with reference to Fig. 1 and Fig. 2. Fig. 1 is a block diagram showing the overall configuration of the medicine sorting device 1. Fig. 2 is a diagram showing an example of the configuration of the medicine sorting device 1, in which 2001 is a perspective view of the medicine sorting device 1 and 2002 is a perspective view showing the basic configuration of the medicine sorting area 2. As shown in Fig. 1 and 2001 and 2002 of Fig. 2, the medicine sorting device 1 includes the medicine sorting area 2, a touch panel 3, a print output unit 4, and a packaging mechanism 6.

[0024] The medicine sorting device 1 takes an image of each of a plurality of types of medicine, determines the type of medicine based on the image obtained as a result of the imaging, and sorts the medicines by type. Specifically, this process is performed in the medicine sorting area 2. Details of the medicine sorting area 2 (internal configuration of the medicine sorting device 1) will be described later. After the medicines sorted by type are visually inspected by the user, they are packaged or returned to the medicine shelf or packaging machine.

[0025] In this embodiment, the multiple types of medicines are medicines that are not contained in a container or the like, or medicines that are not packaged, and an example of such medicines will be described as tablets or capsules. Also, the multiple types of medicines will be described as returned medicines. The medicines are medicines adopted by a pharmacy or hospital that are returned to the pharmacy or hospital as "returned medicines". However, the multiple types of medicines may also be "brought-in medicines" that may include medicines issued by other pharmacies or hospitals in addition to the adopted medicines at the pharmacy or hospital. After the medicines are returned, the medicine sorting device 1 can automatically perform processes from imaging to sorting.

[0026] The touch panel 3 accepts various user inputs at the operation unit 31, and displays various images on the display unit 32 (for example, an image showing the progress of drug sorting, an image for visual inspection).

[0027] The print output unit 4 prints out a journal representing drug data (e.g., data indicating the drug name, manufacturer, or ingredients) relating to the drug after visual inspection according to user input after visual inspection. The drug data may include image data indicating an image specific to the drug.

[0028] The packaging mechanism 6 packages the sorted medicines. The packaging mechanism 6 is an optional mechanism. When the packaging mechanism 6 is provided in the medicine sorting device 1, the medicine sorting device 1 can perform all processes from sorting returned medicines to packaging after visual inspection all at once. In particular, when medicines are fed into the packaging mechanism 6 by the transporting / sorting unit 12, the above processes from sorting to packaging can be performed automatically, except for visual inspection.

[0029] A conventional tablet packing machine or powder packing machine may be used as the packing mechanism 6. In this case, for example, drugs in a sorting cup 141 that have been sorted for each drug type can be packed into one or more packages.

[0030] It should be noted that throughout this specification, the term "packaging" as used at least in the description of the drug sorting device 1 includes both the meaning of "packaging drugs according to the period of administration based on the prescription data" and the meaning of "simply packaging the drugs sorted into the second storage section 14 regardless of the prescription data."

[0031] The medicine sorting device 1 also includes a first RFID (Radio Frequency Identifier) ​​reader / writer unit 5. The first RFID reader / writer unit 5 is provided on the medicine removal side of the base 19, as indicated by 2002 in FIG.

[0032] The first RFID reader / writer unit 5 reads data related to the medicines stored in each sorting cup 141, which is stored in an RFID tag (not shown) provided at the bottom of each sorting cup 141 in the second storage section 14. Examples of the data include data indicating the number of medicines stored, medicine identification data (e.g., GS1 code) for identifying the medicines, data indicating the type of the sorting cup 141, and sorting cup identification information (identification information assigned to the RFID tag) for identifying the sorting cup 141. Note that the medicine data (e.g., medicine name) of the medicines stored in the sorting cup 141 and the image data acquired by the imaging unit 13 are stored in the medicine database 81 in association with the sorting cup identification information.

[0033] The data may also include drug data determined by visual inspection (drug data after visual inspection). The drug data after visual inspection may also be written to the RFID tag. The drug data after visual inspection is used when the drug stored in the corresponding sorting cup 141 is (1) packaged by the packaging mechanism 6 or a packaging machine other than the drug sorting device 1, or (2) returned to the drug shelf. The drug data may also be linked to the sorting cup identification information and stored in the drug database.

[0034] As shown in FIG. 2 at 2001, the medicine sorting device 1 is provided with an opening / closing shutter 51 and an opening / closing door 52 that enable the medicine removal side to be opened and closed.

[0035] (Basic configuration of drug sorting area 2) Next, the basic configuration of the medicine sorting area 2 (the internal configuration of the medicine sorting device 1) will be described with reference to FIG. 1 and 2002 in FIG.

[0036] 1 and 2, the medicine sorting area 2 mainly comprises, as hardware, a first storage section 11, a transport / sorting unit 12 (sorting section), an imaging unit 13, a second storage section 14, a waiting tray 15, a collection tray 16, a medicine insertion port 17, and a second RFID reader / writer unit 18. Each member except for the transport / sorting unit 12 is mounted on a base 19. The main functions of the transport / sorting unit 12, the imaging unit 13, and the second RFID reader / writer unit 18 will be described in detail in the description of each process below.

[0037] The first storage section 11 stores a mixture of multiple types of medicines returned by users. In this embodiment, the first storage section 11 is divided into multiple storage sections. In this case, for example, when all of the medicines stored in one storage section are transported by the transport / sorting unit 12, the medicines stored in the storage section adjacent to the storage section are transported. The first storage section 11 may be provided rotatable about the Z axis (center of the cylindrical shape). In this case, the control section 60a of the computer (type discrimination device) 60 may rotate the first storage section 11 so that the transport / sorting unit 12 can easily obtain the medicines, for example, when one storage section becomes empty.

[0038] The second storage section 14 includes a plurality of sorting cups 141 that store medicines sorted by type. The control section 60a determines the type of medicine based on an image of the medicine captured by the imaging unit 13, and determines the sorting cup 141 in which to store the medicine based on the determination result. The medicine is transported to the determined sorting cup 141 by the transporting / sorting unit 12 and stored therein.

[0039] The standby tray 15 is a temporary storage unit where medicines are temporarily placed. For example, when all of the sorting cups 141 are filled with medicines, medicines determined by the control unit 60a to be of a type other than those are temporarily placed on the standby tray 15. In this case, after the medicines are removed from the sorting cups 141, they may be transported from the standby tray 15 to the sorting cups 141.

[0040] In this embodiment, a suspected drug (described later) that is suspected to be a drug may be temporarily placed on the waiting tray 15. When the suspected drug is temporarily placed, the suspected drug is transported from the waiting tray 15 to a predetermined area of ​​the second container 14, for example, in accordance with the determination result of the control unit 60a.

[0041] The collection tray 16 is a storage unit that stores objects whose types cannot be determined by the control unit 60a (e.g., foreign objects other than medicines). Examples of foreign objects other than medicines include pieces of PTP (Press Through Pack) sheets. The pieces of PTP sheets may be mixed into the first storage unit 11 when medicines are returned. The control unit 60a also stores in the collection tray 16 medicines that are registered in the medicine database 81 as medicines to be discarded or medicines that the user wishes to discard (e.g., medicines with old manufacturing dates).

[0042] When the medicine sorting device 1 is provided with a packaging mechanism 6, the medicine input port 17 is provided for transporting medicines stored in the second storage section 14 to the packaging mechanism 6 by the transport / sorting unit 12. Naturally, when the medicine sorting device 1 is not provided with a packaging mechanism 6, the medicine input port 17 is not necessary.

[0043] 1, the medicine sorting device 1 is provided with a computer 60 which controls the above-mentioned components (hardware) of the medicine sorting device 1. The computer 60 is provided with a control unit 60a and a storage unit 80. The control unit 60a includes a transport control unit 61, a sorting control unit (sorting determination unit) 62, an imaging control unit 63, a discrimination unit 64, a priority determination unit 65, an operation input unit 66, a display control unit 67, an RFID control unit 68, a print output control unit 69, a registration unit 70, a packaging control unit 71, a medicine adsorption control unit 72, an image processing unit 73, a medicine database update unit (update unit) 74, a notification control unit 75, and a lighting failure determination unit 76.

[0044] Here, a description will be given of basic processing by the operation input unit 66, display control unit 67, RFID control unit 68, print output control unit 69, registration unit 70, and packaging control unit 71. Basic processing by the transport control unit 61, sorting control unit 62, imaging control unit 63, and discrimination unit 64 will be described in detail in the sections below titled (Drug transport processing to imaging unit 13), (Drug sorting processing), (Drug imaging processing), and (Image processing / discrimination processing). Processing by other components included in the control unit 60a will be described in each embodiment below.

[0045] The operation input unit 66 and the display control unit 67 respectively control the operation unit 31 and the display unit 32 of the touch panel 3. The RFID control unit 68 controls the first RFID reader / writer unit 5 and the second RFID reader / writer unit 18. The print output control unit 69 controls the print output unit 4 in accordance with the user input received by the operation input unit 66.

[0046] The registration unit 70 registers the drug data relating to a drug for which the discrimination unit 64 has determined that there is no drug data corresponding to the image data in the drug database 81. Specifically, for a drug for which the discrimination unit 64 has determined that there is no corresponding drug data, the registration unit 70 registers the captured image 82 of the drug in the drug database 81 by linking it with the drug data specified by the user.

[0047] When the medicine sorting device 1 includes a packaging mechanism 6, the control unit 60a includes a packaging control unit 71 that controls the packaging mechanism 6. The packaging control unit 71 controls the operation of the packaging mechanism 6. The packaging control unit 71 also controls the transport / sorting unit 12 to transport the medicines stored in the sorting cup 141 to the medicine insertion port 17.

[0048] The medicine sorting device 1 may also include a barcode reader 7. The barcode reader 7 reads, for example, a barcode indicating medicine data of the medicine printed on a medicine packet (packaging paper) in which the packaging mechanism 6 packages the medicine after sorting. This allows the control unit 60a to perform processing based on the read barcode (for example, displaying the medicine data indicated by the barcode). The packaging mechanism 6 may also include a barcode printing mechanism (not shown) that prints, on the medicine packet, a barcode indicating the medicine data of the medicine packaged in the medicine packet.

[0049] The barcode reader 7 may be any reading device capable of reading information indicating drug data printed on a drug package or the like. The drug sorting device 1 does not necessarily need to include the barcode reader 7. When the control unit 60a performs processing based on the above information, the control unit 60a may obtain the above information by communicating with an external device including the barcode reader 7.

[0050] The medicine sorting device 1 may also include a notification unit 8. The notification unit 8 includes, for example, a Patlite (registered trademark) that turns on a light, a speaker that outputs sound, and the like.

[0051] The computer 60 also includes a storage unit 80. The storage unit 80 stores in advance a drug database (drug master) 81 that manages drug data on a plurality of types of drugs, and stores captured images 82 and the like as the drug sorting device 1 performs sorting. The captured image 82 is an image captured by the first camera 131. The captured image 82 may also be an image captured by the first camera 131 and subjected to image processing by the imaging control unit 63. The image processing may include a process of generating an image to be analyzed by the discrimination unit 64 (an image for extracting the characteristics of a drug and enabling comparison with the characteristics of a drug (reference drug) included in the drug database 81). For example, a process of extracting an image of the drug from the captured image may be included.

[0052] The various data stored in the storage unit 80 may not necessarily be managed by the storage unit 80, but may be managed by, for example, an external device. In this case, the control unit 60a may obtain the various data from the external device via a communication line such as the Internet, as necessary. The drug database 81 may be updated by adding new drug data.

[0053] The storage unit 80 may also include priority data 83, target drug color data 84, identification information change information 85, captured image discrimination information 86, and discrimination count information 88. Note that these configurations are not essential for the drug sorting device 1. Details of these configurations will be described in each embodiment that requires these configurations.

[0054] (Overview of the process in the medicine sorting device 1) In the medicine sorting device 1, the conveying / sorting unit 12 conveys each medicine returned to the first storage section 11 to the imaging unit 13. The imaging unit 13 sequentially captures an image of each conveyed medicine. The control unit 60a determines the type of each medicine based on the captured image and determines a sorting position in the second storage section 14 for each of the determined medicines. The conveying / sorting unit 12 conveys each medicine to the determined sorting position. Then, information about the medicine stored in the second storage section 14 is written to the RFID tag of the sorting cup 141, stored in the storage section 80, or displayed on the touch panel 3. After or during the sorting of the medicines, the user operates the touch panel 3 to perform visual inspection, packaging, and other processes. Each process will be described in detail below.

[0055] (Drug delivery process to imaging unit 13) First, the process of transporting medicine from the first container 11 to the imaging unit 13 will be described with reference to FIG. 1 and 2001 in FIG.

[0056] Specifically, the transport / sorting unit 12 transports the medicines stored in the first storage section 11 to a receiving area Ar1 (see 3002 in FIG. 3) where the imaging unit 13 receives the medicines. The transport control section 61 controls the transport process by the transport / sorting unit 12.

[0057] The transport / sorting unit 12 includes a second camera 121 , a suction / shutter mechanism 122 , and a transport mechanism 123 .

[0058] The second camera 121 sequentially captures images of the first storage unit 11 in order to identify the medicine to be transported. The imaging control unit 63 controls the imaging process of the second camera 121. The second camera 121 is provided at an end of the transport / sorting unit 12 (specifically, of a housing including at least the suction / shutter mechanism 122) facing the base 19. The second camera 121 may be provided at a tip of the suction mechanism described below. The imaging control unit 63 analyzes the captured image and determines whether or not the image contains medicine. If it is determined that the image contains medicine, the transport control unit 61, for example, brings the tip close to the first storage unit 11 and identifies the medicine included in the image captured at that time as the medicine to be transported.

[0059] The suction / shutter mechanism 122 includes a suction mechanism that suctions the medicine identified as the transport target, and a shutter mechanism that prevents the medicine suctioned by the suction mechanism from dropping. The suction mechanism is provided so as to be movable in the Z-axis direction. The shutter mechanism is provided in front of the end so as to be movable approximately parallel to the XY plane.

[0060] When acquiring a medicine, the suction mechanism extends from the end, and after suctioning the specified medicine at its tip, returns to the position of the end. In this state, the transport control unit 61 moves the shutter mechanism to a position facing the end, and maintains the position of the shutter mechanism during the medicine transport (closed state). When the transport control unit 61 moves the suction / shutter mechanism 122 to a position facing the medicine mounting stage 133a (see 3002 in FIG. 3) of the medicine holding mechanism 133 arranged in the receiving area Ar1, it moves the shutter mechanism to a position not facing the end (open state). Then, after the suction mechanism extends from the end, the suction state is released, and the medicine is mounted on the medicine mounting stage 133a.

[0061] The transport mechanism 123 moves the suction / shutter mechanism 122 in the X-axis and Y-axis directions under the control of the transport control unit 61. This transport mechanism 123 enables the movement of the suction / shutter mechanism 122 when searching for a medicine to be transported on the first container 11, or transport of a medicine from the first container 11 to the medicine placement table 133a. Also, in the medicine sorting process, it enables transport of a medicine from the medicine placement table 133a to the second container 14, the waiting tray 15, or the collection tray 16. In the medicine sorting process, the sorting control unit 62 controls the transport / sorting unit 12 to transport the medicine placed in the receiving area Ar1 to a predetermined sorting cup 141 of the second container 14 or the waiting tray 15 based on the discrimination result by the discrimination unit 64.

[0062] (Drug Imaging Processing) Next, the medicine imaging process by the imaging unit 13 will be described with reference to Fig. 1, 2002 in Fig. 2, Fig. 3, and Fig. 4. 3001 and 3002 in Fig. 3 are perspective views showing the overall configuration of the imaging unit 13, and 3003 in Fig. 3 is a perspective view showing an example of the medicine placement table 133a. 4001 and 4002 in Fig. 4 are diagrams for explaining the rotation of the imaging unit 13. The medicine imaging process is mainly performed by the imaging unit 13 and the imaging control unit 63.

[0063] Specifically, the imaging unit 13 is placed on the medicine placement table 133a, and captures an image of the medicine placed in the placement area Ar2 (imaging area) in which the medicine to be imaged is placed, as shown in 3002 in Fig. 3. The imaging control unit 63 controls the imaging process by the imaging unit 13, the pivoting movement of the first camera 131 and the illuminator 134, and the movement of the medicine holding mechanism 133. As shown in Figs. 1 and 3, the imaging unit 13 includes the first camera 131 (imaging section), the rotation mechanism 132 (rotating section), the medicine holding mechanism 133 (medicine placement table, movement mechanism), and the illuminator 134 (ultraviolet light irradiation section, visible light irradiation section).

[0064] The first camera 131 captures an image of a medicine placed in a placement area Ar2 facing the first camera 131 in order to identify the type of medicine in the discrimination unit 64 described later. The medicine holding mechanism 133 is a mechanism for holding a medicine, and includes a medicine placement table (petri dish) 133a, a rotation mechanism 133b (movement mechanism), and an axis portion 133c connecting the medicine placement table 133a and the rotation mechanism 133b, as shown in 3001 and 3002 in FIG. 3. The medicine placement table 133a is for placing a medicine to be imaged. The rotation mechanism 133b is for moving the medicine placement table 133a, and more specifically, rotates the medicine placement table 133a with respect to the XY plane and rotates the axis portion 133c in the circumferential direction of the axis portion 133c.

[0065] When the medicine transported from the first container 11 is placed on the medicine placement table 133a, the imaging control unit 63 drives the turning mechanism 133b to move the medicine placement table 133a from the receiving area Ar1 to the placement area Ar2. Thereafter, the imaging control unit 63 controls at least the first camera 131 and the illuminator 134 to capture an image of the medicine placed in the placement area Ar2. The captured image is stored in the storage unit 80 as a captured image 82. For example, after the imaging is completed, the imaging control unit 63 drives the turning mechanism 133b to move the medicine placement table 133a on which the imaged medicine is placed from the placement area Ar2 to the receiving area Ar1.

[0066] In this embodiment, two medicine placement tables 133a are provided at the tip (end) of the shaft 133c. The turning mechanism 133b turns the shaft 133c, and when one medicine placement table 133a is placed in the placement area Ar2, the other medicine placement table 133a is placed in the receiving area Ar1. When imaging medicines in the placement area Ar2, the transport / sorting unit 12 transports medicines from the first container 11 to the medicine placement table 133a present in the receiving area Ar1, thereby enabling continuous imaging of medicines. Note that it is assumed that the medicine placement table 133a is in a state where no medicine is placed thereon, such as after the medicine is sorted into the second container 14.

[0067] In this embodiment, the medicine placing stand 133a has transparency, so that the first camera 131 can capture images of the medicine placed on the medicine placing stand 133a from multiple directions through the medicine placing stand 133a.

[0068] As shown in 3003 in FIG. 3, the medicine mounting stand 133a may have a substantially V-shaped cross section with a recessed bottom. As shown in 3003 in FIG. 3 and FIG. 4, when the medicine mounting stand 133a is placed in the receiving area Ar1 and the placement area Ar2, the groove direction of the substantially V-shaped cross section (extension direction of the shaft portion 133c) is substantially parallel to the rotation axis Ay of the imaging mechanism (described later) by the rotation mechanism 132. The bottom of the medicine mounting stand 133a may not be a sharp V-shaped shape. As shown in 3003 in FIG. 3, the bottom may include a bottom surface portion 133aa and an inclined surface portion 133ab inclined from two opposing points of the bottom surface portion 133aa. The shape of the bottom portion need only be such that the information (engraved information or printed information) engraved or printed on the medicine can be recognized when viewed (imaged) from the back side of the medicine placement stand 133a, and that the medicine can be fixed in place.

[0069] In the case where the medicine is a capsule or a deformed tablet (e.g., rugby ball-shaped), if the bottom of the medicine placement table 133a is flat, the orientation of the medicine may not be uniform on the XY plane, making it difficult to obtain a clear image of the medicine (engraved information or printed information). If the cross section is approximately V-shaped, the capsule or deformed tablet is fitted into the lowest end, and the medicine can be fixed. This makes it easier to obtain a clear image of the medicine. In the case of a tablet, for example, the axis portion 133c may be rotated in the circumferential direction of the axis portion 133c to make the flat portion (inclined surface portion 133ab) of the medicine placement table 133a face the first camera 131, thereby ensuring that the medicine does not move.

[0070] In addition, the turning mechanism 133b can also vibrate (slightly move or shake) the medicine placement table 133a. In this case, for example, by vibrating and rolling the capsule placed on the medicine placement table 133a, the part of the capsule on which the print is attached can be oriented in a predetermined direction (for example, the part can be made to face the first camera 131 placed in the initial position described below). In addition, by the vibration, even if a cylindrical tablet (with a circular bottom) is placed upright on the flat surface, the tablet can be turned sideways (placed so that the bottom of the tablet faces the flat surface).

[0071] The illuminator 134 emits light to be irradiated onto the medicine when imaging the medicine under the control of the imaging control unit 63. Fig. 5 is a diagram showing a schematic internal configuration of the imaging unit 13. As shown in 3001 of Fig. 3 and Fig. 5, the illuminator 134 includes a visible light irradiating section (first irradiating section 134a and second irradiating section 134b) that irradiates the medicine with visible light, and an ultraviolet light irradiating section 134c that irradiates the medicine with ultraviolet light.

[0072] The first irradiation unit 134a and the second irradiation unit 134b irradiate the medicine with white light as visible light. The first irradiation unit 134a is a bar-shaped visible light source (bar illumination), and the second irradiation unit 134b is a ring-shaped visible light source (ring illumination). The first camera 131 receives the visible light emitted from the first irradiation unit 134a or the second irradiation unit 134b and reflected by the medicine, thereby acquiring an image based on the visible light (visible light image). The imaging control unit 63 stores image data indicating the visible light image acquired by the first camera 131 in the storage unit 80 as an imaged image 82.

[0073] The ultraviolet light irradiating unit 134c irradiates the drug with ultraviolet light (e.g., light having a peak wavelength of 365 nm or more and 410 nm or less) to excite the components contained in the drug. This causes fluorescence (e.g., light having a peak wavelength of 410 nm or more and 800 nm or less) to be extracted from the drug. The first camera 131 receives the fluorescence emitted from the drug to obtain an image based on the ultraviolet light (ultraviolet light image). The imaging control unit 63 stores image data indicating the ultraviolet light image obtained by the first camera 131 in the storage unit 80 as the captured image 82.

[0074] As shown in Figs. 3 and 4, the rotation mechanism 132 rotates the first camera 131 so as to revolve around the arrangement area Ar2 (the medicine placement table 133a arranged at that position) where the medicine to be imaged is arranged. The first camera 131 images the medicine arranged in the arrangement area Ar2 from multiple positions to which the rotation mechanism 132 has rotated it. Specifically, the imaging mechanism including the first camera 131 and the illuminator 134 is rotated so as to revolve around the arrangement area Ar2. Therefore, the first camera 131 can image the medicine from multiple directions while maintaining the positional relationship of the first camera 131 and the illuminator 134 with respect to the arrangement area Ar2.

[0075] As shown in 3001 of Fig. 3, the rotation mechanism 132 includes an imaging mechanism driving unit 132a and a power transmission mechanism 132b. The imaging mechanism driving unit 132a generates power for rotating the imaging mechanism around the arrangement area Ar2. The power transmission mechanism 132b transmits the power generated by the imaging mechanism driving unit 132a to the imaging mechanism. The imaging mechanism driving unit 132a is driven under the control of the imaging control unit 63 to change the position of the imaging mechanism around the arrangement area Ar2.

[0076] The rotation mechanism 132 rotates the imaging mechanism between an initial position and a position opposite to the initial position. The initial position is a position in a direction substantially perpendicular to the arrangement area Ar2 and above the arrangement area Ar2. The position opposite to the initial position is a position in a direction substantially perpendicular to the arrangement area Ar2 and below the arrangement area Ar2. This position can also be said to be a position where the first camera 131 faces the bottom of the medicine placement table 133a present in the arrangement area Ar2.

[0077] As shown in Fig. 4, an axis passing through the center of the arrangement area Ar2 and parallel to the Z axis is defined as axis Ax0, and an axis passing through the center of the arrangement area Ar2 and the center of the imaging mechanism is defined as axis Ax1. The angle between axis Ax0 and axis Ax1 is defined as θ. In this embodiment, the rotation mechanism 132 places the imaging mechanism at any one of the positions θ=0° (initial position), 45°, 135°, and 180°. Note that 4001 in Fig. 4 shows a case where the imaging mechanism is at a position of θ=0°, and 4002 in Fig. 4 shows a case where the imaging mechanism has rotated from the initial position to a position of θ=45°.

[0078] In this way, by rotating the imaging mechanism around the arrangement area Ar2, the medicine can be imaged from multiple directions while the medicine is fixed in the arrangement area Ar2. Even if the medicine (tablet) stands upright after shaking the medicine placement table 133a, information indicated by the markings or the like affixed to the medicine can be obtained by imaging from an oblique direction (θ=45° or 135°).

[0079] It should be noted that the imaging mechanism may be fixed and the drug may be rotated to capture images of the drug from multiple directions.

[0080] (Imaging position control) Next, an example of position control of the imaging mechanism will be described. The imaging control unit 63 first sets the imaging mechanism to an initial position, and causes the first camera 131 to capture an image of the medicine placed in the placement area Ar2 at the initial position. At this time, the first camera 131 acquires a visible light image (two visible light images) based on visible light from the first irradiation unit 134a and the second irradiation unit 134b, and also acquires an ultraviolet light image based on ultraviolet light from the ultraviolet light irradiation unit 134c.

[0081] Next, the imaging control unit 63 sets the imaging mechanism at a position opposite to the initial position, and causes the first camera 131 to capture an image of the medicine placed in the placement area Ar2 at that position, thereby acquiring two visible light images and an ultraviolet light image. The discrimination unit 64 analyzes these six images to discriminate the type of medicine. If the type of medicine cannot be identified as one, the imaging control unit 63 causes the first irradiating unit 134a and the second irradiating unit 134b to emit visible light at positions θ=45° and 135°, and causes the first camera 131 to capture an image of the medicine. The discrimination unit 64 analyzes the visible light image at this time to discriminate the type of medicine.

[0082] The position control of the imaging mechanism is not limited to the above, and various methods can be used. For example, imaging may be performed from the initial position after imaging from a position opposite to the initial position. Also, a drug discrimination process based on a visible light image when imaging from a position of θ=45° may be performed, and only if the type of drug cannot be identified as one, a visible light image when imaging from a position of θ=135° may be acquired. Also, only ultraviolet light images may be acquired at the initial position and a position opposite to the initial position, and after a drug discrimination process based on the ultraviolet light image, a visible light image at the position may be acquired. Also, visible light images and ultraviolet light images may be acquired at all positions.

[0083] (Image processing / discrimination processing) Next, image processing of the image captured by the imaging unit 13 and drug discrimination processing based on the result of the image processing will be described with reference to Fig. 1. The image processing is mainly performed by the imaging control unit 63, and the discrimination processing is mainly performed by the discrimination unit 64.

[0084] The discrimination unit 64 discriminates the type of drug based on the image of the drug captured by the first camera 131. Specifically, the discrimination unit 64 discriminates the type of drug based on the imaging result (visible light image) of the drug captured in a state where visible light is irradiated from the first irradiating unit 134a or the second irradiating unit 134b. The discrimination unit 64 also discriminates the type of drug based on the imaging result (ultraviolet light image) of the drug captured in a state where ultraviolet light is irradiated.

[0085] The discrimination unit 64 performs image analysis on each of the visible light image and / or the ultraviolet light image to extract features of the medicine contained in the image. Examples of the features of the medicine include size, shape, marking, print, dividing line, and representative color (color of the area with marking or print).

[0086] Examples of the size characteristic of the drug include the major axis and minor axis of the drug, and examples of the shape characteristic of the drug include the circularity and aspect ratio of the drug.

[0087] When OCR (Optical Character Recognition) or the like is performed, other information such as the engraved or printed name of the drug (e.g., identification code) or identification information indicating the manufacturer (identification information for identifying the drug), expiration date, etc. are extracted as the drug's characteristics. In the case of an ultraviolet light image, the representative color of the drug in the image is an example of the drug's characteristics. The discrimination unit 64 associates the extracted information indicating the characteristics of each drug with the captured image 82 of the drug and stores it in the storage unit 80. The extraction of drug characteristics may be performed by a known technique.

[0088] The extracted features of the medicine include the representative color of the medicine in the image as described above. Hereinafter, data indicating this representative color will be referred to as color data (data indicating the color of the medicine). Color data includes data generated from a visible light image and data generated from an ultraviolet light image. In the following description, unless otherwise specified, when the term "color data" is simply stated, it refers to both color data generated from a visible light image and color data generated from an ultraviolet light image. The color data is data indicating the color of a predetermined area (at least a part of the area in which the medicine is shown, typically an area with an inscription or print) in an image in which the medicine is captured. For example, the average value of the RGB values ​​of each pixel included in the area may be used as the color data. In addition, the color data may be a CIELab value, which is a value representing the color included in the area as a combination of the L* value, a* value, and b* value in the CIELab color space.

[0089] The discrimination unit 64 discriminates the type of drug by comparing the characteristics of each drug with the drug database 81. For example, the discrimination unit 64 ranks candidates for drug data (reference drug data) related to the imaged drug from the drug database 81 based on the color data. Thereafter, the discrimination unit 64 discriminates the type based on other characteristics according to the above ranking.

[0090] The discrimination unit 64 may also narrow down candidates for drug data related to the captured drug from the drug database 81 using pattern matching or the like based on the extracted drug characteristics. In this case, for example, the drug data candidates are narrowed down using at least one of the above-mentioned size, shape, marking, print, dividing line, and representative color. Thereafter, the discrimination unit 64 performs OCR or the like to read the identification information or the like shown on the marking or print, and further narrows down the types of drug from the candidates using pattern matching or the like. The discrimination unit 64 may also rank the candidates based on the degree of agreement between the extracted drug characteristics and the characteristics of the drug (reference drug) included in the drug database 81.

[0091] Furthermore, even if the drug features (target features) extracted using pattern matching or the like are not in the drug database 81, when the drug is estimated to be a drug (tablet or capsule) based on at least a part of the target features, the discrimination unit 64 determines the type of drug as a suspected drug. In this case, the suspected drug can also be sorted into the second container 14 or the waiting tray 15. In this embodiment, the suspected drug may first be temporarily placed on the waiting tray 15.

[0092] In this manner, the discrimination unit 64 determines whether or not there is drug data corresponding to the captured image 82 captured by the first camera 131 in the drug data (drug database 81) relating to a plurality of types of drugs registered in advance.

[0093] The discrimination unit 64 outputs the discrimination result of the type of medicine to the sorting control unit 62. For example, when the type of medicine can be identified as one, or when the number of candidates is narrowed down to a predetermined number or less, the discrimination unit 64 outputs the medicine data related to the medicine as the discrimination result. In this case, the discrimination unit 64 stores the medicine data related to the medicine in the storage unit 80 in association with the captured image 82 of the medicine.

[0094] When the discrimination unit 64 discriminates the type of medicine as a suspected medicine, it outputs the characteristics of the medicine (the characteristics of the object presumed to be a suspected medicine) as the discrimination result. On the other hand, when the discrimination unit 64 discriminates that the medicine is registered in the medicine database 81 as a medicine to be discarded, or when the discrimination unit 64 discriminates that the object contained in the first container 11 is a foreign object other than a medicine, it outputs the fact that the medicine is not to be sorted as the discrimination result.

[0095] As described above, the discrimination unit 64 performs discrimination processing by analyzing the captured image 82. The discrimination unit 64 may be configured to perform the following processing when it is difficult to discriminate the type of drug in one discrimination processing (the type of drug cannot be discriminated in one discrimination processing). For example, the discrimination unit 64 may be configured to perform image analysis on the captured image 82 again and attempt to discriminate the type of drug (discrimination retry processing) until a predetermined upper limit number of times (e.g., 3 times) is reached or a timeout occurs.

[0096] (Medicine sorting processing) Next, the medicine sorting process based on the result of the above-mentioned discrimination process will be described with reference to Fig. 1. The medicine sorting process is mainly performed by the transport / sorting unit 12 and the sorting control unit 62.

[0097] The transporting and sorting unit 12 sorts the medicines by type based on the discrimination result by the discrimination section 64, and stores them in the second storage section 14 or the waiting tray 15. The sorting control section 62 controls the transporting and sorting unit 12 to transport the medicines placed in the receiving area Ar1 after the imaging and discrimination process to a predetermined sorting cup 141 in the second storage section 14 or the waiting tray 15 based on the discrimination result.

[0098] When the sorting control unit 62 receives the discrimination result of the medicine, it determines a sorting position to store the medicine, and associates the discrimination result with the determined sorting position and stores them in the memory unit 80. Specifically, the sorting control unit 62 determines whether or not a discrimination result identical to the above discrimination result is stored in the memory unit 80.

[0099] When the same discrimination result as the above discrimination result is stored, the sorting cup 141 linked to the stored discrimination result is determined as the sorting position. When the sorting position linked to the stored discrimination result (e.g., estimated drug) is the waiting tray 15, the waiting tray 15 is determined as the sorting position. On the other hand, when the same discrimination result as the above discrimination result is not stored, the sorting cup 141 that does not store a drug (the sorting cup 141 that has not been determined as the sorting position) is determined as the sorting position. When drugs are stored in all of the sorting cups 141, the waiting tray 15 is determined as the sorting position. Note that, for the estimated drug, the sorting control unit 62 may determine any of the sorting cups 141 included in a predetermined area of ​​the second storage unit 14 as the sorting position instead of the waiting tray 15.

[0100] When the sorting control unit 62 determines the sorting position, it controls the transport mechanism 123 in the same manner as the transport control unit 61 to move the transport / sorting unit 12 above the receiving area Ar1. Similarly to the transport control unit 61, the sorting control unit 62 controls the second camera 121 and the suction / shutter mechanism 122 to adsorb the medicines placed in the receiving area Ar1. Thereafter, the transport mechanism 123 transports the medicines to the determined sorting cup 141 or waiting tray 15. As described above, the shutter mechanism is in a closed state during the medicine transport, so that it is possible to prevent the medicines from falling into an area other than the determined sorting position (e.g., a sorting cup 141 other than the determined sorting cup 141). After the transport, the suction is released to store the medicines in the sorting cup 141 or waiting tray 15. In addition, the sorting control unit 62 counts the number of medicines stored in the sorting cup 141, and stores the number in the memory unit 80 in association with the sorting position.

[0101] After the sorting control section 62 transports the medicines (medicines after identification) on the medicine placement table 133a arranged in the receiving area Ar1 to the sorting position, the transport control section 61 controls the transport / sorting unit 12 to transport and place the medicines stored in the first storage section 11 on the now emptied medicine placement table 133a. This allows the medicine sorting device 1 to continuously identify the types of medicines.

[0102] In addition, if the sorting control unit 62 receives a discrimination result indicating that the type of medicine could not be identified, the object placed in the receiving area Ar1 after discrimination is a foreign object, and therefore the sorting control unit 62 transports the foreign object to the collection tray 16.

[0103] In this way, the sorting control unit 62 stores all of the items contained in the first container 11 in either the second container 14, the waiting tray 15, or the collection tray 16, regardless of the result of identifying the type of medicine. Therefore, even if the type of medicine cannot be identified as one, or if a foreign object has been mixed into the first container 11, the sorting process can be continued without being stopped for that reason.

[0104] In order to take out the medicines for which the discrimination process has been completed from the medicine placing table 133a arranged in the receiving area Ar1, the sorting control unit 62 causes the second camera 121 to capture an image of the medicine placing table 133a, thereby narrowing down the positions of the medicines. In addition, when transporting the medicines stored in the sorting cup 141 to the packaging mechanism 6, the sorting control unit 62 causes the second camera 121 to capture an image of the sorting cup 141, thereby narrowing down the medicines to be transported.

[0105] In addition, when the number of drugs stored in the sorting cup 141 reaches the upper limit, the sorting control unit 62 stores the drugs to be sorted in an empty sorting cup 141 other than the sorting cup 141, even if the type of drug to be sorted is the same as the type of drug sorted in the sorting cup 141.

[0106] Furthermore, data on the medicines stored in the sorting cup 141 by the sorting control unit 62 is stored in an RFID tag provided in the sorting cup 141 by the second RFID reader / writer unit 18.

[0107] The second RFID reader / writer unit 18 writes various data to the RFID tag or reads various data stored in the RFID tag, similar to the first RFID reader / writer unit 5. The sorting control unit 62 causes the RFID control unit 68 to write data related to the medicine every time the medicine is stored in the sorting cup 141. The second RFID reader / writer unit 18 is provided below the second storage unit 14. Specifically, the second RFID reader / writer unit 18 is provided so as to face the bottom of each sorting cup 141 when reading or writing data related to the medicine stored in the RFID tag of each sorting cup 141.

[0108] [Embodiment 2] Other embodiments of the present invention will be described below. For the sake of convenience, the same reference numerals will be used to designate components having the same functions as those described in the above embodiment, and the description thereof will not be repeated. The same applies to the following embodiments.

[0109] (overview) In this embodiment, a configuration for quickly and accurately discriminating between coated tablets, such as sugar-coated tablets, whose surfaces are covered with a film, and other drugs (plain tablets) will be described using Figures 6 and 7.

[0110] The discrimination unit 64 in this embodiment extracts feature information indicating the external characteristics of the target drug, including at least reflection area information indicating the reflection area of ​​light irradiated onto the target drug, from the captured image of the drug to be discriminated (target drug), and uses the reflection area information to discriminate the target drug.

[0111] For example, the reflection area of ​​light irradiated onto a drug varies depending on the presence or absence of a sugar coating on the drug. According to the above configuration, by using the reflection area of ​​light irradiated onto the drug to distinguish the type of the target drug, coated tablets can be quickly and accurately distinguished from other drugs.

[0112] (Control unit 60a) The control unit 60a according to this embodiment has the main components described in the first embodiment.

[0113] (Discrimination unit 64) The discrimination unit 64 according to this embodiment includes a feature extraction unit 64a and a matching unit 64b shown in Fig. 1. The discrimination unit 64 performs the following processes in addition to the processes described in the first embodiment.

[0114] (Feature extraction unit 64a) The feature extraction unit 64a extracts feature information (first feature information) indicating the external characteristics of the target drug, including at least reflection area information indicating the reflection area of ​​the light irradiated to the target drug, from the captured image in which the target drug is captured. The reflection area of ​​the light may be, for example, an area affected by halation in the captured image 82.

[0115] In detail, the feature extraction unit 64a extracts features of the drug contained in the image by performing image analysis on the visible light image and / or ultraviolet light image (captured image 82). In addition to the features of the drug extracted by the discrimination unit 64 described in the first embodiment, the feature extraction unit 64a extracts a reflection area of ​​the light irradiated on the target drug as a feature of the target drug. The feature extraction unit 64a outputs feature information indicating the extracted features of the drug, including reflection area information, to the collation unit 64b.

[0116] For example, the feature extraction unit 64a may extract, as the reflection region, an image region having a saturation value higher than a predetermined value in the captured image 82. The predetermined value may be set, for example, to a saturation level that allows the reflection region to be extracted from the captured image of a coated tablet so that the coated tablet can be distinguished from other drugs through experiments.

[0117] Furthermore, the feature extraction unit 64a may extract the reflection region by performing a filtering process on the captured image 82 using, for example, a bilateral filter.

[0118] Fig. 6 is a diagram showing an example of a reflection area of ​​light reflected by a target drug in a captured image. The diagram shown in D1 of Fig. 6 is a visible light image of a sugar-coated tablet captured using the second irradiator 134b (ring illumination). The diagram shown in D2 of Fig. 6 is an image obtained by performing a filter process using a bilateral filter on the visible light image shown in D1.

[0119] Moreover, the diagram shown in D3 of Fig. 6 is a visible light image of the plain tablet captured using the second irradiator 134b. The diagram shown in D4 of Fig. 6 is an image obtained by performing a filter process using a bilateral filter on the visible light image shown in D3.

[0120] As shown in D2 of Fig. 6, in an image that has been filtered using a bilateral filter, a ring-shaped reflection region is extracted in an image of a sugar-coated tablet. On the other hand, as shown in D4 of Fig. 6, in an image that has been filtered using a bilateral filter, a reflection region is not extracted in an image of an uncoated tablet.

[0121] (Collation unit 64b) The collation unit 64b compares characteristic information (second characteristic information) indicating the characteristics of the appearance of the reference drug with characteristic information of the target drug. The characteristic information of the reference drug includes at least reflection area information indicating a reflection area of ​​the light irradiated onto the reference drug. The characteristic information is drug data on the reference drug included in the drug database 81. The characteristic information of the target drug includes at least reflection area information indicating a reflection area of ​​the light irradiated onto the target drug. The collation unit 64b determines the type of the target drug based on the result of the collation.

[0122] The collation unit 64b may narrow down candidates of drug data related to the imaged target drug from drug data related to a reference drug included in the drug database 81 by using pattern matching or the like based on the features of the target drug extracted by the feature extraction unit 64a. The collation unit 64b may also narrow down candidates of drug data by using at least one of the drug features described in the first embodiment in addition to the reflection region information. The collation unit 64b may also rank the candidates based on the degree of agreement between the extracted features of the target drug and the features of the reference drug included in the drug database 81.

[0123] For example, the drug database 81 includes, as drug data for each reference drug, reflection area information indicating a reflection area of ​​light irradiated onto the reference drug in an image in which the reference drug is captured. The collation unit 64b compares the shape of the reflection area indicated by the reflection area information of the target drug with the shape of the reflection area indicated by the reflection area information of each reference drug, and narrows down candidates for drug data for the target drug (i.e., candidates for the type of the target drug) from the drug data for the multiple reference drugs.

[0124] The collation unit 64b outputs the discrimination result of the type of the target drug to the sorting control unit 62. For example, when the type of the target drug can be identified as one, or when the number of candidates is narrowed down to a predetermined number or less, the collation unit 64b outputs the drug data of the target drug as the discrimination result. In this case, the collation unit 64b stores the drug data of the target drug in the storage unit 80 in association with the captured image 82 of the target drug.

[0125] (Processing example) Fig. 7 is a flowchart showing an example of the discrimination process of the discrimination unit 64 of this embodiment. As shown in Fig. 7, the feature extraction unit 64a extracts feature information of the target drug including reflection region information from the captured image 82 (S11). Then, the collation unit 64b compares the feature information of the reference drug (drug data) included in the drug database 81 with the feature information of the target drug (S12). Then, the collation unit 64b discriminates the type of the target drug based on the result of the collation (S13), outputs the discrimination result of the drug type to the sorting control unit 62, and the process ends.

[0126] (Modification) (Summary of the modified example) In this modification, the discrimination unit 64 extracts feature information indicating the external appearance features of the target drug from the captured image of the target drug. The feature information includes at least reflection information indicating whether the light irradiated to the target drug is reflected by the target drug. The discrimination unit 64 uses the reflection information to discriminate the target drug.

[0127] For example, whether or not the light irradiated onto the drug is reflected depends on whether or not the drug is coated (e.g., sugar-coated), etc. Therefore, by using whether or not the light irradiated onto the drug is reflected to distinguish the type of target drug, coated tablets can be quickly and accurately distinguished from other drugs.

[0128] Other processing by the discriminator 64 according to this modification is similar to that by the discriminator 64 described in the above-mentioned second embodiment, and therefore the description will not be repeated.

[0129] (Feature extraction unit 64a) The feature extraction unit 64a according to this modification extracts feature information (third feature information) of the target drug from the captured image of the target drug. The feature information includes at least reflection information indicating whether the light irradiated to the target drug is reflected by the target drug. The feature extraction unit 64a outputs the feature information of the target drug including the extracted reflection information to the collation unit 64b.

[0130] For example, as described in the second embodiment, the feature extraction unit 64a extracts an image area having a saturation value higher than a predetermined value in the captured image 82. The feature extraction unit 64a judges whether or not light is reflected by the target drug depending on the presence or absence of the extraction. Also, as described in the second embodiment, the feature extraction unit 64a judges whether or not light is reflected by the target drug using a captured image obtained by performing bilateral filter processing on the captured image 82. In response to the above judgment, the feature extraction unit 64a extracts reflection information indicating whether or not the irradiated light is reflected by the reference drug.

[0131] (Collation unit 64b) The collation unit 64b according to this modified example collates the characteristic information of the reference drug (fourth characteristic information) with the characteristic information of the target drug (third characteristic information). The characteristic information of the reference drug includes at least reflection information indicating whether or not the irradiated light is reflected by the reference drug. The characteristic information of the target drug includes at least reflection information indicating whether or not the irradiated light is reflected by the target drug. The collation unit 64b determines the type of the target drug based on the result of the collation. The collation unit 64b outputs the determination result of the type of the target drug to the sorting control unit 62.

[0132] For example, the drug database 81 includes, as drug data for each reference drug, reflection information indicating whether or not light irradiated in an image in which each reference drug is captured is reflected by the reference drug. The collation unit 64b may collate the reflection information of the target drug with the reflection information of each reference drug, and narrow down candidates for drug data for the target drug from among the drug data for the multiple reference drugs.

[0133] For example, when the collation unit 64b extracts reflection information indicating that the light irradiated in the captured image of the target drug is reflected by the target drug from the captured image, the collation unit 64b extracts characteristic information (drug data) including the reflection information from the drug database 81. The reflection information is information indicating that the light irradiated in the captured image of the reference drug is reflected. As a result, the collation unit 64b narrows down the characteristic information of the reference drug including the reflection information indicating that the light is reflected as a candidate for drug data related to the target drug in the drug database 81.

[0134] Similarly, when the collation unit 64b extracts reflection information indicating that the light irradiated in the captured image of the target drug is not reflected by the target drug from the captured image, the collation unit 64b extracts feature information including the following reflection information. The reflection information is information indicating that the light irradiated in the captured image of the reference drug is not reflected. As a result, the collation unit 64b narrows down the feature information of the reference drug including the reflection information indicating that the light is not reflected as candidates for drug data related to the target drug in the drug database 81.

[0135] Furthermore, the collation unit 64b may narrow down candidates for drug data by using at least one of the drug characteristics described in the first and second embodiments in addition to the above-mentioned reflection information.

[0136] [Embodiment 3] (overview) In this embodiment, a configuration for quickly and accurately identifying medicines by utilizing differences in thickness of the medicines will be described.

[0137] (Control unit 60a) The control unit 60a according to this embodiment has the main components described in the first embodiment.

[0138] (Discrimination unit 64) The discrimination unit 64 according to this embodiment includes a feature extraction unit 64a and a matching unit 64b shown in Fig. 1. The discrimination unit 64 according to this modification performs the following process in addition to the process described in the first embodiment.

[0139] (Feature extraction unit 64a) The feature extraction unit 64a according to this embodiment extracts the thickness of the target drug from a captured image of the target drug captured from an oblique direction (θ=45° or 135°). The feature extraction unit 64a outputs thickness information indicating the thickness to the collation unit 64b as one of the features of the target drug. For example, the feature extraction unit 64a extracts the thickness of the drug contained in the image by performing image analysis on the visible light image and / or ultraviolet light image (captured image 82). Note that the process of capturing an image of the target drug from an oblique direction has been described in detail in the "Drug imaging process" of the first embodiment, and therefore will not be described again here.

[0140] FIG. 8 is a diagram showing an example of the thickness of the target drug extracted by the feature extraction unit 64a. In detail, the diagram shown in D5 of FIG. 8 is a visible light image of the drug captured using the first irradiator 134a (bar illumination). For example, the feature extraction unit 64a extracts the thickness T1 of the captured target drug by a known image processing technique. For example, the feature extraction unit 64a may extract the thickness T1 of the target drug from the captured image by using a keystone correction technique, a panoramic imaging technique, or the like.

[0141] (Collation unit 64b) The collation unit 64b collates the characteristic information of the reference drug with the characteristic information of the target drug. The characteristic information of the reference drug includes at least thickness information indicating the thickness of the reference drug. The characteristic information of the target drug includes at least thickness information indicating the thickness of the target drug.

[0142] For example, the drug database 81 includes thickness information indicating the thickness of each reference drug as drug data for each reference drug. The collation unit 64b may collate the thickness information of the target drug with the thickness information of each reference drug to narrow down candidates for drug data for the target drug from among drug data for a plurality of reference drugs. The collation unit 64b may also narrow down candidates for drug data using at least one of the drug features described in the first and second embodiments in addition to the thickness information. The collation unit 64b may also collate the thickness information of the target drug with the thickness information of each reference drug in the "discrimination retry process" described in the "image processing and discrimination process" of the first embodiment to discriminate the type of the target drug.

[0143] [Embodiment 4] (overview) In this embodiment, a configuration capable of accurately discriminating the type of target medicine will be described with reference to FIG.

[0144] The drug database update unit 74 according to this embodiment performs the following process when the discrimination unit 64 fails to discriminate the type of the target drug. After accepting an operation by the user, the drug database update unit 74 updates the target drug color data 84 (target color information) indicating the color of the target drug used in the discrimination to color data (reference color information) indicating the color of the reference drug included in the drug database 81.

[0145] According to the above configuration, for a target drug whose type has been unsuccessfully identified, the target drug color data 84 extracted from the captured image 82 captured in an environment in which the type of the target drug is actually identified can be used as the color data of the reference drug. Therefore, the type of the target drug can be identified with high accuracy.

[0146] The control unit 60a receives the medicine database 81 created by the external device from the external device and stores it in the storage unit 80. The medicine sorting device 1 used when the external device creates the medicine database 81 is different from the medicine sorting device 1 installed in a medical institution such as a hospital, and the medicine imaging environment is also different. With the above configuration, it is possible to reduce the possibility that the type of the target medicine will not be appropriately identified due to a difference in color in the captured image caused by a difference in the medicine sorting device 1 or the imaging environment.

[0147] In addition, when creating the drug database 81, whether the type of drug can be appropriately identified based on the drug data registered in the drug database 81 is checked using captured images of multiple drugs of the same or similar types. In the above configuration, when only the color data of the reference drug is updated, this check does not need to be performed. Therefore, the time and effort required for this check can be reduced.

[0148] (Control unit 60a) The control unit 60a according to this embodiment includes a medicine database update unit 74 shown in FIG.

[0149] (Discrimination unit 64) The discrimination unit 64 according to this embodiment performs the following process in addition to the process described in the first embodiment. The discrimination unit 64 compares the characteristic information (fifth characteristic information) of the target drug with characteristic information (sixth characteristic information) including color data (reference color information) indicating the color of a reference drug included in the drug database 81, and discriminates the type of the target drug based on the result of the comparison. The characteristic information of the target drug includes target drug color data 84 (target color information) indicating the color of the target drug extracted from the captured image in which the target drug is captured. The target drug color data 84 is the same as the color data described in the first embodiment, so the description here will not be repeated. Furthermore, the discrimination unit 64 links the target drug color data 84 to the captured image 82 of the target drug and stores it in the storage unit 80 as the target drug color data 84.

[0150] (Operation unit 31) The operation unit 31 of the touch panel 3 accepts user input. In particular, the operation unit 31 of this embodiment accepts an input operation for updating the target drug color data 84 linked to the captured image 82 in which the discrimination unit 64 has failed to discriminate the type of the target drug, to color data of a reference drug designated by the user.

[0151] For example, if the discrimination unit 64 fails to discriminate the type of the target drug, the user checks the failed captured image 82 on the display unit 32 of the touch panel 3 or the like. If the user is able to discriminate the target drug captured in the captured image 82, the user specifies the discriminated type of drug and performs an operation input to update the target drug color data 84 linked to the captured image 82 to the color data of the specified reference drug. That is, the above operation input includes inputting the specification of the reference drug and the specification of the captured image 82. The operation unit 31 may also accept an operation input to update only the color data of the reference drug to the target drug color data 84 linked to the specified captured image 82. The operation unit 31 may also accept an operation input to update both the color data and the captured image of the reference drug to the specified captured image 82 and the target drug color data 84 linked to the specified captured image 82.

[0152] (Drug Database Update Division 74) When the discrimination unit 64 fails to discriminate the type of the target drug, the drug database update unit 74 accepts an operation by the user and then updates the target drug color data 84 used in the discrimination to color data of a new reference drug.

[0153] In detail, the drug database update unit 74 updates the color data of the reference drug specified by the user in the drug database 81 to the target drug color data 84 linked to the captured image 82 specified by the user in accordance with the user's operational input via the operation input unit 66.

[0154] Furthermore, when an operation input is received to update both the color data of the reference drug and the captured image of the reference drug, the drug database update unit 74 performs the following process: The drug database update unit 74 updates the color data and captured image of the reference drug designated by the user in the drug database 81 to the designated captured image 82 and the target drug color data 84 linked to the designated captured image 82.

[0155] (Processing example) Fig. 9 is a flowchart showing an example of the update process of the drug database update unit 74 of this embodiment. As shown in Fig. 9, the drug database update unit 74 judges whether or not an operation input for updating the color data of the reference drug stored in the drug database 81 has been received (S21). When an operation input for updating the color data of the reference drug has been received (YES in S21), the drug database update unit 74 performs the following process. The drug database update unit 74 updates the color data of the reference drug designated by the user in the drug database 81 to the target drug color data 84 linked to the designated captured image 82 (S22), and the process ends. Note that when an operation input for updating the color data of the reference drug has not been received (NO in S21), the process returns to S21.

[0156] [Embodiment 5] (overview) In this embodiment, a configuration capable of quickly and accurately identifying a target drug will be described with reference to Figs. 10 to 12.

[0157] In this embodiment, the drug database 81 includes specific drug information indicating whether each reference drug is a specific drug or not as drug data regarding each reference drug.

[0158] The discrimination unit 64 according to the present embodiment discriminates the type of the target drug using the identification information displayed on the surface of the reference drug and the target drug, and the position information indicating the relative position of the display area of ​​the identification information with respect to the image of the drug in the captured image of the reference drug and the target drug. However, when the reference drug indicated by the specific drug information as a specific drug is a candidate for the target drug, the discrimination unit 64 does not use the position information to discriminate the type of the target drug, but discriminates whether the target drug is the same type of drug as the reference drug.

[0159] For example, in the case of a spherical medicine or a medicine in which the display position of the identification information differs between production lots, the relative position in the reference image and the relative position in the target image may be separated by a predetermined value or more even if the medicine is the same type. According to the above configuration, when the above-mentioned medicine is the target medicine, it is possible to determine whether the target medicine is the same type as the reference medicine, regardless of whether the two relative positions are separated by a predetermined value or more. On the other hand, for medicines other than the target medicine of a predetermined type, if the two relative positions are separated by a predetermined value or more, the type of the target medicine is not determined to be the same type as the reference medicine. For example, for two different medicines in which part of the identification information is the same character string, the target medicine is not determined to be the same type as the reference medicine. Therefore, according to the above configuration, the possibility of misidentification of medicines can be reduced.

[0160] (Control unit 60a) The control unit 60a according to this embodiment has the main components described in the first embodiment.

[0161] (Discrimination unit 64) The discrimination unit 64 according to this embodiment includes a feature extraction unit 64a and a collation unit 64b shown in Fig. 1. The discrimination unit 64 performs the following processes in addition to the processes described in the first embodiment.

[0162] (Feature extraction unit 64a) The feature extraction unit 64a extracts feature information (seventh feature information) of the target drug from the captured image 82 in which the target drug is captured. The feature information includes at least (1) identification information displayed on the surface of the target drug, and (2) position information (first position information) indicating the relative position of the display area of ​​the identification information with respect to the image of the target drug.

[0163] In detail, the feature extraction unit 64a extracts the relative position of the display area of ​​the identification information with respect to the image of the target drug as a feature, in addition to the feature of the target drug extracted by the discrimination unit 64 described in the embodiment 1. The feature extraction unit 64a outputs feature information including the first position information to the collation unit 64b.

[0164] For example, the identification information is an inscription or print or the like affixed to the surface of the medicine to identify the medicine, as described in embodiment 1. In addition, the "relative position of the display area of ​​the identification information with respect to the image of the target medicine" can be, for example, a predetermined position in the display area of ​​the inscription or print on the surface of the medicine with respect to the image of the target medicine (for example, the center of the display area).

[0165] (Collation unit 64b) The collation unit 64b collates the characteristic information of the reference drug (eighth characteristic information) with the characteristic information of the target drug (seventh characteristic information). The characteristic information of the target drug includes at least the identification information and the first position information. The characteristic information of the reference drug (drug data on the reference drug) includes at least the specific drug information indicating whether the reference drug is a specific drug or not, the identification information displayed on the surface of the reference drug, and the position information (second position information) indicating the relative position of the display area of ​​the identification information with respect to the image of the reference drug. The "relative position of the display area of ​​the identification information with respect to the image of the reference drug" may be, for example, a position corresponding to a predetermined position on the target drug (for example, the center of the display area). The relative position on the target drug and the relative position on the target drug may be any position as long as they are in a corresponding positional relationship. Examples of the specific drug indicated by the specific drug information include a drug with a shape (spherical, etc.) that makes the reference drug easy to roll, a drug with a display position of the identification information that differs between production lots, etc.

[0166] The collation unit 64b determines the type of the target drug based on the result of the collation. The collation unit 64b may narrow down candidates of drug data related to the imaged target drug from drug data related to the reference drug included in the drug database 81 by using pattern matching or the like based on the features of the target drug extracted by the feature extraction unit 64a. The collation unit 64b may also narrow down candidates of drug data by using at least one of the features of the drug described in the first embodiment in addition to the above identification information.

[0167] When the specific drug information indicates that the reference drug is a specific drug, the comparison unit 64b determines whether the target drug is the same type of drug as the reference drug without using the first position information and the second position information to determine the type of the target drug.

[0168] In addition, when the specific drug information indicates that the reference drug is not a specific drug, the comparison unit 64b uses the first position information and the second position information to determine the type of the target drug, and determines whether the target drug is the same type of drug as the reference drug.

[0169] In detail, the collation unit 64b judges whether the position indicated by the first position information and the position indicated by the second position information are separated by a predetermined value or more. That is, the collation unit 64b judges whether the relative position of the target drug and the relative position of the reference drug are separated by a predetermined value or more. The collation unit 64b outputs the discrimination result of the type of drug to the sorting control unit 62 according to the result of the above judgment.

[0170] (Processing example) FIG. 10 is a flowchart showing an example of the discrimination process of the discrimination unit 64 of this embodiment. As shown in FIG. 10, the feature extraction unit 64a extracts feature information of the target drug from the captured image 82 (S1). The feature information includes, for example, shape, color data, identification information, and first position information. Next, the collation unit 64b compares a part of the feature information of the target drug (shape, color data, etc.) with the feature information of the reference drug included in the drug database 81, and narrows down the drug data that is a candidate for the target drug (S2). Next, the collation unit 64b starts collation of the identification information of the reference drug data of each of the narrowed down candidates for the target drug with the identification information of the target drug (S3). In the process of collation of the identification information, the collation unit 64b starts matching of the entire identification information (S4). In detail, the collation unit 64b determines whether or not the shape of the display area of ​​the identification information of the reference drug data of the candidate matches the shape of the display area of ​​the identification information of the target drug (S5).

[0171] When it is determined that the shape of the display area of ​​the identification information of the reference drug data of the candidate matches the shape of the display area of ​​the identification information of the target drug (YES in S5), the discrimination unit 64 starts pattern matching for each character of the identification information (S6). The feature extraction unit 64a performs OCR on the identification information of the target drug (S7). Note that the feature extraction unit 64a may perform OCR on the identification information of the target drug in step S1. Next, the collation unit 64b determines whether or not all characters included in the identification information of the target drug match the characters included in the identification information of the reference drug included in the drug database 81 (S8). When it is determined that all characters included in the identification information of the target drug match the characters included in the identification information of the reference drug (YES in S8), the collation unit 64b performs the following process. The collation unit 64b determines whether or not the specific drug information of the reference drug data of the candidate indicates that the drug is a specific drug (S31). Note that in this example, a case will be described in which the specific drug is a drug with a shape that is easy to roll. When it is determined that the specific drug information indicates that the reference drug data of the candidate is not a drug with a shape that is easy to roll (NO in S31), the collation unit 64b compares the first position information extracted by the feature extraction unit 64a with the second position information of the reference drug indicated by the drug data of the candidate drug of the target drug included in the drug database 81 (S32). Through this comparison, the collation unit 64b determines whether the position indicated by the first position information and the position indicated by the second position information are apart by a predetermined value or more (S33).

[0172] FIG. 11 is a diagram showing an example of the relative position in the target drug or the relative position in the reference drug. Positions P1, P2, P3, and P4 are shown in the images of the target drug or the reference drug shown at D6, D7, D8, and D9 in FIG. 11. Each of the positions P1, P2, P3, and P4 is the center (predetermined position) in the display area of ​​the identification information (ABC or ABC 12). For example, the relative position in the target drug or the relative position in the reference drug is the position P1, P2, P3, and P4 with respect to the images of the target drug shown at D6, D7, D8, and D9. The feature extraction unit 64a extracts the display area of ​​the identification information using, for example, a known image processing technique, and identifies the center of the display area.

[0173] FIG. 12 is a diagram showing an example of a comparison between the relative position in a target drug and the relative position in a reference drug.

[0174] D10 in FIG. 12 shows an example of an image of a target drug. P5 shown in D10 in FIG. 12 shows the relative position (center of the display area of ​​the identification information) of the display area of ​​the identification information with respect to the image D10 of the target drug. D11 in FIG. 12 shows an example of an image of a reference drug. P6 shown in D11 in FIG. 12 shows the relative position (center of the display area of ​​the identification information) of the display area of ​​the identification information with respect to the image D11 of the reference drug. D12 in FIG. 12 shows a diagram in which the image D10 of the target drug and the image D11 of the reference drug are superimposed. Distance L1 shown in FIG. 12 shows the distance between the center P5 of the display area of ​​the identification information in the image of the target drug and the center P6 of the display area of ​​the identification information in the image of the reference drug.

[0175] The collation unit 64b judges whether the value of the distance L1 is equal to or greater than a predetermined value. The predetermined value can be set appropriately, and may be, for example, 30 pixels. The predetermined value may be set to a level that allows drugs other than the predetermined drug to be identified as different drugs through experiments, for example.

[0176] If the collation unit 64b determines that the position indicated by the first position information and the position indicated by the second position information are not separated by more than a predetermined value (NO in S33), the collation unit 64b outputs the determined type of medicine to the sorting control unit 62 (S34), and the processing ends.

[0177] In addition, when it is determined that the shape of the display area of ​​the identification information of the reference drug data of the candidate does not match the shape of the display area of ​​the identification information of the target drug (NO in S5), the discrimination unit 64 performs the following process. The discrimination unit 64 determines whether there is any unmatched candidate reference drug data (S35). If there is any unmatched candidate reference drug data (YES in S35), the process returns to S3. If there is no unmatched candidate reference drug data (NO in S35), the process ends. In addition, when it is determined that all characters included in the identification information of the target drug do not match the characters included in the identification information of the reference drug (NO in S8), the process continues to S35. In addition, when the collation unit 64b determines that the position indicated by the first position information and the position indicated by the second position information are apart by a predetermined value or more (YES in S33), the process continues to S35. In addition, when it is determined that the specific drug information indicates that the reference drug data of the candidate is a drug with a shape that is easy to roll (YES in S31), the process continues to S34.

[0178] If the drug database 81 does not contain any drug data that may be a candidate for the target drug, i.e., if there is no candidate reference drug data that has not been matched (NO in S35), the following process may be performed. If the matching unit 64b estimates that the target drug is a drug (tablet or capsule) based on at least some of the characteristics of the target drug, it determines the type of the target drug as a suspected drug and ends the process. If the matching unit 64b cannot determine that the imaged object in the captured image 82 is a drug, it determines that the imaged object is a foreign object other than a drug and ends the process.

[0179] [Embodiment 6] (overview) In this embodiment, a configuration capable of improving the efficiency of the sorting process will be described with reference to FIG.

[0180] The priority determination unit 65 according to this embodiment prioritizes the types of medicine based on the past sorting performance of the medicine sorting device 1. For example, the priority determination unit 65 may determine a priority for each type of medicine according to the frequency of discrimination in the discrimination history of the discrimination unit 64. Furthermore, the sorting control unit 62 according to this embodiment determines to temporarily place in the waiting tray (temporary storage unit) 15 medicine types whose priority is lower than a predetermined value.

[0181] Generally, while hundreds to thousands of medicines are sorted in the medicine sorting device 1, there is a limit to the number of sorting cups 141 that can be placed in the second storage unit 14 (40 sorting cups 141 can be placed in the present embodiment). Therefore, when the medicines are sorted in the sorting order, there is a possibility that medicines with a low discrimination frequency (medicines contained in a small number of sorting cups 141) are sorted into the sorting cups 141, and medicines with a high discrimination frequency (medicines contained in a large number of sorting cups 141) are sorted into the waiting tray 15.

[0182] According to the above configuration, medicines with low frequency in the classification history are temporarily placed on the waiting tray 15. Therefore, medicines with high frequency in the classification history can be preferentially sorted into the sorting cups 141 of the second container 14. That is, more medicines can be sorted (to be sorted into the sorting cups 141).

[0183] Furthermore, the priority determination unit 65 may determine the priority for each type of medicine according to the prescription frequency.

[0184] Furthermore, the priority determination unit 65 uses a genetic algorithm to identify a combination of drug types to be sorted into the sorting cups 141 that will maximize the rate at which the sorting work can be completed by sorting into the sorting cups 141 in one sorting operation. In the above identification, the priority determination unit 65 may use past sorting records. The priority determination unit 65 calculates an index for each drug type from the identified combination of drug types. The priority determination unit 65 assigns a priority to each drug type from the calculated index.

[0185] In addition, the process according to this embodiment may be configured to be performed when the amount of drug contained in the first storage section 11 is greater than a predetermined amount (for example, the bottom of the first storage section 11 cannot be seen due to the contained drug).

[0186] (Control unit 60a) The control unit 60a according to this embodiment includes a priority determination unit 65 shown in FIG. 1 in addition to the main components described in the first embodiment.

[0187] (Priority determination unit 65) The priority determination unit 65 assigns a priority to the type of medicine based on the past sorting performance of the medicine sorting device 1. The priority determination unit 65 stores priority data 83 indicating the determined priority of each type of medicine in the storage unit 80. In detail, the priority determination unit 65 determines a priority for each type of medicine (reference medicine) according to the frequency of discrimination in the discrimination history of the discrimination unit 64. In more detail, when the discrimination unit 64 can identify one type of the target medicine or narrow down the number of candidates to within a predetermined number, the discrimination unit 64 associates the medicine data (discriminated type) related to the target medicine with the captured image 82 of the target medicine and stores it in the storage unit 80. For example, the priority determination unit 65 may use the medicine data (discriminated type) related to the target medicine as the discrimination history. The priority determination unit 65 may also set a priority for each type of medicine so that the priority is higher in the order of the type of medicine that is discriminated more frequently in the discrimination history.

[0188] The priority determination unit 65 may update the priority data 83 every time the discrimination unit 64 discriminates a target drug. The priority determination unit 65 may update the priority data 83 when the discrimination unit 64 has discriminated a predetermined number of times since the last update of the priority data 83. The priority determination unit 65 may update the priority data 83 at predetermined intervals.

[0189] (Sorting control unit 62) The sorting control unit 62 according to this embodiment performs the following processes in addition to the processes described in the first embodiment.

[0190] When the priority corresponding to the type of target drug discriminated by the discriminator 64 is lower than a predetermined value, the sorting control unit 62 determines to temporarily place the target drug on the waiting tray 15. In detail, the sorting control unit 62 acquires the priority corresponding to the type of target drug discriminated by the discriminator 64 from the priority data 83 in the memory unit 80. When the acquired priority is lower than a predetermined value, the sorting control unit 62 determines to temporarily place the target drug discriminated by the discriminator 64 on the waiting tray 15. The above-mentioned predetermined value may be set to a level that allows the user to sort the number of types of drugs desired when using the drug sorting device 1, for example.

[0191] (Processing example) FIG. 13 is a flowchart showing an example of a medicine sorting process of the sorting control unit 62 of this embodiment.

[0192] 13, when the sorting control unit 62 receives the type of the identified target medicine, it determines whether the priority corresponding to the type of the target medicine is lower than a predetermined value (S41). If the priority is lower than the predetermined value (YES in S41), it decides to temporarily place the target medicine on the waiting tray 15 (S42), and the process ends.

[0193] If the priority is equal to or higher than a predetermined value (NO in S41), the sorting control unit 62 judges whether or not a discrimination result identical to the discrimination result is stored in the storage unit 80 (S43). That is, it judges whether or not the type of the target medicine has already been discriminated. If a discrimination result identical to the discrimination result is stored (YES in S43), the sorting cup 141 linked to the stored discrimination result is determined as the sorting position (S44), and the process ends.

[0194] If the same discrimination result is not stored (NO in S43), the sorting control unit 62 determines the sorting position as a sorting cup 141 that does not contain any medicine (a sorting cup 141 that has not been determined as a sorting position) (S45). Next, the sorting control unit 62 associates the determined type of medicine with the determined sorting position and stores them in the memory unit 80 (S46), and the process ends.

[0195] [Embodiment 7] (overview) In this embodiment, a configuration capable of improving the sorting work will be described with reference to FIG.

[0196] When the identification information shown on a certain drug is changed by a pharmaceutical manufacturer, etc., drugs with the identification information before the change and drugs with the identification information after the change will be mixed in the pharmacy. In particular, when the identification information of a certain drug has been changed, but the drugs distinguished before and after the change are managed with the same YJ code, etc., the drugs with the identification information before and after the change may be managed in a mixed state.

[0197] The print output control unit 69 according to this embodiment performs the following process when a drug whose identification information has been changed has been identified multiple times by the discrimination unit 64. The print output control unit 69 controls the print output unit 4 to print an alert stating "Identification information has been changed" on the medicine packaging paper that packages the medicine, or in a journal that shows the medicine data related to the medicine.

[0198] According to the above configuration, the user can be made aware of the possibility that medicines before and after the identification information change may be mixed and sorted. For example, when filling or reusing medicines in a packaging machine, the user can be alerted to not mix medicines before and after the identification information change.

[0199] (Control unit 60a) The control unit 60a according to this embodiment has the main components described in the first embodiment.

[0200] (Discrimination unit 64) The discrimination section 64 according to this embodiment performs the following process in addition to the process described in the first embodiment. The discrimination section 64 stores the captured image 82 used to discriminate the target drug and the captured image discrimination information 86 in the storage section 80. In detail, the discrimination section 64 discriminates the type of the target drug from the captured image 82, and stores a code (e.g., a YJ code) that specifies the discriminated type of the target drug in the storage section 80 as the captured image discrimination information 86. The captured image discrimination information 86 and the captured image 82 used to discriminate the target drug are associated with each other and stored in the storage section 80.

[0201] The storage unit 80 according to the present embodiment also stores identification information change information 85. The identification information change information 85 indicates a code (e.g., a YJ code) that identifies the type of medicine whose identification information has been changed. The identification information change information 85 may also indicate the date and time when the identification information was changed.

[0202] (Print output control unit 69) The print output control unit 69 refers to the identification information change information 85 and acquires a code that identifies the type of drug whose identification information has been changed. The print output control unit 69 compares the captured image discrimination information 86 with the identification information change information 85 to determine whether or not there are multiple captured images 82 linked to the drug whose identification information has been changed. Note that the print output control unit 69 may be configured to perform the above process only for a predetermined period of time after the change (for example, 30 days after the change) when a change occurs in the identification information of a certain drug.

[0203] When it is determined that there are multiple captured images 82 linked to a drug whose identification information has been changed, the print output control unit 69 performs the following process. The print output control unit 69 controls the print output unit 4 to print an alert stating "Identification information has been changed" on the medicine packaging paper or journal. In the above configuration, the packaging mechanism 6 includes a printing mechanism (not shown) that prints, on the medicine packaging, drug data of the drug packaged in the medicine packaging, and the print output control unit 69 may control printing by the printing mechanism.

[0204] In addition, for a drug whose identification information has been changed, if the discrimination unit 64 discriminates only drugs that show either the identification information before the change or the identification information after the change during a specified period, the print output control unit 69 may discontinue control for printing the alert.

[0205] (Processing example) FIG. 14 is a flowchart showing an example of a print control process of the print output control unit 69 according to the present embodiment.

[0206] 14, the printout control unit 69 refers to the identification information change information 85 and determines whether or not there is a drug whose identification information has been changed (S51). For example, the printout control unit 69 may determine whether or not there is a drug whose identification information has been changed within a predetermined period of time.

[0207] If it is determined that a drug with a changed identification information exists (YES in S51), the print output control unit 69 determines whether or not there are multiple captured images 82 linked to the code that identifies the drug with a changed identification information (S52). If it is determined that there are multiple captured images 82 (YES in S52), the print output control unit 69 controls the print output unit 4 to print an alert stating "IDENTIFICATION INFORMATION CHANGED" (S53), and the process ends.

[0208] If the printout control unit 69 determines that there is no medicine whose identification information has been changed (YES in S51), the process ends. Also, if the printout control unit 69 determines that there are no multiple captured images 82 (NO in S52), the process ends.

[0209] [Embodiment 8] (overview) In this embodiment, a configuration capable of improving the sorting work will be described.

[0210] The medicine sorting device 1 according to this embodiment accepts an operational input for setting a time when no one will be present, such as at night, and restricts processes that require a heat source, processes that emit light, processes that output an alarm sound, and the like.

[0211] For example, when the medicine sorting device 1 is installed in an environment where a security system is activated during unmanned hours such as at night, and is operated at night, the security system may detect light, alarm sounds, heat, and the like generated by the medicine sorting device 1. In this case, the medicine sorting device 1 may stop processing. Alternatively, the medicine sorting device 1 may not be usable at night. The above configuration enables the medicine sorting device 1 to be operated during unmanned hours such as at night when the security system is activated.

[0212] (Operation unit 31) The operation unit 31 of the touch panel 3 accepts user input. In particular, the operation unit 31 according to this embodiment accepts an input operation for setting the time period specified by the user.

[0213] (Notification section 8) The medicine sorting device 1 according to this embodiment includes a notification unit 8 shown in Fig. 1. The notification unit 8 includes, for example, a Patlite (registered trademark) that turns on a light, a speaker that outputs sound, etc. The notification unit 8 notifies the completion, interruption, etc. of each process of the medicine sorting device 1 by turning on the Patlite (registered trademark), outputting sound, etc.

[0214] (Packaging mechanism 6) The packaging mechanism 6 according to this embodiment includes, in addition to the configuration described in the first embodiment, a heater roller (not shown) for sealing the packaging paper.

[0215] (Control unit 60a) The control unit 60a according to this embodiment includes a notification control unit 75 shown in FIG. 1 in addition to the main components described in the first embodiment.

[0216] (Notification control unit 75) The notification control unit 75 receives instructions to notify the completion or interruption of processing from each component included in the control unit 60a. The notification control unit 75 controls the notification unit 8 in response to the received instructions.

[0217] Particularly in this embodiment, the notification control unit 75 accepts a setting input of the time period specified by the user via the operation input unit 66. The notification control unit 75 controls the notification unit 8 so that the notification unit 8 does not issue a notification during the set time period.

[0218] (Packaging control unit 71) The packaging control unit 71 controls the operation of the packaging mechanism 6. Particularly in this embodiment, the packaging control unit 71 accepts a setting input of the time period specified by the user via the operation input unit 66. The packaging control unit 71 controls the packaging mechanism 6 so that the heater roller of the packaging mechanism 6 does not start during the set time period.

[0219] (Processing example) Next, an example of a function restriction process of the medicine sorting device 1 according to this embodiment will be described.

[0220] The notification control unit 75 and the packaging control unit 71 judge whether or not an input operation for setting the above-mentioned time period has been received. If an input operation for setting the time period has been received, the notification control unit 75 and the packaging control unit 71 perform the following processing. The notification control unit 75 controls the notification unit 8 so that the notification unit 8 does not issue a notification during the set time period. In addition, the packaging control unit 71 controls the packaging mechanism 6 so as not to start the heater roller of the packaging mechanism 6 during the set time period. Then, the processing ends. Note that if an input operation for setting the above-mentioned time period has not been received, the processing returns to the processing for determining whether or not the packaging control unit 71 has received an input operation for setting the above-mentioned time period.

[0221] [Embodiment 9] (overview) In this embodiment, a configuration capable of accurately discriminating a target drug will be described with reference to FIG.

[0222] The illumination failure determination unit 76 according to the present embodiment determines whether or not the illuminator 134 is broken when the medicine sorting device 1 is started up or when the determination process has been performed a predetermined number of times. According to the above configuration, since it is possible to detect a failure of the illuminator 134, it is possible to reduce the possibility that the determination process will be performed using the captured image 82 captured in a state in which the illuminator 134 is broken.

[0223] (Control unit 60a) The control unit 60a according to this embodiment includes a lighting failure determination unit 76 in addition to the main components described in the first embodiment.

[0224] (Lighting failure determination unit 76) As shown in FIG. 1, the lighting failure determination unit 76 includes a luminance calculation unit 76a and a luminance comparison unit 76b.

[0225] (Brightness calculation unit 76a) The luminance calculation unit 76a instructs the imaging control unit 63 to capture an image, and calculates the average luminance value in a predetermined area (an imaging area such as the frame of the medicine placement table 133a) in the captured image. The luminance calculation unit 76a outputs the calculated average luminance value to the luminance comparison unit 76b.

[0226] For example, the luminance calculation section 76a may calculate the average value when the number of times the discrimination section 64 has performed the discrimination process for discriminating the type of the target drug reaches a predetermined number of times since the previous malfunction determination.

[0227] The storage unit 80 may store discrimination count information 88. The discrimination count information 88 indicates the cumulative number of discrimination processes performed by the discrimination unit 64. The discrimination unit 64 updates the cumulative number indicated by the discrimination count information 88 every time the discrimination process for one captured image 82 is completed. The brightness calculation unit 76a refers to the discrimination count information 88 and determines whether the number of discrimination processes performed by the discrimination unit 64 has reached a predetermined number since the previous failure determination. For example, the brightness calculation unit 76a determines whether the number of discrimination processes performed by the discrimination unit 64 has reached 100 since the previous failure determination. The above-mentioned predetermined number may be set to a number less than the number of times at which a failure is likely to occur, for example, through experiments or the like.

[0228] Furthermore, the brightness calculation unit 76a may instruct the imaging control unit 63 to capture an image when the medicine sorting device 1 is started up, and calculate an average value of the brightness of the captured image.

[0229] (Brightness comparison unit 76b) The luminance comparison unit 76b judges whether the average luminance value of the captured image calculated by the luminance calculation unit 76a is within a predetermined range with respect to a reference value. For example, the luminance comparison unit 76b judges whether the average luminance value of the captured image calculated by the luminance calculation unit 76a is a value between 80% and 120% of the reference value. The above-mentioned predetermined range may be appropriately set, for example, by experiments or the like.

[0230] The reference value is, for example, an average value of luminance in a predetermined area (an image capturing area such as the frame of the medicine placing table 133a) of an image captured at a time when no failure occurs in the illuminator 134. The reference value may be acquired when the medicine sorting device 1 is started up (for example, during teaching).

[0231] The luminance may be, for example, a V value of an HSV (H: hue, S: saturation, V: brightness) value that can be converted from the RGB values ​​of each pixel included in the predetermined region in the captured image.

[0232] Furthermore, the captured image used for failure determination of the ultraviolet light irradiation unit 134c may be, for example, an image captured with the maximum exposure time allowed for the ultraviolet light irradiation unit 134c. For example, if the exposure time during normal imaging is 8 to 10 msec, the maximum time may be set to, for example, 1 sec. The maximum time may be appropriately set, for example, through experiments or the like.

[0233] The luminance comparison unit 76b determines whether or not the illuminator 134 is malfunctioning based on the above-mentioned determination result. The display control unit 67 causes the display unit 32 to display the malfunction determination result.

[0234] (Processing example) Fig. 15 is a flowchart showing an example of a malfunction determination process of the medicine sorting device 1 according to this embodiment. As shown in Fig. 15, the luminance calculation unit 76a determines whether the number of determination processes performed by the determination unit 64 has reached a predetermined number since the previous malfunction determination (S71).

[0235] When the brightness calculation unit 76a determines that the number of discrimination processes has reached a predetermined number since the previous failure determination (YES in S71), the imaging control unit 63 controls the first camera 131 to capture an image (S72). Next, the brightness calculation unit 76a calculates the average brightness of the captured image captured in S72 (S73). Next, the brightness comparison unit 76b determines whether the average brightness of the captured image calculated by the brightness calculation unit 76a is within a predetermined range with respect to a reference value (S74). When the brightness comparison unit 76b determines that the average value is not within the predetermined range (NO in S74), the brightness comparison unit 76b determines that the illuminator 134 is malfunctioning (S75). Next, the display unit 32 displays the determination result (S76), and the process ends.

[0236] If the luminance calculation unit 76a determines that the number of discrimination processes has not reached a predetermined number since the previous failure determination (NO in S71), the process returns to S71. If the luminance comparison unit 76b determines that the average value is within a predetermined range (YES in S74), the luminance comparison unit 76b determines that the illuminator 134 is normal (S77), and the process continues to S76.

[0237] [Embodiment 10] (overview) In this embodiment, a configuration for reducing the data volume of an image for creating an image used to distinguish the type of medicine will be described mainly with reference to Figs.

[0238] The image processing unit 73 provided in the drug sorting device 1 of this embodiment generates a cut-out image by cutting out a first region, which is the region of the image of the target drug, or a second region, which is the region of the image of the drug placing table 133a on which the target drug including the first region is placed, from a captured image including the image of the target drug, in order to generate an image of a reference drug for determining the type of the target drug.

[0239] For example, according to the above configuration, the amount of image data required to generate an image of the reference drug can be reduced. When the medicine sorting device 1 transmits a captured image to an external device, the medicine sorting device 1 transmits a cut-out image to the external device as the captured image, thereby reducing the amount of data to be transmitted compared to a configuration in which a cut-out image is not generated. This makes it easier to transfer data from the medicine sorting device 1 to the external device.

[0240] In addition, the transfer time of the captured image data can be reduced. Therefore, the captured image data can be transferred using a VPN line or the like. Even when the data is transferred to a HDD, the cost of the HDD can be reduced by reducing the data capacity. Therefore, the data transfer cost can be reduced. In addition, the running cost of the medicine sorting device 1 can be reduced.

[0241] (Image generation system 1000) The image generation system 1000 according to this embodiment will be described with reference to Fig. 16. Fig. 16 is a diagram showing an example of the image generation system 1000.

[0242] As shown in FIG. 16, the image generating system 1000 includes a medicine sorting apparatus 1 and an information processing device 200 that can be communicatively connected to the medicine sorting apparatus 1. The information processing device 200 generates an image of a reference medicine for identifying the type of a target medicine. More specifically, the information processing device 200 generates a reference image based on a cut-out image generated by the medicine sorting apparatus 1. The reference image is an image for identifying the type of a target medicine to be identified, and is an image (master image) that is registered in advance in a medicine database 81. The medicine sorting apparatus 1 and the information processing device 200 transmit and receive data via an Internet line or a dedicated VPN (Virtual Private Network) line. Note that the image generating system 1000 may include a plurality of medicine sorting apparatuses 1, and each of the medicine sorting apparatuses 1 may be communicatively connected to the information processing device 200.

[0243] Furthermore, data transmission and reception between the medicine sorting apparatus 1 and the information processing device 200 does not have to be performed using the above-mentioned line. For example, data transmission and reception with the information processing device 200 may be performed using a communication device (e.g., a PC (Personal Computer)) different from the medicine sorting apparatus 1. Furthermore, data to be transmitted to the information processing device 200 may be stored in a storage medium (e.g., a HDD (Hard Disk Drive) or a DVD (Digital Versatile Disc)), and the data may be input to the information processing device 200. When a communication device or a storage medium is used, the medicine sorting apparatus 1 does not have to include the transmitting / receiving unit 100. Similarly, the information processing device 200 does not have to include the transmitting / receiving unit 201.

[0244] (Drug sorting device 1) 16, the medicine sorting device 1 includes an imaging unit 13, a touch panel 3, and a computer 60. The computer 60 also includes a control unit 60b, a storage unit 80b, and a transmitting / receiving unit 100 that transmits and receives data to and from the information processing device 200.

[0245] 16 shows only the configuration of the medicine assorting device 1 related to the cut-out process and the transmission process to the information processing device 200 according to this embodiment. The medicine assorting device 1 according to this embodiment may include all the configurations of the medicine assorting device 1 shown in FIG.

[0246] (Operation unit 31) The operation unit 31 of the touch panel 3 accepts an input operation by a user. In particular, the operation unit 31 according to this embodiment accepts an input operation by a user for transmitting a cropped image 821, a region information file 822, and a compressed image 823 to the information processing device 200.

[0247] (Control unit 60b) The control unit 60b according to this embodiment includes a transmission control unit 77b in addition to the main components of the control unit 60a described in the first embodiment.

[0248] (Imaging control unit 63) The imaging control unit 63 causes the first camera 131 to capture an image of the medicine placed on the medicine placement table 133a. The imaging control unit 63 acquires the captured image from the first camera 131 and transmits the image to the image processing unit 73.

[0249] (Operation input unit 66) The operation input unit 66 accepts an input by the user on the operation unit 31. In this embodiment, in particular, the operation input unit 66 accepts an operation for transmitting the cut-out image 821, the region information file 822, and the compressed image 823 to the information processing device 200. When the operation is accepted, the operation input unit 66 transmits a signal indicating that the operation has been accepted to the transmission control unit 77b.

[0250] (Image processing unit 73) The image processing unit 73 receives the captured image from the imaging control unit 63. The image processing unit 73 generates a cut-out image 821, a region information file 822, and a compressed image 823 from the received captured image. The cut-out image 821 may be a cut-out image obtained by cutting out a region (first region) of the image of the target drug from a captured image including the image of the target drug. The cut-out image 821 may also be a region (second region) of the image of the drug placement table 133a on which the target drug is placed, including the image of the target drug. The region information file 822 is region information indicating a region (position and size of the image of the drug in the captured image) cut out in the captured image. The compressed image 823 is an image obtained by compressing the captured image. The image processing unit 73 stores the generated cut-out image, region information file 822, and compressed image 823 in the storage unit 80b.

[0251] (Transmission control unit 77b) The transmission control unit 77b transmits the cut-out image 821, the area information file 822, and the compressed image 823 stored in the storage unit 80b to the information processing device 200 via the transmitting / receiving unit 100 in accordance with the received user operation input.

[0252] (Storage unit 80b) The storage unit 80b according to this embodiment stores a cut-out image 821, a region information file 822, and a compressed image 823 in addition to the data stored in the storage unit 80 described in the first embodiment.

[0253] (Information processing device 200) The information processing device 200 can be communicatively connected to the medicine sorting device 1, and generates an image of a reference medicine. As shown in Fig. 16, the information processing device 200 includes a transmitting / receiving unit 201, a control unit 202, a storage unit 203, and a touch panel 204. The touch panel 204 includes an operation unit 241 and a display unit 242.

[0254] (Transmitter / receiver 201) The transmitting / receiving unit 201 transmits and receives data to and from the medicine sorting device 1. In this embodiment, in particular, the transmitting / receiving unit 201 receives a cut-out image 821, a region information file 822, and a compressed image 823 from the transmitting / receiving unit 100 of the medicine sorting device 1.

[0255] (Control unit 202) The control unit 202 controls the information processing device 200 in an integrated manner. The control unit 202 mainly includes an acquisition unit (reception unit) 221 and an image generation unit 222. The acquisition unit 221 acquires the cut-out image 821, the region information file 822, and the compressed image 823 from the transmission / reception unit 201, and stores them in the storage unit 203. The storage unit 203 stores the cut-out image 821, the region information file 822, and the compressed image 823. The image generation unit 222 generates a reference image by superimposing the cut-out image 821 on the compressed image 823 based on the region information file 822. For example, the image generation unit 222 may resize the reduced compressed image 823 to the original size, and then superimpose the cut-out image 821 on the position of the image of the medicine in the captured image indicated by the region information file 822 to generate a reference image. For example, the image generating unit 222 may generate a reference image in response to an operation input by a user via the operation unit 241 of the touch panel 204 .

[0256] According to the above configuration, the medicine sorting device 1 transfers the compressed image 823, the cut-out image 821, and the region information file 822 to the information processing device 200, which is an external device, thereby reducing the amount of data transferred from the medicine sorting device 1 to the information processing device 200. Even if the amount of data transferred from the medicine sorting device 1 to the information processing device 200 is reduced, the information processing device 200 can generate a reference image in which the resolution of the medicine image is at least equivalent to the resolution of the captured image.

[0257] (Processing example) Fig. 17 is a flowchart showing an example of the cut-out process of the image processing unit 73 of this embodiment. As shown in Fig. 17, the imaging control unit 63 acquires a captured image from the first camera 131 (S101).

[0258] Next, the image processing unit 73 specifies the cutout region in the received captured image (S102). For example, the image processing unit 73 converts the captured image into a binarized (white, black) image. The image processing unit 73 may specify a white region in the binarized image as the cutout region. The image processing unit 73 may also specify the cutout region by using pattern matching between the shape of the white region in the binarized image and a predetermined shape. The predetermined shape may be, for example, the shape of the image of the medicine placing table 133a in the image obtained by capturing the medicine placing table 133a. For example, when generating a cutout image using the shape of the image of the medicine placing table 133a in the image obtained by capturing the medicine placing table 133a, the image processing unit 73 may generate the cutout image from each of the following two captured images. One is a captured image in which the front surface of the tablet is captured, and the other is a captured image in which the back surface of the tablet is captured. Here, the front surface refers to one side of the tablet on which the identification information is displayed, and the back surface refers to the other side of the tablet that is different from the one side on which the identification information is displayed.

[0259] Next, the image processing unit 73 generates a cut-out image 821 by cutting out the region specified in S102 from the captured image D100 (S103). The image processing unit 73 also generates a region information file 822 (S104). Next, a compressed image 823 is generated (S105). Fig. 18 is a diagram showing an example of the captured image D100, cut-out image D101, region information file D102, and compressed image D103 of the target drug.

[0260] For example, the cut-out image D101 may be generated as PNG format data. Also, as shown in Fig. 18, the region information file D102 indicates the position of the cut-out image D101 in the captured image D100. Also, the compressed image D103 may be generated as JPEG format data obtained by compressing the captured image D100. For example, an example of the compressed image D103 is JPEG format image data obtained by resizing the captured image D100 to 1 / 4 size. That is, the amount of data can be compressed by resizing the captured image D100 to 1 / 4 size.

[0261] Next, the image processing unit 73 stores the cut-out image 821, the region information file 822, and the compressed image 823 in the storage unit 80b (S106), and the process ends.

[0262] Thereafter, the medicine sorting device 1 transmits the cut-out image 821, the region information file 822, and the compressed image 823 to the information processing device 200. As a result, the information processing device 200 can restore the captured image D100 based on, for example, the cut-out image D101, the region information file D102, and the compressed image D103.

[0263] In addition, a plurality of captured images may be used to distinguish the type of one target drug. For example, when the target drug is a tablet, the determination may be performed using 10 captured images, and when the target drug is a capsule, the determination may be performed using a maximum of 10 captured images in addition to the 10 captured images. For example, the image processing unit 73 may determine whether the target drug captured in the received captured image is a tablet or a capsule. In addition, the image processing unit 73 may perform the determination using pattern matching between the image of the target drug captured in the received captured image and a predetermined shape. When the image processing unit 73 determines that the target drug is a tablet, it may be configured not to process the captured images other than the first 10 captured images among the received captured images, and not to store the captured images in the storage unit 80b. This is because when the target drug is a tablet, the type can be distinguished using 10 captured images. On the other hand, when the target drug is a capsule, the type may not be distinguished using 10 captured images. Therefore, when the target drug is a capsule, the image processing unit 73 may store, in the storage unit 80b, more than 10 captured images that have been acquired up until the time when it has been determined that the target drug is a capsule.

[0264] (Modification) A modification of this embodiment will be described with reference to Fig. 19. For ease of explanation, the same reference numerals are given to members having the same functions as those described in the above embodiment, and the description thereof will not be repeated.

[0265] The image processing unit 73 in this modified example generates serialized data including the cut-out image, the cut-out area image, the area information file, information indicating the color of the target drug, information indicating the shape of the target drug, etc., and consolidates them into one file. The image processing unit 73 stores the file in a specified backup disk. For example, serialized data is data in which specific data is arranged in a regular pattern. In this modified example, an image cut out from the range of the image of the target drug in the captured image is called a cut-out image. Here, the "range of the image of the target drug" is the same as the "area of ​​the image of the target drug (first area)" in the above-mentioned embodiment 10. For ease of explanation, in this modified example, it is called the "range of the image of the target drug".

[0266] In this modification, an image obtained by cutting out the image of the medicine placing table 133a including the image of the target medicine in the captured image is called a cut-out area image. In addition, the "range of the image of the medicine placing table 133a on which the target medicine including the image of the target medicine is placed" in this modification is the same as the "area (second area) of the image of the medicine placing table 133a on which the target medicine including the image of the target medicine is placed" in the above-mentioned embodiment 10. For convenience of explanation, in this modification, it is called "range of the image of the medicine placing table 133a on which the target medicine including the image of the target medicine is placed". In addition, in this modification, a cut-out image of a predetermined range centered on the image of the target medicine in the captured image is also called a cut-out area image.

[0267] Moreover, the information processing device 200 according to this modification deserializes (restores serialization) serialized data and returns the serialized data to the file format before serialization. The serialized data includes, for a discrimination process of one target drug type, the number of discrimination processes, data indicating the drug color and shape, a cut-out image generated from a captured image, and cut-out and aggregated data.

[0268] For example, the information processing device 200 creates a black background of the same size as the captured image from which the cutout has been performed. The information processing device 200 generates a reference image by pasting the cutout image into the area of ​​the black background that corresponds to the area from which the cutout has been performed in the captured image based on the region information file.

[0269] (Generating image set classes and lightweight classes) The image processing unit 73 according to this modification generates an image set class for each discrimination process of one type of target drug. The image processing unit 73 prepares in advance, as an image set class, a data storage area capable of storing the maximum number of cut-out images and cut-out region images that can be generated in one discrimination process. In this embodiment, the image set class can store cut-out images and cut-out region images generated from a maximum of 20 captured images.

[0270] For example, if the matching unit 64b is able to determine the type from a predetermined number of captured images (e.g., 10 images) in one discrimination process, the image processing unit 73 compiles the cut-out images and cut-out area images generated from the predetermined number of captured images (e.g., 10 images) and stores them in an image set class prepared in advance for the discrimination process.

[0271] If the collation unit 64b is unable to determine the type from a predetermined number of captured images (for example, 10), the imaging control unit 63 controls the first camera 131 to acquire further captured images. The imaging control unit 63 acquires captured images until the collation unit 64b is able to determine the type from the acquired captured images. The image processing unit 73 also stores in the image set class the cut-out images and cut-out area images generated from the captured images acquired in excess of the predetermined number.

[0272] For example, when the collation unit 64b completes discrimination of one target drug, the image processing unit 73 adds an image set class corresponding to each discrimination process to an image set class list of the light weight class. The drug sorting device 1 transmits the image set class list of the light weight class to the information processing device 200, whereby the information processing device 200 can generate a reference image by deserializing the data included in the image set class for each target image.

[0273] The discrimination unit 64 may be configured to perform image analysis on the captured image 82 again to try to discriminate the type of drug (perform discrimination retry processing) if the type of drug cannot be discriminated by one discrimination process. When discrimination retry processing occurs, the image processing unit 73 according to this modification generates an image set class corresponding to the discrimination retry processing.

[0274] (Example of cutout process) Next, an example of the cut-out process from the captured image by the image processing unit 73 according to this modification will be described with reference to Fig. 19. Fig. 19 is a diagram showing an example of the cut-out process from the captured image performed by the image processing unit 73.

[0275] First, two patterns of captured images will be described. The captured images have two patterns, a horizontal image (N image) and a vertical image (V image) according to the inclination of the medicine mounting table 133a when the captured image is captured. N in FIG. 19 is a diagram showing the inclination of the medicine mounting table 133a when the captured image is captured as an N image. As shown in N in FIG. 19, when the captured image is captured as an N image, the N image is captured in a state where one of the inclined surface portions 133ab of the medicine mounting table 133a is horizontal.

[0276] V in Fig. 19 is a diagram showing the inclination of the medicine mounting stand 133a when the captured image is captured as a vertical image (V image). As shown in V in Fig. 19, when the captured image is captured as a V image, the V image is captured with the surface of the bottom surface part 133aa of the medicine mounting stand 133a being horizontal.

[0277] The image processing unit 73 performs a process of cutting out the captured image in accordance with the pattern of the captured image (V image, N image), the type of illumination used when the captured image was captured, and the like.

[0278] An example of the cutout process by the image processing unit 73 for a captured image (bar illumination N image) captured using the first irradiator 134a (bar illumination) during shooting will be described with reference to a captured image D104 in Fig. 19. The captured image D104 in Fig. 19 is a bar illumination N image. In the captured image D104 in Fig. 19, a range J104 of the image of the target drug, which is the range in which cutting is performed, and a range R104 of the image of the drug placement table 133a including the image of the target drug are shown.

[0279] The image processing unit 73 performs binarization processing on the captured image. The image processing unit 73 detects the white range of the binarized captured image as the range to be cut out. As shown in the captured image D104 of FIG. 19, for example, the cut-out range detected by the image processing unit 73 is the range J104 of the image of the target drug and the range R104 of the image of the drug placement table 133a including the image of the target drug. For example, the image processing unit 73 may use a captured image binarized using different threshold values ​​for detecting the range of the image of the target drug and the range of the image of the drug placement table 133a including the image of the target drug. The image processing unit 73 cuts out the range of the image of the target drug in the captured image to generate a cut-out image. In addition, the image processing unit 73 cuts out the range of the image of the drug placement table 133a including the image of the target drug to generate a cut-out area image.

[0280] (2) An example of the cut-out process by the image processing unit 73 for a captured image (bar illumination V image) captured using the first illuminating unit 134a (bar illumination) during shooting, which is a V image, will be described using a captured image D105 in Figure 19.

[0281] The captured image D105 in Fig. 19 is an image of a bar illumination V. In the captured image D105 in Fig. 19, a range J105 of the image of the target drug, which is the range to be cut out, and a predetermined range R105 centered on the image of the target drug are shown.

[0282] As shown in the captured image D105 of FIG. 19, for example, the image processing unit 73 detects the range J105 of the image of the target drug by pattern matching. The above-mentioned predetermined shape may be, for example, the shape of the image of the drug in the image captured by placing the drug on the drug placement table 133a. Next, the image processing unit 73 determines a range R105 that is a predetermined range centered on the range J105 of the image of the target drug. For example, the range R105 is a range obtained by enlarging the range J105 of the image of the target drug by a predetermined magnification factor, centered on the range J105 of the image of the target drug. The above-mentioned predetermined magnification factor may be determined, for example, from the degree of reduction in the volume of the image data, or the result of verifying the quality of the restored image, etc.

[0283] The image processor 73 cuts out the range of the image of the target drug from the captured image to generate a cut-out image. The image processor 73 also cuts out a predetermined range centered on the image of the target drug to generate a cut-out region image.

[0284] (3) An example of the cut-out process by the image processing unit 73 for a captured image (ring illumination N image) captured using the second illuminating unit 134b (ring illumination) during shooting will be described using a captured image D106 in FIG. 19.

[0285] The image processing unit 73 refers to the range of the image of the target drug detected in the bar illumination N image (the relative position of the range of the image of the target drug with respect to the captured image) and specifies the position of the range of the image of the target drug in the ring illumination N image. In detail, the image processing unit 73 specifies the position of the range of the image of the target drug in the ring illumination N image so that the relative position of the range of the image of the target drug with respect to the ring illumination N image is the same as the relative position of the range of the image of the target drug in the bar illumination N image.

[0286] A captured image D106 in Fig. 19 is an image with ring illumination N. In the captured image D106 in Fig. 19, a range J106 of the image of the target drug, which is the range in which extraction is performed, is shown.

[0287] For example, in the example shown in FIG. 19, the image processing unit 73 refers to the relative position of the range J104 of the image of the target drug with respect to the captured image D104, which is the bar illumination N image, and identifies the position of the range J106 of the image of the target drug in the captured image D106.

[0288] (4) An example of the cutout process by the image processing unit 73 for a captured image (ring illumination V image) captured using the second illuminating unit 134b (ring illumination) during shooting, which is a V image, will be described.

[0289] The image processing unit 73 refers to the range of the image of the target drug detected in the bar illumination V image (the relative position of the range of the image of the target drug in the captured image) and specifies the position of the range of the image of the target drug in the ring illumination V image. In detail, the image processing unit 73 specifies the position of the range of the image of the target drug in the ring illumination V image so that the relative position of the range of the image of the target drug in the ring illumination V image is the same as the relative position of the range of the image of the target drug in the bar illumination V image.

[0290] For example, in the example shown in Figure 19, the image processing unit 73 refers to the relative position of the range J105 of the image of the target drug with respect to the captured image D105, which is the bar illumination V image, and identifies the position of the range J105 of the image of the target drug in the ring illumination V image (not shown).

[0291] An example of the cutout process by the image processing unit 73 for a captured image (UV illumination N image) that is a (5)N image and is captured using the ultraviolet light irradiating unit 134c (UV illumination) during shooting will be described.

[0292] The image processing unit 73 refers to the range of the image of the target drug detected in the bar illumination N image (the relative position of the range of the image of the target drug with respect to the captured image) and specifies the position of the range of the image of the target drug in the UV illumination N image. In detail, the image processing unit 73 specifies the position of the range of the image of the target drug in the UV illumination N image so that the relative position of the range of the image of the target drug in the UV illumination N image is the same as the relative position of the range of the image of the target drug in the bar illumination N image.

[0293] For example, in the example shown in Figure 19, the image processing unit 73 refers to the relative position of the range J104 of the image of the target drug with respect to the captured image D104, which is the bar illumination N image, and identifies the position of the range of the image of the target drug in the UV illumination N image (not shown).

[0294] It should be noted that the image processing unit 73 does not need to generate a cutout region image for an image captured using ring illumination or UV illumination during shooting.

[0295] The above-mentioned processes (1) to (5) may be performed on the predetermined number of captured images. That is, the above-mentioned predetermined number of captured images are a bar illumination N image, a bar illumination V image, a ring illumination N image, a ring illumination V image, and a UV illumination N image. The above-mentioned bar illumination N image, bar illumination V image, ring illumination N image, ring illumination V image, and UV illumination N image may be captured images by arranging an imaging mechanism so that the angle θ between the axis Ax0 and the axis Ax1 shown in FIG. 4 is 0° and 180°. In this case, the above-mentioned predetermined number of captured images is a total of 10 captured images including the bar illumination N image, bar illumination V image, ring illumination N image, ring illumination V image, and UV illumination N image captured by arranging an imaging mechanism so that θ is 0° and 180°. On the other hand, the captured images acquired in excess of the predetermined number are bar illumination V images captured while changing the imaging angle. Therefore, the above-mentioned process (2) is performed on the images.

[0296] When comparing the data capacity of a captured image without the above-mentioned processing with the data capacity of serialized data after the above-mentioned processing, the data capacity of the serialized data relative to the data capacity of a captured image without the cut-out processing was as follows. For 39 imprinted tablets, the data volume of the captured images without cutting out was 23.2%. For the 39 printed tablets, the data volume was 21.5% of the captured image data without cutting out. For a capsule of 20 tablets, the data volume is 34.5% of the data volume of an image captured without cutting out. Furthermore, it was confirmed that when the serialized data is compressed using zip compression, the data volume is approximately 10% of the data volume of an image captured without cutting out.

[0297] This modified example can be expressed as follows.

[0298] In order to generate an image of a reference drug for determining the type of the target drug, the image processing unit 73 of the drug sorting device 1 in this modified example generates at least one cut-out image by cutting out the range of the image of the target drug (first region) and the range of the image of the drug placing table 133a on which the target drug is placed, including the image of the target drug, from a captured image including the image of the target drug.

[0299] The image processing section 73 generates at least one of a region information file indicating a first region in a captured image and a region information file indicating a second region.

[0300] The information processing device 200 according to this modification can be communicably connected to the medicine sorting device 1, and generates an image of a reference medicine. An acquisition unit 221 of the information processing device 200 receives a cut-out image and a region information file corresponding to the cut-out image from the medicine sorting device 1. An image generation unit (generation unit) 222 generates a reference image based on the region information file.

[0301] The image generating system 1000 of this modified example includes a medicine sorting apparatus 1 and an information processing apparatus 200.

[0302] [Embodiment 11] (overview) In this embodiment, a configuration for reducing the replacement cost of the sorting cup 141 will be described mainly with reference to FIGS.

[0303] The medicine sorting device 1 according to this embodiment generates a shape model 800 showing the shape of a scratch in the sorting cup 141, and stores the generated shape model 800. When detecting medicines from a captured image of the sorting cup 141 for remaining medicine confirmation or the like, the medicine sorting device 1 uses the shape model 800 so as not to detect the scratch in the sorting cup 141 as medicine. According to the above configuration, the sorting cup 141 with a scratch can be continued to be used. Therefore, the replacement cost of the sorting cup 141 can be reduced.

[0304] (Drug sorting device 1) The medicine sorting device 1 according to this embodiment will be described with reference to Fig. 20. Fig. 20 is a block diagram showing an example of a portion of the configuration of the medicine sorting device 1 according to this embodiment. Note that Fig. 20 shows only the configuration of the medicine sorting device 1 related to this embodiment that is related to the shape model generation process of the sorting cup 141 and the medicine detection process in the sorting cup 141. The medicine sorting device 1 according to this embodiment may include all of the configuration provided in the medicine sorting device 1 shown in Fig. 1.

[0305] (Operation unit 31) The operation unit 31 of the touch panel 3 accepts input operations by a user. In particular, the operation unit 31 according to this embodiment accepts a user input instructing generation of a shape model 800 of the sorting cup 141. The operation unit 31 also accepts a user input instructing confirmation of remaining medicine in the sorting cup 141. Confirmation of remaining medicine refers to the medicine sorting device 1 determining whether or not medicine is contained in the sorting cup 141 based on a captured image of the sorting cup 141.

[0306] (Control unit 60c) The control unit 60c according to this embodiment includes, in addition to the main components of the control unit 60a described in the first embodiment, a shape model generating unit 791c, a medicine detecting unit 792c, and a matching determining unit 793c.

[0307] (Imaging control unit 63) The imaging control unit 63 causes the second camera 121 to capture an image of the inside of the sorting cup 141 in accordance with an instruction received from the operation input unit 66. The imaging control unit 63 acquires the captured image from the second camera 121. When the operation input unit 66 accepts a user input instructing generation of a shape model 800 of the sorting cup 141, the imaging control unit 63 transmits the acquired captured image to the shape model generation unit 791c. When the operation input unit 66 accepts a user input instructing confirmation of remaining medicine in the sorting cup 141, the imaging control unit 63 transmits the acquired captured image to the medicine detection unit 792c.

[0308] (Operation input unit 66) The operation input unit 66 accepts input by the user on the operation unit 31. In this embodiment, in particular, the operation input unit 66 accepts a user input instructing the generation of a shape model 800 of the sorting cup 141 and a user input instructing the confirmation of remaining medicine in the sorting cup 141.

[0309] Upon receiving a user input instructing the generation of a shape model 800 of the sorting cup 141 and a user input instructing the confirmation of remaining medicine in the sorting cup 141, the operation input unit 66 instructs the imaging control unit 63 to capture an image of the sorting cup 141 by the second camera. Note that the user input instructing the generation of the shape model 800 of the sorting cup 141 may include an input specifying the sorting cup 141.

[0310] (Display control unit 67) The display control unit 67 receives a signal indicating the detection result of the medicine image from the medicine detection unit 792c. The display control unit 67 displays a remaining medicine confirmation image on the display unit 32. For example, the remaining medicine confirmation image may display an image of each sorting cup 141 and also display "remaining medicine", "no remaining medicine", or the like for that sorting cup 141.

[0311] (Shape model generating unit 791c) The shape model generating unit 791c receives the captured image from the imaging control unit 63. The shape model generating unit 791c generates a shape model 800 of the sorting cup 141 from the captured image. The process of generating the shape model 800 will be described in detail later. The shape model generating unit 791c associates the shape model 800 with the UID (unique identification) of the RFID tag of the corresponding sorting cup 141 and stores it in the storage unit 80c. The shape model 800 may include area information indicating the area of ​​the scratch in the sorting cup 141 in addition to the shape model indicating the shape of the scratch.

[0312] (Drug detection unit 792c) The medicine detection unit 792c receives the captured image from the imaging control unit 63. The medicine detection unit 792c detects the image of the medicine from the captured image. When the medicine detection unit 792c detects the image of the medicine from the captured image, it transmits the captured image to the matching determination unit 793c.

[0313] For example, the drug detection unit 792c converts the captured image into a binarized image. The drug detection unit 792 may identify a white area in the binarized image as an image of the drug. The drug detection unit 792c may also identify the image of the drug by using pattern matching between the shape of the white area in the binarized image and a predetermined shape. The above-mentioned predetermined shape may be, for example, the shape of the image of the drug in an image captured in advance.

[0314] Moreover, the medicine detection unit 792c receives a signal indicating a matching region from the matching determination unit 793c. The matching region will be described in detail later. The medicine detection unit 792c detects the image of the medicine by excluding the matching region indicated by the signal from the region to be detected. When the medicine detection unit 792c detects the image of the medicine, it transmits a signal indicating that there is a remaining medicine in the corresponding sorting cup 141 to the display control unit 67. When the medicine detection unit 792c receives a signal indicating that the matching region has not been detected from the matching determination unit 793c, it transmits a signal indicating that there is a remaining medicine in the corresponding sorting cup 141 to the display control unit 67. When the medicine detection unit 792c does not detect the image of the medicine from the captured image excluding the matching region or the captured image received from the image capture control unit 63, it transmits a signal indicating that there is no remaining medicine in the corresponding sorting cup 141 to the display control unit 67.

[0315] (Matching determination unit 793c) The matching determination unit 793c receives the captured image from the drug detection unit 792c. The matching determination unit 793c matches the shape model 800 in the storage unit 80c with the image detected as the image of the drug in the captured image, and calculates a matching score. The matching determination unit 793c determines whether the matching score is greater than a predetermined value. If the matching score is greater than a predetermined value, the matching determination unit 793c specifies the area of ​​the image detected as the image of the drug as a matching area. The matching determination unit 793c transmits a signal indicating the matching area to the drug detection unit 792c. If the matching score is equal to or less than the predetermined value, the matching determination unit 793c transmits a signal indicating that the matching area was not detected to the drug detection unit 792c.

[0316] As described above, the matching region is a region where the matching score is greater than a predetermined value. In other words, the matching region is a region of the captured image in which an image of a shape similar to the shape of the flaw shown in the shape model 800 is captured. Furthermore, a value greater than the above-mentioned predetermined value (threshold value) is a value that can be considered to indicate a high similarity between the shape of the flaw shown in the shape model 800 and the image of the captured image. A specific example of the above-mentioned predetermined value is 0.75 (75 points). For example, the matching score is a value when a perfect match is 1 (100 points) and dissimilarity is 0 (0 points).

[0317] (Example of generation process of shape model 800) Fig. 21 is a flowchart showing an example of a shape model generation process of the sorting cup 141 by the medicine sorting device 1 of this embodiment. As shown in Fig. 21, the operation input unit 66 receives an instruction to generate a shape model 800 of the sorting cup 141 (S201). For example, when checking the remaining medicine after medicines are removed from the sorting cup 141, if the user determines that the sorting cup 141 has a scratch, the user inputs an instruction to generate the shape model 800 of the sorting cup 141 from the operation unit 31.

[0318] Next, the imaging control unit 63 acquires a captured image of the inside of the sorting cup 141 from the second camera 121 (S202). Next, the shape model generating unit 791c generates a shape model 800 of the sorting cup 141 from the captured image (S203). FIG. 22 is a diagram showing an example of the captured image of the sorting cup 141 and the shape model 800 of the sorting cup 141. The captured image D200 shown in FIG. 22 is an example of a captured image of the inside of the sorting cup 141 captured by the second camera 121. The captured image D200 shows an area R20, and one scratch exists in the area R20. The image D201 shown in FIG. 22 is an enlarged image of the area R20. The shape model 800E1 shown in FIG. 22 shows the shape model 800 corresponding to the scratch detected in the image D201.

[0319] For example, the shape model 800E1 is the shape of a scratch on the sorting cup 141 extracted from the image D201. The shape model 800 may show only a part of the shape of the scratch on the sorting cup 141. The image D202 shown in FIG. 22 is an example of an enlarged image of a captured image of the inside of another sorting cup 141. There are multiple scratches on the sorting cup 141 captured in the image D202. When multiple scratches are detected from the captured image of the sorting cup 141, the shape model generation unit 791c may generate a shape model 800 corresponding to each of the detected scratches. The shape models 800E2 to 800E4 shown in FIG. 22 show the shape models 800 corresponding to each of the multiple scratches detected in the image D202.

[0320] Next, the geometric model generating unit 791c stores the generated geometric model 800 in the storage unit 80c (S204).

[0321] (Example of drug detection process for checking remaining medication) Fig. 23 is a flowchart showing an example of a medicine detection process for checking remaining medicine by the medicine sorting device 1 of this embodiment. As shown in Fig. 23, the operation input unit 66 receives an instruction to check remaining medicine in the sorting cup 141 (S301). Next, the imaging control unit 63 obtains a captured image of the inside of the sorting cup 141 from the second camera 121 (S302).

[0322] Next, the medicine detection unit 792c detects the image of the medicine from the captured image (S303). If the medicine detection unit 792c detects the image of the medicine from the captured image (YES in S303), the matching determination unit 793c matches the shape model 800 stored in the storage unit 80c with the image detected as the medicine in the captured image (S304). Next, the matching determination unit 793c determines whether the matching score is greater than a predetermined value (S305).

[0323] FIG. 24 is a diagram showing an example of a captured image of the sorting cup 141, an extracted image in which an image of the inside of the sorting cup 141 is extracted, a shape model 800, and an image of a matching region in the extracted image. The captured image D203 shown in FIG. 24 is an example of a captured image of the sorting cup 141. The matching determination unit 793c may generate an extracted image in which an image of the inside of the sorting cup 141 is extracted from the captured image of the sorting cup 141. The extracted image D204 shown in FIG. 24 is an extracted image in which an image of the inside of the sorting cup 141 is extracted from the captured image D203. The matching determination unit 793c may perform matching using the extracted image as the captured image. The shape model 800F1 shown in FIG. 24 is an example of a shape model of a scratch in the sorting cup 141. In addition, the image D205 shown in FIG. 24 is an example of an image of a matching region corresponding to the shape model 800F1 in the extracted image D204. As shown in Fig. 24, the matching determination unit 793c searches for an image pattern similar to the shape model 800F1 from the extracted image D204, and calculates a matching score indicating how similar the searched image pattern is to the shape model 800F1. Fig. 24 shows an example in which the matching score is calculated to be 0.93 by the matching determination unit 793c.

[0324] If the matching determination unit 793c determines that the matching score is greater than a predetermined value (threshold) (YES in S305), the medicine detection unit 792c excludes the matching area from the area in the captured image where medicine is detected (S306), and detects the image of the medicine (S307). If the medicine detection unit 792c detects the image of the medicine (YES in S307), the display control unit 67 displays a remaining medicine confirmation image indicating "Remaining medicine" on the corresponding sorting cup 141 on the display unit 32 (S308), and the process ends.

[0325] An image D206 shown in Fig. 24 shows an example of a detection result of a medicine by the medicine detection unit 792c when the matching region is excluded from the detection target region. As shown in the image D206 of Fig. 24, the medicine detection unit 792c detects only the medicine image J200 and does not detect the image of the wound as a medicine.

[0326] If the medicine detection unit 792c does not detect an image of a medicine from the captured image (NO in S303), the display control unit 67 displays a remaining medicine confirmation image indicating "No remaining medicine" in the corresponding sorting cup 141 on the display unit 32 (S309), and the process ends. If the matching determination unit 793c determines that the matching score is equal to or less than a predetermined value (NO in S305), the process continues to 308. If the medicine detection unit 792c does not detect an image of a medicine (NO in S307), the process continues to 309.

[0327] [Embodiment 12] In this embodiment, a configuration that can assist a user in removing medicines in poor condition from the sorted medicines will be described with reference to Fig. 25. For example, medicines in poor condition include medicines with parts missing, medicines that are dirty, medicines that are discolored, and the like.

[0328] The medicine sorting device 1 according to the present embodiment displays buttons that allow the user to select the state of each medicine on an image (image for visual inspection) for the user to visually inspect the sorted medicines. The medicine sorting device 1 prints the state of each medicine on at least one of a journal and a packaging paper according to the received user input.

[0329] According to the above configuration, when the sorted medicines include medicines in poor condition, the user can easily grasp the number of medicines in poor condition. Therefore, the medicine sorting device 1 can assist the user in removing medicines in poor condition from the sorted medicines. In addition, since the user can be made aware that the sorted medicines include medicines in poor condition, it is possible to reduce the omission of removing medicines in poor condition.

[0330] The operation unit 31, the control unit 60a, and the print output unit 4 according to this embodiment perform the following processes in addition to the processes described in the first embodiment.

[0331] (Operation unit 31) The operation unit 31 accepts input operations by the user. In particular, the operation unit 31 according to this embodiment accepts user input for displaying an image for visual inspection. The operation unit 31 also accepts user input entered by the above-mentioned buttons displayed on the image for visual inspection. The operation unit 31 transmits a signal indicating the accepted user input to the operation input unit 66.

[0332] (Imaging control unit 63) The imaging control unit 63 receives an instruction from the operation input unit 66 and causes the second camera 121 to capture an image of the sorting cup 141. The imaging control unit 63 obtains the captured image and transmits it to the display control unit 67.

[0333] (Operation input unit 66) When the operation input unit 66 receives a signal indicating a user input for displaying an image for visual inspection, it instructs the imaging control unit 63 to capture an image of the sorting cup 141 with the second camera 121. The operation input unit 66 also receives a signal indicating a user input entered using the button displayed on the image for visual inspection. The operation input unit 66 transmits the signal indicating the user input to the print output control unit 69.

[0334] (Display control unit 67) The display control unit 67 receives the captured image from the imaging control unit 63, generates an image for visual inspection using the captured image, and displays it on the display unit 32. The image for visual inspection includes a "button that allows the user to select the state of each medicine." Via the button, the user can input the state of each medicine sorted in the sorting cup 141. For example, by using the button, the user can select the state of the medicine, such as whether the medicine is dirty, whether it is chipped, or whether it has discolored.

[0335] (Print output control unit 69) The print output control unit 69 controls the print output unit 4 in accordance with the user input received by the operation input unit 66 .

[0336] (Print output section 4) The print output unit 4 prints the state of each medicine on at least one of a journal and a packet according to user input.

[0337] (Processing example) FIG. 25 is a flowchart showing an example of the printing process of the medicine sorting device according to the present embodiment. As shown in FIG. 25, the operation input unit 66 accepts a user input for displaying an image for visual inspection (S401). Next, the image capture control unit 63 controls the second camera 121 to capture an image of the sorting cup 141 (S402). Next, the display control unit 67 displays an image for visual inspection including a button for allowing the user to select the state of each medicine (S403). Next, the operation input unit 66 accepts a user input to the button for the state of each medicine (S404). The user visually checks the image for visual inspection and performs a visual inspection of the medicine shown in each image. If the user finds any problem with the medicine during visual inspection, the user selects the button indicating "Yes" for the corresponding problem. If the user does not find any problem, the user selects the button indicating "No" for each problem. In response to this selection, the operation input unit 66 accepts a user input to the button.

[0338] Next, the print output control unit 69 controls the print output unit 4 to print the status of each medicine on the journal (S405), and the process ends. For example, if the user performs a visual inspection before packaging the sorted medicines, the status of each medicine may be printed on both the journal paper and the packaging paper. Also, if the user performs a visual inspection after packaging the sorted medicines, the status of each medicine may be printed only on the journal paper. For example, as an example of printing, the status of the medicine and the number of medicines in that state may be printed for each sorting cup 141, such as "dirty: 1 tablet present, missing: 2 tablets present."

[0339] [Embodiment 13] (overview) In this embodiment, mainly with reference to Figs. 26 to 28, a configuration that can increase the probability of successful identification of the type of target medicine and can increase the accuracy of identification of the type of target medicine will be described.

[0340] When the identification information of the target drug includes an unidentifiable character, the drug sorting device 1 according to this embodiment generates a converted character string in which the unidentifiable character in the character string of the identification information is converted into a wildcard that matches all patterns. The drug sorting device 1 determines the type of the target drug from the search results of the user adopted drug list 810 and the comprehensive drug database 541 using the converted character string.

[0341] According to the above configuration, when the identification information of the target medicine contains unidentifiable characters, the medicine assorting device 1 determines the type of the target medicine from the search results using the user adopted medicine list 810 and the medicine comprehensive database 541. Therefore, the medicine assorting device 1 can increase the probability that the target medicine is one of the medicines.

[0342] Here, FIG. 26 is a diagram showing an example of a drug discrimination system 2000 according to this embodiment. As shown in FIG. 26, a user adopted drug list 810 is stored in the memory unit 80d of each drug sorting device 1. The user adopted drug list 810 is a list including characteristics (drug data) of reference drugs corresponding to drugs managed in a hospital, ward, pharmacy, or the like where the drug sorting device 1 is used. The drug data is associated with identification information of the reference drug (e.g., information indicating the type of drug, such as drug name). The drug data may be image data including the characteristics of the reference drug.

[0343] 26, the comprehensive drug database 541 is stored in the storage unit 504 of the data management device 500. The data management device 500 manages drug data relating to multiple types of drugs that can be used in any hospital, ward, pharmacy, etc. The data management device 500 can be communicatively connected to the drug sorting device 1, and comprehensively and centrally manages multiple types of drugs in the comprehensive drug database 541.

[0344] Because the amount of drug data managed in the comprehensive drug database 541 is enormous, it is not realistic to include all of it in the user's adopted drug list 810. Therefore, the drug data included in the user's adopted drug list 810 is drug data extracted from the drug data included in the comprehensive drug database, which is expected to be used in each drug sorting device 1, or in each hospital, ward, pharmacy, etc.

[0345] (Drug Identification System 2000) The drug discrimination system 2000 according to this embodiment will be described with reference to Fig. 26. As shown in Fig. 26, the drug discrimination system 2000 includes a plurality of drug sorting devices 1 and a data management device 500 that can be communicatively connected to each drug sorting device 1. The drug sorting devices 1 and the data management device 500 transmit and receive data via an Internet line or a dedicated VPN (Virtual Private Network) line. Note that the drug discrimination system 2000 may include only one drug sorting device 1.

[0346] (Data management device 500) The data management device 500 is a device used by, for example, a manufacturer of the medicine sorting device 1. The data management device 500 includes a communication unit 501, a control unit 502, a touch panel 503, and a storage unit 504. The storage unit 504 stores a comprehensive medicine database 541. The communication unit 501 transmits and receives data to and from the medicine sorting device 1. The communication unit 501 receives, for example, a conversion character string from the communication unit 101 of the medicine sorting device 1. The control unit 502 searches the comprehensive medicine database 541 using the conversion character string. The control unit 502 transmits the medicine data of the reference medicine searched for in the comprehensive medicine database 541 to the medicine sorting device 1 via the communication unit 501. The touch panel 503 includes an operation unit and a display unit (not shown). For example, the medicine data included in the comprehensive medicine database 541 may be updated by a user operation via the touch panel 503.

[0347] (Drug sorting device 1) As shown in FIG. 26, the medicine sorting device 1 includes a touch panel 3, a control unit 60a, a storage unit 80d, and a communication unit 101.

[0348] 26 shows only the configuration related to the discrimination process according to this embodiment among the configurations of the medicine sorting device 1. The medicine sorting device 1 according to this embodiment may include all the configurations of the medicine sorting device 1 shown in FIG.

[0349] (Touch Panel 3) An operation unit (not shown) of the touch panel 3 accepts an input operation by a user. In particular, the operation unit according to this embodiment accepts a user operation to instruct adding drug data of a reference drug to the user adopted drug list 810.

[0350] For example, the drug data of the reference drug added to the user adopted drug list 810 is, in a search using a converted character string, drug data of the reference drug that is not searched for in the user adopted drug list 810 but is searched for in the comprehensive drug database 541. For example, when the operation input unit 66 receives a user operation instructing to add drug data of the reference drug, the drug database update unit 74 shown in FIG. 1 may add the drug data of the reference drug to the user adopted drug list 810. In addition, the user may request the manufacturer of the drug sorting device 1 to add drug data of the reference drug that is not searched for in the user adopted drug list 810 but is searched for in the comprehensive drug database 541 to the user adopted drug list 810.

[0351] The control unit 60a according to this embodiment has the following functions in addition to the functions described in the first embodiment.

[0352] (Feature extraction unit 64a) The feature extraction unit 64a performs OCR processing on the identification information of the target drug. In addition, the feature extraction unit 64a determines whether or not an unidentifiable character is included in the character string of the identification information after OCR.

[0353] In addition, the feature extraction unit 64a determines whether the character string of the identification information after OCR contains characters equal to or greater than a first number, which is a predetermined number. For example, the feature extraction unit 64a determines whether the total number of identifiable characters and unidentifiable characters contained in the character string of the identification information is equal to or greater than a first number. The first number may be a number set by a user.

[0354] Furthermore, the feature extraction unit 64a determines whether the character string of the identification information after OCR contains more identifiable characters than a second number, which is a predetermined number. For example, the feature extraction unit 64a may determine whether the number of identifiable characters is greater than the number of unidentifiable characters. If the number of characters included in the character string of the identification information after OCR is 8, the feature extraction unit 64a may determine whether the number of identifiable characters is 5 or more (greater than 4).

[0355] When the character string of the identification information after OCR contains a first number of characters or more and the character string of the identification information after OCR contains more than a second number of identifiable characters, the feature extraction unit 64a generates a converted character string. In detail, the feature extraction unit 64a generates the converted character string by converting the unidentifiable characters in the character string of the identification information after OCR to wildcards. The feature extraction unit 64a transmits a signal indicating the generated converted character string to the comparison unit 64b.

[0356] (Collation unit 64b) The collation unit 64b searches for a reference drug of the same type as the target drug by comparing the received converted character string with a character string of identification information of the reference drug included in the user adopted drug list 810.

[0357] The collation unit 64b also transmits a signal indicating the conversion character string to the data management device 500 via the communication unit 101. The collation unit 64b acquires drug data of the reference drug searched for in the comprehensive drug database 541 by the conversion character string from the data management device 500 via the communication unit 101. The collation unit 64b discriminates the type of the target drug according to the search result. The collation unit 64b also updates the discrimination result information 820 stored in the storage unit 80d. The discrimination result information 820 is information including the type of the target drug discriminated by the collation unit 64b, drug data of the reference drug used for discrimination, and all candidate drugs when there are multiple candidates for the target drug. The discrimination result information 820 may be stored in the storage unit 80 in association with the captured image 82 of the target drug.

[0358] (Processing example) Fig. 27 is a flowchart showing an example of the discrimination process of the medicine sorting device 1 of this embodiment. As shown in Fig. 27, the feature extraction unit 64a performs OCR processing on the identification information of the target medicine (S501). Next, the feature extraction unit 64a determines whether or not the character string of the identification information after OCR contains an unidentifiable character (S502).

[0359] FIG. 28 is a diagram showing an example of the identification information of the target drug, the drug data of the reference drug in the user adopted drug list 810, and the drug data of the reference drug in the comprehensive drug database 541. D301 in FIG. 28 shows an example of the identification information in the image of the upper (front) side of the target drug. D302 in FIG. 28 shows an example of the identification information in the image of the lower (back) side of the target drug. In the example shown in D301 in FIG. 28, the identification information "ABC" is displayed in the upper row on the upper side of the target drug, and "123" is displayed in the lower row. As shown in C1 in D301 in FIG. 28, after OCR processing, the character "C" in the identification information in the upper row on the upper side of the target drug is an unidentifiable character. Also, as shown in C2 in D301 in FIG. 28, after OCR processing, the character "2" in the lower row on the upper side of the target drug is an unidentifiable character. Also, in the example shown in D302 in FIG. 28, the identification information "20" is displayed on the lower side of the target drug. As shown in C3 of D302 in Fig. 28, after OCR processing, the character "2" in the identification information on the lower side of the target drug is an unidentifiable character. In the example shown in D301 and D302 in Fig. 28, since the characters shown in C1, C2, and C3 are unidentifiable characters, the feature extraction unit 64a determines that the character string in the identification information after OCR contains an unidentifiable character.

[0360] When the character string of the identification information includes an unidentifiable character (YES in S502), the feature extraction unit 64a judges whether the character string of the identification information after OCR includes characters equal to or greater than the first number (S503). For example, in the example shown in D301 and D302 of FIG. 28, regardless of whether the character string is identifiable or unidentifiable, six-character identification information "ABC" and "123" are displayed on the Upper side, and two-character identification information "20" is displayed on the Lower side. That is, in the example shown in D301 and D302 of FIG. 28, a total of eight characters of identification information are displayed. When the first number is set to a number equal to or less than eight (for example, 5), in the example shown in D301 and D302 of FIG. 28, the feature extraction unit 64a judges that the character string of the identification information after OCR includes characters equal to or greater than the first number.

[0361] When the character string of the identification information after OCR contains characters equal to or greater than the first number (YES in S503), the feature extraction unit 64a judges whether the character string of the identification information after OCR contains identifiable characters that are greater than the second number (S504). For example, in the example shown in D301 and D302 of FIG. 28, "A" and "B" in the upper row on the Upper side of the target drug, "1" and "3" in the lower row, and "0" on the Lower side are identifiable characters, and the character string of the identification information contains five identifiable characters. For example, the second number may be the number of unidentifiable characters among the characters contained in the character string of the identification information displayed on the target drug. In this case, in the example shown in D301 and D302 of FIG. 28, the number of unidentifiable characters is 3, and the number of identifiable characters, 5, is greater than the number of unidentifiable characters, 3. Therefore, the feature extraction unit 64a judges that the character string of the identification information after OCR contains identifiable characters that are greater than the second number (the number of unidentifiable characters).

[0362] If the character string of the identification information after OCR contains more than the second number of identifiable characters (YES in S504), the feature extraction unit 64a converts the unidentifiable characters in the character string of the identification information after OCR to wildcards (S505) and generates a converted character string. For example, in the example shown in D301 and D302 of FIG. 28, the feature extraction unit 64a may generate a converted character string as follows:

[0363] First, the feature extraction unit 64a may divide the character string of the identification information for each display area by a delimiter ("space", ":"). The display areas are the upper row of the Upper side, the lower row of the Upper side, the Lower side, etc. In the example shown in D301 and D302 of FIG. 28, the feature extraction unit 64a generates "ABx 1x3:x0" (x is an unidentifiable character). Next, the feature extraction unit 64a converts the unidentifiable character to a wildcard (*). In addition, the feature extraction unit 64a adds a wildcard (*) to the beginning and end of the character string for each display area. That is, the character string in the upper row of the Upper side becomes "*AB**", the character string in the lower row of the Upper side becomes "*1*3*", and the character string on the Lower side becomes "**0*". Note that the wildcard (*) indicates any character string of 0 or more.

[0364] The process of adding a wildcard (*) to the beginning and end of a character string is a process for cases where the feature extraction unit 64a does not recognize a character before the beginning or after the end of the character string. This process makes it possible to appropriately perform the process of searching for a reference drug when the feature extraction unit 64a does not recognize a character before the beginning or after the end of the character string.

[0365] Next, the collation unit 64b searches for a reference drug of the same type as the target drug using the user adopted drug list 810 (S506). D303 in FIG. 28 shows an example of drug data of a reference drug searched using the user adopted drug list 810. As shown in D303 in FIG. 28, the reference drug (adopted drug MB master) is displayed with identification information of "ABC" in the upper row (Upper1) on the Upper side and "123" in the lower row (Upper2) on the Upper side. In addition, the reference drug is displayed with identification information of "30" on the Lower side. In this example, the adopted drug B master searched using the user adopted drug list 810 is a drug of a different type from the target drug.

[0366] Next, the collation unit 64b acquires the search result using the comprehensive drug database 541 (S507). D304 in FIG. 28 shows an example of drug data of a reference drug searched using the comprehensive drug database 541. As shown in D304 in FIG. 28, the reference drug (drug MA master) has identification information "ABC" displayed in the upper row (Upper1) on the Upper side and "123" displayed in the lower row (Upper2) on the Upper side. Also, the reference drug has identification information "20" displayed on the Lower side. In this example, drug A searched using the comprehensive drug database 541 is the same type of drug as the target drug.

[0367] Next, the collation unit 64b judges whether or not there is a reference drug found (S508). In detail, the collation unit 64b judges whether or not a reference drug of the same type as the target drug is found in either the search using the user adopted drug list 810 or the search using the drug comprehensive database 541.

[0368] If there is a reference drug found (YES in S508), the collation unit 64b determines whether there are multiple reference drugs found (S509). For example, the collation unit 64b determines that there are multiple reference drugs found in the following cases.

[0369] (1) When one reference drug is found in a search using the user's adopted drug list 810, and when one reference drug is found in a search using the comprehensive drug database 541. (2) When multiple reference drugs are found in at least one of a search using the user's adopted drug list 810 and a search using the comprehensive drug database 541.

[0370] If there are multiple reference drugs found (YES in S509), the collation unit 64b determines the type of the target drug as one of multiple candidate drugs (S510). For example, if a reference drug is found in both the search using the user's adopted drug list 810 and the search using the comprehensive drug database 541, the collation unit 64b may determine the type of the target drug as the reference drug found in the search using the user's adopted drug list 810. In addition, a discrimination priority indicating the discrimination priority may be set for the reference drug included in the user's adopted drug list 810 and the comprehensive drug database 541. The collation unit 64b may determine the type of the target drug based on the discrimination priority. Next, the collation unit 64b stores all of the multiple candidate drugs that are the searched reference drugs in the storage unit 80d as discrimination result information 820 (S511), and the process ends.

[0371] If the character string of the identification information does not contain an unidentifiable character (NO in S502), the process ends. For example, the determination process described in the first embodiment may be performed without converting the unidentifiable character in the character string of the identification information to a wildcard.

[0372] If the character string of the identification information after OCR does not contain the first number of characters or more (NO in S503), the collation unit 64b determines that the target drug is a suspected drug (S513), and the process ends. If the character string of the identification information after OCR does not contain identifiable characters more than the second number (NO in S504), the process continues to S513. If there is no reference drug found (NO in S508), the process continues to S513.

[0373] Moreover, if the retrieved reference drugs are not multiple (single) (NO in S509), the collation unit 64b determines that the type of the target drug is the retrieved reference drug (S512), and the process ends.

[0374] For example, after the above-mentioned discrimination process of the medicine sorting device 1 is completed, when the operation input unit 66 receives a user input for displaying an image for visual inspection via the operation unit 31, the following process is performed. The display control unit 67 causes the display unit 32 to display a display image showing a warning for a target drug for which there are multiple searched reference drugs. The image for visual inspection includes a warning indicating that there are multiple candidates, drug data for the multiple candidate drugs, etc. In the example shown in FIG. 28, the drug data in the adopted drug MB master and the drug MA master as candidate drugs for the target drug are included in the display image.

[0375] Furthermore, when the user checks this display image and finds that the drug data of the drug whose type has been determined is not included in the user's adopted drug list 810, the user inputs, from the operation unit 31 of the touch panel 3, an instruction to add the drug data to the user's adopted drug list 810. When the operation input unit 66 accepts the instruction, the drug database update unit 74 adds the drug data of the reference drug to the user's adopted drug list 810.

[0376] [Embodiment 14] (overview) As described above, the medicine sorting device 1 can sort medicines stored in the first storage unit 11 by type. Medicines stored in the first storage unit 11 include returned medicines and medicines brought by patients. In this embodiment, a configuration example of the first storage unit 11A assuming that the medicine sorting device 1 sorts medicines brought by patients, a processing example when the medicine sorting device 1 sorts medicines brought by patients, and an example of a display image (display screen) that can be displayed when the medicine sorting device 1 sorts medicines brought by patients are mainly described. A medicine brought by a patient is a medicine (adopted medicine) that was once prescribed to a patient at a certain medical institution, and then brought by the patient to another medical institution due to hospitalization or the like, and is being taken by the patient.

[0377] In this embodiment, the patient is prescribed a drug for multiple days, and multiple dosing times are set for each day. The type of drug taken at the same dosing time on each day is the same. A specific day out of the multiple dosing days is referred to as a "predetermined dosing day." The specific dosing day is, for example, the start date of dosing, but may be any other specific day.

[0378] (An example of the first storage area, which is useful for separating medications brought in by the recipient) Fig. 29 is a diagram showing an example of the first storage unit 11A. The first storage unit 11A shown in Fig. 29 has an internal structure that enables the medicine sorting device 1 to efficiently sort brought-in medicines, unlike the first storage unit 11 shown in Fig. 2. The first storage unit 11A can be effectively used mainly when sorting brought-in medicines, but may also be used when sorting returned medicines.

[0379] In the example of FIG. 29, the first storage section 11A has four storage sections 111-114 with approximately the same volume. Each of the four storage sections 111-114 is further divided into four. The storage section 111 has three small storage sections 111a-111c and one medium storage section 111d. The storage section 112 has three small storage sections 112a-112c and one medium storage section 112d. The storage section 113 has three small storage sections 113a-113c and one medium storage section 113d. The storage section 114 has three small storage sections 114a-114c and one medium storage section 114d.

[0380] When storing the brought-to-patient medicines in the first storage unit 11A, the user classifies the brought-to-patient medicines into first brought-to-patient medicines and second brought-to-patient medicines and stores them. The first brought-to-patient medicines are medicines prescribed by a certain medical institution to be taken by a certain patient PA at each of a plurality of times on a certain taking date (a certain taking time) and are brought to a medical institution other than the said medical institution. The second brought-to-patient medicines are medicines prescribed by a certain medical institution to the patient PA and are brought to a medical institution other than the said medical institution, and are the remaining brought-to-patient medicines other than the first brought-to-patient medicines among the brought-to-patient medicines that are prescribed by a certain medical institution to the patient PA and are brought to a medical institution other than the said medical institution. In the storage unit 111, each of the small storage units 111a to 111c functions to store the first brought-to-patient medicines of the patient PA. The medium storage unit 111d functions to store the second brought-to-patient medicines of the patient PA. For example, if the brought-to-patient medicines are prescribed to be taken three times each day, the medicines for the three times taken on the first day are the first brought-to-patient medicines, and the medicines taken on the second day and thereafter are the second brought-to-patient medicines.

[0381] Since the number of first brought-in medicines contained in the small containing sections 111a-111c is equal to or smaller than the number of second brought-in medicines contained in the medium containing section 111d, the volume of the small containing sections 111a-111c is smaller than the volume of the medium containing section 111d. In consideration of the number and volume of the small containing sections and the medium containing sections, in the example of FIG. 29, the small containing sections 111a-111c are arranged in the circumferential direction in the outer region of the containing section 111, and the medium containing section 111d is arranged in the remaining region (inner region) of the containing section 111. The containing sections 112-114 also have the same function and configuration as the containing section 111.

[0382] The storage units 111-114 may store, for example, first and second brought-in medications of different patients PA-PD, respectively. In this case, the first storage unit 11A can store up to four brought-in medications at a time. However, in this case, the brought-in medications of the patients PA-PD whose taking time on a given day is set to three times or less (for example, at least one of morning, afternoon, and evening) are stored in the storage units 111-114, respectively. When the taking time on a given day of a patient is set to four times or more, two or more of the storage units 111-114 are used as the storage location for the brought-in medication of the patient. Note that, for the second brought-in medication, at least one of the middle storage units of the two or more storage units may be used. When the taking time is set to four times or more, the first storage unit 11A can store up to three brought-in medications at a time.

[0383] For example, when the dosing time of a patient on a given dosing date is set to 4 to 6 times, two storage sections (e.g., storage sections 111 and 112) are used as storage locations for the patient's brought-in medication. For example, when the dosing time of a patient on a given dosing date is set to 6 times, small storage sections 111a-111c and 112a-112c are used as storage locations for the first brought-in medication. Meanwhile, medium storage sections 111d and / or 112d are used as storage locations for the second brought-in medication.

[0384] Further, indicators 111e to 114e are provided in the storage sections 111 to 114, respectively. The indicators 111e to 114e function as markers for identifying the storage sections 111 to 114, respectively. The indicators 111e to 114e have different colors from each other. Specifically, the indicators 111e to 114e may be areas to which the respective colors are applied. For example, the color of the indicator 111e may be red, the color of the indicator 112e may be blue, the color of the indicator 113e may be yellow, and the color of the indicator 114e may be green, but is not limited to this. Furthermore, the indicators 111e to 114e do not necessarily have to have different colors from each other as long as they are distinguishable from each other, and may have different shapes or patterns from each other, for example.

[0385] The indicators 111e are disposed at two locations on the boundary between the small housing sections 111a to 111c and the middle housing section 111d. The indicators 112e are disposed at two locations on the boundary between the small housing sections 112a to 112c and the middle housing section 112d. The indicators 113e are disposed at two locations on the boundary between the small housing sections 113a to 113c and the middle housing section 113d. The indicators 114e are disposed at two locations on the boundary between the small housing sections 114a to 114c and the middle housing section 114d. However, the positions of the indicators 111e to 114e are not limited to the above example as long as there is no inconvenience in identifying the housing sections 111 to 114.

[0386] (Example of sorting and processing of medications brought in by customers) In the medicine sorting device 1 of this embodiment, it is possible to set a normal sorting mode (returned medicine sorting mode) in which returned medicines are automatically sorted, and a brought-in medicine sorting mode in which brought-in medicines are automatically sorted.

[0387] The process and operation of the medicine sorting device 1 when the normal sorting mode is set is as described above. That is, in the normal sorting mode, the medicine sorting device 1 takes out the multiple types of medicines stored in the first storage unit 11A one by one, and determines the type of the medicine based on an image of the taken out medicine. Based on the determination result, the medicine sorting device 1 transports the medicine to any of the second storage unit 14, the waiting tray 15, and the collection tray 16. In the normal sorting mode, the user may store the medicines to be sorted in any small storage unit and / or medium storage unit.

[0388] When the brought-medicine sorting mode is set, the user classifies the first brought-medicine and the second brought-medicine and stores them in the small storage section and / or the medium storage section as described above. The control unit 60a sorts the first brought-medicine before the second brought-medicine. At this time, the order in which the brought-medicine is taken out from the storage sections 111-114 and the order in which the brought-medicine is stored in the sorting cup 141 may be preset. The order in which the brought-medicine is taken out from the storage sections 111-114 is set to the order of the storage sections 111, 112, 113, and 114, for example. In addition, the order in which the brought-medicine is stored in the sorting cup 141 is set to the order of columns A to F in the first row, columns A to F in the second row, and so on, for example, when the sorting cup 141 is arranged with rows 1 to 7 and columns A to F. For example, consider a case where the patient PA has five types of brought-in medication stored in the storage unit 111, and the patient PB has five types of brought-in medication stored in the storage unit 112. In this case, the control unit 60a stores the patient PA's brought-in medications in the sorting cups 141 arranged in columns A to E of the first row, and then stores the patient PB's brought-in medications in columns F of the first row and columns A to D of the second row. That is, the control unit 60a stores the brought-in medications in the sorting cups 141 in a preset order for each patient and each type of medication.

[0389] In addition, the discrimination unit 64 in the medicine sorting device 1 of this embodiment has a function of determining reference data for discriminating the type of the second brought-in medicine, for example, by one of the following two methods. The discrimination unit 64 stores the determined reference data in the storage unit 80.

[0390] (Method 1) The discrimination unit 64 determines reference data indicating information based on at least one characteristic (e.g., the above-mentioned size, shape, or representative color) of the first brought-to-person drug extracted from an image of the first brought-to-person drug. The discrimination unit 64 determines, as reference data, a plurality of characteristics managed as drug data of the first brought-to-person drug, which are obtained by the collation unit 64b collation of at least one characteristic of the first brought-to-person drug with a drug database. In this case, the collation unit 64b can compare the plurality of characteristics of the first brought-to-person drug with at least one characteristic of the second brought-to-person drug.

[0391] (Method 2) The discrimination unit 64 determines at least one characteristic of the first brought-to-patient medication as reference data. For example, the discrimination unit 64 determines the size, shape, and representative color of the first brought-to-patient medication as reference data.

[0392] After sorting the first medicine, the control unit 60a sorts the second medicine. At this time, the control unit 60a may use the reference data to sort the second medicine based on the characteristics of the first medicine. Therefore, even if the type of the first medicine is not accurately determined or narrowed down, the first medicine and the second medicine considered to be the same type may be stored in the same sorting cup 141. In the above method 1, the type of the first medicine can be accurately determined or narrowed down by checking the characteristics of the first medicine against the medicine database, but the number of medicine data managed in the medicine database is huge, so it takes time. In the above method 2, the discrimination unit 64 determines the characteristics of the first medicine as reference data, so that the processing time of the discrimination unit 64 (the time to create the reference data) can be shortened.

[0393] When the same small container contains multiple first brought-in medications, the collation unit 64b compares the reference data of each first brought-in medication to determine whether the reference data can be considered to be identical. When the degree of agreement of at least one feature of the two first brought-in medications to be compared is equal to or greater than a predetermined value, the collation unit 64b may consider the reference data to be identical. The number of features for determining whether the degree of agreement is equal to or greater than the predetermined value and the predetermined value may be set by experiment or the like. The collation unit 64b may also perform a similar process when comparing at least one feature of the second brought-in medication with the reference data.

[0394] The matching unit 64b also functions as a first matching unit that matches at least one feature of the second brought-to-patient drug extracted from an image of the second brought-to-patient drug with the reference data determined by the discrimination unit 64. The matching unit 64b does not match the features of the second brought-to-patient drug with the drug database, at least for the second brought-to-patient drug. In addition, only the number of the first brought-to-patient drugs is stored in the storage unit 80 as reference data. Therefore, the matching time can be shortened compared to the case where the features of the second brought-to-patient drug are matched with all the drug data managed in the drug database. In addition, the matching time can be further shortened by narrowing down the features of the first brought-to-patient drug included in the reference data (e.g., the size, shape, and representative color of the first brought-to-patient drug).

[0395] Furthermore, when the discrimination unit 64 determines the reference data by the above-mentioned method 1, the collation unit 64b functions as a second collation unit that narrows down the type of the first brought-to-patient drug by comparing at least one feature of the first brought-to-patient drug with the drug database. In this case, the collation unit 64b can accurately discriminate or narrow down the type of the first brought-to-patient drug, and therefore can accurately discriminate or narrow down the type of the second brought-to-patient drug.

[0396] It should be noted that the matching unit 64b is described as having the functions of both the first matching unit and the second matching unit, but the control unit 60a may be provided with the first matching unit and the second matching unit as separate functions.

[0397] (Screen Description) FIG. 30 is a diagram showing an example of an initial image (initial screen) on which a medicine sorting result can be displayed. The display control unit 67 displays the initial image on the display unit 32 in a normal state. The initial image shown in FIG. 30 includes a button B11 for displaying a menu related to the operation of the medicine sorting device 1. When the user operates the button B11, the display control unit 67 displays a menu including a button B12 for displaying a submenu for switching the sorting mode of the medicine sorting device 1. When the user operates the button B12, the display control unit 67 displays a submenu including a button B13 for setting the sorting mode to a normal sorting mode and a button B14 for setting the sorting mode to a brought-medicine sorting mode. When the user operates the button B14, the control unit 60a sets the sorting mode to a brought-medicine sorting mode.

[0398] FIG. 31 is a diagram showing an example of a setting image (setting screen) for a user to set a storage method for bringing-medicines in the first storage unit 11A when the brought-medicine sorting mode is set. When the control unit 60a sets the sorting mode to the brought-medicine sorting mode, the display control unit 67 changes the image displayed on the display unit 32 from an initial image to a setting image. The setting image shown in FIG. 31 includes an input area PIR that accepts input of patient information. The user inputs patient information such as the patient's name, sex, age, and medical department in the input area PIR. The control unit 60a stores the input patient information in the storage unit 80.

[0399] The setting image shown in Fig. 31 further includes a button B21 for selecting a storage unit for storing the brought-to-be-brought-in medicine. The button B21 includes areas corresponding to the colors of the indicators 111e to 114e. By operating the button B21, the user can select a storage unit having an indicator corresponding to the color of the operated area as a storage unit for storing the brought-to-be-brought-in medicine.

[0400] The setting image shown in FIG. 31 further includes a button B22 for selecting another storage unit for storing the patient's own medicine. As described above, when the taking time on a predetermined taking date of a certain patient is set four or more times, among the storage units 111 to 114, two or more storage units are used as the storage locations for the patient's own medicine. The user can select, as the second storage unit for storing the patient's own medicine, the storage unit having an indicator corresponding to the color of the operated area, by operating the button B22.

[0401] The button B22 includes, in addition to the areas corresponding to the respective colors of the indicators 111e to 114e, which are the same as those of the button B21, an area for clearing the selection of the storage unit. When the selection of the second storage unit is not required, the user may operate the area of the button B22 for clearing the storage unit for storing the patient's own medicine.

[0402] Hereinafter, it will be described on the assumption that the storage unit 111 is selected by the button B21 and the storage unit 112 is selected by the button B22.

[0403] The setting image shown in FIG. 31 further includes buttons B3 corresponding to the small storage units 111a to 111c and 112a to 112c, respectively. The button B3 is a button for the user to set the usage method of the patient's own medicine stored in each of the small storage units 111a to 111c and 112a to 112c. When any one of the buttons B3 is operated, the display control unit 67 displays a sub-menu (not shown) for selecting the usage method of the patient's own medicine stored in the small storage unit corresponding to the button B3. In the sub-menu, the user can select usage methods such as "morning", "noon", "night", "every", "when waking up", "before going to bed", "before meals", "between meals", "after meals", "immediately before meals", and "immediately after meals". When there is no appropriate usage method in the sub-menu (for example, "when it hurts"), the user can also directly input the usage method in text. However, the control unit 60a may accept text input for all usage methods without displaying the sub-menu.

[0404] 31 further includes an image IA indicating the storage section 111, and an image IB indicating the storage section 112. In other words, the display control section 67 causes the setting image to include images IA and IB corresponding to the storage sections 111 and 112 selected by the user by operating buttons B21 and B22, respectively. Image IA includes an image IAe corresponding to indicator 111e. Image IB includes an image IBe corresponding to indicator 112e. By referring to images IAe and IBe, the user can confirm that the selected storage sections are storage sections 111 and 112.

[0405] The image IA includes images IAa-IAd corresponding to the small containing sections 111a-111c and the medium containing section 111d of the containing section 111, respectively. The image IA also includes an image IAf showing the usage of the brought-in medication to be contained in each of the small containing sections 111a-111c. Similarly, the image IB includes images IBa-IBd corresponding to the small containing sections 112a-112c and the medium containing section 112d of the containing section 112, respectively. The image IB also includes an image IBf showing the usage of the brought-in medication to be contained in each of the small containing sections 112a-112c.

[0406] The display control unit 67 reflects the usage of the brought-to-be-owned medicine contained in each of the small containers 111a-111c and 112a-112c selected by the user by operating the button B3 in the images IAf and IBf. The user refers to the images IAf and IBf and puts the first brought-to-be-owned medicine into the small containers 111a-111c and 112a-112c. The user also puts the second brought-to-be-owned medicine into the medium containers 111d and 112d.

[0407] The setting image shown in Fig. 31 further includes a button B41 for adding patient information, etc., for a patient who has brought in medication. By operating the button B41, a tab for displaying a setting image for setting the patient information, etc., of a new patient is added next to the button B41. By selecting a tab, the user can register patient information for each patient and set in which storage section the medication brought in by the patient is to be stored, and in which small storage section the first medication, with which usage, is to be stored.

[0408] 31 further includes a button B42 for deleting patient information, etc. When sorting of a patient's brought-in medications becomes unnecessary, the user operates the button B42 to delete the patient information, etc. of the patient. When the control unit 60a receives the user's operation of the button B42, it deletes the patient information, etc. of the corresponding patient from the storage unit 80.

[0409] The setting image shown in Fig. 31 further includes a button B5 for starting sorting of the brought-in medications. After the user has finished putting the brought-in medications into the first storage unit 11A, the user operates the button B5 to cause the medicine sorting device 1 to start sorting the brought-in medications. Note that, as shown in Fig. 30, the button B5 is also included in the initial image.

[0410] On the other hand, when the user operates button B13 in the setting image shown in FIG. 30, the control unit 60a sets the sorting mode to the normal sorting mode. As described above, in the normal sorting mode, the first and second brought-in medications are not classified for each patient, and the brought-in medications or returned medications may be stored in any small storage unit and / or medium storage unit. In this case, the display control unit 67 does not change the image displayed on the display unit 32 from the initial image to the setting image. After the user puts the medications to be sorted into the first storage unit 11, the user operates button B5 included in the initial image. When button B5 is operated, the control unit 60a starts sorting.

[0411] Fig. 32 is a diagram showing an example of a sorting image for displaying the sorting status of brought-to-be-treated medications when the brought-to-be-treated medication sorting mode is set. After the control unit 60a starts sorting the brought-to-be-treated medications, the display control unit 67 changes the image displayed on the display unit 32 from the initial image to a sorting image. The display control unit 67 updates the sorting image according to the progress of sorting the brought-to-be-treated medications by the control unit 60a. The sorting image shown in Fig. 32 includes an image IC showing the sorting status of the brought-to-be-treated medications. The image IC includes an image showing the number of brought-to-be-treated medications contained in each area corresponding to the sorting cups 141 of the second container 14.

[0412] The display control unit 67 causes the color of the area corresponding to the sorting cup 141 to correspond to the color of the indicator of the storage unit in which the brought-in medications sorted into the sorting cup 141 were stored. In the example shown in FIG. 32, the display control unit 67 causes the colors of columns A to D in the first row to correspond to the indicator 111e of the storage unit 111. The display control unit 67 also causes the colors of columns E and F in the first row to correspond to the indicator 112e of the storage unit 112. The display control unit 67 also causes the colors of columns C to E in the second row to correspond to the indicator 113e of the storage unit 113. The display control unit 67 also causes column F in the second row and column A in the third row to correspond to the indicator 114e of the storage unit 114.

[0413] The image IC also includes an image indicating whether or not a visual inspection of the brought-in medications stored in each sorting cup 141 of the second storage unit 14 has been completed. In the example shown in Fig. 32, visual inspection has not been completed for any of the sorting cups 141. For this reason, the display control unit 67 displays the text "Not Visually Inspected" in the area corresponding to each sorting cup 141.

[0414] When the type of the brought-in medicine contained in each sorting cup 141 of the second storage unit 14 can be determined at the time of sorting, the image IC includes an image indicating the type. In the example shown in FIG. 32, the display control unit 67 indicates the type with multiple "*"s below the character string "not visually inspected" described above in columns A and C of the first row, column E of the second row, and column A of the third row. In addition, when the type of the brought-in medicine contained in each sorting cup 141 of the second storage unit 14 cannot be determined at the time of sorting, the image IC includes an image indicating that the type of the brought-in medicine contained in the sorting cup 141 is in a provisionally sorted state in which the type of the brought-in medicine is not determined. In the example shown in FIG. 32, the display control unit 67 displays "provisionally sorted" instead of a character string indicating the type in the area corresponding to the sorting cup 141 containing the brought-in medicine of which the type is not determined. The user can determine the type of brought-in medicine in a provisionally sorted state by visual inspection and input the type to the medicine sorting device 1.

[0415] The sorting image shown in Fig. 32 further includes a button B6 for starting packaging of the sorted brought-by medications. After completing sorting and visual inspection of the brought-by medications, the user operates button B6 to cause the medicine sorting device 1 to start packaging the brought-by medications. When the user operates button B6, the print output control unit 69 controls the print output unit 4 to print a journal showing medicine data related to the brought-by medications to be packaged. In addition, the packaging control unit 71 controls the packaging mechanism 6 to package the brought-by medications sorted into each sorting cup 141.

[0416] As described above, in the medicine sorting device 1, the display control unit 67 can refer to the image displayed on the display unit 32 to easily identify the storage unit to which the patient's own medicine should be placed. This reduces the possibility of placing medicine in the wrong storage unit. In addition, by sorting and packaging medicines using the medicine sorting device 1, labor costs can be reduced and economic productivity can be improved. This can contribute to the achievement of the Sustainable Development Goals (SDGs).

[0417] [Software implementation example] The medicine sorting device 1, the information processing device 200, and the data management device 500 are provided with a computer that executes instructions of a program, which is software that realizes each function. This computer is provided with, for example, one or more processors, and a computer-readable recording medium that stores the program. In the computer, the processor reads the program from the recording medium and executes it, thereby achieving the object of the present invention. For example, a CPU (Central Processing Unit) can be used as the processor. For the recording medium, a "non-transient tangible medium", for example, a ROM (Read Only Memory) or the like, as well as a tape, a disk, a card, a semiconductor memory, a programmable logic circuit, or the like can be used. In addition, a RAM (Random Access Memory) that expands the program, or the like, may be further provided. In addition, the program may be supplied to the computer via any transmission medium (such as a communication network or a broadcast wave) that can transmit the program. Note that one aspect of the present invention may also be realized in the form of a data signal embedded in a carrier wave in which the program is embodied by electronic transmission.

[0418] [Additional Notes] The present invention is not limited to the above-described embodiments, and various modifications are possible within the scope of the claims. Embodiments obtained by appropriately combining the technical means disclosed in different embodiments are also included in the technical scope of the present invention.

[0419] Another embodiment of the present invention can be described as follows.

[0420] A type discrimination device according to one embodiment of the present invention is a type discrimination device that discriminates the type of a target drug from an image of the target drug, and includes a feature extraction unit that extracts first feature information indicating characteristics of the appearance of the target drug from the image, which is reflection area information indicating the reflection area of ​​light irradiated onto the target drug, and a discrimination unit that compares the first feature information with second feature information indicating characteristics of the appearance of the reference drug, which is reflection area information indicating the reflection area of ​​light irradiated onto a reference drug, and discriminates that the target drug is a coated tablet as a type of the target drug based on the result of the comparison, and the reflection area is an area located inside the outer edge of the target drug included in the image.

[0421] In a type discrimination device according to one aspect of the present invention, the discrimination unit may compare a shape of a reflection area indicated by reflection area information included in the first feature information with a shape of a reflection area indicated by reflection area information included in the second feature information.

[0422] In one embodiment of the type discrimination device of the present invention, the reflective area is an image area in the captured image having a saturation value higher than a predetermined value, and when the target drug is a coated tablet, may be a ring-shaped area formed on the surface of the coated tablet. [Explanation of symbols]

[0423] 1. Drug sorting device 11 First storage section 13 Imaging unit (imaging section) 14 Second storage section 15 Waiting tray (temporary storage area) 60 Computer (type discrimination device) 62 Sorting control unit (sorting decision unit) 64a Feature Extraction Unit 64b Matching section (discrimination section) 65 Priority determination section 73 Image Processing Section 74 Drug Database Update Division (Update Division) 82 Captured images 200 Information processing device 221 Acquisition unit (reception unit) 222 Image generation unit (generation unit) 1000 Image Generation System

Claims

1. A type discrimination device that discriminates the type of a target drug from an image of the target drug, a discrimination unit that compares fifth feature information indicating the characteristics of the appearance of the target drug, including target color information indicating the color of the target drug, extracted from the captured image, with sixth feature information including reference color information indicating the color of a reference drug, and discriminates the type of the target drug based on the result of the comparison; A type discrimination device characterized by comprising an update unit that, when the discrimination unit fails to discriminate the type of the target drug, updates the target color information used in the discrimination as new reference color information after accepting operation by a user.

2. A feature extraction unit extracts third feature information indicating an appearance feature of the target drug from the captured image, the third feature information including at least reflection information indicating whether or not the light irradiated to the target drug is reflected by the target drug; The type discrimination device of claim 1, wherein the discrimination unit compares fourth characteristic information indicating the appearance characteristics of the reference drug, which at least includes reflection information indicating whether light irradiated to the reference drug is reflected by the reference drug, with the third characteristic information, and discriminates the type of the target drug based on the result of the comparison.

Images