Inspection system for blister paperboard packaging system

Abstract

An inspection system for a blister paperboard packaging system. The inspection system includes an electronic processor. The electronic processor is configured to capture a continuous plurality of images of a blister of a blister paperboard, display an image of at least a portion of the blister paperboard for inspection, receive a selection of the blister after displaying the image, and display the continuous plurality of images in response to receiving the selection.

Description

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS

[0002] This application claims priority to U.S. Provisional Patent Application No. 63 / 509,365, filed on June 21, 2023, the entire contents of which are incorporated herein by reference. Technical Field

[0003] The present disclosure relates to blister paperboard packaging systems. More particularly, the present disclosure relates to inspection systems for blister paperboard packaging systems. Summary of the invention

[0004] Pharmacies use several types of packaging to deliver medicines or medications to consumers. The types of packaging can include strip packs, blister boards, bottles, etc. Bottles and strip packs are best suited for individual customers of retail pharmacies. However, institutional customers, such as nursing homes, palliative or hospice facilities, hospitals, etc., use blister boards extensively.

[0005] Most blister boards are currently packed manually by pharmacists or pharmacy technicians. Inspection of blister boards is also done manually during packaging. Automatic or semi-automatic blister board packaging machines do not have a robust inspection system for inspecting whether the blister boards are properly packed. Instead, pharmacists need to manually inspect the packaged blister boards before dispensing. Some automatic packaging machines can inspect the drugs in an intermediate step before dispensing them into blister boards. These automatic packaging machines use a disc to temporarily hold the drugs in an intermediate step, while a camera captures an image of the drugs before they are packaged in a blister board. Some disadvantages of this intermediate inspection system are that the disc may have debris from the previous drug, which may cause cross contamination. In addition, since the image is captured before the drug is dispensed into the blister board, the pharmacist may still need to inspect the final package to ensure that all pills from the disc are transferred to the blister board.

[0006] Therefore, a testing system is needed to solve the above-mentioned defects of the intermediate testing system.

[0007] One embodiment provides an inspection system for a blister board packaging system. The inspection system includes an electronic processor. The electronic processor is configured to capture a plurality of consecutive images of blisters of a blister board, display the image of at least a portion of the blister board for inspection, receive a selection of a blister after displaying the image, and display the plurality of consecutive images in response to receiving the selection.

[0008] Another embodiment provides a method for inspecting a blister board. The method includes capturing a plurality of consecutive images of blisters of a blister board, displaying the images of at least a portion of the blister board for inspection, receiving a selection of a blister after displaying the images, and displaying the plurality of consecutive images in response to receiving the selection.

[0009] Yet another embodiment provides a blister board packaging system including an electronic processor configured to capture a plurality of consecutive images of blisters of a blister board, display the image of at least a portion of the blister board for inspection, receive a selection of the blister after displaying the image, and display the plurality of consecutive images in response to receiving the selection. BRIEF DESCRIPTION OF THE DRAWINGS

[0010] Figure 1 A blister board according to some examples is illustrated.

[0011] Figure 2 is a perspective view of an automatic blister carton packaging machine according to some examples.

[0012] Figure 3 Based on some examples Figure 2 An enlarged view of a portion of an automatic blister board packaging machine.

[0013] Figure 4 Based on some examples Figure 2 A front perspective view of a multi-purpose medication cabinet for an automatic blister carton packaging machine with a portion of the housing removed.

[0014] Figure 5 Based on some examples Figure 4 A floor plan of a multi-purpose medication cabinet.

[0015] Figure 6 Based on some examples Figure 4 A three-dimensional diagram of the silo and silo mechanism of a multi-purpose medication cabinet.

[0016] Figure 7 Based on some examples Figure 2 An enlarged view of a portion of an automatic blister board packaging machine.

[0017] Figure 8 Based on some examples Figure 2 A three-dimensional view of an automatic blister carton packaging machine.

[0018] Fig.9A and Fig. 9B Based on some examples Figure 2 A perspective view of the packaging unit of an automatic blister carton packaging machine.

[0019] Fig.10Based on some examples Fig.9A and Fig. 9B A three-dimensional diagram of a packaging unit.

[0020] Fig.11 Based on some examples FIG. 9A to FIG. 10 A three-dimensional diagram of a packaging device of a packaging unit.

[0021] Fig.12 Based on some examples FIG. 9A to FIG. 10 A three-dimensional view of a packaging plate of a packaging device.

[0022] Fig.13 Based on some examples and Figure 2 Block diagram of an inspection system used with an automatic blister board packaging machine.

[0023] Fig.14 is a flow chart of an inspection method for blister board according to some examples.

[0024] Fig.15 The diagram shows the Fig.13 Inspection screens generated by the inspection system.

[0025] Fig.16A and Fig. 16B The diagram shows the Fig.13 Inspection screens generated by the inspection system.

[0026] Fig.17 The diagram shows the Fig.13 Inspection screens generated by the inspection system.

[0027] Fig.18 The diagram shows the Fig.13 Inspection screens generated by the inspection system. DETAILED DESCRIPTION

[0028] Before explaining any examples, features, aspects or embodiments in detail, it should be understood that the application of these examples, features, aspects or embodiments is not limited to the construction and arrangement details of the components described in the following specific embodiments or illustrated in the following figures. These examples, features, aspects or embodiments can be practiced or implemented in various ways.

[0029] Figure 1An example of a blister cardboard 100 is illustrated. The blister cardboard 100 includes a blister sheet 110 having one or more blister cavities 120, for example, twenty-eight to thirty-two, depending on the configuration of the blister cardboard 100. Each blister cavity 120 can accommodate a single unit of medication or can accommodate more than a single unit of medication. When the blister cavity 120 is filled, a label sheet 130 is attached to the back of the blister sheet 110 to seal the blister cavity 120. The label sheet 130 includes information about the blister cardboard 100, including, for example, the name of the institution, the name of the patient, the name of the medication, the dosage of the medication, etc. The label sheet 130 includes a sealing portion 140 aligned with each blister cavity 120 so that the user can tear the sealing portion 140 to take out the packaged medication.

[0030] exist Figure 1 In the example shown, the blister cardboard 100 is a standard 6" x 9" card. In other examples, the blister cardboard 100 can be other sizes. The blister cardboard 100 can be used to fill different amounts of pills for different time periods. For example, the blister cardboard 100 can be used for a week's worth of pills (e.g., 7 pills), up to four weeks or a month's worth of pills (e.g., 28 to 31 pills), or more. In some examples, the blister cardboard 100 is a "pre-package" with only one medication in some or all of the blister cavities 120. In other examples, the blister cardboard 100 can include more than one pill in the same blister cavity 120, or include more than one pill distributed in different blister cavities 120. In the example shown, the label sheet 130 is shown as being attached to the blister sheet 110; however, the label sheet 130 can be provided separately from the blister sheet 110. The label sheet 130, whether provided with or separate from the blister sheet 110, can be cold-sealed or heat-sealed with the blister sheet 110 after filling. In some examples, a bar code can be printed on the label sheet 130 to provide identification information. The bar code can be scanned to obtain information about the blister board 100 as provided above. The bar code can be pre-printed before filling, or can be printed after filling to uniquely identify the blister board 100. The bar code can be used later by the filling machine to identify the blister board 100 currently being filled.

[0031] Figures 2 to 3An example of an automatic blister board packaging machine 200 that efficiently packages blister boards 100 is illustrated. In the illustrated example, the automatic blister board packaging machine 200 includes a multi-purpose medication cabinet 205, a packaging unit 210, and a manifold 215 connecting the multi-purpose medication cabinet 205 and the packaging unit 210. The multi-purpose medication cabinet 205 and the packaging unit 210 are supported by a frame 220. The multi-purpose medication cabinet 205 receives medication from a large-capacity tank and individually distributes pills to the packaging unit 210. The automatic blister board packaging machine 200 includes a door 225 that provides selective access to the packaging unit 210.

[0032] like Figures 2 to 3 As shown, the packaging unit 210 can move toward and away from the automatic blister carton packaging machine 200. The movement is generally performed in the front-to-back direction along a first axis. The first axis can also be referred to as the z-axis. However, in the example shown, the packaging unit 210 can also move laterally within the automatic blister carton packaging machine 200, such as Figure 12 to Figure 14 The movement is performed along a second axis perpendicular to the first axis. The second axis may also be referred to as the x-axis. The movement along the first axis is controlled by the first guide rail system 505 (eg, FIG. 9A to FIG. 10 The movement along the second axis is controlled by the second rail system 540 (as shown in FIG. Fig.10 ). The packaging unit 210 moves forward and backward along a first axis and moves laterally along a second axis to position different openings below the manifold 215, as further described below.

[0033] An example blister cardboard packaging machine is described in U.S. patent application Ser. No. 17 / 916,011, filed on Sep. 29, 2022, and entitled “AUTOMATIC PACKAGER FOR MEDICATIONS,” the entire contents of which are incorporated herein by reference.

[0034] refer to Figures 4 to 5 The multi-purpose medication cabinet 205 includes a housing 230 having a plurality of silo slots 235 therein. A dispensing opening 240 is disposed at the bottom of the housing 230. The dispensing opening 240 is communicated with the manifold 215 of the automatic blister cardboard packaging machine 200. Figures 4 to 5 In the example shown, the multi-purpose medication cabinet 205 includes up to sixteen bin slots 235. In some examples, the bin slots 235 are arranged in a double-layer structure (e.g., two rows stacked vertically), so that the second row of bin slots 235 are arranged above the first row of bin slots 235 in the housing 230 to facilitate faster filling of the blister cardboard 100.

[0035] Figure 5A side view of the double-layer structure of the silo slot 235 is illustrated. In some examples, the multi-purpose medication cabinet 205 may include only a single row of silo slots 235, or may include more than two rows of silo slots 235. The silo slots 235 are configured to receive silos 245. A plurality of silo mechanisms 250 are fixed to the housing 230, one silo mechanism corresponding to each silo slot 235. When received in the silo slot 235, the silo 245 is connected to the silo mechanism 250. As described below, the silo mechanism 250 dispenses drugs individually from the silo 245. The dispensing opening 240 transfers the drugs from the silo 245 to the packaging unit 210 for packaging.

[0036] refer to Figure 6 , the silo 245 stores the medicine during the dispensing process, and includes a wheel 255 to transport the medicine to the silo mechanism 250. The silo mechanism 250 includes a shuttle system 300, a camera system 305, and a motor assembly 310. The wheel 255 of the silo 245 is driven by the motor assembly 310. When the wheel 255 is driven, the wheel 255 singulates the medicine stored in the silo 245 and delivers the singulated medicine to the shuttle system 300. The shuttle system 300 includes a platform 315, a shuttle device 320, and a shuttle device driver 325. The platform 315 can be made of a transparent or translucent plastic material. An LED lighting system can be provided above and / or below the platform 315 to illuminate the contents on the platform 315 when the camera system 305 of the silo mechanism 250 captures an image of the contents. The LED lighting system can emit visible light or infrared light to illuminate the platform 315.

[0037] The shuttle 320 can move laterally between the platforms 315, over the drug reservoir of the silo 245, and over the conduit 330. The shuttle 320 transfers the drug from the platforms 315 back to the silo 245 or the conduit 330. The shuttle 320 is driven by a shuttle drive 325. The shuttle drive 325 can be a motor assembly, an actuator, etc.

[0038] The camera system 305 includes a camera 335 and a reflector 340. The camera 335 is positioned at the rear of the silo mechanism 250. The camera 335 can be a still camera or a video camera that captures images of the contents of the platform. The reflector 340 is arranged directly above the platform 315 and tilted at a 45 degree angle so that the camera 335 positioned at the rear of the silo mechanism 250 can capture images of the platform 315. In other examples, the camera 335 can be arranged directly above the platform, or in other configurations with or without the use of the reflector 340.

[0039] An example silo 245 and silo mechanism 250 are described in U.S. patent application Ser. No. 16 / 160,535, filed on Oct. 15, 2018, and entitled “Universal Feed Mechanism for Automatic Packaging Machine,” the entire contents of which are incorporated herein by reference.

[0040] Figure 7 An example of a manifold 215 for use with an automatic blister carton packaging machine 200 is illustrated. The manifold 215 helps direct medications (e.g., pills, vitamins, etc.) from a multi-use medication cabinet 205 to a packaging unit 210. In the example shown, the manifold 215 includes eight separate tracks or channels 270. The number of channels 270 corresponds to the number of silo slots 235 (and thus silos) in each row of the multi-use medication cabinet 205. Thus, in some examples, the manifold 215 may include fewer or more channels 270. Each channel 270 has a separate outlet that corresponds to an opening 575 (e.g., Fig.11 When the drug is delivered from the multi-purpose dosing cabinet 205, the drug travels through the channel 270 of the manifold 215, through the outlet, and enters one of the openings 575 in the packaging unit 210.

[0041] Using the manifold 215, the hopper 245 can release pills simultaneously (or relatively simultaneously) to fill a row (or column) of blister cavities 120, the packaging unit 210 can be transferred to the next row (or column) of blister cavities 120 along the first axis (i.e., z-axis) (or along the second axis (i.e., x-axis)), and the process can be repeated until all rows (or columns) of blister cavities 120 are filled. In some examples, the hopper 245 can release a single pill into each blister cavity 120. In other examples, the hopper 245 can release multiple pills into each blister cavity 120 (e.g., between two and eight pills, depending on the size of the blister cavity 120).

[0042] Figure 8Another example of a manifold 215A for use with an automatic blister board packaging machine 200 is illustrated. In the example shown, the manifold 215A includes two shared tracks or channels 270A that distribute medications to the packaging unit 210 through a shared outlet. For example, four silo slots 235 (and therefore silos 245) in a row of a multi-purpose medication cabinet 205 share half of the manifold 215A (i.e., the first channel 270A) to distribute medications through the first outlet, while four other silo slots 235 (and therefore silos 245) in the same row of the multi-purpose medication cabinet 205 share the other half of the manifold 215A (i.e., the second channel 270A) to distribute medications through the second outlet. In other examples, the manifold 215A may include a single shared track or channel that distributes medications through a single outlet. Thus, the illustrated example of the manifold 215 can only direct medications to two openings 575 (e.g., the second channel 270A) of the packaging unit 210 at a time. Fig.12 However, packaging unit 210 may be moved laterally to align different openings 575 in a row of openings 575 with the common outlet of manifold 215A.

[0043] Using the manifold 215A, only two of the bins 245 (e.g., one bin 245 associated with each common channel 270A) can release pills. The pills are then delivered to the associated blister cavities 120 of the blister board 100 through the shared outlet. After the associated blister cavities 120 in a row are filled, the packaging unit 210 can then move along the second axis (i.e., the x-axis) to fill the other blister cavities 120 in the row. Once a whole row of blister cavities 120 is filled, the packaging unit 210 can be transferred to the next row of blister cavities 120 along the first axis (i.e., the z-axis), and the process can be repeated. This process can be used to deliver a single pill to each blister cavity 120 of the blister board 100. Alternatively, multiple pills can be delivered to each blister cavity 120 of the blister board 100. For example, more than one bin 245 associated with each common channel 270A can release pills into the common channel 270A simultaneously (or relatively simultaneously) to deliver multiple pills to a single blister cavity 120. Alternatively, each bin 245 can release more than one pill into the common channel 270A. In some examples, a full row of blister cavities 120 may not be filled before the packaging unit 210 moves to the next row. Instead, the packaging unit 210 may move in a "zigzag" pattern along the first axis and the second axis to fill the blister cavities 120.

[0044] refer to Figure 5, the camera 275 is mounted at or near the junction of the conduit and the manifold 215. Each camera 275 is associated with one of the silos 245 supported in the multi-purpose medication cabinet 205. The camera 275 is operable to capture images and determine whether the appropriate amount and / or type of medicine is being dispensed from the silo 245. The camera 275 captures the image of the medicine leaving the multi-purpose medication cabinet 205 and compares the characteristics of the medicine (e.g., color, outline, size, shape, lettering, etc.) with the stored images of known medicines. In some examples, recognition software can be used to automatically compare the image captured by the camera with the stored image. In other examples, the captured image can be transmitted to a pharmacist or technician located at a distance, who analyzes the image and verifies that the correct amount and type of medicine has been dispensed. In a further example, the camera 275 can be an infrared sensor that only detects whether an object (e.g., a pill) falls through the multi-purpose medication cabinet 205, rather than identifying a specific type of medicine.

[0045] refer to FIG. 9A to FIG. 9B , the packaging unit 210 includes a first rail system 505 and a packaging device 510. The first rail system 505 includes a first rail 515 and a first rail driver 520 and moves the packaging device 510 along the Z axis of the automatic blister carton packaging machine 200 (see also Fig.10 ). In the example shown, the first rail 515 includes a fixed rail 525, a first movable rail 530 and a second movable rail 535. The fixed rail 525 is stationary and starts from the rear of the packaging unit 210 and extends, for example, to one-third of the length of the packaging unit 210. The first movable rail 530 slides along the fixed rail 525 and extends the first rail 515 to two-thirds of the length of the packaging unit 210. The second movable rail 535 slides along the first movable rail 530 and extends the first rail 515 to the entire length of the packaging unit 210. The packaging device 510 is attached to the second movable rail 535 to move with the second movable rail 535. The first rail 515 enables the packaging device 510 to be telescopic along the length of the packaging unit 210. The first rail driver 520 can be a motor assembly, an actuator, etc. that drives the packaging device 510 using the first rail 515.

[0046] refer to Fig.9A When in the first position, the packaging device 510 is within the automatic blister board packaging machine 200 and is not accessible to the pharmacist and / or technician. The first rail drive 520 moves the packaging device 510 below the manifold 215 within the automatic blister board packaging machine 200 to fill the blister board 100 arranged in the packaging device 510. Fig. 9BWhen in the second position, the packaging device 510 can still be in the automatic blister board packaging machine 200. However, at least a portion of the packaging device 510 can be approached by a user to pull the packaging device. When in the second position, the user can pull the packaging device 510 toward the user.

[0047] refer to Fig.10 , the packaging unit 210 further includes a second rail system 540. The second rail system 540 includes a second rail 545 and a second rail driver 550 and moves the packaging device 510 and the first rail system 505 along the X axis of the automatic blister paperboard packaging machine 200. The second rail 545 and the second rail driver 550 work similarly to the first rail 515 and the first rail driver 520 to move the packaging device 510 and the first rail system 505 along the X axis. Alternatively, in some examples, the second rail system 540 moves the packaging device 510 and the first rail system 505 drives the packaging device 510 and the second rail system 540. In other examples, different drive configurations can be used to move the packaging device within the automatic blister paperboard packaging machine 200, and to move the packaging device into and out of the automatic blister paperboard packaging machine.

[0048] refer to Figure 11 to Figure 12 , the packaging device 510 includes a packaging plate 555 and a packaging cover 560. The packaging plate 555 includes a blister opening 565 disposed in a blister paperboard receiving portion 570. The blister opening 565 accommodates the blister cavity 120 of the blister sheet 110. In the example shown, the blister opening 565 is a through hole extending through the packaging plate 555. The packaging cover 560 is hingedly connected to the packaging plate 555. The packaging cover 560 includes a top side and a bottom side opposite to the top side. The drug receiving opening 575 extends from the top side of the packaging cover 560 to the bottom side.

[0049] Fig.134 is a block diagram of an example inspection system 400 for an automatic blister carton packaging machine 200. In the example shown, the inspection system 400 includes an electronic processor 410, a memory 420, a transceiver 430 and an input / output interface 440, a first inspection camera system 450, a second inspection camera system 460, an additional camera 470, a first rail driver 520, and a second rail driver 550. The electronic processor 410, the memory 420, the transceiver 430, the input / output interface 440, the first inspection camera system 450, the second inspection camera system 460, the additional camera 470, the first rail driver 520, and the second rail driver 550 communicate via one or more control and / or data buses (e.g., a communication bus 480). In some examples, the inspection system 400 is part of the automatic blister carton packaging machine 200 and is located within the frame 220. In other examples, the inspection system 400 can be a separate device that is communicatively coupled to the automatic blister carton packaging machine 200. In these examples, components of the inspection system may be distributed between the frame 220 and the separate device. The inspection system 400 may be used with other blister carton packaging machines and may include more Fig.13 The components shown may be more or less components, depending on the blister carton packaging machine. In some examples, the inspection system 400 may be used independently of the automatic blister carton packaging machine 200 or other blister carton packaging machines, or may be used interoperably with the automatic blister carton packaging machine or other blister carton packaging machines.

[0050] In some examples, the electronic processor 410 is implemented as a microprocessor with an independent memory (such as memory 420). In other examples, the electronic processor 410 can be implemented as a microcontroller (on the same chip as the memory 420). In other examples, the electronic processor 410 can be implemented using multiple processors. In addition, the electronic processor 410 can be partially or completely implemented as, for example, a field programmable gate array (FPGA), an application specific integrated circuit (ASIC), etc., and the memory 420 can be modified accordingly without the need for the memory 420. In the example shown, the memory 420 includes a non-transient computer readable memory, which stores instructions, which are received and executed by the electronic processor 410 to implement the functions of the inspection system described herein. The memory 420 may include, for example, a program storage area and a data storage area. The program storage area and the data storage area may include a combination of different types of memories (such as read-only memory and random access memory).

[0051] The transceiver 430 enables wired or wireless communication between the inspection system 400 and other devices via one or more communication networks. In other examples, the transceiver 430 may include separate transmitting and receiving components, such as a transmitter and a receiver.

[0052] The input / output interface 440 may include one or more input mechanisms (e.g., a touch screen, a keyboard, buttons, knobs, etc.), one or more output mechanisms (e.g., a display, a printer, a speaker, etc.), or a combination thereof. The input / output interface 440 receives input from an input device actuated by a user and provides output to an output device with which the user interacts. In one example, the input / output interface 440 includes a display 490 (e.g., Figures 2 to 3 ), the display being configured to display images captured and processed by the inspection system 400.

[0053] The first inspection camera system 450 and the second inspection camera system 460 are configured to capture images of the blister board 100 during and / or after filling the blister board 100. The first inspection camera system 450 and the second inspection camera system 460 are configured to capture images from opposite sides of the blister board 100 and the blister cavity 120. For example, the first inspection camera system 450 includes one or more first inspection cameras 610 (see Figures 7 and 8 ), the one or more first inspection cameras are configured to capture an image of the contents of the blister cavity 120 from the open end of the blister cavity 120 (e.g., from above the blister cavity 120). The second inspection camera system 460 includes one or more second inspection cameras 620 (see Figures 7 and 8 ), the one or more second inspection cameras are configured to capture images of the contents of the blister cavity 120 from the closed end of the blister cavity 120 (e.g., from below the blister cavity 120). To capture images of the blister cavity 120, the first inspection camera system 450 and the second inspection camera system 460 can be arranged adjacent to the packaging unit 210 in the automatic blister carton packaging machine 200, as further described below. In some examples, the first inspection camera system 450 and the second inspection camera system 460 can be collectively referred to as camera systems 450, 460.

[0054] refer to Figure 7, the first inspection camera system 450 can be arranged near the manifold 215. The first inspection camera system 450 can include a plurality of first inspection cameras 610 arranged near the junction of the manifold 215 and the packaging unit 210. The plurality of first inspection cameras 610 can include one first inspection camera 610 for each track of the manifold 215. The first inspection camera 610 for each track can be arranged directly above the junction of the manifold 215 and the packaging unit 210. The first inspection camera 610 for each track is configured to capture an image of the blister cavity 120 corresponding to the track from above the blister cavity 120. The first inspection camera 610 can capture images before and / or after one or more pills are released into the blister cavity 120. In some examples, the first inspection camera system 450 and the corresponding plurality of first inspection cameras 610 can be arranged in other positions. In one example, the track of the manifold 215 can be bent backward toward the bottom end of the manifold 215 to guide the drug into the blister cavity 120. The first inspection camera system 450 can be disposed just above the curved portion and behind the manifold 215 so that a plurality of first inspection cameras 610 can see the blister cavity through the curved portion of the track. In some examples, the first inspection camera system 450 can include more or fewer first inspection cameras 610 than the number of tracks in the manifold 215. In these examples, the first inspection camera 610 or the packaging unit 210 can be moved to capture images from above the blister cavity 120.

[0055] refer to Figure 8 , the first inspection camera system 450 can be arranged near the manifold 215A. In this example, the first inspection camera system 450 can include two first inspection cameras 610, one inspection camera for each track 270A of the manifold 215A. Alternatively, the first inspection system 450 can include a single inspection camera that is visible to both tracks 270A. Track 270A includes a bend near the bottom end of the manifold 215A. Track 270A bends inward from the manifold 215A. The first inspection camera 610 is arranged near the junction of the manifold 215A and the packaging unit 210 and just above the bend of the track 270A, so that the first inspection camera 610 can see the blister cavity 120 through the bend of the track 270A. The first inspection camera 610 is configured to capture an image of the blister cavity 120 corresponding to the track 270A from above the blister cavity 120. The first inspection camera 610 can capture images before and / or after one or more pills are released into the blister cavity 120. In some examples, the first inspection camera system 450 and the corresponding plurality of first inspection cameras 610 may be arranged in other locations.

[0056] refer to Fig.10, the second inspection camera system 460 can be arranged in the automatic blister board packaging machine 200, below the packaging unit 210. The second inspection camera system 460 can include one or more second inspection cameras 620, which are configured to capture images of the blister cavities 120 from below the packaging device 510. The first inspection camera system 450 and the second inspection camera system 460 are therefore configured to capture images of the blister cavities 120 from the top and bottom of the blister board 100 during and / or after filling the blister board 100. In some examples, the second inspection camera system 460 and the corresponding one or more second inspection cameras 620 can be arranged in other locations, for example, on opposite sides of the packaging device 510.

[0057] In some examples, the first inspection camera system 450 and the second inspection camera system 460 may also include an integrated light (e.g., a flash) to illuminate the blister cavity 120 when taking an image. These lights may be activated when the cameras 610, 620 are capturing images of the blister cavity 120. In some embodiments, the first inspection camera system 450 is configured to capture images of individual blister cavities 120 from above during filling, while the second inspection camera system 460 is configured to capture images of the entire filled blister cardboard 100 from below after filling. In other examples, both the first inspection camera system 450 and the second inspection camera system 460 are configured to capture images of individual blister cavities 120 from above and below, respectively, during filling. In further examples, both the first inspection camera system 450 and the second camera inspection system 460 are configured to capture images of the entire blister cardboard 100 from above and below. In further examples, both the first inspection camera system 450 and the second camera inspection system 460 are configured to capture images of portions (eg, rows or columns) of the blister board 100 from above and below. The additional cameras 470 include the camera 275 and the camera system 305 .

[0058] Fig.141 is a flow chart illustrating an example method 1400 for the inspection of a blister board 100. The method 1400 is performed using the inspection system 400 and can be used to inspect the filling of the blister board 100 using the automatic blister board packaging machine 200, another blister board packaging machine or when filling manually. The method 1400 includes capturing a continuous plurality of images of blisters of the blister board 100 using the camera system 450, 460 (at box 1410). The continuous plurality of images can be captured during the filling of the blister board. For example, the continuous plurality of images can depict the blister after the continuous drug layer falls into the blister. In one example, capturing the continuous plurality of images includes capturing a plurality of images from above the blister cavity 120 using the first inspection camera system 450. In some embodiments, the electronic processor 410 controls the first inspection camera system 450 to capture one or more images of each blister cavity 120 in the blister board 100. In some examples, the continuous plurality of images of the blister cavity 120 is a collection of one or more images of each blister cavity 120 captured.

[0059] In some examples, one or more images are captured after each medication is dropped into the blister cavity 120. For example, when the blister cavity 120 is specified to accept three pills, three images of the blister cavity 120 are captured - one image is captured after each pill is dropped. In some examples, one or more images are captured after each pill is dropped into the blister cavity 120. The electronic processor 410 may divide the drop of the pills into multiple drops, each drop including one pill or more than one pill, depending on, for example, the arrangement of the hopper 245, the flow through the manifold 215, etc. For example, the first drop may include one pill and the second drop may include three pills. The electronic processor 410 captures a first image of the one or more images after the first drop and a second image of the one or more images after the second drop. It will be appreciated by those of ordinary skill in the art that the first image captured after the first drop is captured before the second drop is performed, and so on.

[0060] In some embodiments, the electronic processor 410 may be configured to capture one or more images after each medication layer is dropped. For example, the electronic processor 410 captures a first image after the first layer is dropped or added to the blister, and captures a second image after the second layer is dropped or added to the blister. In some examples, the electronic processor 410 may determine that a medication layer is added to the blister cavity 120 based on the number of pills added to the blister cavity 120, the size of one or more pills added to the blister cavity 120, the size (e.g., length and width) of the blister cavity 120, a combination of the foregoing, and the like. For example, a medication layer may be added to the blister cavity when four small pills are added to the blister cavity 120, or when two large pills are added to the blister cavity 120. In some examples, after the first medication layer is added to the blister cavity 120, a first image may be captured from above the blister cavity 120 using the first inspection camera system 450, and additionally, a second image may be captured from below the blister cavity 120 using the second inspection camera system 460.

[0061] In some embodiments, the user can select how often an image of the blister cavity 120 is captured by selecting the number of pills or pill volume that can be dropped into the blister cavity 120 without an image being captured. For example, the user can make a selection indicating that an image should be captured every three pills dropped into the blister cavity 120. In this example, an image of the blister cavity 120 is captured after three drops of one pill are completed, after one drop of three pills is completed, after a first drop of one pill and a second drop of two pills, and after a first drop of two pills and a second drop of one pill. In some examples, an image of the blister cavity 120 may be captured after the final drop of the blister cavity 120, even if less than the selected number of pills have been dropped or added to the blister cavity 120 since the last image was captured. For example, if the user selects 3 as the number of pills that can be dropped into the blister cavity without an image being captured, and only a single pill has been dropped into the blister cavity 120 since the last image was captured, but the blister cavity 120 has received its prescribed number of pills (filling of the blister cavity 120 is complete), an image of the blister cavity 120 is captured.

[0062] In some examples, each blister cavity 120 included in a row of the blister board 100 may be filled at the same time (or relatively at the same time). In these examples, the electronic processor 410 may control the first inspection camera system 450 to capture one or more images of each row of blister cavities 120, rather than capturing one or more images of each blister cavity 120, and the consecutive multiple images of the blister cavities 120 may be a collection of one or more images captured for each row of blister cavities 120 included in the blister board 100. In some examples, the electronic processor 410 may segment the image of a row of blister cavities 120 into multiple individual blister cavities 120 images.

[0063] In other examples, each blister cavity 120 included in a column of the blister board 100 may be filled at the same time (or relatively at the same time). In these examples, the electronic processor 410 may control the first inspection camera system 450 to capture one or more images of each column of blister cavities 120, rather than one or more images of each blister cavity 120, and the consecutive multiple images of the blister cavities 120 may be a collection of one or more images captured for each column of blister cavities 120 included in the blister board 100. In some examples, the electronic processor 410 may segment the image of a column of blister cavities 120 into multiple individual blister cavities 120 images.

[0064] In some examples, after filling, e.g., after all desired pills or prescription drugs have fallen into corresponding blister cavities 120, but before sealing the blister board 100, the electronic processor 410 captures an image of the entire blister board 100. The image of the filled blister board 100 can be the last image in a series of images captured. In one example, the image of the blister board 100 can be captured from below the blister board 100 (e.g., from below the blister cavity 120) using the second inspection camera system 460. In some examples, such as Figures 15 to 18 As shown, each of the consecutive multiple images can be captured and displayed from the same orientation.

[0065] In some examples, the electronic processor 410 may create an image of the blister board 100 after filling by combining images captured during filling of the blister board 100 using known image processing techniques, rather than capturing an image of the entire blister board 100. For example, when the blister board 100 includes a plurality of blister cavities 120, for each blister cavity 120 of the blister board 100, an image of the filled blister board 100 may be created using an image of the filled blister cavity 120.

[0066] The method 1400 includes displaying an inspection image of at least a portion of the blister board on the user interface (at block 1420). In some examples, the inspection image is an image of the entire filled blister board 100 or a portion of the filled blister board 100. In one example, the display 490 is used to inspect the filled blister board 100. In other examples, a separate display of a separate device, such as a communication connection to the automatic blister board packaging machine 200 or the inspection system 400, is used to inspect the filled blister board 100. The electronic processor 410 generates to display an inspection screen for inspecting the filled blister board 100 to the user. The inspection image of the blister board 100 is displayed on the inspection screen.

[0067] Fig.15 An example inspection screen 1500 for inspecting a filled blister board 100 generated by the electronic processor 410 is illustrated. In the example shown, the inspection screen 1500 includes an image pane 1510, a job pane 1520, a reference pane 1530, and a navigation pane 1540. The image pane 1510 includes an image 1550 of the blister board 100 and a label 1560 associated with the image 1550 of the blister board 100. The label 1560 includes, for example, a date and a dosing time corresponding to the blister cavity 120 of the blister board 100. The labels 1560 are arranged on the image pane 1510 so that each label in the plurality of labels 1560 corresponds to a row or column of the blister board 100 in the image 1550 of the blister board 100. The label 1560 can be selected to select a row or column of blister cavities 120 of the blister board 100.

[0068] The operation pane 1520 displays information related to the prescription. For example, the operation pane 1520 may display the name of the patient, the name of the institution, the number of the blister cardboard 100, the packaging time, etc. The reference pane 1530 displays information and / or images related to the pills or drugs packaged into the blister cardboard 100 in the image 1550 of the blister cardboard 100. For example, the reference pane 1530 may display a reference image of the pills or drugs, an NDC code, characteristics of the pills or drugs (e.g., shape, color, size, lettering, etc.), etc. Although in Figures 15 to 18Not shown in the figure, the reference pane 1530 can also display the SIG code associated with the pill or medicine. The SIG code can tell the user (e.g., pharmacist) when and how often the pill or medicine should be taken (e.g., once a day, twice a day, at night, etc.). The reference information related to the pill can be obtained from the National Drug Code (NDC) database or other publicly available or privately created drug databases. The navigation pane 1540 displays navigation buttons 1570 for navigating between filled blister boards 100. In the example shown, the navigation buttons 1570 include an Approve Board button for approving the filled blister board 100, a Previous Board button for viewing the previously displayed blister board 100, and a Rework Board button for providing instructions for repackaging the blister board 100.

[0069] return Fig.14 , the method 1400 includes receiving a selection of a blister via the user interface after displaying the verification image (at block 1430). In some examples, the selection of a blister can include a selection of a plurality of blisters (e.g., one or more blister cavities 120 of a blister board 100). In some cases, the user may not be able to see all of the pills within the blister cavity 120 from the image of the blister cavity 120. In these cases, the user may want to use additional images to verify the filling of the blister cavity 120. The user can select one or more blister cavities 120 in the image pane 1510 (see Fig.15 ). In one example, a user may select one of the tabs 1560 of the image pane 1510 (e.g., click on the tab or hover over the tab) to select a row or column of blister cavities 120. In another example, a user may select (e.g., click on the portion or hover over the portion) on a portion of the image 1550 of the blister board 100 that corresponds to a desired blister cavity 120 (e.g., on the blister cavity 120). In this example, the electronic processor 410 performs known image processing techniques to segment the image 1550 of the blister board 100 according to the number of blister cavities 120 present in the image 1550. The electronic processor 410 assigns each portion of the image 1550 to the blister cavity 120 shown in that portion of the image 1550, so that when the portion of the image 1550 is selected, the electronic processor 410 interprets the action as a selection of the blister cavity 120 shown in that portion of the image 1550.

[0070] In some embodiments, when a user hovers a cursor over a particular blister cavity 120, a pop-up window including what pills are expected in the blister cavity 120 may be displayed. For example, the electronic processor 410 may detect a hover action on a blister. The hover action may include, for example, determining that the cursor is on a portion of the screen for a specific amount of time, that the cursor moves on a portion of the screen, and the like. The electronic processor 410 may then detect the blister associated with that portion of the screen. The electronic processor 410 generates a pop-up window including a list of expected pills expected in the blister. The pop-up window may be a temporary window that may only be displayed when the cursor is on the blister and may disappear when the cursor is moved away from the blister. The pop-up window may not be a separate window, but may include a pop-up box generated on the current window displaying the blister. That is, the pop-up box may be displayed within or on the image pane 1510.

[0071] The method 1400 includes displaying a continuous plurality of images via a user interface in response to receiving the selection (at block 1440). The continuous plurality of images includes, for example, one or more images captured for a blister at block 1410. In some examples, when the blister board 100 includes a greater number of blister cavities 120 than the number of blister cavities 120 selected, a subset of the plurality of images corresponding to the selected one or more blister cavities 120 is displayed via the user interface. The continuous plurality of images (or a subset thereof) may be displayed in various ways to show the selected blister, as further explained below.

[0072] exist Fig.16A and Fig. 16B In the example of FIG. 1 , a subset of the continuous plurality of images 1610 corresponding to one or more selected blister cavities 120 is displayed in the image pane 1510 of the inspection screen 1500. In this example, the image 1550 of the blister board 100 is cropped to show only the selected one or more blister cavities 120. The subset of the continuous plurality of images 1610 corresponding to the selected one or more blister cavities 120 is displayed adjacent to the cropped image 1620 of the selected one or more blister cavities 120. In one example, the subset of the continuous plurality of images 1610 is displayed above the cropped image 1620 (see FIG. 1 ). Fig.16A ) or below (see Fig. 16B). In some examples, a subset of the continuous plurality of images is displayed to the left or right of the cropped image 1620. The subset of the continuous plurality of images 1610 corresponding to the first blister cavity 120 and a portion of the cropped image 1620 corresponding to the first blister cavity 120 may be arranged so that the first blister cavity 120 appears in the same row or column of the combined display of the subset of the continuous plurality of images 1610 and the cropped image 1620. In some examples, the continuous plurality of images 1610 or the cropped image 1620 may be flipped vertically and / or horizontally (i.e., mirrored) so that the pills in both the plurality of images 1610 and the cropped image 1620 are aligned with each other, for example, in the same orientation.

[0073] exist Fig.17 In the example of FIG. 1 , a subset of the continuous plurality of images 1610 can be displayed in a second image pane 1630 (e.g., in the same window). The electronic processor 410 modifies the inspection screen to add the second image pane 1630 adjacent to (e.g., above, below, to the left, or to the right of) the image pane 1510 (e.g., the first image pane). Even if the subset of the continuous plurality of images 1610 is displayed in a separate pane, the subset of the continuous plurality of images 1610 can be displayed as in reference to FIG. Fig.16A and Fig. 16B Arranged similarly as described. Fig.18 In the example of , a subset of the continuous plurality of images 1610 can be displayed in a separate window. The separate window can be a new window or a pop-up window.

[0074] The present invention therefore provides, inter alia, an inspection system for an automatic blister carton packaging machine.

Claims

1. An inspection system for a blister paperboard packaging system, the inspection system comprising: An electronic processor configured to: capturing a plurality of successive images of blisters of a blister board; displaying an inspection image of at least a portion of the blister board; receiving a selection of the blister after displaying the inspection image; as well as The sequential plurality of images is displayed in response to receiving the selection.

2. The inspection system according to claim 1, wherein: The successive plurality of images depict the blister after successive layers of medication have been dropped into the blister, and the electronic processor is further configured to: A selection of a volume of drug corresponding to each of the successive layers is received.

3. The inspection system according to claim 1, wherein: A final image in the continuous plurality of images is captured after the blister is filled with a prescribed amount of medication and before the blister cardboard is sealed, wherein the verification image is the final image in the continuous plurality of images.

4. The inspection system according to claim 3, wherein: The electronic processor is further configured to: generating an inspection screen including an image pane, a job pane, a reference pane, and a navigation pane, wherein: the inspection image is displayed in the image pane together with a plurality of labels, each label of the plurality of labels corresponding to a row or a column of the blister cardboard in the inspection image, for each medication included in the blister cardboard, displaying in the reference pane one or more reference images, an NDC code, one or more characteristics, and a SIG code, wherein the SIG code informs a user when the medication should be taken, how often the medication should be taken, or both, and One or more navigation buttons are displayed in the navigation pane, the one or more navigation buttons comprising at least one item selected from the group consisting of: an Approve Sheet button for approving the blister sheet, a Previous Sheet button for viewing a previously displayed blister sheet, and a Rework Sheet button for providing instructions for repacking the blister sheet.

5. The inspection system according to claim 4, wherein: The electronic processor is configured to receive a selection of the blister by: A selection is received of one selected from the group consisting of: a label of the plurality of labels corresponding to the blister and a portion of the inspection image corresponding to the blister.

6. The inspection system according to claim 1, wherein: The electronic processor is configured to, in response to receiving the selection, display the sequential plurality of images by: The continuous plurality of images are displayed adjacent to a cropped image of the blister cardboard including only the blisters such that a portion of the cropped image corresponding to the blisters appears in the same row or column as the continuous plurality of images corresponding to the blisters.

7. The inspection system according to claim 1, wherein: The electronic processor is further configured to: detecting a hovering action over the blister in the image displayed for inspection; and A pop-up window is generated, the pop-up window including a list of medications expected in the blister.

8. A method for inspecting blister paperboard, the method comprising: capturing a plurality of successive images of blisters of a blister board; displaying an inspection image of at least a portion of the blister board; receiving a selection of the blister after displaying the inspection image; as well as The sequential plurality of images is displayed in response to receiving the selection.

9. The method according to claim 8, wherein: The successive plurality of images depict the blister after successive layers of medication have been dropped into the blister, and the method further comprises: A selection of a volume of drug corresponding to each of the successive layers is received.

10. The method according to claim 8, wherein: A final image in the continuous plurality of images is captured after the blister is filled with a prescribed amount of medication and before the blister cardboard is sealed, and the verification image is the final image in the continuous plurality of images.

11. The method according to claim 10, further comprising: generating an inspection screen including an image pane, a job pane, a reference pane, and a navigation pane, wherein: the inspection image is displayed in the image pane together with a plurality of labels, each label of the plurality of labels corresponding to a row or a column of the blister cardboard in the inspection image, for each medication included in the blister cardboard, displaying in the reference pane one or more reference images, an NDC code, one or more characteristics, and a SIG code, wherein the SIG code informs a user when the medication should be taken, how often the medication should be taken, or both, and One or more navigation buttons are displayed in the navigation pane, the one or more navigation buttons comprising at least one item selected from the group consisting of: an Approve Sheet button for approving the blister sheet, a Previous Sheet button for viewing a previously displayed blister sheet, and a Rework Sheet button for providing instructions for repacking the blister sheet.

12. The method according to claim 11, wherein: Receiving a selection of said blister includes: A selection is received of one selected from the group consisting of: a label of the plurality of labels corresponding to the blister and a portion of the inspection image corresponding to the blister.

13. The method according to claim 8, wherein: Displaying the sequential plurality of images in response to receiving the selection comprises: The continuous plurality of images are displayed adjacent to a cropped image of the blister cardboard including only the blisters such that a portion of the cropped image corresponding to the blisters appears in the same row or column as the continuous plurality of images corresponding to the blisters.

14. The method according to claim 8, further comprising: detecting a hovering action over the blister in the image displayed for inspection; as well as A pop-up window is generated, the pop-up window including a list of medications expected in the blister.

15. A blister paperboard packaging system, comprising: An electronic processor configured to: capturing a plurality of successive images of blisters of a blister board; displaying an inspection image of at least a portion of the blister board; receiving a selection of the blister after displaying the inspection image; as well as The sequential plurality of images is displayed in response to receiving the selection.

16. The blister paperboard packaging system of claim 15, wherein: The successive plurality of images depict the blister after successive layers of medication have been dropped into the blister, and the electronic processor is further configured to: A selection of a volume of drug corresponding to each of the successive layers is received.

17. The blister paperboard packaging system of claim 15, wherein: A final image in the continuous plurality of images is captured after the blister is filled with a prescribed amount of medication and before the blister cardboard is sealed, and the verification image is the final image in the continuous plurality of images.

18. The blister paperboard packaging system of claim 17, wherein: The electronic processor is further configured to: generating an inspection screen including an image pane, a job pane, a reference pane, and a navigation pane, wherein: the inspection image is displayed in the image pane together with a plurality of labels, each label of the plurality of labels corresponding to a row or a column of the blister cardboard in the inspection image, for each medication included in the blister cardboard, displaying in the reference pane one or more reference images, an NDC code, one or more characteristics, and a SIG code, wherein the SIG code informs a user when the medication should be taken, how often the medication should be taken, or both, and One or more navigation buttons are displayed in the navigation pane, the one or more navigation buttons comprising at least one item selected from the group consisting of: an Approve Sheet button for approving the blister sheet, a Previous Sheet button for viewing a previously displayed blister sheet, and a Rework Sheet button for providing instructions for repacking the blister sheet.

19. The blister paperboard packaging system of claim 18, wherein: The electronic processor is configured to receive a selection of the blister by: A selection is received of one selected from the group consisting of: a label of the plurality of labels corresponding to the blister and a portion of the inspection image corresponding to the blister.

20. The blister paperboard packaging system of claim 15, wherein: The electronic processor is configured to, in response to receiving the selection, display the sequential plurality of images by: The continuous plurality of images are displayed adjacent to a cropped image of the blister cardboard including only the blisters such that a portion of the cropped image corresponding to the blisters appears in the same row or column as the continuous plurality of images corresponding to the blisters.

Images