Individual information registration device, individual authentication device, and individual authentication system

Abstract

To authenticate a package by acquiring individual information of the package in which a product is packaged.SOLUTION: The individual information registration apparatus includes an acquisition unit configured to acquire a plurality of captured images obtained by imaging a package in which an object is packaged, a feature acquisition unit configured to analyze each of the plurality of captured images to acquire a feature vector of a packaging material forming the package, and a feature registration unit configured to register the feature vector of the packaging material.SELECTED DRAWING: Figure 6

Description

[Technical Field]

[0001] The present disclosure relates to an individual information registration device, an individual authentication device, and an individual authentication system. [Background technology]

[0002] Patent Document 1 discloses an electromagnetic wave reading type condition detection system. The condition detection system includes an electromagnetic wave responsive material arranged in a state where it is sensitive to the material condition of the object to be detected in the object to be inspected, a reader that transmits electromagnetic waves from outside the object to a position in the object to be inspected where the electromagnetic wave responsive material is arranged and receives the reflected waves to obtain a spectrum of the reflected waves, and an analyzer that estimates the material condition in the object to be inspected at a first time based on a spectrum obtained at the same position in the object to be inspected at a first time and a spectrum obtained at a second time earlier than the first time. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] International Publication No. 2022 / 239427 Summary of the Invention [Problem to be solved by the invention]

[0004] The present disclosure has been devised in consideration of the above-described conventional circumstances, and aims to provide an individual information registration device, an individual authentication device, and an individual authentication system that acquire individual information of a package in which a product is packed and enable authentication of the package. [Means for solving the problem]

[0005] The present disclosure provides an individual information registration device including an acquisition unit that acquires a plurality of captured images of a package that packages an object, a feature acquisition unit that analyzes each of the plurality of captured images to acquire a feature vector of a packaging material that forms the package, and a feature registration unit that registers the feature vector of the packaging material.

[0006] The present disclosure also provides an individual authentication device including an acquisition unit that acquires an image of a package that packs an object, a feature acquisition unit that analyzes the image and acquires a feature vector of a packaging material that forms the package, and an individual authentication unit that authenticates the package based on the acquired feature vector of the packaging material and the feature vector of a registered packaging material that forms at least one registered package that has been registered in advance.

[0007] The present disclosure also provides an individual authentication system including a registration device provided at a first logistics base among multiple logistics bases through which packages containing objects are distributed, the registration device generating a database of the packages, and an authentication device provided at a second logistics base different from the first logistics base and communicatively connected to the database, wherein the registration device acquires a plurality of first captured images of the packages at the first logistics base, analyzes each of the plurality of first captured images to acquire feature vectors of the packaging materials that form the packages, and registers the feature vectors for each package in the database; and the authentication device acquires a second captured image of the packages at the second logistics base, analyzes the second captured images to acquire feature vectors of the packaging materials that form the packages, and authenticates the packages at the second logistics base based on the acquired feature vectors of the packaging materials and the feature vectors of at least one of the packaging materials registered in the database. [Effects of the Invention]

[0008] According to the present disclosure, individual information of the package in which the product is packed can be obtained, enabling authentication of the package. [Brief explanation of the drawings]

[0009] [Figure 1] FIG. 1 is a diagram showing an example of a system configuration of an individual authentication system according to a first embodiment and a second embodiment. [Figure 2] A block diagram showing an example of the internal configuration of a registration device. [Figure 3] Block diagram showing an example of the internal configuration of an authentication device [Figure 4] FIG. 10 is a diagram showing an example of an imaging area of ​​a package. [Figure 5] Schematic diagram showing an example of capturing a registration image or authentication image of a package [Figure 6] FIG. 10 shows an example of acquiring a registration image or authentication image of a package and an example of displaying an authentication result in the first embodiment. [Figure 7] A diagram showing an example of a millimeter wave image. [Figure 8] 1 is a flowchart showing an example of an individual registration procedure of the individual authentication system according to the first embodiment; [Figure 9] 1 is a flowchart showing an example of an individual authentication procedure of the individual authentication system according to the first embodiment; [Figure 10] FIG. 1 is a diagram showing an example of a registration image vector database. [Figure 11] FIG. 1 is a diagram illustrating an example of individual authentication. [Figure 12] FIG. 10 shows an example of acquiring a registration image or authentication image of a package and an example of displaying an authentication result in the second embodiment. [Figure 13] A diagram showing an example of a thermographic image [Figure 14] 10 is a flowchart showing an example of an individual registration procedure of an individual authentication system according to a second embodiment. [Figure 15] 10 is a flowchart showing an example of an individual authentication procedure of an individual authentication system according to a second embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0010] (Background to this disclosure) In recent years, counterfeit goods that imitate original products have been mixed in with the logistics of transporting products to their destinations. However, products are usually transported packaged in predetermined packaging materials (for example, cardboard, wood, or plastic (resin) materials). Therefore, it has been difficult for workers who transport products in and out to distinguish whether a product is genuine or a counterfeit by appearance.

[0011] Conventional technologies for identifying whether a product is genuine or counterfeit involve assigning a physical identifier (e.g., ID, serial number, two-dimensional barcode, or Radio Frequency Identification (RFID) tag) to each package at each logistics base (e.g., a stopover or destination on the transportation route), and then authenticating the package based on the identifier to determine whether the product is genuine. However, conventional packaging authentication technologies require an identifier to be assigned to each package, which poses the problem of increasing the time required to assign identifiers in proportion to the number of products, resulting in increased transportation costs.

[0012] Furthermore, Patent Document 1 discloses a condition detection system that estimates the material condition (condition of the object) contained in an object to be inspected (package). However, because the condition detection system aims to estimate the material condition (condition of the object), it is difficult to divert it to use for authenticating the product itself inside the object to be inspected using electromagnetic waves.

[0013] Therefore, in each of the embodiments described below, examples of an individual information registration device, an individual authentication device, and an individual authentication system that acquire individual information of a package in which a product is packed and enable authentication of the package will be described.

[0014] Hereinafter, with reference to the drawings as appropriate, detailed embodiments of the individual information registration device, individual authentication device, and individual authentication system according to the present disclosure will be described in detail. However, more detailed description than necessary may be omitted. For example, detailed descriptions of well-known matters or redundant descriptions of substantially identical configurations may be omitted. This is to avoid unnecessary redundancy in the following description and to facilitate understanding by those skilled in the art. Note that the accompanying drawings and the following description are provided to enable those skilled in the art to fully understand the present disclosure, and are not intended to limit the subject matter recited in the claims.

[0015] An overview of the individual authentication systems 100, 100A according to the present disclosure will be described with reference to FIG. 1. FIG. 1 is a diagram showing an example of the system configuration of the individual authentication systems 100, 100A according to the first and second embodiments. Note that the individual authentication systems 100, 100A shown in FIG. 1 are merely examples and are not limited to this. Furthermore, in this disclosure, for ease of understanding, an example will be described in which the packaging material is cardboard, but the packaging material is not limited to this. The packaging material in the present disclosure may be made of paper, wood, resin, or the like, and may be realized, for example, by cardboard, a wooden box, a plastic box, or the like.

[0016] In a logistics process in which a package BX, which is a product packed in a packaging material (see FIG. 4), is transported and moved between multiple logistics bases, the individual authentication systems 100, 100A perform individual authentication to determine whether the package BX (product) moving between multiple logistics bases (for example, a product shipping base, a relay base on a transportation route, or a destination base where the product is to be delivered) is the same individual, based on feature quantities of the packaging material obtained from the packaging material. The individual authentication systems 100, 100A include a multi-scanner, a registration device P1, a registration image vector database DB, at least one authentication device P2, and a network NW.

[0017] The multi-scanner and registration device P1 is installed at a site A where a packing process in which a product is packed in a packing material or a collection process in which a product packed in a packing material (package BX) is collected is performed. The multi-scanner and registration device P1 acquires and registers features that indicate the individuality of the packing material and are used to authenticate the package BX.

[0018] The multi-scanner and authentication device P2 is installed at one or more bases B where a receiving process of receiving (carrying in) a product packed in a packaging material (package BX) or a delivery process of delivering (carrying out) a product packed in a packaging material to another base is performed. The multi-scanner and authentication device P2 acquires and authenticates the features of the packaging material.

[0019] The individual authentication system 100 according to the first embodiment uses a multi-scanner MLT1 installed at each location to detect and capture an image of the package BX. The multi-scanner MLT1 includes at least a millimeter-wave computed tomography (hereinafter, abbreviated as "CT") scanner MSC (see FIGS. 5 and 6), and captures an image of the package BX using the millimeter-wave CT scanner MSC.

[0020] The individual authentication system 100A according to the second embodiment uses a multi-scanner MLT2 installed at each base to detect and capture an image of the package BX. The multi-scanner MLT2 includes at least a thermal camera CM (see FIGS. 5 and 12), and captures an image of the package BX using the thermal camera CM.

[0021] First, an individual authentication system 100 according to the first embodiment that performs individual authentication of a package BX using a millimeter wave CT scanner MSC will be described.

[0022] (Embodiment 1) An example of the internal configuration of each of the registration device P1 and the authentication device P2 will be described with reference to Fig. 2 and Fig. 3. Fig. 2 is a block diagram showing an example of the internal configuration of the registration device P1. Fig. 3 is a block diagram showing an example of the internal configuration of the authentication device P2.

[0023] The registration device P1 includes a communication unit 10, a processor 11, and a memory 12.

[0024] The communication unit 10 is connected to the multi-scanner MLT1 corresponding to the registration device P1 and the registration image vector database DB so that data can be transmitted and received between them. The communication unit 10 transmits various data output from the processor 11 to the registration image vector database DB. The communication unit 10 also outputs various data (various information) transmitted from the multi-scanner MLT1 to the processor 11.

[0025] Processor 11 is configured using, for example, a Central Processing Unit (hereinafter referred to as "CPU"), a Digital Signal Processor (hereinafter referred to as "DSP"), or a Field Programmable Gate Array (hereinafter referred to as "FPGA"), and performs various processes and controls in cooperation with memory 12. Specifically, processor 11 references the programs and data stored in memory 12 and executes the programs to realize the functions of image acquisition unit 111, registration image vector generation unit 112, image vector centroid generation unit 113, etc.

[0026] The image acquisition unit 111 acquires a millimeter-wave image IMG11 (see FIG. 7 ) obtained by capturing an area including the imaging area AR of the package BX using the millimeter-wave CT scanner MSC of the multi-scanner MLT1 via the communication unit 10. The image acquisition unit 111 outputs the acquired millimeter-wave image IMG11 to the registration image vector generation unit 112.

[0027] The registration image vector generation unit 112 analyzes the millimeter wave image IMG11 (i.e., the registration image) output from the image acquisition unit 111 using a similarity calculation model that calculates the similarity of images, and acquires individual information specific to the internal structure of the packaging material that forms the packaged item BX (for example, the uneven pattern of the core inside the cardboard, or the depth of the unevenness, etc.). Based on the acquired internal structure characteristics, the registration image vector generation unit 112 generates two-dimensional vector data (hereinafter referred to as "registration image vector data") that is a feature of the internal structure of the packaging material and indicates the individuality of the packaged item BX.

[0028] Specifically, the registration image vector generation unit 112 converts the characteristics of the internal structure of the packaging material from the millimeter wave image IMG11 into high-dimensional (e.g., 768-dimensional) vector data by analyzing the millimeter wave image IMG11 using a similarity calculation model, and acquires this high-dimensional vector data as registration image vector data for the millimeter wave image IMG11, which is the registration image.

[0029] The registration image vector generation unit 112 generates a predetermined number of registration image vectors for one packing item BX based on each of a predetermined number (e.g., 25, 30, etc.) of millimeter-wave images of one packing item BX. The registration image vector generation unit 112 outputs information on the generated predetermined number of registration image vectors to the image vector centroid generation unit 113.

[0030] The image vector centroid generation unit 113 calculates the centroid of the registration image vector of the packing item BX based on the predetermined number of registration image vectors output from the registration image vector generation unit 112. The image vector centroid generation unit 113 associates the position information of the predetermined number of registration image vectors, information on the centroid positions of the registration image vectors, and identification information for identifying the packing item BX, and stores (registers) them in the registration image vector database DB.

[0031] The memory 12 includes a read-only memory (hereinafter referred to as "ROM") and a random access memory (hereinafter referred to as "RAM"). The ROM stores programs that define the processing (operations) of the processor 11, and data that is referenced when the programs are executed. The RAM is a working memory used when the processor 11 executes the processing (operations), and temporarily stores data or information generated or acquired during each process.

[0032] The registration image vector database DB is a so-called storage, and is configured using a storage medium such as a flash memory, a hard disk drive (HDD), a solid state drive (SSD), etc. The registration image vector database DB stores (registers) for each package BX, in association with the position information of a predetermined number of registration image vectors, information on the center of gravity positions of the registration image vectors, and identification information for identifying the package BX.

[0033] The authentication device P2 includes a communication unit 20, a processor 21, and a memory 22.

[0034] The communication unit 20 is connected to the multi-scanner MLT1 corresponding to the authentication device P2 and the registration image vector database DB so that data can be transmitted and received between them. The communication unit 20 transmits various data output from the processor 21 to the registration image vector database DB. The communication unit 20 also outputs various data (various information) transmitted from the multi-scanner MLT1 to the processor 21.

[0035] The processor 21 is configured using, for example, a CPU, a DSP, or an FPGA, and performs various processes and controls in cooperation with the memory 22. Specifically, the processor 21 references the programs and data stored in the memory 22 and executes the programs to realize the functions of an image acquisition unit 211, an authentication image vector generation unit 212, an image similarity calculation unit 213, an authentication unit 214, and the like.

[0036] The image acquisition unit 211 acquires a millimeter-wave image IMG11 (see FIG. 7 ) obtained by capturing an area including the imaging area AR of the package BX using the millimeter-wave CT scanner MSC of the multi-scanner MLT1 via the communication unit 20. The image acquisition unit 211 outputs the acquired millimeter-wave image IMG11 to the authentication image vector generation unit 212.

[0037] The authentication image vector generation unit 212 analyzes the millimeter-wave image IMG11 (i.e., the authentication image) output from the image acquisition unit 211 using a similarity calculation model that calculates the similarity of images, and acquires individual information specific to the internal structure of the packaging material that forms the packaged item BX (for example, the uneven pattern of the core inside the cardboard, or the depth of the unevenness, etc.). Based on the acquired internal structure features, the authentication image vector generation unit 212 generates two-dimensional vector data (hereinafter referred to as "authentication image vector data") that is a feature of the internal structure of the packaging material and indicates the individuality of the packaged item BX. The authentication image vector generation unit 212 outputs information on the generated authentication image vector to the image similarity calculation unit 213.

[0038] Specifically, the authentication image vector generation unit 212 converts the features of the internal structure of the packaging material from the millimeter-wave image IMG11 into high-dimensional (e.g., 768-dimensional) vector data by analyzing the millimeter-wave image IMG11 using the similarity calculation model. The authentication image vector generation unit 212 acquires this high-dimensional vector data as authentication image vector data of the millimeter-wave image IMG11, which is the authentication image.

[0039] Image similarity calculation unit 213 acquires the authentication image vector output from authentication image vector generation unit 212, and acquires the registration image vector that is most similar to the authentication image vector based on the distance between the authentication image vector and the center of gravity of the registration image vector registered in registration image vector database DB. Image similarity calculation unit 213 outputs information about the acquired registration image vector to authentication unit 214.

[0040] Furthermore, the image similarity calculation unit 213 calculates a score indicating the degree of similarity between the package BX shown in the authentication image and the package BX indicated by the registration image vector, based on the calculated distance between each vector. The image similarity calculation unit 213 associates information about the calculated score with identification information about the package BX and outputs and stores it in the memory 22. Note that, as an example, the score in the present disclosure decreases as the distance between the vectors decreases.

[0041] In this disclosure, an example will be described in which the package BX is identified based on the distance between the authentication image vector and the center of gravity of the registration image vector, but the method for identifying the package BX is not limited to this. The value used to identify the package BX may be a statistical representative value such as the median of the vector, the center of a cluster obtained by principal component analysis, or the k-means method.

[0042] The authentication unit 214 performs individual authentication of the package BX based on the identification information of the package BX, based on whether the registration image vector most similar to the authentication image vector matches the registration image vector at the time of registration. The authentication unit 214 further associates the result of the individual authentication (i.e., information on authentication "OK" or authentication "NG") with the recorded calculated score information and the identification information of the package BX, and records them in the memory 22.

[0043] The memory 22 includes a ROM and a RAM. The ROM stores a program that defines the processing (operation) of the processor 21, and data that is referenced when the program is executed. The RAM is a work memory used when the processor 21 executes the processing (operation), and temporarily stores data or information generated or acquired in each process. The memory 22 records the individual authentication results of the package BX.

[0044] The display unit 23 is configured using, for example, a Liquid Crystal Display (LCD) or an organic electroluminescence (EL) display. The display unit 23 displays a screen MNT (see FIG. 6) including the authentication result of the package BX output from the processor 21.

[0045] Next, the imaging area AR will be described with reference to Fig. 4. Fig. 4 is a diagram showing an example of the imaging area AR of the package BX.

[0046] The package BX has an imaging area AR that is imaged by the millimeter-wave CT scanner MSC or the thermal camera CM. The imaging area AR is an area set in the upper part of one side of the package BX. The imaging area AR imaged by the registration device P1 and the imaging area AR imaged by the authentication device P2 are set on the same side and in the same area (position).

[0047] In the individual authentication systems 100 and 100A of the present disclosure, the imaging area AR is set on one side of the package BX, thereby more effectively suppressing a decrease in individual authentication accuracy due to changes (deformations) in the internal structure of the packaging material used for individual authentication (for example, the uneven pattern or depth of the unevenness of the core of the cardboard) caused by the placement of other packages or collision with other packages, obstacles, etc. In particular, when the packaging material is cardboard, the core, which is the internal structure, has high resistance to external forces (loads) along the vertical direction (gravity direction), which is the extension direction of the core. Therefore, in the individual authentication systems 100 and 100A, the imaging area AR is set on the top surface (ceiling surface) on which other packages are placed, or on a side other than the bottom that comes into contact with other packages, the floor, the ground, etc., thereby suppressing changes in the internal structure used for individual authentication.

[0048] Furthermore, by setting the imaging area AR at the upper part of one side of the package BX, the individual authentication systems 100, 100A can minimize the influence of the product packed inside the package BX, more effectively capture the internal structure of the package itself, and more effectively prevent a decrease in individual authentication accuracy. Specifically, the internal information captured in the image captured by the millimeter-wave CT scanner MSC or thermal camera CM may change due to the influence of the product inside the package BX. However, when the imaging area AR is set at the upper part of one side of the package BX, if the package BX is not filled to the top with products or cushioning material, etc., it is possible to prevent a decrease in the internal structure feature amount captured due to the influence of the product inside the package BX.

[0049] Next, examples of detection and imaging of the packing item BX will be described with reference to Fig. 5 and Fig. 6. Fig. 5 is a schematic diagram showing an example of acquiring a registration image or authentication image of the packing item BX. Fig. 6 is a diagram showing an example of acquiring a registration image or authentication image of the packing item BX and an example of displaying an authentication result in the first embodiment.

[0050] The stage STG is placed with the package BX on which the detection process and the image capture process are performed by the multi-scanner MLT1. The stage STG may be a so-called belt conveyor that can transport the package BX.

[0051] The multi-scanner MLT1 includes a marker illuminator LS that irradiates markers Mk1 and Mk2 onto the package BX to detect the position of the imaging area AR of the package BX on the stage STG, and a millimeter wave CT scanner MSC that images the package BX.

[0052] The marker illuminator LS is a so-called laser illuminator that irradiates a laser beam from two different directions (for example, 45° relative to the surface of the imaging area AR) toward the side of the package BX where the imaging area AR is set. The laser irradiated by the marker illuminator LS provides markers Mk1 and Mk2 on the imaging area AR to detect the position of the imaging area AR of the package BX.

[0053] The registration device P1 and the authentication device P2 use a marker illuminator LS to irradiate two markers Mk1 and Mk2 onto an imaging area AR, and use a millimeter-wave CT scanner MSC to capture (scan) the imaging area AR illuminated with the markers Mk1 and Mk2. The registration device P1 and the authentication device P2 detect the markers visually by an operator inspecting, sorting, etc. the packages BX, or from a visible light image captured by a visible light camera VCM1.

[0054] The registration device P1 and the authentication device P2 determine whether the package BX on the stage STG is at a position and distance suitable for capturing an image in the imaging area AR (i.e., acquiring the internal structure of the packaging material) based on the number and positions of the markers detected by the worker's visual inspection or by the visible light image. Note that the determination of whether the package BX is at a position and distance suitable for capturing an image in the imaging area AR may be performed by the multi-scanner MLT1.

[0055] The registration device P1 and the authentication device P2 determine whether the number of markers detected from the millimeter wave image is one and whether the position of this one marker is at a predetermined position in the imaging area AR.

[0056] Specifically, when the registration device P1 and the authentication device P2 determine that the number of detected markers is one (i.e., only marker Mk0), as in the captured image RST1 shown in Figure 5, and that the position of this one marker Mk0 is a predetermined position in the imaging area AR (e.g., the upper left corner of the imaging area AR), they determine that the relative position and distance between the millimeter-wave CT scanner MSC and the imaging area AR of the packaged item BX are suitable for imaging the imaging area AR.

[0057] On the other hand, when the registration device P1 and the authentication device P2 determine that two markers Mk1 and Mk2 have been detected from the captured image (millimeter wave image) as in the captured image RST2 shown in Fig. 5, they determine that the relative position and distance between the millimeter wave CT scanner MSC and the imaging area AR of the package BX are not suitable for capturing the image of the imaging area AR. Also, when the registration device P1 and the authentication device P2 determine that one marker Mk0 has been detected from the captured image (millimeter wave image) as in the captured image RST3 and that the position of the marker Mk is not a predetermined position, they determine that the relative position between the millimeter wave CT scanner MSC and the imaging area AR of the package BX is not suitable for capturing the image of the imaging area AR.

[0058] When the registration device P1 and the authentication device P2 determine that the relative position between the millimeter wave CT scanner MSC and the imaging area AR of the package BX is a position and distance suitable for imaging the imaging area AR, they perform imaging of a registration image or an authentication image of the package BX.

[0059] The authentication device P2 performs individual authentication of the package BX based on the authentication image (millimeter wave image) transmitted from the multi-scanner MLT1. The authentication device P2 generates a screen MNT that notifies the authentication result of the individual authentication of the package BX and a score (i.e., similarity) based on the distance between the registration image vector and the authentication image vector obtained by the individual authentication, and outputs the screen MNT to the display unit 23.

[0060] 6, the authentication device P2 generates a table storing identification information (identification number) of the package BX, the authentication result of the individual authentication, and the score in association with each other, and outputs the table to the display unit 23. Specifically, the authentication device P2 notifies that the individual authentication result of the package BX with the identification number "XX_YY_001" is "NG" and the score calculated by this individual authentication is "8", and that the individual authentication result of the package BX with the identification number "XX_YY_002" is "OK" and the score calculated by this individual authentication is "2".

[0061] The authentication result of the individual authentication may be displayed (notified) for each package BX for which authentication has been completed. In addition, the smaller the score in this disclosure, the smaller the distance between the registration image vector and the authentication image vector obtained by individual authentication, that is, the more similar the characteristics of the internal structure of the packaging material that forms the package BX are.

[0062] Next, the millimeter wave image IMG11 will be described with reference to Fig. 7. Fig. 7 is a diagram showing an example of the millimeter wave image IMG11.

[0063] The millimeter-wave image IMG11 is an image of the package BX captured by the millimeter-wave CT scanner MSC. The millimeter-wave image IMG11 is captured in a manner that allows information regarding the irregularities of the core, which is the internal structure of the packaging material, to be obtained.

[0064] The registration device P1 and the authentication device P2 perform image analysis on the millimeter-wave image IMG11 to acquire individual information specific to the package BX based on the characteristics of the internal structure of the packaging material (here, information on the uneven pattern of the core, the depth of the unevenness, etc.) as a registration image vector or an authentication image vector of the imaging area AR. This allows the individual authentication system 100 to authenticate which individual (package BX) the package BX is registered or authenticated at another location, based on the similarity of the registration image vector or the authentication image vector of the imaging area AR.

[0065] Next, an example of a procedure for registering the individual information of the package BX will be described with reference to Fig. 8. Fig. 8 is a flowchart showing an example of an individual registration procedure of the individual authentication system 100 according to the first embodiment.

[0066] The processor 11 of the registration device P1 receives settings for measurement (imaging) conditions for the package BX by the millimeter-wave CT scanner MSC (St11). The measurement conditions for the package BX include, for example, the position and size of the scan area (imaging area AR) or the intensity of the irradiated millimeter waves. The measurement conditions for the package BX are set for each package BX based on the thickness of the packaging material, the size of the package BX, etc.

[0067] The measurement conditions for the package BX may be set by an operator at each location, or may be set automatically based on pre-registered information about the package BX (e.g., size, etc.), information about the packaging material (e.g., material, etc.), or information acquired from a device other than the registration device P1. If pre-registered information about the package BX is available, the registration device P1 may automatically set the measurement conditions for the package BX by referencing the registered information about the package BX. Although not described in this disclosure, when the measurement conditions for the package BX are automatically set, the multi-scanner MLT1 may further include a sensor capable of measuring the thickness of the packaging material, the size of the package BX, etc. In such a case, the registration device P1 may accept the setting of the measurement conditions for the package BX based on the thickness of the packaging material measured by the multi-scanner MLT1.

[0068] Based on the measurement conditions of the package BX, the processor 11 determines the position and distance between the imaging area AR of the package BX and the millimeter wave CT scanner MSC using the position of the marker Mk0, which is the reference position of the scan area (imaging area AR), as a reference (St12).

[0069] The processor 11 transmits to the multi-scanner MLT1 information on the position and distance between the imaging area AR of the package BX and the millimeter wave CT scanner MSC based on the position of the marker Mk0, and causes the multi-scanner MLT1 to scan and image the imaging area AR of the package BX (St13).

[0070] The multi-scanner MLT1 scans (takes an image) the scan area (imaging area AR) based on a control command (instruction) sent from the registration device P1. If the multi-scanner MLT1 determines based on the scan (imaging) result that the position and distance between the imaging area AR of the package BX and the millimeter-wave CT scanner MSC are the position and distance specified by the registration device P1, the multi-scanner MLT1 takes an image of the imaging area AR using the millimeter-wave CT scanner MSC and sends the image to the registration device P1.

[0071] The image acquisition unit 111 acquires the millimeter wave image IMG11 (captured image) of the package BX transmitted from the multi-scanner MLT1 (St14).

[0072] The registration image vector generation unit 112 performs image analysis on the acquired millimeter wave image IMG11 (captured image) using the similarity calculation model to acquire high-dimensional vector data based on the internal structure of the packaging material. The registration image vector generation unit 112 acquires the acquired high-dimensional vector data as registration image vector data, which is individual information unique to the package BX (St15).

[0073] The image vector centroid generating unit 113 determines whether the number of millimeter-wave images IMG11 currently used to generate the image vector data for registration is a predetermined number (for example, 25 or 30) (St16).

[0074] If the image vector centroid generating unit 113 determines that the number of millimeter-wave images IMG11 currently used to generate the registration image vector data is a predetermined number (St16, YES), it calculates the centroids of the predetermined number of generated registration image vectors (St17).The image vector centroid generating unit 113 associates the position information of the predetermined number of registration image vectors, information on the centroid positions of the registration image vectors, and identification information for identifying the package BX, and stores (registers) them in the registration image vector database DB, thereby generating a database of registration image vectors for each package BX (St18).

[0075] On the other hand, if the image vector centroid generating unit 113 determines that the number of millimeter wave images IMG11 currently used to generate the registration image vector data is not the predetermined number (St16, NO), it returns to the processing of step St12.

[0076] As described above, the registration device P1 in the first embodiment can acquire individual information (image vector for registration) specific to the package BX based on the internal structure of the package BX from the millimeter-wave image IMG11 captured of the package BX. Furthermore, by using the internal structure of the packaging material for individual authentication of the package BX, the registration device P1 can efficiently detect counterfeits even if counterfeits that imitate the packaging material itself are mixed in.

[0077] Next, an example of a procedure for authenticating the package BX based on the internal structure of the packaging material will be described with reference to Fig. 9. Fig. 9 is a flowchart showing an example of an individual authentication procedure of the individual authentication system 100 according to the first embodiment.

[0078] The processor 21 of the authentication device P2 receives settings for measurement (imaging) conditions for the package BX by the millimeter-wave CT scanner MSC (St21). The measurement conditions for the package BX include, for example, the size and position of the scan area (imaging area AR) or the intensity of the irradiated millimeter waves. The measurement conditions for the package BX are set for each package BX based on the thickness of the packaging material, the size of the package BX, etc.

[0079] The measurement conditions for the package BX may be set by an operator at each location, or may be set automatically based on information acquired from a device other than the authentication device P2. Although not described in this disclosure, when the measurement conditions for the package BX are set automatically, the multi-scanner MLT1 may further include a sensor capable of measuring the thickness or size of the packaging material. In such a case, the authentication device P2 may accept the setting of the measurement conditions for the package BX based on the thickness of the packaging material measured by the multi-scanner MLT1.

[0080] Based on the measurement conditions of the package BX, the processor 21 determines the position and distance between the imaging area AR of the package BX and the millimeter wave CT scanner MSC using the position of the marker Mk0, which is the reference position of the scan area (imaging area AR), as a reference (St22).

[0081] The processor 21 transmits to the multi-scanner MLT1 information on the position and distance between the imaging area AR of the package BX and the millimeter wave CT scanner MSC based on the position of the marker Mk0, and causes the multi-scanner MLT1 to scan and image the imaging area AR of the package BX (St23).

[0082] The multi-scanner MLT1 scans (takes an image) the scan area (imaging area AR) based on a control command (instruction) sent from the authentication device P2. If the multi-scanner MLT1 determines based on the scan (imaging) result that the position and distance between the imaging area AR of the package BX and the millimeter-wave CT scanner MSC are the position and distance specified by the authentication device P2, the multi-scanner MLT1 takes an image of the imaging area AR using the millimeter-wave CT scanner MSC and sends the image to the authentication device P2.

[0083] The image acquisition unit 211 acquires the millimeter wave image IMG11 (captured image) of the package BX transmitted from the multi-scanner MLT1 (St24).

[0084] The authentication image vector generation unit 212 performs image analysis on the acquired millimeter-wave image IMG11 (captured image) using the similarity calculation model to acquire high-dimensional vector data based on the internal structure of the packaging material. The authentication image vector generation unit 212 acquires the acquired high-dimensional vector data as authentication image vector data, which is individual information unique to the package BX (St25).

[0085] The image similarity calculation unit 213 calculates the distance between the center of gravity of each registration image vector data registered in the registration image vector database DB and the vector of the authentication vector data. The image similarity calculation unit 213 calculates the minimum distance among the calculated distances between each vector, and identifies the registration image vector data for which the minimum distance was calculated (i.e., the registration image vector that is most similar to the authentication image vector) (St26).

[0086] The authentication unit 214 performs individual authentication of the package BX based on whether or not the registration image vector data corresponding to the minimum distance matches the registration image vector at the time of registration (St27).

[0087] If the authentication unit 214 determines that the registration image vector data corresponding to the minimum distance matches the registration image vector at the time of registration (St27, YES), it calculates a score indicating the similarity between the registration image vector data corresponding to the minimum distance and the registration image vector at the time of registration based on the minimum distance. The authentication unit 214 generates a notification that the individual authentication result of the package BX is OK (success) and information about the calculated score, and displays them on the display unit 23 (St28).

[0088] On the other hand, if the authentication unit 214 determines that the registration image vector data corresponding to the minimum distance does not match the registration image vector at the time of registration (St27, NO), it calculates a score indicating the similarity between the registration image vector data corresponding to the minimum distance and the registration image vector at the time of registration based on the minimum distance. The authentication unit 214 generates a notification that the individual authentication result of the package BX is NG (failed) and information about the calculated score, and displays them on the display unit 23 (St29).

[0089] The processor 21 determines whether or not the individual authentication of all packages BX has been completed (St30).

[0090] When the processor 21 determines that the individual authentication of all packages BX has been completed (St30, YES), the processor 21 ends the individual authentication procedure shown in FIG.

[0091] On the other hand, when the processor 21 determines that the individual authentication of all the packages BX has not been completed (St30, NO), the processor 21 returns to the processing of step St22.

[0092] As described above, the authentication device P2 in embodiment 1 can more effectively identify counterfeit products by performing individual authentication using individual information (registration image vector) unique to the package BX based on the internal structure of the packaging material from the millimeter-wave image IMG11 in which the package BX is captured.

[0093] Next, the registration image vector database will be described with reference to Fig. 10. Fig. 10 is a diagram showing an example of the registration image vector database DB.

[0094] The registration image vector database DB registers each of the sampling data SMP1, SMP2, SMP3, SMP4, SMP5, and SMP6, which are the positions of a predetermined number of registration image vectors mapped in two-dimensional space, each of the centers of gravity Pt1, Pt2, Pt3, Pt4, Pt5, and Pt6 of the predetermined number of registration image vectors (each of the sampling data SMP1 to SMP6), and identification information (not shown) of the package BX, in correspondence with each package BX.

[0095] By converting high-dimensional vector data into two-dimensional vector data, the registration image vector database DB can visualize differences in the individual information (characteristics) of each package BX based on the positional relationship of each registration image vector, as shown in FIG. 10. Here, the registration device P1 may generate and transmit an image visualizing the registration image vector database DB to a display unit (not shown) connected to the registration device P1 so that data can be communicated therewith. This allows the worker to visually confirm differences in the individual information of each package BX. Note that the process of converting high-dimensional vector data into two-dimensional vector data is performed for the purpose of visualizing differences in the individual information (characteristics) of each package BX, and therefore is not essential if visualization is not required, and may be omitted.

[0096] Next, individual authentication of the package BX will be described with reference to Fig. 11. Fig. 11 is a diagram for explaining an example of individual authentication.

[0097] The authentication device P2 calculates the distance between the authentication image vector Pt10 and each of the centers of gravity Pt1 to Pt6 of the registration image vectors (each of the sampling data SMP1 to SMP6) (i.e., the distance between the vectors). The authentication device P2 performs individual authentication of the package BX based on whether or not the identification information of the package BX corresponding to the center of gravity Pt2, which has the smallest calculated distance between the vectors, matches the identification information of the package BX corresponding to the authentication image vector Pt10.

[0098] The authentication device P2 may generate a screen that visualizes the registration image vector database DB including the authentication image vector Pt10, and transmit the screen to the display unit 23. This allows the worker to visually confirm the difference between the individual information of the registered package BX and the individual information of the package BX to be authenticated.

[0099] (Embodiment 2) The individual authentication system 100 according to the first embodiment has been described as an example in which the individual information of the package BX is registered and authenticated using a millimeter wave CT scanner MSC. The individual authentication system 100A according to the second embodiment will be described as an example in which the individual information of the package BX is registered and authenticated using a thermal camera CM.

[0100] In the description of the second embodiment, the same components as those in the first embodiment are denoted by the same reference numerals, and the description of the same components will be omitted.

[0101] An example of the internal configuration of each of the registration device P1A and the authentication device P2A in the second embodiment will be described with reference to FIGS. 2 and 3, respectively.

[0102] The registration device P1A includes a communication unit 10A, a processor 11A, and a memory 12.

[0103] The communication unit 10A is connected to the multi-scanner MLT2 corresponding to the registration device P1A and the registration image vector database DB so that data can be transmitted and received between them. The communication unit 10A transmits various data output from the processor 11A to the registration image vector database DB. The communication unit 10A also outputs various data (various information) transmitted from the multi-scanner MLT2 to the processor 11A.

[0104] Processor 11A is configured using, for example, a CPU, DSP, or FPGA, and performs various processes and controls in cooperation with memory 12. Specifically, processor 11A references the programs and data stored in memory 12 and executes the programs to realize the functions of image acquisition unit 111A, registration image vector generation unit 112A, image vector centroid generation unit 113, and the like.

[0105] The image acquisition unit 111A acquires a thermographic image IMG12 (see FIG. 13) of an area including the imaging area AR of the package BX captured by the thermographic camera CM of the multi-scanner MLT2 via the communication unit 10. The image acquisition unit 111A outputs the acquired thermographic image IMG12 to the registration image vector generation unit 112A.

[0106] The registration image vector generation unit 112A uses a similarity calculation model that calculates the similarity of images to analyze the thermo image IMG12 (i.e., the registration image) output from the image acquisition unit 111A and acquires individual information specific to the internal structure of the packaging material that forms the packaged item BX (for example, the uneven pattern of the core inside the cardboard, or the depth of the unevenness, etc.).The registration image vector generation unit 112A generates registration image vector data that indicates the feature quantities of the packaged item BX based on the acquired internal information.

[0107] Specifically, the registration image vector generation unit 112A converts the internal structural features of the packaging material from the thermo image IMG12 into high-dimensional (e.g., 768-dimensional) vector data by analyzing the thermo image IMG12 using the similarity calculation model. The registration image vector generation unit 112A acquires this high-dimensional vector data as registration image vector data for the thermo image IMG12, which is the registration image.

[0108] The registration image vector generation unit 112A generates a predetermined number of registration image vectors for one package BX based on a predetermined number (e.g., 25, 30, etc.) of thermo images of one package BX. The registration image vector generation unit 112A outputs information on the generated predetermined number of registration image vectors to the image vector centroid generation unit 113.

[0109] The authentication device P2A includes a communication unit 20, a processor 21A, and a memory 22.

[0110] The communication unit 20A is connected to the multi-scanner MLT2 corresponding to the authentication device P2A and the registration image vector database DB so that data can be transmitted and received between them. The communication unit 20A transmits various data output from the processor 21A to the registration image vector database DB. The communication unit 20A also outputs various data (various information) transmitted from the multi-scanner MLT2 to the processor 21A.

[0111] Processor 21A is configured using, for example, a CPU, DSP, or FPGA, and performs various processes and controls in cooperation with memory 22. Specifically, processor 21A refers to the programs and data stored in memory 22 and executes the programs to realize functions such as image acquisition unit 211A, authentication image vector generation unit 212A, image similarity calculation unit 213, and authentication unit 214.

[0112] The image acquisition unit 211A acquires a thermographic image IMG12 (see FIG. 13) obtained by capturing an area including the imaging area AR of the package BX using the thermographic camera CM of the multi-scanner MLT2 via the communication unit 20A. The image acquisition unit 211A outputs the acquired thermographic image IMG12 to the authentication image vector generation unit 212A.

[0113] The authentication image vector generation unit 212A uses a similarity calculation model that calculates the similarity of images to analyze the thermo image IMG12 (i.e., the authentication image) output from the image acquisition unit 211A and acquires individual information specific to the internal structure of the packaging material that forms the package BX (for example, the uneven pattern of the core inside the cardboard, or the depth of the unevenness, etc.). The authentication image vector generation unit 212A generates authentication image vector data for the package BX based on the acquired features of the internal structure. The authentication image vector generation unit 212A outputs information on the generated authentication image vector to the image similarity calculation unit 213.

[0114] Specifically, the authentication image vector generation unit 212A converts the features of the internal structure of the packaging material from the thermo image IMG12 into high-dimensional (e.g., 768-dimensional) vector data by analyzing the thermo image IMG12 using the similarity calculation model. The authentication image vector generation unit 212A obtains this high-dimensional vector data as authentication image vector data of the thermo image IMG12, which is the authentication image.

[0115] Next, examples of detection and imaging of the package BX will be described with reference to Fig. 5 and Fig. 12. Fig. 12 is a diagram showing an example of obtaining a registration image or authentication image of the package BX and an example of displaying an authentication result in the second embodiment.

[0116] The stage STG is placed with the package BX on which the detection process and the image capture process are performed by the multi-scanner MLT2. The stage STG may be a so-called belt conveyor.

[0117] The multi-scanner MLT2 is equipped with a marker illuminator LS that irradiates markers Mk1 and Mk2 onto the package BX to detect the position of the imaging area AR of the package BX on the stage STG, a thermal camera CM that images the package BX, and a heating heater HT that heats the imaging area AR.

[0118] The heater HT heats the area including the imaging area AR of the package BX based on the heating conditions transmitted from the registration device P1A and the authentication device P2A, respectively. The heating conditions here refer to heating parameters such as temperature or time.

[0119] The thermo camera CM captures an image of an area including the imaging area AR heated by the heater HT, and transmits the captured thermo image IMG12 to the registration device P1A or the authentication device P2A.

[0120] The registration device P1A and the authentication device P2A use a marker illuminator LS to irradiate two markers Mk1 and Mk2 onto an imaging area AR, and use a thermal camera CM to capture an image of the imaging area AR illuminated with the markers Mk1 and Mk2. The registration device P1A and the authentication device P2A detect the markers visually by an operator inspecting and sorting the packages BX, or from a visible light image captured by a visible light camera VCM2.

[0121] The registration device P1A and the authentication device P2A determine whether the package BX on the stage STG is at a position and distance suitable for capturing an image of the imaging area AR (i.e., acquiring the internal structure of the packaging material) based on the number and positions of the markers detected by the worker's visual inspection or by the visible light image. Note that the determination of whether the package BX is at a position and distance suitable for capturing an image of the imaging area AR may be performed by the multi-scanner MLT2.

[0122] When the registration device P1A and the authentication device P2A determine that the package BX is at a position and distance suitable for capturing an image of the imaging area AR, the registration device P1A and the authentication device P2A control the heater HT based on the heating conditions to heat the area of ​​the package BX including the imaging area AR. Once heating (warming) by the heater HT is complete, the registration device P1A and the authentication device P2A cause the thermal camera CM to capture an image of the imaging area AR. The registration device P1A causes the heater HT to heat the imaging area AR and the thermal camera CM to capture an image of the imaging area AR until a predetermined number of registration image vectors have been acquired.

[0123] The authentication device P2A performs individual authentication of the package BX based on the authentication image (thermo image) transmitted from the multi-scanner MLT2. The authentication device P2A generates a screen MNT that notifies the authentication result of the individual authentication of the package BX and a score based on the distance between the registration image vector and the authentication image vector obtained by the individual authentication, and outputs the screen MNT to the display unit 23.

[0124] Next, the thermo image IMG12 will be described with reference to Fig. 13. Fig. 13 is a diagram showing an example of the thermo image IMG12.

[0125] The thermographic image IMG12 is an image of the package BX captured by a thermographic camera CM. The thermographic camera CM captures the image in a manner that allows information regarding the irregularities of the core, which is the internal structure of the packaging material, to be obtained.

[0126] The registration device P1A and the authentication device P2A perform image analysis of the thermographic image IMG12 to acquire individual information specific to the package BX based on the internal structure of the packaging material (here, information on the uneven pattern of the core, the depth of the unevenness, etc.) as a registration image vector or an authentication image vector of the imaging area AR. This allows the individual authentication system 100A to authenticate which individual (package BX) the package BX is registered or authenticated at another location, based on the similarity of the registration image vector or the authentication image vector of the imaging area AR.

[0127] Next, an example of a procedure for registering individual information of a package BX will be described with reference to Fig. 14. Fig. 14 is a flowchart showing an example of an individual registration procedure of the individual authentication system 100A according to embodiment 2. Note that the processing of steps St12, St15, and St17 to St18 in the registration procedure shown in Fig. 14 is similar to the processing of steps St12, St15, and St17 to St18 shown in Fig. 8, and therefore description thereof will be omitted.

[0128] The processor 11A of the registration device P1A accepts the setting of heating conditions of the image capturing area AR of the package BX by the heater HT by the operator (St11A). The heating conditions include the heating temperature, the heating time, etc. The heating conditions are set arbitrarily depending on the thickness of the packaging material, the material of the packaging material, the size of the image capturing area AR, etc.

[0129] Here, the heating conditions may be set by an operator or automatically based on the thickness of the packaging material acquired by the multi-scanner MLT2. When the multi-scanner MLT2 is used, the multi-scanner MLT2 may further include a sensor capable of measuring the thickness of the packaging material. In such a case, the registration device P1A may accept the setting of the heating conditions based on the thickness of the packaging material measured by the multi-scanner MLT2.

[0130] The processor 11A transmits to the multi-scanner MLT2 information on the position and distance between the imaging area AR of the package BX and the thermal camera CM based on the position of the marker Mk0, and causes the multi-scanner MLT2 to capture an image of the imaging area AR of the package BX (St13A).

[0131] The multi-scanner MLT2 performs imaging of the imaging area AR based on a control command (instruction) transmitted from the registration device P1A. If the multi-scanner MLT2 determines based on the imaging result that the position and distance between the imaging area AR of the package BX and the thermal camera CM are the position and distance specified by the registration device P1A, it images the imaging area AR with the thermal camera CM and transmits the image to the registration device P1A.

[0132] The image acquisition unit 111A acquires the thermo image IMG12 (captured image) of the package BX transmitted from the multi-scanner MLT2 (St14A).

[0133] The image vector centroid generating unit 113 determines whether the number of thermo images IMG12 currently used to generate the image vector data for registration is a predetermined number (for example, 25 or 30) (St16A).

[0134] If the image vector centroid generation unit 113 determines that the number of thermo images IMG12 currently used to generate the registration image vector data is a predetermined number (St16A, YES), it calculates the centroid of the predetermined number of registration image vectors generated (St17).

[0135] On the other hand, if the image vector centroid generating unit 113 determines that the number of thermo images IMG12 currently used to generate the registration image vector data is not the predetermined number (St16A, NO), it returns to the processing of step St12.

[0136] As described above, the registration device P1A in the second embodiment can acquire individual information (image vector for registration) specific to the package BX based on the internal structure of the package BX from the thermographic image IMG12 of the package BX. Furthermore, by using the internal information of the package BX for individual authentication of the package BX, the registration device P1A can efficiently detect counterfeits even if counterfeits that imitate the packaging material itself are mixed in.

[0137] Next, an example of a procedure for authenticating a package BX will be described with reference to Fig. 15. Fig. 15 is a flowchart showing an example of an individual authentication procedure of the individual authentication system 100A according to embodiment 2. Note that the processing of step St22 and steps St25 to St30 in the authentication procedure shown in Fig. 15 is similar to the processing of step St22 and steps St25 to St30 shown in Fig. 9, and therefore description thereof will be omitted.

[0138] The processor 21A of the authentication device P2A accepts the setting of heating conditions for the imaging area AR of the package BX by the heater HT by the worker (St21A). The heating conditions include the heating temperature, the heating time, etc. The heating conditions are set arbitrarily depending on the thickness of the packaging material, the material of the packaging material, the size of the imaging area AR, etc. As in the case of the registration device P1A, the authentication device P2A may also accept the setting of heating conditions based on the thickness of the packaging material measured by the multi-scanner MLT2.

[0139] The processor 21A transmits to the multi-scanner MLT2 information on the position and distance between the imaging area AR of the package BX and the thermal camera CM based on the position of the marker Mk0, and causes the multi-scanner MLT2 to capture an image of the imaging area AR of the package BX (St23A).

[0140] The multi-scanner MLT2 performs imaging of the imaging area AR based on a control command (instruction) transmitted from the authentication device P2A. If the multi-scanner MLT2 determines based on the imaging result that the position and distance between the imaging area AR of the package BX and the thermal camera CM are the position and distance specified by the authentication device P2A, the multi-scanner MLT2 images the imaging area AR with the thermal camera CM and transmits the image to the authentication device P2A.

[0141] The image acquisition unit 211A acquires the thermo image IMG12 (captured image) of the package BX transmitted from the multi-scanner MLT2 (St24A).

[0142] As described above, the authentication device P2A in embodiment 2 can more effectively identify counterfeit products by performing individual authentication using individual information (registration image vector) unique to the package BX based on the internal structure of the packaging material from the thermographic image IMG12 of the package BX.

[0143] (Addendum) The above description of each embodiment discloses the following techniques.

[0144] (Technology 1) An acquisition unit (communication unit 10, 10A) that acquires a plurality of captured images (millimeter wave images IMG11 or thermo images IMG12) of a package BX that contains an object (product); a feature acquisition unit (image vector for registration generation units 112, 112A and image vector center of gravity generation unit 113) that analyzes each of the plurality of captured images and acquires feature vectors (image vectors for registration) of the packaging material that forms the package BX; a feature registration unit (image vector centroid generation unit 113) that registers a feature vector (image vector for registration) of the packaging material; Individual information registration devices P1 and P1A. This allows the registration devices P1 and P1A to acquire registration image vectors that indicate the individuality of the internal structure of the packaging material that forms the package BX (for example, the unevenness of the core, the grain of the wood, etc.) from the captured image. Furthermore, the registration devices P1 and P1A register the acquired registration image vectors in the registration image vector database DB, thereby enabling individual authentication of the package BX using the individual information of the package BX registered in the registration image vector database DB (i.e., the registration image vector of the package BX).

[0145] (Technology 2) The feature acquisition unit (registration image vector generation units 112, 112A and image vector centroid generation unit 113) analyzes each of the plurality of captured images to acquire feature vectors (registration image vectors) of the plurality of packaging materials, and calculates a representative value (centroid position) of the acquired feature vectors (registration image vectors) of the plurality of packaging materials; The feature registration unit (image vector centroid generation unit 113) registers the representative value (centroid position) of the calculated feature vector (image vector for registration) of the packaging material. Individual information registration devices P1 and P1A described in (Technology 1). As a result, the registration devices P1 and P1A can register the positions of the centers of gravity of multiple registration image vectors, thereby realizing the registration of individual information of the packaged item BX, which can more effectively suppress the decline in individual authentication accuracy due to variations in the registration image vectors obtained from the captured image.

[0146] (Technology 3) The acquisition unit (communication unit 10, 10A) acquires the captured image (millimeter wave image IMG11 or thermo image IMG12) of the packaging material at the upper side of the package BX. Individual information registration devices P1 and P1A described in (Technology 1). This allows the registration devices P1 and P1A to more effectively prevent a decrease in the accuracy of individual authentication caused by changes (deformations) in the internal structure of the packaging material used for individual authentication (for example, the uneven pattern of the cardboard core, or the depth of the unevenness, etc.) due to the loading of other packages or collisions with other packages, obstacles, etc.

[0147] (Technology 4) The captured image is a millimeter wave image IMG11 generated by irradiating millimeter waves onto the package BX, receiving millimeter waves reflected by the package BX, and generating the millimeter wave image IMG11 based on the received millimeter waves. (Technology 1) describes an individual information registration device P1. This allows the registration devices P1 and P1A to acquire, from the captured image, a registration image vector that indicates the individuality of the internal structure of the packaging material that forms the package BX. Therefore, the registration devices P1A and P1A can easily detect not only the product being packed, but also counterfeit products in which the packaging material itself is imitated.

[0148] (Technology 5) The captured image is a thermo image IMG12 capturing infrared light emitted from the package BX. (Technology 1) describes an individual information registration device P1A. This allows the registration devices P1 and P1A to acquire, from the captured image, a registration image vector that indicates the individuality of the internal structure of the packaging material that forms the package BX. Therefore, the registration devices P1A and P1A can easily detect not only the product being packed, but also counterfeit products in which the packaging material itself is imitated.

[0149] (Technology 6) an acquisition unit (communication unit 20, 20A) that acquires a captured image (millimeter wave image IMG11 or thermo image IMG12) of a package BX that packs an object (product); a feature acquisition unit (authentication image vector generation unit 212, 212A) that analyzes the captured image and acquires a feature vector (authentication image vector) of the packaging material that forms the package BX; and an individual authentication unit (authentication unit 214) that authenticates the package BX based on the acquired feature vector (authentication image vector) of the packaging material and the feature vector (registration image vector) of a registered packaging material that forms at least one registered package BX that has been registered in advance. Individual authentication device (authentication device P2, P2A). As a result, the authentication devices P2 and P2A can obtain an authentication image vector that indicates the individuality of the internal structure of the packaging material that forms the package BX (e.g., the unevenness of the core, the grain of the wood, etc.) from the captured image, and thereby perform individual authentication of the package using the individual information of the package BX (i.e., the registration image vector of the package BX).

[0150] (Technology 7) The individual authentication unit (authentication unit 214) authenticates the package BX based on the distance between the feature vector (authentication image vector) of the packaging material and the feature vector (registration image vector) of the registered packaging material. (Technology 6) The individual authentication device (authentication device P2, P2A) described above. This allows the authentication devices P2 and P2A to perform individual authentication of the package BX based on the distance between the authentication image vector and the registration image vector, that is, based on the difference in the characteristics of the packaging material.

[0151] (Technology 8) The feature vector (image vector for registration) of the registered packaging material is associated with individual identification information that identifies an individual registered package (package BX), The individual authentication unit (authentication unit 214) authenticates the package BX based on a comparison between individual identification information corresponding to the registered packaging material having the smallest distance between the feature vector (authentication image vector) of the packaging material and the feature vector (registration image vector) of the registered packaging material and individual identification information that identifies the individual package BX. (Technology 7) The individual authentication device (authentication device P2, P2A) described above. As a result, the authentication devices P2 and P2A can perform individual authentication of the package BX based on whether the identification information of the package BX for which the authentication image vector was generated matches the identification information of the package BX for which the distance between the authentication image vector and the registration image vector is the smallest, i.e., the difference in the characteristics of the packaging material is the smallest. Therefore, even if the registration image vector database DB contains registered characteristics of the package BX with similar characteristics to the packaging material, the authentication devices P2 and P2A can more effectively prevent erroneous authentication of the package BX by matching the identification information. Furthermore, even if the imaging area AR is subjected to an external force while the package BX is being moved between logistics centers, causing the internal structure of the packaging material in the area corresponding to the imaging area AR to change (deform), resulting in the packaging material becoming similar in characteristics to other packages.

[0152] (Technology 9) The individual authentication unit (authentication unit 214) authenticates the package BX based on the feature vector (authentication image vector) of the packaging material and a representative value (centroid) of the feature vectors (registration image vectors) obtained by analyzing each of a plurality of captured images of the registered package. (Technology 6) The individual authentication device (authentication device P2, P2A) described above. As a result, the authentication devices P2 and P2A can perform individual authentication based on the authentication image vector and the position of the center of gravity of multiple registration image vectors, thereby more effectively suppressing a decrease in individual authentication accuracy due to variations in the registration image vectors obtained from the captured image.

[0153] (Technology 10) The individual authentication unit (authentication unit 214) calculates a similarity based on the distance between the feature vector (authentication image vector) of the packaging material and the feature vector (registration image vector) of the registered packaging material, and outputs the similarity and an authentication result of the package BX. (Technology 7) The individual authentication device (authentication device P2, P2A) described above. As a result, the authentication devices P2 and P2A can notify the worker of the results of individual authentication by outputting the similarity between the package BX for which the authentication image vector was generated and the package registered in the registration image vector database DB, as well as the authentication result.

[0154] (Technology 11) The acquisition unit (communication unit 20, 20A) acquires the captured image (millimeter wave image IMG11 or thermo image IMG12) of the packaging material on the upper side of the package BX. (Technology 6) The individual authentication device (authentication device P2, P2A) described above. This allows the registration devices P1 and P1A to more effectively prevent a decrease in the accuracy of individual authentication caused by changes (deformations) in the internal structure of the packaging material used for individual authentication (for example, the uneven pattern of the cardboard core, or the depth of the unevenness, etc.) due to the loading of other packages or collisions with other packages, obstacles, etc.

[0155] (Technology 12) The captured image is a millimeter wave image generated by irradiating millimeter waves onto the package BX, receiving millimeter waves reflected by the package BX, and generating the millimeter wave image based on the received millimeter waves. (Technical 6) The individual authentication device (authentication device P2). This allows the authentication device P2 to acquire, from the captured image, a registration image vector that indicates the individuality of the internal structure of the packaging material that forms the package BX. Therefore, the authentication device P2 can easily detect not only the packaged product but also counterfeit products in which the packaging material itself is imitated.

[0156] (Technology 13) The captured image is a thermographic image capturing infrared rays emitted from the package BX. (Technology 6) The individual authentication device (authentication device P2A) described above. This allows the authentication device P2A to acquire, from the captured image, a registration image vector that indicates the individuality of the internal structure of the packaging material that forms the package BX. Therefore, the authentication device P2A can easily detect not only the packaged product but also counterfeit products in which the packaging material itself is imitated.

[0157] (Technology 14) a registration device P1, P1A provided at a first logistics base (for example, base A) among a plurality of logistics bases through which packages BX containing objects (products) are distributed, the registration device P1, P1A generating a database (a registration image vector database DB) of the packages BX; An individual authentication system 100, 100A including an authentication device P2, P2A provided at a second logistics base (for example, base B) different from the first logistics base and communicably connected to the database (registration image vector database DB), The registration devices P1 and P1A are: Acquire a plurality of first captured images (millimeter wave images IMG11 or thermo images IMG12) of the package BX at the first logistics base, Analyzing each of the plurality of first captured images to obtain a feature vector (image vector for registration) of the packaging material forming the package BX, and registering the feature vector for each package BX in the database (image vector database DB for registration); The authentication devices P2 and P2A include: A second captured image (a millimeter wave image IMG11 or a thermo image IMG12) of the package BX at the second logistics base is acquired, Analyzing the second captured image to obtain a feature vector (authentication image vector) of the packaging material that forms the package BX; authenticating the package BX at the second logistics base based on the acquired feature vector (authentication image vector) of the packaging material and at least one feature vector (registration image vector) of the packaging material registered in the database (registration image vector database DB); Individual authentication system 100, 100A. As a result, the individual authentication systems 100, 100A can acquire, from the captured images, a registration image vector and an authentication image vector that indicate the individuality of the internal structure of the packaging material that forms the package BX (for example, the unevenness of the core, the grain of the wood, etc.), and by performing individual authentication using this information, can authenticate that the package BX that passes through multiple logistics bases is the same individual package.In addition, as a result, the individual authentication systems 100, 100A can easily detect counterfeits, not only of the products being packaged, but also of the package BX itself.

[0158] Although various embodiments have been described above with reference to the accompanying drawings, the present disclosure is not limited to such examples. It is clear that those skilled in the art can conceive of various modifications, alterations, substitutions, additions, deletions, and equivalents within the scope of the claims, and it is understood that these also fall within the technical scope of the present disclosure. Furthermore, the components of the various embodiments described above may be combined in any manner without departing from the spirit of the invention. [Industrial Applicability]

[0159] The present disclosure is useful as an individual information registration device, an individual authentication device, and an individual authentication system that acquire individual information of a package in which a product is packed and enable authentication of the package. [Explanation of symbols]

[0160] 10, 10A, 20, 20A Communication section 11, 11A, 21, 21A processors 12,22 memory 23 Display section 100,100A Individual Authentication System 111,111A,211,211A Image acquisition unit 112, 112A Registration image vector generation unit 113 Image vector centroid generation unit 212,212A Authentication image vector generation unit 213 Image similarity calculation unit 214 Authentication Department AR imaging area BX Packaging CM Thermal Camera DB Image vector database for registration HT Heating heater IMG11 Millimeter wave image IMG12 Thermo image LS marker irradiator MLT1, MLT2 multi-scanner MNT screen MSC Millimeter Wave CT Scanner P1, P1A registration device P2, P2A authentication device Pt10 authentication image vector Pt1,Pt2,Pt3,Pt4,Pt5,Pt6 Center of gravity

Claims

1. an acquisition unit that acquires a plurality of captured images of a package containing an object; a feature acquisition unit that analyzes each of the plurality of captured images to acquire a feature vector of a packaging material that forms the package; a feature registration unit that registers a feature vector of the packaging material, A device for registering individual information.

2. the feature acquisition unit analyzes each of the plurality of captured images to acquire feature vectors of the plurality of packaging materials, and calculates a representative value of the acquired feature vectors of the plurality of packaging materials; The feature registration unit registers the calculated representative value of the feature vector of the packaging material. The individual information registration device according to claim 1.

3. the acquisition unit acquires the captured image in which an upper side surface of the packaging material is captured. The individual information registration device according to claim 1.

4. The captured image is a millimeter wave image generated by irradiating the package with millimeter waves, receiving millimeter waves reflected by the package, and generating the millimeter wave image based on the received millimeter waves. The individual information registration device according to claim 1.

5. The captured image is a thermo image capturing infrared rays emitted from the package. The individual information registration device according to claim 1.

6. an acquisition unit that acquires a captured image of a package that packs an object; a feature acquisition unit that analyzes the captured image and acquires a feature vector of a packaging material that forms the package; and an individual authentication unit that authenticates the package based on the acquired feature vector of the package and the feature vector of a registered package forming at least one registered package that has been registered in advance. Individual authentication device.

7. the individual authentication unit authenticates the packaged item based on a distance between a feature vector of the packaging material and a feature vector of the registered packaging material. The individual authentication device according to claim 6.

8. The feature vector of the registered packaging material is associated with individual identification information that identifies an individual registered packaging item, the individual authentication unit authenticates the package based on a comparison between individual identification information corresponding to a registered packaging material having the smallest distance between the feature vector of the package and the feature vector of the registered packaging material, and individual identification information identifying an individual package. The individual authentication device according to claim 7.

9. the individual authentication unit authenticates the package based on a feature vector of the packaging material and a representative value of a plurality of feature vectors obtained by analyzing each of a plurality of captured images of the registered package. The individual authentication device according to claim 6.

10. the individual authentication unit calculates a similarity between the feature vector of the packaging material and the feature vector of the registered packaging material based on the distance, and outputs the similarity and an authentication result of the package. The individual authentication device according to claim 7.

11. the acquisition unit acquires the captured image in which the packaging material at the upper side of the package is captured. The individual authentication device according to claim 6.

12. The captured image is a millimeter wave image generated by irradiating the package with millimeter waves, receiving millimeter waves reflected by the package, and generating the millimeter wave image based on the received millimeter waves. The individual authentication device according to claim 6.

13. The captured image is a thermo image capturing infrared rays emitted from the package. The individual authentication device according to claim 6.

14. a registration device that is provided at a first logistics base among a plurality of logistics bases through which packages containing objects are distributed, and that generates a database of the packages; an authentication device provided at a second logistics base different from the first logistics base and communicably connected to the database, The registration device acquiring a plurality of first captured images of the package at the first logistics base; analyzing each of the plurality of first captured images to obtain a feature vector of a packaging material forming the package, and registering the feature vector in the database for each package; The authentication device acquiring a second image of the package at the second logistics base; Analyzing the second captured image to obtain a feature vector of a packaging material that forms the package; authenticating the package at the second logistics center based on the acquired feature vector of the packaging material and at least one feature vector of the packaging material registered in the database; Individual authentication system.

Images