Authentication system and tracking system

Abstract

The authentication system (110) of the present application is provided with: a first photographing device (11) that photographs an individual generation registration image of an individual in a first stage; a second photographing device (12) that photographs an individual generation authentication image of an authentication target individual in a second stage; and a registration device (30) configured to acquire registration image information by cutting a registration partial image from the registration image using a registration template, acquire authentication image information by cutting an authentication partial image from the authentication image using an authentication template, and determine whether the authentication image information and the registration image information indicate the same individual to perform authentication of the individual of the authentication target, the authentication template corresponding to the registration template and having a difference corresponding to a processing process with respect to the registration template.

Description

[0001] Cross-reference to related applications

[0002] This application is based on Japanese Patent Application No. 2021-046202, filed on March 19, 2021, the contents of which are incorporated herein by reference. Technical Field

[0003] This disclosure relates to a tracking system for tracking individuals and an authentication system used in the tracking system, and more specifically, to a tracking system for tracking individuals who have undergone a first phase, a second phase, and processing and / or alteration between the first and second phases, and an authentication system used in the tracking system. Background Technology

[0004] In the manufacturing process of an item, an item is completed through multiple processes such as sintering, grinding, and cleaning. In such a manufacturing process, when a problem is discovered in an item at a downstream stage or in a finished item, it is desirable to be able to trace the status of that item in the upstream process (e.g., manufacturing conditions, the condition of the item itself, etc.) (traceability). Conversely, when a problem is discovered at an upstream stage, it is desirable to be able to trace the product that passed through the problematic upstream process from the downstream item or finished item (forward tracing). In this case, if inherent identification information can be marked on the item itself using methods such as labeling with codes or assigning RFID tags, then that item can be traced using such identification information.

[0005] However, there are also cases where it is difficult to assign identification information to items, and assigning identification information to each individual item would increase costs. Therefore, a technique has been proposed that uses patterns that are not intentionally assigned but accidentally assigned to processed items (e.g., the shape of minor surface scratches, patterns caused by configuration, etc.) as identification information to track the items (e.g., Patent Document 1). Such patterns, due to their accidental nature, are inherent in each item and can function as identification information.

[0006] Patent Document 1: Japanese Patent Application Publication No. 2020-190794

[0007] Random patterns appearing individually in multiple items of the same kind can function as identification information. However, if large-scale patterns on an item are used as identification information, the amount of information that needs to be stored increases. Therefore, images of the same region from multiple items of the same kind are used as identification information. For example, this region is selected to easily represent differences in patterns caused by chance.

[0008] However, during the manufacturing process, due to various treatments and processes, the appearance of certain areas of an item may not be completely consistent between upstream and downstream. For example, an item may be deformed due to the manufacturing process. Additionally, there are cases where intentional patterns used as a reference for determining certain areas are altered. In these situations, it is impossible to cut out corresponding areas from images of the upstream and downstream items, and it is impossible to match the images of the upstream and downstream items. Summary of the Invention

[0009] Therefore, the purpose of this disclosure is to provide an authentication system that enables tracking of individuals before and after processing, even when the appearance of an individual changes due to processing or treatment, and a tracking system using the authentication system.

[0010] To address the aforementioned issues, one aspect of the present disclosure discloses an authentication system that authenticates individuals who have undergone a first stage, a second stage, and processing and / or alteration between the first and second stages. The authentication system comprises: a first imaging device that captures an individual in the first stage to generate a registration image; a registration image information acquisition unit that uses a registration template to cut a portion of the registration image from the registration image to acquire registration image information; a second imaging device that captures an individual being authenticated in the second stage to generate an authentication image; an authentication image information acquisition unit that uses an authentication template to cut a portion of the authentication image from the authentication image to acquire authentication image information; and an authentication unit that authenticates the individual being authenticated by determining whether the authentication image information and the registration image information represent the same individual. The authentication template corresponds to the registration template and has differences relative to the registration template corresponding to the aforementioned processing and / or alteration.

[0011] With this structure, since different templates are used for registration (for obtaining registration image information) and authentication (for obtaining authentication image information) depending on the individual's appearance at each stage, individual authentication can be performed even if the individual's appearance has changed due to processing and / or manufacturing.

[0012] The authentication system described above may also include a storage device that stores multiple registration image information generated for multiple individuals of the same kind. The authentication unit can use the authentication image information as a query to search for registration image information representing the same individual as the individual shown in the authentication image information from the multiple registration image information stored in the storage unit, thereby authenticating the individual of the authentication target.

[0013] This structure enables traceability-based tracking of individuals.

[0014] In the aforementioned authentication system, the authentication department can also authenticate the individual of the authentication object by determining whether the authentication image information and the registration image information represent the same individual from each of the multiple authentication image information obtained for multiple individuals of the same kind.

[0015] This structure enables the tracking of individuals based on positive trends.

[0016] In the aforementioned authentication system, the registration image information acquisition unit may acquire the registration image information by adjusting the registration portion of the image based on the size of the individual in the first stage, and / or the authentication image information acquisition unit may acquire the authentication image information by adjusting the authentication portion of the image based on the size of the individual in the second stage.

[0017] This structure allows for the use of registration and authentication images, ensuring that some images are the same size. Therefore, authentication can be performed by comparing registration and authentication image information through pattern matching.

[0018] In the aforementioned authentication system, the registration image information acquisition unit can acquire the registration image information by extracting feature quantities from the registration portion of the image, and the authentication image information acquisition unit can acquire the authentication image information by extracting feature quantities from the authentication portion of the image.

[0019] This structure enables authentication using feature quantities.

[0020] In the above-mentioned authentication system, the registration image information acquisition unit can also cut out the area corresponding to the registration template in the registration image as the registration partial image and acquire the registration image information. Similarly, the authentication image information acquisition unit can also cut out the area corresponding to the authentication template in the authentication image as the authentication partial image and acquire the authentication image information.

[0021] This structure allows for the cutting of the region corresponding to the template for authentication.

[0022] In the aforementioned authentication system, the registration image information acquisition unit may also cut out a region in the registration image that is in a predetermined positional relationship with the region corresponding to the registration template as a partial image for registration and acquire the registration image information. Similarly, the authentication image information acquisition unit may cut out a region in the authentication image that is in the predetermined positional relationship with the region corresponding to the authentication template as a partial image for authentication and acquire the authentication image information.

[0023] This structure allows for the arbitrary setting of areas corresponding to the template and areas used for authentication.

[0024] One aspect of the present disclosure is a tracking system that tracks individuals undergoing a first stage, a second stage, and processing and / or alteration between the first and second stages. The tracking system comprises: a processing device for altering the appearance of the individual by processing and / or altering the individual between the first and second stages; a first imaging device for capturing an image of the individual in the first stage to generate a registration image; a registration image information acquisition unit for cropping a portion of the registration image from the registration image using a registration template to acquire registration image information; a second imaging device for capturing an image of the individual in the second stage to generate an authentication image; an authentication image information acquisition unit for cropping an authentication portion of the authentication image using an authentication template to acquire authentication image information; and an authentication unit for authenticating the individual by determining whether the authentication image information and the registration image information represent the same individual, wherein the authentication template corresponds to the registration template and has differences relative to the registration template corresponding to the processing and / or alteration.

[0025] According to this structure, since different templates are used for registration (for obtaining registration image information) and authentication (for obtaining authentication image information) depending on the individual's appearance at each stage, individual authentication can be performed even if the individual's appearance has changed due to processing and / or manufacturing. Attached Figure Description

[0026] The above-mentioned objects, as well as other objects, features, and advantages of this disclosure, will become clearer from the following detailed description with reference to the accompanying drawings.

[0027] Figure 1 This is a diagram showing the overall structure of the tracking system according to the first embodiment.

[0028] Figure 2 This is a block diagram illustrating the structure of the authentication system according to the first embodiment.

[0029] Figure 3 This diagram illustrates the processing in the registration device according to the first embodiment.

[0030] Figure 4 This diagram illustrates the processing in the authentication device according to the first embodiment.

[0031] Figure 5 This is a block diagram illustrating the structure of the authentication system according to the second embodiment.

[0032] Figure 6 This diagram illustrates the processing in the registration device according to the second embodiment.

[0033] Figure 7 This diagram illustrates the processing in the authentication device according to the second embodiment. Detailed Implementation

[0034] (First Implementation)

[0035] Figure 1 This is a diagram showing the overall structure of the tracking system according to the first embodiment. The tracking system 100 of this embodiment is applied to a system for manufacturing articles. The articles are subjected to prescribed processing and / or finishing (hereinafter referred to as "processing") during the processing stage. In the following description, the first part of the processing stage is referred to as the first stage, and the second part of the processing stage is referred to as the second stage.

[0036] Because an item undergoes processing during the manufacturing stage, its appearance is altered. For example, it may be shrunk or enlarged by shrinking or expanding, or its aspect ratio may be changed. In addition, the appearance or pattern of a part of the surface may be altered by processing, and the shape of the item itself may be changed by cutting or adding other parts.

[0037] On the other hand, patterns on the surface of an object may be imparted by chance during the manufacturing process. For example, under visual observation, multiple fine lines applied during hairline finishing may appear to give the same pattern to any individual, but upon magnification, they differ from one person to another. Furthermore, even without surface finishing, small scratches unintentionally formed on the surface of an object can result in patterns that vary from one person to another. Moreover, the material itself may possess inherent patterns in each individual piece (e.g., the grain of wood).

[0038] These patterns vary from person to person and can be used as identification information for individuals. In this embodiment, patterns that retain their characteristics even after processing are used as identification information for individuals among the patterns that appear on the surface of an object.

[0039] The tracking system 100 includes: a first camera 101 for capturing images of an item P in a first stage; a processing apparatus 200 for processing the item P delivered from the first stage; and a second camera 102 for capturing images of the item P in a second stage that has been processed by the processing apparatus 200. The tracking system 100 of this embodiment is a tracking system that identifies and traces an item P in the first stage that corresponds to a specific individual in the second stage by registering the item P in the first stage.

[0040] In addition, Figure 1The example shown illustrates an item P being transported by a conveyor belt in the sequence of a first stage, a processing stage, and a second stage. However, the transport of items is not limited to this; it could also be a robotic arm or a device based on human operation. Furthermore, the item P in the second stage could be a finished product after all manufacturing processes have been completed.

[0041] Figure 2 This is a block diagram illustrating the structure of the authentication system according to the first embodiment. The authentication system 110 includes a first imaging device 11, a second imaging device 12, a registration device 30, an authentication device 40, and a storage device 50. The imaging device 11 and the imaging device 12 respectively correspond to... Figure 1 The first camera 101 and the second camera 102.

[0042] Figure 3 This diagram illustrates the processing in the registration device according to the first embodiment. Figure 4 This diagram illustrates the processing in the authentication device according to the first embodiment. The first imaging device 11 captures an image for individual registration during the first stage. Figure 3 Image 61 is an example of an image generated by the first imaging device 11. In this embodiment, the article P is a rectangular plate-shaped object with two machining marks 611a and 611b at the right end.

[0043] The registration device 30 registers the first-stage item P. The registration device 30 includes a template matching unit 31, a cutting unit 32, a scaling unit 33, and a registration unit 34. Furthermore, the registration device 30 can be implemented by executing the registration program of this embodiment through a processor of a general-purpose information processing device equipped with a processor, memory, storage device, etc.

[0044] The template matching unit 31 stores a registration template 62 applied to the registration image. This registration template 62 represents features shared by multiple items in the first stage of the image. Figure 3 In the example, registration template 62 is a template corresponding to the right end portion of item P in the first stage. There are two processing marks on the right end of item P, which are characteristic and therefore easy to match with templates.

[0045] The cutting unit 32 cuts the area of ​​the registration image mapped from the registration template 62 through template matching as a registration partial image 63. The scaling unit 33 adjusts the area so that the registration partial image 63 cut out by the cutting unit 32 is of a predetermined size and aspect ratio, thus becoming the adjusted registration partial image 64. The registration unit 34 saves the adjusted registration partial image 64 as registration image information in the storage device 50.

[0046] In the first stage, multiple identical articles P manufactured are photographed and registered sequentially as described above. The storage device 50 then stores the registration image information of the multiple manufactured articles P. Within the storage device 50, for each article P, an identification number and other manufacturing-related information, such as manufacturing time, batch number, and production line, are stored in association with the registration image information of each article P. Therefore, by authenticating articles P from the second stage onwards, it is possible to determine which article is registered in the storage device 50 and obtain its manufacturing-related information.

[0047] The second imaging device 12 captures images of the individual being authenticated in the second stage to generate authentication images. Figure 4 Image 71 is an example of an image generated by the second imaging device 12. In this embodiment, the article P shrinks in the longitudinal direction and extends in the lateral direction compared to before processing. The processing marks 611a and 611b of the first stage deform into processing marks 711a and 711b as the article P deforms.

[0048] The authentication device 40 performs authentication on the item P that becomes the object of authentication in the second stage. For example, items found to be defective in the second stage are designated as objects of authentication. The authentication device 40 includes a template matching unit 41, a cutting unit 42, a scaling unit 43, and an authentication unit 44. Furthermore, the authentication device 40 can be implemented by executing the authentication procedure of this embodiment using a general information processing device equipped with a processor, memory, storage device, etc.

[0049] The template matching unit 41 stores an authentication template 72 applied to the authentication image. This authentication template 72 represents the features of an image shared by multiple items in the second stage. The features of this image are the same as those of the image represented by the registration template 62. Figure 3 and Figure 4 In the example, both the registration template 62 and the authentication template 72 correspond to the right-hand portion of the article P with the processing marks. However, the authentication template 72 is a template in which the registration template 62 is modified to correspond to the change in the appearance of the article caused by the processing. That is, the authentication template 72 corresponds to the registration template and has differences relative to the registration template 62 corresponding to the processing stage.

[0050] The clipping unit 42 clips the area of ​​the authentication image mapped from the authentication template through template matching, resulting in the authentication partial image 73. The scaling unit 43 adjusts the area so that the authentication partial image 73 clipped by the clipping unit 42 is of a specified size and aspect ratio, resulting in the adjusted authentication partial image 74. The scaling unit 43 then performs enlargement and reduction processing so that the adjusted authentication partial image 74 has the same size and aspect ratio as the adjusted registration partial image of the item P being authenticated.

[0051] The authentication unit 44 uses the end-of-adjustment authentication image information as a query to search for the registration image information of the same individual as the individual shown in the end-of-adjustment registration image information stored in the storage device 50, thereby authenticating the individual to be authenticated. Specifically, the authentication unit 44 uses the end-of-adjustment authentication image information as a query to perform pattern matching, and searches for the end-of-adjustment registration image information corresponding to the end-of-adjustment authentication image information from the multiple end-of-adjustment registration image information stored in the storage device 50.

[0052] As described above, according to this embodiment, even if the appearance of an object is altered due to processing, since the template used for authentication of the modified second-stage item is a template modified from the registration template of the first-stage item before the modification, based on the change in the appearance of the item, it is possible to cut out the corresponding portion from the images of the item before and after the modification. Furthermore, since adjustments are also made during the adjustment of the cut-out portion image, ensuring that the size of the modified second-stage item matches the size of the first-stage item before the modification, the sizes of the registered adjustment-finish registration portion image and the adjustment-finish authentication portion image are made consistent, facilitating the search for the adjustment-finish registration portion image corresponding to the adjustment-finish authentication portion image.

[0053] Furthermore, in the above embodiments, both the registration device 30 and the authentication device 40 are equipped with scaling units 33 and 43, but it is also possible for only one of them to have a scaling unit. That is, the scaling unit provided on one side only needs to adjust the cropped image so that the item in the cropped image of that side is the same size as the item in the cropped image of the other side.

[0054] (Second Implementation)

[0055] Figure 5 This is a block diagram illustrating the structure of the authentication system according to the second embodiment. In the authentication system 120, the same reference numerals are used for structures identical to those in the authentication system 110 of the first embodiment, and descriptions are appropriately omitted. Compared to the authentication system 110 of the first embodiment, the authentication system 120 of this embodiment does not have the scaling unit 33 in the registration device 30 or the scaling unit 43 in the authentication device 40. That is, in this embodiment, as described later, since feature values ​​are extracted for authentication, it is not necessary to make the sizes of the registration portion image and the authentication portion image consistent through scaling.

[0056] In the first embodiment, the cutting unit 32 cuts out the area of ​​the registration image mapped from the registration template as a partial registration image, and the cutting unit 42 cuts out the area of ​​the authentication image mapped from the authentication template as a partial authentication image. In this embodiment, the cutting units 32 and 42 do not cut out the areas mapped from the template themselves, but rather cut out the areas that are in a predetermined positional relationship with the template.

[0057] Figure 6 This diagram illustrates the processing in the registration device according to the second embodiment. Figure 7 This diagram illustrates the processing in the authentication device according to the second embodiment. In this disclosure, for multiple articles at the same stage, templates are set for the parts of their appearance that share common features, and areas that clearly exhibit different appearances in each individual are set as cut-off regions. Furthermore, although these are parts that exhibit common features across multiple articles, it is disadvantageous to use parts with high autocorrelation as cut-off regions; therefore, these areas are set as templates.

[0058] exist Figure 6 and Figure 7 In this example, similar to the first embodiment, a template is set on the right end of the item. Furthermore, in... Figure 6 and Figure 7 In the example, in the second stage, machining marks are added compared to the first stage, and the corners at the ends are shaved off, and the shape of the article is also changed. However, as with the first embodiment, taking into account such changes in appearance, a template suitable for the changed article is prepared as a template for authentication in the second stage. Therefore, despite such changes, the same parts of the article can be identified in both the first and second stages.

[0059] In addition, Figure 6 and Figure 7 In the example, cut regions 822 and 922 are set so that they are adjacent to the registration template 821 and the authentication template 921. However, as long as the positional relationship between the template and the cut regions is fixed, they do not need to be adjacent to each other.

[0060] Furthermore, in this embodiment, the registration unit 34 extracts feature quantities (e.g., SIFT feature quantities, HoG feature quantities, etc.) 84 from the registration portion image 83 cut out by the cutting unit 32, and registers these feature quantities 84 as registration image information in the storage device 50. Additionally, the authentication unit 44 also extracts feature quantities 94 from the authentication portion image 93 cut out by the cutting unit 42 using the same method as the registration unit 34, and searches for a feature quantity 84 corresponding to the extracted feature quantity 94 from a plurality of feature quantities 84 stored in the storage device 50.

[0061] According to this embodiment, a template for identifying corresponding parts of an article and a cutting area for cutting areas with high recognition accuracy can be set independently. Therefore, the accuracy of template matching and authentication is improved, and the processing load is reduced while increasing processing speed.

[0062] (Third Implementation)

[0063] In both the first and second embodiments, the authentication systems 110 and 120 register multiple identical items in the first stage, which is earlier than the processing stage. In the second stage, which is later than the first stage, after the processing stage, problematic items and other items that require searching for information from the first stage are designated as authentication objects. The system then searches for items corresponding to these authentication objects from among the registered multiple items (traceability).

[0064] In this embodiment, for example, if a problematic item is discovered after the processing stage in the first stage, it is assumed that the problematic item is discovered in the second stage (forward tracking). The authentication system in this embodiment can have the same structure as the first or second embodiment. In this embodiment, the registration device 30 registers multiple items in the first stage to the storage device 50. If a problem is discovered, the individual related to the problem is identified from the storage device 50. For example, if a problem is discovered on a production line specified within a specified time period after a predetermined time period, the individual related to the problem is identified from the items registered in the storage device 50.

[0065] The authentication device 40 identifies an individual from among the multiple items in the second stage that is identical to the identified individual. Specifically, the authentication unit 44 authenticates each object in the multiple items in the second stage by determining whether each piece of authentication image information obtained in the second stage for multiple individuals of the same kind represents the same individual.

[0066] In the first to third embodiments, examples of articles being products manufactured in a manufacturing process have been described. However, the objects of authentication or tracking of the authentication or tracking system of this disclosure are not limited to products. As long as there are multiple articles of the same kind and their appearance changes due to processing, finishing, etc., this disclosure can be effectively applied.

[0067] This disclosure is described based on embodiments, but it should be understood that this disclosure is not limited to those embodiments or structures. This disclosure also includes various modifications and equivalent variations. Furthermore, various combinations and methods, including only one element, one or more, or one or fewer of these elements, are also included in the scope and spirit of this disclosure.

Claims

1. An authentication system that authenticates an individual who has undergone a first stage, a second stage, and processing and / or handling between the first stage and the second stage, the authentication system comprising: a first imaging device that generates an enrollment image of an individual in the first stage; an enrollment image information acquisition section that acquires enrollment image information by cropping an enrollment partial image from the enrollment image using an enrollment template; a second imaging device that generates an authentication image of an individual who is an authentication target in the second stage; an authentication image information acquisition section that acquires authentication image information by cropping an authentication partial image from the authentication image using an authentication template; and an authentication section that performs authentication of the individual who is the authentication target by determining whether the authentication image information and the enrollment image information indicate the same individual, the authentication template corresponds to the enrollment template, and has a difference corresponding to the processing and / or handling with respect to the enrollment template.

2. The authentication system according to claim 1, wherein the authentication section performs authentication of the individual who is the authentication target by searching for the enrollment image information indicating the same individual as the individual indicated by the authentication image information from among the plurality of enrollment image information stored in the storage device with the authentication image information as a query.

3. The authentication system according to claim 1, wherein the authentication section performs authentication of the individual who is the authentication target by determining whether the authentication image information and the enrollment image information indicate the same individual for each of a plurality of authentication image information obtained for a plurality of the same individuals.

4. The authentication system according to any one of claims 1 to 3, wherein the enrollment image information acquisition section acquires the enrollment image information by adjusting the enrollment partial image based on the size of the individual in the first stage, and / or the authentication image information acquisition section acquires the authentication image information by adjusting the authentication partial image based on the size of the individual in the second stage.

5. The authentication system according to any one of claims 1 to 3, wherein the enrollment image information acquisition section acquires the enrollment image information by extracting a feature amount from the enrollment partial image, the authentication image information acquisition section acquires the authentication image information by extracting a feature amount from the authentication partial image.

6. The authentication system according to any one of claims 1 to 3, wherein the enrollment image information acquisition section acquires the enrollment image information by cropping a region corresponding to the enrollment template in the enrollment image as the enrollment partial image, the authentication image information acquisition section acquires the authentication image information by cropping a region corresponding to the authentication template in the authentication image as the authentication partial image.

7. The authentication system according to claim 4, wherein ​ ​ The registration image information acquisition section cuts out a region corresponding to the registration template from the registration image as a registration partial image, and acquires registration image information. The authentication image information acquisition section cuts out a region corresponding to the authentication template from the authentication image as an authentication partial image, and acquires authentication image information.

8. The authentication system according to claim 5, wherein The registration image information acquisition section cuts out a region corresponding to the registration template from the registration image as a registration partial image, and acquires registration image information. The authentication image information acquisition section cuts out a region corresponding to the authentication template from the authentication image as an authentication partial image, and acquires authentication image information.

9. The authentication system according to any one of claims 1 to 3, wherein The registration image information acquisition section cuts out a region corresponding to the registration template from the registration image as a registration partial image, and acquires registration image information. The authentication image information acquisition section cuts out a region corresponding to the authentication template from the authentication image as an authentication partial image, and acquires authentication image information.

10. The authentication system according to claim 4, wherein The registration image information acquisition section cuts out a region corresponding to the registration template from the registration image as a registration partial image, and acquires registration image information. The authentication image information acquisition section cuts out a region corresponding to the authentication template from the authentication image as an authentication partial image, and acquires authentication image information.

11. The authentication system according to claim 5, wherein The registration image information acquisition section cuts out a region corresponding to the registration template from the registration image as a registration partial image, and acquires registration image information. The authentication image information acquisition section cuts out a region corresponding to the authentication template from the authentication image as an authentication partial image, and acquires authentication image information.

12. A tracking system that tracks an individual who has undergone a first stage, a second stage, and processing and / or processing between the first stage and the second stage, The tracking system includes: a processing and processing device that changes the appearance of the individual by processing and / or processing the individual between the first stage and the second stage; a first imaging device that generates a registration image by imaging the individual in the first stage; a registration image information acquisition section that cuts out a registration partial image from the registration image using a registration template, and acquires registration image information; a second imaging device that generates an authentication image by imaging the individual who is the authentication target in the second stage; and a matching device that matches the registration image information and the authentication image information. An authentication image information acquisition section acquires authentication image information by cutting an authentication partial image from the authentication image using an authentication template; And An authentication section performs authentication of the individual of the authentication object by determining whether the authentication image information and the registration image information indicate the same individual, The authentication template corresponds to the registration template, and has a difference corresponding to the processing and / or machining with respect to the registration template.

Images