Reading device, reading method, and computer program

Abstract

To reduce a workload of identification with an identification document.SOLUTION: A reception device comprises a scanner that scans an item, a face camera that takes a picture of a user's face to generate a target person face image, a document camera that takes a picture of the face of an identification document of the user to generate a document photographic image, an IC reader that accesses an IC chip in the identification document, and a processor. The processor reads character information from the document photographic image if there is an item scanned by the scanner that requires confirmation of the user's personal information, reads face image data and personal information from the IC chip using the read character information, and performs face matching based on the face image data and the target person face image, then if the face matching is successful, confirms the user based on the personal information read from the IC chip.SELECTED DRAWING: Figure 13

Description

[Technical field]

[0001] The present disclosure relates to a reception device, an identity verification method, and a computer program. [Background technology]

[0002] A person (hereinafter referred to as a verifier) ​​who verifies whether a person holding an identification document such as a driver's license (hereinafter referred to as the target person) is the person shown on the identification document (hereinafter referred to as the document person) visually compares the target person's face with the facial photograph printed on the identification document to verify whether the target person is the document person. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2010-128913 A Summary of the Invention [Problem to be solved by the invention]

[0004] However, the method of having a verifying person visually compare the face of the target person with the facial photograph printed on the identification document places a heavy workload on the verifying person.

[0005] An object of the present disclosure is to provide a reception device, an identity verification method, and a computer program that reduce the workload of identity verification using identity verification documents. [Means for solving the problem]

[0006] A reception device according to one embodiment of the present disclosure includes a scanner for scanning items, a facial camera for photographing a user's face to generate a facial image of a target person, a document camera for photographing the face of an identification document held by the user to generate a document image, an IC reader for accessing an IC chip on the identification document, and a processor, wherein if an item that requires confirmation of personal information of the user is present among the items scanned by the scanner, the processor reads text information from the document image, reads facial image data and the personal information from the IC chip using the read text information, and performs facial matching based on the facial image data and the facial image of the target person, and if the facial matching is successful, confirms the user based on the personal information read from the IC chip.

[0007] A reception device according to one embodiment of the present disclosure includes a scanner for scanning items, a facial camera for capturing an image of a user's face to generate a facial image of a target person, an IC reader for accessing an IC chip on an identification document carried by the user, and a processor, wherein if an item that requires confirmation of personal information of the user is present among the items scanned by the scanner, the processor performs PIN authentication by the user, and if the PIN authentication is successful, reads facial image data and the personal information from the IC chip and performs facial matching based on the facial image data and the facial image of the target person, and if the facial matching is successful, confirms the user based on the personal information read from the IC chip.

[0008] In one embodiment of the identity verification method of the present disclosure, when an item that requires confirmation of a user's personal information is present among the scanned items, a face camera photographs the face of the user to generate a target person's face image, a document camera photographs the face of the identity verification document held by the user to generate a document image, text information is read from the document image, and an IC reader uses the read text information to access an IC chip on the identity verification document to read out facial image data and the personal information, and performs facial matching based on the facial image data and the target person's facial image, and if the facial matching is successful, the user is verified based on the personal information read from the IC chip.

[0009] An identity verification method according to one embodiment of the present disclosure scans an item with a scanner, and if the scanned item contains an item for which a user's personal information needs to be verified, a facial camera photographs the user's face to generate a facial image of the target person, and the user performs PIN authentication. If the PIN authentication is successful, an IC chip on an identity verification document carried by the user is accessed to read facial image data and the personal information, and a facial match is performed based on the facial image data and the facial image of the target person. If the facial match is successful, the user is verified based on the personal information read from the IC chip.

[0010] A computer program according to one aspect of the present disclosure causes a computer to execute the identity verification method described above.

[0011] Furthermore, these comprehensive or specific aspects may be realized by a system, an apparatus, a method, an integrated circuit, a computer program, or a recording medium, or may be realized by any combination of a system, an apparatus, a method, an integrated circuit, a computer program, and a recording medium. Effect of the Invention

[0012] According to the present disclosure, it is possible to provide a reception device, an identity verification method, and a computer program that reduce the workload of identity verification using an identity verification document. [Brief description of the drawings]

[0013] [Figure 1] FIG. 1 is a block diagram showing a configuration example of an identity verification device according to a first embodiment. [Diagram 2] A table showing the information contained in each type of identity document [Diagram 3] A diagram showing an example of the My Number card (front and back) [Figure 4] An example of the front of a driver's license [Diagram 5] An example of the front of a residence card [Figure 6] Diagram showing an example of a passport personal information page [Figure 7] A flowchart showing an example of the operation of the identity verification device according to the first embodiment. [Figure 8] A flowchart showing an example of a process for acquiring My Number card information according to the first embodiment. [Figure 9] A flowchart showing an example of a passport information acquisition process according to the first embodiment. [Figure 10] Flowchart showing an example of residence card information acquisition processing according to the first embodiment [Figure 11] A flowchart showing an example of a driver's license information acquisition process according to the first embodiment. [Figure 12] A flowchart showing a processing example when identity verification and age verification are performed by linking the identity verification device according to the first embodiment with a self-checkout register. [Figure 13] FIG. 11 is a block diagram showing a first configuration example of a reception device according to a second embodiment. [Figure 14] A diagram outlining the My Number Card application [Figure 15] A flowchart showing an example of the operation of the reception device according to the second embodiment. [Figure 16] Flowchart showing an example of age verification processing according to the second embodiment [Figure 17] A flowchart showing an example of a name and address confirmation process according to the second embodiment. [Figure 18] A flowchart showing an example of age, name and address confirmation processing according to the second embodiment. [Figure 19] FIG. 11 is a block diagram showing a second configuration example of the reception device according to the second embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0014] Hereinafter, the embodiments of the present disclosure will be described in detail with reference to the drawings as appropriate. However, more detailed description than necessary may be omitted. For example, detailed description of already well-known matters and duplicated description of substantially the same configuration may be omitted. This is to avoid the following description becoming unnecessarily redundant and to facilitate understanding by those skilled in the art. Note that the accompanying drawings and the following description are provided to enable those skilled in the art to fully understand the present disclosure, and are not intended to limit the subject matter described in the claims.

[0015] (Embodiment 1) <Device configuration> FIG. 1 is a block diagram showing an example of the configuration of a personal identification device 10 according to the first embodiment.

[0016] The personal identification device 10 includes a processor 11, a memory 12, a face camera 13, a document camera 14, an IC reader 15, an operating device 16, a display device 17, and a placement unit 18.

[0017] The processor 11 executes a computer program stored in the memory 12 to realize the functions of the personal identification device 10 .

[0018] The memory 12 stores computer programs and data that realize the functions of the identity verification device 10. The memory 12 may include a read only memory (ROM) and a random access memory (RAM). The memory 12 may also include a volatile storage medium and a non-volatile storage medium.

[0019] The placement section 18 is a portion on which the personal identification document 20 is placed. In this embodiment, the personal identification document 20 is described as being any one of a My Number card 31, a passport 32, a residence card 33, and a driver's license. However, the personal identification document 20 is not limited to these. Note that the "My Number card" may be read as a "personal number card."

[0020] The personal identification document 20 has a secure IC chip 21 that can be read without contact. The IC chip 21 stores personal information of the owner of the personal identification document 20. Details of the personal information will be described later (see FIG. 2). The IC chip 21 also stores facial image data of the owner of the personal identification document 20. However, if the owner of the residence card 33 is under 16 years old, facial image data does not need to be stored in the IC chip 21 of the residence card 33.

[0021] Furthermore, printed on the face of the identity verification document 20 are textual information 23 indicating the personal information of the holder of the identity verification document 20 and a photograph 22 of the holder's face. Note that if the holder of the residence card 33 is under the age of 16, the photograph 22 does not need to be printed on the face of the residence card 33.

[0022] The IC reader 15 reads the data stored in the IC chip 21 of the personal identification document 20 placed on the placement unit 18 in a non-contact manner (for example, using the NFC (Near Field Communication) method).

[0023] The document photographing camera 14 photographs the face of the personal identification document 20 placed on the placement section 18, and generates a photographed document image.

[0024] The face photographing camera 13 photographs the face of a person (hereinafter referred to as a target person) 1 who places an identification document 20 on the placement section 18, and generates an image of the target person's face.

[0025] The operation device 16 is a device that accepts operations from the target person 1. Examples of the operation device 16 include a touch panel, a physical button, or a combination thereof.

[0026] The display device 17 is a device that displays information, images, etc. Examples of the display device 17 include a liquid crystal display, an organic EL display, etc. Furthermore, the operation device 16 and the display device 17 may be configured as an integrated device (for example, a touch panel display).

[0027] When the target person 1 places the identification document 20 on the placement section 18 of the identification device 10, the identification device 10 captures the face of the target person 1 with the face photographing camera 13 to generate a target person face image, obtains a document face image for identification from the placed identification document 20, and performs face matching between the target person face image and the document face image. The face matching may be a method of directly comparing and matching the document face image and the target person face image, or a method of generating facial features of the document face image and the target person face image, and comparing and matching the facial features. Note that the face matching is not limited to a specific face matching method as long as it can be determined whether the document face image and the target person face image are the same person. If the face matching is successful, the identification device 10 determines that the target person 1 is a person shown on the identification document 20 (hereinafter referred to as the document person) (i.e., determines that the target person 1 is the person), and if the face matching is unsuccessful, determines that the target person 1 is not the document person (i.e., determines that the target person 1 is not the document person). Although details will be described later, the document facial image may be facial image data stored in the IC chip 21, or it may be an image of the facial photograph 22 printed on the identification document 20 (hereinafter referred to as the facial photograph image).

[0028] As described above, there are various types of identity verification documents 20, such as My Number Card 31 (individual number card), passport 32, residence card 33, and driver's license 34, and they mainly refer to documents issued or issued by public offices. The identity verification device 10 according to this embodiment identifies the type of identity verification document 20 placed on the placement unit 18, and performs appropriate processing based on the identification result, thereby efficiently and reliably verifying identity using various types of identity verification documents 20. This will be described in detail below.

[0029] <Information contained in identity verification documents> FIG. 2 is a table showing the main information contained in each type of identification document 20. FIG. 3 is a diagram showing an example of the face (front and back) of a My Number card 31. FIG. 4 is a diagram showing an example of the personal information page of a passport 32. FIG. 5 is a diagram showing an example of the face (front) of a residence card 33. FIG. 6 is a diagram showing an example of the face (front) of a driver's license 34.

[0030] As shown in Fig. 3, at least the name, address, date of birth, gender, security code, and expiration date are printed as text information 23 on the front side of the My Number card 31. Information including the name, address, date of birth, and gender is also referred to as four pieces of information. In this embodiment, the four pieces of information may also be referred to as personal information. In addition, a face photograph 22 is printed on the front side of the My Number card 31.

[0031] At least the name, address, date of birth, sex, facial image data, and personal number are stored in the IC chip 21 of the My Number Card 31. The facial image data is image data obtained by photographing the face of the owner of the My Number Card 31.

[0032] The My Number card 31 has at least a verification number A, a verification number B, a signature electronic certificate PIN, a user certificate PIN, a card information input assistance PIN, and a resident register PIN as information used to control access to the IC chip 21.

[0033] The verification number B is a combination of a six-digit date of birth, a four-digit year portion of the expiration date, and a four-digit security code, which are printed on the surface of the My Number card 31. By using the verification number B, it is possible to access the four pieces of information and the facial photo data stored in the IC chip 21 of the My Number card 31. In other words, by obtaining the verification number B printed on the surface of the My Number card 31, it is possible to access the four pieces of information and the facial photo data stored in the IC chip 21 of the My Number card 31.

[0034] 4, at least the name, date of birth, sex, passport number, expiration date, and MRZ (Machine Readable Zone) are printed as text information 23 on the personal information page of the passport 32. In addition, a facial photograph 22 is printed on the personal information page of the passport 32.

[0035] The IC chip 21 of the passport 32 stores at least the name, date of birth, sex, facial image data, and passport number.

[0036] The passport 32 has at least the MRZ as information used for access control to the IC chip 21. By using the MRZ, it is possible to access the four pieces of information and facial image data stored in the IC chip 21 of the passport 32. In other words, by obtaining the MRZ from the text information 23 printed on the personal information page of the passport 32, it is possible to access the four pieces of information and facial image data stored in the IC chip 21 of the passport 32.

[0037] 5, at least the name, address, date of birth, sex, residence card number, and expiration date are printed as text information 23 on the front of residence card 33. In addition, a face photo 22 (for those aged 16 or older) is printed on the front of residence card 33.

[0038] At least the address, face image data, and face image data are stored in the IC chip 21 of the residence card 33. The face image data is an image of the face of the residence card.

[0039] The residence card 33 has at least a residence card number as information used for access control to the IC chip 21. By using the residence card number, it is possible to access the four pieces of information, the facial image data and the face image data stored in the IC chip 21 of the residence card 33. In other words, by obtaining the residence card number printed on the surface of the residence card 33, it is possible to access the four pieces of information, the facial image data and the face image data stored in the IC chip 21 of the residence card 33.

[0040] 6, at least the name, address, date of birth, license number, and expiration date are printed as text information 23 on the front of the driver's license 34. In addition, a face photograph 22 is printed on the front of the driver's license 34.

[0041] The IC chip 21 of the driver's license 34 stores at least the name, address, date of birth, facial image data, and license number.

[0042] The driver's license 34 has at least PIN1 and PIN2 as information used for access control to the IC chip 21. PIN1 and PIN2 are four-digit numbers set in advance by the owner of the driver's license 34. By using PIN1, it is possible to access four pieces of information stored in the IC chip 21. In addition, by using PIN1 and PIN2, it is possible to access face image data stored in the IC chip 21 of the driver's license 34.

[0043] Since the IC chip 21 of the personal identification document 20 is tamper-resistant, it is very difficult to physically tamper with the data stored in the IC chip 21. Furthermore, since the data stored in the IC chip 21 is digitally signed, if the data stored in the IC chip 21 is tampered with, the tampering can be detected. Therefore, when the personal identification device 10 reads out face image data from the IC chip 21 and performs face matching of the read out face image data with the target person's face image as the document face image, and the face matching is successful, the reliability of the personal identification result that the target person 1 is determined to be the document person is very high.

[0044] Therefore, it is preferable that the identity verification device 10 uses the face image data stored in the IC chip 21 for face matching, but depending on the situation, there are cases where the IC chip 21 cannot be accessed. In such a case, if the identity verification fails because the IC chip 21 cannot be accessed, the efficiency of the identity verification will deteriorate. Therefore, when the identity verification device 10 cannot access the IC chip 21, the face photo 22 printed on the identity verification document 20 may be used for face matching. However, the face photo 22 printed on the identity verification document 20 may be physically tampered with. Therefore, even if the identity verification device 10 performs face matching with the target person's face image using the face photo 22 printed on the identity verification document 20 as the document face image and the face matching is successful, the identity verification result that determines that the target person 1 is the document person has a lower reliability than the identity verification result determined using the face image data stored in the IC chip 21 described above.

[0045] When the identity verification device 10 according to the present embodiment succeeds in identity verification, it can inform a person (hereinafter, referred to as a verifyer) who verifies whether the target person 1 is the document person or not or other devices of how much the successful identity verification can be trusted by also presenting the reliability of the successful identity verification. This allows the verifyer or other devices to take various measures according to the reliability of the successful identity verification.

[0046] The operation of the identity verification device 10 capable of presenting the reliability will be described in detail below.

[0047] <Overall processing> FIG. 7 is a flowchart showing an example of the operation of the identity verification device 10 according to the first embodiment.

[0048] The target person 1 places the identification document 20 on the placement section 18. At this time, the identification device 10 detects that the identification document 20 has been placed on the placement section 18 (S101). For example, the identification device 10 may determine whether the identification document 20 has been placed on the placement section 18 by either of the following methods (A1) or (A2). (A1) The identification device 10 keeps the document photographing camera 14 in a constant photographing state, and when the identification document 20 is photographed, determines that the identification document 20 has been placed on the placement section 18. (A2) The identification device 10 keeps the IC reader 15 in a constant reading state, and when the IC chip 21 of the identification document 20 can be read, determines that the identification document 20 has been placed on the placement section 18.

[0049] The face photographing camera 13 of the personal identification device 10 photographs the face of the target person 1 and generates a target person's face image (S102).

[0050] The processor 11 accesses the AID and common area of ​​the IC chip 21 of the personal identification document 20 through the IC reader 15, and determines the type of the personal identification document 20 (hereinafter referred to as document type) based on the identification information acquired by the access (S103). Alternatively, the processor 11 may determine the type of the personal identification document 20 based on an image of the personal identification document 20.

[0051] Processor 11 determines whether the document type is a "My Number card," a "passport," a "residence card," or a "driver's license" based on the determination result in step S103 (S104).

[0052] If the determination result in step S104 is "My Number Card" (S104: My Number Card), the processor 11 executes My Number Card information acquisition processing (S105). The My Number Card information acquisition processing will be described later in detail (see FIG. 8).

[0053] If the determination result in step S104 is "passport" (S104: passport), the processor 11 executes a passport information acquisition process (S106). The passport information acquisition process will be described later in detail (see FIG. 9).

[0054] If the determination result in step S104 is "residence card" (S104: residence card), the processor 11 executes a residence card information acquisition process (S107). The residence card information acquisition process will be described later in detail (see FIG. 10).

[0055] If the determination result in step S104 is "driver's license" (S104: driver's license), the processor 11 executes a driver's license information acquisition process (S108). The driver's license information acquisition process will be described in detail later (see FIG. 11).

[0056] That is, the processor 11 switches the method of accessing the IC chip 21 to any one of steps S105, S106, S107, and S108 based on the determination result of step S104 (that is, the document type).

[0057] In any of the above steps S105, S106, S107, and S108, the processor 11 obtains a document face image and personal information from the identification document 20, and obtains the reliability of the obtained information. Hereinafter, the document face image and personal information obtained from the identification document 20 may be collectively referred to as document-obtained information.

[0058] Next, the processor 11 performs face matching of the target person's face image with the document face image (S110). The face matching may be realized using a known face image matching technique.

[0059] The processor 11 determines whether or not the face matching in step S110 has been successful (S111). That is, the processor 11 determines whether or not the target person 1 is a document person.

[0060] If face matching fails (S111: NO), the processor 11 outputs information indicating failure of identity verification (S121) and ends this process.

[0061] If face matching is successful (S111: YES), processor 11 determines whether the reliability of the document-acquired information is "high" (S112).

[0062] If the reliability of the document acquisition information is not "high" (for example, if the reliability is "medium" or "low") (S112: NO), processor 11 outputs information indicating successful identity verification and information indicating the reliability of "medium" or "low" (S122), and ends this process. Note that the reliability output here is the reliability determined in the process of step S105, step S106, step S107, or step S108.

[0063] If the reliability of the document-acquired information is "high" (S112: YES), processor 11 outputs information indicating successful identity verification and information indicating the reliability "high" (S123), and ends this process.

[0064] The information output in step S121, step S122, or step S123 may be displayed on the display device 17. This allows the verifying person to know whether the target person 1 is the document person or not, as well as the reliability of the verification if successful.

[0065] The information output in step S121, step S122, or step S123 may be transmitted to another device. This allows the other device to use the determination result of whether the target person 1 is the document person or not, and also the reliability of the successful identity verification. An example of the use of the identity verification device 10 by another device will be described later (see FIG. 12).

[0066] 7, if face matching in step S110 is successful (S111: YES), identity verification is deemed successful regardless of the reliability of the document-acquired information, but the success or failure of identity verification may be determined according to the reliability. For example, even if face matching in step S110 is successful (S111: YES), processor 11 may determine identity verification as unsuccessful if the reliability of the document-acquired information is not "high" (for example, if the reliability is "medium" or "low") (S112: NO), and may determine identity verification as successful only if the reliability of the document-acquired information is "high" (S112: YES).

[0067] In addition, in the present embodiment, "high", "medium", and "low" are used to express the level of reliability, but the level of reliability may be expressed in other ways. For example, the level of reliability may be expressed as a numerical value, with a higher numerical value indicating a higher level of reliability and a lower numerical value indicating a lower level of reliability.

[0068] <My Number Card information acquisition process> 8 is a flowchart showing an example of a process for acquiring My Number card information according to embodiment 1. This process corresponds to step S105 in FIG.

[0069] The document photographing camera 14 of the personal identification device 10 photographs the face (front side) of the My Number card 31 and generates a document photographed image (S201).

[0070] The processor 11 of the personal identification device 10 performs OCR (Optical Character Recognition) on the document photographed image generated in step S201 to obtain character information 23, and obtains the verification number B from the character information 23 (S202). Specifically, the processor 11 obtains the six-digit date of birth, the four-digit year portion of the expiration date, and the four-digit security code printed on the surface of the My Number card 31, and obtains the verification number B by combining them.

[0071] Processor 11 determines whether or not verification number B was obtained in step S202 (S203). For example, if the face of the card is dirty or the face of the card photographed in step S201 is the opposite side (i.e., the back side) to the side on which verification number B is printed, verification number B may not be obtained.

[0072] If processor 11 has acquired verification number B (S203: YES), the process proceeds to step S204. If processor 11 has not acquired verification number B (S203: NO), the process proceeds to step S210.

[0073] First, the case where the verification number B is acquired (S203: YES) will be described.

[0074] The processor 11 accesses the IC chip 21 using the verification number B as a key (S204). Then, the processor 11 determines whether or not the IC chip 21 has been accessed (S205).

[0075] If the processor 11 is unable to access the IC chip 21 (S205: NO), the process proceeds to step S210.

[0076] When the processor 11 can access the IC chip 21 (S205: YES), the processor 11 reads out the face image data stored in the IC chip 21 as a document face image and also reads out the personal information stored in the IC chip 21 (S206). Then, the processor 11 sets the reliability of the document acquisition information including the read out face image data (document face image) and personal information to "high" (S207), and ends this process.

[0077] Next, a case where the verification number B cannot be acquired (S203: NO) or where the IC chip 21 cannot be accessed (S205: NO) will be described.

[0078] The processor 11 acquires the face photograph image included in the document photograph image as a document face image, and also subjects the document photograph image to OCR to acquire the character information 23 printed on the face as personal information (S210). Then, the processor 11 sets the reliability of the document acquired information including the acquired face photograph image (document face image) and personal information to "low" (S211), and ends this process (i.e., the process of step S105).

[0079] <Passport information acquisition process> 9 is a flowchart showing an example of the passport information acquisition process according to Embodiment 1. This process corresponds to step S106 in FIG.

[0080] The document photographing camera 14 of the personal identification device 10 photographs the personal information page of the passport 32 and generates a document photographed image (S301).

[0081] The processor 11 of the personal identification device 10 performs OCR on the document image generated in step S301 to obtain the MRZ (S302). Specifically, the processor 11 obtains the character information 23 printed on the lower part of the personal information page of the passport 32 by OCR, and obtains the MRZ from the character information 23.

[0082] The processor 11 determines whether or not the MRZ was obtained in step S302 (S303). For example, if the personal information page is dirty or the page photographed in step 301 is a page different from the personal information page, the MRZ may not be obtained.

[0083] If the processor 11 has been able to acquire the MRZ (S303: YES), the process proceeds to step S304. If the processor 11 has not been able to acquire the MRZ (S303: NO), the process proceeds to step S310.

[0084] First, the case where the MRZ is acquired (S303: YES) will be described.

[0085] The processor 11 accesses the IC chip 21 using the MRZ as a key (S304), and then the processor 11 determines whether or not the IC chip 21 has been accessed (S305).

[0086] If the processor 11 is unable to access the IC chip 21 (S305: NO), the process proceeds to step S310.

[0087] When the processor 11 can access the IC chip 21 (S305: YES), the processor 11 reads out the facial image data stored in the IC chip 21 as a document facial image and also reads out the personal information stored in the IC chip 21 (S306). Then, the processor 11 sets the reliability of the document acquisition information including the read facial image data (document facial image) and personal information to "high" (S307), and ends this process.

[0088] Next, a case where the MRZ cannot be acquired (S303: NO) or the IC chip 21 cannot be accessed (S305: NO) will be described.

[0089] The processor 11 acquires the face photograph image included in the document photograph image as a document face image, and performs OCR on the document photograph image to acquire the text information 23 printed on the page as personal information (S310). Then, the processor 11 sets the reliability of the document acquired information including the acquired face photograph image (document face image) and personal information to "low" (S311), and ends this process (i.e., the process of step S106).

[0090] <Residence card information acquisition process> 10 is a flowchart showing an example of the residence card information acquisition process according to Embodiment 1. This process corresponds to step S107 in FIG.

[0091] The document photographing camera 14 of the personal identification device 10 photographs the face (front side) of the residence card 33 and generates a document photographed image (S401).

[0092] The processor 11 of the personal identification device 10 performs OCR on the photographed document image generated in step S401 to obtain character information 23, and obtains the residence card number from the character information 23 (S402).

[0093] The processor 11 determines whether or not the residence card number was obtained in step S402 (S403). For example, if the card face is dirty or the card face photographed in step S401 is the opposite side (i.e., the back side) to the side on which the residence card number is printed, the residence card number may not be obtained.

[0094] If the processor 11 has acquired the residence card number (S403: YES), the process proceeds to step S404. If the processor 11 has not acquired the residence card number (S403: NO), the process proceeds to step S420.

[0095] First, the case where the residence card number can be obtained (S403: YES) will be described.

[0096] The processor 11 accesses the IC chip 21 using the residence card number as a key (S404). Then, the processor 11 determines whether or not the IC chip 21 has been accessed (S405).

[0097] If the processor 11 is unable to access the IC chip 21 (S405: NO), the process proceeds to step S420.

[0098] When the processor 11 can access the IC chip 21 (S405: YES), the processor 11 acquires face image data stored in the IC chip 21 (S406). The face image data is image data obtained by photographing the face (front) of the residence card 33.

[0099] The processor 11 performs OCR on the acquired card face image data to acquire character information 23, and acquires personal information from the character information 23 (S407).

[0100] The processor 11 determines whether the age included in the personal information acquired in step S407 indicates that the user is 16 years old or older (S408).

[0101] If the age included in the personal information indicates 16 years or older (S408: YES), the processor 11 reads out the face image data from the IC chip 21 as a document face image (S409). Then, the processor 11 sets the reliability of the document acquired information including the acquired personal information and face image data (document face image) to "high" (S410), and ends this process.

[0102] If the age included in the personal information indicates that the person is under 16 years old (S408: NO), the processor 11 sets the reliability of the document-acquired information including the personal information to "medium" (S411) without acquiring face image data, and ends this process. The reason for not acquiring face image data is that the residence card 33 of a person under 16 years old does not store face image data in the IC chip 21.

[0103] Next, a case where the residence card number cannot be acquired (S403: NO) or the IC chip 21 cannot be accessed (S405: NO) will be described.

[0104] The processor 11 performs OCR on the photographed document image to obtain the character information 23, and obtains personal information from the character information 23 (S420).

[0105] The processor 11 determines whether the age included in the personal information acquired in step S420 indicates 16 years of age or older (S421).

[0106] If the age included in the personal information indicates 16 years or older (S421: YES), the processor 11 acquires the face photo image included in the document photograph image as a document face image (S422). Then, the processor 11 sets the reliability of the document acquired information including the acquired personal information and face photo image (document face image) to "low" (S423), and ends this process (i.e., the process of step S107).

[0107] If the age included in the personal information indicates that the person is under 16 years old (S421: NO), the processor 11 sets the reliability of the document-acquired information including the personal information to "low" (S424) without acquiring a facial photo image, and ends this process. The reason for not acquiring a facial photo image is that residence cards 33 for persons under 16 years old do not have facial photos printed on the card face.

[0108] <Driver's license information acquisition process> 11 is a flowchart showing an example of the driver's license information acquisition process according to Embodiment 1. This process corresponds to step S108 in FIG.

[0109] The document photographing camera 14 of the personal identification device 10 photographs the face (front) of the driver's license 34 and generates a document photographed image (S501).

[0110] The processor 11 of the personal identification device 10 prompts the user to enter PIN1 (S502).

[0111] The processor 11 accesses the personal information in the IC chip 21 using the PIN1 entered in step S502 as a key (S503).

[0112] The processor 11 determines whether or not the personal information in the IC chip 21 has been accessed (S504). For example, if the entered PIN1 is incorrect or if access is locked, access is not possible.

[0113] If the processor 11 can access the personal information in the IC chip 21 (S504: YES), the process proceeds to step S505. If the processor 11 cannot access the personal information in the IC chip 21 (S504: NO), the process proceeds to step S520.

[0114] First, the case where the personal information in the IC chip 21 is accessed (S504: YES) will be described.

[0115] The processor 11 reads the personal information from the IC chip 21 (S505).

[0116] The processor 11 prompts the user to enter PIN2 (S506).

[0117] The processor 11 accesses the face image data in the IC chip 21 using the PIN2 entered in step S506 as a key (S507).

[0118] The processor 11 determines whether or not the face image data in the IC chip 21 can be accessed (S508). For example, if the entered PIN2 is incorrect or if access is locked, access is not possible.

[0119] When the processor 11 can access the face image data in the IC chip 21 (S508: YES), the processor 11 reads the face image data from the IC chip 21 and sets it as a document face image (S509). Then, the processor 11 sets the reliability of the document acquisition information including the acquired personal information and face image data (document face image) to "high" (S510), and ends this process.

[0120] If the processor 11 cannot access the face image data in the IC chip 21 (S508: NO), the processor 11 acquires a face photo image from the document photograph image and sets it as the document face image (S511). Then, the processor 11 sets the reliability of the document acquired information including the acquired personal information and face photo image (document face image) to "medium" (S512), and ends this process.

[0121] Next, a case where the personal information in the IC chip 21 cannot be accessed (S504: NO) will be described.

[0122] The processor 11 performs OCR on the photographed document image generated in step S501 to obtain character information 23, and obtains personal information from the character information 23 (S520).

[0123] The processor 11 acquires a face photo image from the document photograph image and sets it as a document face image (S521). Then, the processor 11 sets the reliability of the document acquired information including the acquired personal information and face photo image (document face image) to "low" (S522), and ends this process (i.e., the process of step S108).

[0124] <Linkage with identity verification device> The identity verification device 10 can be linked to various devices or systems. For example, examples of devices or systems that can be linked to the identity verification device 10 include self-checkout registers, vending machines, entrance / exit systems for amusement parks, identity verification for health insurance cards in medical facilities, and various other devices that require identity verification. Below, as an example of linkage, a case where the identity verification device 10 is linked to a self-checkout register will be described.

[0125] FIG. 12 is a flowchart showing a processing example in which identity verification and age verification are performed by linking the identity verification device 10 according to the first embodiment with a self-checkout register.

[0126] The personal identification device 10 executes the process shown in Fig. 7 (S601). That is, the target person 1 using the self-checkout register places the personal identification document 20 on the placement unit 18 of the personal identification device 10. The personal identification device 10 executes the process shown in Fig. 7 for the personal identification document 20, and outputs the personal identification result (success or failure), personal information, and reliability to the self-checkout register.

[0127] The self-checkout machine scans the barcode of the product (S602).

[0128] The self-checkout checkout determines whether or not any of the items scanned in step 602 require age verification (S603).

[0129] If the scanned item does not require age verification (S603: NO), the self-checkout adds the item price to the transaction (S610) and returns the process to step S602.

[0130] If the scanned product is one that requires age verification (S603: YES), the self-checkout determines whether or not the identity verification of the target person 1 has been successful based on the identity verification result output from the identity verification device 10 (S604). The identity verification result may include information indicating the date of birth of the target person 1 in addition to the success or failure of identity verification.

[0131] If the identity verification of the target person 1 is successful (S604: YES), the self-checkout refers to the personal information output from the identity verification device 10 and determines whether the target person 1 is over the age at which products can be purchased (S605).

[0132] If the target person 1 is at least old enough to purchase a product (S605: YES), the self-checkout determines whether the reliability output from the personal identification device 10 is "high" (S606).

[0133] If the reliability is "high" (S606: YES), the self-checkout register adds the price of the product to the transaction (S610) and returns the process to step S602.

[0134] If the identity verification of the target person 1 fails (S604: NO), if the age of the target person 1 is below the age at which the product can be sold (S605: NO), or if the reliability output from the identity verification device 10 is "medium" or "low" (S606: NO), the self-checkout calls a store clerk (S611) and temporarily suspends processing. At this time, the monitor of the self-checkout may display information indicating whether the identity verification has failed, whether the age of the target person 1 is below the age at which the product can be sold, or whether the reliability is "medium" or "low". If the called store clerk finds that the age of the target person 1 is below the age at which the product can be sold, for example, the store clerk may collect the product and resume the self-checkout process, ask the target person 1 to re-line up at a manned register, or have the store clerk visually check the product on the spot and approve the self-checkout age verification. In addition, if the identity verification fails or if the reliability is "medium" or "low," the called store clerk may, for example, ask the target person 1 to place another identity verification document 20 on the placement section 18 of the identity verification device 10 and verify the person's identity again.

[0135] In this way, by linking the identity verification device 10 with another device, the other device can perform processing according to the strictness of the person verification required, using the identity verification result, personal information, and reliability output from the identity verification device 10. For example, in a situation where strict person verification is required, the other device may determine that the identity verification has failed if the identity verification output from the identity verification device 10 is successful but the reliability output together is lower than "high". On the other hand, in a situation where strict person verification is not required, the other device may determine that the identity verification has succeeded if the identity verification output from the identity verification device 10 is successful and the reliability output together is "high" or "medium", and may determine that the identity verification has failed if the reliability output together is "low".

[0136] In the above, an example of a self-checkout has been described, so if the identity verification fails, the reliability is low, or the identity verification cannot be performed, a manned response is performed or the sale is stopped. However, when the identity verification device 10 is used for entering and exiting a place with a low security risk, entry and exit may be permitted even if the reliability is low. In this case, the identity verification device 10 may notify the user (administrator) that the reliability was low. This allows the user (administrator) to visually check the actual matching image for the target person 1 with a low reliability or to monitor the target person 1. This makes it possible to realize a system including the identity verification device 10 that can respond to security risks while maintaining the convenience of entering and exiting. In this way, other devices or systems can take various measures depending on the reliability output from the identity verification device 10.

[0137] (Summary of the first embodiment) The above description of the first embodiment discloses the following techniques.

[0138] <Technology A1> The identification device 10, which determines whether a target person 1 is the document person shown on an identification document 20, comprises a face photographing camera 13 which photographs the face of the target person 1 to generate a target person's facial image, a document photographing camera 14 which photographs the face of the identification document 20 to generate a document photographed image, an IC reader 15 which accesses the IC chip 21 of the identification document 20, and a processor 11, and the processor 11 performs face matching based on the facial image data read from the IC chip 21 and the target person's facial image, and determines whether the target person 1 is the document person based on the result of the face matching. In this way, the identity verification device 10 can efficiently and reliably perform identity verification using the identity verification document 20 by comparing the facial image of the target person taken of the face of the target person with either the facial image data stored in the IC chip 21 of the identity verification document 20 or the facial photograph printed on the face of the identity verification document to determine whether the target person 1 is the document person.

[0139] <Technology A2> In the personal identification device 10 described in Technique A1, the processor 11 identifies the type of the personal identification document 20, switches the access method to the IC chip 21 based on the identified type, and reads face image data from the IC chip 21 by the switched access method. This makes it possible to provide an identity verification device 10 that can use various types of identity verification documents 20 with different access methods to the IC chip 21.

[0140] <Technology A3> In the personal identification device 10 described in Technique A2, the types of personal identification document 20 include at least one of a My Number card 31, a passport 32, a residence card 33, and a driver's license 34. This makes it possible to provide an identity verification device 10 that can use a My Number card 31, a passport 32, a residence card 33, and a driver's license 34 for identity verification.

[0141] <Technology A4> In the identity verification device 10 described in Technology A2 or Technology A3, when the processor 11 determines that the identity verification document 20 is of a type that allows access to the IC chip 21 based on the information on the face of the identity verification document 20, it reads character information from the photographed document image and switches to an access method in which the processor 11 reads facial image data from the IC chip 21 using the read character information. As a result, when the My Number card 31, passport 32, or residence card 33 is placed, the personal identification device 10 can automatically obtain face image data from the IC chip 21 and perform face matching without the target person 1 having to input a PIN or the like. Therefore, the personal identification device 10 can perform personal identification efficiently with high reliability.

[0142] <Technology A5> In an identity verification device 10 described in any one of Technologies A2 to A4, when a processor 11 determines that the type of identity verification document 20 is a type that allows access to an IC chip 21 based on a PIN, the processor 11 has the target person 1 input a PIN and switches to an access method in which facial image data is read from the IC chip 21 using the input PIN. As a result, when the driver's license 34 is placed on the personal identification device 10, the personal identification device 10 can automatically obtain face image data from the IC chip 21 using the input PIN and perform matching. Therefore, the personal identification device 10 can perform personal identification efficiently with high reliability.

[0143] <Technology A6> In an identity verification device 10 described in any one of Technologies A1 to A5, an identity verification document 20 has a facial photograph on its face, and if the processor 11 is able to read facial image data from the IC chip 21, it performs face matching based on the facial image data read from the IC chip 21 and the facial image of the target person, and if it is unable to read facial image data from the IC chip 21, it performs face matching based on an image of the facial photograph obtained from a photographed document image and the facial image of the target person. In this way, the personal identification device 10 performs face matching by preferentially using the face image data acquired from the IC chip 21, thereby enabling the personal identification to be performed with higher reliability.

[0144] <Technology A7> In an identity verification device 10 described in any one of Techniques A1 to A6, a processor 11 determines the reliability of the face matching results based on whether face image data is used for face matching or whether a face photograph image is used for face matching. In this way, the personal identification device 10 determines the reliability of the face matching result, and various subsequent responses and processes can be made possible using not only the face matching result but also the reliability.

[0145] <Technology A8> In the personal identification device 10 described in Technique A7, the processor 11 determines the reliability of the facial image data to be higher when used for face matching than the reliability of the facial photograph image to be used for face matching. In this way, by determining a high reliability when the facial image data read from the IC chip 21 is used for facial matching, the personal identification device 10 can be used for various responses and processes that require a higher reliability.

[0146] <Technology A9> The method of identifying whether or not a target person 1 is the document person shown on an identification document 20 involves photographing the face of the target person 1 to generate a target person's facial image, photographing the face of the identification document 20 to generate a document-photographed image, performing face matching based on the facial image data read from the IC chip 21 of the identification document 20 and the target person's facial image, and determining whether or not the target person is the document person based on the results of the face matching. In this way, the facial image of the target person captured by photographing the face of the target person is compared with either the facial image data stored in the IC chip 21 of the identification document 20 or the facial photograph printed on the face of the identification document to determine whether the target person 1 is the document person, thereby enabling the identification method to efficiently perform identity verification using the identification document 20 with sufficient reliability.

[0147] <Technology A10> The computer program causes a computer to execute the method described in Technique A9. In this way, by comparing the facial image of the target person taken of the face of the target person with either the facial image data stored in the IC chip 21 of the identification document 20 or the facial photograph printed on the face of the identification document and determining whether the target person 1 is the document person, the computer executing the computer program can efficiently and reliably perform identity verification using the identification document 20.

[0148] (Embodiment 2) In the second embodiment, the components already described in the first embodiment may be given the same reference symbols and the description thereof may be omitted. Furthermore, the contents of the first embodiment may be incorporated into the second embodiment. For example, the face matching and / or PIN authentication performed in the second embodiment may be realized by the face matching and / or PIN authentication method described in the first embodiment.

[0149] <Configuration of the reception device> FIG. 13 is a block diagram showing a first example of a configuration of the accepting device 40 according to the second embodiment.

[0150] The reception device 40 is installed in a store, such as a convenience store, and is used by the user 2 to pay for products purchased at the store by himself or herself, or to carry out procedures for receiving a package by himself or herself using a receipt (or a non-delivery slip; the same applies below). In other words, the reception device 40 can also be interpreted as a multi-function self-checkout. There are products in the store that have age restrictions on sales. Examples of products that have age restrictions include licensed products, such as alcohol or tobacco. If the products purchased by the user 2 include products that have age restrictions (for example, licensed products), the reception device 40 performs age verification using the identification document 20. In addition, when handing over a package, the user is required to confirm that the name and address of the package destination match the user's name and address. When the user 2 carries out procedures for receiving a package, the reception device 40 confirms the name and address of the user 2 using the identification document 20. This makes it possible to automate the age verification process and the name and address verification process in the store, thereby reducing the workload of store clerks. The place where the reception device 40 is installed is not limited to a convenience store, but may be any place where products can be purchased and parcels can be received using a receipt. This will be described in detail below.

[0151] The reception device 40 comprises a processor 11, a memory 12, a face camera 13, a document camera 14, an IC reader 15, an operation device 16, a display device 17, a placement unit 18, a scanner 41, a settlement device 42, and a luggage processing device 43.

[0152] The processor 11 executes a computer program stored in the memory 12 to realize the functions of the receiving device 40. The memory 12 stores computer programs and data that realize the functions of the receiving device 40. The memory 12 may include a read only memory (ROM) and a random access memory (RAM). The memory 12 may also include a volatile storage medium and a non-volatile storage medium.

[0153] Face camera 13, document camera 14, IC reader 15, operating device 16, display device 17 and placement unit 18 have already been described in the first embodiment, so description thereof will be omitted here.

[0154] The scanner 41 scans a code (e.g., a barcode or a two-dimensional code (e.g., a QR code (registered trademark))) of an item. The scanner 41 may be of a type that scans codes using infrared rays, a type that scans codes using a camera, or another type.

[0155] In this embodiment, the item includes at least one of a product sold in a store where the reception device 40 is installed and a package receipt. The product also includes normal products with no age restriction on sales and licensed products with age restrictions on sales. In this embodiment, the age restriction is described as not being sold to anyone under the age of 20 (adult) (i.e., not being able to be purchased by anyone under the age of 20). However, the age restriction is not limited to being under 20, and may differ from country to country or from product to product.

[0156] When the scanner 41 scans the code of a product, the processor 11 obtains, from the scan result, the product name and price of the product, and information indicating whether the product is a licensed product. The settlement device 42 performs settlement processing for the scanned products in cooperation with the processor 11. For example, the settlement device 42 displays the sum of the prices of the scanned products (total amount), accepts payment by cash, credit card, electronic money, etc., and issues receipts.

[0157] The receipt of the parcel contains at least a parcel number for identifying the delivery of the parcel. Note that, although the receipt is expressed as a receipt in this embodiment, the receipt does not necessarily have to be paper and may be, for example, an electronic image displayed on the screen of a smartphone.

[0158] When the baggage number on the receipt is scanned by the scanner 41, the processor 11 obtains information indicating the baggage number on the receipt from the scan result. The baggage processing device 43 performs baggage receipt processing for the baggage indicated by the scanned receipt in cooperation with the processor 11. For example, the baggage processing device 43 displays the door number of the electronic locker 51 in which the baggage indicated by the baggage number is stored, and unlocks the door of the electronic locker 51 in which the baggage indicated by the baggage number is stored.

[0159] <My Number Card Application> FIG. 14 is a diagram for explaining an outline of the application of the My Number card 31.

[0160] As shown in FIG. 14, the IC chip 21 of the My Number card 31 has four applications, broadly divided into (B1) to (B4) as follows.

[0161] (B1) Card Application (Card AP) The card AP stores image data of the front information (four pieces of information (address, name, date of birth, gender) + face photo) and the back information (personal number).

[0162] (B2) Electronic Certificate Application by Public Personal Identification Service (JPKI-AP) JPKI-AP records information on "signature electronic certificates" and "user electronic certificates."

[0163] (B3) Application for assisting input of information on cards (AP for assisting input of information on cards) The card information input assistance AP records information for using the personal number and the four pieces of information as text data when carrying out administrative tasks that utilize the personal number and the four pieces of information. The information to be recorded or used is as follows: (1) Personal number and four pieces of information (and their electronic signature data) (2) Personal number (and its electronic signature data) (3) 4 Information (and its electronic data)

[0164] (B4) Resident Registration Application (Resident Registration AP) The Resident Registration AP records information for using resident registration codes as text data when handling Resident Registration Network-related affairs.

[0165] When using (2) or (3) of the card's face AP or the face-information input support AP, the card can be accessed using the matching number based on the information printed on the card. However, when using the two electronic certificates of the JPKI-AP, (1) of the card's face-information input support AP, or the Resident Registration AP, the PIN number set when the Individual Number Card31 is issued is used.

[0166] <Example of reception device operation> FIG. 15 is a flowchart showing an example of the operation of the accepting device 40 according to the second embodiment.

[0167] User 2 operates scanner 41 to scan a code (e.g., a barcode or two-dimensional code) of an item (S701). Processor 11 stores item information corresponding to the scanned code in memory 12. If the item is a commodity, the item information may include the item name and price corresponding to the scanned code, as well as information indicating whether the item is a licensed item. If the item is a package receipt, the item information may include the package number corresponding to the scanned code.

[0168] User 2 repeats the process of step S701 until all items have been scanned (S702: NO). If all items have been scanned (S702: YES), the process proceeds to step S703.

[0169] The processor 11 determines whether the scanned items include items that require identity verification (S703). In this embodiment, licensed items (e.g., alcohol, tobacco) and package receipts are described as items that require identity verification. However, items that require identity verification are not limited to these.

[0170] If the scanned items do not include items that require identity verification (S703: NO), the processor 11 cooperates with the settlement device 42 to carry out the settlement process for the scanned items (i.e., the products) (S720), and ends this process. In the settlement process, the settlement device 42 displays the total price of the scanned products, carries out the payment process with the user 2, and issues a receipt.

[0171] If the scanned items include an item that requires identity verification (S703: YES), the processor 11 displays a message on the display device 17 instructing the user 2 to place the identity verification document 20 on the placement unit 18. After the user 2 places the identity verification document 20 on the placement unit 18 (S704), the process proceeds to the next step S705.

[0172] The processor 11 determines items required for identity verification (S705). For example, when the scanned items include only licensed items, the processor 11 determines that age verification is required (S705: age), when the scanned items include only receipts, the processor 11 determines that name and address verification is required (S705: name and address), and when the scanned items include both licensed items and receipts, the processor 11 determines that age, name, and address verification are required (S705: age, name, and address).

[0173] When the processor 11 determines that age verification is required (S705: Age), it executes the age verification process (S711) and ends this process. Details of the age verification process will be described later (see FIG. 16). The processor 11 may execute the age verification process (S711) when scanning a product that requires age verification, rather than after completing scanning of all items (S702: YES).

[0174] When the processor 11 determines that the name and address need to be confirmed (S705: name and address), it executes the name and address confirmation process (S712) and ends this process. Details of the name and address confirmation process will be described later (see FIG. 17). The processor 11 may perform the name and address confirmation process (S712) when scanning a receipt or the like that requires the name and address confirmation, rather than after completing the scanning of all items (S702: YES). In this case, the processor 11 does not necessarily need to confirm both the name and address, and may confirm only whichever is necessary.

[0175] When the processor 11 determines that it is necessary to confirm the age, name, and address (S705: age, name, and address), it executes the age, name, and address confirmation process (S713) and ends this process. The details of the age, name, and address confirmation process will be described later (see FIG. 18).

[0176] <Age verification process> Fig. 16 is a flowchart showing an example of age verification processing according to the embodiment 2. The processing shown in Fig. 16 corresponds to a detailed explanation of step S711 shown in Fig. 15. The processing shown in Fig. 16 shows processing in the case where the personal identification document 20 is a My Number card 31.

[0177] The processor 11 determines whether or not to perform face matching (S801). For example, the processor 11 inquires of the user 2 whether or not to perform face matching, and determines to perform face matching if the user 2 permits face matching, and determines to perform PIN authentication instead of face matching if the user 2 does not permit face matching.

[0178] First, a case where it is determined that face matching is to be performed (S801: YES) will be described.

[0179] The processor 11 photographs the face of the user 2 through the face photographing camera 13, and generates a target person's face image (S802).

[0180] The processor 11 photographs the face of the card (My Number card 31) placed on the placement unit 18 through the document photographing camera 14, and generates a document photographed image (S803).

[0181] The processor 11 performs OCR on the photographed document image to obtain a verification number B (S804).

[0182] The processor 11 accesses the IC chip 21 of the personal identification document 20 via the IC reader 15 using the verification number B as a key (S805).

[0183] The processor 11 acquires face image data from the face information AP of the IC chip 21 (S806).

[0184] The processor 11 acquires the date of birth from the card information input assistance AP of the IC chip 21 (S807).

[0185] The processor 11 performs face matching of the target person's face image with the face image data (S808).

[0186] The processor 11 determines whether or not the face matching in step S808 has been successful (S809).

[0187] If face matching fails (S809: NO), the processor 11 performs failure processing (S830) and ends this processing. In the failure processing, for example, the processor 11 displays a message on the display device 17 indicating that a store clerk will be called because a problem has occurred, and performs processing to call the store clerk. As processing to call the store clerk, for example, the processor 11 transmits a call notification to the store clerk's terminal or rings a bell in the store to call the store clerk.

[0188] When the face matching is successful (S809: YES), the processor 11 determines whether or not the age of the user 2 falls within the age limit based on the date of birth acquired in step S807 (S810). For example, the processor 11 calculates the age of the user 2 from the current date and the acquired date of birth, and determines whether or not the age of the user 2 falls within the age limit (for example, under 20 years old).

[0189] If the processor 11 determines that the age of the user 2 falls within the age limit (for example, if the age of the user 2 is less than 20 years old) (S810: YES), the processor 11 performs the failure processing described above (S830) and ends this processing.

[0190] When the processor 11 determines that the age of the user 2 does not fall under the age limit (for example, when the age of the user 2 is 20 years or older) (S810: YES), the processor 11 performs a settlement process (S811) and ends this process. The settlement process may be the same as step S720 in FIG. 15 described above.

[0191] Next, a case where it is determined that PIN authentication is to be performed instead of face matching (S801: NO) will be described.

[0192] Processor 11 displays a message on display device 17 instructing user 2 to input a PIN for assisting input of card information, and accepts input of the PIN. User 2 inputs the PIN via operation device 16 (S821).

[0193] The processor 11 authenticates the input PIN (S822). That is, the processor 11 determines whether the input PIN matches the PIN for assisting input of information stored in the IC chip 21 of the personal identification document 20.

[0194] If the PIN authentication fails (S822: NO), the processor 11 performs failure processing (S830) and ends this processing.

[0195] If the PIN authentication is successful (S822: YES), the processor 11 acquires the date of birth from the card information input assistance AP of the IC chip 21 (S824), and then proceeds to the process of step S810 described above.

[0196] According to the above process, the reception device 40 can verify the age of the user 2 from the My Number card 31 by either face matching or PIN input.

[0197] As described in the first embodiment, it is much more difficult to tamper with the information stored in the IC chip 21 than to tamper with the information written on the face of the My Number card 31. In the process shown in Fig. 16, the age of the user 2 is confirmed using the date of birth obtained by successful face matching based on the face image data stored in the IC chip 21, which is difficult to tamper with, or the date of birth obtained by successful PIN authentication based on the PIN stored in the IC chip. Therefore, according to the process shown in Fig. 16, it is possible to perform age confirmation with higher reliability than when a store clerk visually checks the date of birth written on the face of the My Number card 31.

[0198] In addition, when a driver's license 34 is used as the identification document 20, the reception device 40 performs processing equivalent to the processing shown in FIG. 16, and if face matching or PIN authentication is successful, the reception device 40 may obtain the date of birth of the user 2 from the IC chip 21 of the driver's license 34 and perform age confirmation of the user 2.

[0199] In addition, when a residence card 33 is used as the personal identification document 20, the reception device 40 performs processing equivalent to the processing shown in FIG. 16, acquires an image of the face of the residence card 33 from the IC chip 21 of the residence card 33, and performs OCR on the acquired image of the face of the card to acquire the date of birth of the user 2, thereby confirming the age of the user 2.

[0200] In addition, if there is an item among the items scanned by the scanner 41 that requires confirmation of personal information of user 2, the processor 11 performs PIN authentication by user 2 as shown in step S821 in FIG. 16, and if PIN authentication is successful as shown in step S822, the processor 11 may access the IC chip 21 using the PIN as a key to read out facial image data and personal information from the IC chip 21, and perform face matching based on the facial image data and the target person's facial image, and if face matching is successful, may confirm user 2 based on the personal information read from the IC chip 21.

[0201] <Name and address verification process> Fig. 17 is a flowchart showing an example of a name and address confirmation process according to the embodiment 2. The process shown in Fig. 17 corresponds to a detailed explanation of step S712 shown in Fig. 15. The process shown in Fig. 17 shows a process in the case where the personal identification document 20 is a My Number card 31.

[0202] The processor 11 determines whether or not to perform face matching (S901), similarly to step S801 in FIG.

[0203] First, a case where it is determined that face matching is to be performed (S901: YES) will be described.

[0204] The processor 11 performs steps S902 to S906 similar to steps S802 to S806 shown in FIG. 16 (S902 to S906).

[0205] The processor 11 acquires the name and address from the card information input assistance AP of the IC chip 21 (S907).

[0206] The processor 11 performs face matching of the target person's face image with the face image data (S908).

[0207] The processor 11 determines whether or not the face matching in step S908 has been successful (S909).

[0208] If face matching fails (S909: NO), the processor 11 performs failure processing similar to step S830 shown in FIG. 16 (S930) and ends this processing.

[0209] If face matching is successful (S909: YES), the processor 11 cooperates with the baggage processing device 43 to obtain from the baggage management server 50 the name and address linked to the baggage number on the baggage receipt (item) scanned in step S701 of FIG. 15 (S910).

[0210] The processor 11 determines whether or not the name and address acquired in step S907 match the name and address acquired in step S910 (S911). Note that this match determination does not need to be a perfect match, and it is sufficient if they substantially match.

[0211] If the name and address acquired in step S907 do not match the name and address acquired in step S910 (S911: NO), the processor 11 performs failure processing (S930) and ends this processing.

[0212] If the name and address acquired in step S907 match the name and address acquired in step S910 (S911: YES), the processor 11 performs a package receiving process (S912) and ends this process. Details of the package receiving process will be described later.

[0213] According to the above-described process, the reception device 40 can confirm the name and address of the user 2 from the My Number card 31 by either face matching or PIN input.

[0214] As described in the first embodiment, it is much more difficult to tamper with the information stored in the IC chip 21 than to tamper with the information written on the face of the My Number card 31. In the process shown in FIG. 17, the name and address of the user 2 are confirmed using the name and address obtained by successful face matching based on the face image data stored in the IC chip 21, which is difficult to tamper with, or the name and address obtained by successful PIN authentication based on the PIN stored in the IC chip. Therefore, according to the process shown in FIG. 17, the name and address can be confirmed with higher reliability than when a store clerk visually checks the name and address written on the face of the My Number card 31.

[0215] In addition, when a driver's license 34 is used as the identification document 20, the reception device 40 performs processing equivalent to the processing shown in FIG. 17, and if face matching or PIN authentication is successful, the reception device 40 may obtain the name and address of the user 2 from the IC chip 21 of the driver's license 34, and confirm the name and address of the user 2.

[0216] In addition, when a residence card 33 is used as the personal identification document 20, the reception device 40 may perform processing equivalent to the processing shown in FIG. 17, obtain an image of the face of the residence card 33 from the IC chip 21 of the residence card 33, and perform OCR on the obtained image of the face of the residence card 33 to confirm the name and address of the user 2.

[0217] In addition, if there is an item scanned by the scanner 41 that requires confirmation of personal information of user 2, the processor 11 performs PIN authentication by user 2 as shown in step S921 in FIG. 17, and if PIN authentication is successful as shown in step S922, the processor 11 may access the IC chip 21 using the PIN as a key to read out facial image data and personal information from the IC chip 21, and perform face matching based on the facial image data and the target person's facial image, and if face matching is successful, may perform confirmation of user 2 based on the personal information read from the IC chip 21.

[0218] <Age, name and address verification process> Fig. 18 is a flowchart showing an example of age, name and address confirmation processing according to embodiment 2. The processing shown in Fig. 18 corresponds to a detailed explanation of step S713 shown in Fig. 15. The processing shown in Fig. 18 shows processing in the case where the personal identification document 20 is a My Number card 31.

[0219] The processor 11 determines whether or not to perform face matching (S1001), similarly to step S801 in FIG.

[0220] First, a case where it is determined that face matching is to be performed (S1001: YES) will be described.

[0221] Processor 11 performs steps S1002 to S1006 similar to steps S802 to S806 shown in FIG. 16 (S1002 to S1006).

[0222] The processor 11 acquires the date of birth, name, and address from the card information input assistance AP of the IC chip 21 (S1007).

[0223] The processor 11 performs face matching of the target person's face image with the face image data (S1008).

[0224] The processor 11 determines whether or not the face matching in step S1008 has been successful (S1009).

[0225] If face matching fails (S1009: NO), the processor 11 performs failure processing similar to step S830 shown in FIG. 16 (S1030) and ends this processing.

[0226] If face matching is successful (S1009: YES), the processor 11 determines whether or not the age of the user 2 satisfies the age restriction based on the date of birth acquired in step S1007 (S1010).

[0227] When the processor 11 determines that the age of the user 2 falls within the age limit (S1010: YES), the processor 11 performs the failure process described above (S1030) and ends this process.

[0228] If the processor 11 determines that the age of the user 2 does not fall within the age limit (S1010: YES), the processor 11 proceeds to the next step S1011.

[0229] The processor 11, in cooperation with the baggage processing device 43, obtains from the baggage management server 50 the name and address linked to the baggage number on the baggage receipt (item) scanned in step S701 of FIG. 15 (S1011).

[0230] The processor 11 determines whether or not the name and address acquired in step S1007 match the name and address acquired in step S1011 (S1012).

[0231] If the name and address acquired in step S1007 do not match the name and address acquired in step S1011 (S1012: NO), the processor 11 performs failure processing (S1030), similar to step S830 shown in FIG. 16, and terminates this processing.

[0232] If the name and address acquired in step S1007 match the name and address acquired in step S1011 (S1012: YES), the processor 11 performs a payment process and a package receiving process (S1012) and ends this process. The payment process may be the same as step S720 shown in Fig. 15. The package receiving process will be described later in detail.

[0233] According to the above-described process, the reception device 40 can verify the age, name, and address of the user 2 by either face matching or PIN input from the My Number card 31. Furthermore, the user 2 can scan the product and the receipt together and complete the payment procedure for the product and the receipt procedure for the package without having to scan the product and the receipt separately.

[0234] In addition, when a driver's license 34 is used as the identification document 20, the reception device 40 performs processing equivalent to that shown in Figure 18, and if face matching or PIN authentication is successful, the reception device 40 may obtain the date of birth, name, and address of the user 2 from the IC chip 21 of the driver's license 34, and confirm the age, name, and address of the user 2.

[0235] In addition, when a residence card 33 is used as the personal identification document 20, the reception device 40 may perform processing equivalent to the processing shown in FIG. 18, obtain an image of the face of the residence card 33 from the IC chip 21 of the residence card 33, and perform OCR on the obtained image of the face of the residence card 33 to verify the age, name, and address of the user 2.

[0236] In addition, if there is an item among the items scanned by the scanner 41 that requires confirmation of personal information of user 2, the processor 11 performs PIN authentication by user 2 as shown in step S1021 in FIG. 18, and if PIN authentication is successful as shown in step S1022, the processor 11 may access the IC chip 21 using the PIN as a key to read out facial image data and personal information from the IC chip 21, and perform face matching based on the facial image data and the target person's facial image, and if face matching is successful, may perform confirmation of user 2 based on the personal information read from the IC chip 21.

[0237] <When installing electronic lockers in stores> Next, details of the parcel receiving process shown in Figs. 17 and 18 will be described for the case where a store is provided with locked electronic lockers 51 and a user 2 receives a parcel that has been stored in advance in the electronic locker 51.

[0238] For example, the package management server 50 manages the package number of the package, information indicating the storage location of the package in the electronic locker 51 (for example, a locker number), and the name and address of the recipient of the package in association with each other.

[0239] As part of the baggage receipt process, the processor 11 and baggage processing device 43 of the reception device 40 obtain, from the baggage management server 50, information indicating the storage location of the baggage in the electronic locker 51 (e.g., locker number) linked to the baggage number obtained by scanning the receipt, and display the information indicating the storage location on the display device 17. Furthermore, the processor 11 and baggage processing device 43 of the reception device 40 unlock the door of the electronic locker 51 to that storage location.

[0240] The user 2 retrieves the item from the storage location of the unlocked electronic locker 51.

[0241] This allows the user 2 to receive the package by himself / herself using the reception device 40 in the store without asking a store clerk for help. This reduces the amount of work for the store clerk to hand over the package, and lightens the workload.

[0242] <When installing a reception device at a parcel delivery company's office> FIG. 19 is a block diagram showing a second exemplary configuration of the accepting device 40 according to the second embodiment.

[0243] The reception device 40 may be installed, for example, in an office of a company that delivers packages. In this case, the reception device 40 may be configured to scan the receipt of the package, but not to scan the product as described above. The reception device 40 may be configured to perform the name and address confirmation process shown in FIG. 17, but not to perform the age confirmation process shown in FIG. 16, and the age, name, and address confirmation process shown in FIG. 19. Therefore, in this case, the reception device 40 may be configured not to have a settlement device 42, as shown in FIG. 19, as compared to FIG. 16.

[0244] When the parcel is brought into the office's parcel warehouse 52, the parcel management server 50 manages the parcel's parcel number by linking it to information indicating the storage location of the parcel in the parcel warehouse 52 (e.g., the warehouse shelf number), but does not necessarily have to manage the name and address of the recipient of the parcel by linking it to the parcel number.

[0245] When user 2 goes to a branch office to pick up a parcel that is being delivered to him / her, before going to the branch office, he / she sends the parcel number written on the receipt for the parcel he / she is going to pick up, as well as his / her name and address, to the parcel management server 50 via his / her terminal (e.g., a PC, smartphone, etc.).

[0246] The baggage management server 50 searches for the baggage number sent by the user 2, and links the searched baggage number to the name and address sent by the user 2. This allows the user 2 to input the name and address to be linked to the baggage number, eliminating the need for the worker 3 to input the name and address to be linked to the baggage number into the baggage management server 50. In other words, the workload of the worker 3 can be reduced.

[0247] After the user 2 transmits the parcel number, name, and address, the parcel management server 50 manages the parcel number of the parcel, information indicating the storage location of the parcel in the parcel warehouse 52, and the name and address of the recipient of the parcel, in association with each other. The storage location of the parcel may be changed as the parcel is moved. For example, after receiving a message from the user 2 that he or she will pick up the parcel, a worker 3 at the office may move the parcel to an appropriate storage location and input information indicating the storage location to which the parcel will be moved to the parcel management server 50.

[0248] User 2 goes to the office and operates scanner 41 of reception device 40 to scan the code (baggage number) on the receipt. Reception device 40 performs the process shown in Fig. 17, and if the name and address match (S911: YES), performs baggage receipt processing (S912).

[0249] As a package receipt process, the processor 11 and package processing device 43 of the reception device 40 cooperate with the package management server 50 to notify the worker 3 at the office of the package number obtained by the user 2 scanning the receipt, the name and address linked to the package number, and information indicating the storage location. Upon receiving the notification, the worker 3 retrieves the package from the notified storage location in the package warehouse 52 and hands it over to the user 2 who has visited the office.

[0250] As a result, the worker 3 at the office waits in the back yard, and when a notification is received from the reception device 40, he or she can hand over the package to the user 2. In other words, the counter at the office can be unmanned, so the workload of the worker 3 can be reduced.

[0251] 17, the processor 11 of the reception device 40 may display a message indicating that a problem has occurred and that the worker 3 should be called on the display device 17, and may also perform processing to call the worker 3. As processing to call the worker 3, for example, the processor 11 may send a call notification to the terminal of the worker 3 or ring a bell in the office to call the worker 3.

[0252] Moreover, the office may be provided with the electronic locker 51 described above instead of the baggage warehouse 52. In this case, the user 2 can receive his / her baggage from the electronic locker 51 as described above. This can further reduce the workload of the worker 3 at the office.

[0253] (Summary of the second embodiment) The above description of the second embodiment discloses the following technology.

[0254] <Technology B1> The reception device 40 of the present disclosure comprises a scanner 41 for scanning items, a face camera 13 for photographing the face of a user 2 to generate a target person's facial image, a document camera 14 for photographing the face of an identification document 20 held by the user 2 to generate a document image, an IC reader 15 for accessing the IC chip 21 of the identification document 20, and a processor 11. If an item that requires confirmation of personal information of the user 2 is present among the items scanned by the scanner 41, the processor 11 reads character information from the document image, reads facial image data and the personal information from the IC chip 21 using the read character information, and performs facial matching based on the facial image data and the target person's facial image. If the facial matching is successful, the processor 11 confirms the user 2 based on the personal information read from the IC chip 21. This makes it possible to automate identity verification when providing an item requiring identity verification to the user 2. This reduces the workload of store clerks, etc., compared to when a store clerk, etc. visually checks the face of the identity verification document 20 to verify the identity of the user.

[0255] <Technology B2> The reception device 40 of the present disclosure comprises a scanner 41 for scanning items, a facial camera 13 for capturing an image of the face of a user 2 to generate a facial image of the target person, an IC reader 15 for accessing the IC chip 21 of an identification document 20 carried by the user 2, and a processor 11. If an item that requires confirmation of personal information of the user 2 is present among the items scanned by the scanner 41, the processor 11 performs PIN authentication by the user 2, and if the PIN authentication is successful, it reads facial image data and the personal information from the IC chip 21 and performs facial matching based on the facial image data and the facial image of the target person, and if the facial matching is successful, it confirms the user 2 based on the personal information read from the IC chip 21. This makes it possible to automate the identification of the user 2 when handling an item that requires identification. This reduces the workload of store clerks, etc., compared to when a store clerk, etc. visually checks the face of the identification document 20 to perform identity verification.

[0256] <Technology B3> In the reception device 40 described in Technique B1 or B2, the processor 11 acquires the face image data from the IC chip 21, and reads out the personal information by performing OCR on the acquired face image data. This makes it possible to read out personal information from the face image data stored in the IC chip 21.

[0257] <Technology B4> In the reception device 40 described in any one of Techniques B1 to B3, when an item that requires age confirmation as the personal information is present among the items scanned by the scanner 41, the processor 11 reads the date of birth from the IC chip 21 as the personal information, and when the face matching is successful, confirms the age of the user based on the date of birth read from the IC chip 21. This makes it possible to automate age verification of user 2 when handling items that require age verification.

[0258] <Technology B5> In the reception device 40 described in Technique B4, the article for which age verification is required is a product for which an age limit is imposed for sale. This makes it possible to automate age verification of user 2 when handling products that have age restrictions.

[0259] <Technology B6> In the reception device 40 described in any one of Technologies B1 to B5, when an item is present among the items scanned by the scanner 41 and the name and address need to be confirmed as the personal information, the processor 11 reads the name and address from the IC chip 21 as the personal information, and if the face matching is successful, obtains the name and address that are previously linked to the number obtained by scanning the item, and determines whether the obtained name and address match the name and address read from the IC chip 21. This makes it possible to automate the confirmation of the name and address of user 2 when handling an item that requires name and address confirmation.

[0260] <Technology B7> In the reception device 40 described in Technique B6, the item for which the name and address need to be confirmed is the receipt for the package, and the number is written on the receipt. This allows for automated verification of the name and address of user 2 when handling receipts.

[0261] <Technology B8> In the reception device 40 described in Technology B7, the processor 11 obtains the name and address that are pre-linked to the number from a specified server (e.g., a parcel management server 50) that pre-links and manages the storage location of the parcel, the number of the parcel, and the name and address of the recipient of the parcel, and if it is determined in the determination that the name and address match, it outputs information indicating the storage location of the parcel that is linked to the number. This allows the name and address of the recipient of the package to be automatically confirmed, and if the confirmation is successful, information indicating the storage location of the package can be output.

[0262] <Technology B9> In the reception device 40 described in Technology B7, the processor 11 obtains the name and address that are pre-linked to the number from a predetermined server (e.g., a luggage management server 50) that pre-links and manages the storage location of the luggage in a predetermined electronic locker 51, the number of the luggage, and the name and address of the recipient of the luggage, and if it is determined that the name and address match, it unlocks the storage location of the luggage in the electronic locker 51 that is pre-linked to the number. This allows the name and address of the recipient of the package to be automatically confirmed, and if the confirmation is successful, the storage location of the package in electronic locker 51 can be automatically unlocked.

[0263] <Technology B10> In the reception device 40 described in any one of Techniques B1 to B9, the personal identification document 20 is a My Number card 31, a residence card 33, or a driver's license 34. This allows the reception device 40 to accept identity verification using the My Number card 31, residence card 33, or driver's license 34.

[0264] <Technology B11> The identity verification method of the present disclosure involves scanning an item with a scanner 41, and if the scanned item contains an item for which personal information of user 2 needs to be verified, then a face photographing camera 13 photographs the face of user 2 to generate a target person's face image, a document photographing camera 14 photographs the face of an identity verification document 20 held by user 2 to generate a document photographed image, reading text information from the document photographed image, and an IC reader 15 uses the read text information to access an IC chip 21 of the identity verification document to read out facial image data and the personal information, and performing facial matching based on the facial image data and the target person's facial image, and if the facial matching is successful, verifying user 2 based on the personal information read from the IC chip 21. This makes it possible to automate identity verification when providing an item requiring identity verification to the user 2. This reduces the workload of store clerks, etc., compared to when a store clerk, etc. visually checks the face of the identity verification document 20 to verify the identity of the user.

[0265] <Technology B12> The identity verification method of the present disclosure scans an item with a scanner 41, and if the scanned items include an item for which personal information of user 2 needs to be verified, a face photographing camera 13 photographs the face of user 2 to generate a target person's facial image, and PIN authentication is performed by user 2. If PIN authentication is successful, an IC chip 21 in an identity verification document 20 held by user 2 is accessed to read out facial image data and the personal information, and a facial match is performed based on the facial image data and the target person's facial image. If the facial match is successful, user 2 is verified based on the personal information read from IC chip 21. This makes it possible to automate identity verification when providing an item requiring identity verification to the user 2. This reduces the workload of store clerks, etc., compared to when a store clerk, etc. visually checks the face of the identity verification document 20 to verify the identity of the user.

[0266] <Technology B13> The computer program according to the present disclosure causes a computer to execute the identity verification method described in Technology B11.

[0267] <Technology B14> The computer program according to the present disclosure causes a computer to execute the identity verification method described in Technique B12.

[0268] Although the embodiments have been described above with reference to the accompanying drawings, the present disclosure is not limited to such examples. It is clear that a person skilled in the art can conceive of various modifications, corrections, substitutions, additions, deletions, and equivalents within the scope of the claims, and it is understood that these also belong to the technical scope of the present disclosure. In addition, the components in the above-mentioned embodiments may be arbitrarily combined within the scope of the invention. [Industrial Applicability]

[0269] The reception device of the present disclosure is applicable to tasks involving identity verification. [Explanation of symbols]

[0270] 1. Target person 2. Users 3. Workers 10 Personal identification device 11 Processors 12. Memory 13 Face camera 14 Document Camera 15 IC Reader 16 Operating device 17 Display device 18 Placement section 20 Identification documents 21 IC chip 22 Photo 23 Textual information 31 My Number Card 32 Passport 33 Residence Card 34 Driver's License 40 Reception device 41 Scanner 42 Clearing device 43 Baggage handling equipment 50 Baggage management server 51 Electronic Locker 52 Luggage Warehouse

Claims

1. A facial camera that captures a user's face and generates a target person's facial image, a reader that communicates with an identification medium held by the user via short-range communication, and a processor, The processor: If there is an item among the items input by the external scanner that requires confirmation of the user's personal information, After the face matching based on the target person's face image is successful, the personal information is read from the identification medium; Performing predetermined processing based on the personal information Reading device.

2. The processor If there is an item that requires age verification as the personal information among the items scanned by the scanner, reading out the date of birth as the personal information, and confirming the age of the user based on the read out date of birth; 2. A reading device according to claim 1.

3. The processor: As a result of confirming the user's age, determining whether or not the user is able to purchase an item requiring age confirmation, or determining whether or not the user has reached the age required to purchase an item requiring age confirmation.

3. A reading device according to claim 2.

4. The article is a product for which an age restriction is imposed on sales.

2. A reading device according to claim 1.

5. The processor, If there is an item among the items scanned by the scanner that requires confirmation of the name and address as the personal information, The personal information includes the name and address. acquiring a name and address previously associated with the number acquired by scanning the item, and determining whether the acquired name and address match the read name and address; 2. A reading device according to claim 1.

6. The item for which the name and address need to be confirmed is a parcel receipt, and the number is written on the receipt.

6. A reading device according to claim 5.

7. The processor: The system acquires the name and address pre-linked to the number from a predetermined server that manages the storage location of the package, the package number, and the name and address of the recipient of the package in association with each other, and if it is determined that the name and address match, outputs information indicating the storage location of the package linked to the number.

7. A reading device according to claim 6.

8. The computer If there are any items among the items entered by the external scanner that require confirmation of the user's personal information, After face matching based on a target person's face image generated by a face camera photographing the user's face is successful, the personal information of the user is read from an identification medium held by the user through short-distance communication by a reader; Performing predetermined processing based on the personal information Reading method.

9. A computer program that causes a computer to execute the reading method described in claim 8.

Images