Identity verification method, identity verification device, identity verification system and identity verification program

Abstract

To provide a technique capable of reading information on an identity verification document even when a type of the identity verification document to be read is different from a type of an identity verification document that has been set.SOLUTION: An identity verification method for reading information on an identity verification document, includes: setting different reading types corresponding to each type of identity verification document, for each of a first reading process and a second reading process; executing the first reading process based on the set reading type on a document-surface-captured image obtained by capturing a surface of the identity verification document; and when the first reading process fails, executing the second reading process based on the set reading type, on the document-surface-captured image.SELECTED DRAWING: Figure 10

Description

Technical Field

[0001] The present disclosure relates to a personal identification method, a personal identification device, a personal identification system, and a personal identification program.

Background Art

[0002] For example, when a store sells a product that cannot be purchased by a user under a predetermined age, the store may use a personal identification document (i.e., an official identification document) such as a My Number card, a driver's license, a residence card, or a passport to confirm the user's age (Non-Patent Document 1). Further, a reading device that reads age and the like from a personal identification document is known (Patent Document 1).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Non-Patent Documents

[0004]

Non-Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] As described above, since there are multiple types of identification documents, a reading device that allows the user to input or select the type of identification document to be read is conceivable. However, if the user incorrectly inputs or selects the type of identification document to be read, the reading device will not be able to read the identification document, and the user will be required to re-enter (re-select) the correct type. This is inconvenient for the user and also leads to a deterioration in sales efficiency for the store.

[0006] Therefore, an object of the present disclosure is to provide a technology that can read the information of an identification document even when the type of the identification document to be read is different from the set type of the identification document.

Means for Solving the Problem

[0007] An identification confirmation method according to an aspect of the present disclosure is an identification confirmation method for reading information of an identification document, wherein for each of a first reading process and a second reading process, different reading types corresponding to each type of the identification document are set, a first reading process based on the set reading type is performed on a face image of the identification document obtained by photographing the face of the identification document, and when the first reading process fails, a second reading process based on the set reading type is performed on the face image of the identification document.

[0008] An identification confirmation device according to an aspect of the present disclosure is an identification confirmation device for reading information of an identification document, comprising a camera and a processor, wherein the processor sets different reading types of the identification document for each of a first reading process and a second reading process, generates a face image of the identification document by photographing the face of the identification document using the camera, performs the first reading process based on the set reading type on the face image of the identification document, and when the first reading process fails, performs the second reading process based on the set reading type on the face image of the identification document.

[0009] The personal identification system according to one aspect of the present disclosure is a personal identification system that reads information on a personal identification document, and includes an authentication terminal and a POS system. The authentication terminal sets different types of personal identification documents to be read for each of a first reading process and a second reading process, captures an image of the face of the personal identification document using a predetermined camera to generate a face-captured image, performs the first reading process based on the set reading type on the face-captured image, and when the first reading process fails, performs the second reading process based on the set reading type on the face-captured image. Based on the information read from the personal identification document in the first reading process or the second reading process, the age of the person holding the personal identification document is calculated, and the age is transmitted to the POS system. The POS system determines whether to permit the provision of goods to the person based on the age received from the authentication terminal.

[0010] The personal identification program according to one aspect of the present disclosure is a personal identification program that reads information on a personal identification document, and sets different types of personal identification documents to be read for each of a first reading process and a second reading process. The first reading process based on the set reading type is performed on the face-captured image obtained by capturing an image of the face of the personal identification document. When the first reading process fails, the second reading process based on the set reading type is performed on the face-captured image. This is to be executed by a computer.

[0011] These general or specific aspects may be implemented by a system, apparatus, method, integrated circuit, computer program, or recording medium, or may be implemented by any combination of a system, apparatus, method, integrated circuit, computer program, and recording medium.

Effects of the Invention

[0012] According to the present disclosure, even when the type of the personal identification document to be read is different from the set type of the personal identification document, the information on the personal identification document can be read.

Brief Description of the Drawings

[0013]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

Figure 17

Figure 18

Figure 19

Figure 20

Embodiments for Carrying Out the Invention

[0014] Hereinafter, embodiments of the present disclosure will be described in detail with appropriate reference to the drawings. However, a more detailed description than necessary may be omitted. For example, detailed descriptions of well-known matters and duplicate descriptions of substantially the same configurations may be omitted. This is to avoid making the following description unnecessarily redundant and to facilitate the understanding of those skilled in the art. Note that the attached drawings and the following description are provided for those skilled in the art to fully understand the present disclosure, and are not intended to limit the subject matter described in the claims.

[0015] (Embodiment 1) <Information possessed by personal identification documents> FIG. 1 is a table showing the main information possessed by various types of personal identification documents 20. FIG. 2 is a diagram showing an example of the face (front and back) of the My Number Card 31. FIG. 3 is a diagram for explaining the outline of the application (AP) of the My Number Card 31. FIG. 4 is a diagram showing an example of the identity page of the passport 32. FIG. 5 is a diagram showing an example of the face (front) of the residence card 33. FIG. 6 is a diagram showing an example of the face (front) of the driver's license 34. Next, the information possessed by various types of personal identification documents 20 will be described with reference to FIGS. 1 to 6.

[0016] On the front (face) of the My Number Card 31, as shown in FIGS. 1 and 2, at least the name, address, date of birth, gender, security code, and expiration date are printed as character information 23. The information including the name, address, date of birth, and gender is also called 4-information. In the present embodiment, 4-information may also be referred to as personal information. Further, a face photo 22 is printed on the front of the My Number Card 31.

[0017] At least the name, address, date of birth, gender, face image data, and personal number are stored in the IC chip 21 of the My Number card 31. The face image data is image data obtained by photographing the face of the owner of the My Number card 31.

[0018] The My Number card 31 has at least a collation number A, a collation number B, an electronic certificate PIN for signature, a PIN for user certificate, a PIN for assisting in inputting face matter, and a PIN for the basic resident register as information used for access control to the IC chip 21.

[0019] The collation number B is a number obtained by combining six digits of the date of birth, four digits of the AD part of the expiration date, and four digits of the security code, which are printed on the surface of the My Number card 31. By using the collation number B, access can be made to the four pieces of information and the face photo data stored in the IC chip 21 of the My Number card 31. That is, by obtaining the collation number B printed on the surface of the My Number card 31, access can be made to the four pieces of information and the face photo data stored in the IC chip 21 of the My Number card 31.

[0020] As shown in FIG. 3, four APs shown in the following (B1) to (B4) are registered in the IC chip 21 of the My Number card 31 in a broad sense.

[0021] (B1) Face matter application (face matter AP) Image data of surface information (four pieces of information (address, name, date of birth, gender) + face photo) and back information (personal number) are recorded in the face matter AP.

[0022] (B2) Electronic certificate application by public personal authentication service (JPKI-AP) Information on "electronic certificate for signature" and "electronic certificate for user" is recorded in the JPKI-AP.

[0023] (B3) Face matter input assistance application (face matter input assistance AP)

[0024] In the voucher item input assistance AP, when conducting transactions using the personal number and the four types of information, information for using the personal number and the four types of information as text data is recorded. The information to be recorded or used is as follows. (1) Personal number and the four types of information (as well as their electronic signature data) (2) Personal number (as well as its electronic signature data) (3) The four types of information (as well as their electronic data)

[0025] (B4) Resident basic application (Resident basic AP)

[0026] In the Resident basic AP, information for using the resident register code as text data is recorded during resident register network-related transactions.

[0027] Among the voucher AP and the voucher item input assistance AP, when using (2) or (3), it can be used by the verification number based on the information described on the voucher. However, for the two electronic certificates of the JPKI-AP and when using (B4) the Resident basic AP among the voucher item input assistance AP, the password set at the time of issuance of the My Number Card 31 is used.

[0028] On the identity item page of the passport 32, as shown in FIG. 1 and FIG. 4, at least the name, date of birth, gender, passport number, expiration date, and Machine Readable Zone (MRZ) are printed as character information 23. Also, a face photo 22 is printed on the identity item page of the passport 32.

[0029] In the IC chip 21 of the passport 32, at least the name, date of birth, gender, face image data, and passport number are stored.

[0030] The passport 32 has at least an MRZ as information used for access control to the IC chip 21. By using the MRZ, access can be made to the information 4 and face image data stored in the IC chip 21 of the passport 32. That is, by obtaining the MRZ from the character information 23 printed on the identity page of the passport 32, access can be made to the information 4 and face image data stored in the IC chip 21 of the passport 32.

[0031] On the surface (front side) of the residence card 33, as shown in FIGS. 1 and 5, at least the name, place of residence, date of birth, gender, residence card number, and expiration date are printed as character information 23. Also, a face photograph 22 (in the case of 16 years old or above) is printed on the surface of the residence card 33.

[0032] In the IC chip 21 of the residence card 33, at least the place of residence, face image data, and front side image data are stored. The front side image data is an image of the surface of the residence card.

[0033] The residence card 33 has at least a residence card number as information used for access control to the IC chip 21. By using the residence card number, access can be made to the information 4, face image data, and front side image data stored in the IC chip 21 of the residence card 33. That is, by obtaining the residence card number printed on the surface of the residence card 33, access can be made to the information 4, face image data, and front side image data stored in the IC chip 21 of the residence card 33.

[0034] On the surface (front side) of the driver's license 34, as shown in FIGS. 1 and 6, at least the name, address, date of birth, license number, and expiration date are printed as character information 23. Also, a face photograph 22 is printed on the surface of the driver's license 34.

[0035] In the IC chip 21 of the driver's license 34, at least the name, address, date of birth, face image data, and license number are stored.

[0036] The driver's license 34 has at least PIN1 and PIN2 as information used for access control to the IC chip 21. PIN1 and PIN2 are four-digit numbers preset by the owner of the driver's license 34. By using PIN1, access can be made to the four pieces of information stored in the IC chip 21. Also, by using PIN1 and PIN2, access can be made to the face image data stored in the IC chip 21 of the driver's license 34.

[0037] Note that the above-mentioned My Number Card 31 is an example. In the present embodiment, when the specifications of the My Number Card 31 are changed, various information possessed by the My Number Card 31 can be read based on the changed specifications. For example, the gender may not be described on the face of the My Number Card 31. In this case, the present embodiment may acquire three pieces of information excluding the gender and the face image data from the IC chip 21. Also, the verification number B may be a predetermined-digit number different from the 14-digit number obtained by combining the above six digits of the date of birth, the four digits of the AD part of the expiration date, and the four digits of the security code. In this case, the present embodiment may read the predetermined-digit number based on the specifications of the My Number Card 31 and use it as the verification number B. Also, not limited to the My Number Card 31, for the identification documents 20 such as the passport 32, the residence card 33, and the driver's license 34, in the present embodiment, when the specifications are changed, various information can be read based on the changed specifications.

[0038] Since the IC chip 21 of the identification document 20 has tamper resistance, it is very difficult to physically alter the data stored in the IC chip 21. Also, since the data stored in the IC chip 21 is provided with an electronic signature, if the data stored in the IC chip 21 is altered, the alteration can be detected.

[0039] <System Configuration> FIG. 7 is a block diagram showing a configuration example of the store system 1 according to Embodiment 1.

[0040] The store system 1 is a system for managing the provision (sale) of products in a store. The store system 1 is installed in the store that provides products.

[0041] The store system 1 includes a POS system 50, an authentication terminal 10, a face camera 5, and a product information DB 70. Note that POS is an abbreviation for Point Of Sales. The POS system 50, the authentication terminal 10, and the face camera 5 are connected via a predetermined electrical cable (e.g., a LAN cable and / or a USB cable, etc.) and can transmit and receive information to and from each other. Alternatively, the POS system 50, the authentication terminal 10, and the face camera 5 may be connected via a predetermined wireless communication (e.g., wireless LAN, Bluetooth (registered trademark), etc.).

[0042] The POS system 50 performs settlement processing when a user purchases a product in the store. The user can operate the POS system 50 by himself / herself to perform the settlement of the purchased product. That is, the POS system 50 may be a self-checkout system. The details of the configuration of the POS system 50 will be described later (see FIG. 9).

[0043] The authentication terminal 10 performs age verification of the user using the identification document 20. For example, the authentication terminal 10 is used when the user purchases a product (e.g., a licensed product such as alcohol or tobacco) that requires age verification by the identification document 20. The details of the configuration of the authentication terminal 10 will be described later (see FIG. 8).

[0044] The face camera 5 captures the face of the user and generates a face-captured image. The face-captured image is used to determine whether the user is the person in the identification document 20. The face camera 5 may be integrated with the POS system 50 or the authentication terminal 10, or may be separate from the POS system 50 or the authentication terminal 10.

[0045] The product information DB 70 is a database (DB) that manages information on products provided (sold) in the store (hereinafter referred to as product information). For example, the product information includes information on products that require age verification. The product information DB 70 may be arranged in a server installed in the store. Alternatively, the product information DB 70 may be arranged in a server commonly used by a plurality of stores, and each store may access the product information DB 70 of the server via a predetermined communication network (for example, the Internet).

[0046] <Authentication terminal> FIG. 8 is a block diagram showing a configuration example of the authentication terminal 10 according to Embodiment 1.

[0047] The authentication terminal 10 includes a processor 11, a memory 12, a placement unit 13, a coupon surface photographing camera 14, and an IC reader 15. Although not shown in FIG. 8, the authentication terminal 10 may further include an input unit that receives an input operation from the user and a display unit that displays an image and / or information.

[0048] The processor 11 realizes the functions of the authentication terminal 10 by executing a computer program stored in the memory 12. Note that the processor 11 may be read as other terms such as a controller, a Central Processing Unit (CPU), or a control unit. In the following description, the operation mainly performed by the authentication terminal 10 can be read as an operation mainly performed by the processor 11 included in the authentication terminal 10.

[0049] The memory 12 stores a computer program and data for realizing the functions of the authentication terminal 10. The memory 12 may be constituted by a volatile storage medium (for example, RAM) and / or a non-volatile storage medium (for example, ROM or flash memory, etc.).

[0050] The placement unit 13 is a part on which the personal identification document 20 is placed.

[0051] The coupon surface photographing camera 14 photographs the coupon surface of the identity document 20 placed on the placement unit 13 and generates a document photographed image.

[0052] The IC reader 15 reads the data stored in the IC chip 21 of the identity document 20 placed on the placement unit 13 in a non-contact manner (for example, by Near Field Communication (NFC) method).

[0053] <POS system> FIG. 9 is a block diagram showing a configuration example of the POS system 50 according to the first embodiment.

[0054] The POS system 50 includes a processor 51, a memory 52, a display unit 53, an operation unit 54, a communication unit 55, and a scanner 56. Although not shown in FIG. 9, the POS system 50 may include various functions (for example, a receipt discharging function, a cash inserting and change discharging function, etc.) provided in a general POS system 50 in addition to these components.

[0055] The processor 51 realizes the functions of the POS system 50 by executing a program in cooperation with the memory 52. In the following description, the main operation of the POS system 50 can be read as the operation mainly performed by the processor 51 provided in the POS system 50.

[0056] The memory 52 stores programs and data for realizing the functions of the POS system 50. The memory 52 may be composed of a volatile storage medium and / or a non-volatile storage medium.

[0057] The display unit 53 displays information about the products purchased by the user (for example, product names and prices), information about the settlement process (for example, the total amount), information about notifications and inquiries to the customer, etc. In addition, when purchasing a product that requires age confirmation, the display unit 53 displays the result of the age confirmation. The display unit 53 is composed of, for example, a liquid crystal display or an organic EL display.

[0058] The operation unit 54 receives operations from the user. Note that the display unit 53 and the operation unit 54 may be an integrated touch panel display.

[0059] The communication unit 55 controls the transmission and reception of various data with the product information DB 70, the authentication terminal 10, and the face photographing camera 5.

[0060] The scanner 56 is, for example, a barcode scanner and / or a QR code (registered trademark) scanner, and is used to read the barcode and / or QR code (registered trademark) of a product. The scanner 56 may be a handy scanner or a scanner provided in the POS system 50.

[0061] For example, when the user uses the scanner 56 to read the barcode of the purchased product and has completed reading the barcodes of all the purchased products, the user presses the "Checkout" button through the operation unit 54. The processor 51 displays the total amount of all the purchased products on the display unit 53 and performs settlement processing. The POS system 50 may support various settlement means such as cash settlement, electronic money settlement, and credit card settlement.

[0062] In addition, when the processor 51 of the POS system 50 determines that the purchased products include products that require age verification, the processor 51 cooperates with the authentication terminal 10 to verify the user's age and displays the result of the age verification on the display unit 53.

[0063] <Reading process of the identity document> FIG. 10 is a flowchart showing an example of the reading process of the identity document 20 according to Embodiment 1. This process may be executed when the purchased products read by the POS system 50 include products that require age verification. In the following description, the reading process of the passport 32 is omitted, but the reading process of the passport 32 may be added as the first to fourth reading processes.

[0064] The authentication terminal 10 sets a reading process for each type of the personal identification document 20 (hereinafter referred to as the reading type) for each of the first to third reading processes (S101).

[0065] The reading types set for each of the first to third reading processes may be predetermined in the authentication terminal 10. For example, setting information indicating that a My Number card is set for the first reading process, a driver's license is set for the second reading process, and a residence card is set for the third reading process may be stored in advance in the memory 12 of the authentication terminal 10.

[0066] Alternatively, the reading type set for the first reading process may be input or selected by the user. For example, when the user selects a My Number card from a selection screen 100 (see FIG. 19) of the types of personal identification documents displayed on the display unit 53 of the POS system 50, the authentication terminal 10 sets the My Number card for the first reading process. In this case, for the remaining second to third reading processes, the reading types may be set based on the priority. For example, when the driver's license has a higher priority than the residence card, the authentication terminal 10 sets the driver's license for the second reading process and the residence card for the third reading process. Details of the priority will be described later with reference to FIG. 18.

[0067] The authentication terminal 10 confirms that the personal identification document 20 is placed on the placement unit 13 (S102). For example, the authentication terminal 10 confirms that the personal identification document 20 is placed on the placement unit 13 by the IC reader 15 detecting the personal identification document 20. Alternatively, the authentication terminal 10 may confirm that the personal identification document 20 is placed on the placement unit 13 by detecting that the face of the personal identification document 20 has been photographed by the face photographing camera 14.

[0068] The authentication terminal 10 performs a first reading process based on the reading type set in step S101 (S104). For example, when a My Number card is set for the first reading process, the authentication terminal 10 executes a My Number card reading process (see FIG. 11) described later as the first reading process. When a driver's license is set for the first reading process, the authentication terminal 10 executes a driver's license reading process (see FIG. 13) described later as the first reading process. When a residence card is set for the first reading process, the authentication terminal 10 executes a residence card reading process (see FIG. 15) described later as the first reading process.

[0069] The authentication terminal 10 determines whether the reading in the first reading process was successful (S105).

[0070] If the reading in the first reading process is successful (S105: YES), the authentication terminal 10 executes a first reading continuation process (S106). The first reading continuation process is a process that is continuously performed after the first reading process. For example, when the authentication terminal 10 executes a My Number card reading process (see FIG. 11) as the first reading process, it executes a My Number card reading continuation process (see FIG. 12) described later as the first reading continuation process. When the authentication terminal 10 executes a driver's license reading process (see FIG. 13) as the first reading process, it executes a driver's license reading continuation process (see FIG. 14) described later as the first reading continuation process. When the authentication terminal 10 executes a residence card reading process (see FIG. 15) described later as the first reading process, it executes a residence card reading continuation process (see FIG. 16) described later as the first reading continuation process. Then, the process proceeds to step S114.

[0071] If the reading fails in the first reading process (S105: NO), the authentication terminal 10 performs a second reading process based on the reading type set in step S101 (S107). For example, when the my number card is set for the second reading process, the authentication terminal 10 executes a my number card reading process (see FIG. 11) described later as the second reading process. When the driver's license is set for the second reading process, the authentication terminal 10 executes a driver's license reading process (see FIG. 13) described later as the second reading process. When the residence card is set for the second reading process, the authentication terminal 10 executes a residence card reading process (see FIG. 15) described later as the second reading process.

[0072] The authentication terminal 10 determines whether the reading is successful in the second reading process (S108).

[0073] If the reading is successful in the second reading process (S108: YES), the authentication terminal 10 executes a second reading continuation process (S109). The second reading continuation process is a process that is continuously performed after the second reading process. For example, when the authentication terminal 10 executes a my number card reading process (see FIG. 11) as the second reading process, it executes a my number card reading continuation process (see FIG. 12) described later as the second reading continuation process. When the authentication terminal 10 executes a driver's license reading process (see FIG. 13) as the second reading process, it executes a driver's license reading continuation process (see FIG. 14) described later as the second reading continuation process. When the authentication terminal 10 executes a residence card reading process (see FIG. 15) as the second reading process, it executes a residence card reading continuation process (see FIG. 16) described later as the second reading continuation process. Then, the process proceeds to step S114.

[0074] If the reading fails in the second reading process (S108: NO), the authentication terminal 10 performs a third reading process based on the set reading type (S110). When a My Number card is set for the third reading process, the authentication terminal 10 executes a My Number card reading process (see FIG. 11) described later as the third reading process. When a driver's license is set for the third reading process, the authentication terminal 10 executes a driver's license reading process (see FIG. 13) described later as the third reading process. When a residence card is set for the third reading process, the authentication terminal 10 executes a residence card reading process (see FIG. 15) described later as the third reading process.

[0075] The authentication terminal 10 determines whether the reading is successful in the third reading process (S111).

[0076] If the reading is successful in the third reading process (S111: YES), the authentication terminal 10 executes a third reading continuation process (S112). The third reading continuation process is a process that is continuously performed after the third reading process. For example, when the authentication terminal 10 executes a My Number card reading process (see FIG. 11) as the third reading process, it executes a My Number card reading continuation process (see FIG. 12) described later as the third reading continuation process. When the authentication terminal 10 executes a driver's license reading process (see FIG. 13) as the third reading process, it executes a driver's license reading continuation process (see FIG. 14) described later as the third reading continuation process. When the authentication terminal 10 executes a residence card reading process (see FIG. 15) as the third reading process, it executes a residence card reading continuation process (see FIG. 16) described later as the third reading continuation process. Then, the process proceeds to step S114.

[0077] If the reading fails in the third reading process (S111: NO), the authentication terminal 10 displays information indicating that the reading of the personal identification document 20 placed on the placement unit 13 has failed on the display unit 53 of the POS system 50 (S113), and ends this process. In this case, since the user's age cannot be confirmed, the POS system 50 may call a store clerk.

[0078] As step S114, the authentication terminal 10 confirms that the personal identification document 20 has been removed from the placement unit 13 (S114), and ends this process. Note that before executing step S114, the authentication terminal 10 may display information prompting the user to remove the personal identification document 20 on the display unit 53 of the POS system 50. Note that the display of the result of age confirmation is performed in each reading continuation process described later.

[0079] By the above process, even if the user makes a mistake in selecting the type of personal identification document to be used (for example, even if the reading fails in the first reading process), the authentication terminal 10 can read the information of the personal identification document without asking the user to reselect or start over from the beginning.

[0080] <My Number Card Reading Process> FIG. 11 is a flowchart showing an example of the My Number Card reading process according to Embodiment 1.

[0081] The authentication terminal 10 captures an image of the face of the personal identification document 20 placed on the placement unit 13 through the face capture camera 14, and generates a face capture image (S201).

[0082] The authentication terminal 10 reads the face information of the My Number Card 31 from the face capture image using the face format information for the My Number Card (S202). As shown in FIG. 17, the face format information for the My Number Card includes information indicating what information is described in which section of the face of the My Number Card 31. For example, the authentication terminal 10 may perform OCR on each section described in the face format information for the My Number Card in the face capture image to read the face information. OCR is an abbreviation for Optical Character Recognition / Reader.

[0083] The authentication terminal 10 determines whether it has successfully read the coupon surface information of the My Number card 31 in step S202 (S203). For example, the authentication terminal 10 determines whether it has successfully read at least a part (or all) of the name, address, date of birth, expiration date, and access key described in each section of the coupon surface (front surface) of the My Number card 31.

[0084] If it is determined that the reading of the coupon surface information is successful (S203: YES), the authentication terminal 10 determines that the reading is successful (S205), and returns to the process of the calling source of any one of the first to third reading processes shown in FIG. 10 (any one of S104, S107, S110). In this case, the authentication terminal 10 determines that the reading is successful (YES) in the next process (any one of S105, S108, S111) of the process of the calling source of any one of the first to third reading processes shown in FIG. 10, and executes the My Number card reading continuation process shown in FIG. 12.

[0085] If it is determined that the reading of the coupon surface information fails (S203: NO), the authentication terminal 10 determines that the reading fails (S206), and returns to the process of the calling source of any one of the first to third reading processes shown in FIG. 10 (any one of S104, S107, S110). In this case, the authentication terminal 10 determines that the reading fails (NO) in the process (any one of S105, S108, S111) of the calling source of any one of the first to third reading processes shown in FIG. 10, and executes the subsequent processes.

[0086] Note that the determination of whether or not the reading of the face value information of the My Number Card 31 in step S203 was successful may be performed by a method different from the above. For example, the authentication terminal 10 may previously hold a reference image of the face of the My Number Card 31, calculate the similarity between the reference image and the face photographed image, and determine that the reading was successful if the similarity is equal to or greater than a predetermined threshold value, and determine that the reading failed if the similarity is less than the predetermined threshold value. Alternatively, the authentication terminal 10 may previously hold the positions of unique colors, patterns, face photos, etc. on the face of the My Number Card 31, and determine that the reading was successful if the same colors, patterns, face photos, etc. can be detected from these positions in the face photographed image, and determine that the reading failed if they cannot be detected.

[0087] <My Number Card Reading Continuation Process> FIG. 12 is a flowchart showing an example of the My Number Card reading continuation process according to Embodiment 1. This process is executed when the My Number Card reading process shown in FIG. 11 is successful.

[0088] The authentication terminal 10 (or the POS system 50) photographs the face of the user who purchases the product through the face photographing camera 5 and generates a face photographed image (S210).

[0089] The authentication terminal 10 collates the face photographed image photographed in step S210 with the face photo 22 on the face of the My Number Card 31 (S211). Note that the authentication terminal 10 may acquire face image data from the IC chip 21 using the collation number B instead of the face photo 22 on the face. In this case, the authentication terminal 10 collates the face photographed image with the acquired face image data.

[0090] The authentication terminal 10 determines whether or not the collation in step S211 was successful (S212). That is, the authentication terminal 10 determines whether or not the user is the person indicated by the My Number Card 31.

[0091] When it is determined that the verification has failed (S212: NO), the authentication terminal 10 transmits information indicating a failure in the personal confirmation to the POS system 50 (S220), and returns to the process of the caller of any of the first to third reading continuation processes shown in FIG. 10 (S106, S109, S112).

[0092] When it is determined that the verification has succeeded (S212: YES), the authentication terminal 10 acquires the date of birth from the face value information of the My Number Card 31 (S213). Note that the authentication terminal 10 may acquire the date of birth from the IC chip 21. Also, the face verification process in steps S210 to S212 and the process of acquiring the date of birth in step S213 may be performed in any order.

[0093] The authentication terminal 10 calculates the age of the user based on the acquired date of birth and today's date (S214).

[0094] The authentication terminal 10 transmits the calculated age to the POS system 50 (S215), and returns to the process of the caller of any of the first to third reading continuation processes shown in FIG. 10 (any of S106, S109, S112).

[0095] Through the above processing, the POS system 50 can confirm the age of the user in cooperation with the authentication terminal 10. The POS system 50 receives the age from the authentication terminal 10, and when the age is equal to or greater than the age at which commodity purchase is permitted, information indicating that the purchase is possible may be displayed on the display unit 53, and when the age is less than the age at which commodity purchase is permitted, information indicating that the purchase is impossible may be displayed on the display unit 53.

[0096] Note that after step S214, the authentication terminal 10 may determine whether the calculated age is equal to or greater than a predetermined threshold (for example, determine whether the user is an adult), and in step S215, transmit the determination result to the POS system 50. In this case, when the POS system 50 receives the determination result from the authentication terminal 10 and the determination result is that it is equal to or greater than the threshold (for example, in the case of determining that the user is an adult), it may display information indicating that the purchase is possible on the display unit 53, and when the determination result is that it is less than the threshold (for example, in the case of determining that the user is not an adult), it may display information indicating that the purchase is impossible on the display unit 53.

[0097] Note that the authentication terminal 10 may determine whether the My Number card 31 is within the expiration date from the coupon information, and if it determines that the expiration date has passed, it may notify the same.

[0098] Further, in the My Number card reading continuation process, the authentication terminal 10 may acquire the name and / or address, etc. not only from the age but also from the coupon information or the IC chip 21 and transmit it to the POS system 50. When the name and address received from the authentication terminal 10 match the membership information, the POS system 50 may perform point addition corresponding to the purchase for the points associated with the membership information. Thereby, the user can receive point awarding by presenting the My Number card 31 without separately presenting a membership card.

[0099] <Driver's license reading process> FIG. 13 is a flowchart showing an example of the driver's license reading process according to Embodiment 1.

[0100] The authentication terminal 10 captures an image of the coupon surface of the identity document 20 placed on the placement unit 13 through the coupon surface photographing camera 14 and generates a coupon surface photographed image (S301).

[0101] The authentication terminal reads the license plate information of the driver's license 34 from the license plate captured image using the license plate format information for the driver's license (S302). As shown in FIG. 17, the license plate format information for the driver's license includes information indicating what information is described in which section of the license plate of the driver's license 34. For example, the authentication terminal 10 may perform OCR on each section described in the license plate format information for the driver's license in the license plate captured image to read the license plate information.

[0102] The authentication terminal 10 determines whether it has successfully read the license plate information of the driver's license 34 in step S302 (S303). For example, the authentication terminal 10 determines whether it has successfully read at least a part (or all) of the name, address, date of birth, expiration date, and license number described on the license plate (front surface) of the driver's license 34.

[0103] If it is determined that the license plate information has been successfully read (S303: YES), the authentication terminal 10 determines that the reading is successful (S305) and returns to the process of the calling source of any of the first to third reading processes shown in FIG. 10 (any of S104, S107, S110). In this case, the authentication terminal 10 determines that the reading is successful (YES) in the next process (any of S105, S108, S111) of the process of the calling source of any of the first to third reading processes shown in FIG. 10, and executes the driver's license reading continuation process shown in FIG. 14.

[0104] If it is determined that the reading of the license plate information has failed (S303: NO), the authentication terminal 10 determines that the reading has failed (S306) and returns to the process of the calling source of any of the first to third reading processes shown in FIG. 10 (any of S104, S107, S110). In this case, the authentication terminal 10 determines that the reading has failed (NO) in the process (any of S105, S108, S111) of the calling source of any of the first to third reading processes shown in FIG. 10, and executes the subsequent processes.

[0105] Note that the determination of whether or not the face information on the driver's license 34 has been successfully read in step S303 may be performed by a method different from the above. For example, the authentication terminal 10 may previously hold a reference image of the face of the driver's license 34, calculate the similarity between the reference image and the face captured image, determine that the reading is successful if the similarity is equal to or greater than a predetermined threshold value, and determine that the reading is failed if the similarity is less than the predetermined threshold value. Alternatively, the authentication terminal 10 may previously hold the positions of unique colors, patterns, face photos, etc. on the face of the driver's license 34, and determine that the reading is successful if the same colors, patterns, face photos, etc. can be detected from these positions in the face captured image, and determine that the reading is failed if they cannot be detected.

[0106] <Driver's License Reading Continuation Process> FIG. 14 is a flowchart showing an example of the driver's license reading continuation process according to the first embodiment. This process is executed when the driver's license reading process shown in FIG. 13 is successful.

[0107] The authentication terminal 10 (or the POS system 50) captures the face of the user who purchases the product through the face capture camera 5 and generates a face captured image (S310).

[0108] The authentication terminal 10 collates the face captured image captured in step S310 with the face photo 22 on the face of the driver's license 34 (S311).

[0109] The authentication terminal 10 determines whether or not the collation in step S311 is successful (S312). That is, the authentication terminal 10 determines whether or not the user is the person indicated by the driver's license 34.

[0110] If it is determined that the collation has failed (S312: NO), the authentication terminal 10 transmits information indicating a failure in personal identification to the POS system 50 (S320), and returns to the processing (S106, S109, S112) of any of the call sources of the first to third reading continuation processes shown in FIG. 10.

[0111] When it is determined that the verification has been successful (S312: YES), the authentication terminal 10 acquires the date of birth from the face value information of the driver's license 34 (S313). Note that the face verification process in steps S310 to S312 and the process of acquiring the date of birth in step S313 may be carried out in any order.

[0112] The authentication terminal 10 calculates the age of the user based on the acquired date of birth and today's date (S314).

[0113] The authentication terminal 10 transmits the calculated age to the POS system 50 (S315), and returns to the process of the calling source of any of the first to third reading continuation processes shown in FIG. 10 (S106, S109, S112).

[0114] Through the above processing, the POS system 50 can confirm the age of the user from the driver's license 34 in cooperation with the authentication terminal 10. When the POS system 50 receives the age from the authentication terminal 10, if the age is equal to or greater than the age allowing the purchase of goods, information indicating that the purchase is possible may be displayed on the display unit 53, and if the age is less than the age allowing the purchase of goods, information indicating that the purchase is impossible may be displayed on the display unit 53.

[0115] Note that after step S314, the authentication terminal 10 may determine whether the calculated age is equal to or greater than a predetermined threshold value (for example, determine whether the user is an adult), and transmit the determination result to the POS system 50 in step S315. In this case, when the POS system 50 receives the determination result from the authentication terminal 10, if the determination result is a determination that it is equal to or greater than the threshold value (for example, in the case of a determination that the user is an adult), information indicating that the purchase is possible may be displayed on the display unit 53, and if the determination result is a determination that it is less than the threshold value (for example, in the case of a determination that the user is not an adult), information indicating that the purchase is impossible may be displayed on the display unit 53.

[0116] In addition, the authentication terminal 10 may determine whether the driver's license 34 is within the expiration date from the face value information, and if it is determined that the expiration date has passed, notify the same.

[0117] In addition, in the driver's license reading continuation process, the authentication terminal 10 may obtain the name and / or address, etc. from the face information regardless of age and transmit it to the POS system 50. When the name and address received from the authentication terminal 10 match the membership information, the POS system 50 may add points corresponding to the purchase to the points associated with the membership information. Thereby, the user can receive point awarding by presenting the driver's license 34 without separately presenting a membership card.

[0118] <Resident Card Reading Process> FIG. 15 is a flowchart showing an example of the resident card reading process according to Embodiment 1.

[0119] The authentication terminal 10 captures an image of the face of the identification document 20 placed on the placement unit 13 through the face photographing camera 14 and generates a face photographed image (S401).

[0120] The authentication terminal 10 reads the face information of the resident card 33 from the face photographed image using the face format information for the resident card (S402). As shown in FIG. 17, the face format information for the resident card includes information indicating what information is described in which section of the face of the resident card 33. For example, the authentication terminal 10 may perform OCR on each section described in the face format information for the resident card in the face photographed image to read the face information.

[0121] The authentication terminal 10 determines whether or not it has successfully read the face information of the resident card 33 in step S402 (S403). For example, the authentication terminal 10 determines whether or not it has successfully read at least a part (or all) of the name, place of residence, date of birth, resident card number, and expiration date described on the face (front surface) of the resident card 33.

[0122] When it is determined that the reading of the ticket surface information has been successful (S403: YES), it is determined that the reading is successful (S405), and the process returns to the process of the calling source of any of the first to third reading processes shown in FIG. 10 (any of S104, S107, S110). In this case, the authentication terminal 10 determines that the reading is successful (YES) in the next process (any of S105, S108, S111) of the process of the calling source of any of the first to third reading processes shown in FIG. 10, and executes the resident card reading continuation process shown in FIG. 16.

[0123] When it is determined that the reading of the ticket surface information has failed (S403: NO), the authentication terminal 10 determines that the reading has failed (S406), and returns to the process of the calling source of any of the first to third reading processes shown in FIG. 10 (any of S104, S107, S110). In this case, the authentication terminal 10 determines that the reading has failed (NO) in the process (any of S105, S108, S111) of the calling source of any of the first to third reading processes shown in FIG. 10, and executes the subsequent processes.

[0124] Note that the determination as to whether or not the reading of the ticket surface information of the resident card 33 in step S403 has been successful may be performed by a method different from the above. For example, the authentication terminal 10 may previously hold a reference image of the ticket surface of the resident card 33, calculate the similarity between the reference image and the ticket surface photographed image, and determine that the reading is successful when the similarity is equal to or greater than a predetermined threshold value, and determine that the reading has failed when the similarity is less than the predetermined threshold value. Alternatively, the authentication terminal 10 may previously hold the positions of colors, patterns, face photos, etc. unique to the ticket surface of the resident card 33, and determine that the reading is successful when the same colors, patterns, face photos, etc. can be detected from these positions in the ticket surface photographed image, and determine that the reading has failed when they cannot be detected.

[0125] <Resident Card Reading Continuation Process> FIG. 16 is a flowchart showing an example of the resident card reading continuation process according to Embodiment 1. This process is executed when the resident card reading process shown in FIG. 15 is successful.

[0126] The authentication terminal 10 (or the POS system 50) captures the face of the user who purchases the product through the face capture camera 5 and generates a face capture image (S410).

[0127] The authentication terminal 10 compares the face capture image captured in step S410 with the face photo 22 on the face of the residence card 33 (S411).

[0128] The authentication terminal 10 determines whether the comparison in step S411 is successful (S412). That is, the authentication terminal 10 determines whether the user is the person indicated by the residence card 33. In addition, when the authentication terminal 10 cannot obtain the face photo 22 from the face of the residence card 33 (for example, when the user is under 16 years old), it may be determined that the comparison has failed.

[0129] When it is determined that the comparison has failed (S412: NO), the authentication terminal 10 transmits information indicating that the personal confirmation has failed to the POS system 50 (S420), and returns to the processing of any of the call sources of the first to third reading continuation processes shown in FIG. 10 (S106, S109, S112).

[0130] When it is determined that the comparison has been successful (S412: YES), the authentication terminal 10 obtains the date of birth from the face information of the residence card 33 (S413). In addition, the authentication terminal 10 may access the IC chip of the residence card 33 using the residence card number, and obtain the date of birth by OCR from the face image data obtained from the IC chip. Also, the face comparison process in steps S410 to S412 and the process of obtaining the date of birth in step S413 may be performed in any order.

[0131] The authentication terminal 10 calculates the age of the user based on the obtained date of birth and today's date (S414).

[0132] The authentication terminal 10 transmits the calculated age to the POS system 50 (S415), and returns to the processing of any of the call sources of the first to third reading continuation processes shown in FIG. 10 (any of S106, S109, S112).

[0133] Through the above process, the POS system 50 can cooperate with the authentication terminal 10 to confirm the user's age from the residence card 33. The POS system 50 receives the age from the authentication terminal 10. If the age is equal to or greater than the age permitting commodity purchase, information indicating that the purchase is possible may be displayed on the display unit 53. If the age is less than the age permitting commodity purchase, information indicating that the purchase is impossible may be displayed on the display unit 53.

[0134] Note that after step S414, the authentication terminal 10 may determine whether the calculated age is equal to or greater than a predetermined threshold value (for example, determine whether the user is an adult), and in step S415, transmit the determination result to the POS system 50. In this case, the POS system 50 receives the determination result from the authentication terminal 10. If the determination result is that the age is equal to or greater than the threshold value (for example, in the case of determining that the user is an adult), information indicating that the purchase is possible may be displayed on the display unit 53. If the determination result is that the age is less than the threshold value (for example, in the case of determining that the user is not an adult), information indicating that the purchase is impossible may be displayed on the display unit 53.

[0135] In addition, the authentication terminal 10 may determine whether the residence card 33 is within the expiration date from the ticket surface information, and if it is determined that the expiration date has passed, may notify the same.

[0136] In addition, in the residence card reading continuation process, the authentication terminal 10 may obtain not only the age but also the name, place of residence, etc. from the ticket surface information and transmit them to the POS system 50. If the name and address received by the POS system 50 from the authentication terminal 10 match the member information, points corresponding to the purchase may be added to the points associated with the member information. Thereby, the user can receive point granting by presenting the My Number card 31 without separately presenting a membership card.

[0137] <Ticket surface format information> FIG. 17 shows an example of the ticket surface format information 80 according to the first embodiment.

[0138] The coupon format information 80 has, as items, the type of the identity document 20, the information type, the section, the font type, and the font size, etc.

[0139] The types of identity documents are set to be the My Number Card, the driver's license, the residence card, or the passport. The information type indicates the type of information described on the coupon of the identity document. The information type may have the item of "paper surface (front surface)" shown in FIG. 1 set. The section indicates the section (range) on the coupon where the information indicated by the information type is described. The font type indicates the type of font of the characters that describe the information indicated by the information type on the coupon. The font size indicates the size of the font of the characters that describe the information indicated by the information type on the coupon.

[0140] In the table shown in FIG. 17, the row of the type of identity document "My Number Card" corresponds to the format information for the My Number Card. The row of the type of identity document "driver's license" corresponds to the format information for the driver's license. The row of the type of identity document "residence card" corresponds to the format information for the residence card. The row of the type of identity document "passport" corresponds to the format information for the passport.

[0141] For example, for the coupon format information 80 for the My Number Card shown in FIG. 17, the information type "date of birth", the section "(ax1, ay1), (ax2, ay2)", the font type "Font A", and the font size "7" indicate that on the coupon of the My Number Card 31, "date of birth" is described in a rectangular section with the coordinates of the upper left vertex being (ax1, ay1) and the coordinates of the lower right vertex being (ax2, ay2), the font type of the characters is "Font A", and the font size is "7". The authentication terminal 10 can determine the type of identity document indicated by the coupon photographed image by reading the coupon information from the coupon photographed image using this coupon format information 80.

[0142] <Usage history information of the type of identity document> FIG. 18 is a diagram showing the usage history information 90 of the types of the personal identification documents 20 according to the first embodiment.

[0143] Each time the personal identification document 20 is used, the authentication terminal 10 associates the date and time of use with the type of the used personal identification document 20 and stores them in the usage history information 90 as shown in FIG. 18. The usage history information 90 may be stored in the memory 12 of the authentication terminal 10. For example, in the first to third reading processes shown in FIG. 10, the authentication terminal 10 may specify the type of the used personal identification document 20 based on the reading type for which the reading is successful and store it in the usage history information 90.

[0144] Based on the usage history information 90, the authentication terminal 10 may determine or change the reading type set for each of the first to third reading processes. Next, some examples of the determination or change method will be described.

[0145] <<Change in priority based on usage frequency within a period>> The authentication terminal 10 refers to the usage history information 90 for a predetermined period (for example, the past one week) and determines the priority of the reading types in descending order of the number of uses. Then, the authentication terminal 10 sets the reading type for each of the first to third reading processes according to the priority.

[0146] For example, in the period of the usage history information 90 shown in FIG. 18, the number of uses of the residence card (6 pieces of L13, L17, L18, L21, L22, L23), the my number card (5 pieces of L12, L14, L15, L19, L20), and the driver's license (2 pieces of L11, L16) is large in this order. In this case, in step S101, the authentication terminal 10 sets the residence card for the first reading process, the my number card for the second reading process, and the driver's license for the third reading process. Thereby, the probability of successful reading in the first reading process in the future is improved.

[0147] <<Change in priority based on usage frequency for each store>> The authentication terminal 10 refers to the usage history information 90 for each store, and for each store, determines the priority order of reading types in descending order of the number of uses. Then, the authentication terminal 10 sets the reading types for each of the first to third reading processes according to the priority order for each store.

[0148] For example, in the usage history information 90 of store A, as shown in FIG. 18, the number of uses is in the order of the residence card, the my number card, and the driver's license. In the usage history information of store B, although not shown, it is assumed that the number of uses is in the order of the driver's license, the my number card, and the residence card. In this case, the authentication terminal 10 of store A sets the residence card for the first reading process, the my number card for the second reading process, and the driver's license for the third reading process in step S101. The authentication terminal 10 of store B sets the driver's license for the first reading process, the my number card for the second reading process, and the residence card for the third reading process in step S101. Thereby, in each store, the probability of successful reading in the first reading process is improved in the future.

[0149] <<Change of Priority Based on Usage Frequency per Time Zone>> The authentication terminal 10 refers to the usage history information 90 for each time zone of a day (for example, daytime and nighttime), and for each time zone, determines the priority order of reading types in descending order of the number of uses. Then, the authentication terminal 10 sets the reading types for each of the first to third reading processes according to the priority order for each time zone.

[0150] For example, in the usage history information 90 shown in FIG. 18, during the daytime (9:00 to 18:00), the usage frequencies are in the order of My Number Card (4 pieces: L12, L15, L19, L20), driver's license (2 pieces: L11, L16), and residence card (0 pieces). During the nighttime (18:00 to 23:00), the usage frequencies are in the order of residence card (6 pieces: L13, L17, L18, L21, L22, L23), My Number Card (1 piece: L14), and driver's license (0 pieces). In this case, during the daytime, the authentication terminal 10 sets the My Number Card for the first reading process, sets the driver's license for the second reading process, and sets the residence card for the third reading process in step S101. During the nighttime, the authentication terminal 10 sets the residence card for the first reading process, sets the My Number Card for the second reading process, and sets the driver's license for the third reading process in step S101. Thereby, the probability of successful reading in the first reading process in each time zone is improved in the future.

[0151] <Selection Screen for Types of Personal Identification Documents> FIG. 19 is a diagram showing an example of a selection screen 100 for types of personal identification documents according to Embodiment 1.

[0152] Before step S101 in FIG. 10, the POS system 50 may display a selection screen 100 for types of personal identification documents as shown in FIG. 19 on the display unit 53. For example, the selection screen 100 displays a My Number Card selection button 101, a driver's license selection button 102, a residence card selection button 103, and a clerk call button 104.

[0153] Before step S101 in FIG. 10, the user selects the type of personal identification document 20 to be used from the selection screen 100. For example, when the user uses the My Number Card 31, the user touches the My Number Card selection button 101; when using the driver's license 34, the user touches the driver's license selection button 102; and when using the residence card 33, the user touches the residence card selection button 103.

[0154] The POS system 50 may display the button corresponding to the reading type with the highest priority described in FIG. 18 more prominently than the buttons corresponding to other reading types. For example, when the priority of the My Number Card 31 is the highest, as shown in FIG. 19, the POS system 50 displays the My Number Card selection button 101 larger than the driver's license selection button 102 and the alien registration card selection button 103 on the selection screen 100. Alternatively, when the priority of the My Number Card 31 is the highest, the POS system 50 displays the My Number Card selection button 101 in a color different from that of the driver's license selection button 102 and the alien registration card selection button 103 on the selection screen 100. The configuration of the selection screen 100 may be changed according to the change in priority.

[0155] As a result, on the selection screen 100, the selection button with a high probability of being used by the user is displayed most prominently, so that the user can be reduced from making a wrong selection.

[0156] Note that instead of the selection screen 100 as shown in FIG. 19, the POS system 50 may display only the reading start button on the display unit 53. In this case, when the reading start button is touched, the process shown in FIG. 10 may be started. Thereby, even if the user does not select the type of the personal identification document 20 to be used, the authentication terminal 10 can automatically read the coupon information of any type of the personal identification document 20.

[0157] <Configuration of the Personal Identification Device> FIG. 20 is a diagram showing a configuration example of a personal identification device 200 according to a modification of Embodiment 1.

[0158] The store system 1 may use the personal identification device 200 shown in FIG. 20 instead of the authentication terminal 10 shown in FIG. 8.

[0159] The personal identification device 200 includes a face camera 201, an operation unit 202, and a display unit 203 in addition to the processor 11, the memory 12, the mounting unit 13, the document surface photographing camera 14, and the IC reader 15 provided in the authentication terminal 10 shown in FIG. 8. The face camera 201 corresponds to the face camera 5 shown in FIG. 7. The operation unit 202 receives input operations from the user to the personal identification device 200. The display unit 203 displays the images and information generated by the processor 11. The operation unit 202 and the display unit 203 may be an integrated touch panel type display.

[0160] For example, the information displayed on the display unit 53 of the POS system 50 described above may be displayed on the display unit 203 of the personal identification device 200. Further, the selection screen 100 shown in FIG. 19 may be displayed on the display unit 203 of the personal identification device 200 and operated from the operation unit 202.

[0161] (Summary of Embodiment 1) Based on the description of the above Embodiment 1, the following technologies are disclosed.

[0162] <Technology 1> In the personal identification method for reading the information of the personal identification document (20) according to Embodiment 1, for each of the first reading process and the second reading process, different reading types corresponding to each type of the personal identification document are set (S101), and the first reading process based on the set reading type is performed on the document surface photographing image obtained by photographing the document surface of the personal identification document (S104). When the first reading process fails (S105: NO), the second reading process based on the set reading type is performed on the document surface photographing image (S107). Thereby, even when the type of the personal identification document to be read is different from the set type of the personal identification document, the information of the personal identification document can be read without causing the user any trouble.

[0163] <Technology 2> In the personal identification method described in Technology 1, the reading type set for the first reading process is predetermined, or the reading type set for the first reading process is selected by the user. Thereby, even when the type of the personal identification document to be read is different from the type of the personal identification document that is predetermined or selected by the user, the information of the personal identification document can be read without causing trouble to the user.

[0164] <Technology 3> In the personal identification method described in Technology 1 or 2, the first reading process reads information from the image of the document surface based on the document surface format information corresponding to the set reading type, and when the reading fails, it is determined that the first reading process has failed. Thereby, it is possible to determine whether the image of the document surface corresponds to the reading type set for the first reading process.

[0165] <Technology 4> In the personal identification method described in any one of Technology 1 or 2, the first reading process calculates the similarity between the reference image corresponding to the set reading type and the image of the document surface, and when the calculated similarity is less than a predetermined threshold value, it is determined that the first reading process has failed. Thereby, it is possible to determine whether the image of the document surface corresponds to the reading type set for the first reading process.

[0166] <Technology 5> In the personal identification method described in any one of Technologies 1 to 4, based on the information read from the personal identification document in the first reading process or the second reading process, the age of the person possessing the personal identification document is calculated, and based on the age, it is determined whether to permit the provision of goods to the person. Thus, even when the type of the personal identification document to be read is different from the set type of the personal identification document, the user's age can be calculated from the personal identification document without causing trouble to the user, and it can be determined whether to permit the provision of the product to the user.

[0167] <Technology 6> In the personal identification method according to any one of Technologies 1 to 5, the reading type is set for each of the first reading process and the second reading process based on a predetermined condition. Thereby, the reading type set for each of the first reading process and the second reading process can be determined or changed based on a predetermined condition.

[0168] <Technology 7> In the personal identification method according to Technology 6, the predetermined condition is the usage frequency for each type of the personal identification document, and for the first reading process, the reading type corresponding to the type of the personal identification document with the highest usage frequency is set. Thereby, the reading type set for each of the first reading process and the second reading process can be determined or changed based on the usage frequency for each type of the personal identification document.

[0169] <Technology 8> In the personal identification method according to Technology 6, the predetermined condition is the usage frequency by time zone for each type of the personal identification document. In a certain time zone, for the first reading process, the reading type corresponding to the type of the personal identification document with the highest usage frequency in the time zone is set. Thereby, the reading type set for each of the first reading process and the second reading process can be determined or changed based on the usage frequency by time zone for each type of the personal identification document. Therefore, an appropriate reading type can be set for each of the first reading process and the second reading process for each time zone.

[0170] <Technology 9> In the personal identification method described in Technique 6, the predetermined condition is the usage frequency for each type of personal identification document in each store. In a certain store, for the first reading process, a reading type corresponding to the type of personal identification document with the highest usage frequency in that store is set. Thereby, the reading types set for each of the first reading process and the second reading process can be determined or changed based on the usage frequency for each type of personal identification document in each store. Therefore, an appropriate reading type can be set for each store for each of the first reading process and the second reading process.

[0171] <Technique 10> In the personal identification method according to any one of Techniques 6 to 9, every time a predetermined period elapses, the setting of the reading type for each of the first reading process and the second reading process is changed. Thereby, the setting of the reading type for each of the first reading process and the second reading process can be changed periodically.

[0172] <Technique 11> A personal identification device (200) that reads information of a personal identification document (20) includes a camera (for example, a document surface photographing camera 14) and a processor (11). The processor sets different reading types of personal identification documents for each of the first reading process and the second reading process, uses the camera to photograph the document surface of the personal identification document to generate a document surface photographed image, performs the first reading process based on the set reading type on the document surface photographed image, and when the first reading process fails, performs the second reading process based on the set reading type on the document surface photographed image. Thereby, even when the type of the personal identification document to be read is different from the set type of the personal identification document, the information of the personal identification document can be read without causing trouble to the user.

[0173] <Technique 12> The personal identification document information reading personal identification system (for example, store system 1) that reads the information of the personal identification document (20) includes an authentication terminal (10) and a POS system (50). The authentication terminal sets different types of personal identification documents to be read for each of the first reading process and the second reading process (S101), uses a predetermined camera (for example, the document surface photographing camera 14) to photograph the document surface of the personal identification document to generate a document surface photographed image, performs the first reading process based on the set reading type on the document surface photographed image (S104), and when the first reading process fails (S105: NO), performs the second reading process based on the set reading type on the document surface photographed image (S107). Based on the information read from the personal identification document in the first reading process or the second reading process, the age of the person holding the personal identification document is calculated (S214, S314 or S414), the age is transmitted to the POS system, and the POS system determines whether to permit the provision of goods to the person based on the age received from the authentication terminal. Thereby, even when the type of the personal identification document to be read is different from the set type of the personal identification document, the age of the user can be calculated from the personal identification document without causing trouble to the user, and it can be determined whether to permit the provision of goods to the user.

[0174] <Technology 13> The personal identification document information reading personal identification system (for example, store system 1) for reading the information of the personal identification document (20) includes an authentication terminal (10) and a POS system (50). The authentication terminal sets (S101) different types of personal identification documents to be read for each of the first reading process and the second reading process, captures the front side of the personal identification document using a predetermined camera (for example, the front side photographing camera 14) to generate a front side photographing image, performs the first reading process based on the set reading type on the front side photographing image (S104), and when the first reading process fails (S105: NO), performs the second reading process based on the set reading type on the front side photographing image (S107). Based on the information read from the personal identification document in the first reading process or the second reading process, it is determined whether the age of the person possessing the personal identification document is equal to or greater than a predetermined threshold value, and the result of the determination is transmitted to the POS system. Based on the result of the determination received from the authentication terminal, the POS system determines whether to permit the provision of goods to the person. Thereby, even when the type of the personal identification document to be read is different from the set type of the personal identification document, it is possible to determine whether the age of the user is equal to or greater than a predetermined threshold value from the personal identification document without causing trouble to the user, and to determine whether to permit the provision of goods to the user based on the determination result.

[0175] <Technology 14> The personal identification program for reading the information of the personal identification document (20) sets (S101) different types of personal identification documents to be read for each of the first reading process and the second reading process, and causes the computer to perform the first reading process based on the set reading type on the front side photographing image obtained by photographing the front side of the personal identification document (S104), and when the first reading process fails (S105: NO), perform the second reading process based on the set reading type on the front side photographing image (S107). As a result, even when the type of the personal identification document to be read is different from the set type of the personal identification document, it is possible to read the information of the personal identification document without causing trouble to the user.

[0176] As described above, the embodiments have been described with reference to the accompanying drawings, but the present disclosure is not limited to such examples. It is obvious that those skilled in the art can conceive various modification examples, correction examples, substitution examples, addition examples, deletion examples, and equivalent examples within the scope described in the claims, and it is understood that they also belong to the technical scope of the present disclosure. Further, within the scope not departing from the gist of the invention, the respective components in the above-described embodiments may be arbitrarily combined.

Industrial Applicability

[0177] The technology of the present disclosure is useful for devices, systems, methods, programs, etc. that utilize personal identification documents.

Explanation of Reference Numerals

[0178] 1 Store system 5 Face photographing camera 10 Authentication terminal 11 Processor 12 Memory 13 Mounting portion 14 Document surface photographing camera 15 IC reader 20 Personal identification document 21 IC chip 22 Face photograph 23 Character information 31 My Number card 32 Passport 33 Residence card 34 Driver's license 50 POS system 51 Processor 52 Memory 53 Display unit 54 Operation unit 55 Communication unit 56 Scanner 70 Product information DB 80 Voucher format information 90 Usage history information 100 Selection screen 101 My Number card selection button 102 Driver's license selection button 103 Residence card selection button 104 Button 200 Identity verification device 201 Face camera 202 Operation unit 203 Display unit

Claims

1. A method for personal identification that reads information from personal identification documents, For each of the first reading process and the second reading process, different reading types corresponding to various types of the personal identification documents are set, For the document surface photograph image obtained by photographing the document surface of the personal identification document, the first reading process based on the set reading type is performed, When the first reading process fails, for the document surface photograph image, the second reading process based on the set reading type is performed, A method for personal identification.

2. The reading type set for the first reading process is predetermined, or The reading type set for the first reading process is selected by the user, The method for personal identification according to Claim 1.

3. The first reading process reads information from the document surface photograph image based on the document surface format information corresponding to the set reading type, When the reading fails, it is determined that the first reading process has failed, The method for personal identification according to Claim 1.

4. The first reading process calculates the similarity between the reference image corresponding to the set reading type and the document surface photograph image, When the calculated similarity is less than a predetermined threshold value, it is determined that the first reading process has failed, The method for personal identification according to Claim 1.

5. Based on the information read from the personal identification document in the first reading process or the second reading process, the age of the person holding the personal identification document is calculated, Based on the age, it is determined whether to permit the provision of goods to the person, The method for personal identification according to Claim 1.

6. Based on predetermined conditions, the reading types are set for each of the first reading process and the second reading process, The method for personal identification according to Claim 1.

7. The predetermined condition is the usage frequency for each type of the personal identification document, For the first reading process, the reading type corresponding to the type of the personal identification document with the highest usage frequency is set, The method for personal identification according to Claim 6.

8. The predetermined condition is the usage frequency by time zone for each type of the personal identification document, In a certain time zone, for the first reading process, the reading type corresponding to the type of the personal identification document with the highest usage frequency in that time zone is set, The method for personal identification according to Claim 6.

9. The predetermined condition is the usage frequency for each type of the personal identification document at each store, At a certain store, for the first reading process, set a reading type corresponding to the type of the personal identification document with the highest usage frequency at the store. The personal identification method according to claim 6.

10. Every time a predetermined period elapses, change the setting of the reading type for each of the first reading process and the second reading process. The personal identification method according to claim 6.

11. A personal identification device that reads information of a personal identification document, comprising a camera and a processor, The processor: For each of the first reading process and the second reading process, set different reading types for the personal identification documents, Use the camera to capture an image of the face of the personal identification document to generate a face-captured image, Perform the first reading process based on the set reading type on the face-captured image, When the first reading process fails, perform the second reading process based on the set reading type on the face-captured image. Personal identification device.

12. A personal identification system that reads information of a personal identification document, comprising an authentication terminal and a POS system, The authentication terminal: For each of the first reading process and the second reading process, set different reading types for the personal identification documents, Use a predetermined camera to capture an image of the face of the personal identification document to generate a face-captured image, Perform the first reading process based on the set reading type on the face-captured image, When the first reading process fails, perform the second reading process based on the set reading type on the face-captured image, Calculate the age of the person holding the personal identification document based on the information read from the personal identification document in the first reading process or the second reading process, Transmit the age to the POS system, The POS system: Based on the age received from the authentication terminal, determine whether to permit the provision of goods to the person. Personal identification system.

13. A personal identification system that reads information of a personal identification document, comprising an authentication terminal and a POS system, The authentication terminal: For each of the first reading process and the second reading process, set different reading types for the personal identification documents, Use a predetermined camera to capture an image of the face of the personal identification document to generate a face-captured image, Perform the first reading process based on the set reading type on the photographed image of the certificate surface. When the first reading process fails, perform the second reading process based on the set reading type on the photographed image of the certificate surface. Based on the information read from the identity verification document in the first reading process or the second reading process, determine whether the age of the person possessing the identity verification document is equal to or greater than a predetermined threshold. Send the result of the determination to the POS system. The POS system Based on the result of the determination received from the authentication terminal, determine whether to permit the provision of goods to the person. Identity verification system.

14. An identity verification program for reading information on an identity verification document, For each of the first reading process and the second reading process, set different reading types of identity verification documents, Perform the first reading process based on the set reading type on the photographed image of the certificate surface of the identity verification document. When the first reading process fails, perform the second reading process based on the set reading type on the photographed image of the certificate surface. A computer-executable identity verification program.

Images