Information processing system, information processing method, and program

Abstract

To provide an information processing system, method and program that enables the time spent for media-used procedures to be shortened.SOLUTION: In the information processing system, a reader device 1 includes an execution unit, a holding unit, and a determination unit. The execution unit performs any of one or more types of procedures carried out using a medium when a medium is presented to the reader unit. The holding unit holds information acquired in a media-used procedure. The determination unit performs sameness determination of whether or not a first medium and a second medium are the same when the second medium is presented to the reader unit after a first procedure using the first medium and carried out by presenting the first medium to the reader unit is aborted or completed, by using at least a part of information acquired in the first procedure and held by the holding unit. When it is determined that the first medium and the second medium are the same, the execution unit omits processing in a second procedure using the second medium provided that it duplicates processing carried out in the first procedure.SELECTED DRAWING: Figure 2

Description

[Technical Field]

[0001] The present disclosure relates to a technique for performing a procedure using a medium on which user information is recorded. [Background technology]

[0002] Conventionally, a device has been proposed (see Patent Document 1) that scans the face of an inserted IC card using a scanner or the like, reads the embossed characters on the face of the IC card to obtain face information, and also obtains card information from an IC module using a reader / writer, compares the obtained face information with the card information, and if the face information is successfully compared with the card information, determines that the IC card is not a counterfeit IC card, and if the face information is not successfully compared with the card information, determines that the IC card is a counterfeit IC card and suspends use of the inserted IC card. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2007-179157 Summary of the Invention [Problem to be solved by the invention]

[0004] Conventionally, systems for performing procedures using a medium such as an identification document have been known. In such systems, for example, an identification document such as a My Number card is presented to a reading device, and the procedure is performed using the presented identification document. However, the procedure may be interrupted during the procedure due to the user accidentally removing the identification document or erroneous screen operation by the user. When the procedure is interrupted in this way, the user often has to reinsert the identification document into the reading device and start the procedure from scratch, which results in a time-consuming procedure. Furthermore, when the same user performs multiple procedures using the same medium, even if the multiple procedures include overlapping processes, the process is often performed individually for each procedure, which results in a time-consuming procedure.

[0005] In view of the above-mentioned problems, an object of the present disclosure is to reduce the time required for procedures using media. [Means for solving the problem]

[0006] One example of the present disclosure is an information processing system comprising: an execution means for performing at least one of one or more types of procedures that can be performed using a medium when the medium is presented to a reading unit capable of reading the medium on which user information is recorded; a storage means for storing information acquired in the procedure using the medium; and a determination means for performing an identity determination of whether the first medium and the second medium are identical using at least a portion of the information acquired in the first procedure stored by the storage means when a first procedure using the first medium, which was performed when the first medium was presented to the reading unit, is interrupted or completed, and when a second medium is presented to the reading unit, the execution means omits processing in the second procedure using the second medium that overlaps with processing performed in the first procedure, if it is determined that the first medium and the second medium are identical.

[0007] The present disclosure can be understood as an information processing device, a system, a method executed by a computer, or a program executed by a computer. The present disclosure can also be understood as such a program recorded on a recording medium readable by a computer or other device, machine, etc. Here, a recording medium readable by a computer, etc. refers to a recording medium that stores information such as data and programs by electrical, magnetic, optical, mechanical, or chemical action and can be read by a computer, etc. [Effects of the Invention]

[0008] According to the present disclosure, it is possible to reduce the time required for procedures using media. [Brief explanation of the drawings]

[0009] [Figure 1] 1 is a schematic diagram illustrating a configuration of a system according to an embodiment. [Figure 2] 1 is a diagram illustrating an outline of the functional configuration of an information processing apparatus (reading apparatus) according to an embodiment. [Figure 3] 10 is a flowchart showing an outline of the flow of identity verification processing (normal processing when accessing an IC chip) according to the embodiment. [Figure 4] 10 is a flowchart showing an outline of the flow of identity verification processing (normal processing when the IC chip is not accessed) according to the embodiment. [Figure 5] 10 is a flowchart showing an outline of the flow of a temporarily held data monitoring process. [Figure 6A] 10 is a flowchart (1) showing an overview of the flow of identity verification processing (when accessing an IC chip) when performing identity determination processing according to the embodiment. [Figure 6B] 10 is a flowchart (2) showing an outline of the flow of the identity verification process (when accessing the IC chip) when performing the identity determination process according to the embodiment. [Figure 6C]10 is a flowchart (3) showing an outline of the flow of the identity verification process (when accessing the IC chip) when performing the identity determination process according to the embodiment. [Figure 7A] 10 is a flowchart (1) showing an overview of the flow of identity verification processing (when the IC chip is not accessed) when performing identity determination processing according to the embodiment. [Figure 7B] 10 is a flowchart (2) showing an outline of the flow of the identity verification process (when the IC chip is not accessed) when performing the identity determination process according to the embodiment. [Figure 7C] 10 is a flowchart (3) showing an outline of the flow of the identity verification process (when the IC chip is not accessed) when performing the identity determination process according to the embodiment. [Figure 8] FIG. 10 is a schematic diagram illustrating the configuration of a system according to another embodiment. [Figure 9] FIG. 10 is a diagram for explaining the reason for interruption in the personal identification process. DETAILED DESCRIPTION OF THE INVENTION

[0010] Hereinafter, embodiments of an information processing device, system, method, and program according to the present disclosure will be described with reference to the drawings. However, the embodiments described below are merely examples, and the information processing device, system, method, and program according to the present disclosure are not limited to the specific configurations described below. In implementing the present disclosure, a specific configuration according to the embodiment may be appropriately adopted, and various improvements and modifications may be made.

[0011] In this embodiment, an information processing device, a system, a method, and a program according to the present disclosure will be described in terms of an embodiment in which the information processing device, a system, a method, and a program according to the present disclosure are implemented in a system for performing a procedure using an identification document. However, the information processing device, a system, a method, and a program according to the present disclosure can be widely used in technologies for performing any procedure using a medium, and the application of the present disclosure is not limited to the examples shown in the embodiment.

[0012] Conventionally, there are known identity verification devices that can perform identity verification processing using an identity verification document, such as a My Number card equipped with an integrated circuit (IC) chip, by placing the document on the device. In the identity verification processing, for example, the identity verification device photographs the face of the identity verification document, performs character recognition processing on the face image to obtain an access key for accessing the IC chip, and then uses the obtained access key to obtain information stored in the IC chip. The information (such as name) stored in the IC chip thus obtained can be used in identity verification determination processing and various other processes (procedures). Furthermore, face authentication can be performed using a face image (face photo) of the user recorded in the IC and a face photo of the user captured by the identity verification device, and identity verification can be determined based on the results of the face authentication. However, during this identity verification processing, for some reason (e.g., not understanding the content displayed on the screen of the identity verification device, being unfamiliar with device operation, etc.), the user may interrupt the identity verification processing by removing the identity verification document from the identity verification device or pressing the cancel button.

[0013] FIG. 9 is a diagram for explaining a reason for interruption in identity verification processing. In the identity verification processing illustrated in FIG. 9, when an identity verification document equipped with an IC chip is inserted into an identity verification device, the face of the identity verification document is photographed, and character recognition processing is performed on the photographed image (face image). Then, an access key for accessing the IC chip is generated (acquired) based on the character recognition results, and access processing to the IC chip is performed using the access key, and user information is acquired from the IC chip. In parallel with these processing, the face of the user who inserted the identity verification document is photographed, and facial authentication is performed by comparing the facial image (facial features) obtained by photographing with the facial image (facial features) acquired from the IC chip. Identity verification is then determined based on the result of the facial authentication. After the identity verification determination processing, post-processing (such as processing to accept a selection input from the user, such as whether or not to agree to the consent terms) is performed, and the identity verification processing is completed. Note that the identity verification processing illustrated in FIG. 9 is merely an example, and for example, the access key may be obtained by inputting the access key from the user, rather than from the face of the document.

[0014] In such an identity verification process, the process may be interrupted mainly due to the interruption reasons (a) to (f) shown below. The interruption reasons (a) to (f) are explained below. The interruption reasons (a) to (f) may occur at the timings (a) to (f) shown in FIG. 9.

[0015] (a) Identification documents are not inserted within the time limit If the user does not insert the identification document within a certain time from when they stand in front of the identification device or when a message instructing them to insert the identification document appears on the display of the identification device (for example, if the insertion is delayed), an error will occur and the identification process will be interrupted.

[0016] (b) Removal of identification documents during identity verification processing In the case of identity verification processing, an error often occurs if the identity verification document is not presented (inserted, placed, held over, etc.) to the identity verification device until the identity verification processing is completed. Therefore, if the identity verification document is accidentally removed from the identity verification device during identity verification processing, an error occurs and the identity verification processing is interrupted. Note that this interruption reason can occur not only at the timing of (b) in Figure 9, but also in processing after (b).

[0017] (c) Character recognition cannot be performed correctly on images of personal identification documents. Character recognition may not be performed correctly from the captured image if the personal identification document is inserted into the personal identification device upside down, if the personal identification document is inserted with the cover still on, if the personal identification document is placed in a position where it cannot be read correctly, or if a document different from the pre-designated personal identification document is placed, etc. In such cases, an error occurs and the personal identification process is interrupted.

[0018] (d) The IC chip embedded in the identification document cannot be accessed. If character recognition is not performed correctly due to dirt on the card surface or external light entering the card, the access key generated from the character recognition results may be incorrect. Also, the access key entered by the user may be incorrect. In such cases, the IC chip cannot be accessed, resulting in an error and interrupting the identity verification process.

[0019] (e)Facial recognition is not successful In the identity verification process, which determines identity based on the facial authentication results, if a facial image cannot be captured or if facial authentication fails (if the facial image stored in the IC chip on the identity verification document differs from the facial image captured by capturing the face), an error occurs and the identity verification process is interrupted. Note that this interruption can occur not only at the timing of (e) in Figure 9, but also at any time from (e) until the facial authentication process begins.

[0020] (f) Removal of identity documents in processing after identity verification If the user removes the personal identification document when selecting whether or not to agree to the terms of the agreement after the personal identification determination process, an error may occur and the personal identification process may be interrupted.

[0021] When a reason for interruption occurs and the procedure is interrupted, even if information on the IC card or the like was obtained before the interruption, it has been common practice to discard the obtained information from the identity verification device (not leave the data on the device) from the perspective of protecting personal information. As a result, if the identity verification process is interrupted and the user wants to perform the identity verification process again, the process must be restarted from the beginning, which reduces the user's convenience and increases the time required for the process because the identity verification process must be restarted. In addition, there is also the problem that the process (identity verification process) takes time, which may lead the user to stop the process again midway. In addition, when one user performs multiple procedures, performing identity verification for each procedure increases the time required for the process.

[0022] For this reason, in the system described in this embodiment, information (such as an access key) acquired in the previous procedure (such as identity verification processing) is temporarily stored, and if it is determined that the same identity verification document as the previous one has been presented, that is, if it is determined that the procedure is a redo of an interrupted procedure or a different procedure by the same user, the system omits processes that overlap with those already performed in the previous procedure (reuses (carries over) information acquired by the performed process). For example, it is possible to omit at least one of the processes surrounded by dotted lines in FIG. 9. This shortens the time required for the procedure and improves user comfort.

[0023] FIG. 1 is a schematic diagram showing the configuration of a system according to this embodiment. The system according to this embodiment is a system including an information processing device 1. In this embodiment, a reading device capable of reading a medium on which user information is recorded is exemplified as the information processing device 1. However, as will be described later, the system according to this embodiment may also be a system in which the reading device 1 capable of reading a medium on which user information is recorded is communicably connected (wired and / or wirelessly) to one or more other information processing devices 9 via a network or other communication means. The systems according to this embodiment and other embodiments described later are information processing systems that perform procedures using a medium on which user information is recorded.

[0024] The information processing device 1 is a computer including a reading unit 11, a face-capturing camera 12, a central processing unit (CPU) 13, a read-only memory (ROM) 14, a random access memory (RAM) 15, a storage device 16 such as an electrically erasable and programmable read-only memory (EEPROM) or a hard disk drive (HDD), an input device 17 such as a touch panel, an output device 18 such as a display, and a communication unit 19 such as a network interface card (NIC). The information processing device 1 may include any input device and any output device as the input device 17 and the output device 18. For example, the information processing device 1 may include a microphone, keyboard, mouse, etc. as input devices, and a speaker, printer, etc. as output devices. However, the specific hardware configuration of the information processing device 1 may be omitted, replaced, or added as appropriate depending on the embodiment. The information processing device 1 is not limited to a device consisting of a single housing, and may be realized by multiple devices using so-called cloud or distributed computing technology, etc.

[0025] The information processing device 1 is a device that performs a procedure (process) using a medium on which user information is recorded. As described above, in this embodiment, a reading device capable of reading a medium is exemplified as the information processing device 1, and the information processing device 1 performs a procedure including a medium reading process. Hereinafter, the information processing device 1 will be referred to as a reading device 1. Also, hereinafter, a procedure using a medium will be simply referred to as a "procedure." In this embodiment, a procedure including an identity verification process is exemplified as the procedure. A "procedure including an identity verification process" may be a procedure (process) that performs only identity verification process, or may be a procedure (process) that includes other processes besides identity verification process (e.g., a form generation process). In this embodiment, examples of "identity verification process" when accessing an IC chip mounted on a medium include a process for acquiring a medium type, photographing the medium, character recognition process, a process for acquiring an access key, a process for accessing the IC chip, a reading process for reading information from the IC chip, a face photographing process for photographing the user's face, face authentication process, and an identity verification determination process. Furthermore, examples of "identity verification processing" for media that do not have an IC chip or when the IC chip on the media is not accessed include processing to acquire the medium type, processing to photograph the medium (processing to acquire a medium image), character recognition processing for the medium image, facial photography processing, facial authentication processing, and identity verification processing. However, as long as the procedure uses a medium, it may include any one or more processes. Therefore, the procedure is not limited to one that includes identity verification processing, and may be, for example, a procedure (processing) that does not perform identity verification processing and only generates a form using information read from the medium.

[0026] The medium on which user information is recorded, which is the target of the reading process (reading target) by the reading device 1, is a medium on which information related to the user (user information), such as personal information such as the user's name, address, date of birth, and gender, is recorded. The medium to be read is, for example, an identity verification medium (identification document (identification card)) that is presented by the user during identity verification and can verify the identity of the user (prove the user's identity). The identity verification medium may be any type of identity verification medium, such as a driver's license, My Number card, passport, residence card, special permanent resident certificate, health insurance card, student ID, or qualification certificate. Furthermore, in this embodiment, it is assumed that the medium to be read is an IC card equipped with (embedded in) an IC chip. However, the medium to be read may not be equipped with an IC chip as long as it is a medium on which user information is recorded. The medium to be read may also be a card, document, or the like other than an identity verification medium. Furthermore, the medium to be read is not limited to being in card format, and may be a medium of a size different from that of a card. Furthermore, the medium to be read may be made of any material, such as plastic or paper. Furthermore, any user information may be recorded on the medium to be read. For example, the user information may include the four basic pieces of information, name, address, date of birth, and gender, a facial image, a number unique to the user (such as a driver's license number or passport number), and an expiration date related to the medium (such as a driving expiration date or passport expiration date). Furthermore, information other than user information may be recorded on the medium to be read.

[0027] As described above, the reading device 1 is a device capable of reading a medium. In this embodiment, the reading device 1 is exemplified by a card reader (IC card reader) that reads information recorded on a medium, such as an IC card equipped with an IC chip. The reading device (IC card reader) 1 includes a reading unit 11 that reads information from a medium, such as an IC reader 11A (including an IC reader / writer) that reads information recorded on an IC chip equipped on the medium. The IC reader 11A may be a contactless IC reader or a contact IC reader. Typically, in order for the IC reader 11A to read information recorded on the IC chip, it is necessary to obtain an access key for accessing the IC chip and enter the obtained access key to access the IC chip. Details of the access key will be described later. In addition to the IC reader 11A, the reading unit 11 in this embodiment also includes a medium photographing unit 11B that photographs (takes an image of) the surface of the medium (such as the front and back surfaces of the medium). The medium photographing unit 11B is exemplified by a camera, scanner, or the like that can photograph the medium. In the reading device 1, the medium photographing unit 11B captures an image of the surface of the medium (hereinafter referred to as the "medium surface"), and the CPU 13 then performs character recognition processing on this captured image, making it possible to read the characters contained in the captured image, i.e., the characters written on the medium surface (acquire character information).

[0028] The reading device 1 including the medium photographing unit 11B may be a device capable of simultaneously photographing both sides of a medium, or may be a device (single-sided reading device) capable of photographing only one side (e.g., one side) of a medium at a time. In the present embodiment, the reading unit 11 includes an IC reader 11A and a medium photographing unit 11B, but the reading unit 11 does not necessarily include the medium photographing unit 11B. The reading device 1 is not limited to an IC card reader, but may be a card reader without the function of reading information recorded on an IC chip (IC reader 11A). The reading device 1 is not limited to a card reader that reads information from a card-type medium, but may be any reading device other than a card reader. Therefore, the reading device 1 (reading unit 11) may be, for example, an imaging device (a device that photographs a medium and acquires an image) such as a scanner, a digital camera, or a camera sensor built into a smartphone / tablet. The reading device 1 may also include a magnetic reader as the reading unit 11.

[0029] Furthermore, in this embodiment, the reading device 1 is provided with a face camera 12 for photographing (taking an image of) the face of a user, and thus, for example, it is possible to photograph the face of a user standing in front of the reading device 1. This makes it possible for the reading device 1 to perform face authentication using a photograph (image) of the user's face. However, in the information processing system according to this embodiment, if processing using a photograph of the user's face, such as facial authentication, is not performed, the reading device 1 does not necessarily have to include the face camera 12 or the face photographing unit 35 described below.

[0030] 2 is a diagram showing an outline of the functional configuration of an information processing device (reading device) according to this embodiment. The reading device 1 is provided with an execution unit 21, a holding unit 22, a determination unit 23, and a discarding unit 24, as a result of a program recorded in a storage device 16 being read into a RAM 15 and executed by a CPU 13, which controls each piece of hardware provided in the reading device 1. In this embodiment, each function provided in the reading device 1 is executed by the CPU 13, which is a general-purpose processor, but some or all of these functions may be executed by one or more dedicated processors.

[0031] When a medium is presented to the reading unit 11, the execution unit 21 performs a procedure using the medium. The procedure using the medium has been described above, and therefore will not be described again. When a medium is presented, the execution unit 21 may perform only one predetermined type of procedure, or may perform multiple types of procedures. For example, when a medium is presented, multiple types of procedures (such as a resident registration certificate application and a seal registration certificate application) may be performed. In other words, when a medium is presented, the execution unit 21 performs at least one of one or multiple types of procedures that can be performed using the medium. The first and second procedures performed by the execution unit 21 are not limited to the same type of procedure, and may be different types of procedures (e.g., procedures with different purposes) as long as they use a medium. In this embodiment, the execution unit 21 includes a reading unit 31, a character recognition unit 32, a medium type acquisition unit 33, an access key acquisition unit 34, a face capture unit 35, and an identity verification unit 36.

[0032] The reading unit 31 performs a medium reading process using the reading unit 11. The reading unit 31 reads information recorded (including "written") on the medium to be read via the reading unit 11. In this embodiment, the medium reading process is executed as a process included in a procedure using the medium. In this embodiment, the reading unit 31 includes an IC reading unit 31A and a surface reading unit 31B.

[0033] The IC reading unit 31A accesses the IC chip mounted on the medium via the IC reader 11A and reads the information recorded on the IC chip. For example, if user information such as the user's name and address is recorded on the IC chip, the IC reading unit 31A reads this user information from the IC chip. The surface reading unit 31B photographs the medium surface via the medium photographing unit 11B and reads an image of the medium surface (hereinafter referred to as a "medium image").

[0034] The character recognition unit 32 recognizes characters included in the medium image acquired by the surface reading unit 31B. The character recognition unit 32 can recognize characters included in the medium image, i.e., characters written on the medium, for example, by performing OCR (Optical Character Recognition) processing on the medium image. In this way, the character recognition unit 32 can read user information such as the user's name and address written on the medium surface by performing character recognition processing on the medium image.

[0035] The medium type acquisition unit 33 acquires the medium type of the medium to be read. The medium type is the type (category) of the medium, and examples include a driver's license, My Number card, passport, residence card, special permanent resident certificate, health insurance card, student ID card, and qualification certificate. For example, when a user who presents the medium inputs (including "selects") the type of the presented medium via the input device 17, the medium type acquisition unit 33 acquires the medium type by accepting this input. However, the method of acquiring the medium type may be other than the method of accepting user input. For example, the medium type acquisition unit 33 may acquire the medium type from a free area (a data area that does not require the input of a PIN or the like) in an IC chip mounted on the medium. In this case, the medium type acquisition unit 33 may function as part of the IC reading unit 31A. Furthermore, for example, the medium type acquisition unit 33 may acquire the medium type by acquiring characters indicating the medium type (for example, characters such as "driver's license") written on the medium from the character recognition unit 32. In this case, the medium type acquisition unit 33 may function as part of the character recognition unit 32. Furthermore, for example, the medium type acquisition unit 33 may acquire (determine) the medium type by analyzing the arrangement of characters, images (including photographs), etc. written on the surface of the medium recognized by the character recognition unit 32.

[0036] The access key acquisition unit 34 acquires an access key for accessing the IC chip mounted on the medium. The access key is information (key) required to access the IC chip (data recorded on the IC chip), and examples thereof include a personal identification number (PIN) for a driver's license or My Number card, a verification number B for a My Number card, a residence card number for a residence card, a special permanent resident certificate number for a special permanent resident certificate, and part of information in the machine readable zone (MRZ) for a passport. As described above, the access key may be any information required to access the IC chip. For example, when a user who presents the medium inputs an access key via the input device 17, the access key acquisition unit 34 acquires the access key by accepting this input. However, the method of acquiring the access key may be a method other than accepting user input.

[0037] For example, the access key acquisition unit 34 may acquire an access key based on character information read by the character recognition unit 32. More specifically, the read character information (part of the read information) itself may be acquired as the access key, or the access key may be generated from the read character information and acquired. For example, in the case of a residence card or a special permanent resident certificate, the access key acquisition unit 34 may acquire the card number or certificate number, which is the access key, by acquiring the card number or certificate number read by the character recognition unit 32 from the character recognition unit 32. In this case, the access key acquisition unit 34 may function as a part of the character recognition unit 32. Also, in the case of a My Number card, for example, the access key acquisition unit 34 may acquire the date of birth (6 digits), the expiration date (year in the Gregorian calendar) (4 digits), and the security code (4 digits) read by the character recognition unit 32, and combine these three pieces of information to generate and acquire the verification number B, which is the access key.

[0038] The method for acquiring the access key may be determined according to the medium type of the medium presented to the reading device 1. For example, the method for acquiring the access key (whether to prompt the user to input the access key or to generate the access key based on information acquired from the medium) may be set in advance for each medium type (definition information may be stored in the storage device 16), and when the medium type of the presented medium is acquired by the medium type acquisition unit 33, the method for acquiring the access key for the presented medium may be determined by referring to the definition information based on the acquired medium type. Once the method for acquiring the access key is determined, processing according to that method (such as a process for prompting the user to input and then accepting the user input, or a process for photographing the medium and performing character recognition to generate an access key) is performed in the procedure.

[0039] The face capturing unit 35 captures a face image (face photo) of a user (user) using the face capturing camera 12. In this embodiment, when a user (operator of the reading device 1) stands in front of the reading device 1, the face capturing unit 35 captures the user's face via the face capturing camera 12. The timing at which the face image is captured by the face capturing unit 35 is not limited to when the user stands in front of the reading device 1, and may be any timing at which the user's face can be captured. Therefore, for example, the face image may be captured when the user stands in front of the reading device 1 and presents (inserts, holds, etc.) a medium to the reading device 1 (reading unit 11). When the face image is captured, the display unit (not shown) may display a message via the output device 18 indicating that the face image will be captured.

[0040] The identity verification unit 36 ​​performs identity verification determination processing. In the identity verification determination processing, for example, it is determined whether the user presenting the medium is the person who owns the medium. In this embodiment, the identity verification determination processing is performed based on the facial authentication result. Specifically, the identity verification unit 36 ​​performs facial authentication based on the user's facial image (hereinafter referred to as the "captured facial image") captured by the face capture unit 35 and facial information (facial image (hereinafter referred to as the "read facial image") or facial features) included in the user information obtained through the medium reading processing by the reading unit 31 (reading unit 11). For example, the identity verification unit 36 ​​may extract feature points from each of the captured facial image and the read facial image, compare the feature points, and determine that the facial authentication is successful if a predetermined number or more of the feature points match (if the facial features match), and determine that the facial authentication is unsuccessful if the predetermined number or more of the feature points do not match (if the facial features differ). If the face authentication is successful, the identity verification unit 36 ​​determines that the identity verification is successful, and if the face authentication is unsuccessful, the identity verification unit 36 ​​determines that the identity verification is unsuccessful. Note that the read face image may be a face image read from an IC chip or a face image read from the surface of a medium.

[0041] However, the method of identity verification is not limited to the above-described method, and various methods may be used. Therefore, for example, when the information read from the IC chip mounted on the medium is compared with the information written on the surface of the medium, if the two match (for example, if the user information such as the name matches), identity verification may be determined to be successful, and if the two do not match, identity verification may be determined to be unsuccessful. Identity verification may also be determined by combining the two methods described above. Specifically, identity verification may be determined based on whether face authentication is successful and whether the information read from the IC chip matches the information acquired from the surface of the medium (the two pieces of information match).

[0042] Furthermore, for example, identity verification may be determined by determining whether an IC chip mounted on the medium can be accessed using an access key input by the user via the input device 17. For example, identity verification may be determined as successful if the IC chip can be accessed using the input access key, and as unsuccessful if the IC chip cannot be accessed. Identity verification may also be determined as successful if the IC chip can be accessed using the access key input by the user and facial authentication is successful. Identity verification may also be determined by using fingerprint authentication, vein authentication, or the like. Other methods may be used to determine identity verification as unsuccessful if the layout of the surface of the medium obtained through the reading process is that of a driver's license but the medium does not have an IC chip (typically, a driver's license has an IC chip), if the medium type recorded on the IC chip mounted on the medium is a My Number Card but the surface layout of the medium is that of a driver's license, or if the age of the user read through the reading process is below a specified age.

[0043] The storage unit 22 stores information acquired during a procedure using a medium. In this embodiment, as described above, in order to illustrate a procedure including identity verification processing, the storage unit 22 stores information acquired during a procedure including identity verification processing using a medium. For example, if the medium is a medium equipped with an IC chip, the storage unit 22 stores an access key acquired by the access key acquisition unit 34 to access the IC chip of the medium during the procedure. Also, for example, the storage unit 22 stores information recorded on the medium obtained based on a medium reading process performed by the reading unit 31 during the procedure. The information recorded on the medium obtained based on the reading process is information read from the medium during the reading process and / or information obtained using the information read from the medium during the reading process. For example, the information read from the medium during the reading process is information read from the IC chip by the IC reading unit 31A, a medium image captured of the medium surface by the surface reading unit 31B, etc. Furthermore, for example, information obtained using information read from a medium by the reading process may be character information (characters written on the medium) obtained by performing character recognition processing on a medium image read by the surface reading unit 31B using the character recognition unit 32. Therefore, user information such as the four basic information may be stored as information recorded on the medium obtained based on the reading process. Furthermore, for example, the storage unit 22 stores identity verification information related to identity verification processing performed in the procedure. As identity verification information, for example, information used in identity verification judgment processing acquired in the procedure (a face image acquired by photographing a face, a face image recorded on a medium, a face authentication result, etc.) and the result of the identity verification judgment processing are stored. Furthermore, the storage unit 22 may store the medium type acquired by the medium type acquisition unit 33 in the procedure.

[0044] The information that may be retained during the procedure exemplified in this embodiment will be described using a case where the medium is a driver's license. First, assume that the IC chip embedded in the driver's license is accessed during the procedure. In this case, the retaining unit 22 may retain, for example, the access key (PIN1, PIN2) used (acquired) when the IC chip was accessed, the medium type, personal information such as the four basic information (name, address, date of birth, and gender) and a facial image acquired from the medium, a facial image acquired by photographing a face, a facial authentication result, and an identity verification determination result. In this case, the personal information may be acquired from the IC chip or from the surface of the medium. Next, assume that the IC chip embedded in the driver's license is not accessed during the procedure. In this case, the retaining unit 22 may retain, for example, the medium type, personal information such as the four basic information (name, address, date of birth, and gender) and a facial image acquired from the medium, a facial image acquired by photographing a face, a facial authentication result, and an identity verification determination result. In this case, the personal information is acquired from the surface of the medium. In addition, when post-processing is performed after identity verification in the procedure, the storage unit 22 can also store information acquired in this post-processing. For example, after identity verification is successful, if input (including selection input) by the user is accepted, such as selection of consent items such as whether or not to provide information, selection of whether or not to use the high-cost medical care system, and various selections for creating a form, the results of this input can be stored.

[0045] The access key may be retained only when access to the IC chip is successful.Facial authentication results may also be retained only when facial authentication is successful.Similarly, personal identification determination results may also be retained only when personal identification is successful.

[0046] The storage unit 22 also stores information acquired during a procedure at a predetermined timing. For example, information acquired during a procedure may be stored when information required for the procedure, such as information recorded on an IC chip, is acquired, when the identity verification process is completed, when the procedure is completed, when the medium is removed from the reading device 1 and the procedure (identity verification process) is interrupted (ended midway), or when the procedure (identity verification process) is interrupted by a user operation (e.g., a cancel operation). In this embodiment, information acquired during a procedure is stored when the procedure is interrupted or completed, etc., so the information stored by the storage unit 22 varies depending on the progress of the procedure. For example, if the procedure is interrupted before facial authentication is performed, the facial authentication result is not stored. However, if the procedure including the facial authentication process is successfully completed, information such as the facial authentication result and the identity verification determination result is stored. The storage unit 22 stores (temporarily stores) the information until the discarding process by the discarding unit 24, which will be described later, is performed.

[0047] When a medium is presented to the reading unit 11, the determination unit 23 performs an identity determination process using information stored in the storage unit 22 to determine whether the presented medium is the same as a previously presented medium. In this embodiment, the identity determination process determines whether the currently presented medium is the same as the previously presented medium. However, the medium to be determined as the currently presented medium is not limited to the previously presented medium, but may also be the medium presented two times before. Hereinafter, the previously presented medium and the currently presented medium will be referred to as the "first medium" and the "second medium," respectively, and the procedure using the first medium and the procedure using the second medium will be referred to as the "first procedure" and the "second procedure," respectively. In other words, it is assumed that the second procedure using the second medium will be performed after (next to) the first procedure using the first medium. In this case, when a second medium is presented to the reading unit 11 after a first procedure performed when a first medium is presented to the reading unit 11 is interrupted or completed, the judgment unit 23 makes an identity judgment as to whether the first medium and the second medium are the same.

[0048] As described above, the "(first) procedure" is not limited to a completed procedure, but may be an interrupted procedure. Furthermore, the "second procedure" is not limited to a procedure performed to restart a first procedure when the first procedure is interrupted, but may be the next procedure (additional procedure) performed by a user who performs multiple procedures after completing one of the procedures. For example, the first procedure may involve identity verification processing and a form generation processing for generating a first form (e.g., a resident registration application form), while the second procedure may involve identity verification processing and a form generation processing for generating a second form (e.g., a seal registration certificate application form) different from the first form. In this way, when a form generation processing is performed in a procedure, the reading device 1 may be equipped with a form format storage unit and a form generation unit (not shown). The following provides a detailed example of a method for determining identity.

[0049] The identity determination process uses information contained in the information acquired in the first procedure, that is, at least a part of the information acquired in the first procedure, which is stored in the storage unit 22. In this embodiment, the following two methods are exemplified as identity determination methods.

[0050] (1) Identification using access keys If the first medium and the second medium are media equipped with IC chips (e.g., IC cards), the determination unit 23 can determine whether the first medium and the second medium are identical using the access key stored in the storage unit 22 and acquired in the first procedure. More specifically, the determination unit 23 can determine whether the first medium and the second medium are identical based on whether the IC chip equipped on the second medium can be accessed using the access key acquired by the access key acquisition unit 34 in the first procedure. For example, the determination unit 23 causes the IC reading unit 31A to attempt to access the IC chip equipped on the second medium using the access key acquired in the first procedure, and acquires the result of the attempt. If the IC chip equipped on the second medium can be accessed using the access key, the determination unit 23 determines that the first medium and the second medium are identical. If the IC chip equipped on the second medium cannot be accessed using the access key, the determination unit 23 determines that the first medium and the second medium are different. Note that the determination unit 23 may also attempt to access the IC chip via the IC reader 11A.

[0051] Since IC reader 11A (IC reading unit 31A) can access the IC chip mounted on the medium from either the front or back side of the medium, when performing identity determination using an access key, the first medium and the second medium may be facing different sides to reading unit 11 (such as the side (orientation) over which the medium is held or the side (orientation) on which the medium is placed) than the second medium. In other words, when performing identity determination using the access key acquired in the first procedure, determination unit 23 can perform identity determination even if the orientation of the first medium when presented to reading unit 11 (IC reader 11A) is different from the orientation of the second medium when presented to reading unit 11 (IC reader 11A). In other words, the judgment unit 23 can make an identity judgment using the access key even if the side of the first medium facing the reading unit 11 (IC reader 11A) during the reading process of the first medium is different from the side of the second medium facing the reading unit 11 (IC reader 11A) during the reading process of the second medium (the front and back are different).

[0052] (2) Identification using information recorded on the media The determination unit 23 can perform an identity determination using information recorded on the first medium obtained through the reading process of the first medium and stored in the storage unit 22. More specifically, the determination unit 23 can determine whether the first medium and the second medium are the same based on whether the information recorded on the first medium obtained through the reading process of the first medium matches the information recorded on the second medium obtained through the reading process of the second medium. The determination unit 23 determines that the first medium and the second medium are the same if the information recorded on the first medium and the information recorded on the second medium are the same, and determines that the first medium and the second medium are different if the information recorded on the first medium and the information recorded on the second medium are not the same. For example, the determination unit 23 can determine that the first medium and the second medium are the same if the user information (e.g., name) read from the first medium and the second medium matches. The information to be compared to determine whether the first medium and the second medium are the same may be any information recorded on the medium obtained through the medium reading process. Therefore, the information to be compared to determine whether the first medium and the second medium are the same may be a name, an address, a unique number, a facial photograph, an image other than a facial photograph printed on the surface of the medium, or the like, and may not be user information. Furthermore, the information to be compared to determine whether the first medium and the second medium are the same is not limited to a single piece of information (e.g., name only) but may be multiple pieces of information (e.g., name and address). When multiple pieces of information are used to determine whether the first medium and the second medium are the same, it is possible to determine whether the first medium and the second medium are the same if all of these pieces of information match. Increasing the number of pieces of information to be compared in this way can enhance security, such as preventing the fraudulent use of personal information and preventing identity verification authentication from being breached. Furthermore, the information to be compared to determine whether the first medium and the second medium are identical (information recorded on the medium) may be information recorded on an IC chip or information written on the surface of the medium.

[0053] The determination unit 23 may perform the identity determination using both of the above methods (1) and (2). For example, it may first determine whether the second medium can be accessed using the access key acquired in the first procedure, and if access is possible, it may further determine whether the name recorded on the first medium matches the name recorded on the second medium, and if the names match, it may determine that the first medium and the second medium are the same. In this way, by combining multiple determinations, it is possible to prevent the fraudulent use of personal information and the breach of identity verification authentication, as in the above case, thereby enhancing security.

[0054] Note that the information held by the holding unit 22 may be discarded by the discarding unit 24 (described later). Therefore, the determination unit 23 determines whether the first medium and the second medium are the same only when the information acquired in the first procedure is held by the holding unit 22. As will be described in detail later, the discarding unit 24 discards the information held by the holding unit 22, for example, if the subsequent second procedure is not performed within a predetermined time from a predetermined timing related to the first procedure. That is, in this case, the determination unit 23 determines whether the first medium and the second medium are the same when a predetermined time condition is satisfied in relation to the predetermined timing related to the first procedure (for example, when a predetermined time has not elapsed since the predetermined timing). Furthermore, for example, if the discarding unit 24 determines that the medium type of the first medium and the medium type of the second medium are not the same before making the identity determination, it discards the information held by the holding unit 22. That is, when the medium type of the first medium and the medium type of the second medium are the same, the determination unit 23 determines whether the first medium and the second medium are the same.

[0055] As described above, when the determination unit 23 determines that the first medium and the second medium are the same, it can be assumed that the second procedure is a redo procedure due to an interruption of the first procedure, or a different procedure (such as identity verification processing in a different procedure) performed by the user who performed the first procedure after the first procedure was completed. Therefore, as will be described later, when the first medium and the second medium are the same, it is possible to omit processing already performed in the first procedure using the first medium in the second procedure. Note that the identity determination processing for determining whether the first medium and the second medium are the same may be performed before the second procedure or may be performed during the second procedure.

[0056] The discard unit 24 discards the information held by the holding unit 22 when a predetermined condition (discard condition) is met. According to the present disclosure, by holding information acquired in a procedure using a medium, when the same medium is inserted again, the information can be used to omit processing that overlaps with processing that has already been performed. Therefore, the discard unit 24 discards the held information when it is not appropriate to use the information acquired in a procedure using a medium in another procedure. In this embodiment, for example, the information held by the holding unit 22 is discarded when at least one of the following discard conditions 1 to 5 is met.

[0057] (Disposal condition 1: The next procedure is not carried out within the specified time from the specified timing of the procedure) Typically, when a procedure is interrupted and the same user performs the procedure again (restarts), it is assumed that the re-procedure will be performed shortly after the procedure is interrupted. Similarly, when a user who performs multiple procedures performs a next procedure (additional procedure) after completing one procedure, it is assumed that the next procedure will be performed shortly after the previous procedure is completed. Therefore, if the next procedure is not performed within a predetermined time from a procedure (first procedure), it can be assumed that the user who performed the first procedure (the user who presented the medium in the first procedure) will not perform a re-procedure or additional procedure. In other words, it can be assumed that after a predetermined time has passed from the procedure, a procedure will be performed by a user other than the user who performed the procedure. Therefore, in this embodiment, to prevent the unauthorized use of personal information, such as the retained information being used for another user's procedure, if the next procedure (second procedure) is not performed within a predetermined time from a predetermined timing related to the procedure (first procedure), the discarding unit 24 discards the information acquired in the first procedure stored by the retaining unit 22. Note that the "predetermined timing related to the procedure" is, for example, when the information acquired in the procedure is stored. In this case, if the next procedure is not performed within a predetermined time from when the information is stored by the storage unit 22, the information stored by the storage unit 22 is discarded. However, this "predetermined timing" may be set to any timing related to the procedure. Therefore, the "predetermined timing" may be, for example, when the information required for the procedure is obtained, when the procedure starts, when the procedure is interrupted, when the procedure is completed, etc. Furthermore, the "predetermined time" may be set to any time, such as between 10 and 15 seconds.

[0058] (Discard condition 2: The presented media is determined to be of a different media type) If the medium type of the first medium and the medium type of the second medium are different (not the same), the information recorded on the media may be different, and therefore it may not be appropriate to use the information acquired in the procedure using the first medium in the procedure using the second medium. Therefore, in this embodiment, before performing the identity determination process by the determination unit 23, it is determined whether the medium type of the first medium and the medium type of the second medium are the same, and if they are not the same, the information acquired in the first procedure is discarded.

[0059] (Disposal condition 3: No information is retained to determine whether the first medium and the second medium are the same.) If it is not possible to determine whether the first medium and the second medium are the same, it is not appropriate to use the information acquired in the procedure using the first medium in the procedure using the second medium. Therefore, in this embodiment, before the identity determination process is performed by the determination unit 23, it is determined whether the information stored by the storage unit 22 includes information for determining whether the first medium and the second medium are the same (for example, an access key for accessing the first medium), and if the information does not include the information, the information acquired in the first procedure is discarded.

[0060] (Discard condition 4: The remaining number of times that the IC chip can be accessed is less than a certain number of times.) Typically, an IC chip is set to a maximum number of access attempts (e.g., three attempts). In such cases, if the access key is entered incorrectly more than the maximum number of times, the medium (the IC chip mounted on the medium) is locked. As described above, it may be determined whether the first medium and the second medium are identical by determining whether the second medium can be accessed using the access key used to access the first medium. However, it is undesirable for the IC chip of the second medium to be locked due to failure to access the second medium. Therefore, in this embodiment, to prevent the IC chip from being locked due to the identity determination process using the access key, before the determination unit 23 performs the identity determination process, it is determined whether the remaining number of access attempts to the IC chip mounted on the second medium is a predetermined number (e.g., one attempt) or less. If the remaining number is less than the predetermined number, the information acquired in the first procedure is discarded. As a result, the access key used to access the first medium is also discarded, making it possible to prevent the second medium from being locked due to the access process using the access key. The remaining number of times the IC chip can be accessed is stored, for example, in a free area within the IC chip (a data area that does not require the input of a PIN number, etc.), so it is possible to refer to the remaining number of times read from this free area.

[0061] (Discard condition 5: The identity determination process determines that the items are not identical.) If the identity determination process by the determination unit 23 determines that the first medium and the second medium are not the same (for example, if IC access fails), it is assumed that the procedure is being performed by a different user than the previous procedure. Therefore, using information acquired in a procedure using the first medium in a procedure using the second medium would be inappropriate, as it would be the use of information belonging to another person. Therefore, in this embodiment, if the identity determination process is performed after the second medium is presented and it is determined that the first medium and the second medium are not the same, the information acquired in the first procedure is discarded.

[0062] Alternatively, the information stored in the storage unit 22 may be discarded when the reading device 1 is restarted, etc. In this way, by temporarily storing the information acquired during the procedure in the reading device 1 (and discarding it when a predetermined condition is met), it is possible to avoid the risk of leakage of user information such as personal information. Note that if the information stored in the storage unit 22 is not information for which processing can be omitted in the next procedure (second procedure), processing overlapping with processing performed in the first procedure to acquire the stored information does not need to be omitted in the second procedure. For example, if face authentication fails in the first procedure, even if the result of this face authentication (a result indicating failure) is stored, face authentication will be performed in the second procedure because face authentication was not successful in the first procedure. In other words, if a result indicating failure of face authentication is stored, face authentication processing will not be omitted in the second procedure.

[0063] When it is determined that the first medium and the second medium are the same, the execution unit 21 omits, in the second procedure using the second medium, processes that overlap with the processes performed in the first procedure (at least a part of the overlapping processes). More specifically, in the second procedure, the execution unit 21 omits processes that overlap with the processes performed in the first procedure to acquire the information stored in the storage unit 22 (at least a part of the overlapping processes). For example, when it is determined that the first medium and the second medium are the same because the second medium can be accessed using the access key acquired in the first procedure, the execution unit 21 can omit, in the second procedure, processes that overlap with the processes performed in the first procedure to acquire the access key (processing of acquiring the access key by the access key acquisition unit 34).

[0064] More specifically, because the second medium can be accessed using the access key obtained in the first procedure, it is possible to omit the steps of inputting the access key by the user (user operation), receiving the input in the reading device 1, and generating the access key based on information written on the medium in the second procedure. For example, in a case where the user inputs the access key, the process of inputting the access key by the user (the process of obtaining the access key from the user) can be omitted, which is expected to shorten the procedure by about one second. Note that in a case where input of two PINs is required, such as a driver's license, it is possible to omit inputting the access key twice, which is expected to shorten the procedure by about two seconds. Furthermore, in a case where the access key is generated based on information written on the medium, for example, the process of generating the access key (photographing the medium and character recognition processing) can be omitted, which is expected to shorten the procedure by about five seconds.

[0065] Furthermore, when it is determined that the first medium and the second medium are the same, the execution unit 21 can omit processes that overlap with the processes performed in the first procedure (at least a part of the overlapping processes) by using, in the second procedure, at least a part of the information acquired in the first procedure and stored in the storage unit 22. For example, assume that information (such as the four basic information) recorded on the first medium obtained based on the process of reading the first medium performed in the first procedure is stored in the storage unit 22. In this case, the execution unit 21 can omit, in the second procedure, processes that overlap with the processes performed in the first procedure to acquire the information recorded on the first medium (at least a part of the overlapping processes) by using the information recorded on the first medium stored in the storage unit 22. For example, if user information is acquired from an IC chip in the first procedure and the user information is stored in the storage unit 22, the execution unit 21 can use the stored user information in the second procedure. Therefore, the execution unit 21 can omit the process of acquiring user information from the IC chip in the second procedure. Furthermore, for example, in the first procedure, if the user information written on the face of the card is acquired by performing character recognition processing on the medium image after acquiring the medium image, and the user information is stored in the storage unit 22, the execution unit 21 can use this stored user information in the second procedure. Therefore, the execution unit 21 can omit the process of acquiring the medium image and the character recognition processing to acquire the user information in the second procedure. Note that, if the first medium and the second medium are determined to be the same using the access key and the user information is stored in the storage unit 22, the process of acquiring the access key and the process of acquiring the user information (photographing the face of the card, OCR processing, and reading information from the IC chip) can be omitted, which is expected to shorten the procedure by about 5 seconds.

[0066] Also, for example, assume that personal identification information (including information used in the personal identification determination process in the first procedure and / or the result of the personal identification determination process) is stored in the storage unit 22. The personal identification information includes, for example, a face image acquired by the face photographing unit 35, a face image acquired from a medium (an IC chip or a medium surface) by the reading unit 31 or the character recognition unit 32, a face authentication result, and a result of the personal identification determination process. In this case, the execution unit 21 can use the personal identification information stored in the storage unit 22 in the second procedure. Therefore, in the second procedure, the execution unit 21 can omit processes (at least a part of the overlapping processes) that overlap with processes performed in the first procedure to acquire the personal identification information stored in the storage unit 22. For example, if a face image captured by the face photographing unit 35 in the first procedure is stored, the face image can be used in the second procedure, thereby omitting the photographing process by the photographing unit 35. Furthermore, if a facial image acquired from the medium in the first procedure is stored, using this facial image makes it possible to omit the process of acquiring a facial image from the medium in the second procedure. Furthermore, if facial authentication and identity verification are performed in the first procedure, and the facial authentication and identity verification are successful and the facial authentication result and identity verification result are stored, using this result (a “success” result) makes it possible to omit the facial photography, facial authentication process, and identity verification process in the second procedure. Note that if the first medium and the second medium are determined to be the same using the access key and user information and facial authentication results are stored in the storage unit 22, the process of acquiring the access key, the process of acquiring user information, and facial authentication can be omitted, which is expected to shorten the procedure by approximately 10 seconds. Note that if a match determination result between the information on the IC chip and the medium surface is stored in addition to the facial authentication result, the match determination in addition to facial authentication can be omitted, which is expected to shorten the procedure by approximately 10 seconds.

[0067] Furthermore, in the first procedure, if the user performs a selection process regarding whether or not to provide information after identity verification and the selection result is stored, the process of accepting the user's selection regarding whether or not to provide information (including the process of instructing the user to make a selection) can be omitted in the second procedure by using the selection result. In other words, the user does not need to perform the selection process regarding whether or not to provide information again.

[0068] As described above, by omitting the processing in the second procedure by the execution unit 21, it is possible to shorten the time required for the procedure (for example, the time required for the identity verification process) compared to when the procedure is performed from the beginning. This also makes it possible to prevent the user from canceling the procedure midway because it takes a long time.

[0069] FIG. 3 is a flowchart showing an outline of the flow of identity verification processing (normal processing when accessing an IC chip) according to this embodiment. In this embodiment, "normal processing" refers to a procedure (identity verification processing, etc.) that is performed without using information (stored information) acquired in the previous procedure. The processing shown in this flowchart is started when it is determined in the processing shown in FIG. 6 described below that normal processing will proceed (when there is no stored information or when there is stored information but the information is not used). Furthermore, the flow shown in FIG. 3 shows, as an example, an example in which identity verification is performed based on the result of face authentication and whether or not the information on the IC chip matches the information on the medium surface.

[0070] In step S101, the medium type is acquired. For example, when a user presents a medium to the reading device 1 and selects the medium type of the presented medium (for example, by selecting "My Number Card" via the input device 17), the medium type acquisition unit 33 accepts this selection input and acquires the medium type of the presented medium. Thereafter, the process proceeds to steps S102 and S107. Note that the processes of steps S102 to S106 and steps S107 to S109 are performed in parallel.

[0071] In step S102, the medium (medium surface) is photographed. The surface reading unit 31B photographs the medium surface of the presented medium (for example, the face of a My Number card) to obtain a medium image (face image). Then, the process proceeds to step S103.

[0072] In step S103, character recognition processing is performed. The character recognition unit 32 performs character recognition processing (OCR processing) on ​​the medium image acquired in step S102. The character recognition unit 32 may perform character recognition processing on the medium image, or may perform character recognition processing on an image (cut-out image) cut out from the medium image for each item (such as name or date of birth) recorded on the medium. The portion of the medium (medium image) to be subjected to character recognition may be set in advance for each medium type (definition information stored in the storage device 16). In this case, the target of character recognition (items to be subjected to character recognition, their positions, etc.) may be determined by referring to the definition information based on the medium type acquired in step S101. In this embodiment, the processing of steps S102 and S103 is performed to acquire an access key for accessing an IC chip mounted on the presented medium. In other words, in step S103, only the information (character string) required to acquire the access key needs to be acquired as the character recognition result. For example, in the case of a My Number card, to obtain (generate) verification number B, which is an access key for accessing the IC chip of the My Number card, it is sufficient to obtain the date of birth (6 digits), expiration date (4 digits), and security code (4 digits). However, in step S103, character recognition processing may be performed so that information other than the information required to obtain the access key is also obtained as the character recognition result. For example, information other than the information required to obtain verification number B, such as name, address, and gender, may also be obtained as the character recognition result. Then, the process proceeds to step S104.

[0073] In step S104, an access key for accessing the IC chip is acquired. The access key acquisition unit 34 acquires an access key for accessing the presented medium based on the character recognition result acquired in step S103. For example, the access key is acquired by generating an access key using the character recognition result acquired in step S103. Note that how the access key is acquired (generated, etc.) may be set in advance for each medium type (definition information is stored in the storage device 16). In this case, the access key may be acquired (generated, etc.) by referring to this definition information based on the medium type acquired in step S101. Then, the process proceeds to step S105.

[0074] In step S105, the IC chip mounted on the medium is accessed. The IC reader 31A performs an access process to access the IC chip mounted on the presented medium using the access key acquired in step S104. In step S105, if the IC chip is accessed, the access key used at that time is temporarily stored in a temporary storage area. Then, the process proceeds to step S106.

[0075] In step S106, user information is acquired from the IC chip. If the IC chip can be accessed in step S105, the IC reading unit 31A acquires user information such as the four basic pieces of information from the IC chip. In addition to acquiring user information from the IC chip, the character recognition unit 32 may acquire user information from the medium surface. In step S106, the acquired user information is temporarily stored in a temporary storage area. Thereafter, the process proceeds to step S110.

[0076] In step S107, the face of the user is photographed. The face photographing unit 35 photographs the face of the user who presented the medium, thereby acquiring a facial image (photographed facial image) or facial features (feature amount) of the user who presented the medium. In step S107, the acquired photographed facial image or facial features are temporarily stored in a temporary storage area. Thereafter, the process proceeds to step S108.

[0077] In step S108, a facial image is acquired from the IC chip. The IC reading unit 31A acquires the facial image (read facial image) or facial features of the person recorded on the IC chip. In step S108, the acquired read facial image or facial features are temporarily stored in a temporary storage area. In addition, the processing of step S108 may be performed together with step S106. Thereafter, the processing proceeds to step S109.

[0078] In step S109, face authentication is performed. The personal identification unit 36 ​​performs face authentication based on the captured face image (or facial features) acquired in step S107 and the read face image (or facial features) acquired in step S108. Note that the face image to be matched (compared) with the captured face image may be a face image printed on the surface of the medium, rather than a face image recorded in the IC chip. In this case, in step S108, a face image is acquired from the surface of the medium. In addition, in step S109, the result of face authentication is temporarily stored in a temporary storage area. Thereafter, the process proceeds to step S110.

[0079] In step S110, a match determination is made between the information on the IC chip and the surface of the medium. For example, if the name recorded on the IC chip mounted on the presented medium and the name written on the surface of the presented medium are acquired in step S106, the personal identification unit 36 ​​determines whether these names match. Note that in step S110, the result of the match determination may be temporarily stored in a temporary storage area. Thereafter, the process proceeds to step S111.

[0080] In step S111, an identity verification determination is performed. The identity verification unit 36 ​​performs identity verification determination based on the result of the face authentication in step S109 and the result of the match determination in step S110. If face authentication is successful and the information on the IC chip and the medium surface match, it may be determined that identity verification has been successful. Note that in step S111, the result of identity verification determination is temporarily stored in a temporary storage area. At this time, the result of identity verification determination may be temporarily stored only if identity verification determination is successful. Thereafter, the process proceeds to step S112.

[0081] In step S112, the acquired information is temporarily stored. Upon completion of the identity verification process (identity verification determination process), the storage unit 22 stores the information temporarily stored in the temporary storage area (RAM 15, which is a volatile memory) in the processes up to step S111 in the storage area (RAM 15 or the storage device 16, which is a non-volatile memory) as temporarily stored data. Thereafter, the process shown in this flowchart ends. Note that even if the normal process shown in FIG. 3 is interrupted for some reason (for example, reasons (a) to (f) described above), the information temporarily stored up to the time of interruption is temporarily stored by the storage unit 22. For example, when a detection unit (not shown) detects that the procedure has been interrupted, the temporarily stored information is stored by the storage unit 22. In this embodiment, when the data (information) is stored by the storage unit 22 in this manner, the discarding unit 24 performs timer monitoring. The timer monitoring will be described in detail with reference to FIG. 5.

[0082] While FIG. 3 illustrates an example in which an access key is obtained based on information written on the surface of the medium, the access key may be obtained by receiving an input of the access key from the user. In this case, the access key may be obtained from the user in step S104. Furthermore, if the procedure does not use information written on the surface of the medium, such as when an access key is obtained from the user and user information is obtained only from the IC chip, or when the processing result of step S110 is not used for identity verification (when the processing of step S110 is not performed), the processes of step S102 (photographing the medium) and step S103 (character recognition) may not be executed. Furthermore, if the IC chip is only accessed but not read from the IC chip, in step S106, the user information is not read from the IC chip, but information is obtained from the surface of the medium by the character recognition unit 32. In this case, the user information may have already been obtained in step S103 instead of step S106.

[0083] Fig. 4 is a flowchart showing an outline of the flow of identity verification processing (normal processing when the IC chip is not accessed) according to this embodiment. The processing shown in this flowchart is started when it is determined to proceed to normal processing in the processing shown in Fig. 7, which will be described later. The flow shown in Fig. 4 also shows an example of identity verification determination based on the results of face authentication.

[0084] In step S201, the medium type is acquired. The processing in step S201 is roughly the same as the processing in step S101 in Fig. 3, so a description thereof will be omitted. Thereafter, the processing proceeds to steps S202 and S205. Note that the processing in steps S202 to S204 and the processing in steps S205 to S207 are performed in parallel.

[0085] In steps S202 and S203, the medium is photographed and character recognition processing is performed. The processing in steps S202 and S203 is roughly the same as the processing in steps S102 and S103 in Fig. 3, so a description thereof will be omitted. Thereafter, the processing proceeds to step S204.

[0086] In step S204, user information is acquired from the medium surface. By performing character recognition processing in step S203, the character recognition unit 32 acquires the user information from the medium surface. Note that in step S204, the acquired user information is temporarily stored in a temporary storage area. Thereafter, the process proceeds to step S208.

[0087] In steps S205 to S207, facial authentication is performed after photographing the person's face and acquiring a facial image from the medium surface. The processing of steps S205 to S207 is generally similar to the processing of steps S107 to S109 in Fig. 3 except for acquiring a facial image from the medium surface, so a description thereof will be omitted. Then, the processing proceeds to step S208.

[0088] In step S208, an identity verification determination is performed. The identity verification unit 36 ​​performs the identity verification determination based on the result of the face authentication in step S207. If the face authentication is successful, it may be determined that the identity verification is successful. Note that in step S208, the result of the identity verification determination may be temporarily stored in a temporary storage area. However, in the example of FIG. 4, the face authentication result becomes the identity verification determination result as it is, so the identity verification result does not need to be temporarily stored. Then, the process proceeds to step S209.

[0089] In step S209, the acquired information is temporarily stored. Upon completion of the identity verification process (identity verification determination process), the storage unit 22 stores the information temporarily stored in the temporary storage area in the process up to step S208 in the storage area as temporarily stored data. Thereafter, the process shown in this flowchart ends. As in FIG. 3, even if the normal process shown in FIG. 4 is interrupted for some reason, the information temporarily stored up to the time of interruption is temporarily stored by the storage unit 22. As described above, when the information is stored by the storage unit 22, the discarding unit 24 performs timer monitoring. If the procedure includes other processes (e.g., form generation process, etc.) that use user information in addition to the identity verification process, the user information acquired in FIGS. 3 and 4 may be used for the other processes (form generation process).

[0090] 5 is a flowchart showing an outline of the flow of the temporarily stored data monitoring process according to this embodiment. The process shown in this flowchart is started, for example, when information (data) is stored in the storage unit 22 of the reading device 1.

[0091] In step S301, it is determined whether the next procedure has been performed before a predetermined time has elapsed since the data was stored. The discarding unit 24 (which may be the determination unit 23) determines whether the next procedure has been performed before a predetermined time has elapsed since the information was stored by the storage unit 22. For example, if the discarding unit 24 detects that a medium has been presented within the predetermined time, the discarding unit 24 may determine that the next procedure has been performed within the predetermined time. Note that the process of detecting the presentation of a medium may also be interpreted as one process of the identity verification process. In this way, if a process related to a procedure (presenting a medium, reading the medium, etc.) has been performed within the predetermined time, the discarding unit 24 may determine that the next procedure has been performed before the predetermined time has elapsed. If it is determined that the next procedure has been performed before the predetermined time has elapsed (Yes in step S301), the process (timer monitoring) shown in this flowchart ends. For example, if the next medium is presented within a predetermined time after the information acquired in the previous procedure is held, the process proceeds to Yes in step S301 and the process shown in this flowchart ends, but then the process proceeds to the process in Figure 6 or 7, where it is determined that the presented medium is the same as the medium presented in the previous procedure.On the other hand, if it is determined that the next procedure was not performed before the predetermined time has elapsed (No in step S301), the process proceeds to step S302.

[0092] In step S302, the temporarily stored data is discarded (deleted). If the next procedure is not performed before a predetermined time has elapsed since the information was stored by the storage unit 22, it can be assumed that the same person will not perform a repeat procedure or an additional procedure. Therefore, the discarding unit 24 discards the information stored by the storage unit 22. Thereafter, the process (timer monitoring) shown in this flowchart ends.

[0093] The following describes the processing flow when identity determination processing is performed when performing a procedure (such as identity verification processing). Figure 6 shows an example of the flow of identity verification processing (including identity determination processing) when an IC chip mounted on a medium is accessed during the procedure. Figure 7 shows an example of the flow of identity verification processing (including identity determination processing) when an IC chip mounted on a medium is not accessed during the procedure or when an IC chip is not mounted on the medium. Whether or not to access the IC chip on the medium during the procedure may be set in advance. Whether or not to access the IC chip on the medium during the procedure may also be set individually for each type of medium.

[0094] FIG. 6 (FIGS. 6A to 6C) is a flowchart showing an outline of the flow of identity verification processing (when accessing an IC chip) when performing identity determination processing according to this embodiment. The processing shown in this flowchart is initiated when the reading unit 31 in the reading device 1 detects the user's presentation of a medium (insertion, placement, holding up, etc.). In the following description of FIG. 6, the medium that triggered the start of the flow of FIG. 6 (the medium currently presented) will be referred to as the "second medium," and the medium presented previously will be referred to as the "first medium." As with the case of FIG. 3, the flow shown in FIG. 6 illustrates an example of identity verification determination based on the results of face authentication and whether or not the information on the IC chip matches the information on the medium surface.

[0095] In step S401, the medium type is acquired. For example, if a user selects the medium type of a second medium when presenting the second medium to the reading device 1, the medium type acquisition unit 33 acquires the medium type of the presented second medium by accepting this selection input. Then, the process proceeds to step S402.

[0096] In step S402, it is determined whether or not there is temporarily held data. The determination unit 23 determines whether or not temporarily held data (information) is held by the holding unit 22. If no temporarily held data is held (No in step S402), the process proceeds to step S403. On the other hand, if temporarily held data is held (Yes in step S402), the process proceeds to step S404.

[0097] In step S403, the normal processing shown in Fig. 3 is performed. However, since the medium type has already been acquired in step S401, the processing in step S101 in Fig. 3 does not need to be performed when performing the normal processing.

[0098] In step S404, it is determined whether the medium types are the same. The determination unit 23 determines whether the medium type stored in the storage unit 22 (the medium type of the medium (first medium) used in the previous procedure) is the same as the medium type acquired in step S401. If the medium types are not the same (No in step S404), for example, when one medium type is a "My Number Card" and the other medium type is a "driver's license," the process proceeds to step S405. On the other hand, if the medium types are the same (Yes in step S404), such as when both medium types are "My Number Card," the process proceeds to step S406.

[0099] In step S405, the temporarily held data is discarded and normal processing is performed. The discarding unit 24 discards the temporarily held data held by the holding unit 22, and the normal processing shown in Fig. 3 is performed. However, since the medium type has already been acquired in step S401, the processing of step S101 in Fig. 3 does not need to be performed when normal processing is performed.

[0100] In step S406, it is determined whether the temporarily held data includes an access key. The determination unit 23 determines whether the information held by the holding unit 22 includes an access key. If the held information does not include an access key (No in step S406), the process proceeds to step S405. On the other hand, if the held information includes an access key (Yes in step S406), the process proceeds to step S407.

[0101] In step S407, it is determined whether the remaining number of times that the IC chip can be accessed is greater than one. When IC reading unit 31A reads the remaining number of times that the IC chip can be accessed from the free area in the IC chip mounted on the presented medium, determination unit 23 determines whether the read remaining number of times is greater than one. If the remaining number of times is not greater than one (No in step S407), the process proceeds to step S405. On the other hand, if the remaining number of times is greater than one (Yes in step S407), the process proceeds to step S408.

[0102] In step S408, an attempt is made to access the IC chip using the stored access key. The determination unit 23 instructs the IC reading unit 31A to attempt to access the IC chip mounted on the currently presented second medium using the access key stored in the storage unit 22. The determination unit 23 then obtains the result of the attempt to access the IC chip. Thereafter, the process proceeds to step S409.

[0103] In step S409, it is determined whether the IC chip was accessible. The determination unit 23 determines whether the IC chip of the second medium was accessible using the stored access key by referring to the result of the attempted access to the IC chip obtained in step S408. That is, in step S409, it is determined whether the previously presented medium (first medium) and the currently presented medium (second medium) are the same. If the IC chip was not accessible (No in step S409), the determination unit 23 determines that the previously presented medium (first medium) and the currently presented medium (second medium) are not the same, and the process proceeds to step S405. On the other hand, if the IC chip was accessible (Yes in step S409), the determination unit 23 determines that the previously presented medium (first medium) and the currently presented medium (second medium) are the same, and the process proceeds to step S410. In this way, if the IC chip of the currently presented medium can be accessed using the stored access key, it is possible to omit the process of accepting an access key from the user to access the IC chip of the second medium, and the process of generating an access key by photographing the medium and performing OCR processing. In other words, it is possible to omit the process of obtaining an access key (the process of step S104 in the normal process of FIG. 3) in the procedure using the currently presented medium (second medium). Note that if a method of generating an access key is used, the processes of steps S102 and S103 can also be omitted.

[0104] In the processing from step S410 onwards, processing is performed to acquire information required for the procedure that is missing (for example, information that was not acquired (stored) in the previous procedure). In step S410, it is determined whether or not the basic four information is stored. The execution unit 21 determines whether or not the basic four information is stored by the storage unit 22. Note that in step S410, it may also be determined whether or not user information other than the basic four information is stored. If the basic four information is not stored (No in step S410), the processing proceeds to step S411. On the other hand, if the basic four information is stored (Yes in step S410), the processing proceeds to step S412.

[0105] In step S411, the Basic 4 information is read. The IC reading unit 31A reads the Basic 4 information from the IC chip mounted on the second medium. Note that in step S411, the surface reading unit 31B and the character recognition unit 32 may read the Basic 4 information from the surface of the medium. Then, the process proceeds to step S412.

[0106] In step S412, the Basic 4 information is stored in the temporary storage area. If the Basic 4 information is stored in the storage area by the storage unit 22, this stored Basic 4 information is stored (read) from the storage area to the temporary storage area in step S412. In this way, since the personal 4 information is stored in the storage unit 22, the execution unit 21 can use the stored Basic 4 information in the personal identification process using the second medium and other processes (such as the form generation process). Furthermore, since the Basic 4 information is stored in the storage unit 22, the execution unit 21 can omit the process of acquiring the Basic 4 information from the medium in the personal identification process using the second medium and other processes. On the other hand, if the Basic 4 information is read in step S411, this read Basic 4 information is stored in the temporary storage area in step S412. Thereafter, the process proceeds to step S413.

[0107] In step S413, it is determined whether or not the identity verification determination result is held. The execution unit 21 determines whether or not the identity verification determination result is held by the holding unit 22. If the identity verification determination result is not held (No in step S413), the process proceeds to step S414. On the other hand, if the identity verification determination result is held (Yes in step S413), the process proceeds to step S425.

[0108] In step S414, it is determined whether or not the face authentication result is held. The execution unit 21 determines whether or not the face authentication result is held by the holding unit 22. If the face authentication result is not held (No in step S414), the process proceeds to step S415. On the other hand, if the face authentication result is held (Yes in step S414), the process proceeds to step S422.

[0109] In step S415, it is determined whether or not a read facial image is stored. The execution unit 21 determines whether or not a read facial image is stored by the storage unit 22. If a read facial image is not stored (No in step S415), the process proceeds to step S416. On the other hand, if a read facial image is stored (Yes in step S415), the process proceeds to step S417.

[0110] In step S416, a facial image is read. The IC reading unit 31A reads the facial image (or facial features) from the IC chip mounted on the second medium. Note that in step S416, the face reading unit 31B may read the facial image (or facial features) from the medium surface. Thereafter, the process proceeds to step S417.

[0111] In step S417, the read facial image is stored in a temporary storage area. If the read facial image (or facial features) is stored in the storage area by the storage unit 22, the stored read facial image is stored (read) from the storage area into the temporary storage area in step S417. Since the read facial image is stored in the storage unit 22 in this way, the execution unit 21 can use the stored read facial image in identity verification processing using the second medium and other processing (such as form generation processing). Furthermore, since the read facial image is stored in the storage unit 22, the execution unit 21 can omit the process of acquiring the read facial image from the medium in processing such as identity verification processing using the second medium. On the other hand, if a facial image is read from the medium in step S416, the read facial image (or facial features) is stored in the temporary storage area in step S417. Thereafter, the process proceeds to step S418.

[0112] In step S418, it is determined whether or not a photographed face image is stored. The execution unit 21 determines whether or not a photographed face image (or facial features) is stored in the storage unit 22. If a photographed face image is not stored (No in step S418), the process proceeds to step S419. On the other hand, if a photographed face image is stored (Yes in step S418), the process proceeds to step S420.

[0113] In step S419, the face of the user is photographed. The face photographing unit 35 photographs the face of the user who presented the medium, thereby acquiring a face image (photographed face image) or facial features of the user who presented the medium. Thereafter, the process proceeds to step S420.

[0114] In step S420, the photographed facial image is stored in a temporary storage area. If the photographed facial image (or facial features) is stored in the storage area by the storage unit 22, the stored photographed facial image is stored (read) from the storage area to the temporary storage area in step S420. Since the photographed facial image is stored in the storage unit 22 in this way, the execution unit 21 can use the stored photographed facial image (or facial features) in identity verification processing using the second medium and other processing (such as form generation processing). Furthermore, since the photographed facial image is stored in the storage unit 22, the execution unit 21 can omit face photography in processing such as identity verification processing using the second medium. On the other hand, if the face of the person is photographed in step S419, the photographed facial image (or facial features) obtained by photographing the face is stored in the temporary storage area in step S420. Thereafter, the process proceeds to step S421.

[0115] In step S421, face authentication is performed. The personal identification unit 36 ​​performs face authentication based on the read face image (or facial features) stored in step S417 and the captured face image (or facial features) stored in step S420. Thereafter, the process proceeds to step S422.

[0116] In step S422, the face authentication result is stored in the temporary storage area. If the face authentication result has been stored in the storage area by the storage unit 22, the stored face authentication result is stored (read) from the storage area to the temporary storage area in step S422. In this way, since the face authentication result has been stored in the storage unit 22, the execution unit 21 can use the stored face authentication result in identity verification processing using the second medium and other processing (such as form generation processing). Furthermore, since the face authentication result has been stored in the storage unit 22, the execution unit 21 can omit processing for acquiring the face authentication result (processing for acquiring a read face image from the medium, photographing the face of the person, and performing face authentication) in processing such as identity verification processing using the second medium. On the other hand, if face authentication has been performed in step S421, the face authentication result is stored in the temporary storage area in step S422. Thereafter, the process proceeds to step S423.

[0117] In step S423, a match determination is made between the information on the IC chip and the medium surface. For example, if the name recorded on the IC chip mounted on the second medium and the name written on the surface of the second medium are acquired in step S411, the personal identification unit 36 ​​determines whether these names match (are the same). Note that, if the storage unit 22 stores the name recorded on the IC chip mounted on the first medium and the name written on the surface of the first medium, step S423 may determine whether these names match (are the same). In step S423, the result of the match determination is temporarily stored in a temporary storage area. Note that, if the storage unit 22 stores the result of the match determination, the execution unit 21 can omit the processing of step S423. Thereafter, the processing proceeds to step S424.

[0118] In step S424, identity verification is performed. The identity verification unit 36 ​​performs identity verification based on the face authentication result stored in step S422 and the match determination result stored in step S423. Thereafter, the process proceeds to step S425.

[0119] In step S425, the identity verification determination result is stored in the temporary storage area. If the identity verification determination result has been stored in the storage area by the storage unit 22, the stored identity verification determination result is stored (read) from the storage area to the temporary storage area in step S425. Since the identity verification determination result has been stored in the storage unit 22 in this way, the execution unit 21 can use the stored identity verification determination result in identity verification processing using the second medium and other processing (such as form generation processing). Furthermore, since the identity verification determination result has been stored in the storage unit 22, the execution unit 21 can omit processing for acquiring the identity verification determination result in processing such as identity verification processing using the second medium (processing for acquiring a scanned facial image from the medium, photographing the person's face, facial authentication, determining whether information between the IC chip and the medium surface matches, and identity verification determination). On the other hand, if identity verification determination has been performed in step S424, the identity verification determination result is stored in the temporary storage area in step S425. Thereafter, the process proceeds to step S426.

[0120] In step S426, it is determined whether the identity verification has been successful. In step S426, the process branches based on the identity verification determination result stored in step S425. If the identity verification determination result is a failure (identity verification has failed) (No in step S426), the process proceeds to step S427. For example, if face authentication has failed or if a mismatch is determined in the determination of whether the information on the IC chip and the medium surface matches, the process proceeds to step S427. On the other hand, if the identity verification determination result is a success (identity verification has been successful) (Yes in step S426), the process shown in this flowchart ends.

[0121] In step S427, the temporarily held data is discarded and normal processing is performed. The discarding unit 24 discards the temporarily held data held by the holding unit 22, and the normal processing shown in Fig. 3 is performed. However, since the medium type has already been acquired in step S401, the processing of step S101 in Fig. 3 does not need to be performed when normal processing is performed. Thereafter, the processing shown in this flowchart ends.

[0122] The determination processes of steps S402, S404, S406, and S407 may be performed by the discarding unit 24, rather than the determination unit 23. When performing identity verification based only on the result of facial authentication, it may be determined in step S413 whether the identity verification result, i.e., the facial authentication result, is stored. In this case, the processes of steps S414 and S423 may not be performed, and if it is determined in step S413 that the identity verification result is not stored, the process may proceed to step S415. While FIG. 6 illustrates an example in which identity verification is performed based on whether the second medium is accessible using the stored access key (a case in which the above-described method (1) is used), a method that uses both the above-described methods (1) and (2) may be employed as a method for identity verification. When a method that uses both methods is employed, for example, in FIG. 6, it may be determined between steps S412 and S413 whether the information recorded on the first medium and the information recorded on the second medium match. Note that this determination is based on the premise that the information recorded on the first medium is stored by the storage unit 22 before the determination is made, and that information is also acquired from the second medium (the re-presented medium). For example, it is based on the premise that when the first medium is inserted, the name is acquired and stored from the first medium, and when the second medium is inserted, the name is also acquired from the second medium.

[0123] FIG. 7 (FIGS. 7A to 7C) is a flowchart showing an outline of the flow of identity verification processing (when the IC chip is not accessed) when performing identity determination processing according to this embodiment. The processing shown in this flowchart is initiated when the reading unit 31 in the reading device 1 detects the presentation of a medium by the user, for example. In the following explanation of FIG. 7, the medium that triggered the start of the flow of FIG. 7 (the medium presented this time) will be referred to as the "second medium," and the medium presented previously will be referred to as the "first medium." The flow shown in FIG. 7 illustrates an example in which identity verification is performed based on the results of facial authentication, as in the case of FIG. 4.

[0124] In steps S501 to S504, after the medium type is acquired, it is determined whether or not there is temporarily stored data. If there is no temporarily stored data, the process proceeds to the normal processing of Fig. 4. If there is temporarily stored data, it is determined whether or not the medium type is the same. Also, if it is determined in step S504 that the medium type is not the same, the process proceeds to step S505, where the temporarily stored data is discarded, and the process proceeds to the normal processing of Fig. 4. The processing of steps S501 to S505 is generally similar to the processing of steps S401 to S405 in Fig. 6, and therefore description thereof will be omitted. If it is determined in step S504 that the medium type is the same, the process proceeds to step S506.

[0125] In steps S506 and S507, the currently presented second medium is photographed and character recognition processing is performed on the medium image obtained by photographing the second medium. Note that the processing in steps S506 and S507 is generally similar to the processing in steps S202 and S203 in Fig. 4, and therefore a description thereof will be omitted. Thereafter, the processing proceeds to step S508.

[0126] In step S508, it is determined whether the read information matches the stored information. The determination unit 23 determines, for example, whether the name recorded on the first medium stored by the storage unit 22 matches the name recorded on the second medium acquired in step S507. Thus, the determination unit 23 determines whether the previously presented medium (first medium) and the currently presented medium (second medium) are the same. If the read information does not match the stored information (No in step S508), the determination unit 23 determines that the previously presented medium (first medium) and the currently presented medium (second medium) are not the same, and the process proceeds to step S509. On the other hand, if the read information matches the stored information (Yes in step S508), the determination unit 23 determines that the previously presented medium (first medium) and the currently presented medium (second medium) are the same, and the process proceeds to step S510.

[0127] In step S509, the normal processing shown in Fig. 4 is performed. However, since the medium type has already been acquired in step S501, when normal processing is performed, the processing of step S201 in Fig. 4 does not need to be performed. Also, since the medium has been photographed and character recognition processing has been performed in steps S506 and S507, when normal processing is performed, the processing of steps S202 and S203 in Fig. 4 does not need to be performed.

[0128] In steps S510 to S518, it is determined whether or not a facial authentication result is stored. If a facial authentication result is stored, the stored facial authentication result is stored (read) in a temporary storage area. If a facial authentication result is not stored, facial authentication is performed and the result is stored in the temporary storage area. Note that the processing in steps S510 to S518 is generally similar to the processing in steps S414 to S422 in FIG. 6, and therefore a description thereof will be omitted. However, in step S512, a facial image is read from the medium surface. Note that if a facial authentication result is stored in the storage unit 22 in step S510, the execution unit 21 can omit processing for acquiring the facial authentication result (processing for acquiring a read facial image from the medium, photographing the person's face, and performing facial authentication) in processing such as identity verification processing using a second medium. Furthermore, if the read face image is stored in the storage unit 22 in step S511, the execution unit 21 can omit the process of acquiring the read face image from the medium in processes such as identity verification using the second medium. Furthermore, if the captured face image is stored in the storage unit 22 in step S514, the execution unit 21 can omit face capture in processes such as identity verification using the second medium. Thereafter, the process proceeds to step S519.

[0129] In step S519, identity verification is performed. The identity verification unit 36 ​​performs identity verification based on the face authentication result stored in step S518. If face authentication is successful, it may be determined that identity verification has been successful. Note that in step S519, the result of identity verification may be temporarily stored in a temporary storage area. Thereafter, the process proceeds to step S520.

[0130] In step S520, it is determined whether the identity verification has been successful. If the identity verification determination result is a failure (identity verification has failed) (No in step S520), the process proceeds to step S521. On the other hand, if the identity verification determination result is a success (identity verification has been successful) (Yes in step S520), the process shown in this flowchart ends.

[0131] In step S521, the temporarily stored data is discarded and normal processing is performed. The discarding unit 24 discards the temporarily stored data stored by the storage unit 22, and the normal processing shown in FIG. 4 is performed. However, since the medium type has already been acquired in step S501, the processing of step S201 in FIG. 4 does not need to be performed when performing normal processing. Also, since the medium is photographed and character recognition processing is performed in steps S506 and S507, the processing of steps S202 and S203 in FIG. 4 does not need to be performed when performing normal processing. Thereafter, the processing shown in this flowchart ends. Note that in steps S506 and S507, only information used for the identity determination in step S508 may be acquired. In this case, if it is determined that the media are identical in step S508, by using the stored user information in the second procedure, it is possible to omit processing for acquiring information not used for identity determination from the medium (e.g., character recognition processing).

[0132] As described above, according to this embodiment, the information acquired in the first procedure and stored in the storage unit 22 is used to determine whether the first medium and the second medium are the same. If it is determined that they are the same, the second procedure omits processes that overlap with those performed in the first procedure, thereby shortening the time required for the procedure using the media. This improves user comfort. Furthermore, according to this embodiment, since it is possible to omit processes that overlap with those performed in the first procedure in the second procedure, when a procedure is interrupted and the procedure needs to be restarted, the procedure does not need to be restarted from the beginning. This also prevents the user from canceling the procedure (the user giving up midway) due to the time it takes to restart the procedure.

[0133] <Other embodiments> In the above-described embodiment, an information processing system including a reading device (information processing device) 1 has been exemplified, but the system according to this embodiment may be a system in which the information processing device is communicably connected to the reading device via a network or other communication means. In this embodiment, an implementation of a system including a reading device and an information processing device in a housing separate from the reading device will be described.

[0134] FIG. 8 is a schematic diagram showing the configuration of a system according to this embodiment. In this system, an information processing device 9 is communicatively connected to a reading device 1 via a network or other communication means. This embodiment describes a system in which a card reader (reading device 1) equipped with a reading unit 11 is connected to an information processing device 9 connected to the card reader via a wired or wireless connection, and implements the technology according to the present disclosure. The configuration of the reading device 1 according to this embodiment is generally similar to the configuration of the reading device 1 described with reference to FIG. 1 in the above embodiment, and therefore, a detailed description thereof will be considered. The information processing device 9 is a computer including a CPU (Central Processing Unit) 91, a ROM 92, a RAM 93, a storage device 94 such as an EEPROM or HDD, an input device 95, an output device 96, and a communication unit 97 such as a NIC. However, the specific hardware configuration of the information processing device 9 can be omitted, replaced, or added as appropriate depending on the embodiment. Furthermore, the information processing device 9 is not limited to a device consisting of a single housing, and may be realized by multiple devices using so-called cloud or distributed computing technology, etc. The information processing device 9 may be any device (computer), such as a tablet terminal, a desktop computer, a laptop computer, a smartphone, a mobile phone (feature phone), etc. The reading device 1 according to this embodiment has a function of transmitting various information, such as information read from a medium, to the information processing device 9 via a network.

[0135] The reading device 1 and the information processing device 9 according to this embodiment share the functional units of the reading device 1 described with reference to FIG. 2 . Therefore, each functional unit shown in FIG. 2 may be included in at least one of the reading device 1 and the information processing device 9. For example, the reading device 1 may include an execution unit 21 (a reading unit 31, a character recognition unit 32, a medium type acquisition unit 33, an access key acquisition unit 34, a face capture unit 35, and an identity verification unit 36), and the information processing device 9 may include a storage unit 22, a determination unit 23, and a discard unit 24. However, the functional units included in each of the reading device 1 and the information processing device 9 are not limited to this example. As long as the functional units shown in FIG. 2 are included in at least one of the reading device 1 and the information processing device 9, the sharing of the functional units shown in FIG. 2 (which functions each device is responsible for) may be arbitrary. Furthermore, the outline of the identity verification process according to this embodiment is roughly similar to the outline of the identity verification process described in the above-described embodiment, and therefore a description thereof will be omitted. As described above, some of the processes in the identity determination process and procedures (personal identification process, etc.) may be performed in the information processing device 9, which is a device other than the reading device 1 that reads information from a medium. [Explanation of symbols]

[0136] 1. Reading device (information processing device) 9. Information processing equipment

Claims

1. an execution means for performing at least one of one or more types of procedures that can be performed using a medium when the medium on which user information is recorded is presented to a reading unit capable of reading the medium; a storage means for storing information acquired in a procedure using the medium; a determination means for, when a second medium is presented to the reading unit after a first procedure using the first medium that was presented to the reading unit and was interrupted or completed, determining whether the first medium and the second medium are the same by using at least a part of the information acquired in the first procedure that is stored by the storage means; when it is determined that the first medium and the second medium are the same, the execution means omits, in a second procedure using the second medium, a process that overlaps with a process performed in the first procedure; Information processing system.

2. the storage means stores the information acquired in the procedure using the medium, including an access key acquired to access the IC chip of the medium in the procedure using the medium when the medium is equipped with an IC (Integrated Circuit) chip, and / or information recorded on the medium obtained based on a reading process of the medium by the reading unit performed in the procedure using the medium; the determining means performs the identity determination using the access key acquired in the first procedure and / or information recorded on the first medium obtained based on the reading process of the first medium, which are stored in the storing means; The information processing system according to claim 1 .

3. When the second medium is equipped with the IC chip, the determination means determines whether the first medium and the second medium are the same based on whether the IC chip equipped on the second medium can be accessed using the access key acquired in the stored first procedure, and / or whether information recorded on the first medium obtained based on the reading process of the stored first medium matches information recorded on the second medium obtained based on the reading process of the second medium by the reading unit performed in the second procedure. The information processing system according to claim 2 .

4. the determination means performs the identity determination when a predetermined time condition is satisfied in relation to a predetermined timing related to the first procedure and / or when the medium type of the first medium and the medium type of the second medium are the same. The information processing system according to claim 1 .

5. The information storage device further includes a discarding unit that discards the information stored by the storing unit when a predetermined condition is satisfied, the determining means performs the identity determination when the information acquired in the first procedure is stored by the storing means. The information processing system according to claim 1 .

6. The discarding means discards the information acquired in the first procedure that is held by the holding means in the following cases: if the next procedure is not performed within a predetermined time from a predetermined timing related to the first procedure; if it is determined that the medium type of the first medium and the medium type of the second medium are different from each other; if it is determined that the information acquired in the first procedure does not include information for determining whether the first medium and the second medium are the same; if it is determined that the remaining number of times that an IC (Integrated Circuit) chip mounted on the second medium can be accessed is equal to or less than a predetermined number; or if it is determined as a result of the identity determination that the first medium and the second medium are not the same. The information processing system according to claim 5 .

7. When it is determined that the first medium and the second medium are the same, the execution means omits, in the second procedure, a process that overlaps with a process that was performed in the first procedure for acquiring the information stored in the storage means. The information processing system according to claim 1 .

8. When the information recorded on the first medium, which is obtained based on the reading process of the first medium by the reading unit performed in the first procedure, is stored in the storage means, the execution means omits, in the second procedure, a process that overlaps with the process performed in the first procedure for acquiring the information recorded on the first medium. The information processing system according to claim 7 .

9. the medium is an identity verification medium on which the user information is recorded, The procedure includes an identity verification determination process for determining whether a user who presents the identity verification medium is the person who owns the identity verification medium; When the storage means stores personal identification information including information used in the personal identification determination process in the first procedure and / or a result of the personal identification determination process, the execution means omits, in the second procedure, a process that overlaps with a process performed in the first procedure for acquiring the personal identification information. The information processing system according to claim 7 .

10. the storage means stores the information acquired in the procedure using the medium, including an access key acquired to access an IC (Integrated Circuit) chip of the medium in the case where the medium is equipped with the IC chip; the determining means performs the identity determination using at least the access key acquired in the first procedure and stored in the storing means; when it is determined that the first medium and the second medium are the same using the access key obtained in the first procedure, the execution means omits, in the second procedure, a process that overlaps with a process performed in the first procedure for obtaining the access key. The information processing system according to claim 7 .

11. the storage means stores the information acquired in the procedure using the medium when the procedure using the medium is completed or when the procedure using the medium is interrupted. The information processing system according to claim 1 .

12. the access key stored in the storage means is the access key used when the IC chip mounted on the medium was accessed; The information processing system according to claim 2 .

13. The reading unit is further provided, the reading unit includes an IC reader that reads an IC (Integrated Circuit) chip mounted on the medium and / or a medium photographing means that reads a surface of the medium; The information processing system according to claim 1 .

14. the medium is an identity verification medium on which the user information is recorded, The procedure includes an identity verification determination process for determining whether or not a user who presents the identity verification medium is the person who owns the identity verification medium.

14. The information processing system according to claim 1, wherein the information processing system comprises: a first communication unit;

15. The execution means includes at least a face photographing means for photographing the face of the user who presents the medium; and an identity verification means for performing the identity verification determination process based on the face image of the user photographed by the face photographing means and face information included in the user information obtained based on the reading process of the medium by the reading unit performed in the procedure. The information processing system according to claim 14.

16. One or more computers an execution step of performing at least one of one or more types of procedures that can be performed using a medium when the medium on which user information is recorded is presented to a reading unit that can read the medium; a storage step for storing information acquired during a procedure using the medium; a determining step of determining whether the first medium and the second medium are identical using at least a part of the information acquired in the first procedure that is stored in the storing step, when a second medium is presented to the reading unit after a first procedure using the first medium that is presented to the reading unit and that is interrupted or completed; In the execution step, if it is determined that the first medium and the second medium are the same, in a second procedure using the second medium, a process that overlaps with a process performed in the first procedure is omitted. Information processing methods.

17. one or more computers, an execution means for performing at least one of one or more types of procedures that can be performed using a medium when the medium on which user information is recorded is presented to a reading unit capable of reading the medium; a storage means for storing information acquired in a procedure using the medium; and when a second medium is presented to the reading unit after a first procedure using the first medium that was presented to the reading unit and was then interrupted or completed, the device functions as a determination unit that determines whether the first medium and the second medium are identical, using at least a portion of the information acquired in the first procedure that is stored by the storage unit; when it is determined that the first medium and the second medium are the same, the execution means omits, in a second procedure using the second medium, a process that overlaps with a process performed in the first procedure; Information processing program.

Images