Identification information acquisition device, program and identification information acquisition method

The identity verification information acquisition device addresses inaccuracies in existing systems by assessing image quality and requesting re-takes, ensuring clear images are used for verification, thereby reducing errors and improving efficiency.

JP2024158896APending Publication Date: 2024-11-08CLOVER NETWORK COM CO LTD
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
JP2023074517
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-04-28
Publication Date
2024-11-08

AI Technical Summary

Technical Problem

Existing identity verification systems, such as those described in Patent Document 1, face issues with inaccurate identity verification due to unclear images of identification documents, leading to unnecessary re-takes and processing errors.

Method used

An identity verification information acquisition device that determines the quality of identification document images before processing, requesting re-takes if necessary, and extracts relevant information using OCR, while also capturing user appearance data for verification.

Benefits of technology

This approach reduces unnecessary identity verification processing by ensuring clear images are used, minimizing errors and reducing the need for repeated photography, thus enhancing the accuracy and efficiency of the verification process.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024158896000001_ABST
    Figure 2024158896000001_ABST
Patent Text Reader

Abstract

To suppress the occurrence of wasteful identification processing.SOLUTION: The present disclosure relates to an identification information acquisition device 10 that is connected to a user terminal 3 of a user and acquires one or more pieces of identification information for performing identification of the user from the user terminal 3. The device includes: a reception unit 111 that receives from the user terminal 3 identification document image data, which is image data of an identification document for the user, as identification information; a determination unit 13 that determines whether or not the identification document image data received by the reception unit 111 is an image that can be used for identification; and a transmission unit 112 that, when the determination unit 13 determines that the identification document image data is not an image that can be used for identification, transmits data including a re-imaging request allowing the user to recognize an error content to the user terminal 3.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present disclosure relates to an apparatus, a program, and a method for acquiring personal identification information. [Background technology]

[0002] When initiating a transaction such as opening a deposit account at a financial institution, etc., the applicant must verify his / her identity (hereinafter referred to as "identity verification").

[0003] In the past, applicants often went to financial institutions in person to apply at their counters. In this case, applicants fill out application forms with their applicant information (such as name, address, date of birth, etc.) and submit the application forms and a photo ID (such as a driver's license) to the financial institution's counter to apply for an account. The financial institution that receives the application compares the applicant's appearance with the photo attached to the ID, and further compares the applicant information on the application forms with the information on the ID (such as name, address, date of birth, etc.) to verify the applicant's identity.

[0004] However, the method of applicants themselves verifying their identity at a financial institution's counter and applying to open an account places a heavy burden in terms of time and physical resources on both the applicant and the financial institution. For this reason, in recent years, the method of verifying identity using eKYC (electronic Know Your Customer), which allows identity verification to be completed online, has become increasingly popular.

[0005] For example, Patent Document 1 discloses a credit card application processing system using a general eKYC. This credit card application system is configured such that a user terminal issues an application request to a server, and the server processes the request. An applicant (user) accesses the server using a user terminal and obtains an application form. The user takes an image of an identification document such as a driver's license, selects the image data on the application form, and transmits it to the server. The server uses the identification document image to verify that the user is the one who issued the application request. For example, the face photo on the driver's license and the user's face are photographed in the same image, and the server verifies that the request issuer is the user based on whether the two match. The server replies to the user terminal that the user's identity has been verified, and transmits a form for inputting personal information. The user inputs personal information, and the server uses the personal information to examine the new application. [Prior art documents] [Patent documents]

[0006] [Patent Document 1] JP 2022-116848 A Summary of the Invention [Problem to be solved by the invention]

[0007] In the credit card application processing system described in Patent Document 1, a user takes a picture of their identity document, such as a driver's license, and their appearance, and sends it to a server. The server performs a process (hereinafter referred to as an "identification process") of comparing the user's facial photo contained in an image of the identity document (hereinafter referred to as an "identification document image") with a photo of the user's appearance taken by the user, thereby confirming whether the applicant is the user himself / herself (whether the user is the person listed on the identity document). In this case, if the identity document image on which identity confirmation is based is unclear, the server cannot perform accurate identity confirmation, and returns an error to the user, requesting that the identity document image be taken again.

[0008] In this way, in the credit card application processing system described in Patent Document 1, errors in the identity verification document image (identification document image data) are recognized after the identity verification process, which may result in unnecessary identity verification processing based on the error image (identification document image data containing an error).

[0009] Therefore, an object of the present disclosure is to provide an apparatus, a program, and a method for acquiring personal identification information that can prevent the occurrence of unnecessary personal identification processing. [Means for solving the problem]

[0010] In order to solve the above problem, a first aspect of the present invention is an identity verification information acquisition device that is connected to a user terminal of a user and acquires one or more pieces of identity verification information from the user terminal for verifying the identity of the user, and includes a receiving unit that receives identity verification document image data, which is image data of the user's identity verification document, from the user terminal as the identity verification information, a determination unit that determines whether the identity verification document image data received by the receiving unit is an image that can be used for identity verification, and a transmitting unit that transmits data to the user terminal including a request for re-photographing that allows the content of the error to be recognized when the determination unit determines that the identity verification document image data is not an image that can be used for identity verification.

[0011] A second aspect of the present invention is the personal identification information acquisition device of the first aspect, wherein the judgment by the judgment unit is made based on at least one of whiteout, blackout, and blurring of the personal identification document image data.

[0012] A third aspect of the present invention is a personal identification information acquisition device of the first aspect or the second aspect, wherein the receiving unit receives appearance photograph data, which is photograph data of the user's appearance, from the user terminal as the personal identification information.

[0013] A fourth aspect of the present invention is a personal identification information acquisition device of the third aspect described above, comprising an identification document information extraction unit that extracts information contained in the identification document image data by OCR processing when the determination unit determines that the identification document image data is an image that can be used for personal identification, and the transmission unit transmits the identification document information extracted by the identification document information extraction unit to the user terminal, and the receiving unit receives from the user terminal the confirmed identification document information after confirmation, which has been confirmed and corrected or not corrected on the user terminal side, as the personal identification information.

[0014] A fifth aspect of the present invention is a personal identification information acquisition device of the fourth aspect described above, wherein the personal identification information acquisition device is connected to a verifier terminal that performs personal identification, and the transmission unit transmits the personal identification information received from the user terminal to the verifier terminal.

[0015] A sixth aspect of the present invention is a program for obtaining one or more pieces of identification information from a user terminal for identifying a user, which causes a computer to function as a receiving means for receiving identification document image data, which is image data of the user's identification document, from the user terminal as the identification information, a determining means for determining whether the identification document image data received by the receiving means is an image that can be used for identity verification, and a transmitting means for transmitting data to the user terminal including a request for re-photographing so that error content can be recognized when the determining means determines that the identification document image data is not an image that can be used for identity verification.

[0016] A seventh aspect of the present invention is a method for acquiring one or more pieces of identification information for identifying a user from a user terminal, the method including a receiving step of receiving identification document image data, which is image data of the user's identification document, from the user terminal as the identification information, a determining step of determining whether the identification document image data received in the receiving step is an image that can be used for identity verification, and a transmitting step of transmitting data to the user terminal including a request for re-photographing that allows the content of the error to be recognized if it is determined in the determining step that the identification document image data is not an image that can be used for identity verification. Effect of the Invention

[0017] According to the present disclosure, it is possible to prevent unnecessary identity verification processing from occurring. [Brief description of the drawings]

[0018] [Figure 1] 1 is a block diagram of a personal identification information acquisition system including a personal identification information acquisition device according to an embodiment of the present invention. [Diagram 2] 13 is a flowchart of a process executed by a personal identification information acquisition device. [Diagram 3] 13 is a flowchart mainly focusing on the user terminal. [Figure 4] FIG. 13 is an explanatory diagram of an account opening start screen. [Diagram 5] FIG. 13 is an explanatory diagram of an identification document selection screen. [Figure 6] FIG. 13 is an explanatory diagram of a screen for photographing an identification document. [Figure 7] FIG. 13 is an explanatory diagram of a display screen for a re-shooting message. [Figure 8] FIG. 13 is an explanatory diagram of a screen for photographing a user's appearance. [Figure 9] FIG. 13 is an explanatory diagram of an identification document information confirmation screen. [Figure 10] 1 is a sequence diagram showing a process flow of a personal identification information acquisition system. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0019] Hereinafter, a mode for carrying out the present invention (hereinafter, referred to as an embodiment) will be described in detail with reference to the accompanying drawings. Note that the same elements are given the same numbers or symbols throughout the description of the embodiment.

[0020] The identity verification information acquisition device according to the present disclosure is a device for acquiring one or more pieces of information (hereinafter referred to as "identity verification information") necessary for identity verification via a network. The identity verification information acquisition device is used by a verifier performing identity verification to acquire one or more pieces of identity verification information from a user side when the verifier performs identity verification of a user who is the party being verified online. For example, the identity verification information acquisition device is used by a verifier such as a credit card company or a bank performing identity verification to perform identity verification of a user who is attempting to open a credit card account or a bank account online. In other words, the user means a user who uses the services of the verifier. The verifier performs identity verification based on the identity verification information acquired from the user side via the identity verification information acquisition device. Note that the verifier is not limited to a credit card company or a bank, and the user is not limited to a person who is attempting to open a credit card account or a bank account.

[0021] FIG. 1 is a block diagram of a personal identification information acquisition system including a personal identification information acquisition device according to one embodiment of the present invention.

[0022] As shown in FIG. 1, the personal identification information acquisition system includes a personal identification information acquisition device 10, a verifier terminal 2 on the verifier side connected to the personal identification information acquisition device 10 via a network 1 (including the Internet and a local area network; the same applies below), and a user terminal 3 on the user side connected to the personal identification information acquisition device 10 via the network 1. That is, the personal identification information acquisition device 10 according to this embodiment is connected to the verifier terminal 2 and the user terminal 3 via the network 1. Note that, although FIG. 1 illustrates one verifier terminal 2 and one user terminal 3, this is not limiting, and the personal identification information acquisition device 10 may be connected to multiple verifier terminals 2 and may also be connected to multiple user terminals 3.

[0023] The personal identification information acquisition device 10 acquires personal identification information from the user terminal 3 through the network 1 (hereinafter simply referred to as "acquire"). After acquiring personal identification information from the user terminal 3, the personal identification information acquisition device 10 of this embodiment transmits the information to the verifier terminal 2 through the network 1 (hereinafter simply referred to as "transmit"). Note that in this embodiment, the personal identification information acquisition device 10 transmits the personal identification information acquired from the user terminal 3 to the verifier terminal 2, but this is not limited to this. For example, when the personal identification information acquisition device 10 is owned by the verifier or when the personal identification information acquisition device 10 and the verifier terminal 2 are integrated, the personal identification information acquisition device 10 may or may not transmit the personal identification information acquired from the user terminal 3 to the verifier terminal 2.

[0024] The identity verification information includes identity verification document image data, which is image data of the identity verification document of the user. In this embodiment, the identity verification information includes, in addition to the identity verification document image data, appearance photograph data, which is image data of the user's appearance, and identity verification document information. The identity verification document is preferably an official identification card with a face photograph (e.g., a driver's license or a My Number card). In this disclosure, "image data" means still image data. Furthermore, the user's appearance photograph data is not limited to image data, and may be video data including the user's face. Furthermore, the identity verification document information is personal information capable of identifying a specific individual, and includes name, address, date of birth, etc.

[0025] The verifier terminal 2 of this embodiment performs identity verification processing based on the identity verification information of the user received from the identity verification information acquisition device 10. For example, the verifier terminal 2 performs identity verification processing by comparing a face image included in the identity verification document image data with a face image included in the user's facial image photograph data using a general face recognition technology. Extraction of a face image from each data may be performed using a learning model that has been machine-learned in advance to output a face image in response to input of image data or video data. In this case, a face image is extracted by inputting image data or video data into the learning model. In addition to the above identity verification processing, the verifier terminal 2 may perform identity verification processing by comparing the identity verification document description information included in the identity verification document image data with the user's information input by the user. Note that the identity verification processing is not limited to processing by a computer (such as the verifier terminal 2), and for example, the verifier may perform identity verification processing visually based on the identity verification information of the user received from the identity verification information acquisition device 10.

[0026] (Confirmer's terminal) The verifier terminal 2 is configured, for example, by a personal computer, and is owned by a verifier (for example, a company such as a credit card company or a bank). The verifier terminal 2 includes a communication unit 21, a storage unit 22, a display unit 23, an input unit 24, a control unit 25, etc. Note that the verifier terminal 2 is not limited to the above configuration, and may include other configurations.

[0027] The communication unit 21 executes communication with the outside via the network 1 .

[0028] The storage unit 22 is configured with, for example, a hard disk, a memory, etc., and stores various data (including programs).

[0029] The display unit 23 is configured by, for example, a display device, and is capable of displaying various information.

[0030] The input unit 24 is configured with a mouse, a keyboard, etc., and accepts input of predetermined information.

[0031] The control unit 25 is configured with a CPU (Central Processing Unit), a memory, etc., and controls the entire terminal (verifier terminal 2) by executing a predetermined program.

[0032] (User terminal) The user terminal 3 is, for example, a smartphone, a tablet terminal, a personal computer, or the like, and is owned by a user. The user terminal 3 includes a communication unit 31, a storage unit 32, a display unit 33, a photographing unit 36, an input unit 34, a control unit 35, and the like. Note that the user terminal 3 is not limited to the above configuration, and may include other configurations.

[0033] The photographing unit 36 ​​is composed of an outer camera and an inner camera, and is capable of taking photographs (still images) and videos.

[0034] In addition, the configurations of the communication unit 31, memory unit 32, display unit 33, input unit 34, and control unit 35 of the user terminal 3 are approximately the same as the communication unit 21, memory unit 22, display unit 23, input unit 24, and control unit 25 of the verifying terminal 2, so their explanations are omitted.

[0035] (Personal Identification Information Acquisition Device) The personal identification information acquisition device 10 is a device for acquiring one or more pieces of personal identification information from the user terminal 3, and includes a communication unit 11, a storage unit 12, and a judgment unit 13. The personal identification information acquisition device 10 of this embodiment further includes a personal identification document description information extraction unit 14 in addition to the communication unit 11, the storage unit 12, and the judgment unit 13. The personal identification information acquisition device 10 includes a CPU (not shown), and the CPU functions as the judgment unit 13 and the personal identification document description information extraction unit 14 by executing various programs. Note that a part of the function of the CPU may be extracted and the extracted function may be provided in another information processing device, and each process may be executed using a plurality of information processing devices. In addition, the personal identification information acquisition device 10 may be owned by a third party (for example, a person who provides a personal identification information acquisition service) different from both the verifyer and the user, or may be owned by the verifyer.

[0036] The communication unit 11 includes a receiving unit 111 and a transmitting unit 112, and executes communication with external devices (the verifying terminal 2 and the user terminal 3 in this embodiment) via the network 1.

[0037] The receiving unit 111 has a function of receiving various data from external devices via the network 1, and receives the user's identification document image data as identification information from the user terminal 3. In this embodiment, the receiving unit 111 receives the user's facial image capture data and confirmed identification document information (described later) from the user terminal 3 as one piece of identification information, in addition to the identification document image data.

[0038] The storage unit 12 is configured with, for example, a hard disk or a memory, and stores the identification document image data received by the receiving unit 111 from the user terminal 3. In this embodiment, the storage unit 12 stores the user's facial image data received from the user terminal 3, the identification document description information extracted from the identification document image data, and the confirmed identification document description information received from the user terminal 3, which will be described later.

[0039] The determination unit 13 determines whether the identification document image data stored in the storage unit 12 is an image usable for identity verification without performing identity verification. The term "image usable for identity verification" refers to an image that is suitable for identity verification processing performed by the verifying person (verifier terminal 2) and that can be used to determine whether a face image (face photo) included in the identification document image data is the face of the same person by comparing it with other clear face photos. The criteria for determining whether an image is usable for identity verification may vary depending on the contents of the identity verification processing performed by the verifying person (verifier terminal 2). In addition, "determining without performing identity verification" does not mean determining whether an image is usable for identity verification based on the result of the identity verification processing (the above-mentioned comparison processing), but means determining whether an image is usable for identity verification at the stage of acquiring the identification document image data before performing the identity verification processing. The above-mentioned determination by the determination unit 13 is preferably performed based on at least one of whiteout, blackout, and blurriness of the identification document image data.

[0040] The term "overexposed" refers to a phenomenon in which too much light hits the surface of a subject when photographing the subject, causing a part or all of the area in the photographed image to be painted white, or the image to become so whitish that it is difficult to distinguish differences in brightness. The term "underexposed" refers to a phenomenon in which too little light hits the surface of a subject when photographing the subject, causing a part or all of the area in the photographed image to be painted black, or the image to become so black that it is difficult to distinguish differences in brightness. The term "unclear" refers to a state in which the subject in the photographed image is blurred, for example, because the subject is not in focus when photographing the subject ("out of focus"), or because the hand holding the camera moves when photographing the subject ("camera shake" occurs).

[0041] As a method of making the above judgment based on whiteout or blackout, for example, a method of binarizing the identification document image data using a predetermined threshold and comparing the brightness of a pixel at a predetermined position of the binarized identification document image data (for example, a position where the identification number of a driver's license is written) with a preset threshold is exemplified. If the brightness of the pixel at the predetermined position is equal to or higher than an upper threshold, it may be determined that an error has occurred because of whiteout caused by reflection, and if the brightness of the pixel at the predetermined position is equal to or lower than a lower threshold, it may be determined that an error has occurred because of blackout. Note that the method of making the above judgment based on whiteout or blackout is not limited to the above, and various methods commonly used for detecting highlights in an image may be used.

[0042] A method of making the above judgment based on blur (out of focus or camera shake) includes a method of calculating an evaluation value for blur from pixel values ​​of the captured image and comparing the evaluation value with a preset threshold value. If the evaluation value is lower than the threshold value, the image may be deemed to be blurred (out of focus or camera shake has occurred) and an error may be determined. Note that the method of making the above judgment based on blur is not limited to the above, and various methods that are generally used to detect out of focus or camera shake in an image may be used.

[0043] When the determination unit 13 determines that the image data of the identification document is an image that can be used for identity verification, the identification document description information extraction unit 14 extracts the identification document description information included in the image data of the identification document as character data by OCR (Optical Character Recognition) processing. The identification document description information extracted by the identification document description information extraction unit 14 is stored in the storage unit 12.

[0044] The transmission unit 112 has a function of transmitting data to an external device via the network 1. When the determination unit 13 determines that the identification document image data is not an image that can be used for identity verification, the transmission unit 112 transmits data including a re-photographing request that allows the content of the error to be recognized (hereinafter referred to as "re-photographing request data") to the user terminal 3. The re-photographing request data is data for displaying a re-photographing request for requesting the user side to re-photograph the identification document on the display unit 33 of the user terminal 3 in a manner that allows the content of the error to be clearly recognized as being either blown out highlights, crushed shadows, or unclear (the subject is blurred).

[0045] Examples of messages to request re-photographing that allow the user to recognize that the error is overexposed or underexposed include messages such as "Ambient light is reflecting off the identification document. Avoid taking the photo in places with a lot of light reflection (directly under a light). Also, if you are using a flashlight, turn it off before taking the photo," and "The identification document is dark and unclear, so please take the photo in a brighter place." In this case, advice such as "If you tilt the surface to be photographed at an angle that does not reflect light, it will be suitable for photography, but in that case, be careful not to tilt it too much" may be added.

[0046] Examples of messages to request re-photographing that allow the user to recognize that the error is blurry include messages such as "The identification document is not in focus. Please focus on the identification document on the screen and take the photo," and "There is camera shake. Please try not to move your hands when taking the photo." In this case, advice such as "The background may be in focus, so please place the photo on a desk or something similar and take the photo," or "Wipe off any dirt on the lens before taking the photo" may be added.

[0047] Furthermore, the transmission unit 112 of this embodiment transmits the information written on the identification document extracted by the information written on the identification document extraction unit 14 and stored in the memory unit 12 to the user terminal 3. For example, the transmission unit 112 may transmit the information written on the identification document to the user terminal 3 in a form in which the information written on the identification document is displayed in advance in a correctable state in a text box b (an input field for inputting information written on the identification document; see FIG. 10) displayed on the display unit 33 of the user terminal 3. Furthermore, the transmission unit 112 of this embodiment transmits the identification document image data stored in the memory unit 12, the user's facial image photograph data, and the confirmed information written on the identification document, which will be described later, to the verifyer terminal 2.

[0048] Next, a description will be given of the process executed by the personal identification information acquisition device 10. Fig. 2 is a flowchart of the process executed by the personal identification information acquisition device.

[0049] As shown in FIG. 2, when the personal identification information acquisition device 10 is accessed by the user terminal 3, it requests the photographing unit 36 ​​of the user terminal 3 to photograph the personal identification document (step S11). One example of photographing the personal identification document is photographing three still images of the front, back, and thickness of the personal identification document. In this embodiment, it first requests the front of the personal identification document to be photographed (step S11). The still image of the personal identification document photographed here becomes personal identification document image data.

[0050] Next, the receiving unit 111 of the personal identification information acquisition device 10 receives (acquires) the personal identification document image data photographed in step S11 from the user terminal 3, and stores it in the storage unit 12 (step S12).

[0051] Next, the determination unit 13 of the personal identification information acquisition device 10 determines whether the personal identification document image data stored in the storage unit 12 is an image usable for personal identification (step S13). If the determination unit 13 determines that the personal identification document image data is not an image usable for personal identification (step S13: NO), the process returns to step S11, and the transmission unit 112 transmits re-photographing request data that allows the error content to be recognized to the user terminal 3, requesting a re-photograph of the personal identification document. Then, steps S11 to S13 are repeatedly executed until the determination unit 13 determines in step S13 that the personal identification document image data is an image usable for personal identification.

[0052] In step S13, if the determination unit 13 determines that the identification document image data of the front side of the identification document is an image that can be used for identity verification (step S13: YES), the identification document image data of the back side of the identification document, the identification document image data of the side of the identification document, and the user's facial image data are acquired from the user terminal 3 (step S14). The identification document image data of the back side of the identification document is preferably acquired from the user terminal 3 by the same process as steps S11 to S13. The identification document image data of the side of the identification document is preferably captured so that the thickness of the identification document can be known, and can be acquired by the same process as steps S11 and S12. The user's facial image data may be a still image of the face captured from the front, or may be a plurality of still images of the face captured from multiple directions (front, diagonally forward to the left and right, diagonally forward to the top and bottom, etc.), and can be acquired by the same process as steps S11 and S12. Alternatively, the user's facial image capture data may be video data of the face, in which case the personal identification information acquisition device 10 may extract a facial image from the video data of the face using a known face extraction technique.

[0053] In this embodiment, after the determination unit 13 determines that the identification document image data of the front side of the identification document is an image that can be used for identity verification, the identification document image data of the back side and side of the identification document and the facial image data of the user are acquired, but this is not limited to this. For example, before the determination unit 13 makes a determination, all the identification document image data and facial image data may be acquired, and then the determination unit 13 may make a determination on the identification document image data of the front side and back side of the identification document.

[0054] Next, the identification document information extraction unit 14 of the identification information acquisition device 10 extracts the identification document information contained in the identification document image data of the front and back of the identification document as character data by OCR processing, and stores it in the memory unit 12 (step S15).

[0055] Next, the transmission unit 112 of the personal identification information acquisition device 10 transmits the information written on the personal identification document stored in the memory unit 12 in step S15 to the user terminal 3 (step S16). Specifically, the transmission unit 112 transmits data for displaying the information written on the personal identification document on the display unit 33 of the user terminal 3 to the user terminal 3. In this embodiment, the transmission unit 112 transmits data to the user terminal 3 for displaying the information written on the personal identification document stored in the memory unit 12 in step S15 in a text box b (see FIG. 10) for inputting information written on the personal identification document displayed on the display unit 33 of the user terminal 3.

[0056] Next, the receiving unit 111 of the personal identification information acquisition device 10 receives the information written on the personal identification document input in the text box b on the display unit 33 of the user terminal 3 (step S17). The information written on the personal identification document is information written on the personal identification document that has been corrected because the information written on the personal identification document transmitted in step S16 was confirmed by the user terminal 3 and found to be incorrect, or information written on the personal identification document that has not been corrected because the information was confirmed by the user terminal 3 and found to be correct. In other words, the information written on the personal identification document received by the receiving unit 111 in step S17 is correct information written on the personal identification document whose success or failure has been confirmed by the user (hereinafter referred to as "confirmed information written on the personal identification document"). The confirmed information written on the personal identification document is stored in the memory unit 12.

[0057] Next, the transmitting unit 112 of the personal identification information acquisition device 10 transmits the personal identification document image data, the user's facial image data, and the verified personal identification document information stored in the memory unit 12 to the verifier terminal 2 (step S18). The transmission of these data in step S18 may be actively transmitted from the personal identification information acquisition device 10 to the verifier terminal 2, or may be passively transmitted (for example, by downloading) to the verifier terminal 2 after receiving a transmission request from the verifier terminal 2.

[0058] Next, an example of processing on the user terminal 3 side when using the personal identification information acquisition device 10 according to this embodiment will be described.

[0059] FIG. 3 is a flow chart mainly focusing on the user terminal. FIG. 4 is an explanatory diagram of the screen for starting to open an account. FIG. 5 is an explanatory diagram of the screen for selecting an identification document. FIG. 6 is an explanatory diagram of the screen for photographing an identification document. FIG. 7 is an explanatory diagram of the screen for displaying a message for re-photographing. FIG. 8 is an explanatory diagram of the screen for photographing the user's appearance. FIG. 9 is an explanatory diagram of the screen for confirming information written on an identification document. Note that the processing within the two-dot chain line in FIG. 3 (steps S23 to S28) is processing executed by the identification information acquisition device 10. Also, the displays of the display unit 33 of the user terminal 3 in FIG. 4 to FIG. 9 are merely examples, and are not limited to these.

[0060] First, when a user applies for opening a bank account using the user terminal 3, various instructions regarding obtaining identification documents (including a request to take a photo) are displayed on the display unit 33 (mobile terminal screen) of the user terminal 3 (step S21).

[0061] For example, as shown in Fig. 4, various explanations M1 regarding obtaining identification documents, an "account opening application button" B1, etc. are displayed on the display unit 33 of the user terminal 3. When the "account opening application button" B1 is tapped, as shown in Fig. 5, a message M1 encouraging the user to photograph an identification document, multiple identification document selection buttons B2 for selecting an identification document to photograph, etc. are displayed on the display unit 33 of the user terminal 3. When the user taps the identification document selection button B2 (see Fig. 5) displayed on the display unit 33 of the user terminal 3, the photographing unit 36 ​​(camera) of the user terminal 3 is activated.

[0062] In accordance with the photographing request displayed on the display unit 33 of the user terminal 3, the user photographs the front of the identification document (front side of the driver's license) using the photographing unit 36 ​​(camera) of the user terminal 3 and uploads it to the identification information acquisition device 10 (server) (step S22).

[0063] 6, the front of the driver's license is photographed by aligning the outer frame of the driver's license within the frame displayed on the display unit 33 of the user terminal 3. When the front of the driver's license is photographed, the communication unit 31 of the user terminal 3 uploads (transmits) the photographed identification document image data to the identification information acquisition device 10 automatically after photographing or in response to a user operation.

[0064] The identification document image data uploaded from the user terminal 3 to the identification information acquisition device 10 is subjected to a blurring (out-of-focus) judgment by the judgment unit 13 of the identification information acquisition device 10 (step S23). If the judgment by the judgment unit 13 is an error judgment (judgment that the image is blurred and not usable for identification) (step S24: YES), re-photographing request data including a message that allows the content of the error to be recognized ("document is out of focus" in FIG. 3) is transmitted from the identification information acquisition device 10 to the user terminal 3 (step S25). The display unit 33 of the user terminal 3 that has received the re-photographing request data displays the above message that allows the content of the error to be recognized. The user repeats steps S22 to S25 until no error judgment is made in step S24 (until step S24: NO).

[0065] If no error is determined in step S24 (step S24: NO), the determination unit 13 determines whether the identification document image data is overexposed or underexposed (highlight determination) (step S26). If the determination unit 13 determines that the image is an error (that is, overexposed or underexposed, and the image is not usable for identification) (step S27: YES), re-photographing request data including a message that allows the user to recognize the error content (in FIG. 3, "ambient light is reflected on the document") is transmitted from the identification information acquisition device 10 to the user terminal 3 (step S28). The display unit 33 of the user terminal 3 that has received the re-photographing request data displays the message that allows the user to recognize the error content. For example, as shown in FIG. 7, the display unit 33 of the user terminal 3 displays a message M3 that allows the user to recognize the error content and a re-photograph button B3. The user repeats steps S22 to S28 until no error is determined in step S27 (until step S24: NO).

[0066] If no error is determined in step S27 (step S27: NO), the user uses the photographing unit 36 ​​of the user terminal 3 to photograph the side of the identification document (the thickness of the driver's license) in accordance with the photographing request displayed on the display unit 33 of the user terminal 3, and uploads the photograph to the identification information acquisition device 10 (step S29).

[0067] Next, the user follows the image capture request displayed on the display unit 33 of the user terminal 3 to capture an image of the back side of the identification document (back side of the driver's license) using the image capture unit 36 ​​of the user terminal 3, and uploads the image to the identification information acquisition device 10 (step S30). When capturing an image of the back side of the identification document, the determination unit 13 continues to determine whether the image is unclear, has whiteout, or is blackout, as in the case of capturing an image of the front side of the identification document described above, until no error determination is made.

[0068] Next, the user photographs the user's appearance using the photographing unit 36 ​​of the user terminal 3 according to the photographing request displayed on the display unit 33 of the user terminal 3, and uploads the photographs to the personal identification information acquisition device 10 (step S31). Furthermore, the user changes the direction of the face according to the photographing request displayed on the display unit 33 of the user terminal 3, photographs the user's appearance from different directions using the photographing unit 36 ​​of the user terminal 3, and uploads the photographs to the personal identification information acquisition device 10 (step S32). For example, as shown in FIG. 8, the user moves the face or the user terminal 3 to photograph the user's appearance from multiple directions. Note that the dashed-dotted arrows in FIG. 8 represent the movement of the face up, down, left and right during photographing.

[0069] Next, the user inputs the information written on the identification document and uploads it to the identification information acquisition device 10 (step S33). For example, as shown in FIG. 9, a text box b for inputting the information written on the identification document and the identification document image data are displayed on the display unit 33 of the user terminal 3. The user inputs the information written on the identification document in the text box b and uploads it to the identification information acquisition device 10. Note that, if the information written on the identification document extracted from the identification document image data by OCR processing has been input in advance in the text box b, the input of the information written on the identification document by the user may be in the form of confirming and correcting the information written on the identification document input in advance in the text box b.

[0070] Finally, a termination screen is displayed on the display unit 33 of the user terminal 3 (step S34), and the processing on the user terminal 3 side ends.

[0071] Next, an example of the flow of processing in the entire personal identification information acquisition system including the personal identification information acquisition device 10 according to this embodiment will be described. Fig. 10 is a sequence diagram showing the flow of processing in the personal identification information acquisition system.

[0072] In this embodiment, we will explain the processing flow of the identity verification information acquisition system when a user uses an Internet browser installed on a user terminal 3 to access a website managed by a verifying party such as a credit card company or bank to open an account.

[0073] As shown in Fig. 10, when opening an account with a credit card company, a bank, etc., the user first uses an Internet browser installed in the user terminal 3 to access a website managed by the credit card company, the bank, etc., and starts the account opening procedure (step S41). For example, the user starts the account opening procedure by tapping an "account opening application button" B1 (see Fig. 4) on the website displayed on the display unit 33 of the user terminal 3.

[0074] When the account opening procedure is started, the user terminal 3 is connected to the personal identification information acquisition device 10 (step S42).

[0075] The personal identification information acquisition device 10 connected to the user terminal 3 transmits data (e.g., HTTP data) for carrying out a procedure for acquiring personal identification information to the user terminal 3 (step S43). The data for carrying out a procedure for acquiring personal identification information includes a request to take an image of the personal identification document and an image of the user's appearance. For example, as shown in FIG. 5, the above data for carrying out a procedure for acquiring personal identification information (personal identification document image data) may be data for displaying a message M1 for encouraging the user to take an image of the personal identification document, a plurality of personal identification document selection buttons B2, etc., on the display unit 33 of the user terminal 3.

[0076] The user takes an image of the identification document in accordance with the image capture instruction displayed on the display unit 33 of the user terminal 3 during the image capture request (step S44). The procedure for acquiring the user's facial image data may be performed simultaneously with the procedure for acquiring the identification document image data, or may be performed after acquiring the identification document image data.

[0077] The communication unit 31 of the user terminal 3 transmits the photographed identification document image data and the user's facial image data to the identification information acquisition device 10 automatically after photographing or in response to an operation by the user (step S45).

[0078] The personal identification information acquisition device 10 stores the personal identification document image data and the user's facial image data received from the user terminal 3 in the memory unit 12, and the judgment unit 13 judges whether the personal identification document image data stored in the memory unit 12 is an image that can be used for personal identification without performing personal identification processing (step S46).

[0079] If the determination unit 13 determines that the identification document image data is not an image that can be used for identity verification, the transmission unit 112 transmits re-photographing request data (see FIG. 7) that enables the content of the error to be recognized to the user terminal 3 (step S47).

[0080] The user who receives the re-photographing request data at the user terminal 3 recognizes the error content displayed on the display unit 33, and re-photographs the identification document in accordance with the photographing instructions during the re-photographing request so that no error occurs (step S48).

[0081] The communication unit 31 of the user terminal 3 transmits the re-photographed image data of the identification document to the identification information acquisition device 10 automatically after the image is captured or in response to an operation by the user (step S49).

[0082] When the personal identification information acquisition device 10 receives the re-photographed personal identification document image data, it proceeds to step S46 and executes the above-mentioned determination again. These steps S46 to S49 are repeatedly executed until the determination unit 13 determines that the personal identification document image data is an image that can be used for personal identification. Note that these processes are also executed when photographing the back side of the personal identification document.

[0083] In step S46, if the determination unit 13 determines that the identification document image data is an image that can be used for identity verification, the identification document description information extraction unit 14 extracts the identification document description information included in the identification document image data as character data by OCR processing (step S50). The identification document description information extracted by the identification document description information extraction unit 14 is stored in the storage unit 12.

[0084] The transmission unit 112 of the personal identification information acquisition device 10 transmits the information written on the personal identification document extracted by the information written on the personal identification document extraction unit 14 to the user terminal 3 (step S51). For example, as shown in Fig. 9, the transmission unit 112 transmits the information written on the personal identification document in a manner in which the information is displayed in advance in a correctable state in a text box b displayed on the display unit 33 of the user terminal 3.

[0085] The user checks the information written on the identification document in the text box b displayed on the display unit 33 of the user terminal 3, leaves the correct information written on the identification document as is without correction, and corrects the incorrect information written on the identification document (step S52).

[0086] The corrected or uncorrected confirmed identification document information entered in text box b of the display unit 33 of the user terminal 3 is transmitted from the user terminal 3 to the identification information acquisition device 10 in response to user operation (step S53).

[0087] The personal identification information acquisition device 10 stores the confirmed personal identification document information received from the user terminal 3 in the memory unit 12, and the transmission unit 112 transmits the personal identification document image data, the user's facial image data, and the confirmed personal identification document information stored in the memory unit 12 to the verifying terminal 2 (step S54).

[0088] The verifying terminal 2 stores the received identification document image data, the user's facial image data, and the verified identification document description information in the storage unit 12, and executes the identification process (step S55). For example, the verifying terminal 2 performs the identification process by comparing the face image included in the identification document image data with the face image included in the user's facial image data.

[0089] In the identity verification information acquisition device 10 configured as described above, the determination unit 13 determines whether or not the identity verification document image data received from the user terminal 3 is an image that can be used for identity verification. In this way, at the stage of acquiring the identity verification document image data before the verifyer performs the identity verification process, it is determined whether or not the identity verification document image data is an image that can be used for identity verification, so that it is possible to prevent the occurrence of unnecessary identity verification processes.

[0090] Furthermore, when the determination unit 13 determines that the identification document image data is not an image that can be used for identity verification, the transmission unit 112 transmits re-photographing request data that allows the user terminal 3 to recognize the error content. In this way, the re-photographing request data transmitted to the user terminal 3 allows the user to recognize the error content, so that the user who is requested to re-photograph the image can recognize the specific error content (for example, out of focus, blown-out highlights, etc.) and can prevent the occurrence of the same error content by changing the shooting location from the previous shooting location when re-photographing, or by being careful not to cause camera shake, etc. This makes it possible to suppress the occurrence of multiple errors and prevent repeated re-photographing.

[0091] Furthermore, by making the judgment by the judgment unit 13 based on at least one of whiteout, blackout, and blurring of the identification document image data, errors that are likely to occur (errors due to whiteout, blackout, and blurring (out of focus, camera shake)) can be discovered before the identification process is performed.

[0092] In addition, the receiving unit 111 receives the facial image data of the user as personal identification information from the user terminal 3. Therefore, both the personal identification document image data and the facial image data of the user required for personal identification can be acquired by the personal identification information acquisition device 10.

[0093] Furthermore, when the determination unit 13 determines that the identification document image data is an image that can be used for identity verification, the identification document written information extraction unit 14 extracts the identification document written information contained in the identification document image data as character data by OCR processing, and the transmission unit 112 transmits the extracted identification document written information to the user terminal 3. Therefore, the user only needs to confirm and correct the identification document written information received from the identification information acquisition device 10, which reduces the effort required for the user to input the identification document written information, unlike the case where all the identification document written information is input.

[0094] Generally, when an error occurs during OCR processing, the specific content of the error (for example, whiteout, blackout, and unclearness (out of focus, camera shake), etc.) cannot be recognized. In this embodiment, OCR processing is performed based on the identification document image data that the determination unit 13 has determined to be an image that can be used for identity verification, so the occurrence of the above errors can be prevented. Therefore, the occurrence of errors in which character data cannot be extracted during OCR processing (errors in which the content cannot be recognized) can be suppressed.

[0095] Furthermore, the receiving unit 111 receives, as identity verification information, the confirmed information written on the identity verification document confirmed on the user terminal 3 side from the user terminal 3. Therefore, it is possible to obtain accurate information written on the identity verification document confirmed on the user terminal 3 side (confirmed information written on the identity verification document).

[0096] Furthermore, the transmitting unit 112 transmits the identification document image data, the user's facial image capture data, and the confirmed identification document description information received from the user terminal 3 to the verifier terminal 2. Therefore, the verifier terminal 2 can acquire the identification document image data, the user's facial image capture data, and the confirmed identification document description information usable for identity verification from the user terminal 3 via the identification information acquisition device 10.

[0097] In this embodiment, the personal identification information acquisition device 10 is connected to the verifier terminal 2, and transmits the personal identification document image data, the user's facial image data, and the confirmed personal identification document information received from the user terminal 3 to the verifier terminal 2, but is not limited to this. For example, when the personal identification information acquisition device 10 is owned by the verifier or when the verifier terminal 2 also functions as the personal identification information acquisition device 10 (when the verifier terminal 2 has the function of the personal identification information acquisition device 10), the personal identification information acquisition device 10 does not need to transmit the personal identification document image data, the user's facial image data, and the confirmed personal identification document information received from the user terminal 3 to the verifier terminal 2.

[0098] In addition, in this embodiment, when the determination unit 13 determines that the identification document image data is an image that can be used for identity verification, the identification document description information extraction unit 14 extracts the identification document description information contained in the identification document image data as character data by OCR processing, but it is not necessary to extract the identification document description information from the identification document image data. For example, when the determination unit 13 determines that the identification document image data is an image that can be used for identity verification, the identification document information acquisition device 10 may proceed to step S51 without performing OCR processing (S50), or may transmit the identification document image data received from the user terminal 3, or the identification document image data and the user's facial image data to the verifying terminal 2 (S56), as shown by the dashed arrow in FIG. 10. That is, the identification document description information acquisition device 10 may not have the identification document description information extraction unit 14.

[0099] In addition, in this embodiment, the above judgment is made by the judgment unit 13 before acquiring the identification document image data and executing the OCR processing, but this is not limited to this, and the above judgment may be made by the judgment unit 13 after executing the OCR processing.

[0100] In the present embodiment, the personal identification information acquisition device 10 receives the facial image data of the user from the user terminal 3 and transmits it to the verifier terminal 2, but is not limited to this, and may at least receive the personal identification document image data from the user terminal 3, execute a determination by the determination unit 13, and acquire the personal identification document image data that can be used for personal identification. The verifier may execute personal identification by comparing the personal identification document image data acquired by the personal identification information acquisition device 10 with the facial image data of the user acquired by a method other than the personal identification information acquisition device 10.

[0101] A program according to one embodiment of the present invention is a program for acquiring one or more pieces of identification information from a user terminal 3 for performing identity verification of a user, and causes a computer (identification information acquisition device 10) to function as a receiving means for receiving the user's identification document image data from the user terminal 3 as identification information, a determining means for determining whether the identification document image data received by the receiving means is an image that can be used for identity verification, and a transmitting means for transmitting re-photograph request data capable of recognizing the error content to the user terminal 3 when the determining means determines that the identification document image data is not an image that can be used for identity verification.

[0102] According to the program having the above configuration, it is possible to prevent the occurrence of unnecessary personal identification processing, similarly to the personal identification information acquisition device 10. It is also possible to prevent repeated re-imaging.

[0103] The program according to the present disclosure may include means for executing other processes included in the above-mentioned personal identification information acquisition system (see FIG. 10).

[0104] A method for acquiring personal identification information according to one embodiment of the present invention is a method for acquiring one or more pieces of personal identification information from a user terminal 3 for performing personal identification of a user, and includes a receiving step (S45) for receiving the user's personal identification document image data from the user terminal 3 as personal identification information, a determination step (S46) for determining whether the personal identification document image data received in the receiving step is an image that can be used for personal identification, and a transmitting step (S47) for transmitting re-photographing request data capable of recognizing the error content to the user terminal 3 if it is determined in the determination step that the personal identification document image data is not an image that can be used for personal identification.

[0105] According to the personal identification information acquisition method configured as above, it is possible to prevent the occurrence of unnecessary personal identification processing, similarly to the personal identification information acquisition device 10. In addition, it is possible to prevent repeated re-imaging.

[0106] The personal identification information acquisition method according to the present disclosure may include other steps included in the personal identification information acquisition system (see FIG. 10).

[0107] Although the present invention has been described based on the above embodiment, the present invention is not limited to the contents of the above embodiment, and can be modified as appropriate without departing from the scope of the present invention. In other words, all other embodiments, examples, and operational techniques made by those skilled in the art based on this embodiment are naturally included in the scope of the present invention. [Explanation of symbols]

[0108] 2: Verifier terminal 3: User terminal 10: Personal identification information acquisition device 11: Communications Department 111: Receiving unit 112: Transmitter 13: Judgment section 14: Identification document information extraction unit

Claims

1. A personal identification information acquisition device that is connected to a user terminal of a user and acquires one or more pieces of personal identification information for performing personal identification of the user from the user terminal, A receiving unit that receives, from the user terminal, identification document image data that is image data of an identification document of the user, as the identification information; a determination unit that determines whether the identification document image data received by the receiving unit is an image that can be used for identification; a transmission unit that transmits to the user terminal data including a request for re-photographing that allows the content of an error to be recognized when the determination unit determines that the image data of the identification document is not an image that can be used for identity verification.

2. A personal identification information acquisition device comprising:

2. The determination by the determination unit is based on at least one of whiteout, blackout, and blurring of the image data of the identification document.

2. The personal identification information acquisition device according to claim 1.

3. The receiving unit receives facial image capture data, which is image capture data of the user's appearance, from the user terminal as the personal identification information.

3. The personal identification information acquisition device according to claim 1 or 2.

4. an identification document information extraction unit that extracts identification document information included in the identification document image data by OCR processing when the determination unit determines that the identification document image data is an image that can be used for identity verification; The transmission unit transmits the identification document written information extracted by the identification document written information extraction unit to the user terminal, The receiving unit receives, from the user terminal, confirmed information described in the identification document, which has been confirmed and corrected or not corrected on the user terminal side, as the identification information.

4. The personal identification information acquisition device according to claim 3.

5. The personal identification information acquisition device is connected to a verifying terminal that performs personal identification, The transmission unit transmits the identity verification information received from the user terminal to the verifying terminal.

5. The personal identification information acquisition device according to claim 4.

6. A program for acquiring one or more pieces of identity verification information for verifying the identity of a user from a user terminal, Computer, A receiving means for receiving, from the user terminal, identification document image data, which is image data of an identification document of the user, as the identification information; a determination means for determining whether the identification document image data received by the receiving means is an image usable for identification; a transmitting means for transmitting to the user terminal data including a request for re-photographing, which allows the content of an error to be recognized, when the determining means determines that the image data of the identification document is not an image that can be used for identification. A program characterized by:

7. 1. A method for acquiring one or more pieces of identity verification information for verifying the identity of a user from a user terminal, comprising: a receiving step of receiving, from the user terminal, identification document image data which is image data of an identification document of the user, as the identification information; a determination step of determining whether the identification document image data received in the receiving step is an image usable for identification; and a transmission step of transmitting data to the user terminal, the data including a request for re-photographing that allows the content of the error to be recognized, when the determination step determines that the image data of the identification document is not an image that can be used for identification. A method for acquiring personal identification information, comprising:

Citation Information

Patent Citations

  • Credit card application processing system and credit card application receiving method

    JP2022116848A