Information processing device, information processing method, and information processing program

The information processing device automates identity verification in electronic payment services by using image segmentation and character recognition to verify the authenticity of submitted documents, reducing manual labor and improving efficiency.

JP7595801B1Active Publication Date: 2024-12-06PAYPAY CO LTD
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
JP2024123478
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2024-07-30
Publication Date
2024-12-06
Estimated Expiration
2044-07-30

AI Technical Summary

Technical Problem

Conventional identity verification processes in electronic payment services require significant manual labor for examining identity verification documents, which is inefficient.

Method used

An information processing device that includes an acquisition section to acquire identity verification images, an extraction section to identify predetermined areas on the images, and a determination section to verify the authenticity of the documents based on extracted information, using techniques like U-Net segmentation and OCR for character recognition.

Benefits of technology

Automates the identity verification process, reducing the need for manual labor and enhancing efficiency by accurately determining the validity of submitted documents.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007595801000001_ABST
    Figure 0007595801000001_ABST
Patent Text Reader

Abstract

To reduce the workload involved in identity verification processing. [Solution] The information processing device according to the present application has an acquisition unit, an extraction unit, and a determination unit. The acquisition unit acquires an identity verification image obtained by photographing a card-type information medium used for identity verification in electronic payment services using a plurality of pre-specified photographing methods. The extraction unit extracts a predetermined area showing information for identity verification from the identity verification image based on the type of information medium. The determination unit determines whether the information medium has been submitted properly based on the information included in the predetermined area.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to an information processing device, an information processing method, and an information processing program. [Background technology]

[0002] Conventionally, a system that can complete "identity verification" online, which is carried out to confirm that the user who is carrying out the procedure is the contract holder, has been widely used. For example, with regard to such "identity verification," a technology has been proposed that makes it easy to open a bank account by having the user and an operator talk directly to each other to complete the registration process when applying for the account opening via the Internet. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2019-105938 A Summary of the Invention [Problem to be solved by the invention]

[0004] However, the above-mentioned conventional techniques have room for improvement in terms of reducing the labor required for identity verification. For example, in the conventional techniques, there are many cases where the formality of identity verification documents has to be examined by human labor.

[0005] The present application has been made in consideration of the above, and has an object to provide an information processing device, an information processing method, and an information processing program that can reduce the labor required for identity verification processing. [Means for solving the problem]

[0006] The information processing device according to the present application has an acquisition unit, an extraction unit, and a determination unit. The acquisition unit acquires an identity verification image obtained by photographing a card-type information medium used for identity verification in electronic payment services using a plurality of photographing methods specified in advance. The extraction unit extracts a predetermined area showing information for identity verification from the identity verification image based on the type of the information medium. The determination unit determines whether the information medium has been submitted properly based on the information included in the predetermined area. Effect of the Invention

[0007] According to one aspect of the embodiment, it is possible to reduce the labor required for identity verification processing. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram for explaining an overview of information processing according to the embodiment. [Diagram 2] FIG. 2 is a diagram for explaining an overview of the document examination process according to the embodiment. [Diagram 3] FIG. 3 is a diagram for explaining an outline of the document examination process according to the embodiment. [Figure 4] FIG. 4 is a diagram for explaining an outline of the document examination process according to the embodiment. [Diagram 5] FIG. 5 is a diagram illustrating an example of the configuration of an information processing system according to the embodiment. [Figure 6] FIG. 6 is a diagram illustrating an example of the configuration of the information processing device according to the embodiment. [Figure 7] FIG. 7 is a diagram showing an outline of information related to an identity verification image stored in the examination image information DB according to the embodiment. [Figure 8] FIG. 8 is a diagram showing an overview of the area specifying information stored in the area specifying information DB according to the embodiment. [Figure 9] FIG. 9 is a diagram illustrating an example of information for identifying a predetermined area according to an embodiment. [Figure 10]FIG. 10 is a flowchart illustrating an example of a processing procedure of information processing executed by the information processing device according to the embodiment. [Figure 11] FIG. 11 is a hardware configuration diagram showing an example of a computer that realizes the functions of the information processing device according to the embodiment or the modification. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, the information processing device, the information processing method, and the information processing program according to the present application (hereinafter, referred to as "embodiments") will be described in detail with reference to the drawings. Note that the information processing device, the information processing method, and the information processing program are not limited to the embodiments. In addition, the same components in the following embodiments are given the same reference numerals, and duplicated descriptions will be omitted.

[0010] [Embodiment] [1. Overview of information processing according to the embodiment] An overview of information processing according to the embodiment will be described below with reference to Fig. 1. Fig. 1 is a diagram for explaining an overview of information processing according to the embodiment.

[0011] The terminal device 10 shown in Fig. 1 is used by a user U who is a service user of an electronic payment service. The electronic payment service is a service that provides the service user with an environment for using code payment using an identification code, which is one type of electronic payment. For example, the user U can use various services such as payment of a price through a payment app by installing a payment app, which is a payment application program equipped with various functions for performing code payment, in the terminal device 10 in advance.

[0012] 1 executes information processing related to identity verification in an electronic payment service for a user U. The information processing device 100 may be operated and managed, for example, by a payment service provider that operates the electronic payment service.

[0013] As shown in FIG. 1, the terminal device 10 transmits an identity verification application to the information processing device 100 in response to an operation of a payment application by a user U (step S01).

[0014] The identity verification application includes designated document information indicating the type of identity verification document designated in advance by the user U on the payment app as the identity verification document, which is a card-type information medium used for identity verification. Examples of identity verification documents include a driver's license, a My Number card, and a driving history certificate.

[0015] The identity verification application also includes an identity verification image, which is an image of the identity verification document photographed by the user U. The user U photographs the identity verification document using a required predetermined photographing method for each identity verification document, and encloses the document as an identity verification image with the identity verification application. For example, for a driver's license, an image of the front of the driver's license photographed from the front, an image of the front of the driver's license photographed from an oblique angle, an image of the back of the driver's license photographed from the front, and the like may be requested.

[0016] When the information processing device 100 receives an identity verification application from the terminal device 10, it executes a document examination process to examine whether the identity verification document has been properly submitted (step S02). For example, the information processing device 100 acquires an identity verification image included in the identity verification application. The information processing device 100 also extracts a predetermined area showing information for identity verification from the identity verification image based on designated document information included in the identity verification application. The information processing device 100 also determines whether the identity verification document has been properly submitted based on the information included in the predetermined area.

[0017] In addition, if the information processing device 100 derives a determination result that the identity verification documents have been properly submitted as a result of the document review process, the information processing device 100 transmits a notification to the terminal device 10 that the identity verification information has been received (step S03).

[0018] An example of the document examination process according to the embodiment will be specifically described with reference to Fig. 2 to Fig. 4. Fig. 2 to Fig. 4 are diagrams for explaining an overview of the document examination process according to the embodiment.

[0019] First, as an example of document screening processing, a document screening process for an image of the front side of a driver's license will be described with reference to Fig. 2. The information processing device 100 acquires an identity verification image G1-1 from an identity verification application received from the terminal device 10 (step S11).

[0020] Furthermore, the information processing device 100 cuts out an area A1 showing the surface of the driver's license from the acquired personal verification image G1-1 using a segmentation model such as U-Net, and transforms the cut-out area A1 into a predetermined attitude (predetermined orientation) using an affine transformation or the like (step S12). That is, the information processing device 100 adjusts the orientation of the cut-out area A1 (image) to a predetermined orientation that is predefined for subsequent processing.

[0021] The information processing device 100 also refers to information for identifying a predetermined area predefined for each type of identification document based on the designated document information (e.g., "driver's license (front side)") included in the identification application. The information processing device 100 then extracts, from the area A1 cut out from the identification image G1-1 in which the front side of the driver's license is photographed, an area a1-1 that should contain the character string "license conditions, etc.", an area a1-2 that should contain the character string "driver's license," and an area a1-3 that should contain the character string "XXX Public Safety Commission" as the predetermined areas (step S13).

[0022] Furthermore, the information processing device 100 executes character recognition processing on the areas a1-1, a1-2, and a1-3 extracted as the predetermined areas. The information processing device 100 can execute character recognition processing on the areas a1-1, a1-2, and a1-3 extracted as the predetermined areas by using "OCR (Optical Character Recognition)" or "AI (Artificial Intelligence)-OCR".

[0023] If the result of the character recognition processing on area a1-1 is that four or more characters can be read from the string "License conditions, etc.", if the result of the character recognition processing on area a1-2 is that three or more characters can be read from the string "Driver's License," or if the result of the character recognition processing on area a1-3 is that three or more characters can be read from the string "XXXX Public Safety Commission," the information processing device 100 derives a determination result that the identification image G1-1 submitted as "Driver's License (front)" matches the type of identification document specified by the user U and the identification document has been submitted properly.

[0024] Furthermore, when the information processing device 100 acquires an identification image showing the thickness of a driver's license obtained by photographing the front side of the driver's license from diagonally above as an identification document, the information processing device 100 may extract, as predetermined areas, an area that should contain the character string "driver's license" and an area that should contain the character string "xxxxxx Public Safety Commission" from the identification image. Then, when the information processing device 100 can read a predetermined number or more of characters from the character string "driver's license" included in the extracted predetermined areas, or when the information processing device 100 can read a predetermined number or more of characters from the character string "xxxxxx Public Safety Commission", it may derive a determination result that the identification document has been properly submitted.

[0025] Next, as an example of the document examination process, a document examination process of an image of the back side of a driver's license will be described with reference to Fig. 3. The information processing device 100 acquires an identity verification image G1-2 from an identity verification application received from the terminal device 10 (step S21).

[0026] In addition, the information processing device 100 cuts out an area A2 showing the back side of the driver's license from the acquired personal verification image G1-2, for example, using a segmentation model such as U-Net, and transforms the cut-out area A2 into a predetermined posture using an affine transformation or the like (step S22).

[0027] The information processing device 100 also refers to specific information for identifying a predetermined area predefined for each type of identification document based on the designated document information (e.g., "driver's license (back side)") included in the identification application. The information processing device 100 then extracts, as the predetermined areas, an area a2-1 that should contain the character string "Notes" and an area a2-2 that should contain the character string "3. I will not donate my organs" from an area A2 cut out of an identification image G1-2 in which the back side of the driver's license is photographed (step S23).

[0028] Furthermore, the information processing device 100 executes character recognition processing on the area a2-1 and the area a2-2 extracted as the predetermined area. If the information processing device 100 can read the character string "Note" as a result of the character recognition processing on the area a2-1, or if the information processing device 100 can read the character string "3. I will not donate my organs" as a result of the character recognition processing on the area a2-2, it derives a determination result that the identification image G1-2 submitted as "Driver's License (back side)" matches the type of identification document specified by the user U and that the identification document has been properly submitted.

[0029] Next, as an example of the document examination process, the document examination process of an image of a My Number card will be described with reference to Fig. 4. The information processing device 100 acquires an identity verification image G1-3 from an identity verification application received from the terminal device 10 (step S31).

[0030] The information processing device 100 also cuts out an area A3 showing the My Number card from the acquired identity verification image G1-3 using a segmentation model such as U-Net, and transforms the cut-out area A3 into a predetermined orientation using an affine transformation or the like (step S32). That is, the information processing device 100 adjusts the orientation of the cut-out area A3 to a predetermined orientation that is predefined for subsequent processing.

[0031] The information processing device 100 also refers to specific information for identifying a predetermined area predefined for each type of identification document based on the designated document information (e.g., "My Number Card") included in the identification application. The information processing device 100 then extracts, as the predetermined areas, an area a3-1 that should contain a logo mark and the character string "My Number Card" and an area a3-2 that should contain the character string "Expiration Date of Electronic Certificate" from an area A3 cut out from an identification image of a photograph of a My Number Card (step S33).

[0032] Furthermore, the information processing device 100 performs character recognition processing and image recognition processing on the area a3-1 extracted as the predetermined area, and also performs character recognition processing on the area a3-2.

[0033] For example, when performing image recognition processing of the area a3-1, the information processing device 100 can execute processing to recognize whether or not the design included in the predetermined area of ​​the identification image is a genuine design by using a trained model that has been trained in advance by machine learning on the features of a learning image obtained by photographing a design (including a symbol, figure, code, mark, and emblem) included in a predetermined area for each type of identification document. For example, the information processing device 100 uses the trained model to acquire a similarity between the features of the design included in the predetermined area of ​​the identification image and the features of the genuine design included in the predetermined area of ​​the learning image, and when the acquired similarity exceeds a predetermined threshold, derives a recognition result that the design included in the predetermined area of ​​the identification image is a genuine design. Note that the information processing device 100 can execute character recognition processing of the areas a3-1 and a3-2 using "OCR" or "AI-OCR".

[0034] If the information processing device 100 is able to read three or more characters of the string "Personal Number Card" as a result of the character recognition processing on area a3-1, if the information processing device 100 is able to recognize the logo mark (an example of a "design") contained in area a3-1 as a genuine logo mark as a result of the image recognition processing on area a3-1, or if the information processing device 100 is able to read six or more characters of the string "Expiration date of electronic certificate" as a result of the character recognition processing on area a3-2, it will determine that the identification image submitted as "My Number Card" matches the type of identification document specified by user U and the identification document has been submitted properly.

[0035] As described above, when the information processing device 100 according to the embodiment receives an identity verification application from the user U through the payment app, it can determine whether the identity verification document submitted in the identity verification application has been properly submitted. Thus, according to the information processing device 100 according to the embodiment, manpower is not required for the task of determining whether the identity verification document has been properly submitted in the identity verification application, and it is possible to reduce the labor required for identity verification processing.

[0036] [2. System configuration] The configuration of the information processing system SYS according to the embodiment will be described below. Fig. 5 is a diagram showing an example of the configuration of the information processing system SYS according to the embodiment.

[0037] As shown in Fig. 5, the information processing system SYS according to the embodiment includes a plurality of terminal devices 10 and an information processing device 100. Note that the configuration of the information processing system SYS shown in Fig. 5 is an example, and may include devices other than those illustrated in Fig. 5.

[0038] The terminal device 10 and the information processing device 100 are connected to a network N by wire or wirelessly. The terminal device 10 and the information processing device 100 can communicate with other devices via the network N.

[0039] The network N includes, for example, a wide area network (WAN) such as the Internet, and mobile communication networks such as long term evolution (LTE), 4th generation (4G), and 5th generation (5G: fifth generation mobile communication system).

[0040] The terminal device 10 is connected to a network N by short-range wireless communication such as a mobile communication network, Bluetooth (registered trademark), or a wireless LAN (Local Area Network), and can communicate with other devices such as the information processing device 100 through the network N.

[0041] Moreover, the terminal device 10 is used by a service user of the electronic payment service (for example, a user U shown in FIG. 1). Each of the multiple terminal devices 10 is used by a different service user.

[0042] Furthermore, the terminal device 10 is typically a smartphone, but is not limited to such examples, and may be a notebook PC (Personal Computer), a desktop PC, a tablet PC, a wearable device, etc. Examples of wearable devices include, but are not limited to, smart glasses and smart watches.

[0043] A service user who uses the terminal device 10 can use a payment application pre-installed in the terminal device 10. The service user operates the terminal device 10 to start the payment application, and by using various functions installed in the payment application, can execute various processes related to the electronic payment service, including payment processing by code payment, in cooperation with the information processing device 100.

[0044] In addition, a service user who uses the terminal device 10 can use various functions installed in the payment application to carry out online identity verification application for the electronic payment service through the payment application.

[0045] For example, the terminal device 10 can display various web contents distributed from the information processing device 100 by using a function installed in the payment application. When the terminal device 10 receives control information for realizing the display processing of information from the information processing device 100, the terminal device 10 realizes the display processing according to the control information.

[0046] Furthermore, when the terminal device 10 receives control information for implementing a predetermined information processing from the information processing device 100, the terminal device 10 implements the information processing according to the control information. Here, the control information is described in, for example, a script language such as JavaScript (registered trademark), a style sheet language such as CSS (Cascading Style Sheets), a programming language such as Java (registered trademark), or a markup language such as HTML (HyperText Markup Language). Note that a predetermined application itself delivered from the information processing device 100 may be regarded as the control information.

[0047] The information processing device 100 executes information processing related to identity verification in an electronic payment service for a service user of the electronic payment service. When the information processing device 100 is configured as a server device, it may be realized by a single server device, or may be realized by a cloud system in which multiple server devices and multiple storage devices operate in cooperation with each other.

[0048] 3. Configuration of information processing device 100 Hereinafter, an example of the functional configuration of the information processing device 100 according to the embodiment will be described with reference to Fig. 6. Fig. 6 is a diagram showing an example of the configuration of the information processing device 100 according to the embodiment. As shown in Fig. 6, the information processing device 100 according to the embodiment has a communication unit 110, a storage unit 120, and a control unit 130.

[0049] (Communication unit 110) The communication unit 110 is realized by, for example, a communication module, a NIC (Network Interface Card), etc. The communication unit 110 is connected to a network N by wire or wirelessly, and transmits and receives information to and from other devices such as the terminal device 10.

[0050] (Storage unit 120) The storage unit 120 stores, for example, programs and data used for control and calculation by the control unit 130. The storage unit 120 is realized, for example, by a semiconductor memory element such as a RAM (Random Access Memory) or a flash memory, or a storage device such as a hard disk or an optical disk. As shown in FIG. 6, the storage unit 120 has a review image information DB (Data Base) 121 and an area identification information DB 122.

[0051] (Judging image information DB121) The examination image information DB121 stores information about an identity verification image that can be used by a service user of an electronic payment service (for example, a user U shown in FIG. 1) for identity verification. FIG. 7 is a diagram showing an overview of information about an identity verification image stored in the examination image information DB121 according to the embodiment.

[0052] 7, the information on the identity verification image stored in the examination image information DB121 has multiple items such as a "document name", a "front image", a "back image", a "thickness image", a "selfie image", and a "selfie video". These items in the information on the identity verification image are mutually associated.

[0053] The "Document Name" field stores the name of the identity verification document that a service user of the electronic payment service can use to apply for identity verification.

[0054] The "front image" field stores information indicating whether or not an image of the front of the corresponding identity verification document is required when applying for identity verification using the corresponding identity verification document. The "back image" field stores information indicating whether or not an image of the back of the corresponding identity verification document is required when applying for identity verification using the corresponding identity verification document. The "thickness image" field stores information indicating whether or not an image of the thickness of the corresponding identity verification document is required when applying for identity verification using the corresponding identity verification document.

[0055] The "Selfie image" field stores information indicating whether or not a selfie image of the applicant (service user) is required when applying for identity verification using the corresponding identity verification document. The "Selfie video" field stores information indicating whether or not a short selfie video of the applicant (service user) is required when applying for identity verification using the corresponding identity verification document.

[0056] In the example shown in Figure 7, if the identification document is a "driver's license", the "front image" item, the "back image" item, the "thickness image" item, the "selfie image" item, and the "selfie video" item are all required.

[0057] (Area identification information DB122) The area identification information DB122 stores area identification information for identifying an area in which information for identity verification is displayed in an identity verification image. Fig. 8 is a diagram showing an overview of area identification information stored in the area identification information DB122 according to the embodiment.

[0058] 8, the area specifying information stored in the examination image information DB 121 has a number of items such as a "document name", a "processing area", and a "processing method". These items in the area specifying information are associated with each other.

[0059] The "Document Name" field stores the name of the identity verification document that can be used by a service user of the electronic payment service to apply for identity verification. The "Processing Area" field stores information for identifying a specific area on the identity verification document in which information for identity verification is displayed. FIG. 9 is a diagram for explaining an example of information for identifying a specific area in an embodiment.

[0060] Fig. 9 shows a schematic diagram of an area (such as area A1 shown in Fig. 2) in which the front of a driver's license cut out from an identification image is projected. As shown in Fig. 9, the information for identifying the predetermined area stored in the "processing area" field can be configured by considering the area in which the front of the driver's license is projected as an XY plane, and by using coordinate values ​​indicating the relative positions of the four vertices of areas a1-1, a1-2, and a1-3 from a reference point P set on this XY plane.

[0061] The "processing method" field stores information indicating the processing method for a specific area. For example, the processing method corresponding to area a1-1 of the identification image obtained by photographing the front of a driver's license is character recognition.

[0062] (Control unit 130) The control unit 130 is a controller, and is realized, for example, by a CPU (Central Processing Unit) or an MPU (Micro Processing Unit) executing various programs (an example of an "information processing program" according to an embodiment) stored in a storage device inside the information processing device 100 using the RAM as a working area.

[0063] Furthermore, the control unit 130 may be realized by an integrated circuit such as an application specific integrated circuit (ASIC), a field programmable gate array (FPGA), or a general purpose graphic processing unit (GPGPU).

[0064] 6, the control unit 130 has an acquisition unit 131, an extraction unit 132, a determination unit 133, and a notification unit 134, and these units realize or execute the functions and actions of information processing described below. Note that the control unit 130 may have new functional units different from the units shown in FIG. 6 in response to the extension of various processes executed by the information processing device 100.

[0065] (Acquisition part 131) The acquisition unit 131 acquires an image for identity verification obtained by photographing an identity verification document, which is a card-type information medium used for identity verification in electronic payment services, by a plurality of photographing methods specified in advance, via the communication unit 110. For example, the acquisition unit 131 can acquire an image for identity verification obtained by photographing an identity verification document such as a driver's license or a My Number card.

[0066] When acquiring the identity verification image, the acquisition unit 131 can also acquire designated document information indicating the type of identity verification document (for example, a driver's license or a My Number card) designated in advance by a service user of the electronic payment service (for example, a user U shown in FIG. 1) who performs identity verification. The acquisition unit 131 transfers the identity verification image and the designated document information to the extraction unit 132.

[0067] (Extraction part 132) The extraction unit 132 extracts a predetermined area in which information for identity verification is displayed from the identity verification image based on the type of identity verification document. For example, the extraction unit 132 cuts out an information medium area in which an identity verification document (e.g., a driver's license or a My Number card) is displayed in the identity verification image. Specifically, the extraction unit 132 cuts out an area in which an identity verification document such as a driver's license or a My Number card is displayed using a segmentation model such as U-Net, and converts the cut-out area into a predetermined attitude using an affine transformation or the like. That is, the information processing device 100 adjusts the orientation of the cut-out area (image) to a predetermined orientation that is predefined for subsequent processing.

[0068] In addition, the extraction unit 132 acquires area specification information corresponding to the type of identification document designated by the service user in the designated document information from the area specification information DB 122, and extracts a predetermined area from the information medium area using the acquired area specification information. For example, when the designated document information received from the acquisition unit 131 is "driver's license (front side)", the extraction unit 132 extracts, as predetermined areas, an area a1-1 (for example, see FIG. 2) that should contain the character string "license conditions, etc.", an area a1-2 (for example, see FIG. 2) that should contain the character string "driver's license", and an area a1-3 (for example, see FIG. 2) that should contain the character string "XXX Public Safety Commission" from the area cut out from the identification image. The extraction unit 132 transfers the designated document information and the information of the predetermined area to the determination unit 133.

[0069] (Judgment unit 133) The determination unit 133 determines whether the identification document has been properly submitted based on the information included in the predetermined area. For example, it can determine whether the identification document has been properly submitted based on at least one of the recognition result of the character string included in the predetermined area and the identification result of the design included in the predetermined area.

[0070] Specifically, when the designated document information received from the extraction unit 132 is "driver's license (front side)", the determination unit 133 executes character recognition processing set in the area identification information DB 122 for the areas a1-1, a1-2, and a1-3 received from the extraction unit 132. Then, when the character recognition processing for the area a1-1 results in four or more characters being read from the character string "license conditions, etc.", when the character recognition processing for the area a1-2 results in three or more characters being read from the character string "driver's license", or when the character recognition processing for the area a1-3 results in three or more characters being read from the character string "XXX Public Safety Commission", the determination unit 133 derives a determination result that the identification image submitted as "driver's license (front side)" matches the type of identification document specified by the service user and that the identification document has been properly submitted.

[0071] (Notification Department 134) When the judgment unit 133 derives a judgment result that the identity verification documents have been properly submitted, the notification unit 134 notifies the service user of the electronic payment service who applied for identity verification (for example, user U shown in Figure 1) that the information for identity verification has been received.

[0072] [4. Processing procedure example] Hereinafter, a flow of information processing executed by the information processing device 100 according to the embodiment will be described with reference to Fig. 10. Fig. 10 is a flowchart showing an example of a processing procedure of information processing executed by the information processing device 100 according to the embodiment. Note that the processing procedure shown in Fig. 10 is executed by the control unit 130 of the information processing device 100.

[0073] As shown in FIG. 10, the acquisition unit 131 acquires an image for personal verification from the terminal device 10 (step S101).

[0074] In addition, the extraction unit 132 extracts an area showing information for identity verification from the identity verification image based on the type of identity verification document specified through the payment application by user U of the terminal device 10, who is a user of the electronic payment service and an applicant for identity verification (step S102).

[0075] Furthermore, the determination unit 133 determines whether or not the personal identification document has been properly submitted based on the information contained in the predetermined area (step S103).

[0076] In addition, the notification unit 134 notifies the user U of the terminal device 10, who is a service user of the electronic payment service and the applicant for identity verification, that the information for identity verification has been received (step S104), and terminates the processing procedure shown in Figure 10.

[0077] [5. Modifications] (5-1. Criteria for determining whether identity verification documents have been properly submitted) In the above embodiment, the determination unit 133 of the information processing device 100 may determine whether or not the identification document has been properly submitted as a composite condition, rather than a single condition. For example, when the user U specifies "driver's license (front side)" as the type of identification document, the determination unit 133 may derive a determination result that the identification image G1-1 submitted as "driver's license (front side)" matches the type of identification document specified by the user U and the identification document has been properly submitted if the determination unit 133 can read four or more characters of the character string "license conditions, etc." in the area a1-1 of the identification image, can read three or more characters of the character string "driver's license" in the area a1-2, and can read three or more characters of the character string "XXX Public Safety Commission" in the area a1-3.

[0078] (5-2. Masking Sensitive Information) In the above embodiment, when sensitive information (such as a name or an address) is included in the personal identification image, the information processing device 100 according to the embodiment may mask the sensitive information when performing a document examination process for determining whether the personal identification document has been properly submitted. In this case, when extracting a predetermined area in which information for personal identification is displayed, the determination unit 133 of the information processing device 100 can specify the area in which the sensitive information is displayed in the personal identification image based on the position of the extracted predetermined area and perform a masking process.

[0079] (5-3. System configuration, etc.) In the above embodiment, the information processing performed by the information processing device 100 may be performed by, for example, a server device that executes a payment process for code payment using an electronic payment service. In this case, the server device that executes the payment process may have a function for realizing the information processing according to the embodiment.

[0080] In addition, among the processes described in the above embodiments, all or part of the processes described as being performed automatically can be performed manually, and conversely, all or part of the processes described as being performed manually can be performed automatically by a known method. In addition, the information including the processing procedures, specific names, various data and parameters shown in the above documents and drawings can be changed arbitrarily unless otherwise specified. For example, the various information shown in each drawing is not limited to the illustrated information.

[0081] In addition, each component of each device shown in the figure is a functional concept, and does not necessarily have to be physically configured as shown in the figure. In other words, the specific form of distribution and integration of each device is not limited to that shown in the figure, and all or part of them can be functionally or physically distributed and integrated in any unit according to various loads, usage conditions, etc.

[0082] Furthermore, the above-described embodiments can be appropriately combined as long as the processing contents are not contradictory.

[0083] [6. Hardware configuration] Moreover, the information processing device 100 according to the above-described embodiment or modification is realized, for example, by a computer 1000 having a configuration as shown in Fig. 11. Fig. 11 is a hardware configuration diagram showing an example of a computer that realizes the functions of the information processing device 100 according to the embodiment or modification.

[0084] The computer 1000 is connected to an output device 1010 and an input device 1020, and has a configuration in which an arithmetic unit 1030, a primary storage device 1040, a secondary storage device 1050, an output IF (Interface) 1060, an input IF 1070, and a network IF 1080 are connected via a bus 1090.

[0085] The arithmetic device 1030 operates based on programs stored in the primary storage device 1040 and the secondary storage device 1050 and programs read from the input device 1020, and executes various processes. The primary storage device 1040 is a memory device, such as a RAM, that temporarily stores data used by the arithmetic device 1030 for various calculations. The secondary storage device 1050 is a storage device in which data used by the arithmetic device 1030 for various calculations and various databases are registered, and is realized by a ROM (Read Only Memory), HDD, flash memory, etc.

[0086] The output IF 1060 is an interface for transmitting information to be output to an output device 1010 that outputs various types of information, such as a monitor or a printer, and is realized by a connector conforming to a standard such as USB (Universal Serial Bus), DVI (Digital Visual Interface), or HDMI (High Definition Multimedia Interface), a registered trademark. The input IF 1070 is an interface for receiving information from various input devices 1020, such as a mouse, keyboard, and scanner, and is realized by a USB, for example.

[0087] The input device 1020 may be a device that reads information from an optical recording medium such as a CD (Compact Disc), a DVD (Digital Versatile Disc), or a PD (Phase change rewritable Disk), a magneto-optical recording medium such as an MO (Magneto-Optical disk), a tape medium, a magnetic recording medium, or a semiconductor memory. The input device 1020 may also be an external storage medium such as a USB memory.

[0088] The network IF 1080 receives data from other devices via the network N and sends it to the arithmetic device 1030, and also transmits data generated by the arithmetic device 1030 to other devices via the network N.

[0089] The arithmetic unit 1030 controls the output device 1010 and the input device 1020 via the output IF 1060 and the input IF 1070. For example, the arithmetic unit 1030 loads a program from the input device 1020 or the secondary storage device 1050 onto the primary storage device 1040 and executes the loaded program.

[0090] For example, when the computer 1000 functions as the information processing device 100 according to the embodiment or the modification, the arithmetic device 1030 of the computer 1000 executes a program loaded onto the primary storage device 1040 to realize functions similar to those of the control unit 130. That is, the arithmetic device 1030 realizes processing by the information processing device 100 according to the embodiment or the modification in cooperation with a program (for example, an example of an information processing program) loaded onto the primary storage device 1040.

[0091] [7. Effects] As described above, the information processing device 100 according to the embodiment includes the acquisition unit 131, the extraction unit 132, and the determination unit 133. The acquisition unit 131 acquires an identity verification image obtained by capturing an image of a card-type information medium used for identity verification in electronic payment services using a plurality of pre-specified imaging methods. The extraction unit 132 extracts a predetermined area showing information for identity verification from the identity verification image based on the type of information medium. The determination unit 133 determines whether the information medium has been properly submitted based on the information included in the predetermined area.

[0092] In the information processing device 100 according to the embodiment, the acquisition unit 131 acquires information indicating the type of information medium designated in advance by the user who applies for identity verification when acquiring the identity verification image. The extraction unit 132 extracts a predetermined area from the area in which the information medium is shown in the identity verification image, based on information for identifying a predetermined area that is predefined for each type of information medium designated by the user.

[0093] In addition, in the information processing device 100 according to the embodiment, the judgment unit 133 judges whether or not the information medium has been submitted properly based on at least one of the recognition result of the character string included in the specified area and the recognition result of the design included in the specified area.

[0094] Moreover, in the information processing device 100 according to the embodiment, the determination unit 133 recognizes a character string included in a predetermined area by optical character recognition processing.

[0095] In addition, in the information processing device 100 according to the embodiment, the determination unit 133 uses a trained model that has been trained in advance by machine learning on the features of a training image that captures a design contained in a specified area for each type of information medium to obtain a similarity between the features of the design contained in a specified area of ​​the personal identification image and the features of the design contained in a specified area of ​​the training image, and recognizes the design contained in the specified area of ​​the personal identification image based on whether the obtained similarity exceeds a specified threshold.

[0096] In addition, the information processing device 100 according to the embodiment may further include a notification unit 134 that, when the determination unit 133 determines that the information medium has been properly submitted, notifies the user who has applied for identity verification that information for identity verification has been received.

[0097] In this way, when the information processing device 100 according to the embodiment receives an identity verification application from a service user of an electronic payment service (for example, user U shown in FIG. 1) through a payment app, it can determine whether or not the identity verification document, which is a card-type information medium submitted in the identity verification application, has been properly submitted. As a result, the information processing device 100 according to the embodiment does not require manpower to check whether the identity verification document has been properly submitted in the identity verification application, thereby making it possible to reduce the labor required for identity verification processing.

[0098] The above-mentioned effects can be realized by the processing executed by each of the above-mentioned units, or any combination of the processing executed by each unit.

[0099] [8.Other] Although some of the embodiments of the present application have been described in detail above with reference to the drawings, these are merely examples, and the present invention can be embodied in other forms that incorporate various modifications and improvements based on the knowledge of those skilled in the art, including the aspects described in the Disclosure of the Invention section.

[0100] Further, the information processing device 100 described above can flexibly change its configuration, for example, by calling an external platform or the like using an API (Application Programming Interface) or network computing to realize some functions.

[0101] Furthermore, the term "unit" in the claims may be read as "means" or "circuit," etc. For example, a control unit may be read as control means or a control circuit. [Explanation of symbols]

[0102] SYS Information Processing System 10 Terminal Equipment 100 Information processing device 110 Communications Department 120 Storage section 121 Image information database for review 122 Area specific information DB 130 Control section 131 Acquisition Department 132 Extraction part 133 Judgment section 134 Notification Department

Claims

1. An acquisition unit that acquires, through a payment app, which is a payment application program equipped with various functions for performing code payments using an identification code, images for identity verification obtained by photographing an identity verification document, which is a card-type information medium used for identity verification in an electronic payment service that provides a service user with an environment for using said code payments, by a number of predetermined photographing methods; an extraction unit that extracts a predetermined area showing information for the identity verification from the identity verification image based on a type of the identity verification document specified in advance by the service user in the payment application; a determination unit that determines whether the identity verification document has been properly submitted based on the information included in the predetermined area; having The acquisition unit is When acquiring the image for identity verification, designated document information indicating the type of the identity verification document designated in advance by the service user who applies for the identity verification is also acquired; The extraction unit is Extracting a predetermined area from an area in which the identification document is displayed in the identification image based on information for identifying the predetermined area that is predefined for each type of the identification document designated by the service user; The determination unit is If the recognition result of the information included in the predetermined area matches the designated document information, a determination result is derived that the identity verification document has been properly submitted.

23. An information processing apparatus comprising:

2. The determination unit is Whether or not the identity verification document has been properly submitted is determined based on at least one of a recognition result of a character string included in the specified area and a recognition result of a design included in the specified area.

2. The information processing apparatus according to claim 1,

3. The determination unit is The character string contained in the predetermined area is recognized by optical character recognition processing.

3. The information processing apparatus according to claim 2.

4. The determination unit is A trained model that has been trained in advance by machine learning on the features of a learning image obtained by photographing a design included in the specified area for each type of identification document is used to obtain a similarity between the features of the design included in the specified area of ​​the identification image and the features of the design included in the specified area of ​​the learning image, and the design included in the specified area of ​​the identification image is recognized based on whether or not the obtained similarity exceeds a specified threshold.

3. The information processing apparatus according to claim 2.

5. a notification unit that notifies the user who applied for the identity verification that the information for the identity verification has been received when the determination unit determines that the identity verification document has been properly submitted.

2. The information processing apparatus according to claim 1, further comprising:

6. 1. A computer-implemented information processing method, comprising: an acquisition step of acquiring an image for identity verification obtained by photographing an identity verification document, which is a card-type information medium used for identity verification in an electronic payment service that provides a service user with an environment for using the code payment, by a plurality of predetermined photographing methods through a payment app, which is a payment application program equipped with various functions for performing code payment using an identification code; an extraction step of extracting a predetermined area showing information for the identity verification from the identity verification image based on a type of the identity verification document designated in advance by the service user in the payment application; a determining step of determining whether the identity verification document has been properly submitted based on the information included in the predetermined area; Including, The obtaining step includes: When acquiring the image for identity verification, designated document information indicating the type of the identity verification document designated in advance by the service user who applies for the identity verification is also acquired; The extraction step comprises: Extracting a predetermined area from an area in which the identification document is displayed in the identification image based on information for identifying the predetermined area that is predefined for each type of the identification document designated by the service user; The determination step includes: If the recognition result of the information included in the predetermined area matches the designated document information, a determination result is derived that the identity verification document has been properly submitted.

23. An information processing method comprising:

7. On the computer, an acquisition step of acquiring an image for identity verification obtained by photographing an identity verification document, which is a card-type information medium used for identity verification in an electronic payment service that provides a service user with an environment for using the code payment by a payment app, which is a payment application program equipped with various functions for performing code payment using an identification code, by a plurality of predetermined photographing methods; an extraction step of extracting a predetermined area showing information for the identity verification from the identity verification image based on a type of the identity verification document designated in advance by the service user in the payment application; a determination step of determining whether the identity verification document has been properly submitted based on the information included in the predetermined area; Run the command, The acquisition step includes: When acquiring the image for identity verification, designated document information indicating the type of the identity verification document designated in advance by the service user who applies for the identity verification is also acquired; The extraction procedure comprises: Extracting a predetermined area from an area in which the identification document is displayed in the identification image based on information for identifying the predetermined area that is predefined for each type of the identification document designated by the service user; The determination procedure includes: If the recognition result of the information included in the predetermined area matches the designated document information, a determination result is derived that the identity verification document has been properly submitted.

2. An information processing program comprising:

Citation Information

Patent Citations

  • Bank account opening system and bank account opening method

    JP2019105938A

  • Program, information processing method, and information processing device

    JP2020021459A

  • Document reading system

    JP2020181369A

  • Information processing program, information processing method, and information processing apparatus

    JP2022143810A

  • Apparatus and method for classifying documents

    KR102144464B1