Information processing apparatus, information processing method, and information processing program

Abstract

To save labor for processing of personal identification.SOLUTION: An information processing apparatus includes an acquisition unit, an extraction unit, and a determination unit. The acquisition unit acquires an identity verification image obtained by photographing a card type information medium used for identity verification in an electronic payment service by a plurality of photographing methods designated in advance. The extraction section extracts a predetermined area where information for identification is projected from the identification image on the basis of the type of the information medium. The determination unit determines whether or not the information medium is properly submitted based on the information included in the predetermined area.SELECTED DRAWING: Figure 6

Description

[Technical Field]

[0001] The present invention relates to an information processing device, an information processing method, and an information processing program. [Background technology]

[0002] Conventionally, systems that can complete "identity verification" online, which is carried out to confirm that the user performing the procedure is the contract holder, have been widely used. For example, with regard to such "identity verification," a technology has been proposed that makes it easy to open a bank account via the Internet by having the user and an operator complete the registration process over the phone. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 2019-105938 Summary of the Invention [Problem to be solved by the invention]

[0004] However, the above-mentioned conventional techniques still have room for improvement in terms of reducing the labor required for identity verification processing. For example, in the conventional techniques, there are many cases where the formality of identity verification documents has to be examined by human labor.

[0005] The present application has been made in view of the above, and aims to provide an information processing device, an information processing method, and an information processing program that can reduce the labor required for identity verification processing. [Means for solving the problem]

[0006] The information processing device according to the present application includes an acquisition unit, an extraction unit, and a determination unit. The acquisition unit acquires an identity verification image obtained by capturing an image of a card-type information medium used for identity verification in electronic payment services using a plurality of pre-specified imaging methods. The extraction unit extracts a predetermined area showing identity verification information from the identity verification image based on the type of information medium. The determination unit determines whether the information medium has been properly submitted based on the information contained in the predetermined area. [Effects of the Invention]

[0007] According to one aspect of the embodiment, it is possible to achieve an effect of reducing the labor required for identity verification processing. [Brief explanation of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram for explaining an overview of information processing according to the embodiment. [Figure 2] FIG. 2 is a diagram for explaining an outline of the document examination process according to the embodiment. [Figure 3] FIG. 3 is a diagram for explaining an outline of the document examination process according to the embodiment. [Figure 4] FIG. 4 is a diagram for explaining an outline of the document examination process according to the embodiment. [Figure 5] FIG. 5 is a diagram illustrating an example of the configuration of an information processing system according to the embodiment. [Figure 6] FIG. 6 is a diagram illustrating an example of the configuration of an information processing device according to the embodiment. [Figure 7] FIG. 7 is a diagram showing an outline of information related to the identification image stored in the examination image information DB according to the embodiment. [Figure 8] FIG. 8 is a diagram showing an outline of the area specifying information stored in the area specifying information DB according to the embodiment. [Figure 9] FIG. 9 is a diagram illustrating an example of information for specifying a predetermined area according to an embodiment. [Figure 10]FIG. 10 is a flowchart illustrating an example of a processing procedure of information processing executed by the information processing device according to the embodiment. [Figure 11] FIG. 11 is a hardware configuration diagram showing an example of a computer that realizes the functions of the information processing device according to the embodiment or the modification. DETAILED DESCRIPTION OF THE INVENTION

[0009] Hereinafter, the information processing device, the information processing method, and the information processing program according to the present application (hereinafter referred to as "embodiments") will be described in detail with reference to the drawings. Note that the information processing device, the information processing method, and the information processing program are not limited to these embodiments. Furthermore, the same components in the following embodiments will be denoted by the same reference numerals, and duplicated descriptions will be omitted.

[0010] [Embodiment] [1. Overview of information processing according to the embodiment] An overview of information processing according to the embodiment will be described below with reference to Fig. 1. Fig. 1 is a diagram for explaining an overview of information processing according to the embodiment.

[0011] The terminal device 10 shown in Figure 1 is used by a user U who is a service user of an electronic payment service. The electronic payment service is a service that provides service users with an environment for using code payment, which is one type of electronic payment, using an identification code. For example, by installing a payment app, which is a payment application program equipped with various functions for performing code payment, in the terminal device 10 in advance, the user U can use various services such as payment of bills through the payment app.

[0012] 1 executes information processing related to identity verification in an electronic payment service for a user U. Information processing device 100 may be operated and managed, for example, by a payment service provider that operates the electronic payment service.

[0013] As shown in FIG. 1, the terminal device 10 transmits an identity verification application to the information processing device 100 in response to an operation of the payment application by the user U (step S01).

[0014] The identity verification application includes designated document information indicating the type of identity verification document designated in advance by the user U on the payment app as an identity verification document, which is a card-type information medium used for identity verification. Examples of identity verification documents include a driver's license, a My Number card, and a driving history certificate.

[0015] The identity verification application also includes an identity verification image, which is an image of the identity verification document photographed by the user U. The user U photographs the identity verification document using a specified photographing method required for each identity verification document and encloses the photograph as an identity verification image with the identity verification application. For example, in the case of a driver's license, an image of the front of the driver's license photographed from the front, an image of the front of the driver's license photographed from an oblique angle, or an image of the back of the driver's license photographed from the front may be requested.

[0016] When the information processing device 100 receives an identity verification application from the terminal device 10, it executes a document review process to review whether the identity verification document has been properly submitted (step S02). For example, the information processing device 100 acquires an identity verification image included in the identity verification application. Furthermore, the information processing device 100 extracts a predetermined area showing information for identity verification from the identity verification image based on designated document information included in the identity verification application. Furthermore, the information processing device 100 determines whether the identity verification document has been properly submitted based on the information included in the predetermined area.

[0017] Furthermore, if the information processing device 100 determines as a result of the document review process that the identity verification documents have been properly submitted, it sends a notification to the terminal device 10 that it has received the identity verification information (step S03).

[0018] An example of the document examination process according to the embodiment will be specifically described with reference to Figures 2 to 4. Figures 2 to 4 are diagrams for explaining an overview of the document examination process according to the embodiment.

[0019] First, as an example of the document examination process, the document examination process of an image of the front side of a driver's license will be described with reference to Fig. 2. The information processing device 100 acquires an identity verification image G1-1 from the identity verification application received from the terminal device 10 (step S11).

[0020] Furthermore, the information processing device 100 cuts out an area A1 showing the surface of the driver's license from the acquired personal verification image G1-1 using a segmentation model such as U-Net, and transforms the cut-out area A1 into a predetermined posture (predetermined orientation) using an affine transformation or the like (step S12). That is, the information processing device 100 adjusts the orientation of the cut-out area A1 (image) to a predetermined orientation that is defined in advance for subsequent processing.

[0021] Furthermore, the information processing device 100 refers to information for identifying predetermined areas defined in advance for each type of identification document based on the designated document information (for example, "driver's license (front side)") included in the identification application. Then, the information processing device 100 extracts, from the area A1 cut out from the identification image G1-1 in which the front side of the driver's license is photographed, an area a1-1 that should contain the character string "license conditions, etc.", an area a1-2 that should contain the character string "driver's license," and an area a1-3 that should contain the character string "XXX Public Safety Commission" as predetermined areas (step S13).

[0022] Furthermore, the information processing device 100 performs character recognition processing on the areas a1-1, a1-2, and a1-3 extracted as predetermined areas. The information processing device 100 can perform character recognition processing on the areas a1-1, a1-2, and a1-3 extracted as predetermined areas using "OCR (Optical Character Recognition)" or "AI (Artificial Intelligence)-OCR."

[0023] If the information processing device 100 is able to read four or more characters from the string "license conditions, etc." as a result of the character recognition processing on area a1-1, if it is able to read three or more characters from the string "driver's license" as a result of the character recognition processing on area a1-2, or if it is able to read three or more characters from the string "XXXXXX Public Safety Commission" as a result of the character recognition processing on area a1-3, it will determine that the identification image G1-1 submitted as "driver's license (front)" matches the type of identification document specified by user U and that the identification document has been properly submitted.

[0024] Furthermore, when the information processing device 100 acquires an identification image showing the thickness of a driver's license photographed from diagonally above the front of the driver's license as an identification document, the information processing device 100 may extract, as predetermined areas, an area that should contain the character string "driver's license" and an area that should contain the character string "XXX Public Safety Commission" from the identification image. Then, when the information processing device 100 can read a predetermined number or more of the character string "driver's license" contained in the extracted predetermined areas, or when it can read a predetermined number or more of the character string "XXX Public Safety Commission," the information processing device 100 may derive a determination result that the identification document has been properly submitted.

[0025] Next, as an example of the document examination process, the document examination process of an image of the back side of a driver's license will be described with reference to Fig. 3. The information processing device 100 acquires an identity verification image G1-2 from the identity verification application received from the terminal device 10 (step S21).

[0026] In addition, the information processing device 100 cuts out an area A2 showing the back side of the driver's license from the acquired personal verification image G1-2, for example, using a segmentation model such as U-Net, and transforms the cut-out area A2 into a predetermined posture using an affine transformation or the like (step S22).

[0027] Furthermore, the information processing device 100 refers to specific information for identifying a predetermined area defined in advance for each type of identification document based on the designated document information (for example, "driver's license (back side)") included in the identification application. Then, the information processing device 100 extracts, as predetermined areas, an area a2-1 that should contain the character string "Notes" and an area a2-2 that should contain the character string "3. I will not donate my organs" from an area A2 cut out from an identification image G1-2 in which the back side of the driver's license is photographed (step S23).

[0028] Furthermore, the information processing device 100 performs character recognition processing on the areas a2-1 and a2-2 extracted as predetermined areas. If the character string "Note" can be read as a result of the character recognition processing on the area a2-1, or if the character string "3. I will not donate my organs" can be read as a result of the character recognition processing on the area a2-2, the information processing device 100 determines that the identification image G1-2 submitted as "driver's license (back side)" matches the type of identification document specified by the user U, and that the identification document has been properly submitted.

[0029] Next, as an example of the document examination process, the document examination process of an image of a My Number card will be described with reference to Fig. 4. The information processing device 100 acquires an identity verification image G1-3 from the identity verification application received from the terminal device 10 (step S31).

[0030] Furthermore, the information processing device 100 cuts out an area A3 showing the My Number card from the acquired personal verification image G1-3 using a segmentation model such as U-Net, and transforms the cut-out area A3 into a predetermined orientation using an affine transformation or the like (step S32). That is, the information processing device 100 adjusts the orientation of the cut-out area A3 to a predetermined orientation that is defined in advance for subsequent processing.

[0031] Furthermore, the information processing device 100 refers to specific information for identifying a predetermined area defined in advance for each type of identification document based on the designated document information (for example, "My Number Card") included in the identification application. Then, the information processing device 100 extracts, from the area A3 cut out from the image of the My Number Card for identification, an area a3-1 that should contain a logo mark and the character string "My Number Card," and an area a3-2 that should contain the character string "Expiration date of electronic certificate," as predetermined areas (step S33).

[0032] Furthermore, the information processing device 100 performs character recognition processing and image recognition processing on the area a3-1 extracted as the predetermined area, and also performs character recognition processing on the area a3-2.

[0033] For example, when performing image recognition processing on area a3-1, the information processing device 100 can execute processing to recognize whether a design included in a predetermined area of ​​the identification image is authentic, using a trained model that has been trained in advance by machine learning on the features of training images that capture designs (including symbols, figures, signs, marks, and emblems) included in a predetermined area for each type of identification document. For example, the information processing device 100 uses the trained model to acquire a similarity between the features of the design included in the predetermined area of ​​the identification image and the features of an authentic design included in the predetermined area of ​​the training image, and if the acquired similarity exceeds a predetermined threshold, derives a recognition result that the design included in the predetermined area of ​​the identification image is authentic. Note that the information processing device 100 can execute character recognition processing on areas a3-1 and a3-2 using "OCR," "AI-OCR," or the like.

[0034] If the information processing device 100 is able to read three or more characters of the string "Personal Number Card" as a result of the character recognition processing on area a3-1, if the information processing device 100 is able to recognize the logo mark (an example of a "design") contained in area a3-1 as a genuine logo mark as a result of the image recognition processing on area a3-1, or if the information processing device 100 is able to read six or more characters of the string "Expiration date of electronic certificate" as a result of the character recognition processing on area a3-2, it will determine that the identification image submitted as "My Number Card" matches the type of identification document specified by user U and that the identification document has been submitted properly.

[0035] As described above, when the information processing device 100 according to the embodiment receives an identity verification application from a user U through a payment app, it can determine whether the identity verification documents submitted in the identity verification application have been properly submitted. As a result, the information processing device 100 according to the embodiment does not require manpower to check whether the identity verification documents have been properly submitted in the identity verification application, thereby enabling labor savings in identity verification processing.

[0036] [2. System Configuration] The configuration of the information processing system SYS according to the embodiment will be described below. Fig. 5 is a diagram showing an example of the configuration of the information processing system SYS according to the embodiment.

[0037] As shown in Fig. 5, the information processing system SYS according to the embodiment is configured to include a plurality of terminal devices 10 and an information processing device 100. Note that the configuration of the information processing system SYS shown in Fig. 5 is an example, and other devices other than those exemplified in Fig. 5 may be included.

[0038] The terminal device 10 and the information processing device 100 are connected to a network N by wire or wirelessly. The terminal device 10 and the information processing device 100 can communicate with other devices via the network N.

[0039] The network N includes, for example, a WAN (Wide Area Network) such as the Internet, and mobile communication networks such as LTE (Long Term Evolution), 4G (4th Generation), and 5G (5th Generation: fifth generation mobile communication system).

[0040] The terminal device 10 is connected to a network N by short-range wireless communication such as a mobile communication network, Bluetooth (registered trademark), or wireless LAN (Local Area Network), and can communicate with other devices such as the information processing device 100 through the network N.

[0041] Furthermore, the terminal device 10 is used by a service user of the electronic payment service (for example, user U shown in FIG. 1). Each of the multiple terminal devices 10 is used by a different service user.

[0042] Furthermore, the terminal device 10 is typically a smartphone, but is not limited to such an example, and may be a notebook PC (Personal Computer), a desktop PC, a tablet PC, a wearable device, etc. Examples of wearable devices include smart glasses and a smart watch, but are not limited to such examples.

[0043] A service user who uses the terminal device 10 can use a payment app that is pre-installed on the terminal device 10. The service user operates the terminal device 10 to launch the payment app, and by using various functions installed in the payment app, can cooperate with the information processing device 100 to execute various processes related to the electronic payment service, including payment processing by code payment.

[0044] Furthermore, a service user using the terminal device 10 can use various functions provided in the payment application to apply for identity verification for the electronic payment service online through the payment application.

[0045] For example, the terminal device 10 can display various web contents distributed from the information processing device 100 using a function installed in the payment application. When the terminal device 10 receives control information for realizing information display processing from the information processing device 100, the terminal device 10 realizes the display processing in accordance with the control information.

[0046] Furthermore, when the terminal device 10 receives control information for realizing predetermined information processing from the information processing device 100, the terminal device 10 realizes the information processing in accordance with the control information. Here, the control information is described in, for example, a script language such as JavaScript (registered trademark), a style sheet language such as CSS (Cascading Style Sheets), a programming language such as Java (registered trademark), or a markup language such as HTML (HyperText Markup Language). Note that a predetermined application itself delivered from the information processing device 100 or the like may also be considered as control information.

[0047] The information processing device 100 executes information processing related to identity verification for electronic payment services for service users of the electronic payment service. When the information processing device 100 is configured as a server device, it may be realized by a single server device, or may be realized by a cloud system in which multiple server devices and multiple storage devices operate in cooperation with each other.

[0048] 3. Configuration of Information Processing Device 100 An example of the functional configuration of the information processing device 100 according to the embodiment will be described below with reference to Fig. 6. Fig. 6 is a diagram showing an example of the configuration of the information processing device 100 according to the embodiment. As shown in Fig. 6, the information processing device 100 according to the embodiment has a communication unit 110, a storage unit 120, and a control unit 130.

[0049] (Communication unit 110) The communication unit 110 is realized by, for example, a communication module, a NIC (Network Interface Card), etc. The communication unit 110 is connected to the network N by wire or wirelessly, and transmits and receives information to and from other devices such as the terminal device 10.

[0050] (Storage unit 120) The storage unit 120 stores, for example, programs and data used for control and calculation by the control unit 130. The storage unit 120 is realized, for example, by a semiconductor memory element such as a RAM (Random Access Memory) or a flash memory, or a storage device such as a hard disk or an optical disk. As shown in FIG. 6 , the storage unit 120 has a review image information DB (Data Base) 121 and an area identification information DB 122.

[0051] (Image information for review DB121) The examination image information DB121 stores information about an identity verification image that can be used for identity verification by a service user of an electronic payment service (for example, user U shown in FIG. 1). FIG. 7 is a diagram showing an overview of information about an identity verification image stored in the examination image information DB121 according to the embodiment.

[0052] 7, the information about the identification image stored in the examination image information DB 121 has multiple items such as a "document name," a "front image," a "back image," a "thickness image," a "selfie image," and a "selfie video." These items in the information about the identification image are associated with each other.

[0053] The "Document Name" field stores the name of the identity verification document that a service user of the electronic payment service can use to apply for identity verification.

[0054] The "front image" field stores information indicating whether an image of the front of the corresponding identity verification document is required when applying for identity verification using the corresponding identity verification document. The "back image" field stores information indicating whether an image of the back of the corresponding identity verification document is required when applying for identity verification using the corresponding identity verification document. The "thickness image" field stores information indicating whether an image of the thickness of the corresponding identity verification document is required when applying for identity verification using the corresponding identity verification document.

[0055] The "Selfie Image" field stores information indicating whether a selfie image of the applicant (service user) is required when applying for identity verification using the corresponding identity verification document. The "Selfie Video" field stores information indicating whether a short selfie video of the applicant (service user) is required when applying for identity verification using the corresponding identity verification document.

[0056] In the example shown in Figure 7, if the identification document is a "driver's license," all of the following items are required: "front image," "back image," "thickness image," "selfie image," and "selfie video."

[0057] (Area specific information DB122) The area identification information DB 122 stores area identification information for identifying an area in an identification image where information for identity verification is displayed. Fig. 8 is a diagram showing an overview of area identification information stored in the area identification information DB 122 according to the embodiment.

[0058] 8, the area identification information stored in the examination image information DB 121 has multiple items such as a "document name," a "processing area," and a "processing method." These items in the area identification information are associated with each other.

[0059] The "Document Name" field stores the name of the identity verification document that can be used by a service user of the electronic payment service to apply for identity verification. The "Processing Area" field stores information for identifying a predetermined area on the identity verification document where information for identity verification is displayed. Figure 9 is a diagram for explaining an example of information for identifying a predetermined area in an embodiment.

[0060] Fig. 9 shows a schematic diagram of an area (such as area A1 shown in Fig. 2) in which the front of a driver's license cut out from the personal verification image is projected. As shown in Fig. 9, the information for identifying the predetermined area stored in the "processing area" field can be configured by regarding the area in which the front of the driver's license is projected as an XY plane, and by using coordinate values ​​indicating the relative positions of the four vertices of areas a1-1, a1-2, and a1-3 from a reference point P set on this XY plane.

[0061] The "Processing Method" field stores information indicating the processing method for a specific area. For example, the processing method for area a1-1 of the personal identification image obtained by photographing the front of a driver's license is character recognition.

[0062] (control unit 130) The control unit 130 is a controller, and is realized, for example, by a CPU (Central Processing Unit) or an MPU (Micro Processing Unit) executing various programs (an example of an "information processing program" according to the embodiment) stored in a storage device inside the information processing device 100 using RAM as a working area.

[0063] Furthermore, the control unit 130 can be realized by an integrated circuit such as an application specific integrated circuit (ASIC), a field programmable gate array (FPGA), or a general purpose graphic processing unit (GPGPU).

[0064] 6, the control unit 130 has an acquisition unit 131, an extraction unit 132, a determination unit 133, and a notification unit 134, and these units realize or execute the functions and actions of the information processing described below. Note that the control unit 130 may be provided with new functional units different from the units shown in FIG. 6 in response to expansion of various processes executed by the information processing device 100.

[0065] (Acquisition part 131) The acquisition unit 131 acquires, via the communication unit 110, an image for identification obtained by photographing an identification document, which is a card-type information medium used for identity verification in electronic payment services, using a plurality of pre-specified photographing methods. For example, the acquisition unit 131 can acquire an image for identification obtained by photographing an identification document such as a driver's license or a My Number card.

[0066] When acquiring the personal identification image, the acquisition unit 131 can also acquire designated document information indicating the type of personal identification document (for example, a driver's license or a My Number card) designated in advance by a service user of the electronic payment service (for example, user U shown in FIG. 1) who will be performing personal identification. The acquisition unit 131 transfers the personal identification image and the designated document information to the extraction unit 132.

[0067] (Extraction part 132) The extraction unit 132 extracts a predetermined area showing information for identity verification from the identity verification image based on the type of identity verification document. For example, the extraction unit 132 cuts out an information medium area showing an identity verification document (e.g., a driver's license or a My Number card) from the identity verification image. Specifically, the extraction unit 132 uses a segmentation model such as U-Net to cut out the area showing the identity verification document, such as a driver's license or a My Number card, and transforms the cut-out area into a predetermined orientation using an affine transformation or the like. That is, the information processing device 100 adjusts the orientation of the cut-out area (image) to a predetermined orientation that is defined in advance for subsequent processing.

[0068] Furthermore, the extraction unit 132 acquires area specifying information corresponding to the type of personal identification document designated by the service user in the designated document information from the area specifying information DB 122, and extracts predetermined areas from the information medium area using the acquired area specifying information. For example, when the designated document information received from the acquisition unit 131 is "driver's license (front side)," the extraction unit 132 extracts, as predetermined areas, area a1-1 (see, for example, FIG. 2) that should contain the character string "license conditions, etc.", area a1-2 (see, for example, FIG. 2) that should contain the character string "driver's license," and area a1-3 (see, for example, FIG. 2) that should contain the character string "XXX Public Safety Commission" from the area cut out from the personal identification image. The extraction unit 132 passes the designated document information and the information on the predetermined areas to the determination unit 133.

[0069] (Judgment unit 133) The determination unit 133 determines whether the personal identification document has been properly submitted based on the information contained in the predetermined area. For example, it can determine whether the personal identification document has been properly submitted based on at least one of the recognition result of the character string contained in the predetermined area and the identification result of the design contained in the predetermined area.

[0070] Specifically, when the designated document information received from the extraction unit 132 is "driver's license (front side)," the determination unit 133 executes character recognition processing set in the area identification information DB 122 on the areas a1-1, a1-2, and a1-3 received from the extraction unit 132. Then, when the character recognition processing on the area a1-1 results in four or more characters being read from the character string "license conditions, etc.", when the character recognition processing on the area a1-2 results in three or more characters being read from the character string "driver's license," or when the character recognition processing on the area a1-3 results in three or more characters being read from the character string "XXX Public Safety Commission," the determination unit 133 derives a determination result that the identification image submitted as "driver's license (front side)" matches the type of identification document specified by the service user and that the identification document has been properly submitted.

[0071] (Notification Department 134) If the judgment unit 133 determines that the identity verification documents have been properly submitted, the notification unit 134 notifies the service user of the electronic payment service who applied for identity verification (for example, user U shown in Figure 1) that the information for identity verification has been received.

[0072] [4. Example of processing procedure] Hereinafter, the flow of information processing executed by the information processing device 100 according to the embodiment will be described with reference to Fig. 10. Fig. 10 is a flowchart showing an example of the processing procedure of information processing executed by the information processing device 100 according to the embodiment. Note that the processing procedure shown in Fig. 10 is executed by the control unit 130 included in the information processing device 100.

[0073] As shown in FIG. 10, the acquisition unit 131 acquires an image for personal verification from the terminal device 10 (step S101).

[0074] In addition, the extraction unit 132 extracts an area from the identity verification image in which information for identity verification is displayed, based on the type of identity verification document specified through the payment app by user U of the terminal device 10, who is a service user of the electronic payment service and the applicant for identity verification (step S102).

[0075] Furthermore, the determination unit 133 determines whether or not the personal identification document has been properly submitted based on the information contained in the predetermined area (step S103).

[0076] In addition, the notification unit 134 notifies the user U of the terminal device 10, who is a service user of the electronic payment service and the applicant for identity verification, that the information for identity verification has been received (step S104), and ends the processing procedure shown in Figure 10.

[0077] [5. Modifications] (5-1. Criteria for determining whether identity verification documents have been properly submitted) In the above embodiment, the determination unit 133 of the information processing device 100 may use a composite condition, rather than a single condition, as the condition for determining whether or not the identification document has been properly submitted. For example, when the user U specifies "driver's license (front side)" as the type of identification document, if the determination unit 133 can read four or more characters of the string "license conditions, etc." in the area a1-1 of the identification image, read three or more characters of the string "driver's license" in the area a1-2, and read three or more characters of the string "XXX Public Safety Commission" in the area a1-3, the determination unit 133 may derive a determination result that the identification image G1-1 submitted as "driver's license (front side)" matches the type of identification document specified by the user U and the identification document has been properly submitted.

[0078] (5-2. Masking Sensitive Information) Furthermore, in the above embodiment, when sensitive information (for example, name, address, etc.) is included in the personal identification image, the information processing device 100 according to the embodiment may mask the sensitive information when performing a document examination process for determining whether the personal identification document has been properly submitted. In this case, when extracting a predetermined area in which information for personal identification is displayed, the determination unit 133 of the information processing device 100 can identify the area in the personal identification image in which the sensitive information is displayed based on the position of the extracted predetermined area and perform a masking process.

[0079] (5-3. System configuration, etc.) In the above embodiment, the information processing performed by the information processing device 100 may be performed by, for example, a server device that executes payment processing for code payment using an electronic payment service. In this case, the server device that executes the payment processing may have a function for realizing the information processing according to the embodiment.

[0080] Furthermore, among the processes described in the above embodiments, all or part of the processes described as being performed automatically can be performed manually, and conversely, all or part of the processes described as being performed manually can be performed automatically using known methods. In addition, the information including the processing procedures, specific names, various data, and parameters shown in the above documents and drawings can be changed as desired unless otherwise specified. For example, the various information shown in each drawing is not limited to the information shown in the drawings.

[0081] Furthermore, the components of each device shown in the figure are conceptual functional components and do not necessarily have to be physically configured as shown in the figure. In other words, the specific form of distribution and integration of each device is not limited to that shown in the figure, and all or part of them can be functionally or physically distributed and integrated in any unit depending on various loads, usage conditions, etc.

[0082] Furthermore, the above-described embodiments can be combined as appropriate within the scope of not causing any contradiction in the processing content.

[0083] [6. Hardware Configuration] Moreover, the information processing device 100 according to the above-described embodiment or modification is realized, for example, by a computer 1000 having a configuration as shown in Fig. 11. Fig. 11 is a hardware configuration diagram showing an example of a computer that realizes the functions of the information processing device 100 according to the embodiment or modification.

[0084] The computer 1000 is connected to an output device 1010 and an input device 1020, and has a configuration in which an arithmetic unit 1030, a primary storage device 1040, a secondary storage device 1050, an output IF (Interface) 1060, an input IF 1070, and a network IF 1080 are connected by a bus 1090.

[0085] The arithmetic device 1030 operates based on programs stored in the primary storage device 1040 and secondary storage device 1050, programs read from the input device 1020, and the like, and executes various processes. The primary storage device 1040 is a memory device, such as a RAM, that temporarily stores data used by the arithmetic device 1030 for various calculations. The secondary storage device 1050 is a storage device in which data used by the arithmetic device 1030 for various calculations and various databases are registered, and is realized by a ROM (Read Only Memory), HDD, flash memory, or the like.

[0086] The output IF 1060 is an interface for transmitting information to be output to an output device 1010 that outputs various types of information, such as a monitor or a printer, and is realized by a connector conforming to a standard such as USB (Universal Serial Bus), DVI (Digital Visual Interface), or HDMI (High Definition Multimedia Interface), etc. The input IF 1070 is an interface for receiving information from various input devices 1020, such as a mouse, keyboard, and scanner, and is realized by a USB, for example.

[0087] The input device 1020 may be a device that reads information from an optical recording medium such as a CD (Compact Disc), a DVD (Digital Versatile Disc), or a PD (Phase Change Rewritable Disk), a magneto-optical recording medium such as an MO (Magneto-Optical disk), a tape medium, a magnetic recording medium, or a semiconductor memory. The input device 1020 may also be an external storage medium such as a USB memory.

[0088] The network IF 1080 receives data from other devices via the network N and sends it to the arithmetic device 1030, and also transmits data generated by the arithmetic device 1030 to other devices via the network N.

[0089] The arithmetic unit 1030 controls the output device 1010 and the input device 1020 via the output IF 1060 and the input IF 1070. For example, the arithmetic unit 1030 loads a program from the input device 1020 or the secondary storage device 1050 onto the primary storage device 1040 and executes the loaded program.

[0090] For example, when the computer 1000 functions as the information processing device 100 according to the embodiment or the modification, the arithmetic device 1030 of the computer 1000 executes a program loaded onto the primary storage device 1040, thereby realizing the same functions as the control unit 130. That is, the arithmetic device 1030 cooperates with the program (for example, an example of an information processing program) loaded onto the primary storage device 1040 to realize the processing by the information processing device 100 according to the embodiment or the modification.

[0091] [7. Effects] As described above, the information processing device 100 according to the embodiment includes an acquisition unit 131, an extraction unit 132, and a determination unit 133. The acquisition unit 131 acquires an identity verification image obtained by capturing an image of a card-type information medium used for identity verification in electronic payment services using a plurality of pre-specified imaging methods. The extraction unit 132 extracts a predetermined area showing information for identity verification from the identity verification image based on the type of information medium. The determination unit 133 determines whether the information medium has been properly submitted based on the information included in the predetermined area.

[0092] Furthermore, in the information processing device 100 according to the embodiment, when acquiring an identity verification image, the acquisition unit 131 also acquires information indicating the type of information medium designated in advance by the user applying for identity verification. The extraction unit 132 extracts a predetermined area from the area in which the information medium is displayed in the identity verification image, based on information for identifying a predetermined area defined in advance for each type of information medium designated by the user.

[0093] In addition, in the information processing device 100 according to the embodiment, the determination unit 133 determines whether the information medium has been submitted properly based on at least one of the recognition results of the character string contained in the specified area and the recognition results of the design contained in the specified area.

[0094] In the information processing device 100 according to the embodiment, the determination unit 133 recognizes a character string included in a predetermined area by optical character recognition processing.

[0095] Furthermore, in the information processing device 100 according to the embodiment, the determination unit 133 uses a trained model that has been trained in advance by machine learning on the features of a training image that captures a design contained in a specified area for each type of information medium to acquire the similarity between the features of the design contained in a specified area of ​​the personal identification image and the features of the design contained in a specified area of ​​the training image, and recognizes the design contained in the specified area of ​​the personal identification image based on whether the acquired similarity exceeds a specified threshold.

[0096] In addition, the information processing device 100 according to the embodiment may further include a notification unit 134 that, when the determination unit 133 determines that the information medium has been properly submitted, notifies the user who has applied for identity verification that the information for identity verification has been received.

[0097] In this way, when the information processing device 100 according to the embodiment receives an identity verification application from a service user of an electronic payment service (for example, user U shown in FIG. 1) through the payment app, it can determine whether the identity verification document, which is a card-type information medium submitted in the identity verification application, has been properly submitted. As a result, the information processing device 100 according to the embodiment does not require manpower to check whether the identity verification document has been properly submitted in the identity verification application, thereby enabling labor savings in identity verification processing.

[0098] The above-described effects can be realized by the processing executed by each of the above-described units, or by any combination of the processing executed by each unit.

[0099] [8. Other] Although some of the embodiments of the present application have been described in detail above with reference to the drawings, these are merely examples, and the present invention can be implemented in other forms that include the embodiments described in the Disclosure of the Invention section and that have been modified and improved in various ways based on the knowledge of those skilled in the art.

[0100] Furthermore, the information processing device 100 described above can flexibly change its configuration, for example, by calling an external platform or the like using an API (Application Programming Interface) or network computing, depending on the function.

[0101] Furthermore, the term "unit" in the claims can be read as "means" or "circuit," etc. For example, a control unit can be read as control means or a control circuit. [Explanation of symbols]

[0102] SYS Information Processing System 10 Terminal Equipment 100 Information processing device 110 Communications Department 120 Storage section 121 Image information database for review 122 Area specific information DB 130 Control Unit 131 Acquisition Department 132 Extraction part 133 Judgment section 134 Notification Department

Claims

1. an acquisition unit that acquires an image for identity verification obtained by photographing a card-type information medium used for identity verification in electronic payment services using a plurality of photographing methods that are specified in advance; an extracting unit that extracts a predetermined area in which the information for personal identification is displayed from the image for personal identification based on the type of the information medium; a determination unit that determines whether the information medium has been properly submitted based on the information included in the predetermined area; An information processing device comprising:

2. The acquisition unit When acquiring the image for personal identification, information indicating the type of the information medium designated in advance by the user who applies for the personal identification is also acquired; The extraction unit Extracting the predetermined area from the area in which the information medium is displayed in the personal identification image based on information for specifying the predetermined area that is predefined for each type of information medium designated by the user.

2. The information processing apparatus according to claim 1, wherein:

3. The determination unit Whether or not the information medium has been properly submitted is determined based on at least one of the recognition result of the character string included in the predetermined area and the recognition result of the design included in the predetermined area.

3. The information processing apparatus according to claim 1, wherein the information processing apparatus is a computer.

4. The determination unit Recognizing the character string contained in the predetermined area through optical character recognition processing 4. The information processing apparatus according to claim 3,

5. The determination unit For each type of information medium, a trained model is used that has been trained in advance by machine learning on the features of a training image obtained by photographing a design included in the predetermined area, and a similarity is obtained between the features of the design included in the predetermined area of ​​the personal identification image and the features of the design included in the predetermined area of ​​the training image, and the design included in the predetermined area of ​​the personal identification image is recognized based on whether the obtained similarity exceeds a predetermined threshold.

4. The information processing apparatus according to claim 3,

6. a notification unit that notifies the user who has applied for the identity verification that the information for the identity verification has been received when the determination unit determines that the information medium has been properly submitted.

2. The information processing apparatus according to claim 1, further comprising:

7. 1. A computer-implemented information processing method, comprising: an acquisition step of acquiring an image for identity verification obtained by photographing a card-type information medium used for identity verification in electronic payment services using a plurality of photographing methods designated in advance; an extraction step of extracting a predetermined area showing the information for personal identification from the image for personal identification based on the type of the information medium; a determining step of determining whether the information medium has been properly submitted based on the information included in the predetermined area; An information processing method comprising:

8. On the computer, an acquisition step of acquiring an image for identity verification obtained by photographing a card-type information medium used for identity verification in an electronic payment service using a plurality of photographing methods designated in advance; an extraction step of extracting a predetermined area showing the information for personal identification from the image for personal identification based on the type of the information medium; a determination step of determining whether the information medium has been properly submitted based on the information included in the predetermined area; An information processing program characterized by causing the program to execute the above.

Images