Information processing device, information processing method, and program

Abstract

To easily and accurately determine whether a certificate is genuine.SOLUTION: An information processing device comprises: an acquisition unit that acquires an image of a certificate; a recognition unit that acquires, from the image, first information of a first type, second information of a second type and third information of a third type; and a comparison unit that generates, based at least on a second characteristic of the second information and a third characteristic of the third information, comparison information for comparison with the first information of the first type, compares the comparison information with a characteristic for comparison of the first information, and determines whether the certificate is genuine based on the comparison result.SELECTED DRAWING: Figure 7

Description

[Technical field]

[0001] The present invention relates to an information processing device, an information processing method, and a program. [Background technology]

[0002] Conventionally, an authenticity determination device capable of more reliably determining the authenticity of a driver's license has been disclosed (see, for example, Patent Document 1). This authenticity determination device has a comparison means for comparing whether IC chip information obtained from the IC chip of the driver's license matches character information on the face of the driver's license obtained from an image of the driver's license, and a determination means for determining whether there is a contradiction in the character information on the face of the driver's license obtained from an image of the driver's license. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent Publication No. 2022-107999 Summary of the Invention [Problem to be solved by the invention]

[0004] Conventional technology uses information from an IC chip, and it is sometimes not possible to easily and accurately determine whether a certificate is genuine from an image.

[0005] The present invention has been made in consideration of the above circumstances, and one of its objects is to provide an information processing device, an information processing method, and a program that can easily and accurately determine whether a certificate is genuine. [Means for solving the problem]

[0006] One aspect of the present invention is an information processing device that includes an acquisition unit that acquires an image of a certificate, a recognition unit that acquires first information of a first type, second information of a second type, and third information of a third type from the image, and a comparison unit that generates matching information for matching with the first information of the first type based on at least a second feature of the second information and a third feature of the third information, compares the matching information with the matching features of the first information, and determines whether the certificate is a genuine certificate based on the result of the comparison. Effect of the Invention

[0007] According to one aspect of the present invention, it is possible to provide an information processing device, an information processing method, and a program that can easily and accurately determine whether a certificate is genuine. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram showing an example of a configuration for realizing an electronic payment service. [Diagram 2] This is a sequence diagram (part 1) illustrating the general flow of electronic payment. [Diagram 3] This is a sequence diagram (part 2) illustrating the general flow of electronic payment. [Figure 4] 1 is a configuration diagram of a payment server 100 according to a first embodiment. [Diagram 5] FIG. 13 is a diagram showing an example of the contents of user information 172. [Figure 6] FIG. 13 is a diagram showing an example of the contents of affiliated store / store information 176. [Figure 7] FIG. 2 illustrates an example of a functional configuration of a matching server 200. [Figure 8] 1 is a sequence diagram showing an example of the flow of processes executed by payment application 20, payment server 100, and verification server 200. FIG. [Figure 9] 13 is a flowchart showing an example of the flow of processing executed by the matching server 200. [Figure 10] FIG. 13 is a diagram showing an example of an image of a driver's license. [Figure 11] FIG. 13 is a diagram showing an example of matching information 286. [Figure 12] 13 is a flowchart showing an example of the flow of a determination process. [Figure 13] FIG. 11 is a diagram for explaining the process of S206. [Figure 14] FIG. 13 is a diagram showing an example of an interface screen displayed on a display unit during visual inspection. [Figure 15] FIG. 13 is a diagram showing another example of an interface screen displayed during visual inspection. [Figure 16] 1 is a diagram showing the date of birth written on a driver's license and matching information. FIG. [Figure 17] FIG. 13 is a diagram showing an example of matching information 286A. [Figure 18] FIG. 13 is a diagram showing an example of an interface screen displayed on a display unit during visual inspection. [Figure 19] FIG. 13 is a diagram showing an example of matching information 286B. [Figure 20] FIG. 13 is a diagram showing an example of an interface screen displayed on a display unit during visual inspection. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] [overview] The information processing device includes an acquisition unit that acquires an image of the certificate, a recognition unit that acquires first information of a first type, second information of a second type, and third information of a third type from the image, and a matching unit that generates matching information for matching with the first information of the first type based on at least a second feature of the second information and a third feature of the third information. The second feature and the third feature are various features or arbitrary features such as the meaning of the information, the type of information which is text, numbers, or symbols, and the arrangement of the information.

[0010] The certificate is a certificate used for identity verification, such as a driver's license, a My Number card, a health insurance card, a passport, a residence card, an employee card, etc. In the following embodiment, an example in which a driver's license is used will be described as an example, but a similar process may be applied when other certificates are used.

[0011] The matching unit matches the matching information with matching features of the first information and determines whether the certificate is a genuine certificate based on the result of the matching. The matching features are, for example, the arrangement of information included in the first information in a field in the image in which the first information of the certificate is written. The matching information is information indicating a position where information included in the first information should be written in a field in the image in which the first information of the certificate is written.

[0012] For example, the first information is the description of the date of birth on the driver's license. The second information and the third information are other items on the driver's license. Based on the description of the other items, the matching information is generated. For example, based on the description of the other items, information indicating the position where the year, month, and day of birth of the date of birth on the genuine driver's license should be located (for example, "April 1, 1985" or "April 1, 1985") is specified. The matching unit compares this specified position with the position of the description of the date of birth on the image of the driver's license to determine whether the driver's license is genuine or not. The first information may be the description of the other items. If the arrangement of the information included in the first information, which is a feature for matching, matches the arrangement of the information included in the matching information, the matching unit determines that the certificate is genuine, and if the arrangement of the information included in the first information, which is a feature for matching, does not match the arrangement of the information included in the matching information, the matching unit determines that the certificate is not genuine. Details will be described later.

[0013] Note that, instead of the second information and the third information, matching information may be generated based on the second information, and this matching information may be used for the determination.

[0014] Hereinafter, with reference to the drawings, an embodiment of an information processing device, an information processing method, and a program of the present invention will be described. Various devices for providing services to users and performing internal analysis, such as a "payment server" and a "verification server" that will be described below, may be realized by a group of distributed devices, and each device may be operated by a different business operator. Furthermore, the owner of the hardware of the device (the provider of the cloud server) and the business operator that actually operates the device may also be different. The application program and the payment server work together to provide an electronic payment service. In the following description, the application program is referred to as a payment application. The electronic payment service is a service that supports payments related to the purchase of goods and services at a store. The store is, for example, a physical store (real store) that exists in the real world, but may also include a virtual store for electronic commerce. The virtual store may include a store provided by an entity different from the operator of the electronic payment service. In that case, when making a payment for shopping at the virtual store, the screen is controlled to transition to an interface screen of the electronic payment service. In the electronic payment service, the store is treated as belonging to, for example, an affiliated store (brand), and processing such as payment when a purchase is made at the store is mainly performed between the user and the affiliated store. Alternatively, processing such as payment may be carried out between the user and the store.

[0015] [Electronic payment service] FIG. 1 is a diagram showing an example of a configuration for realizing an electronic payment service. The electronic payment service is realized mainly by a payment server 100. The payment server 100 communicates with, for example, one or more user terminal devices 10, one or more first store terminal devices 50, one or more second store terminal devices 70, and a verification server 200 via a network NW. The network NW includes, for example, the Internet, a LAN (Local Area Network), a wireless base station, a provider device, and the like. The verification server 200 can also communicate with an examination terminal 300 for an examiner who examines a certificate.

[0016] The user terminal device 10 is, for example, a portable terminal device such as a smartphone or a tablet terminal. The user terminal device 10 is a computer device having at least an optical reading function, a communication function, a display function, an input reception function, and a program execution function. In the following description, components for realizing these functions are referred to as a camera, a communication device, a touch panel, a CPU (Central Processing Unit), etc. In the user terminal device 10, a processor such as a CPU executes a payment application 20, thereby operating to provide an electronic payment service to a user in cooperation with a payment server 100. The payment application 20 is installed in the user terminal device 10 from, for example, an application store, and controls the camera, communication device, touch panel, etc.

[0017] The first store terminal device 50 is installed, for example, in a store. The first store terminal device 50 is a computer device having at least a product price acquisition function, an optical reading function, a program execution function, and a communication function. The first store terminal device 50 includes a so-called POS (Point of Sale) device, and the product price acquisition function and the optical reading function may be realized by the POS device. The store code image 60 is placed in the store, and is a code image such as a QR code (registered trademark) printed on a paper or plastic medium. The store code image 60 may be displayed on a display placed in the store (which may be the display of a terminal device such as a smartphone).

[0018] The second store terminal device 70 is used by the operator of the affiliated store. The second store terminal device 70 is a smartphone, a tablet terminal, a personal computer, or the like. An interface 72 for affiliated stores runs on the second store terminal device 70. The interface 72 for affiliated stores may be an app for affiliated stores or a browser. The interface 72 for affiliated stores accepts coupon settings and the like made by the operator of the affiliated store and transmits them to the payment server 100. The second store terminal device 70, which is a smartphone, has the function of displaying a code image corresponding to a store code image and reading a code image displayed by the user terminal device 10 by executing the app for affiliated stores.

[0019] The payment server 100 realizes electronic payment based on payment information received from the user terminal device 10 or the first store terminal device 50. The first store terminal device 50 may include a POS device and an affiliated store server, in which case the payment information is sent from the POS device via the affiliated store server to the payment server 100. In the following explanation, no distinction is made between these two and it is assumed that the payment information is sent from the first store terminal device 50.

[0020] 2 and 3 are sequence diagrams illustrating the general flow of electronic payment. There may be two patterns of electronic payment: pattern 1 and pattern 2.

[0021] In the case of pattern 1 (hereinafter referred to as user scan) shown in FIG. 2, the user terminal device 10 with the payment application 20 activated decodes the store code image 60 by the optical reading function (S1). The store code image 60 includes store URL (Uniform Resource Locator) information. This store URL is an electronic payment service domain to which store-identifying information is added, and is associated with an affiliated store ID, a store ID, etc. in the payment server 100 (described later). The payment application 20 transmits the first payment information including the store URL and the account ID to the payment server 100 (S2). The payment server 100 searches for store information (described later) from the affiliated store ID and the store ID corresponding to the store URL, acquires the affiliated store name and the store name information (S3), and transmits it to the payment application 20 (S4). The user inputs the payment amount into the user terminal device 10 on the screen on which the affiliated store name and the store name are displayed (S5). Then, the user terminal device 10 generates second payment information including at least the payment amount, and transmits it to the payment server 100 (S6). The payment server 100 performs electronic payment based on the received second payment information (S7). The payment server 100 then transmits a payment completion notice (information for displaying a payment completion screen) to the payment application 20 (S8), and the payment application 20 displays the payment completion screen (S9). Note that when the store code image 60 is displayed on a display installed in the store, the store code image 60 may include not only the store URL but also information on the payment amount. In this case, the step of the user inputting the payment amount is omitted, and the information on the payment amount is included in the first payment information and transmitted to the payment server 100. Information on the affiliated store name and the store name may be included in the payment completion screen and displayed.

[0022] In the case of pattern 2 (hereinafter referred to as store scan) shown in FIG. 3, when the payment application 20 is started, when a payment operation is performed in the payment application 20, when an automatic update timing (e.g., every minute) occurs, and at other timings, the payment application 20 transmits a request for issuing a one-time code to the payment server 100 (S11). The payment server 100 generates a one-time code (S12) and transmits it to the payment application 20 (S13). The payment application 20 displays a code image such as a QR code or a barcode generated based on the one-time code (S14). The user holds (presents) the display surface of the user terminal device 10 over the first store terminal device 50, and the first store terminal device 50 decodes the code image by an optical reading function and obtains the one-time code, etc. (S15). The first store terminal device 50 then generates payment information including the one-time code, payment amount, affiliated store ID, store ID, etc., and transmits it to the payment server 100 (S16). The payment amount information is acquired in advance by reading a barcode or manually entering it. The payment server 100 identifies the user corresponding to the one-time code based on the received information and performs electronic payment (S17). The payment server 100 then transmits a payment completion notice to the payment application 20 (S18), and the payment application 20 displays a payment completion screen (S19).

[0023] Note that electronic payment may be performed using only one of the above patterns. Furthermore, the "account ID" described in FIG. 2 may be other information (e.g., a phone number) that can be used as user identification information. Furthermore, issuance of a one-time code may be omitted in the store scan, and the payment application 20 may display a code image generated based on the user's account ID. In this case, the payment server 100 identifies the user corresponding to the account ID instead of identifying the user corresponding to the one-time code.

[0024] [Payment server] FIG. 4 is a configuration diagram of the payment server 100 according to the first embodiment. The payment server 100 includes, for example, a communication unit 110, a payment content providing unit 120, a payment processing unit 130, an information management unit 140, and a storage unit 170. The components other than the communication unit 110 and the storage unit 170 are realized by, for example, a hardware processor such as a CPU executing a program (software). Some or all of these components may be realized by hardware (including a circuit unit; circuitry) such as an LSI (Large Scale Integration), an ASIC (Application Specific Integrated Circuit), an FPGA (Field-Programmable Gate Array), or a GPU (Graphics Processing Unit), or may be realized by cooperation between software and hardware. The program may be stored in advance in a storage device (a storage device having a non-transient storage medium) such as an HDD (Hard Disk Drive) or a flash memory, or may be stored in a removable storage medium (a non-transient storage medium) such as a DVD or a CD-ROM, and may be installed in the storage device by mounting the storage medium in a drive device.

[0025] The storage unit 170 is a HDD, a flash memory, a RAM (Random Access Memory), etc. The storage unit 170 may be a NAS (Network Attached Storage) device that the payment server 100 can access via a network. The storage unit 170 stores information such as user information 172, payment content information 174, and affiliated store / shop information 176.

[0026] The communication unit 110 is a communication interface for connecting to the network NW. The communication unit 110 is, for example, a network interface card.

[0027] The payment content providing unit 120 has, for example, a function of a Web server, and provides information (content) for displaying various screens of the electronic payment service to the user terminal device 10. The payment content providing unit 120 appropriately reads necessary content from the payment content information 174 and provides it to the user terminal device 10. The user terminal device 10 accepts various inputs by the user while the content is being played by the payment application 20, and transmits the above-mentioned payment information and the like to the payment server 100.

[0028] The payment processing unit 130 performs payment processing based on the payment information transmitted by the user terminal device 10 or the first store terminal device 50. The payment processing unit 130 performs payment processing while referring to the user information 172.

[0029] FIG. 5 is a diagram showing an example of the contents of the user information 172. The user information 172 is an example of the registration information of a user. The user information 172 is, for example, a user URL, an account ID, a telephone number, a password, as well as information associated with an email address, a user ID, a name, an address, a date of birth, a registration date, a charge balance, a post-payment setting, a post-payment limit, a post-payment usage amount, a post-payment available amount, a payment method setting, a bank account, a credit card number, a charge history information, and a payment history information. The user URL is used for a remittance process between users. When registering for the electronic payment service, it is necessary to register a telephone number and a password. The account ID is issued to the user by the payment server 100, and the user ID is an ID that can be set by the user at will (does not have to be set). Similarly, the email address, and the name, address, and date of birth are information that can be set by the user at will (does not have to be set). The registration date is the date on which the user registered for the electronic payment service (the date on which the account was created). Hereinafter, the user's instance (electronic payment account) to which this information is associated will be referred to as an account.

[0030] The charge balance is information indicating the balance of electronic money that is set by a user by transferring money to an account in advance. The means of transfer include transfer from an ATM (Automatic Teller Machine) of a designated company (bank) and transfer from a registered bank account. The deferred payment setting is information indicating whether or not the setting for enabling electronic payment by deferred payment has been completed, and is set to either "completed" or "not completed." The deferred payment limit is the limit of deferred payment that can be used each month, the deferred payment usage amount is the amount of deferred payment that has already been used in the current month, and the deferred payment available amount is the amount of deferred payment that can be used in the current month, which is calculated by subtracting the deferred payment usage amount from the deferred payment limit. Although only one deferred payment limit is shown in the figure, in reality, there is also a daily upper limit, and the lower of these may be set as the deferred payment limit. Further details of deferred payment will be described later. The payment method setting is setting information indicating whether the user will perform electronic payment using the charge balance or payment by deferred payment at that time. The bank account and credit card number are information on a bank account or credit card number (account number, card number) that can be used to deposit funds into an electronic payment service. Charge history information is a history of the user's previous transfers to the electronic payment service to increase the charge balance. Payment history information is information that indicates the details of payments made by the user for each payment (date and time, store ID of the store where the purchase was made, payment amount, payment method, etc.).

[0031] 6 is a diagram showing an example of the contents of affiliated store / store information 176. The affiliated store / store information 176 includes, for example, a first table 176A in which an affiliated store ID and a store ID are associated with a store URL, a second table 176B in which an affiliated store name and sales amount (described above) are associated with an affiliated store ID, and a third table 176C in which a store ID is associated with a store name. In addition to this information, the affiliated store / store information 176 may also include information such as the category of the affiliated store or store, the location of the store, and payment patterns.

[0032] The information management unit 140 manages user information 172 and affiliated store / store information 176 based on information acquired from the user terminal device 10 and the second store terminal device 70. The information management unit 140 adds new records to, edits, and deletes the user information 172 and affiliated store / store information 176.

[0033] [Electronic payment] When payment information is acquired from the user terminal device 10 or the first store terminal device 50, the payment processing unit 130 refers to the user information 172 to acquire the "payment method setting" of the user. For a user whose "payment method setting" is set to "charge balance", the payment processing unit 130 performs electronic payment as follows. For example, the payment processing unit 130 performs electronic payment by decreasing the charge balance managed in association with the user ID and increasing the item value of the affiliated store's sales. The item value of the affiliated store's sales is not used as electronic money itself, for example, and an amount corresponding to the item value of the sales is transferred to a bank account in a cycle according to an agreement between the affiliated store and the electronic payment service.

[0034] The payment processing unit 130 performs electronic payment for users whose "setting information" is set to "deferred payment" as follows. Deferred payment is set separately from "credit payment" in cooperation with a credit card company, which is a separate entity from the operator of the electronic payment service, and the operator of the electronic payment service acts as a creditor and allows electronic payment that is not dependent on the charge balance within the deferred payment limit. In order to receive the deferred payment service, a credit card provided by the operator of the electronic payment service may be required. The amount used for deferred payment is settled on the payment date of the following month, for example, by debiting from a bank account, for one month. In this case, the payment processing unit 130 performs provisional payment by adding the payment amount to the deferred payment amount and subtracting the same amount from the available deferred payment amount, and when the closing date comes, it performs processing to debit the payment for the current month on the payment date of the following month as described above, or requests the operator of the credit card company to perform such processing. In addition, if the payment amount exceeds the available deferred payment amount at the time of provisional payment, an error notification is returned to the payment application 20.

[0035] [Matching server] The verification server 200 determines whether the certificate is genuine. The certificate is used for identity verification. If the verification server 200 determines that the certificate is genuine and passes a predetermined examination, it completes the identity verification process for the person who submitted the certificate. When identity verification is complete, more services are available in the electronic payment service described above than when identity verification is not performed. When identity verification is complete, for example, it becomes possible to charge using a bank account, use electronic payments at affiliated stores where use was previously restricted, and the upper limit on deferred payment amounts may be increased.

[0036] FIG. 7 is a diagram showing an example of the functional configuration of the matching server 200. The matching server 200 includes, for example, a communication unit 210, an information acquisition unit 220, a recognition unit 230, a matching unit 240, a display control unit 250, and a storage unit 280. The components other than the communication unit 210 and the storage unit 280 are realized by, for example, a hardware processor such as a CPU executing a program (software). Some or all of these components may be realized by hardware (including a circuit unit) such as an LSI, ASIC, FPGA, or GPU, or may be realized by cooperation between software and hardware. The program may be stored in a storage device (storage device having a non-transient storage medium) such as an HDD or flash memory in advance, or may be stored in a removable storage medium (non-transient storage medium) such as a DVD or CD-ROM, and may be installed in the storage device by mounting the storage medium in a drive device. Some or all of the functional configuration of the matching server 200 may be included in the payment server 100.

[0037] The storage unit 280 is a HDD, a flash memory, a RAM, or the like. The storage unit 280 may be a NAS device that the verification server 200 can access via a network. The storage unit 280 stores information such as a certificate image 282, application information 284, and verification information 286. The application information 284 is information about the user, such as the name, address, and date of birth, provided by the user. The application information 284 may include information written on a driver's license.

[0038] The communication unit 210 is a communication interface for connecting to the network NW. The communication unit 210 is, for example, a network interface card.

[0039] The information acquiring unit 220 acquires an image of the certificate. This image is stored in the storage unit 280 as a certificate image 282. The information acquiring unit 220 stores the certificate image 282 in the storage unit 280 in association with, for example, the identification information of the user.

[0040] The recognition unit 230 acquires the first information of the first type, the second information of the second type, and the third information of the third type from the image. The recognition unit 230 recognizes, for example, the position of each item on the driver's license and the information written in each item. The recognition unit 230 recognizes characters using OCR (Optical Character Recognition) technology, or recognizes the position of each item based on preset rules, character types, etc.

[0041] The matching unit 240 generates matching information for matching with the first information of the first type based on at least the second feature of the second information and the third feature of the third information, matches the matching information with the matching feature of the first information, and determines whether the certificate is a genuine certificate based on the result of the matching. This process will be described in detail later.

[0042] The display control unit 250 causes the processing results of the information acquisition unit 220, the recognition unit 230, and the matching unit 240 to be displayed on the display unit of the examination terminal 300.

[0043] [Matching process (1-1)] 8 is a sequence diagram showing an example of the flow of processing executed by the payment application 20, the payment server 100, and the verification server 200. For example, when a user performs an operation for identity verification in the content provided by the payment server 100 and obtains an image of a certificate, the payment application 20 transmits the image of the certificate to the payment server 100 (S50). Next, the payment server 100 requests the verification server 200 to determine whether the certificate is a genuine certificate or not (S52). At this time, the user's identification information and the image of the certificate are also provided to the verification server 200.

[0044] Next, the verification server 200 executes a verification process using the image (S54). Next, the verification server 200 transmits the result of the verification process to the payment server 100 (S56). Next, if the result of the verification process is positive and other various conditions are satisfied, the payment server 100 determines that identity verification has been completed and expands the services available to the user (S58). Next, the payment server 100 provides information indicating the completion of identity verification and the expansion of services to the payment application 20 (S60).

[0045] The above-mentioned "other various conditions" are conditions necessary for other identity verification, such as the provision of information about the user. Service expansion refers to making available services that were previously unavailable or restricted to users.

[0046] As described above, electronic payment systems can provide better service to users by using images of driver's licenses to verify identity.

[0047] [Matching process (1-2)] 9 is a flowchart showing an example of the flow of processing executed by the verification server 200. First, the information acquisition unit 220 acquires an image of the driver's license (S100). Next, the recognition unit 230 analyzes the image and recognizes various pieces of information (S102). For example, the recognition unit 230 recognizes the position of each item on the driver's license from the image, the text, symbols, and numbers written in each item, and their positions.

[0048] FIG. 10 is a diagram showing an example of an image of a driver's license. The items of a driver's license are various items included in the driver's license, such as the name, date of birth, address, date of issue, expiration date, license conditions, various numbers, license type, face image, and matters related to the Public Safety Commission. For example, the recognition unit 230 recognizes the position where the user's name is written and the characters written in the position based on the position where the characters of the name are recognized, or recognizes the user's date of birth based on the position where the era name such as Showa and the "month" and "day" are written. The recognition unit 230 may also recognize the position and characters of each item based on a trained model (not shown). The trained model is a model that outputs the area (characters included in the area) written in each item when an image is input. The trained model is a model that has learned training data. The training data is information in which an image of a driver's license is associated with an area where characters of each item written on the driver's license are written.

[0049] Next, the matching unit 240 compares the features of the items to be compared in the image (the features for matching the first information) with the matching information to determine whether the features of the items to be compared match the matching information (S104). The matching information is information specified by the matching information 286. The matching unit 240 generates the matching information based on at least the first information, the second information, and the third information. More specifically, the matching unit 240 generates the matching information based on the number of pieces of information A in the first information (the number of texts, symbols, and numbers), the number of pieces of information B in the first information (the number of texts, symbols, and numbers), the second information, and the third information.

[0050] The number of pieces of information A and the number of pieces of information B may be recognized based on, for example, the result of recognition by the recognition unit 230, or may be specified based on information input by the user on another interface screen (for example, application information 284). Also, for example, one of the number of pieces of information A and the number of pieces of information B may be specified based on information input by the user, and the other may be recognized based on the result of recognition by the recognition unit 230.

[0051] FIG. 11 is a diagram showing an example of the matching information 286. The matching information 286 is, for example, information according to a combination of the second information, the third information, the number of pieces of information A, and the number of pieces of information B. The type of matching information is specified by the combination. The first information, the second information, and the third information are information of items that are preset among the above-mentioned items. The items of the first information, the items of the second information, and the items of the third information are, for example, different items. For example, the number of pieces of information A in the first information is the number of digits of the year of birth in the date of birth column, and the number of pieces of information B in the first information is the number of digits of the month of birth in the date of birth column. One or both of the number of pieces of information A and the number of pieces of information B are an example of the "first characteristic of the first information", and one or both of the information A and the information B are another example of the "first characteristic of the first information". Details of the determination process of S104 will be described later.

[0052] If the features of the item being compared match the matching information, the matching unit 240 estimates that the driver's license in the image is likely to be a genuine driver's license (S106) and proceeds to the next step (S108). If the features of the item being compared do not match the matching information, the matching unit 240 estimates that the driver's license in the image is likely to be an incorrect driver's license (S110) and proceeds to visual inspection (S112). Details of the visual inspection will be described later. This ends the processing of one routine of this flowchart.

[0053] [Matching process details] FIG. 12 is a flowchart showing an example of the flow of the determination process. First, the matching unit 240 generates matching information as described above (S200). The matching information is, for example, information that identifies areas where information such as letters, symbols, and numbers should not be written and areas where information should be written. The matching information is, for example, information that indicates areas where information should not be written with a "circle" and areas where information should be written with a "circle". The "circle" or "circle" may be referred to as a symbol hereinafter. The symbols are arranged at intervals similar to the pitch at which information is written in the corresponding item on the driver's license.

[0054] Next, the matching unit 240 identifies the position of a preset item to be compared among the items of the driver's license (S202). The item to be compared is, for example, an item different from the items of the second information and the items of the third information described above. The information of this item to be compared is the first information.

[0055] Next, the matching unit 240 superimposes the matching information on the position of the item to be compared on the image (S204). For example, the matching unit 240 superimposes the reference position of the matching information so that it matches the reference position of the item to be compared. The reference position of the matching information is, for example, an end of a symbol (for example, the left end). The reference position of the item to be compared is, for example, an end of a box corresponding to the item (for example, the left end). The reference position of the item to be compared may be, for example, the position where the first character is written (on the left side) when it is assumed that characters are written in all of the columns of the item.

[0056] The matching unit 240 compares the features of the item to be compared in the image (the features for matching the first information) with the matching information and judges whether the features of the item to be compared match the matching information (S206, a judgment equivalent to S104 in FIG. 9). FIG. 13 is a diagram for explaining the processing of S206. When the position of the first information matches the matching information, the "●" and the first information are superimposed, as shown in the upper diagram of FIG. 13. When the position of the first information does not match the matching information, a place appears where the "●" and the first information do not superimpose, as shown in the lower diagram of FIG. 13.

[0057] In this way, if the "●" does not overlap with the first information, it is presumed to be an unauthorized driver's license. Also, if part of the information included in the first information overlaps with the "●" or the information included in the first information is written in a position that does not overlap with the "●" and "○", it is presumed to be an unauthorized driver's license because the information included in the first information is written in a position that would not be written on a legitimate driver's license.

[0058] The above judgment may be made by AI (Artificial Intelligence) technology. For example, a trained model may be used for the judgment. The trained model is a model that outputs information indicating whether or not the certificate is genuine when a superimposed image is input. The trained model is a model that has been trained with training data. The training data is information in which an image of a genuine certificate is associated with an image after superimposition (an image in which the information included in the first information and "●" are superimposed) and information indicating that the certificate is genuine, or information in which an image of an unauthorized certificate is associated with an image after superimposition (an image in which the information included in the first information exists other than "●") and information indicating that the certificate is genuine.

[0059] In the above description, the verification information is shown by "◯" and "●", but other symbols, letters, numbers, etc. may be used instead. Also, the actual letters written on the driver's license may be used instead of the "●".

[0060] As described above, if it is presumed that the license is not genuine, the process proceeds to a visual inspection. Note that even if it is presumed that the license is genuine, the process may proceed to a visual inspection, or the results of the process may be presented to the examiner.

[0061] [Interface screen displayed during visual inspection (1)] The display control unit 250 causes the display unit to display an interface screen including information indicating the first feature of the first information obtained from the image. When an operation to correct the first feature of the first information is performed, the matching unit 240 generates new matching information using the corrected first feature, and the display control unit 250 causes the display unit to display an interface screen including the new matching information.

[0062] Fig. 14 is a diagram showing an example of an interface screen displayed on the display unit during visual inspection. The interface screens in Fig. 14 and subsequent figures show information recognized from the driver's license, but an image of the driver's license may also be displayed on the display unit alongside this information. The display control unit 250 causes the display unit to display an interface screen including the second information, the third information, information A, information B, a generate button, the number of pieces of information contained in information A (the number of pieces of text, numbers, and symbols), and the number of pieces of information contained in information B.

[0063] Each piece of information may be information recognized by the recognition unit 230, or some of the information may be information input by the applicant on another interface screen. For example, one or both of information A of the first information and information B of the first information are information input by the applicant. The number of pieces of information A or information B of the first information is specified based on the information input by the applicant. The second information or third information is, for example, information recognized by the recognition unit 230. If the recognition unit 230 cannot recognize the information, the column for the second information or the third information on the interface screen is blank.

[0064] If each piece of information differs from the information written on the driver's license, the eye examiner can correct the information. After the correction, when the generate button is operated, the matching unit 240 refers to the matching information 286 and generates matching information corresponding to the corrected information. The display control unit 250 causes the display unit to display the newly generated matching information.

[0065] Fig. 15 is a diagram showing another example of an interface screen displayed in visual inspection. For example, if the number of pieces of information included in information A is the number of digits for the year of birth, and the number of pieces of information included in information B is the number of digits for the month of birth, the number of digits for the year of birth and the number of digits for the month of birth are corrected as shown in Fig. 15. Then, based on these digits, the first information, the second information, the third information, and the matching information 286, matching information is generated.

[0066] FIG. 16 is a diagram showing the date of birth and the matching information on a driver's license. As in the above, the eye examiner can compare the newly generated matching information with the first information on the driver's license and determine whether the position of the first information matches the position of the "●" in the matching information, thereby determining whether the driver's license is a genuine driver's license. If the "8" for the month of birth is a genuine driver's license, it would be located in the "●" position, but in the example of FIG. 16, it is located in the "○" position. Therefore, the eye examiner determines that the driver's license is not a genuine driver's license.

[0067] Furthermore, to facilitate visual inspection, the display control unit 250 may cause the display unit to display an interface screen in which the newly generated matching information is superimposed on the first information, as shown in FIG. 13 described above.

[0068] The verification unit 240 may verify the newly generated verification information with the verification features of the first information, and determine whether the certificate is a genuine certificate based on the verification result. In this case, the verification unit 240 automatically performs the determination, which reduces the burden on the examiner.

[0069] [Matching process (2)] In the above example, both the number of pieces of information A and the number of pieces of information B are described as being taken into consideration, but one or both of these numbers do not have to be taken into consideration. For example, the contents of information A and information B may be taken into consideration without taking both numbers into consideration as follows. Note that only one of information A and information B may be taken into consideration. In the following example, an example in which information A and information B are taken into consideration will be described.

[0070] The matching unit 240 may generate matching information based on at least the first feature of the first information, the second feature of the second information, and the third feature of the third information, match the matching information with the matching features of the first information, and determine whether the certificate is a genuine certificate based on the result of the matching. The matching features are the arrangement of the information included in the first information in the field in which the first information of the certificate in the image is written, as described above. The matching information is information indicating the position where the information included in the first information should be arranged in the field in which the first information of the certificate in the image is written, as described above.

[0071] The matching unit 240 generates the matching information by referring to the matching information 286A. Fig. 17 is a diagram showing an example of the matching information 286A. The matching information 286A is, for example, information corresponding to a combination of the second information, the third information, the information A, and the information B. The type of the matching information is specified by the combination. If the certificate is determined to be an unauthorized certificate in the above process, an eye inspector performs an eye inspection.

[0072] [Interface screen displayed during visual inspection (2)] The display control unit 250 causes the display unit to display an interface screen including information indicating the first feature of the first information obtained from the image. When an operation to correct the first feature of the first information is performed, the matching unit 240 uses the corrected first feature to newly generate the matching information, and the display control unit 250 causes the display unit to display an interface screen including the new matching information.

[0073] FIG. 18 is a diagram showing an example of an interface screen displayed on the display unit during the eye examination. The display control unit 250 displays an interface screen including the first information, the second information, the third information, and a generation button on the display unit. For example, among the first information, information A and information B are included in one frame on a driver's license. Information A is one meaning or one collection of information among the first information, and information B is similar. If the first information is, for example, a date of birth, information A is the year of birth, and information B is the month and day of birth. If the first information to the third information displayed on the interface screen are different from the information written on the driver's license, the eye examiner can correct the information displayed on the interface screen. After the correction, when the generation button is operated, the collation unit 240 generates collation information corresponding to the corrected information by referring to the collation information 286A. The display control unit 250 displays the newly generated collation information on the display unit.

[0074] As described above, the eye examiner can determine whether the driver's license is a genuine driver's license by comparing the newly generated matching information with the first information on the driver's license and determining whether the position of the first information matches the position of the ●.

[0075] The verification unit 240 may verify the newly generated verification information with the verification features of the first information, and determine whether the certificate is a genuine certificate based on the verification result. In this case, the verification unit 240 automatically performs the determination, which reduces the burden on the examiner.

[0076] [Matching process (3)] In the above example, the information A or information B of the first information is taken into consideration, but the first information does not have to be taken into consideration.

[0077] The matching unit 240 may generate matching information based on at least the second feature of the second information and the third feature of the third information, match the matching information with the matching features of the first information, and determine whether the certificate is a genuine certificate based on the result of the matching. The matching features are the arrangement of the information included in the first information in the field in the image in which the first information of the certificate is written, as described above. The matching information is information indicating the position where the information included in the first information should be written in the field in the image in which the first information of the certificate is written, as described above.

[0078] The matching unit 240 generates the matching information by referring to the matching information 286B. Fig. 19 is a diagram showing an example of the matching information 286B. The matching information 286B is information in which the matching information is associated with a combination of the second information and the third information, for example. The type of the matching information is specified by the combination. If the certificate is determined to be an unauthorized certificate in the above process, an eye inspector performs an eye inspection.

[0079] [Interface screen displayed during visual inspection (3)] The display control unit 250 causes the display unit to display an interface screen including information showing the second feature of the second information and the third feature of the third information obtained from the image. When an operation is performed to modify the second feature of the second information or the third feature of the third information, the matching unit 240 uses the modified second feature or the modified third feature to newly generate the matching information. The display control unit 250 causes the display unit to display an interface screen including the new matching information.

[0080] FIG. 20 is a diagram showing an example of an interface screen displayed on the display unit during the eye examination. The display control unit 250 causes the display unit to display an interface screen including the second information and the third information recognized by the recognition unit 230 and a generate button. The user can correct the second information or the third information as necessary. For example, if the second information or the third information is different from the information written on the driver's license, the eye examiner can correct the second information or the third information. After the correction, when the generate button is operated, the matching unit 240 generates matching information corresponding to the corrected second information or the third information. The display control unit 250 causes the display unit to display the newly generated matching information.

[0081] The eye examiner can determine whether the driver's license is a genuine driver's license by comparing the newly generated matching information with the first information on the driver's license and determining whether the position of the first information matches the position of the ●.

[0082] The verification unit 240 may verify the newly generated verification information with the verification features of the first information, and determine whether the certificate is a genuine certificate based on the verification result. In this case, the verification unit 240 automatically performs the determination, which reduces the burden on the examiner.

[0083] According to the embodiment described above, the matching server 200 acquires first information of a first type, second information of a second type, and third information of a third type from an image of a certificate, generates matching information for matching with the first information of the first type based on at least the second feature of the second information and the third feature of the third information, matches the matching information with the matching features of the first information, and determines whether the certificate is a genuine certificate based on the result of the matching, thereby making it possible to easily and accurately determine whether a certificate is genuine.

[0084] The above describes the form for carrying out the present invention using an embodiment, but the present invention is not limited to such an embodiment, and various modifications and substitutions can be made within the scope that does not deviate from the gist of the present invention. [Explanation of symbols]

[0085] 10 User terminal device 20. Payment App 100 Payment Server 200 Matching Server 220 Information Acquisition Department 230 Recognition part 240 Collation Unit 250 Display control unit 286 Matching Information

Claims

1. an acquisition unit for acquiring an image of the certificate; a recognition unit that acquires first information of a first type, second information of a second type, and third information of a third type from an image; generating matching information for matching with the first information of the first type based on at least a second feature of the second information and a third feature of the third information; a verification unit that compares the verification information with a verification feature of the first information and determines whether the certificate is a genuine certificate based on a result of the comparison; An information processing device comprising:

2. the feature for comparison is an arrangement of information included in the first information of the certificate in a field in the image in which the first information is written, the collation information is information indicating a position where information included in the first information of the certificate in the image should be placed in a field in which the first information is written, The information processing device according to claim 1 .

3. The collation unit is If the arrangement of the information in the verification feature matches the arrangement of the information in the verification information, the certificate is determined to be a genuine certificate; if the arrangement of the information in the verification feature does not match the arrangement of the information in the verification information, determine that the certificate is not a genuine certificate; The information processing device according to claim 2 .

4. The certificate is a driver's license. The information processing device according to claim 1 .

5. a display control unit that causes a display unit to display an interface screen including information indicating the second feature of the second information and the third feature of the third information obtained from the image, When an operation for modifying the second feature of the second information or the third feature of the third information is performed, the matching unit newly generates the matching information using the modified second feature or the modified third feature, the display control unit causes a display unit to display an interface screen including the new matching information. The information processing device according to claim 1 .

6. a display control unit that causes a display unit to display an interface screen including information indicating the second feature of the second information and the third feature of the third information obtained from the image, When an operation for modifying the second feature of the second information or the third feature of the third information is performed, the matching unit newly generates the matching information using the modified second feature or the modified third feature, comparing the new verification information with the verification characteristics, and determining whether the certificate is a genuine certificate based on a result of the comparison; The information processing device according to claim 1 .

7. The collation unit is generating the matching information based on at least a first feature of the first information, a second feature of the second information, and a third feature of the third information; comparing the verification information with the verification characteristics, and determining whether the certificate is a genuine certificate based on a result of the comparison; The information processing device according to claim 1 .

8. the feature for comparison is an arrangement of information included in the first information in a section in the image of the certificate in which the first information is written, the information for matching is information indicating a position where information included in the first information should be placed in a field in which the first information of the certificate in the image is written; The information processing device according to claim 7.

9. a display control unit that causes a display unit to display an interface screen including information indicating the first characteristic of the first information obtained from the image, When an operation for correcting the first feature of the first information is performed, the matching unit generates new matching information using the corrected first feature, the display control unit causes a display unit to display an interface screen including the new matching information.

9. The information processing device according to claim 7 or 8.

10. a display control unit that causes a display unit to display an interface screen including information indicating the first characteristic of the first information obtained from the image, When an operation for correcting the first feature of the first information is performed, the matching unit generates new matching information using the corrected first feature, comparing the new matching information with a first characteristic of the first information, and determining whether the certificate is a genuine certificate based on a result of the comparison; 9. The information processing device according to claim 7 or 8.

11. The computer Get the image of the certificate, acquiring first information of a first type, second information of a second type, and third information of a third type from the image; generating matching information for matching with the first information of the first type based on at least a second feature of the second information and a third feature of the third information; comparing the verification information with a verification feature of the first information, and determining whether the certificate is a genuine certificate based on a result of the comparison; Information processing methods.

12. On the computer, Get a picture of the certificate, obtaining first information of a first type, second information of a second type, and third information of a third type from the image; generating matching information for matching with the first information of the first type based on at least a second feature of the second information and a third feature of the third information; comparing the verification information with a verification feature of the first information, and determining whether the certificate is a genuine certificate based on a result of the comparison; program.

Images