Certificate renewal system, certificate renewal method, server and program

Abstract

To ensure identification of a person as strictly as that of application at a counter when an electronic certificate of My Number Card is renewed by application via a photographic apparatus.SOLUTION: A photographic apparatus 2 is provided with renewal application accepting means 41 for accepting an application for renewal of an electronic certificate from an applicant by reading information on My Number Card of the applicant, photographing the face of the applicant, and transmitting the information on the My Number Card and the photographed face image of the applicant to a server 3. The server 3 is provided with certificate confirming means 51 which cooperates with an authentication server 4 to confirm whether or not the electronic certificate of the My Number Card received from the photographic apparatus 2 is valid; face authenticating means 52 which performs face authentication between the photographed face image received from the photographic apparatus 2 and a card face image; and renewal mediating means 53 which cooperates with the authentication server 4 to mediate renewal of the electronic certificate when the certificate confirming means 51 determines that the electronic certificate is valid and the face authenticating means 52 determines that the applicant is a person himself / herself.SELECTED DRAWING: Figure 5

Description

[Technical field]

[0001] The present invention relates to a certificate renewal system that renews an electronic certificate on a My Number card by application via a photographing device. [Background technology]

[0002] One method of applying for a new My Number card is to apply using a photo ID machine in the city (see Non-Patent Document 1). For example, the photo shooting device described in Patent Document 1 can prevent fraudulent applications in the same way as face-to-face application procedures by strictly verifying the identity of the applicant.

[0003] According to Non-Patent Document 2, the validity period of the My Number card itself is 10 years (5 years for minors), and the validity period of the electronic certificate stored in the card is 5 years. Those approaching the expiration date will be sent an expiration date notice approximately 2 to 3 months before the expiration date.

[0004] According to Non-Patent Document 3, the renewal of the My Number card itself can be applied for via the Internet using a smartphone, a photo ID machine, etc., by using the QR code (registered trademark) for online application on the application form sent together with the expiration date notice. Since a face photo taken within the last six months is required for the renewal of the My Number card itself, it is convenient to apply using a photo ID machine.

[0005] On the other hand, according to Non-Patent Document 4, while a photograph is not required to renew the electronic certificate stored in the My Number card, it is necessary to apply at the counter of each local government. The reason why applications at the counter are necessary is that if it were possible to renew electronic certificates and reset passwords via the Internet without strict identity verification, the risk of unauthorized renewal through impersonation would increase, which would in turn increase the risk of unauthorized electronic applications for various procedures, compromising the security of each procedure. Therefore, electronic certificate renewal is to be applied for at the counter, and strict identity verification will be carried out based on an identification document with a photograph. [Prior art documents] [Patent documents]

[0006] [Patent Document 1] JP 2022-115797 A [Non-patent literature]

[0007] [Non-Patent Document 1] Local Government Information Systems Agency, "How to apply using a photo ID machine in the city", [online], searched on June 19, 2023, Internet,<URL:https: / / www.kojinbango-card.go.jp / apprec / apply / photobooth_apply / > [Non-Patent Document 2] Local Government Information Systems Agency, "About updating My Number cards and electronic certificates," [online], searched on June 19, 2023, Internet,<URL: https: / / www.kojinbango-card.go.jp / 220401_2 / > [Non-Patent Document 3] Local Government Information Systems Agency, "My Number Card Renewal Procedures," [online], searched June 19, 2023, Internet,<URL:https: / / www.kojinbango-card.go.jp / hpsv / wpmng / documents / cardshinsei_A4.pdf> [Non-Patent Document 4] Local Government Information Systems Agency, "Procedure for updating electronic certificates", [online], searched on June 19, 2023, Internet,<URL: https: / / www.kojinbango-card.go.jp / hpsv / wpmng / documents / syoumeipamphlet_A4.pdf> Summary of the Invention [Problem to be solved by the invention]

[0008] However, it is inconvenient to have to apply at the counter of each local government during the reception hours, and there is a need to be able to apply for electronic certificate renewal at a more familiar location at any time. In particular, five years after the period when the number of applications for My Number cards was high, electronic certificates will be renewed all at once, so there is a high possibility that local government counters will be crowded, and it would be desirable to be able to apply for electronic certificate renewal at a location other than the local government counter.

[0009] However, it is difficult to prevent fraudulent activities such as impersonation when using personal digital cameras or smartphones. Therefore, it is desirable to utilize photo booths in town, which have a proven track record as a method for applying for new issuance and renewal of My Number cards. To achieve this, a system is needed that can guarantee strict identity verification equivalent to that required for in-person applications when updating the electronic certificate of a My Number card through a photo booth.

[0010] The present invention has been made in consideration of the above-mentioned problems, and its purpose is to provide a certificate renewal system etc. that can ensure strict identity verification equivalent to that required for an in-person application when renewing an electronic certificate on a My Number card through an application made via a photographing device. [Means for solving the problem]

[0011] A first invention for achieving the above-mentioned object is a certificate renewal system comprising a photographing device that photographs the face of an applicant applying for renewal of an electronic certificate of a My Number card, and a server connected to the photographing device via a network, wherein the photographing device comprises a renewal application acceptance means that reads the information on the applicant's My Number card, photographs the face of the applicant, and accepts an application for renewal of the electronic certificate from the applicant by transmitting the information on the My Number card and the photographed face image of the applicant to the server, and the server comprises a certificate confirmation means that cooperates with an authentication server that provides a public personal authentication service and confirms whether the electronic certificate received from the photographing device is valid, a face authentication means that performs face authentication between the photographed face image received from the photographing device and the card face image of the My Number card received from the photographing device, and an update intermediation means that cooperates with the authentication server and mediates the renewal of the electronic certificate when the certificate confirmation means determines that the electronic certificate is valid and the face authentication means determines that the applicant is the applicant in question. The certificate renewal system of the first invention can ensure strict identity verification equivalent to that required for in-person applications when renewing an electronic certificate on a My Number card by applying via a photographing device.

[0012] The update intermediation means in the first aspect of the invention preferably includes update request means for requesting the authentication server to update the electronic certificate, and update data transfer means for transmitting the update data for the electronic certificate to the photographing device upon receiving the update data for the electronic certificate from the authentication server, thereby mediating the update of the electronic certificate by the photographing device.

[0013] In addition, it is preferable that the update intermediation means in the first invention further includes an update application acceptance information storage means for storing the information on the My Number card including the card face image and the photographed face image as update application acceptance information, and an update application acceptance information transmission means for transmitting the update application acceptance information of the subject approved by the local government to the local government terminal when a request for obtaining the update application acceptance information is received from a local government terminal of a local government that approves the application for renewal of the electronic certificate. This makes it possible to include a flow in which a person in charge of the local government performs the approval work, thereby ensuring even stricter identity verification.

[0014] In addition, it is preferable that the renewal application acceptance information storage means in the first invention stores the similarity between the photographed face image and the face image on the card as the renewal application acceptance information, and the renewal application acceptance information transmission means transmits the similarity between the photographed face image and the face image on the card as the renewal application acceptance information to the local government terminal. This allows the local government personnel to refer to the results of face authentication by the system, allowing for more accurate identity verification.

[0015] In addition, the server in the first invention preferably further comprises a historical face image storage means for storing image data of a face photo of the applicant taken in the past by the photographing device as a historical face image, the renewal application acceptance information storage means stores the historical face image and the similarity between the photographed face image and the historical face image as the renewal application acceptance information, and the renewal application acceptance information transmission means transmits the historical face image and the similarity between the photographed face image and the historical face image to the local government terminal as the renewal application acceptance information. This allows the local government official to refer to the most recent face photo of the applicant taken in the past and the results of face authentication by the system between the most recent face photo and the face photo of the applicant taken at the time of application acceptance, thereby avoiding a misjudgment that the applicant is not the applicant even if he or she is actually the applicant due to an old face photo stored inside the My Number card.

[0016] In addition, the server in the first invention further includes a historical face image storage means for storing image data of a face photo of the applicant taken in the past by the photographing device as a historical face image, and the face authentication means preferably performs face authentication between the photographed face image and the card face image, as well as between the photographed face image and the historical face image. This makes it possible to prevent failure in identity verification due to the data of the face photo stored in the My Number card being out of date.

[0017] In addition, it is preferable that the face authentication means in the first invention suspends the identity verification of the applicant when the similarity between the photographed face image and the card face image minus the similarity between the photographed face image and the history face image is equal to or greater than a predetermined value. This makes it possible to prevent registration of an unauthorized image by impersonation even if the My Number card is stolen and the PIN number of the electronic certificate is leaked.

[0018] In addition, it is preferable that the photographing device in the first aspect of the invention further comprises an update data reflecting means for writing the update data of the electronic certificate to a memory area of ​​the My Number card when the update data of the electronic certificate is received from the server, thereby enabling the photographing device to update the electronic certificate.

[0019] The second invention is a certificate renewal method executed by a photographing device that photographs the face of an applicant who applies for renewal of an electronic certificate of a My Number card, and a server connected to the photographing device via a network, comprising: a renewal application acceptance step in which the photographing device reads information on the applicant's My Number card, photographs the face of the applicant, and transmits the My Number card information and the photographed face image of the applicant to the server, thereby accepting an application for renewal of the electronic certificate from the applicant; a certificate confirmation step in which the server cooperates with an authentication server that provides a public personal authentication service and confirms whether the electronic certificate received from the photographing device is valid; a face authentication step in which the server performs face authentication between the photographed face image received from the photographing device and the card face image of the My Number card received from the photographing device; and an update mediation step in which, if the server determines that the electronic certificate is valid in the certificate confirmation step and determines that the applicant is the principal in the face authentication step, it cooperates with the authentication server and mediates the renewal of the electronic certificate. By carrying out the certificate renewal method of the second invention, when updating the electronic certificate of a My Number card by applying via a photographing device, strict identity verification equivalent to that of an in-person application can be ensured.

[0020] The third invention is a server connected via a network to a photographing device that takes a photograph of the face of an applicant who applies for renewal of an electronic certificate of a My Number card, characterized in that the server includes a certificate confirmation means that cooperates with an authentication server that provides a public personal authentication service and confirms whether the electronic certificate received from the photographing device is valid, a face authentication means that performs face authentication between the photographed face image of the applicant received from the photographing device and the card face image of the My Number card received from the photographing device, and an update mediation means that cooperates with the authentication server and mediates the renewal of the electronic certificate when the certificate confirmation means determines that the electronic certificate is valid and the face authentication means determines that the applicant is the applicant. The certificate renewal system including the server of the third invention ensures strict identity verification equivalent to that of an in-person application when renewing an electronic certificate of a My Number card by application via a photographing device.

[0021] The fourth invention is a program for making a computer function as a server connected via a network to a photographing device that photographs the face of an applicant who applies for renewal of an electronic certificate of a My Number card, the program making the computer function as a certificate confirmation means that cooperates with an authentication server that provides a public personal authentication service and confirms whether the electronic certificate received from the photographing device is valid, a face authentication means that performs face authentication between the photographed face image of the applicant received from the photographing device and the card face image of the My Number card received from the photographing device, and an update mediation means that cooperates with the authentication server and mediates renewal of the electronic certificate when the certificate confirmation means determines that the electronic certificate is valid and the face authentication means determines that the applicant is the applicant. The server of the third invention can be constructed by installing the program of the fourth invention on a general-purpose computer. Effect of the Invention

[0022] The present invention makes it possible to provide a certificate renewal system etc. that can ensure strict identity verification equivalent to that required for in-person applications when updating an electronic certificate for a My Number card through an application made via a photographing device. [Brief description of the drawings]

[0023] [Figure 1] FIG. 1 is a diagram showing an overview of a certificate renewal system 1 according to a first embodiment. [Diagram 2] FIG. 2 is a diagram showing the external configuration of the photographing device 2. [Diagram 3] A block diagram showing the hardware configuration of the photographing device 2. [Figure 4] Block diagram showing the hardware configuration of Server 3 [Diagram 5] FIG. 1 is a block diagram showing a functional configuration of a certificate renewal system 1 according to a first embodiment. [Figure 6] 1 is a flowchart showing the flow of a certificate update process in the first embodiment. [Figure 7] FIG. 13 is a diagram for explaining a modified example of the face authentication means. [Figure 8] FIG. 1 shows an overview of a certificate renewal system 1a according to a second embodiment. [Figure 9] FIG. 1 is a block diagram showing a functional configuration of a certificate updating system 1a according to a second embodiment. [Figure 10] An example of data used in the certificate renewal system 1a according to the second embodiment [Figure 11] A flowchart showing the flow of renewal application reception processing in the second embodiment. [Figure 12] A flowchart showing the flow of a local government approval reception process in the second embodiment. [Figure 13] A flowchart showing the flow of update execution processing in the second embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0024] Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the drawings. The photographing device according to the present invention includes a stationary type passport photographing device installed in a storefront, a station, a street, etc., and a stationary type photographing device used for photographing for purposes other than passport photographing.

[0025] <First embodiment> FIG. 1 is a diagram showing an overview of a certificate renewal system 1 in a first embodiment. Hereinafter, an applicant means a person who applies for renewal of an electronic certificate of a My Number card. The certificate renewal system 1 is a system that includes a photographing device 2 that takes a photograph of the applicant's face, and a server 3 connected to the photographing device 2 via a network 7, and renews the electronic certificate of the My Number card by application via the photographing device 2. The server 3 is a server that manages the photographing device 2, and is connected to an external server not included in the certificate renewal system 1 via the network 7. Specifically, the server 3 is connected to an authentication server 4 that provides a public personal authentication service via the network 7.

[0026] The Japanese Public Key Infrastructure (JPKI) is a public service that uses electronic certificates to ensure the prevention of spoofing, tampering, and transmission repudiation, and enables identity verification and electronic applications over the Internet. Electronic certificates are issued based on the resident registration managed by the city, town, or village, and after strict face-to-face identity verification by the city, town, or village. The authentication server 4 is, for example, the Japan Agency for Local Authority Information Systems (J-LIS). This server is operated by NTT Communications (TSE: 6701).

[0027] There are two types of electronic certificates stored in the My Number Card: a signature electronic certificate that can be used to check whether a document has been tampered with when sending an electronic document over the Internet, and a user authentication electronic certificate that only certifies the identity of the user when browsing the Internet. In an embodiment of the present invention, the My Number Card's user authentication electronic certificate is used to certify that the facial image is definitely that of the applicant. Hereinafter, when both the signature electronic certificate and the user authentication electronic certificate are to be comprehensively described, they will simply be referred to as the "My Number Card's electronic certificate."

[0028] The network 7 includes a LAN (Local Area Network), a WAN (Wide Area Network) that is connected over a wider area, a public communication line such as the Internet, a base station, etc. The network 7 may be wired or wireless. Note that the network 7 may use a dedicated line or a virtual private network (VPN) as a secure communication line, as necessary.

[0029] FIG. 2 is a diagram showing the external configuration of the photographing device 2. As shown in FIG. 2, the photographing device 2 is a box-type device or the like that allows a person to enter the inside of a housing that is a photographing room to photograph and operate it. The form of the photographing device 2 is not limited to the box type, and may be an open type or a stand type. The photographing device 2 has a function of photographing a person in a photographing room as a subject, generating and printing an identification photo according to the purpose from the image (identification photo menu), printing an image received from a terminal such as a user's smartphone, or downloading and printing an image that the user has previously uploaded from the terminal to the server 3 (image print menu). In addition, the photographing device 2 has an application menu for carrying out application procedures for a driver's license, a My Number card, a residence card, a special permanent resident card, a passport, and the like. Furthermore, in the embodiment of the present invention, the photographing device 2 has an electronic certificate update menu for carrying out an update procedure for the electronic certificate of the My Number card. The user can select and use any of the ID photo menu, image print menu, application menu, electronic certificate update menu, and other menus.

[0030] The photographing device 2 shown in the example of Fig. 2 is a box type with an open side, and the outside is separated from the inside (photography room) by a curtain 28. An operation panel 21, a coin mechanism 22, a camera 23, a lighting unit 24, an audio output unit 27, a subject sensor 29, a My Number card reader 31, a document scanner 34, a code reader 35, etc. are provided on the front panel of the photography room. In addition, a control device 10, a printer 25, etc. are stored inside the housing of the photographing device 2, and printed materials printed by the printer 25 are discharged from a printed material outlet 26 provided on the outer wall panel of the photographing device 2.

[0031] Fig. 3 is a block diagram showing the hardware configuration of the photographing device 2. As shown in Fig. 3, the control device 10 of the photographing device 2 is connected to the lighting unit 24, the camera 23, the object sensor 29, the audio output unit 27, the operation panel 21, the coin mechanism 22, the printer 25, the reading device 31, the document scanner 34, the code reader 35, etc. via a bus, and the control device 10 controls each unit.

[0032] The control device 10 includes a control unit (CPU; Central Processing Unit) 101, an I / O (Input / Output) control 102, an I / F (Interface) 103, and a ROM (Read Only Memory). The control device 10 has an I / F 103, a memory 104, a RAM (Random Access Memory) 105, a storage unit 106, and a communication unit 107. The control device 10 is connected to an operation panel 21 and a voice output unit 27 via an I / O control 102. The control device 10 is also connected to a coin mechanism 22, a printer 25, a reading device 31, a document scanner 34, and a code reader 35 via an I / F 103.

[0033] The control unit 101 is a CPU and centrally controls each unit of the photography device 2. The control unit 101 loads programs stored in the storage unit 106, ROM 104, etc. into a work area on the RAM 105 and executes them. The ROM 104 is a non-volatile memory and permanently stores programs such as a boot program and BIOS, data, etc. The RAM 105 is a volatile memory and temporarily stores programs and data loaded from the storage unit 106, ROM 104, etc., and also includes a work area used by the control unit 101 to perform various processes.

[0034] The storage unit 106 is a hard disk drive, a solid state drive, a flash memory, or the like, and stores programs executed by the control unit 101 during processing described below, data necessary for executing the programs, an OS, etc. These programs and data are read and executed by the control unit 101 as necessary.

[0035] The I / O control 102 is an interface for inputting and outputting various information between the operation panel 21, the audio output unit 27, etc. The I / F 103 is an interface for inputting and outputting various information between the coin mechanism 22, the printer 25, the reading device 31, the document scanner 34, and the code reader 35.

[0036] The communication unit 107 includes a communication control device and a communication interface that control communication of the photography device 2. The photography device 2 is equipped with a wireless LAN such as Wi-Fi (registered trademark) or a short-range wireless communication such as Bluetooth (registered trademark), and is communicatively connected to the server 3 via the network 7.

[0037] The illumination unit 24 is a surface light source located in front of or behind the subject. The illumination unit 24 is connected to a light source (strobe) 241, and the timing and amount of light emission are controlled according to a control signal input from the control unit 101.

[0038] Camera 23 is a digital camera composed of an optical lens, an imaging element such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal-Oxide Semiconductor), an A / D (Analog / Digital) converter, etc. Camera 23 captures moving images or still images in accordance with a control signal input from control unit 101. Camera 23 inputs image data obtained by capturing images to control unit 101. Control unit 101 displays and outputs the image data input from camera 23 on the display of operation panel 21.

[0039] The operation panel 21 is an operation means of the photography device 2, and has a display for displaying an operation screen showing an operation procedure, a preview screen, etc., as well as a touch panel for a user to input operation instructions. The operation panel 21 performs display processing according to a display signal input from the control unit 101. Also, the operation panel 21 sends a control signal to the control unit 101 according to a touch operation on the touch panel.

[0040] The object sensor 29 is a sensor that detects a person in the photography room. When a person approaches the front panel of the photography device 2, the object sensor 29 outputs a detection signal to the control unit 101. As the object sensor 29, an optical sensor or the like consisting of a light emitter and a light receiver is used.

[0041] The audio output unit 27 acquires predetermined audio data (operation guidance audio, etc.) from the ROM 104 or the storage unit 106 in accordance with a control signal input from the control unit 101, and outputs the audio from a speaker.

[0042] The coin mech 22 is a cash register equipped with an inlet for coins and bills and an outlet for refunding change, and performs processing for settling the usage fee for the photography device 2. The coin mech 22 outputs information on the amount deposited through the inlet to the control unit 101, and discharges coins and bills according to the amount of change to the outlet in accordance with a control signal input from the control unit 101. Note that in addition to the coin mech 22, a payment processing unit for IC card payment or smartphone payment may be provided.

[0043] Printer 25 prints the image data of the photographed photo on a predetermined sheet of paper in accordance with a control signal input from control unit 101. Printer 25 is a high-resolution color printer, and any type of printer, such as dye-sublimation type or melt type, is acceptable.

[0044] The reading device 31 is a device that reads information on the My Number card. Specifically, the reading device 31 includes a face scanner 32 that performs an image scan to read information on the face (front and back) of the My Number card, and an IC chip reader / writer 33 (such as a non-contact / contact IC reader / writer) that reads data recorded on an IC chip inside the My Number card and writes data to the IC chip inside the My Number card. The face scanner 32 may include a UV / IR scanner that uses ultraviolet (UV) or infrared (IR) as a light source, in addition to a typical image scanner that uses white light as a light source. The IC chip of the My Number card has a free area that is a memory area that is not protected by a secret code and a locked area that is a memory area that is protected by a secret code. The reading device 31 can read and write data in the free area and the locked area. The reading device 31 inputs image data of the face of the My Number card read by the face scanner 32 to the control unit 101. Furthermore, the reading device 31 inputs data read by the IC chip reader / writer 33 to the control unit 101. Furthermore, the reading device 31 writes data output from the control unit 101 by the IC chip reader / writer 33 into the IC chip inside the My Number card.

[0045] The document scanner 34 is a scanner that optically reads paper of approximately A4 size (210 mm×297 mm). The document scanner 34 reads documents used in application procedures and inputs the read document data to the control unit 101. The code reader 35 is a device that reads two-dimensional codes such as QR codes (registered trademark) and bar codes, and inputs the read code information to the control unit 101.

[0046] Fig. 4 is a block diagram showing the hardware configuration of the server 3. As shown in Fig. 4, the server 3 is composed of a control unit 301, a storage unit 302, a communication unit 303, an input unit 304, a display unit 305, a peripheral device I / F unit 306, etc., and these hardware units are connected by a bus 307. However, the configuration of the server 3 is not limited to this, and various configurations can be used as appropriate.

[0047] The control unit 301 is composed of a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), etc. The CPU loads programs stored in the storage unit 302, the ROM, a recording medium, etc. into a work memory area on the RAM and executes them, and drives and controls each unit connected via a bus 307. The ROM permanently stores programs such as the computer's boot program and BIOS, data, etc. The RAM temporarily stores loaded programs and data, and also has a work area used by the control unit 301 to perform various processes. The control unit 301 functions as each means of the server 3, which will be described later, by reading and executing the above programs.

[0048] The storage unit 302 is, for example, a storage device such as a hard disk drive, a solid state drive, or a flash memory. The storage unit 302 stores programs executed by the control unit 301, data necessary for executing the programs, an operating system, and the like. These program codes are read out as necessary by the control unit 301 and transferred to the RAM, and are read out and executed by the CPU. The storage unit 302 stores data used in the certificate renewal system 1.

[0049] The communication unit 303 has a communication control device and a communication port, and controls communication with the network 7, etc. The input unit 304 is, for example, a pointing device such as a keyboard or a mouse, or a touch panel integrated with a display, and inputs data to the control unit 301. The display unit 305 is composed of a display device such as a liquid crystal panel, and a logic circuit (such as a video adapter) for executing display processing in cooperation with the display device, and displays display data input under the control of the control unit 301 on the display device. The peripheral device I / F unit 306 is a port for connecting a peripheral device, and transmits and receives data to and from the peripheral device via the peripheral device I / F unit 306. The connection with the peripheral device may be wired or wireless.

[0050] 5 is a block diagram showing the functional configuration of the certificate renewal system 1 in the first embodiment. The functional configuration of the certificate renewal system 1 is made up of each unit included in the photographing device 2 and each unit included in the server 3.

[0051] The photographing device 2 includes a renewal application receiving means 41 and an update data reflecting means 42. The renewal application receiving means 41 reads the information on the applicant's My Number card, takes a photograph of the applicant's face, and transmits the My Number card information and the photographed face image of the applicant to the server 3, thereby receiving an application for renewal of the electronic certificate from the applicant. Furthermore, upon receiving update data for the electronic certificate from the server 3, the update data reflecting means 42 writes the update data for the electronic certificate in the memory area of ​​the My Number card.

[0052] The information on the applicant's My Number card is data recorded on an IC chip inside the My Number card that is read by the IC chip reader / writer 33. The photographed face image of the applicant is face image data of the applicant captured by the camera 23 of the photographing device 2. The renewal application receiving means 41 may transmit the photographing date and time of the photographed face image to the server 3.

[0053] The IC chip of the My Number Card contains four applications: the "Public Personal Authentication AP", "Card Information Confirmation AP", "Card Input Assistance AP", and "Resident Registration Network AP", as well as free space for municipal and other government agencies to provide their own services. The Public Personal Authentication AP records an electronic certificate for signature and its PIN, and an electronic certificate for user authentication and its PIN. The Card Information Confirmation AP records image data of the information recorded on the card and its verification number. The image data of the information recorded on the card is image data of the front information (= four pieces of information (address, name, date of birth, gender) and a facial photo) and image data of the back information (= personal number). The Card Input Assistance AP records text data of the information recorded on the card, its PIN, and verification number. The text data of the information recorded on the card is the personal number, the four pieces of information, and their electronic signature data. The Resident Registration Network AP records the resident record code and its PIN.

[0054] The detailed format of the signature electronic certificate and the user authentication electronic certificate is in accordance with the X.509 standard established by ITU-T (International Telecommunication Union-Telecommunication Standardization Sector). The user public personal authentication service (JPKI) provided by the authentication server 4 employs a public key cryptosystem. In the public key cryptosystem, a private key and a public key are paired, and data encrypted with one key can only be decrypted with the other key. In the IC chip of the current My Number card, a PIN, an RSA private key, an RSA public key, a certificate conforming to the X.509 standard, a certificate of a certification authority conforming to the X.509 standard, etc. are stored for each signature electronic certificate and user authentication electronic certificate. The "update data of the electronic certificate" written to the IC chip by the update data reflecting means 42 includes these pieces of information. The private key never leaves the area stored in the IC chip, and the IC chip is broken if an attempt is made to forcibly read the private key.

[0055] The server 3 includes a certificate confirmation means 51, a face authentication means 52, and an update intermediation means 53. The certificate confirmation means 51 cooperates with the authentication server 4 to confirm whether or not the electronic certificate received from the photographing device 2 is valid. The face authentication means 52 performs face authentication between the photographed face image received from the photographing device 2 and the card face image of the My Number card received from the photographing device 2. When the certificate confirmation means 51 determines that the electronic certificate is valid and the face authentication means 52 determines that the applicant is the principal, the update intermediation means 53 cooperates with the authentication server 4 to mediate the update of the electronic certificate. By including the certificate confirmation means 51, the face authentication means 52, and the update intermediation means 53 in the server 3, strict identity confirmation equivalent to that of an application in front of a counter can be ensured.

[0056] The card face image stored in the applicant's My Number card is image data of the face photo on the front side recorded in the card face information confirmation AP in the IC chip of the My Number card, or image data including the face photo on the front side of the My Number card read by the card face scanner 32. In order to prevent unauthorized use of counterfeit cards with replaced photos, the former image data in the IC chip is preferable.

[0057] The update intermediation means 53 in the first embodiment includes update request means 531 and update data transfer means 532. When the certificate verification means 51 determines that the electronic certificate is valid and the face authentication means 52 determines that the applicant is the principal, the update request means 531 requests the authentication server 4 to update the electronic certificate. On receiving update data for the electronic certificate from the authentication server 4, the update data transfer means 532 transmits the update data for the electronic certificate to the photograph device 2.

[0058] The server 3 may also include a history face image storage means 54. The history face image storage means 54 stores image data of a facial photograph of the applicant taken in the past by the photographing device 2 as a history face image. For example, after the applicant's facial photograph is taken using various menus of the photographing device 2, if both the validity of the electronic certificate by the certificate verification means 51 and the face authentication by the face authentication means 52 are successful, the history face image storage means 54 stores the image data of the applicant's facial photograph as a history face image together with the photographing date and time and information identifying the person in the facial photograph. Also, for example, after the update intermediation means 53 mediates the update of the electronic certificate, the history face image storage means 54 stores the photographed facial image in the storage unit 302 as a history face image together with the photographing date and time and information identifying the applicant.

[0059] In addition, the renewal application acceptance means 41 of the photographing device 2 may transmit the information of the My Number card and the photographed face image at different timings, or may transmit them at the same timing. For example, the renewal application acceptance means 41 may first transmit the information of the My Number card, and after the certificate confirmation means 51 determines that the electronic certificate of the My Number card is valid, the renewal application acceptance means 41 may transmit the photographed image, and the face authentication means 52 may perform face authentication between the photographed face image and the card face image. In addition, for example, the renewal application acceptance means 41 may transmit the information of the My Number card and the photographed face image, the certificate confirmation means 51 may confirm the validity of the electronic certificate of the My Number card, and the face authentication means 52 may perform face authentication between the photographed face image and the card face image. To avoid confusion, the following description will be given assuming that the information of the My Number card and the photographed face image are transmitted at the latter timing (=transmitted at the same timing).

[0060] 6 is a flowchart showing the flow of the certificate renewal process in the first embodiment. In the first embodiment, the certificate renewal system 1 automatically renews the electronic certificate without the need for approval by a person in charge of the local government.

[0061] The control unit 101 of the photographing device 2 accepts the selection of the electronic certificate renewal menu from the applicant, and when the My Number card is held up to the IC chip reader / writer 33, the IC chip reader / writer 33 reads the data recorded in the IC chip inside the My Number card (step S1). Here, the IC chip reader / writer 33 reads the image data of the face photo (=card face image) recorded in the card information confirmation AP in the IC chip of the My Number card, and inputs it to the control unit 101. In addition, the control unit 101 accepts input of the password for the user authentication electronic certificate via the operation panel 21 in order to read the information of the user authentication electronic certificate recorded in the public personal authentication AP in the IC chip of the My Number card. If the password input by the applicant matches the information stored in the IC chip of the My Number card, the IC chip reader / writer 33 reads the information of the user authentication electronic certificate and inputs it to the control unit 101.

[0062] Next, the control unit 101 of the photographing device 2 displays photographing instructions, face alignment operations, etc. on the operation panel 21, and outputs guidance audio to the audio output unit 27 to provide guidance for photographing to the applicant. Thereafter, the control unit 101 takes a still image of the applicant's face with the camera 23 (step S2), generates still image data, and stores it in a predetermined folder in the RAM 105 or the storage unit 106 as a photographed face image together with the date and time of shooting.

[0063] Next, the control unit 101 of the photographing device 2 transmits the My Number card information, the photographed face image, etc. to the server 3 via the communication unit 107 (step S3). More specifically, the control unit 101 transmits the My Number card information (including information for identifying the applicant, the face image on the card, and information on the electronic certificate), the photographed face image, and the photographing date and time to the server 3.

[0064] Next, the control unit 301 of the server 3 transmits a validity confirmation inquiry of the information of the electronic certificate received from the photographing device 2 to the authentication server 4 (step S4). The authentication server 4 confirms the validity of the electronic certificate received from the server 3 (step S5) and transmits the confirmation result to the server 3 (step S6).

[0065] In steps S3 to S6, the photographing device 2, the server 3, and the authentication server 4 verify the validity of the electronic certificate for user authentication of the applicant's Individual Number Card by a known procedure using a public key cryptosystem. The known procedure is as follows: 1. The server 3 generates a random number and sends it to the photographing device 2. 2. The photographing device 2 converts the random number with the private key in the Individual Number Card. 3. The photographing device 2 transmits the random number body, the converted random number, and the electronic certificate (public key) to the server 3. 4. The server 3 decrypts the converted random number with the electronic certificate (public key). 5. The server 3 compares the decoded random number with the random number body to detect whether it has been tampered with. 6. The server 3 inquires of the authentication server 4 about the validity of the electronic certificate. 7. The authentication server 4 verifies the validity of the electronic certificate and returns the verification result to the server 3. Comparing these procedures with steps S3 to S6, the photographing device 2 and the server 3 execute procedures 1 to 5 in step 3.

[0066] Next, the control unit 301 of the server 3 checks whether the check result of the validity of the electronic certificate received from the authentication server 4 indicates validity (step S7). If the control unit 301 of the server 3 determines that the check result is invalid (No in step S7), it transmits an error notification to the photographing device 2 (step S8). The control unit 101 of the photographing device 2 displays the error notification received from the server 3 on the operation panel 21 (step S9), and ends the process or repeats from step S1 according to the applicant's instructions. On the other hand, if the control unit 301 of the server 3 determines that the check result is valid (Yes in step S7), it proceeds to step S10.

[0067] Next, the control unit 301 of the server 3 executes face recognition processing of the photographed face image and the card face image both received from the photographing device 2 (step S10). The control unit 301 of the server 3 may use a known face recognition technology provided by an API (Application Programming Interface) or the like, or may use its own face recognition technology. In either case, the control unit 301 of the server 3 calculates the similarity between the photographed face image and the card face image by the face recognition technology, compares the calculated similarity with a predetermined threshold, and if the similarity exceeds the predetermined threshold, determines that the face recognition is successful, that is, that the applicant is the applicant.

[0068] If the control unit 301 of the server 3 determines that the facial authentication has failed, that is, that the applicant is not the applicant (No in step S11), it sends an error notification to the photographing device 2 (step S12). The control unit 101 of the photographing device 2 displays the error notification received from the server 3 on the operation panel 21 (step S13), and either ends the process or repeats from step S1 according to an instruction from the applicant. On the other hand, if the control unit 301 of the server 3 determines that the facial authentication has been successful, that is, that the applicant is the applicant (Yes in step S11), it proceeds to step S14.

[0069] Next, the control unit 301 of the server 3 transmits an update request for the electronic certificate to the authentication server 4 (step S14). For example, if the operating entity (such as the Local Government Information Systems Agency) that operates the authentication server 4 provides an update request API for updating the electronic certificate, the control unit 301 of the server 3 transmits an update request for the electronic certificate to the authentication server 4 using this update request API. However, the exchange between the server 3 and the authentication server 4 shall ensure a high level of security.

[0070] Next, the authentication server 4 generates a private key and a public key, issues a digital certificate (step S15), and transmits update data for the digital certificate to the server 3 (step S16). The process of issuing the digital certificate may be performed by a server other than the authentication server 4, such as a server managed by each local government.

[0071] When the control unit 301 of the server 3 determines that the issuance of the electronic certificate has failed (No in step S17), it transmits an error notification to the photographing device 2 (step S18). The control unit 101 of the photographing device 2 displays the error notification received from the server 3 on the operation panel 21 (step S19), and ends the process or repeats the process from step S1 according to the applicant's instruction. On the other hand, when the control unit 301 of the server 3 determines that the issuance of the electronic certificate has succeeded (Yes in step S17), it stores the photographed face image as a historical face image in the storage unit 302 in association with the information identifying the applicant and the photographing date and time (step S20), and transmits update data of the electronic certificate to the photographing device 2 (step S21). The control unit 101 of the photographing device 2 writes the update data of the electronic certificate received from the server 3 into the storage area of ​​the My Number card by the IC chip reader / writer 33 (step S22), and terminates the process.

[0072] In step S20, the control unit 301 of the server 3 may delete the previously stored history facial images and store only the latest history facial image in the memory unit 302, or may not delete the previously stored history facial images, but add the latest history facial image and store it in the memory unit 302, thereby managing multiple image data for each applicant.

[0073] In the certificate renewal process shown in Figure 6, in addition to checking the validity of the electronic certificate, facial authentication is performed between the photographed face image and the face image on the card, ensuring strict identity verification equivalent to that of an in-person application.

[0074] Fig. 7 is a diagram for explaining a modified example of the face authentication means. Fig. 7(a) explains the process in step S10 described above. As described above, the control unit 301 of the server 3 calculates the similarity between the photographed face image 61a and the card face image 62 by face authentication technology, and compares the calculated similarity with a predetermined threshold. In the example of Fig. 7(a), since the similarity exceeds the threshold, the control unit 301 of the server 3 determines that the face authentication is successful, that is, that the applicant is the applicant.

[0075] The validity period of the My Number card itself is 10 years for adults. In other words, the image data of the face photo (= card face image) recorded in the card information verification AP in the My Number card's IC chip is a face photo from up to 10 years ago. In that case, even if it is actually the same person, there may be cases where the similarity calculated by the face recognition technology does not exceed a certain threshold.

[0076] FIG. 7(b) shows a first modified example of the face authentication means 52 for dealing with this case. In the first modified example, the control unit 301 (=face authentication means 52) of the server 3 performs face authentication between the photographed face image 61b and the card face image 62, and also performs face authentication between the photographed face image 61b and the most recent history face image 63 stored by the history face image storage means 54. Then, when either the similarity between the photographed face image 61b and the card face image 62 or the similarity between the photographed face image 61b and the history face image 63 exceeds a threshold, the control unit 301 of the server 3 determines that the face authentication is successful, that is, that the applicant is the applicant. In the example of FIG. 7(b), the similarity between the photographed face image 61b and the card face image 62 is equal to or less than the threshold, but the similarity between the photographed face image 61b and the history face image 63 exceeds the threshold, so the control unit 301 of the server 3 determines that the face authentication is successful, that is, that the applicant is the applicant.

[0077] In addition, although it is a rare case, if the My Number card is stolen and the PIN number of the electronic certificate for user authentication is leaked, the electronic certificate may be illegally renewed. In this case, a fraudulent applicant may use makeup to resemble the face photograph on the front of the My Number card and use the certificate renewal system 1.

[0078] FIG. 7(c) shows a second modified example of the face authentication means 52 for dealing with this case. In the second modified example, the control unit 301 (=face authentication means 52) of the server 3 performs face authentication between the photographed face image 61c and the card face image 62, and also performs face authentication between the photographed face image 61c and the most recent history face image 63 stored by the history face image storage means 54. Then, when the value obtained by subtracting the similarity between the photographed face image 61c and the card face image 62 from the similarity between the photographed face image 61c and the history face image 63 is equal to or greater than a predetermined value, that is, when the photographed face image 61c is similar to the card face image 62 but not very similar to the history face image 63, the control unit 301 of the server 3 suspends the identity verification of the applicant. This is because it is unnatural that the card face image 62 is similar only to the card face image 62, even though it was taken earlier than the history face image 63.

[0079] When the identity verification of the applicant is suspended, the control unit 301 of the server 3 may request retaking the photograph or the presentation of another identity verification document other than the My Number card. For example, the control unit 301 of the server 3 may request the presentation of another identity verification document with a face photo (such as a driver's license), scan the face photo on the other identity verification document using the card scanner 32, and perform face authentication with the photographed face image 61c.

[0080] <Second embodiment> In the second embodiment, rather than having the system automatically renew the electronic certificate, the system is deliberately semi-automated, including the flow in which a local government official performs the approval process, to ensure stricter identity verification. Therefore, in the second embodiment, first, an application for renewal from an applicant is accepted by renewal application acceptance processing. Next, approval from a local government official is accepted by local government approval acceptance processing. Finally, renewal of the electronic certificate of the My Number card is executed by update execution processing.

[0081] FIG. 8 is a diagram showing an overview of a certificate renewal system 1a in the second embodiment. The certificate renewal system 1a includes a photographing device 2a and a server 3a connected to the photographing device 2a via a network 7. The server 3a is connected to an authentication server 4 via the network 7. The server 3a is also connected to a local government terminal 5 used by a local government official who approves an application for renewal of an electronic certificate via the network 7. Furthermore, the server 3a can transmit data (email, message, etc.) to an applicant terminal 6 used by an applicant via the network 7 and an external server (email server, SMS (Short Message Service) server, etc.). The hardware configurations of the photographing device 2a and the server 3a in the second embodiment are similar to those of the photographing device 2a and the server 3a in the first embodiment shown in FIGS. 2 to 4, and therefore will not be described.

[0082] 9 is a block diagram showing the functional configuration of a certificate renewal system 1a in the second embodiment. The functional configuration of the certificate renewal system 1a is made up of each means provided in the photographing device 2a and each means provided in the server 3a.

[0083] The photographing device 2a includes an update application receiving means 41, an update request receiving means 43, and an update data reflecting means 42. The update application receiving means 41 and the update data reflecting means 42 are the same as those in the first embodiment. The update request receiving means 43 reads the information on the My Number card of an applicant approved by a local government official, and transmits the My Number card information to the server 3a, thereby receiving a request for updating the electronic certificate from the applicant.

[0084] The server 3a includes a certificate confirmation means 51, a face authentication means 52, an update intermediation means 53a, and a historical face image storage means 54. The certificate confirmation means 51 and the face authentication means 52 are the same as those in the first embodiment. When the certificate confirmation means 51 determines that the electronic certificate is valid and the face authentication means 52 determines that the applicant is the applicant, the update intermediation means 53a cooperates with the authentication server 4 to mediate the update of the electronic certificate. By including the certificate confirmation means 51, the face authentication means 52, and the update intermediation means 53a in the server 3a, strict identity verification equivalent to that of an application in front of a counter can be ensured. The server 3a may also include a historical face image storage means 54 similar to that in the first embodiment.

[0085] The update intermediation means 53 a in the second embodiment includes an update application acceptance information storage means 533 , an update application acceptance information transmission means 534 , a local government approval acceptance means 535 , an approval completion notification means 536 , an update request means 531 a , and an update data transfer means 532 .

[0086] When the certificate verification means 51 judges that the electronic certificate is valid and the face authentication means 52 judges that the applicant is the principal, the renewal application acceptance information storage means 533 stores the information of the My Number card including the card face image and the photographed face image as renewal application acceptance information. The renewal application acceptance information storage means 533 may also store the similarity between the photographed face image and the card face image as the renewal application acceptance information. The renewal application acceptance information storage means 533 may also store the history face image and the similarity between the photographed face image and the history face image as the renewal application acceptance information.

[0087] When the renewal application acceptance information transmitting means 534 receives a request to obtain renewal application acceptance information from the local government terminal 5, it transmits renewal application acceptance information of the subject to be approved by the local government to the local government terminal 5. The renewal application acceptance information transmitting means 534 may also transmit the similarity between the photographed face image and the card face image as the renewal application acceptance information to the local government terminal 5. The renewal application acceptance information transmitting means 534 may also transmit the history face image and the similarity between the photographed face image and the history face image as the renewal application acceptance information to the local government terminal 5.

[0088] The local government approval receiving means 535 receives an instruction for approval from the local government terminal 5. When the instruction for approval is received by the local government approval receiving means 535, the approval completion notifying means 536 notifies the applicant that the approval has been completed. The approval completion notifying means 536, for example, sends an email to an email address that is registered in advance, sends an SMS message to a mobile phone number that is registered in advance, or cooperates with MynaPortal (registered trademark) to notify via MynaPortal. MynaPortal is an online service operated by the government and has online application and reference functions. The functions provided by this online service can be used by not only government agencies but also private organizations such as companies and civic groups through the MynaPortal API.

[0089] When the update request means 531a receives a request to update the electronic certificate from the photographing device 2a, it requests the authentication server 4 to update the electronic certificate. The update data transfer means 532 is the same as in the first embodiment.

[0090] Fig. 10 is an example of data used in the certificate renewal system 1a in the second embodiment. The renewal application reception table 70 shown in Fig. 10 stores renewal application reception information. The data items included in the renewal application reception table 70 are an application ID 71, personal identification information 72, local government identification information 73, photographed face image file path 74, card face image file path 75, similarity 76 between the photographed face image and the card face image, history face image file path 77, photographing date and time 78 of the history face image, similarity 79 between the photographed face image and the history face image, status 80, mobile phone number 81, etc.

[0091] The application ID 71 is automatically numbered and is the main key of the renewal application reception table 70. The personal identification information 72 is the personal identification information of the user's My Number card, for example, My Key ID (registered trademark). The My Key ID is created arbitrarily in response to the electronic certificate of the My Number card, is stored in the memory area of ​​the My Number card, and can be widely used including private companies. The personal identification information 72 is preferably stored in a hashed state with a salt added. The local government identification information 73 is information for identifying a local government, for example, a city, ward, town, and village code. The photographed face image file path 74 is a character string indicating a memory area on the memory unit 302 in which the file of the photographed face image is stored. The card face image file path 75 is a character string indicating a memory area on the memory unit 302 in which the file of the card face image is stored. The similarity 76 between the photographed face image and the card face image is the similarity between the photographed face image and the card face image calculated by the face authentication means 52.

[0092] The history face image file path 77 is a character string indicating a storage area on the storage unit 302 in which the file of the history face image is stored. The photographing date and time 78 of the history face image is the date and time when the history face image was photographed by the photographing device 2a. The similarity 79 between the photographed face image and the history face image is the similarity between the photographed face image and the history face image calculated by the face authentication means 52. The status 80 indicates the approval status by the local government, for example, "waiting for approval", "approved", "approval pending", "not approved", etc. The mobile phone number 81 is the destination of an SMS message notifying the approval result of the local government, and is the mobile phone number of the applicant. Note that the applicant's email address may be used instead of the mobile phone number 81. In addition, if the approval result of the local government is notified via Mynaportal, it is not necessary to register a mobile phone number or email address.

[0093] Fig. 11 is a flow chart showing the flow of the renewal application reception process in the second embodiment. Steps S31 to S43 shown in Fig. 11 are the same as steps S1 to S13 shown in Fig. 6, so the explanation will be omitted. In step S33, the photography device 2a may accept input of a mobile phone number or email address from the applicant as a notification destination of the approval result of the local government, and transmit it to the server 3a.

[0094] As shown in FIG. 11, when the face authentication is successful, that is, when the applicant is determined to be the same person (Yes in step S41), the control unit 301 of the server 3a stores the renewal application acceptance information (step S44).

[0095] In order to store the renewal application reception information in the renewal application reception table 70, the control unit 301 of the server 3a automatically assigns an application ID 71, sets information identifying the applicant (for example, My Key ID) as personal identification information 72, and specifies local government identification information 73 from the address of the applicant. The information identifying the applicant and the address of the applicant are included in the information of the My Number card received from the photographing device 2a. Furthermore, the control unit 301 of the server 3a names a file name of the photographed face image based on the application ID 71, stores the photographed face image received from the photographing device 2a in a predetermined folder in step S33, and sets the file path as the photographed face image file path 74. Similarly, the control unit 301 of the server 3a names a file name of the card face image based on the application ID 71, stores the card face image received from the photographing device 2a in a predetermined folder in step S33, and sets the file path as the card face image file path 75. Furthermore, the control unit 301 of the server 3a sets the calculation result in the face recognition process in step S40 as the similarity 86 between the photographed face image and the card face image.

[0096] Furthermore, when the control unit 301 of the server 3a calculates the similarity between the photographed face image and the history face image in the face recognition process of step S40, it stores the history face image file path 77, the photographing date and time 78 of the history face image, and the similarity 79 between the photographed face image and the history face image in the update application reception table 70. Then, the control unit 301 of the server 3a sets the status 80 to "waiting for approval" and stores the mobile phone number received from the photographing device 2a in step S33 in the mobile phone number 81.

[0097] Next, the control unit 301 of the server 3a transmits a reception completion notification to the photographing device 2a (step S45). The control unit 101 of the photographing device 2a displays the reception completion notification received from the server 3a on the operation panel 21 (step S46), and ends the process.

[0098] FIG. 12 is a flowchart showing the flow of the local government approval reception process in the second embodiment. Before the local government approval reception process, a person in charge of the local government logs in to a management screen (not shown) provided by the server 3a via the local government terminal 5. As shown in FIG. 12, when the local government terminal 5 transmits an acquisition request for renewal application reception information to the server 3a (step S51), the control unit 301 of the server 3a searches for the target renewal reception information from the renewal application reception table 70 based on the local government identification information included in the acquisition request received from the server 3a (step S52), and transmits a list of the target renewal reception information to the local government terminal 5 (step S53). The renewal reception information transmitted to the local government terminal 5 includes at least the photographed face image and the card face image of the applicant.

[0099] The local government terminal 5 displays a list of the renewal reception information received from the server 3a (step S54). The local government official checks the photographed face image and the card face image of the applicant displayed on the local government terminal 5, and verifies the identity of the applicant. If the local government official determines that the applicant is definitely the applicant, he / she inputs an approval instruction. The local government terminal 5 transmits the input approval instruction to the server 3a (step S55). The control unit 301 of the server 3a updates the status 80 of the renewal application reception table 70 related to the target renewal reception information from "waiting for approval" to "approved" (step S56). Then, the control unit 301 of the server 3a notifies the applicant of the completion of approval based on a predetermined notification method (sending an SMS message, sending an email, notifying the My Number Portal, etc.) (step S57). The control unit 301 of the server 3a transmits a notification of the completion of the status change to the local government terminal 5, and the local government terminal 5 displays a screen indicating the completion of the status change.

[0100] In step S53, the control unit 301 of the server 3a may further transmit the similarity between the photographed face image and the face image on the card as renewal application acceptance information. This allows the local government official to refer to the result of face authentication by the server 3a and perform more accurate identity verification.

[0101] In step S53, the control unit 301 of the server 3a may further transmit the history face image and the similarity between the photographed face image and the history face image to the local government terminal 5 as renewal application acceptance information. This allows the local government official to refer to the history face image and the similarity between the photographed face image and the history face image, so that even if the card face image is old and the similarity with the photographed face image is not high, identity confirmation can be performed by comparing the photographed face image with the history face image. This makes it possible to avoid a misjudgment that a person is not the person in question due to an old card face image, even if the person is actually the person in question.

[0102] For example, even if the similarity 76 between the photographed face image and the face image on the card is not very high, as in the data in the second row (= application ID 71 is "A2") of the renewal application reception table 70 shown in Figure 10, if the similarity 79 between the photographed face image and the historical face image is high, a local government official can determine that the person is the actual person by comparing the photographed face image with the historical face image.

[0103] Also, for example, like the data in the third row (=application ID 71 is "A3") of the renewal application reception table 70 shown in Fig. 10, even if the similarity 76 between the photographed face image and the card face image is relatively high, if the similarity 79 between the photographed face image and the history face image is too low, the local government official can be made aware that the application may be fraudulent. In such a case, the local government official may ask the applicant to come to the counter and submit other identification documents.

[0104] Fig. 13 is a flow chart showing the flow of update execution processing in the second embodiment. As shown in Fig. 13, the control unit 101 of the photographing device 2a accepts the selection of the electronic certificate update menu from the user, and when the My Number card is held up to the IC chip reader / writer 33, the IC chip reader / writer 33 reads the data recorded in the IC chip inside the My Number card (step S61). The specific processing content of step S61 is the same as step S1 shown in Fig. 6.

[0105] Next, the control unit 101 of the photographing device 2a accepts a selection from the user as to whether or not the renewal application has been applied for, and when the user selects that the renewal application has been applied for, transmits the My Number card information to the server 3a (step S62). Steps S63 to S68 are the same as steps S4 to S9 shown in FIG. 6, and therefore the description thereof will be omitted.

[0106] Next, the control unit 301 of the server 3a searches the renewal application reception table 70 to check whether the target renewal application reception information has been approved, that is, whether the status 80 is "approved" (step S69).

[0107] If the control unit 301 of the server 3a determines that the request has not been approved (No in step S70), it sends an error notification to the photography device 2a (step S71). The control unit 101 of the photography device 2a displays the error notification received from the server 3a on the operation panel 21 (step S72), and ends the process or repeats the process from step S61 according to an instruction from the user. On the other hand, if the control unit 301 of the server 3a determines that the request has been approved (Yes in step S70), it proceeds to step S73. Steps S73 to S80 are the same as steps S14 to S19, S21, and S22 shown in FIG. 6, and therefore will not be described here.

[0108] Before the update execution process, the control unit 301 of the server 3a may transmit data on the application approved by the person in charge of the local government to the authentication server 4 by nighttime batch processing once a day, etc. This allows the authentication server 4 to check whether or not the certificate can be issued in step S74. In this case, the authentication server 4 may check whether or not the certificate can be issued in place of the process of step S70, or may check as a double check after the process of step S70 has also been performed.

[0109] As described above, according to the certificate renewal system 1, 1a in an embodiment of the present invention, when the electronic certificate of the My Number Card is renewed by application via the photographing device 2, 2a, the validity of the electronic certificate of the My Number Card is confirmed in cooperation with the authentication server 4, and facial authentication is performed using the card face image etc. stored on the My Number Card, thereby ensuring strict identity verification equivalent to that of an application at a counter.

[0110] Although it is difficult to completely prevent spoofing by only reading the My Number card and inputting the PIN, the certificate renewal system 1, 1a in the embodiment of the present invention performs unique face authentication and confirms that the subject photographed by the photographing device 2, 2a matches the face photo on the My Number card, ensuring security equivalent to that of human visual identity verification at the window of an administrative agency, etc. In particular, by using the face photo data stored inside the My Number card, it is possible to deal with counterfeit cards where the photo has been cleverly replaced.

[0111] In addition, in the certificate renewal system 1a in the second embodiment, the electronic certificate is not automatically renewed by the system, but the approval work is performed by a local government official, and by deliberately making it semi-automatic, it is possible to ensure strict identity verification equivalent to that of an in-person application. The local government official can verify the identity of the applicant by comparing the facial photograph of the applicant taken at the time of acceptance of the application with the facial photograph stored inside the My Number card. In addition, the local government official can also refer to the results of face authentication by the system, so that identity verification can be performed more accurately. Furthermore, the local government official can also refer to the most recent facial photograph of the applicant taken in the past, and the results of face authentication by the system between the most recent facial photograph and the facial photograph of the applicant taken at the time of acceptance of the application, so that it is possible to avoid a misjudgment that the applicant is not the applicant even if he or she is actually the applicant due to an old facial photograph stored inside the My Number card.

[0112] In step S53, the control unit 301 of the server 3a may further transmit the history face image and the similarity between the photographed face image and the history face image to the local government terminal 5 as renewal application acceptance information. This allows the local government official to refer to the history face image and the similarity between the photographed face image and the history face image, so that even if the card face image is old and the similarity with the photographed face image is not high, identity confirmation can be performed by comparing the photographed face image with the history face image. This makes it possible to avoid a misjudgment that a person is not the person in question due to an old card face image, even if the person is actually the person in question.

[0113] Furthermore, in the certificate renewal system 1, 1a according to the embodiment of the present invention, in addition to performing face authentication with the face photo stored in the My Number card, face authentication is also performed with face images previously taken using this system for the face image taken on the spot. This makes it possible to prevent failures in identity verification due to the face photo data stored in the My Number card being out of date. For example, if the latest face image is registered using the certificate renewal system 1, 1a every year, it is possible to reliably prevent failures in identity verification even for young people. Furthermore, if this motivates people to use the certificate renewal system 1, 1a regularly, it will also promote the use of the photography device 2, 2a.

[0114] Although the preferred embodiments of the certificate renewal system and the like according to the present invention have been described above with reference to the attached drawings, the present invention is not limited to such examples. It is clear that a person skilled in the art can come up with various modified or revised examples within the scope of the technical ideas disclosed in this application, and it is understood that these also naturally fall within the technical scope of the present invention. [Explanation of symbols]

[0115] 1, 1a………Certificate renewal system 2, 2a...Photographic equipment 3, 3a...Server 4. Authentication server 5. Local government terminal 6. Applicant terminal 7. Network 41....Means for accepting renewal applications 42... Means of reflecting updated data 43... Update request receiving means 51... Certificate verification means 52...Facial recognition means 53……Update intermediary means 531……Update request means 532...Update data transfer means 533: Renewal application acceptance information storage means 534.... Renewal application acceptance information transmission means 535... Local government approval acceptance means 536……Approval completion notification means 54: Historical face image storage means 70………Renewal application reception table

Claims

1. A certificate renewal system comprising: a photographing device for photographing the face of an applicant who applies for renewal of an electronic certificate of a My Number card; and a server connected to the photographing device via a network, The photographing device is a renewal application receiving means for receiving an application for renewal of the electronic certificate from the applicant by reading information on the applicant's My Number card, taking a photograph of the applicant's face, and transmitting the My Number card information and the photographed facial image of the applicant to the server; Equipped with The server, a certificate verification means for verifying whether the electronic certificate received from the photographing device is valid, in cooperation with an authentication server that provides a public personal authentication service; A face authentication means for performing face authentication between the photographed face image received from the photographing device and the card face image of the My Number card received from the photographing device; an update intermediation means that cooperates with the authentication server and mediates an update of the electronic certificate when the certificate verification means determines that the electronic certificate is valid and the face authentication means determines that the applicant is a legitimate person; A certificate renewal system comprising:

2. The update intermediation means includes: an update request means for requesting the authentication server to update the electronic certificate; an update data transfer means for transmitting the update data of the electronic certificate to the photographing device when the update data of the electronic certificate is received from the authentication server; 2. The certificate renewal system according to claim 1, further comprising:

3. The update intermediation means includes: A renewal application acceptance information storage means for storing information on the My Number card including the card face image and the photographed face image as renewal application acceptance information; a renewal application acceptance information transmitting means for transmitting, upon receiving a request for obtaining the renewal application acceptance information from a local government terminal of a local government that approves an application for renewal of the electronic certificate, the renewal application acceptance information of the subject that is approved by the local government to the local government terminal; 3. The certificate renewal system of claim 2, further comprising:

4. the renewal application acceptance information storage means stores the similarity between the photographed face image and the card face image as the renewal application acceptance information; The renewal application acceptance information transmitting means transmits the similarity between the photographed face image and the card face image to the local government terminal as the renewal application acceptance information.

4. The certificate renewal system according to claim 3.

5. The server, a historical face image storage means for storing image data of a face photograph of the applicant previously taken by the photographing device as a historical face image; Further comprising: the renewal application acceptance information storage means stores, as the renewal application acceptance information, the history face image and a similarity between the photographed face image and the history face image; The renewal application acceptance information transmitting means transmits the historical face image and the similarity between the photographed face image and the historical face image to the local government terminal as the renewal application acceptance information.

5. The certificate renewal system according to claim 4.

6. The server, a historical face image storage means for storing image data of a face photograph of the applicant previously taken by the photographing device as a historical face image; Further comprising: The face authentication means performs face authentication between the photographed face image and the card face image, and also performs face authentication between the photographed face image and the history face image.

4. The certificate renewal system according to claim 2 or 3.

7. The face authentication means reserves the identity verification of the applicant when a value obtained by subtracting a similarity between the photographed face image and the history face image from a similarity between the photographed face image and the card face image is equal to or greater than a predetermined value.

7. The certificate renewal system according to claim 6.

8. The photographing device is an update data reflecting means for writing the update data of the electronic certificate into a storage area of ​​the My Number card when the update data of the electronic certificate is received from the server; 4. The certificate renewal system according to claim 2, further comprising:

9. A certificate renewal method executed by a photographing device that takes a photograph of the face of an applicant who applies for renewal of an electronic certificate of a My Number Card, and a server connected to the photographing device via a network, comprising: a renewal application acceptance step in which the photographing device accepts an application for renewal of the electronic certificate from the applicant by reading information on the applicant's My Number card, taking a photograph of the applicant's face, and transmitting the My Number card information and the photographed face image of the applicant to the server; a certificate verification step in which the server cooperates with an authentication server that provides a public personal authentication service to verify whether the electronic certificate received from the photographing device is valid; A face authentication step in which the server performs face authentication between the photographed face image received from the photographing device and the card face image of the My Number card received from the photographing device; an update mediation step of mediating an update of the electronic certificate in cooperation with the authentication server when the server determines that the electronic certificate is valid in the certificate confirmation step and determines that the applicant is the person in question in the face authentication step; 2. A certificate updating method comprising:

10. A server connected via a network to a photographing device that takes a photograph of the face of an applicant who applies for renewal of an electronic certificate of a My Number card, a certificate verification means for verifying whether the electronic certificate received from the photographing device is valid, in cooperation with an authentication server that provides a public personal authentication service; A face authentication means for performing face authentication between the photographed face image of the applicant received from the photographing device and the card face image of the My Number card received from the photographing device; an update intermediation means that cooperates with the authentication server and mediates an update of the electronic certificate when the certificate verification means determines that the electronic certificate is valid and the face authentication means determines that the applicant is a legitimate person; A server comprising:

11. A program for causing a computer to function as a server connected via a network to a photographing device that takes a photograph of the face of an applicant who applies for renewal of an electronic certificate of a My Number card, The computer, a certificate verification means for verifying whether the electronic certificate received from the photographing device is valid in cooperation with an authentication server that provides a public personal authentication service; A face authentication means for performing face authentication between the photographed face image of the applicant received from the photographing device and the card face image of the My Number card received from the photographing device; an update intermediation means that cooperates with the authentication server and mediates the update of the electronic certificate when the certificate verification means determines that the electronic certificate is valid and the face authentication means determines that the applicant is a legitimate person; A program to function as a

Images