Certificate verification method, computer program, and certificate verification system

Abstract

To provide a novel technique for streamlining a verification operation of a certificate possessed by a user by utilizing a video call.SOLUTION: A certificate verification method executed by a computer device includes: a video call step of executing a video call between a user terminal and a supporter; a target certificate information acquisition step of acquiring target certificate information on the basis of imaging at the user terminal during the video call; a certificate verification step of verifying a certificate on the basis of the target certificate information acquired in the target certificate information acquisition step; and a registration step of registering a verification result for the target certificate information in association with user information of a user who executed the video call, the steps being performed by at least one processing unit.SELECTED DRAWING: Figure 5

Description

[Technical Field]

[0001] The present invention relates to a certificate verification method, a computer program, and a certificate verification system. [Background technology]

[0002] In recent years, with the widespread use of devices equipped with cameras, such as smartphones and tablet terminals, video calling services have become available that allow users to enjoy calls while seeing the other person's face. Such video calling services are also used as a means of communication in services targeting elderly people, such as elderly care.

[0003] Patent Document 1 discloses a technology relating to a video call service that enables communication using a video call bot.

[0004] Video call services are also used, for example, to watch over elderly people and as a means of communication between family members in remote locations.

[0005] Patent Document 2 discloses a technology relating to a monitoring device and a monitoring system that can transmit fixed messages and carry out voice conversations. [Prior art documents] [Patent documents]

[0006] [Patent Document 1] Japanese Patent Publication No. 2021-129296 [Patent Document 2] Japanese Patent Application Publication No. 2017-208657

[0007] When receiving medical or nursing care services on an ongoing basis, monthly health insurance card verification is required. In addition, depending on the nature of the service and the policy of the service provider, other certificates may also need to be verified periodically, regardless of whether they are medical or nursing care. However, the above technology does not improve the efficiency of the periodic certificate verification process. Summary of the Invention [Problem to be solved by the invention]

[0008] An object of the present invention is to provide a novel technique for efficiently verifying certificates held by users by using video calls. [Means for solving the problem]

[0009] [1] A certificate verification method executed by a computer device, comprising: the computing device includes at least one processing unit configured to execute computer-readable instructions stored in a memory unit; The certificate verification method includes: a video call process in which the at least one processing unit executes a video call between the user terminal and the supporter; a target certificate information acquisition step of the at least one processing unit acquiring target certificate information based on an image taken by the user terminal during the video call; a certificate verification step based on the target certificate information acquired in the target certificate information acquisition step, performed by the at least one processing unit; a registration step in which the at least one processing unit registers a result of the verification of the target certificate information in association with user information of the user who made the video call. [2] Before the video call, the user information and the authenticity certificate information are associated with each other to register the authenticity certificate; In the certificate verification step, it is verified whether the photographed target certificate is identical to the registered genuine certificate based on the target certificate information and the genuine certificate information associated with the user information of the user during the video call. The certificate verification method described in [1]. [3] If the verification result in the certificate verification step is the same, the registration step updates the verification date of the certificate associated with the user information. The certificate verification method described in [2]. [4] In the certificate verification step, if the verification results are not identical, a selection is received from the actual supporter to update the authentic certificate information associated with the user information or to re-acquire the target certificate information in the target certificate information acquisition step, and the authentic certificate information is updated or the target certificate information is re-acquired. The certificate verification method described in [2] or [3]. [5] the user information is associated with authentic face information before the video call; a target face information acquisition step of acquiring target face information based on photographing by the user terminal during the video call by the at least one processing unit; the at least one processing unit has an identity verification step of verifying an identity of the user on the video call based on the target face information acquired in the target face information acquisition step and the genuine face information associated with the user information of the user, The certificate verification step is performed based on the identity verification result. The certificate verification method according to any one of [1] to [4]. [6] In the target certificate information acquisition step, a frame image of the video image is input into an image correction model, and the obtained corrected image or data obtained based on the corrected image is used as the target certificate information. The certificate verification method according to any one of [1] to [5]. [7] A computer program that causes the computer device to execute the certificate verification method according to any one of [1] to [6]. [8] A certificate validation system, comprising: a video call unit that executes a video call between the user terminal and the supporter; a target certificate information acquisition unit that acquires target certificate information based on an image captured by the user terminal during the video call; a certificate verification unit based on the target certificate information acquired by the target certificate information acquisition unit; a registration unit that registers a result of the verification of the target certificate information in association with user information of the user who performed the video call.

[0010] The invention of [1] allows efficient verification of user certificates via video calls.

[0011] According to the invention of [2], it is only necessary to determine whether there is a difference with an existing genuine certificate, and the user's certificate can be verified efficiently.

[0012] The invention according to [3] makes it possible to efficiently carry out periodic verification of user certificates.

[0013] [4] The invention of the present invention allows efficient implementation of procedures when the confirmation results are not the same between the computer-generated judgment result and the actual supporter's video footage.

[0014] The invention according to [5] makes it possible to efficiently verify the user's certificate.

[0015] The invention according to [6] makes it possible to efficiently verify the certificates of elderly users in particular. [Effects of the Invention]

[0016] The present invention can provide a novel technique for efficiently verifying certificates held by users by using video calls. [Brief explanation of the drawings]

[0017] [Figure 1]FIG. 1 is a block diagram showing a configuration of a system according to an embodiment. [Figure 2] FIG. 1 is a hardware configuration diagram of a system according to an embodiment. [Figure 3] FIG. 1 is a functional block diagram of a system according to an embodiment. [Figure 4] 1 is a processing flowchart in a system according to an embodiment. [Figure 5] 10 shows an example of a screen display of a user terminal in the system according to an embodiment. [Figure 6] 10 shows an example of a screen display on a supporter terminal in the system according to an embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0018] The present invention will now be described more fully with reference to the accompanying drawings, in which preferred embodiments are shown, but which may be embodied in many different forms and are not limited to the embodiments set forth herein.

[0019] For example, although the configuration, operation, etc. of the certificate verification system will be described in this embodiment, similar effects can be achieved by the executed method, device, computer program, etc. The program may be provided as a non-transitory computer-readable recording medium, or may be provided so as to be downloadable from an external server.

[0020] In this embodiment, a case will be described in particular in which a user, such as an elderly person, and a supporter who provides the user with a monitoring service and supports the user have a video call to confirm and register the contents of a certificate such as an insurance card. The user is not limited to the elderly, but can also be a healthy person or a young person who does not have difficulties with physical or cognitive functions. Furthermore, the supporter does not need to be a human being, but can also be a rule-based robot such as a generative AI or a chatbot that can interact with the user. The certificate is not limited to an insurance card, but can also be a driver's license, passport, My Number card, or any other certificate, certificate, document, etc.

[0021] <1. System configuration> Fig. 1 is a block diagram showing the configuration of a system according to one embodiment. As shown in Fig. 1, the certificate verification system 0 includes a certificate verification device 1, a user terminal 2 operated by a user, and a supporter terminal 3 operated by a real supporter, all of which are configured to be able to communicate with each other via a network 4.

[0022] The certificate verification device 1 can be one or more computer devices such as a general-purpose server device or a personal computer. The user terminal 2 and the supporter terminal 3 can be terminal devices 9, which are computer devices such as a personal computer, smartphone, or tablet terminal. In this embodiment, the user terminal 2 is described as a tablet terminal, and the supporter terminal 3 is described as a personal computer or a tablet terminal. The user terminal 2 executes a user video call program, and the supporter terminal 3 executes a supporter video call program, thereby enabling video calls via the certificate verification device 1. In this embodiment, these video call programs are client applications with video call functions downloaded from a program provider device (not shown). However, for example, video calls may be made via a web browser application pre-installed or downloaded in advance to the terminal device 9.

[0023] A video call between the user terminal 2 and the supporter terminal 3 is realized, for example, via a session conforming to the WebRTC (Web Real-Time Communication) standard, but may also be made by establishing a session conforming to standards such as HTTP or WebSocket. The certificate verification device 1 is appropriately equipped with resources for realizing a video call, such as a web server for screen display, a STUN server, a TURN server, a signaling server, etc.

[0024] In this embodiment, the network 4 is an IP (Internet Protocol) network, but there are no restrictions on the type of communication protocol, the type of network, etc.

[0025] <1.1. Hardware Configuration> FIG. 2 is a hardware configuration diagram of the certificate verification device 1 and the terminal device 9 (user terminal 2, supporter terminal 3).

[0026] Fig. 2(a) is a hardware configuration diagram of the certificate verification device 1. As shown in Fig. 2(a), the certificate verification device 1 has a processing unit 101, a storage unit 102, and a communication unit 103, which are used to perform the functions of each unit and each process.

[0027] The processing unit 101 has a processor such as a CPU that can execute an instruction set, and executes an OS, a consent decision program, and the like. The storage unit 102 includes a volatile memory such as a RAM capable of storing an instruction set, and a non-volatile recording medium such as an HDD or SSD capable of recording an OS, a certificate verification program, and the like. The communication unit 103 has an interface for physically connecting to a network, and controls communication with the network 4 to input and output information.

[0028] Fig. 2(b) is a hardware configuration diagram of the terminal device 9 (user terminal 2 and supporter terminal 3). As shown in Fig. 2(b), the terminal device 9 has a processing unit 901, a memory unit 902, a communication unit 903, an input unit 904, and an output unit 905, which are used to perform the functions of each unit and each process.

[0029] The processing unit 901 has a processor such as a CPU that can execute an instruction set, and executes an OS, a video call program, a web browser application, and the like. The storage unit 902 includes a volatile memory such as a RAM capable of storing an instruction set, and a non-volatile recording medium such as an HDD or SSD capable of recording an OS, a video call program, and the like. The communication unit 903 has an interface for physically connecting to a network, and controls communication with the network 4 to input and output information. The input unit 904 includes an operation input device capable of input processing such as a touch panel or keyboard, an audio input device capable of audio input such as a microphone, and an image input device capable of image input such as a camera. The output unit 905 includes a display device capable of display processing, such as a display, and an audio output device, such as a speaker.

[0030] <1.2. Functional configuration of Certificate Verification System 0> Fig. 3 is a functional block diagram of the certificate verification system 0. As shown in Fig. 3, the certificate verification device 1 has a video call unit 11, a target certificate information acquisition unit 12, a certificate verification unit 13, a registration unit 14, a target face information acquisition unit 15, a personal identification unit 16, and a notification unit 17. This is information processing by software (a certificate verification program stored transiently or non-transiently in a storage unit 102) specifically realized by hardware (a processing unit 101, etc.).

[0031] The user terminal 2 has a video call input / output unit 21. The supporter terminal 3 has a video call input / output unit 31. This is information processing by software (a user video call program stored transiently or non-transiently in the storage unit 902, etc.) specifically realized by hardware (the processing unit 901, etc.). The video call input / output unit 21 and / or the video call input / output unit 31 may be a web browser.

[0032] Note that some or all of the functional components of the certificate verification device 1 may be provided in the user terminal 2 or the supporter terminal 3. Also, a video call between the user terminal 2 and the supporter terminal 3 may be configured to be carried out using a third-party video call system. In this case, at least the target certificate information acquisition unit 12 that acquires images during the video call and the target face information acquisition unit 15 may be provided in the user terminal 2 or the supporter terminal 3.

[0033] <1.3.Video Call Processing> The video call unit 11 of the certificate verification device 1 executes a video call between the user terminal 2 and the supporter terminal 3. As a video call process, the video call unit 11 transmits to the other party the audio and images (including video) input by the video call input / output unit 21 of the user terminal 2 and the video call input / output unit 31 of the supporter terminal 3 via an audio input device and an image input device. The video call input / output units 21 and 31 output the received audio and images via a display device and an audio output device.

[0034] In addition, when the supporter is a rule-based robot such as a generated AI or a chatbot, the certificate verification device 1 includes a video call input / output unit and a virtual supporter unit that generates one or more of text, audio, and images (including video) to be sent to the user terminal 2 on behalf of the real supporter (supporter terminal 3). In this case, the video call may be a one-way video input from the user terminal 2, and the video call input / output unit of the certificate verification device 1 receives audio and images (including video) input by the video call input / output unit 21 of the user terminal 2 via an audio input device and an image input device, and sends the text, audio, or images (including video) input from the virtual supporter unit to the video call input / output unit 21 of the user terminal 2.

[0035] <1.4. Obtaining target certificate information> The target certificate information acquisition unit 12 acquires the target certificate information based on an image taken via an image input device of the user terminal 2.

[0036] The target certificate information is information about the health insurance card (certificate) to be verified, obtained through a video call. The target certificate information may be the captured frame image itself, the feature values ​​of the frame image or the corrected image, or a character string obtained by character recognition of the frame image or the corrected image.

[0037] In this embodiment, the target certificate information acquisition unit 12 includes an image correction unit and a character recognition unit, and inputs frame images of video footage captured by the in-camera of the user terminal 2 during a video call into an image correction model via the image correction unit, inputs the obtained corrected images into a character recognition engine via the character recognition unit, and sets the obtained character string as the target certificate information.

[0038] Any model can be used as the image correction model, such as a known image correction AI using a multi-layer perceptron (MLP) such as MAXIM (Multi-Axis MLP for Image Processing, Google.inc) or a known image correction AI using a convolutional neural network (CNN). Elderly users may have difficulty holding the certificate still in front of the in-camera of the user terminal 2. Therefore, it is preferable that the image correction model be one that can convert the frame image into a corrected image through image correction processes such as noise removal, image stabilization, and low-light correction. Character recognition can also be performed using a known character recognition engine.

[0039] In this embodiment, the image correction model and / or character recognition engine are stored in a memory unit (memory unit 102) of a device (certificate verification device 1) having the target certificate information acquisition unit 12, but may also be stored in a server that can communicate with the target certificate information acquisition unit 12 via a network 4 or the like. In this case, the image correction unit or the character recognition unit may input a frame image or a corrected image to the image correction model or the character recognition engine via the network 4 to acquire target certificate information (corrected image, character string, etc.) or data for obtaining the target certificate information (corrected image, etc.).

[0040] The registration unit 14 registers user information and information associated with the user information in storage. In this embodiment, before a video call, user information is registered in advance in the storage unit 102, and furthermore, authenticity certificate information and authentic face information are associated with the user information and registered in the storage unit 102. Furthermore, as will be described later, after confirmation via the video call, confirmation results for target certificate information such as the certificate confirmation date and new authenticity certificate information are associated with the user information and registered in the storage unit 102. Various data including user information may be stored in a database server communicably connected to the certificate verification device 1 via the network 4.

[0041] The user information includes, for example, the user's name, age, address, and the like. The authenticity certificate information includes one or more of an image of the user's health insurance card (certificate), certificate features obtained from the image, and a character string written on the health insurance card (certificate), and in this embodiment, it is the image of the health insurance card and the character string. Note that the character string may be character-recognized from the image of the health insurance card (certificate) using a character recognition engine. The genuine face information includes one or more of a face image of the user and face feature amounts obtained from the face image, and is assumed to be a face image in this embodiment.

[0042] <1.5. Acquiring target face information> The target face information acquisition unit 15 acquires target face information based on image capture performed via an image input device of the user terminal 2. The target face information is information about the face of the target obtained through a video call, and is a frame image of video footage captured by the in-camera of the user terminal 2 during the video call, a processed image obtained by processing the frame image, or facial feature amounts obtained from the frame image or the processed image. In this embodiment, the target face information acquisition unit 15 inputs the frame image of video footage captured by the in-camera of the user terminal 2 during the video call into a face recognition model, and acquires the obtained facial feature amounts as the target face information.

[0043] The identity verification unit 16 uses a face recognition model to compare the target face information acquired by the target face information acquisition unit 15 with the genuine face information associated with the user information of the user during the video call, and performs identity verification. The identity verification unit 16 may output a determination result to the supporter terminal 3 as the result of identity verification.

[0044] Any model can be used as the face recognition model, and in this embodiment, the face recognition model is stored in a memory unit (memory unit 102) of a device (certificate verification device 1) having a target face information acquisition unit 15 and an identity verification unit 16. However, the face recognition model may also be stored in a server that can communicate with the target face information acquisition unit 15 and the identity verification unit 16 via the network 4. In this case, the target face information acquisition unit 15 and the identity verification unit 16 may input a frame image to the face recognition model via the network 4 to acquire target face information (facial feature amounts), or may input target face information (frame image) acquired during a video call and pre-registered genuine face information to the face recognition model to verify whether they are the same person and acquire the identity verification result.

[0045] <1.6. Verification process of target certificate information> The certificate verification unit 13 performs certificate verification based on the target certificate information acquired in the target certificate information acquisition step. In this embodiment, certificate verification is further performed based on the result of identity verification by the identity verification unit 16, and the certificate verification unit 13 performs certificate verification if identity verification by the identity verification unit 16 is successful, and the registration unit 14 registers the verification result for the target certificate information, such as the certificate verification date, and new authentic certificate information in the storage unit 102. Note that the certificate verification unit 13 may perform certificate verification, and then the identity verification unit 16 may perform identity verification, and the verification result and the like may be registered by the registration unit 14, or the verification processes may be performed in parallel without specifying the order of certificate verification and identity verification.

[0046] <1.7. Notification Processing> The notification unit 17 performs a notification process for the user terminal 2. Particularly in this embodiment, the notification unit 17 sends a certificate confirmation notification to the user terminal 2. The user responds to the confirmation notification by performing an operation input using an operation input device such as a voice input device or a touch panel, thereby starting a video call with the supporter. The notification unit 17 sends a certificate confirmation notification to the user terminal 2 periodically every month (for example, on the Xth day of the first month / Xth day of the week of the first month). Alternatively, the notification unit 17 sends a certificate confirmation notification to the user terminal 2 at shorter intervals (for example, once a day) depending on the certificate confirmation result. The certificate confirmation result is recorded, for example, by the certificate confirmation date recorded in association with the user information or a flag indicating whether the confirmation process for the current month has been completed, and the notification unit 17 can notify users whose confirmation has not been completed by sending a certificate confirmation notification by referring to the confirmation result for the target certificate information associated with the user information.

[0047] <2. How to check the certificate> The flow of the certificate verification method will be explained using Figures 4 to 6. Figure 4 is a processing flowchart when the user terminal 2 and the supporter terminal 3 make a video call and verify the certificate. Figure 5 is an example of a screen display of the video call screen W2 on the user terminal 2, and Figure 6 is an example of a screen display of the video call screen W3 on the supporter terminal 3.

[0048] <2.1. Video Call Process> In this embodiment, the notification unit 17 refers to the certificate confirmation date stored in the storage unit 102 to determine whether the confirmation process for the current month has been completed. If it determines that the process is not completed, it sends a certificate confirmation notification to the user terminal 2 through batch processing. W2(a) in FIG. 5 is an example of a screen display when the user terminal 2 receives a certificate confirmation notification. When the user selects "Yes" in response to the confirmation notification, a video call with the supporter is initiated and the process proceeds to step S101.

[0049] In step S101, the user terminal 2 and the supporter terminal 3 start a video call. W2(b) is an example of the user video call screen W2 immediately after the start of the video call, and W3(a) is an example of the supporter video call screen W3 immediately after the start of the video call. Reference symbol W20 is a user video image W20 captured by the in-camera of the user terminal 2, and reference symbol W30 is a supporter video image W30 captured by the camera of the supporter terminal 3. The supporter video call screen W3 includes a user information display area W31 that displays user information of the user during the video call, as well as the user video image W20 and the supporter video image W30, a certificate confirmation request button W32, and an end call button W33. Note that the user video call screen W2(b) may also include the user video image W20.

[0050] <2.2. Target certificate information acquisition process> The supporter makes a certificate confirmation request by selecting the certificate confirmation request button W32 (step S102). When the certificate confirmation request is made, the video call unit 11 switches the video call screen W2(b) of the user terminal 2 to a certificate confirmation mode (step S103). In the confirmation mode, the video call screen W2(c) displays a guide W21 for photographing the certificate superimposed on the user video image W20. Preferably, as in the illustrated example, the supporter video image W30 is also displayed in a picture-in-picture format.

[0051] In step S104, the user refers to the guide W21 and takes a picture of the target certificate with the in-camera of the user terminal 2. The target certificate information acquisition unit 12 inputs the captured frame image into an image correction model, and performs character recognition on the obtained corrected image using a character recognition engine to acquire target certificate information (character string).

[0052] <2.3. Target face information acquisition process> In step S105, the user photographs his or her own face with the front camera of the user terminal 2. The target face information acquisition unit 15 inputs the photographed frame image into a face recognition model to acquire target face information (facial feature amounts). As with photographing a certificate, a guide for photographing the face may be superimposed on the user video image W20 on the video call screen W2 to assist the user in photographing the face. The acquisition of the target face information may be performed prior to the target certificate information acquisition step, or may be performed before transitioning to confirmation mode, such as on the user video call screen W2(b) immediately after the start of a video call.

[0053] <2.4. Identity Verification Process> In step S106, a verification process is performed. Reference symbol W31(a) is an example of a screen display of the user information display area W31 during the verification process. In this embodiment, first, the identity verification unit 16 is used to compare the target face information and the genuine face information to verify the identity of the user. If the identity verification is successful, a certificate verification process is performed. If the identity verification is unsuccessful, the target face information is acquired again in step S105.

[0054] The success or failure of the identity verification may be finally determined by the operation of the supporter. For example, in either or both of the cases of success and failure, the result of the identity verification by the identity verification unit 16, the user video image W20 or target face information (face image), and the genuine face information (face image) may be output on the supporter video call screen W3, and the supporter may visually compare them to register the result of the identity verification.

[0055] <2.5. Certificate Verification Process> Next, the certificate verification unit 13 is used to compare the target certificate information and the authentic certificate information to verify the certificate. In this embodiment, the certificate verification unit 13 compares the character string that is the target certificate information with the character string that is the authentic certificate information to verify whether there is a difference between the two. If the identity verification is successful and there is no difference in the certificate, the verification process ends. When the verification process ends, the video call unit 11 switches the video call screen W2 of the user terminal 2 to a face-to-face video call screen W2(f) with the supporter.

[0056] The success or failure of the certificate verification may be finally determined by the supporter's operation. For example, in either or both cases where there is no discrepancy and where there is a discrepancy, the result of the determination by the certificate verification unit 13, the user video image W20 or the target certificate information (frame image, its corrected image, character string), and the authentic certificate information (image and character string) may be output on the supporter's video call screen W3, and the supporter may visually compare them to register the result of the certificate verification.

[0057] In Figures 5 and 6, symbol W2(d) is an example of the screen display of the user video call screen W2 when the confirmation process is successful, and symbol W31(b) is an example of the screen display of the user information display area W31 when the confirmation process on the supporter video call screen W3 is successful.

[0058] Furthermore, symbol W2(e) is an example of the screen display of the user video call screen W2 when the verification process has failed, and symbol W31(c) is an example of the screen display of the user information display area W31 when the verification process has failed. A reconfirm button W311 and an update button W312 are displayed in the user information display area W31(c). If the verification process has failed, the supporter can operate the operation input device to select updating the authentic certificate information or re-acquiring the target certificate information in step S104, thereby updating the authentic certificate information or re-acquiring the target certificate information.

[0059] <2.6. Registration process> In step S107, the verification result is registered. If the verification process is successful, i.e., if the verification results are the same, the registration unit 14 updates the verification date of the certificate associated with the user information. On the other hand, if updating the authenticity certificate information is selected, the registration unit 14 registers the new authenticity certificate information in the storage unit 102 in association with the user information of the user during the video call.

[0060] If the end call button W27 is pressed, the video call ends (step S108). If the call ends with the confirmation having failed, the registration unit 14 associates the confirmation with the user information of the user on the video call and registers the fact that the confirmation has failed in the storage unit 102. If the confirmation process is successful, a message indicating that the confirmation process has been successful is displayed on the user terminal 2. Symbol W2(g) is an example of a screen display on the user terminal 2 after the call ends when the confirmation has been successfully registered. [Explanation of symbols]

[0061] 0: Certificate verification system 1: Certificate verification device 2: User terminal 3: Supporter terminal 9: Terminal device 11: Video Call Section 12: Target certificate information acquisition section 13: Certificate verification section 14: Registration section 15: Target face information acquisition unit 16: Identity Verification Department 17:Notification Department 21, 31: Video call input / output section 101: Processing section 102: Storage section 103: Communications Department 901: Processing section 902: Storage section 903: Communications Department 904: Input section 905: Output section

Claims

1. 1. A certificate verification method executed by a computer device, comprising: the computing device includes at least one processing unit configured to execute computer-readable instructions stored in a memory unit; The certificate verification method includes: a video call process in which the at least one processing unit executes a video call between the user terminal and the supporter; a target certificate information acquisition step of the at least one processing unit acquiring target certificate information based on an image taken by the user terminal during the video call; a certificate verification step performed by the at least one processing unit based on the target certificate information acquired in the target certificate information acquisition step; a registration step in which the at least one processing unit registers a confirmation result for the target certificate information in association with user information of the user who made the video call.

2. before the video call, the user information and the authenticity certificate information are associated with each other to register the authenticity certificate; In the certificate verification step, it is verified whether the photographed target certificate is identical to the registered genuine certificate based on the target certificate information and the genuine certificate information associated with the user information of the user during the video call. The certificate verification method of claim 1 .

3. If the verification result in the certificate verification step is the same, the registration step updates the verification date of the certificate associated with the user information. The certificate verification method according to claim 2 .

4. In the certificate verification step, if the verification results are not identical, a selection is received from the actual supporter to update the authentic certificate information associated with the user information or to re-acquire the target certificate information in the target certificate information acquisition step, and the authentic certificate information is updated or the target certificate information is re-acquired. The certificate verification method according to claim 2 .

5. the user information is associated with authentic face information prior to the video call; a target face information acquisition step of acquiring target face information based on photographing by the user terminal during the video call by the at least one processing unit; the at least one processing unit has an identity verification step of verifying an identity of the user on the video call based on the target face information acquired in the target face information acquisition step and the genuine face information associated with the user information of the user, The certificate verification step is performed based on the identity verification result. The certificate verification method of claim 1 .

6. In the target certificate information acquisition step, a frame image of the video image is input to an image correction model, and the obtained corrected image or data obtained based on the corrected image is set as the target certificate information. The certificate verification method of claim 1 .

7. A computer program that causes a computer device to execute the certificate verification method according to any one of claims 1 to 6.

8. 1. A certificate validation system, comprising: a video call unit that executes a video call between the user terminal and the supporter; a target certificate information acquisition unit that acquires target certificate information based on an image captured by the user terminal during the video call; a certificate verification unit based on the target certificate information acquired by the target certificate information acquisition unit; a registration unit that registers a result of the verification of the target certificate information in association with user information of the user who performed the video call.

Images