Image information verification device
Patent Information
- Application Number
- LAP692
- Authority / Receiving Office
- LA · LA
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2017-06-05
- Filing Date
- 2018-04-18
- Publication Date
- 2025-12-19
AI Technical Summary
Conventional methods for verifying identity on mobile devices using two-dimensional codes face challenges with large code sizes due to embedded facial photo data, making it difficult to display and confirm authenticity, especially on smartphone screens.
The use of feature values from facial photo data, such as facial feature points, is employed to create a two-dimensional code, allowing for smaller data storage and verification through electronic signatures and biometric authentication, enabling valid image verification on mobile devices.
This approach allows for efficient verification of identity with a smaller data footprint, ensuring accurate authentication and preventing image forgery by comparing feature values and electronic signatures, while ensuring the image can be displayed on smartphone screens.
Smart Images

Figure 00000000_0000_ABST
Abstract
Description
Image information verification device
[0001] The present invention relates to verification of image information and authentication technology based thereon.
[0002] Identification cards are generally issued as IC cards or plastic cards with attribute information such as a person's photo and name printed on the card. However, with the recent spread of mobile devices such as smartphones, there is a demand for identification to be done using a mobile device that is always carried with oneself, rather than a card-type identification card.
[0003] When implementing an ID card on a mobile device, attribute information such as a facial photo and name is digitized, and when proving identity, the data is displayed on the mobile device's display and presented to visually verify the authenticity of the ID card, or the data is sent via communication to a verifying device, which then mechanically verifies the authenticity of the ID card data. However, in the latter case, mobile devices often store various data other than the ID card data, and there is a possibility that unnecessary data may be mistakenly sent to the verifying device. Therefore, a system that allows identity to be verified simply by displaying and presenting an image of the ID card on the display, as in the former case, is desired.
[0004] However, unlike the printing of the face of a conventional card-type identification card, in the case of digitized identification card data, it is easy to replace the facial photo with a different facial photo, and even if the replaced image data is displayed, it is difficult to detect any traces of the replacement.
[0005] Therefore, a technology has been proposed in which an image of a face photo and a two-dimensional code with the face photo data embedded is used as an identification card, and when proving one's identity, the face photo is restored from the two-dimensional code and compared with the original face photo to determine its authenticity (Patent Document 1).
[0006] Japanese Patent Application Laid-Open No. 2005-141626
[0007] However, with conventional technology, the facial photo data itself is embedded in the two-dimensional code, which poses a problem of large size. Normally, facial photo data of the size used on identification cards is several to several tens of kilobytes in size, and even if that data is compressed, when the facial photo data is embedded in the two-dimensional code and the resolution is set to a level that can be recognized by a two-dimensional code reader, depending on the amount of facial photo data, the two-dimensional code can become as large as half the size of an A4 sheet of paper, for example, and cannot be displayed in its entirety on a smartphone screen.
[0008] Conversely, when trying to embed facial photo data into a two-dimensional code large enough to be displayed on a smartphone screen, the amount of data needed to be reduced results in a rough image of the face, making it difficult to verify the authenticity of the face photo from such a rough image.
[0009] To solve the above problem, technology used in biometric authentication is applied to extract feature values that can uniquely identify a face photo from facial photo data (such as "the positions of facial feature points such as the eyes, nose, and corners of the mouth" or "an image of only the eyes, which characterize the face") and embed these feature values in a two-dimensional code.
[0010] Then, when verifying the image (which can be used as identification) by displaying the facial photo and the two-dimensional code on the same screen on the smartphone display, the image displayed on the display is read using a photographing device such as a digital camera, web camera, or scanner, and the electronic signature is verified from the two-dimensional code in the displayed image to determine whether the two-dimensional code is legitimate.
[0011] In yet another invention, the subject of the camera is authenticated based on a facial image taken by an external camera or the like and a facial photograph that has been verified as authentic.
[0012] A feature of the present invention is that it is possible to verify the authenticity of an image (which can be used as an identification card) using a smaller amount of data than when facial photograph data is embedded in a two-dimensional code.
[0013] FIG. 1 is a diagram showing an example of a system configuration of the present embodiment 1. FIG. 2 is a diagram showing an example of the hardware configuration of an issuing device, a verification device, and a smartphone in the present embodiments 1 and 2. FIG. 3 is a sequence diagram showing the procedure for issuing a digital identification card in the present embodiments 1 and 2. FIG. 4 is a sequence diagram showing the procedure for verifying a digital identification card in the present embodiment 1. FIG. 5 is a diagram showing a verification result in the verification device in the present embodiment 1. FIG. 6 is a diagram showing an example of a system configuration of the present embodiment 2 (difference from FIG. 1). FIG. 7 is a sequence diagram showing the procedure for verifying a digital identification card and the procedure for authenticating the owner of the digital identification card in the present embodiment 2. FIG. 8 is a diagram showing the authentication result in the verification device in the present embodiment 2 (difference from FIG. 5).
[0014] ---System Configuration--- A first embodiment of the present invention will be described in detail below with reference to the drawings.
[0015] Fig. 1 is a diagram showing an example of the overall configuration of a digital identification card system 1 in embodiment 1. This diagram shows not only the overall configuration but also an example of the functional configuration of each computer that makes up the digital identification card system 1. The digital identification card system 1 shown in Fig. 1 is a system in which an issuing device 10 issues a digital identification card (image data) 301 for a smartphone 30, and a verification device 20 reads an image of the digital identification card 301 displayed on the display of the smartphone 30 and determines the authenticity of the presented digital identification card 301 based on the image.
[0016] As shown in FIG. 1, the issuing device 10 manages a signature key SK104 for generating an electronic signature and a common key K105 with the verification device 20, and is composed of a feature value extraction function 106 for extracting feature values from facial photograph data, an encryption processing function 103 for encrypting data and generating an electronic signature, a two-dimensional code generation function 102 for generating a two-dimensional code, and an identification card molding function 101 for molding a digital identification card (image data) 301 from facial photograph data 302, attribute information 303 such as a name, and a two-dimensional code 304. In addition, the verification device 20 is connected to the image capturing device 21, and manages a verification key PK204 for verifying the electronic signature and a common key K205 with the issuing device 10. The verification device 20 can be composed of a data reading function 201 for reading an image of the digital identification card 301 displayed on the display of the smartphone 30, a two-dimensional code reading function 202 for extracting the two-dimensional code portion 304 from the read image and decoding the two-dimensional code, an encryption processing function 203 for performing data decryption and electronic signature verification processing, a character recognition function 206 for recognizing characters of attribute information 303 such as a name from the image of the read digital identification card 301, a matching function 207 for comparing and verifying the feature values embedded in the two-dimensional code with the facial photo image 302 included in the image of the read digital identification card 301, and a verification result processing function 208 for displaying a screen according to the verification result and issuing instructions to open or close an entry / exit management gate. The smartphone 30 also has the function of installing and storing the corresponding digital identification card (image data) 301 obtained via a network or medium, and displaying the digital identification card 301 on the display as needed.
[0017] The issuing device 10, verification device 20, and smartphone 30 having such functions can be realized by a general information processing device 40 as illustrated in Fig. 2. For example, the feature value extraction function 106, encryption processing function 103, two-dimensional code generation function 102, and identification card molding function 101 of the issuing device 10, and the data reading function 201, two-dimensional code reading function 202, encryption processing function 203, character recognition function 206, matching function 207, and verification result processing function 208 of the verification device 20 can be realized as computer programs executed by a CPU 405 such as a central processing unit (CPU). These computer programs can be stored or held in advance in a storage device 404 such as a hard disk, or can be distributed over a network and deployed on the memory 403 for use.
[0018] Instructions from a user of this digital identification system 1 are input via an input device 401 such as a keyboard, mouse, or touch panel that accepts input, and the results of processing based on those instructions are output via an output device 402 such as a liquid crystal display device or an organic EL (Electro Luminescence) display.
[0019] The issuing device 10, the verification device 20, and the smartphone 30 can be configured on an information processing device 40 connected by an internal communication line such as a bus (hereinafter referred to as a bus) 406.
[0020] The image capturing device 21 connected to the verification device 20 is realized by a device such as a digital camera, a web camera, or a scanner.
[0021] ---Example of Processing Procedure--- The procedures in this embodiment 1 will be described below with reference to the drawings. The various operations described below are realized by programs that are read into memory or the like and executed by each device constituting the digital identification system 1.
[0022] FIG. 3 is a sequence diagram showing the procedure for issuing a digital identification card 301 in this embodiment.
[0023] Facial photograph data 302 of the person who will be the holder of digital identification card 301 is input to the issuing device 10, and the issuing device 10 extracts, from the facial photograph data 302 using the feature value extraction function 106, feature values (such as "facial feature points such as the eyes, nose, and corners of the mouth" or "an image of only the eyes"), which are relatively small amounts of data that can uniquely identify the facial photograph (step S101). The issuing device 10 then encrypts the feature values using the encryption processing function 103 with a common key K105 shared with the verification device 20 (step S102). Attribute information 303, such as the name of the person who will be the holder of digital identification card 301, is also input to the issuing device 10, and the issuing device 10 concatenates the attribute information 303 with the encrypted feature values (step S103). Next, the issuing device 10 calculates a digital signature value for the data obtained by concatenating the encrypted feature value and the attribute information 303 using the issuing device's signature key SK104, and assigns the digital signature value to the data obtained by concatenating the encrypted feature value and the attribute information 303 (step S104). The two-dimensional code generation function 102 then generates a two-dimensional code 304 using the concatenated encrypted feature value, the attribute information 303, and the digital signature data as input. That is, the concatenated data is encoded into a two-dimensional code (step S105). The issuing device 10 then arranges and forms the facial photo data 302, the attribute information 303, and the two-dimensional code 304 so that they can be simultaneously displayed on the smartphone display using the identification card forming function 101 (step S106), and outputs the digital identification card (image data) 301 to the outside (step S107).
[0024] The smartphone 30 acquires the digital identification card (image data) 301 via a network or via a medium (step S108), and stores the digital identification card (image data) 301 in the storage device 404 of the smartphone 30 (step S109).
[0025] FIG. 4 is a sequence diagram showing the procedure of the digital identification verification process in the first embodiment.
[0026] The smartphone 30 displays the digital identification card (image data) 301 stored in step S109 on the display of the smartphone 30 and presents it to the image capturing device 21 (step S200).
[0027] The image capturing device 21 captures an image displayed on the display of the smartphone 30 (step S201), and the verification device 20 acquires the screen image captured by the image capturing device 21 from the image capturing device 21 (step S202). The verification device 20 then reads the two-dimensional code from the screen image acquired in step S202 using the two-dimensional code reading function 202 and decodes the two-dimensional code (step S203). The decoded data consists of encrypted feature values, attribute information, and an electronic signature value, and the digital signature is verified using the cryptographic processing function 203 (step S204). If the signature verification fails, an error message is displayed on the display of the verification device 20, indicating that the two-dimensional code 304 on the digital identification document 301 is tampered with and that the signature verification has failed (step S205), as shown in the upper left diagram of FIG. 5 .
[0028] If the signature verification is successful, the character recognition function 206 is used to recognize characters related to the attribute information 303 from the screen image acquired in step S202, and the characters are compared with the attribute information decoded in step S203 (step S206). If the two pieces of information do not match, an error process is performed, for example, as shown in the upper right diagram of Fig. 5, by displaying on the display of the verification device 20 a message indicating that there is fraud in the attribute information 303 of the digital identification card 301 and that the attribute information has been falsified, along with the correct attribute information (step S207).
[0029] If the attribute information matches, the encryption processing function 203 decrypts the encrypted feature value decoded in step S203 using the common key K205 (step S208), and the matching function 207 compares and verifies the decrypted feature value with the facial photograph portion of the screen image acquired in step S202 to verify whether the feature value is data extracted from the facial photograph (step S209). The matching function 207 expresses the correlation between the facial photograph and the feature value as a numerical value, and if the matching rate between the facial photograph and the feature value is below a threshold, an error is processed by displaying on the display of the verification device 20 a message indicating that the facial photograph 302 portion of the digital identification document 301 is tampered with and the facial photograph is forged, as shown in the lower left diagram of Figure 5 (step S210).
[0030] If the matching rate between the facial photograph and the feature values is equal to or greater than a threshold, the verification device 20 displays a message indicating that the digital identification card 301 is authentic, as shown in the lower right diagram of FIG. 5 (step S210).
[0031] A second embodiment of the present invention will be described in detail below with reference to the accompanying drawings. The second embodiment is implemented as an addition to the first embodiment.
[0032] 6 is a diagram showing an example of the overall configuration of a digital identification card system 2 in the second embodiment (difference from FIG. 1). In the second embodiment, the verification device 20 is also connected to a portrait photographing device 22, and the system verifies whether a person presenting a digital identification card 301 is the correct holder through a face authentication function 209 used in biometric authentication based on a facial photograph 302 and a video / image taken by the portrait photographing device 22. The portrait photographing device 22 connected to the verification device is realized by a device such as a digital camera or a web camera.
[0033] In the second embodiment, a digital identification card 301 is issued in the same manner as in the first embodiment.
[0034] 7 is a sequence diagram showing the procedure for verifying a digital identification card and the procedure for authenticating the owner of the digital identification card in embodiment 2. The process up to step S210 is the same as that in embodiment 1.
[0035] The portrait photographing device 22 photographs the person presenting the digital identification card 301 (step S301), and the verification device 20 acquires the portrait image photographed in step S301 from the portrait photographing device 22 (step S302). The verification device 20 then compares and verifies the facial photograph data determined to be authentic in step S209 with the portrait image data acquired in step S301 using the face authentication function 209 to verify whether the person presenting the digital identification card 301 is the correct holder (step S303). The face authentication function 209 numerically expresses the correlation between the facial photograph and the portrait image. If the matching rate between the facial photograph and the portrait image is below a threshold, the verification device 20 displays an error message indicating that the facial photograph 302 on the digital identification card 301 does not match the face of the person presenting the digital identification card 301, as shown in the upper diagram of FIG. 8 (step S304).
[0036] If the matching rate between the facial photograph and the person image is above a threshold, the authenticity result processing is performed by displaying on the display of the verification device 20, for example, as shown in the lower diagram of Figure 8, that the digital identification card 301 is authentic and that the face of the person who presented the digital identification card 301 matches (step S305).
[0037] 1 Digital identification card system 2 Digital identification card system 10 Issuance device 20 Verification device 21 Image capturing device 22 Person capturing device 30 Smartphone 40 Information processing device 101 Identification card molding function 102 Two-dimensional code generation function 103 Encryption processing function 104 Signature key SK 105 Common key K 106 Feature value extraction function 201 Data reading function 202 Two-dimensional code reading function 203 Encryption processing function 204 Verification key PK 205 Common key K 206 Character recognition function 207 Matching function 208 Verification result processing function 209 Face authentication function 301 Digital identification card 302 Facial photo 303 Attribute information 304 Two-dimensional code 401 Input device 402 Output device 403 Memory 404 Storage device 405 CPU (Central Processing Unit) 406 bus
Claims
1. An image information verification device comprising: an extraction unit that reads an image and extracts an identifier image and a facial image from the image; an identifier image verification unit that verifies the identifier image from an electronic signature included in the identifier image; and an image verification unit that compares first feature value information extracted from the facial image with second feature value information included in the identifier image to verify the authenticity of the image information.
2. In the image information verification device described in claim 1, the extraction unit further extracts an attribute information image related to the facial image from the image, and the image verification unit further compares the attribute information contained in the identifier image with the extracted attribute information image to verify the authenticity of the image information.
3. An image information verification device according to claim 2, wherein the first feature value and the second feature value are information relating to the positions of facial feature points.
4. The image information verification device according to claim 3, further comprising a display unit for displaying the results of said verification.
5. An authentication system comprising the image information verification device of claim 4 and a photographing device, wherein the image information verification device further comprises an authentication unit that compares the photographed image taken by the photographing device with the facial image and authenticates the subject photographed by the photographing device.
6. An authentication system according to claim 5, wherein the authentication unit compares the captured image with the facial image using feature values.
7. An authentication system according to claim 6, further comprising a gate that performs processing according to the result of authentication of the target.
8. An authentication system according to claim 7, wherein the identifier image is created by encrypting the second feature value with a public key.
9. A method for verifying image information, comprising: an image reading step for reading an image; an extraction step for extracting an identifier image and a facial image from the image; an identifier image verification step for verifying the identifier image from an electronic signature included in the identifier image; and an image verification step for comparing first feature value information extracted from the facial image with second feature value information included in the identifier image to verify the authenticity of the image information.
10. An authentication method comprising: an image reading step for reading an image; an extraction step for extracting an identifier image and a facial image from the image; an identifier image verification step for verifying the identifier image from an electronic signature included in the identifier image; an image verification step for comparing first feature value information extracted from the facial image with second feature value information included in the identifier image to verify the authenticity of the image information; and an authentication step for comparing an image taken with a photographing device with the facial image to authenticate the subject photographed with the photographing device.
