Electronic apparatus for performing identity verification and identity inquiry and operating method thereof

Abstract

The present invention discloses an electronic device that performs personal authentication and identity verification. An electronic device for performing identity authentication and identity verification according to an embodiment of the present invention may include a communication unit, a storage unit, a camera unit, and a processor for reading identification information including a first face image of a user, controlling the camera unit to capture a second face image of the user, performing identity authentication by comparing the first face image information and the second face image information, performing identity verification by comparing the user's identity information including the identification information and the second face image information with identity information including a third face image information of a person whose whereabouts are unknown received from a server by controlling the communication unit, and transmitting location information of the electronic device to the server according to the result of the identity verification.

Description

Technology Field

[0001] The present invention relates to an electronic device for performing personal authentication and identity verification, and a method of operating the same. Background Technology

[0002] In modern society, there is an increasing need for technology capable of performing identity authentication in unmanned environments. Such technology enables safe and reliable user identification in various contactless service environments, such as unmanned kiosks, vending machines, and unmanned stores, contributing to the simultaneous enhancement of public safety and convenience.

[0003] Recently, with the advancement of facial recognition technology, methods are being utilized to read identification cards and perform identity and age verification by comparing them with captured images of the user's face. For example, technology has been developed that verifies identity by comparing a facial image contained in an identification card with a face image captured by the user, thereby confirming the user's authority or enabling the execution of specific tasks.

[0004] As an example of the technology forming the background of the present invention, Korean Registered Patent Publication No. 10-2682571 relates to a method for controlling access to an unmanned kiosk through adult verification based on facial recognition, and discloses a method of receiving personal information of a user from a user terminal, controlling the user terminal to take a photograph of the user's face, performing user registration and authentication of the user using the personal information and the photograph of the face, and controlling the user's access using the personal information and the photograph of the face. The problem to be solved

[0005] The present invention aims to provide an environment in which user identity information, such as identification card information and facial image information obtained from a user, is utilized not only for adult verification and identity authentication but also for locating missing persons by comparing it with a database of identity information of persons whose whereabouts are unknown, such as missing persons and wanted persons. means of solving the problem

[0006] An electronic device for performing identity authentication and identity verification according to an embodiment of the present invention may include a communication unit, a storage unit, a camera unit, and a processor for reading identification information including a first face image of a user, controlling the camera unit to capture a second face image of the user, performing identity authentication by comparing the first face image information and the second face image information, performing identity verification by comparing the user's identity information including the identification information and the second face image information with identity information including a third face image information of a person whose whereabouts are unknown received from a server by controlling the communication unit, and transmitting location information of the electronic device to the server according to the result of the identity verification.

[0007] A method of operation of an electronic device for performing identity authentication and identity verification according to an embodiment of the present invention may include: a process of reading identification information containing a first face image of a user; a process of capturing a second face image of the user; a process of performing identity authentication by comparing the first face image information and the second face image information; a process of performing an identity verification by comparing the identity information of the user containing the identification information and the second face image information with identity information containing a third face image information of a person whose whereabouts are unknown received from a server; and a process of transmitting location information of the electronic device to the server according to the result of the identity verification. Effects of the invention

[0008] The present invention can provide an environment in which user identity information, such as identification card information and facial image information obtained from a user, is utilized not only for adult verification and identity verification but also for finding missing persons by comparing it with a database of identity information of missing persons, wanted persons, etc. Brief explanation of the drawing

[0009] FIG. 1 is a personal authentication and identity verification system according to one embodiment of the present invention. FIG. 2 is a block diagram of an electronic device that performs identity authentication and identity verification according to an embodiment of the present invention. FIG. 3 is a flowchart of the operation method of a personal authentication and identity verification system according to one embodiment of the present invention. FIG. 4 is a block diagram of the detailed configuration of an electronic device that performs personal authentication and identity verification according to one embodiment of the present invention. FIG. 5 is a flowchart of an operation method of an electronic device that performs personal authentication and identity verification according to an embodiment of the present invention. Specific details for implementing the invention

[0010] The operating principles of preferred embodiments of the present invention will be described in detail below with reference to the attached drawings. Furthermore, in describing embodiments of the invention, detailed descriptions of related known functions or configurations will be omitted if it is determined that such detailed descriptions could obscure the essence of the present disclosure. Additionally, the terms used below are defined considering their functions in the present invention, and these may vary depending on the intentions or conventions of the user or operator. Therefore, the definitions of the terms used should be interpreted based on the content throughout this specification and the corresponding functions.

[0011] FIG. 1 is a personal authentication and identity verification system according to one embodiment of the present invention.

[0012] For example, the present invention can be assumed to apply to a situation where a user performs age verification using an unmanned terminal (100) at a time past 10:00 PM in an unmanned PC room. The user reads their identification card into the unmanned terminal (100) in order to use the PC room even after 10:00 PM. To verify whether another person's identification card has been stolen, the unmanned terminal (200) takes a picture of the user's face image and performs age verification and identity verification by comparing it with the face image on the identification card. Additionally, the unmanned terminal (100) not only utilizes the information obtained from the user for age verification and identity verification, but also enables it to be used for the purpose of finding missing persons by comparing it with the identity information DB of missing persons, such as missing children, missing persons, and wanted persons, received from a server (200) of a government department, etc.

[0013] Referring to FIG. 1, a personal authentication and identity verification system (10) according to one embodiment of the present invention may include an unmanned terminal (100) and a server (200).

[0014] According to one embodiment of the present invention, an unmanned terminal (100) is an electronic device designed to be used directly by a store manager without separate operating personnel. In the present invention, it can transmit and receive data through a network with a server (200) and perform identity verification and identity checks. Here, the unmanned terminal (100) may include a kiosk, a tablet ordering system, a vending machine, etc.

[0015] For example, an unmanned terminal (100) can read the user's identification information through methods such as image scanning, QR code scanning, and OCR (Optical Character Recognition). Here, the identification may include a resident registration card, driver's license, passport, student ID, etc., and may be in the form of a physical document or one electronically stored on the user terminal.

[0016] For example, an unmanned terminal (100) can take a picture of the user's face.

[0017] For example, an unmanned terminal (100) can perform user identity verification by comparing the ID card information with the face of the user that was photographed.

[0018] For example, the unmanned terminal (100) can perform an identity lookup by comparing the identity information of a user with the identity information of a person whose whereabouts are unknown. In addition, the user's location may be reported to the server (200) based on the identity lookup result.

[0019] For example, an unmanned terminal (100) can generate a face image that reflects age and the passage of time in a past face image for more accurate face comparison.

[0020] The detailed configuration and operation method of the unmanned terminal (100) of the present invention will be examined in more detail through FIGS. 2 to 5.

[0021] According to one embodiment of the present invention, a server (200) is a device responsible for data management and processing and can be connected to a plurality of unmanned terminals (100) through a network. In the present invention, information on persons whose whereabouts are unknown, such as missing persons and publicly wanted persons, can be stored and provided to unmanned terminals (100). Here, the server (200) may be a server operated by a government ministry, such as the Ministry of the Interior and Safety or the National Police Agency, for the management of a database of missing persons and publicly wanted persons.

[0022] FIG. 2 is a block diagram of an electronic device that performs identity authentication and identity verification according to an embodiment of the present invention.

[0023] Referring to FIGS. 1 and 2, an unmanned terminal (100) according to one embodiment of the present invention may include a communication unit (110), a storage unit (120), a camera unit (130), and a processor (140).

[0024] According to one embodiment of the present invention, the communication unit (110) can perform wired / wireless communication with an external electronic device.

[0025] For example, the communication unit (110) can transmit and receive various data with the server (200) through a network.

[0026] According to one embodiment of the present invention, the storage unit (120) can store an O / S (Operating System) software module, etc., for operating an unmanned terminal (100).

[0027] For example, the storage unit (120) may include a data storage unit for storing data and instructions executable by a controller / processor (e.g., instructions for performing processes performed by an unattended terminal (100) as described in this specification).

[0028] According to one embodiment of the present invention, the camera unit (130) may include at least one image sensor or at least one camera that captures and provides an image.

[0029] For example, the camera unit (130) can capture an image of the user's face.

[0030] According to one embodiment of the present invention, the processor (140) can control the unmanned terminal (100) overall.

[0031] The processor (140) can read identification information including the user's first face image. Here, the processor (140) can read identification information not only through the user's physical identification but also through a QR code generated from the user's terminal.

[0032] Additionally, the processor (140) can control the camera unit (130) to capture a second face image of the user.

[0033] Additionally, the processor (140) can perform identity authentication by comparing the first face image information and the second face image information. Specifically, the processor (140) can calculate a first similarity by comparing the first face image information and the second face image information, and determine whether the first similarity is greater than or equal to a preset value. Here, the preset value can be set in various ways depending on the required accuracy, such as, for example, a Euclidean distance of 0.6 or less or a cosine similarity of 0.9 or more. The comparison of the two face images can be performed in the order of, for example, preparation of the two face images, face region detection, detection and alignment of landmarks (eyes, nose, mouth, etc.), face preprocessing (sizing and normalization), feature extraction (using a deep learning model, generating embedding vectors, vector normalization), similarity calculation (Euclidean distance, cosine similarity, etc.), and output of results based on the similarity. Here, the Euclidean distance is more similar as the distance value is smaller, and the cosine similarity is more similar as the value is closer to 1.

[0034] Additionally, the processor (140) can extract the date of issuance and date of birth of the identification card to calculate the user's age at the time of issuance and current age, and can generate first face image information by estimating the first face image as a current face image by reflecting the elapsed time from the issuance date to the present and the user's age. Here, the estimation of the face image reflecting age and the elapsed time can be performed using, for example, an algorithm that applies a Generative Adversarial Network (GAN).

[0035] Additionally, the processor (140) can perform an identity lookup by controlling the communication unit (110) and comparing the user's identity information, including identification information and second face image information, with the identity information, including third face image information of a person whose whereabouts are unknown, received from the server (200). The processor (140) can calculate a second similarity by comparing the first face image information and the third face image information, calculate a third similarity by comparing the second face image information and the third face image information, and determine whether at least one of the second similarity and the third similarity is greater than or equal to a preset value. Specifically, the processor (140) can calculate the age at the time of disappearance and the current age from the identity information of the person whose whereabouts are unknown, and generate third face image information in which the third face image is estimated as a face image based on the current standard by reflecting the passage of time from the date of disappearance to the present and the age of the person whose whereabouts are unknown. The processor (140) can compare the name and date of birth of the identification information with the name and date of birth information of the person whose whereabouts are unknown.

[0036] Additionally, the processor (140) may transmit location information of the unmanned terminal (100) to the server (200) according to the identity verification result. Here, the location information may include location information of the store where the unmanned terminal (100) is installed, the unique identification number of the unmanned terminal (100), etc.

[0037] FIG. 3 is a flowchart of the operation method of a personal authentication and identity verification system according to one embodiment of the present invention.

[0038] Referring to FIGS. 1 and FIGS. 3, the unmanned terminal (100) can read identification information including a user's first face image (S310).

[0039] The unmanned terminal (100) can capture a second face image of the user (S320).

[0040] The unmanned terminal (100) can perform identity verification by comparing the first face image information with the second face image information (S330).

[0041] The unmanned terminal (100) can perform an identity lookup by comparing the user's identity information, including identification information and second face image information, with the identity information, including third face image information of a person whose whereabouts are unknown, received from the server (200) (S340). Here, the server (200) can pre-establish a database of identity information of persons whose whereabouts are unknown, such as missing persons and wanted persons.

[0042] The unmanned terminal (100) can transmit location information to the server (200) when the similarity is greater than or equal to a preset value (S350). Here, the server (200) can transmit relevant information to the police agency, etc., to track the missing person.

[0043] FIG. 4 is a block diagram of the detailed configuration of an electronic device that performs personal authentication and identity verification according to one embodiment of the present invention.

[0044] Referring to FIG. 4, an unmanned terminal (400) according to one embodiment of the present invention may include a communication unit (410), a storage unit (420), a camera unit (430), and a processor (440).

[0045] The communication unit (410) can perform wired / wireless communication with an external electronic device. The communication unit (410) may include various communication modules such as a wired communication module (411), a short-range wireless communication module (412), and a wireless communication module (413).

[0046] Here, the wired communication module (411) is a module for communicating with an external electronic device according to a wired communication method such as wired Ethernet. And, the short-range wireless communication module (412) is a module for communicating with an external electronic device located at a short distance according to a short-range wireless communication method such as Bluetooth (BT), BLE (Bluetooth Low Energy), ZigBee, NFC (Near Field Communication), etc. Additionally, the wireless communication module (413) is a module that communicates with an external electronic device by connecting to an external network according to a wireless communication protocol such as WI-FI (Wireless Fidelity), IEEE, etc. Furthermore, the wireless communication module (413) may additionally include a mobile communication module that performs communication by connecting to a mobile communication network according to various mobile communication standards such as 3G (3rd Generation), 3GPP (3rd Generation Partnership Project), LTE (Long Term Evolution), LTE-A (LTE Advanced), 5th generation networks (5G Networks), 6th generation networks (6G Networks).

[0047] The storage unit (420) can store an O / S (Operating System) software module for operating the unmanned terminal (400), data for configuring various UI screens provided in the display area, etc. Additionally, the storage unit (420) is capable of reading and writing as described above.

[0048] The storage unit (420) may include volatile RAM (random access memory), non-volatile ROM (read only memory), non-volatile MRAM (magnetoresistive RAM), and / or other types of storage units.

[0049] The camera unit (430) may include at least one image sensor or at least one camera that captures and provides images. In one embodiment, the camera unit (430) may include a plurality of cameras and may provide images captured by each of the plurality of cameras as a plurality of input images to be merged. In another embodiment, the camera unit (430) may provide images captured sequentially by one camera as a plurality of input images to be merged.

[0050] The processor (440) can control the overall operation of the unmanned terminal (400) using various programs stored in the storage unit (420).

[0051] Specifically, the processor (440) may include RAM (441), ROM (442), main CPU (444), graphics processing unit (443), first to n interfaces (445-1 to 445-n) and a bus (446).

[0052] Here, RAM (441), ROM (442), main CPU (444), graphics processing unit (443), first to n interfaces (445-1 to 445-n), etc. can be connected to each other via a bus (446).

[0053] The first to n interfaces (445-1 to 445-n) are connected to the various components described above. One of the interfaces may be a network interface connected to an external device through a network.

[0054] The ROM (442) stores a set of instructions for booting the system, etc. When a turn-on command is input and power is supplied, the main CPU (444) copies the O / S stored in the storage unit (420) to the RAM (441) according to the instructions stored in the ROM (442), and executes the O / S to boot the system.

[0055] When booting is complete, the main CPU (444) can copy various stored application programs to RAM (441) and execute the application programs copied to RAM (441) to perform various operations.

[0056] The main CPU (444) accesses the storage unit (420) and performs booting using the O / S stored in the storage unit (420). Additionally, the main CPU (444) can perform various operations using various programs, content, data, etc. stored in the storage unit (420).

[0057] The graphics processing unit (443) can generate a screen containing various objects such as icons, images, text, etc. by using the calculation unit and the rendering unit.

[0058] FIG. 5 is a flowchart of an operation method of an electronic device that performs personal authentication and identity verification according to an embodiment of the present invention.

[0059] Referring to FIGS. 3 and FIGS. 5, the unmanned terminal (100) can perform the process of reading identification information including the user's first face image (S510). The unmanned terminal (100) may also read identification information through a QR code generated from the user's terminal.

[0060] Additionally, the unmanned terminal (100) can perform the process of capturing a second face image of the user (S520).

[0061] Additionally, the unmanned terminal (100) can perform identity verification by comparing first face image information and second face image information (S530). Specifically, it can perform a process of calculating a first similarity by comparing first face image information and second face image information, and a process of determining whether the first similarity is greater than or equal to a preset value. Furthermore, it can perform a process of extracting the issuance date and date of birth of the identification card to calculate the user's age at the time of issuance and current age, and a process of generating first face image information in which the first face image is estimated as a current face image by reflecting the elapsed time from the issuance date to the present and the user's age.

[0062] Additionally, identity verification can be performed by comparing the user's identity information, including identification information and second face image information, with the identity information, including third face image information of the missing person received from the server (200) (S540). Specifically, a process of calculating a second similarity by comparing the first face image information and the third face image information, a process of calculating a third similarity by comparing the second face image information and the third face image information, and a process of determining whether at least one of the second similarity and the third similarity is greater than or equal to a preset value can be further performed. Additionally, a process of calculating the age at the time of disappearance and the current age from the identity information of the missing person, and a process of generating third face image information in which the third face image is estimated as a current standard face image by reflecting the time elapsed from the date of disappearance to the present and the age of the missing person can be further performed. Additionally, a process of comparing the name and date of birth of the identification information with the name and date of birth information of the missing person can be further performed. Here, the server (200) may include a server of a government department responsible for matters related to missing persons and wanted persons.

[0063] Additionally, the unmanned terminal (100) can perform the process of transmitting location information of the unmanned terminal (100) to the server (200) according to the identity lookup result. Specifically, if the similarity in the identity lookup is greater than or equal to a preset value, location information can be transmitted.

[0064] Combinations of each block of the block diagram attached to the present invention and each step of the flowchart may be performed by computer program instructions. Since these computer program instructions may be loaded into an encoding processor of a general-purpose computer, a special-purpose computer, or other programmable data processing equipment, the instructions performed through the encoding processor of the computer or other programmable data processing equipment create means for performing the functions described in each block of the block diagram or each step of the flowchart. Since these computer program instructions may also be stored in a computer-available or computer-readable storage unit that can be directed toward the computer or other programmable data processing equipment to implement the function in a specific way, the instructions stored in the computer-available or computer-readable storage unit may also produce a manufactured item containing instruction means for performing the function described in each block of the block diagram or each step of the flowchart. Since computer program instructions can be loaded onto a computer or other programmable data processing equipment, instructions that execute a computer or other programmable data processing equipment by performing a series of operation steps on the computer or other programmable data processing equipment to create a process executed by the computer can also provide steps for executing the functions described in each block of the block diagram and each step of the flowchart.

[0065] Additionally, each block or each step may represent a module, segment, or part of code containing one or more executable instructions for executing a specific logical function. Also, it should be noted that in some alternative embodiments, the functions mentioned in the blocks or steps may occur out of order. For example, two blocks or steps described in succession may actually be performed substantially simultaneously, or the blocks or steps may sometimes be performed in reverse order according to the corresponding function.

[0066] The above description is merely an illustrative explanation of the technical concept of the present invention, and those skilled in the art to which the present invention pertains will be able to make various modifications and variations within the scope of the essential quality of the present invention. Accordingly, the embodiments disclosed in the present invention are intended to explain, not limit, the technical concept of the present invention, and the scope of the technical concept of the present invention is not limited by such embodiments. The scope of protection of the present invention shall be interpreted by the claims below, and all technical concepts within the equivalent scope shall be interpreted as being included within the scope of rights of the present invention. Explanation of the symbols

[0067] Identity Verification and Background Check System: 10 Unmanned terminal: 100 Communications Department: 110, 410 Storage: 120, 420 Camera Unit: 130, 430 Processors: 140, 440 Server: 200

Claims

Claim 1 An electronic device for performing identity verification and identity lookup, comprising: a communication unit; a storage unit; a camera unit; and a processor that reads identification information including a first face image of a user, controls the camera unit to capture a second face image of the user, performs identity verification by comparing the first face image information and the second face image information, performs identity lookup by comparing the user's identity information including the identification information and the second face image information with identity information including a third face image of a person whose whereabouts are unknown received from a server by controlling the communication unit, and transmits location information of the electronic device to the server according to the result of the identity lookup. Claim 2 In claim 1, the processor is an electronic device that reads identification information through a QR code generated by the user's terminal. Claim 3 An electronic device according to claim 1, wherein the processor calculates a first similarity by comparing the first face image information and the second face image information, and determines whether the first similarity is greater than or equal to a preset value. Claim 4 An electronic device according to claim 1, wherein the processor extracts the issuance date and date of birth of the identification card to calculate the user's age at the time of issuance of the identification card and current age, and generates first face image information in which the first face image is estimated as a face image based on the current standard by reflecting the elapsed time from the issuance date to the present and the user's age. Claim 5 An electronic device according to claim 1, wherein the processor calculates a second similarity by comparing the first face image information and the third face image information, calculates a third similarity by comparing the second face image information and the third face image information, and determines whether at least one of the second similarity and the third similarity is greater than or equal to a preset value. Claim 6 An electronic device according to claim 1, wherein the processor calculates the age at the time of the date of disappearance and the current age from the identity information of the missing person, and generates third face image information in which the third face image is estimated as a face image based on the current standard by reflecting the passage of time from the date of disappearance to the present and the age of the missing person. Claim 7 In paragraph 1, the processor is an electronic device that compares the name and date of birth of the identification information with the name and date of birth information of the missing person. Claim 8 In paragraph 1, the said server is an electronic device including a server of a government department responsible for matters related to missing persons and wanted persons. Claim 9 A method of operation of an electronic device for performing identity verification and identity lookup, comprising: a process of reading identification information including a first face image of a user; a process of capturing a second face image of the user; a process of performing identity verification by comparing the first face image information and the second face image information; a process of performing an identity lookup by comparing the user's identity information including the identification information and the second face image information with identity information including a third face image information of a person whose whereabouts are unknown received from a server; and a process of transmitting location information of the electronic device to the server according to the result of the identity lookup. Claim 10 In claim 9, the process of reading the identification information is a method of operation of an electronic device that reads the identification information through a QR code generated by the user's terminal. Claim 11 In claim 9, the process of performing the identity verification further comprises: a process of calculating a first similarity by comparing the first face image information and the second face image information; and a process of determining whether the first similarity is greater than or equal to a preset value, in a method of operation of an electronic device. Claim 12 In claim 9, the process of performing the identity verification further comprises: a process of extracting the date of issuance and date of birth of the identification card to calculate the age of the user at the time of issuance of the identification card and the current age; and a process of generating first face image information in which the first face image is estimated as a current face image by reflecting the elapsed time from the date of issuance to the present and the age of the user. Claim 13 In claim 9, the process of performing the identity lookup further comprises: a process of calculating a second similarity by comparing the first face image information and the third face image information; a process of calculating a third similarity by comparing the second face image information and the third face image information; and a process of determining whether at least one of the second similarity and the third similarity is greater than or equal to a preset value. Claim 14 A method of operation of an electronic device according to claim 9, wherein the process of performing the identity lookup further comprises: a process of calculating the age at the time of the date of disappearance and the current age from the identity information of the missing person; and a process of generating third face image information in which the third face image is estimated as a face image based on the current standard by reflecting the elapsed time from the date of disappearance to the present and the age of the missing person. Claim 15 A method of operation of an electronic device according to claim 9, wherein the process of performing the identity inquiry further includes the process of comparing the name and date of birth of the identification information with the name and date of birth information of the missing person. Claim 16 In paragraph 9, the method of operation of an electronic device, wherein the server includes a server of a government department responsible for matters related to missing persons and wanted persons.

Images