Devices, display methods, and programs

Abstract

To provide a device, display method and program, which enable prevention of an unauthorized access even when spoofing is attempted.SOLUTION: A device is provided, comprising a display capable of displaying first guidance for guiding a target person to be imaged by a camera to maintain his / her line of sight, and second guidance for guiding the target person to change his / her head angle.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present disclosure relates to a device, a display method, and a program for preventing spoofing. [Background technology]

[0002] In recent years, electronic devices and the like have begun using biometric data for purposes such as facial recognition to restrict access to data or easily recognize individuals through specific facial characteristics. Personal security and the threat of identity theft have become major concerns, and malicious actors have attempted to use various techniques to overcome automated identity recognition security methods, particularly to gain unauthorized access to data on or use of electronic devices. Facial recognition is one security method to combat unauthorized access to devices such as smartphones with digital cameras, smart pads, laptops, personal computers, and gaming systems. However, facial recognition can also be intentionally used to misidentify individuals (sometimes referred to as "impersonation") by using photographs, videos, masks, and the like.

[0003] To help overcome such deficiencies in facial recognition methods, several techniques have been implemented. For example, U.S. Patent No. 6,275,999 teaches taking multiple images from a camera and using threshold comparisons to detect whether one is looking at a still image or a live human face. Another known method, as described in Patent Document 2, involves providing stimuli on a screen to induce a facial response in the subject, tracking the subject's facial movements with a camera, and comparing them with a predictive model of the facial response to confirm that the subject is a human. Another known method is to display an image on a screen, move the subject's eyes, and track the subject's eyes with a camera to confirm that the subject is a human, as described in Patent Document 3, for example. Another method described in Patent Document 4 proposes tracking the subject's gaze angle and having the subject respond to challenges such as gazing at numbered positions on a display device in passcode order. However, these methods may still be vulnerable to spoofing attacks, for example, where three-dimensional masks are used. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] European Patent Application Publication No. 2546782 [Patent Document 2] European Patent Application Publication No. 3373202 [Patent Document 3] US Patent Application Publication No. 2017 / 0185760 [Patent Document 4] US Patent Application Publication No. 2019 / 0034606 Summary of the Invention [Problem to be solved by the invention]

[0005] There is a need for a technique that overcomes the vulnerabilities of facial recognition technology, allowing for proper recognition of biometrics even in the face of attempted spoofing methods.

[0006] Therefore, an exemplary object of the present disclosure is to provide a device, a display method, and a program that can prevent unauthorized access even when an attempt is made to spoof the device. [Means for solving the problem]

[0007] A first aspect of the present disclosure provides a device characterized by having a display capable of displaying a first guide that guides a user to maintain line of sight with respect to a subject being imaged by a camera, and a second guide that guides a user to change the angle of the subject's head relative to the subject.

[0008] A second aspect of the present disclosure provides a display method including displaying a first guide that guides a subject being imaged by a camera to maintain line of sight, and displaying a second guide that guides the subject to change the angle of the subject's head.

[0009] A third aspect of the present disclosure provides a program for causing a computer to perform the following: displaying a first guide that guides a user to maintain line of sight toward a subject being imaged by a camera; and displaying a second guide that guides the user to change the angle of the subject's head toward the subject. [Brief explanation of the drawings]

[0010] [Figure 1] FIG. 10 illustrates a diagram showing head angle versus gaze angle of a subject when using an exemplary image processing device of the present disclosure. [Figure 2] 1 is a flowchart of an exemplary method of the present disclosure. [Figure 3] 10 is another flowchart of an exemplary method of the present disclosure. [Figure 4] 10A-10C illustrate examples of prompts for a subject on a display of an exemplary image processing device of the present disclosure. [Figure 5] 10A-10C illustrate examples of prompts for a subject on the display of another exemplary image processing device of the present disclosure. [Figure 6] 10A and 10B show experimental examples of the difference between gaze angle and head angle of a subject during changes in head angle for a living body versus a 3D mask. [Figure 7] FIG. 1 is a block diagram of an exemplary image processing device of the present disclosure. [Figure 8] FIG. 1 illustrates an image processing device according to an exemplary embodiment of the present disclosure. DETAILED DESCRIPTION OF THE INVENTION

[0011] Hereinafter, exemplary embodiments of the present disclosure will be described with reference to the drawings. In the drawings, the same elements are designated by the same reference numerals, and therefore, redundant descriptions will be omitted where appropriate.

[0012] Throughout this specification, references to "one embodiment," "embodiment," "one example," or "example" mean that a particular feature, structure, or characteristic described in connection with an embodiment or example is included in at least one embodiment of the present embodiments. Thus, appearances of the phrases "in one embodiment," "in an embodiment," "one example," or "example" in various places throughout this specification do not necessarily all refer to the same embodiment or example. Furthermore, particular features, structures, or characteristics may be combined in any suitable combinations and / or subcombinations in one or more embodiments or examples.

[0013] Illustrative Embodiments

[0014] An image processing device will be described below as an exemplary embodiment of the present disclosure with reference to the drawings.

[0015] In this example, the image processing device is a mobile phone belonging to an owner (i.e., a subject) whose facial feature points have been previously stored in the storage unit 108. When the subject attempts to unlock or use the mobile phone, the mobile phone may need to identify the subject as the owner or otherwise authorized user. A facial recognition process is initiated to ensure that the subject can properly use the mobile phone. Alternatively, the image processing device may be a security device that identifies authorized people and grants them restricted activities, such as access to sensitive information or entry into restricted areas.

[0016] 7, the image processing device 100 according to this example includes a processor 104, a camera 106, and a storage unit 108. The image processing device may optionally include a display unit 102. First, the camera 106 of the image processing device 100 captures an image of a subject. From the captured image, the processor 104 extracts facial feature points of the subject's face for comparison with facial feature points of targets pre-stored in the storage unit 108. Then, if the comparison determines a match, the image processing device 100 attempts to determine whether the subject is a living person (i.e., checks the liveliness of the subject).

[0017] 1 illustrates an example of an image processing device 100 of the present disclosure in which a subject moves their head position while directing their gaze toward the image processing device 100. In this example, the image processing device captures an image of the subject and calculates the subject's gaze angle in addition to the subject's head angle. The head angle may be determined, for example, by the distance between the subject's nose relative to the position of the subject's eyes or relative to other facial features of the subject. The gaze angle may be calculated from the position of the pupils of each of the subject's eyes in the captured image.

[0018] When a three-dimensional mask is used to fool an image processing device, the relative angular difference between the head angle and gaze angle should remain constant as the head angle changes, allowing the subject to be determined to be a living person if the head angle and gaze angle differ while capturing multiple images of the subject at varying head angles.

[0019] An example of the observed difference between a real person and a three-dimensional mask during changes in head angle is shown in FIG. 6. In this figure, the solid line represents the head pan angle, and the dashed line represents the gaze pan angle. Taking this into consideration, a predetermined threshold difference can be selected to determine whether the subject is a living person. In other words, if the difference between the head angle and the gaze angle is greater than the predetermined threshold, the subject is determined to be a living person, and access to the mobile phone (image processing device) can be appropriately granted. Otherwise, access to the mobile phone is appropriately denied, thereby achieving improved security and accuracy of facial recognition.

[0020] The operational flowchart will be described with reference to FIGS.

[0021] 2 shows an exemplary flowchart for determining the liveliness of a subject. In this method, the gaze angle is calculated (S104) and the head angle is calculated (S105) from an image of the subject captured by a camera 106. The gaze angle calculation (S104) and the head angle calculation (S105) can be performed in any order, provided they precede the subsequent step (S106) of calculating the difference between the gaze angle and the head angle. In this step (S106), the difference between the gaze angle and the head angle is calculated and compared with other images captured by the camera. If the difference between the respective images remains constant within a predetermined threshold, the subject can be determined to be not a living person (S104) and access to the mobile phone can be appropriately denied.

[0022] 3 illustrates additional steps in a flowchart for verifying the subject's identity and prompting the subject to change their head angle so that liveliness determinations can be made. First, the subject's face is recognized (S101). This recognition can be performed using a known facial recognition algorithm or a known facial recognition neural network. Once the face is recognized, the subject can optionally be instructed via the display unit 102 to change their head angle while maintaining a gaze angle toward the image processing device 100 (S102), as shown in FIG. 4, for example. The camera 106 then captures one or more images so that facial features can be extracted (S103), and the gaze angle and head angle within the images can be calculated (S104, S105).

[0023] (Other embodiments) In the above exemplary embodiments, the present disclosure has been described with respect to an image processing device and method for achieving anti-spoofing, but the present disclosure should not be considered limited thereto. Other embodiments are possible without departing from the scope of the present disclosure. Additions, modifications, and other configurations may also be implemented and still fall within the scope of the present disclosure. Some examples are described below.

[0024] The present disclosure may be realized as a non-transitory computer-readable storage medium including instructions for causing at least one computer or multiple processors to execute the above-described functions in the image processing device described in the above exemplary embodiment. The program may implement part of the above-described functions. Furthermore, the program may be a so-called difference file (difference program) that can implement the above-described functions in combination with a program already recorded in a computer system.

[0025] Furthermore, the image processing device described above captures an image of a subject using a single camera. However, in another exemplary embodiment of the present disclosure, as shown in FIG. 5, multiple cameras can be used to more accurately determine the gaze angle and head angle of the subject, and multiple images acquired from multiple cameras with different viewpoints are used to extract 3D information of the subject. The extracted 3D information of the subject is taken into account in calculating the gaze angle and head angle.

[0026] Furthermore, when a three-dimensional mask is used to deceive the image processing device 100 and / or image processing method of the present disclosure, a mask with a peephole cut out may be worn by a live person. In such cases, secondary facial features may be detected as a basis for determining whether the subject has the necessary activity to match the target. For example, the subject's blink rate, mouth movement, nostril flaring, and / or eyebrow movement may be used to determine whether the subject is a living being, and the subject may be prompted to perform any of these actions via the display unit 102 or speaker, in addition to determining gaze angle versus head angle as taught in the present disclosure.

[0027] 8 shows an image processing device 1 according to an exemplary embodiment of the present disclosure. The image processing device 1 includes a receiving unit 10 and a processor 20. The receiving unit 10 receives a plurality of images of a subject from a camera 2. The processor 20 calculates an angular difference between the gaze angle and head angle of the subject for each of the plurality of images, and determines the authenticity of the subject based on at least the angular difference for each image. [Industrial Applicability]

[0028] The present disclosure is applicable to the fields of computers, computer software, and facial recognition. [Explanation of symbols]

[0029] 100 Image Processing Devices 102 Display Unit 104 processors 106 Camera 108 Memory Unit

Claims

1. a display that displays a first guide that guides the user to maintain a line of sight with respect to a subject captured by a camera, and a second guide that guides the user to change the angle of the subject's head with respect to the subject; A device comprising: a processor that determines impersonation using an image including the subject captured by the camera, the image including the subject following the first guidance while following the second guidance.

2. The device according to claim 1 , wherein the second guidance guides the subject to turn the head to either the left or the right.

3. The device of claim 1 or 2, wherein the processor determines spoofing based on an angular difference between the angle of the subject's line of sight and the angle of the subject's head.

4. The device of claim 3 , wherein the processor calculates the angular difference from the image.

5. The device described in claim 1 or 2, characterized in that the processor calculates the angular difference between the angle of the subject's gaze and the angle of the head for each of a plurality of images captured by the camera to obtain a series of angular differences, and if at least the series of angular differences is within a predetermined threshold, the processor determines that the subject is an impersonator.

6. a receiving unit that receives an image including the subject captured by a camera, the image following a first guide that guides the subject to maintain a line of sight and a second guide that guides the subject to change the angle of the subject's head; a processor that determines impersonation using the gaze angle and the head angle in the image.

7. The device according to claim 6 , wherein the second guidance guides the subject to turn the head to either the left or the right.

8. The device of claim 6 or 7, wherein the processor determines spoofing based on an angular difference between the angle of the subject's line of sight and the angle of the subject's head.

9. The device of claim 8 , wherein the processor calculates the angular difference from the images.

10. The device described in claim 6 or 7, characterized in that the processor calculates the angular difference between the angle of the subject's line of sight and the angle of the head for each of a plurality of images captured by the camera to obtain a series of angular differences, and determines impersonation based on at least the series of angular differences.

11. Displaying a first guide to guide the viewer to maintain a line of sight with respect to a subject captured by a camera, and a second guide to guide the viewer to change the angle of the head of the subject with respect to the subject; and determining whether or not the subject is spoofing using an image including the subject captured by the camera, the image including the subject following the second guidance while following the first guidance.

12. On the computer, Displaying a first guide to guide the viewer to maintain a line of sight with respect to a subject captured by a camera, and a second guide to guide the viewer to change the angle of the head of the subject with respect to the subject; A program for executing the steps of: determining whether or not an impersonation has occurred using an image including the subject captured by the camera, the image including the subject following the second guidance while following the first guidance.

Images