Information processing system, information processing device, information processing method, and recording medium

Abstract

An information processing system (10) comprises: an image acquisition means (110) for acquiring an oblique image in which an eye of a target is captured at an angle different from straight in front; a center detection means (120) for detecting a center position (23) of a pupil (21) and a center position (24) of an iris (22) from the oblique image; and a determination means (130) for determining whether or not the target is an imposter, on the basis of a deviation between the center position of the pupil and the center position of the iris. Such an information processing system can appropriately detect an imposter using pattern contacts.

Description

[Technical field]

[0001] The present disclosure relates to the technical fields of an information processing system, an information processing device, an information processing method, and a recording medium. [Background technology]

[0002] As this type of system, there is known a system that detects "spoofing" in iris authentication. For example, Patent Document 1 discloses a technology that detects spoofing by capturing an image of the target's eye from an oblique angle and utilizing the fact that the shape of the iris is not elliptical in pattern contact. Patent Document 2 discloses a technology that detects spoofing by utilizing the reflection characteristics of the cornea region. Patent Document 3 discloses a technology that detects spoofing by applying lighting at different angles when capturing an image. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent No. 4706377 [Patent Document 2] JP 2019-191898 A [Patent Document 3] International Publication No. 2006 / 088042 Summary of the Invention [Problem to be solved by the invention]

[0004] This disclosure is intended to improve upon the techniques disclosed in the prior art documents. [Means for solving the problem]

[0005] One aspect of the information processing system disclosed herein comprises an image acquisition means for acquiring an oblique image of a target's eye taken from an angle other than the front, a center detection means for detecting the center position of the pupil and the center position of the iris from the oblique image, and a determination means for determining whether the target is an impersonator based on the deviation between the center position of the pupil and the center position of the iris.

[0006] Another aspect of the information processing system of this disclosure includes an image acquisition means for acquiring an eye image of a subject's eye, a detection means for detecting the subject's pupil and any tinted contact lenses worn by the subject from the eye image, and a determination means for determining whether the subject is an impersonator based on a gap that occurs between the pupil and the pattern of the tinted contact lens.

[0007] One aspect of the information processing device disclosed herein comprises an image acquisition means for acquiring an oblique image of a target's eye taken from an angle other than the front, a center detection means for detecting the center position of the pupil and the center position of the iris from the oblique image, and a determination means for determining whether the target is an impersonator based on the deviation between the center position of the pupil and the center position of the iris.

[0008] Another aspect of the information processing device of this disclosure includes an image acquisition means for acquiring an eye image of a target's eye, a detection means for detecting the target's pupil and any tinted contact lenses worn by the target from the eye image, and a determination means for determining whether the target is an impersonator based on a gap that occurs between the pupil and the pattern of the tinted contact lens.

[0009] One aspect of the information processing method disclosed herein is an information processing method executed by at least one computer, which obtains an oblique image of a target's eye from an angle other than the front, detects the center position of the pupil and the center position of the iris from the oblique image, and determines whether the target is impersonating someone else based on the deviation between the center position of the pupil and the center position of the iris.

[0010] Another aspect of the information processing method of this disclosure is an information processing method executed by at least one computer, which obtains an eye image of a target's eye, detects the target's pupil and any tinted contact lenses worn by the target from the eye image, and determines whether the target is an impersonator based on a gap between the pupil and a pattern on the tinted contact lens.

[0011] One aspect of the recording medium of this disclosure is a computer program recorded on at least one computer to execute an information processing method, which includes obtaining an oblique image of a subject's eye captured from an angle other than the front, detecting the center position of the pupil and the center position of the iris from the oblique image, and determining whether the subject is impersonating someone else based on the deviation between the center position of the pupil and the center position of the iris.

[0012] Another aspect of the recording medium of this disclosure is a computer program recorded on at least one computer to execute an information processing method, which includes acquiring an eye image of a subject's eye, detecting the subject's pupil and any tinted contact lenses worn by the subject from the eye image, and determining whether the subject is an impersonator based on a gap between the pupil and a pattern on the tinted contact lens. [Brief description of the drawings]

[0013] [Figure 1] 1 is a block diagram showing a hardware configuration of an information processing system according to a first embodiment. [Diagram 2] 1 is a block diagram showing a functional configuration of an information processing system according to a first embodiment. [Diagram 3] 11 is a top view showing an example of an imaging direction and a line of sight direction when capturing an oblique image. FIG. [Figure 4] 10 is a side view showing an example of an imaging direction and a line of sight direction when capturing an oblique image. FIG. [Diagram 5] 4 is a flowchart showing a flow of operations performed by the information processing system according to the first embodiment. [Figure 6]FIG. 2 is a plan view showing an example of a misalignment that occurs between the center of the pupil and the center of the iris. [Figure 7] 10 is a flowchart showing a flow of operations performed by an information processing system according to a second embodiment. [Figure 8] 13 is a flowchart showing the flow of operations performed by the information processing system according to the third embodiment. [Figure 9] FIG. 13 is a block diagram showing a functional configuration of an information processing system according to a fourth embodiment. [Figure 10] 13 is a flowchart showing the flow of operations performed by the information processing system according to the fourth embodiment. [Figure 11] FIG. 13 is a block diagram showing a functional configuration of an information processing system according to a fifth embodiment. [Figure 12] 1 is a front view showing an example of an imaging direction when imaging an obliquely viewed object. FIG. [Figure 13] 13 is a flowchart showing the flow of operations performed by the information processing system according to the fifth embodiment. [Figure 14] FIG. 13 is a block diagram showing a functional configuration of an information processing system according to a sixth embodiment. [Figure 15] 13 is a flowchart showing the flow of operations performed by the information processing system according to the sixth embodiment. [Figure 16] 1 is a plan view showing an example of a gap that occurs between a pupil and a contact lens; [Figure 17] 20 is a flowchart showing the flow of operations performed by the information processing system according to the seventh embodiment. [Figure 18] FIG. 13 is a plan view showing an example of a gap occurring between a pupil and a contact lens in an oblique image. [Figure 19] FIG. 23 is a plan view (part 1) showing an example of guidance display by an information processing system according to an eighth embodiment. [Figure 20] FIG. 23 is a plan view (part 2) showing an example of guidance display by the information processing system according to the eighth embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0014] Hereinafter, embodiments of an information processing system, an information processing device, an information processing method, and a recording medium will be described with reference to the drawings.

[0015] First Embodiment An information processing system according to a first embodiment will be described with reference to FIGS. 1 to 6. FIG.

[0016] (Hardware configuration) First, the hardware configuration of the information processing system according to the first embodiment will be described with reference to Fig. 1. Fig. 1 is a block diagram showing the hardware configuration of the information processing system according to the first embodiment.

[0017] 1, an information processing system 10 according to the first embodiment includes a processor 11, a RAM (Random Access Memory) 12, a ROM (Read Only Memory) 13, and a storage device 14. The information processing system 10 may further include an input device 15 and an output device 16. The information processing system 10 may also include a camera 18. The above-mentioned processor 11, RAM 12, ROM 13, storage device 14, input device 15, output device 16, and camera 18 are connected via a data bus 17.

[0018] The processor 11 reads a computer program. For example, the processor 11 is configured to read a computer program stored in at least one of the RAM 12, the ROM 13, and the storage device 14. Alternatively, the processor 11 may read a computer program stored in a computer-readable storage medium using a storage medium reading device (not shown). The processor 11 may obtain (i.e., read) a computer program from a device (not shown) disposed outside the information processing system 10 via a network interface. The processor 11 controls the RAM 12, the storage device 14, the input device 15, and the output device 16 by executing the computer program that the processor 11 reads. In particular, in this embodiment, when the processor 11 executes the computer program that the processor 11 reads, a functional block for determining spoofing is realized in the processor 11.

[0019] The processor 11 may be, for example, a central processing unit (CPU), a graphics processing unit (GPU), a field-programmable gate array (FPGA), a digital signal processor (DSP), or a Digital Signal Processor The processor 11 may be configured as one of these, or may be configured to use a plurality of them in parallel.

[0020] The RAM 12 temporarily stores a computer program executed by the processor 11. The RAM 12 temporarily stores data that is temporarily used by the processor 11 when the processor 11 is executing the computer program. The RAM 12 may be, for example, a D-RAM (Dynamic RAM).

[0021] The ROM 13 stores computer programs executed by the processor 11. The ROM 13 may also store other fixed data. The ROM 13 may be, for example, a programmable ROM (P-ROM).

[0022] The storage device 14 stores data that is to be stored long-term by the information processing system 10. The storage device 14 may operate as a temporary storage device for the processor 11. The storage device 14 may include, for example, at least one of a hard disk device, a magneto-optical disk device, an SSD (Solid State Drive), and a disk array device.

[0023] The input device 15 is a device that receives an input instruction from a user of the information processing system 10. The input device 15 may include, for example, at least one of a keyboard, a mouse, and a touch panel. The input device 15 may be configured as a mobile terminal such as a smartphone or a tablet.

[0024] The output device 16 is a device that outputs information related to the information processing system 10 to the outside. For example, the output device 16 may be a display device (e.g., a display) that can display information related to the information processing system 10. The output device 16 may also be a speaker or the like that can output information related to the information processing system 10 as audio. The output device 16 may be configured as a mobile terminal such as a smartphone or a tablet.

[0025] Camera 18 is a camera installed at a position capable of capturing an image of a target (specifically, an image of the area around the target's eye including the iris). A plurality of cameras 18 may be installed. Camera 18 may be a camera mounted on a terminal (e.g., a smartphone) owned by the target. Camera 18 may be a USB camera, an IP camera, a Web camera, or the like. Camera 18 may be a camera that captures still images or a camera that captures moving images. Camera 18 may be configured as a visible light camera or a near-infrared camera. Note that the subject captured by camera 18 is not limited to humans, and may include animals such as dogs and snakes, robots, and the like.

[0026] 1 shows an example of an information processing system 10 including a plurality of devices, but all or a part of the functions may be realized by a single device (information processing device). This information processing device may be configured to include only the above-mentioned processor 11, RAM 12, and ROM 13, and the other components (i.e., storage device 14, input device 15, output device 16, camera 18) may be provided by an external device connected to the information processing device. Also, the information processing device may have some of its calculation functions realized by an external device (e.g., an external server, a cloud, etc.).

[0027] (Functional configuration) Next, the functional configuration of the information processing system 10 according to the first embodiment will be described with reference to Fig. 2. Fig. 2 is a block diagram showing the functional configuration of the information processing system according to the first embodiment.

[0028] 2, the information processing system 10 according to the first embodiment is configured to include, as components for realizing its functions, an image acquisition unit 110, a center detection unit 120, and a spoofing determination unit 130. Each of the image acquisition unit 110, the center detection unit 120, and the spoofing determination unit 130 may be a processing block realized by, for example, the above-mentioned processor 11 (see FIG. 1). Also, the image acquisition unit 110 may acquire an image using the above-mentioned camera 18.

[0029] The image acquisition unit 110 is configured to be able to acquire an iris image of the target (i.e., an image including the iris of the target). The iris image may be acquired as, for example, a near-infrared image. In this case, the image acquisition unit 110 may be configured to be able to irradiate the target with near-infrared rays. The image acquisition unit 110 according to this embodiment is particularly configured to be able to acquire an oblique image by capturing an image of the target's eyes from an angle (i.e., obliquely) different from the front. The front here refers to the direction when the target's face faces straight ahead (see Figs. 3 and 4 described later). Note that the oblique image may be captured at an oblique imaging angle with respect to the iris of the target. For example, the oblique image may be captured by changing only the line of sight (in other words, the direction of the eyeball) from the front of the target's face. Alternatively, the oblique image may be captured by capturing an image of the target's face from an oblique angle. The oblique image may also be captured with both the line of sight and the imaging angle oblique. The image acquisition unit 110 may be configured to acquire other images (e.g., an image captured from the front of the target's face) in addition to the oblique image. The image acquired by the image acquisition unit 110 is output to the center detection unit 120 .

[0030] Here, specific examples of the imaging direction and line of sight direction when capturing an oblique image will be described with reference to Fig. 3 and Fig. 4. Fig. 3 is a top view showing an example of the imaging direction and line of sight direction when capturing an oblique image. Fig. 4 is a side view showing an example of the imaging direction and line of sight direction when capturing an oblique image.

[0031] As shown in Fig. 3(a), if the camera 18 is placed in front of the face of the subject and the line of sight of the subject is directed to the left, an oblique image of the subject's eyes can be captured. Also, as shown in Fig. 3(b), if the camera 18 is placed to the right of the front of the face of the subject, an oblique image of the subject's eyes can be captured even if the line of sight of the subject is forward. Furthermore, as shown in Fig. 3(c), if the camera 18 is placed to the right of the front of the face of the subject and the line of sight of the subject is directed to the left, which is the opposite direction to the camera 18, an image of the subject's eyes can be captured from a more oblique angle.

[0032] As shown in Fig. 4(a), if the camera 18 is placed in front of the face of the subject and the line of sight of the subject is directed upward, an oblique image of the subject's eyes can be captured. Also, as shown in Fig. 4(b), if the camera 18 is placed above the front of the face of the subject, an oblique image of the subject's eyes can be captured even if the line of sight of the subject is forward. Furthermore, as shown in Fig. 4(c), if the camera 18 is placed above the front of the face of the subject and the line of sight of the subject is directed downward, which is the opposite direction to the camera 18, an image of the subject's eyes can be captured from a more oblique angle.

[0033] Returning to FIG. 2, the center detection unit 120 is configured to be able to detect the center position of the pupil (hereinafter referred to as the "pupil center" as appropriate) and the center position of the iris (hereinafter referred to as the "iris center" as appropriate) from the image acquired by the image acquisition unit 110. The pupil center and the iris center may each be acquired as coordinate information. The center detection unit 120 may also be configured to be able to acquire information about the eye other than the pupil center and the iris center. For example, the center detection unit 120 may be configured to be able to detect the radius of the pupil, the radius of the iris, etc. Each piece of information detected by the center detection unit 120 is configured to be output to the spoofing determination unit 130.

[0034] The spoofing determination unit 130 is configured to be able to determine whether or not the target is an impersonator based on the deviation between the pupil center and the iris center detected by the center detection unit 120. The spoofing determination unit 130 determines whether the target is an impersonator using, for example, pattern contacts (for example, contact lenses with another person's iris pattern printed on them). The spoofing determination unit 130 may determine that the target is an impersonator when the deviation between the pupil center and the iris center is greater than a predetermined threshold. On the other hand, the spoofing determination unit 130 may determine that the target is not an impersonator when the deviation between the pupil center and the iris center is less than a predetermined threshold. The deviation between the pupil center and the iris center will be described in detail later.

[0035] (Operation flow) Next, the flow of operations performed by the information processing system 10 according to the first embodiment will be described with reference to Fig. 5. Fig. 5 is a flowchart showing the flow of operations performed by the information processing system according to the first embodiment.

[0036] 5, when the information processing system 10 according to the first embodiment operates, the image acquisition unit 110 first acquires an oblique image of the target (step S101). Then, the center detection unit 120 detects the pupil center and the iris center from the oblique image acquired by the image acquisition unit 110 (step S102).

[0037] Next, the spoofing determination unit 130 calculates the deviation between the pupil center and the iris center detected by the center detection unit 120 (step S103). Then, the spoofing determination unit 130 determines whether or not the target is a spoof based on the deviation between the pupil center and the iris center (step S104).

[0038] The spoofing determination unit 130 may output the result of the spoofing determination to a user (e.g., a system administrator or a monitor). The result of the spoofing determination may be output, for example, using the output device 16 (see FIG. 1). For example, the result of the spoofing determination may be displayed as an image using a display, or may be output as audio using a speaker. Also, if it is determined that the target is a spoofed object, a warning (alert) may be output.

[0039] The above-mentioned series of operations may be repeated multiple times. In this case, the accuracy of spoofing can be improved by changing the direction in which the oblique image is captured. For example, if the oblique image is captured from the right oblique direction the first time, the oblique image may be captured from the left oblique direction the second time.

[0040] (Displacement of center position) Next, the misalignment that occurs between the center of the pupil and the center of the iris will be specifically described with reference to Fig. 6. Fig. 6 is a plan view showing an example of the misalignment that occurs between the center of the pupil and the center of the iris.

[0041] As shown in FIG. 6(a), when the subject is not impersonating (i.e., when the actual pupil 21 and iris 23 are imaged), the pupil center 23, which is the center position of the pupil 21, and the iris center 24, which is the center position of the iris 22, almost coincide with each other even in the oblique image because the iris 22 is planar. On the other hand, as shown in FIG. 6(b), when the subject is impersonating (i.e., when the pattern contact is imaged instead of the actual iris 23 of the subject), the pupil center 23 and the iris center 24 (actually, the center of the pattern drawn on the pattern contact) in the oblique image do not coincide with each other due to the spherical shape of the pattern contact. Specifically, the pupil center 23 and the iris center 24 are shifted in the same direction as the direction of the line of sight. In this embodiment, such a property is utilized to determine impersonation from the shift between the pupil center 23 and the iris center 24.

[0042] (Technical effect) Next, technical effects obtained by the information processing system 10 according to the first embodiment will be described.

[0043] As described in Fig. 1 to Fig. 6, in the information processing system 10 according to the first embodiment, whether or not a target is impersonating is determined based on the deviation between the pupil center 23 and the iris center 24 in the oblique image. In this way, it is possible to appropriately determine whether or not a target is impersonating someone using pattern contact lenses. Therefore, it is possible to prevent fraudulent break-through of iris authentication.

[0044] In the case of spoofing, the shape of the iris itself changes in the oblique image, but in order to detect the change in shape, it is necessary to capture the target's eye from a fairly oblique angle (i.e., at a large angle). In this case, not only is there a large restriction on the placement position of the camera, but it may also lead to a deterioration in the accuracy of the authentication process using the iris image. However, in the information processing system 10 according to this embodiment, compared to the configuration for detecting the change in shape described above, spoofing can be detected with high accuracy even from oblique images captured at a gentle angle.

[0045] <Second embodiment> An information processing system 10 according to the second embodiment will be described with reference to Fig. 7. The second embodiment differs from the first embodiment in some operations, and other parts may be the same as the first embodiment. Therefore, hereinafter, parts that differ from the first embodiment already described will be described in detail, and other overlapping parts will be omitted as appropriate.

[0046] (Operation flow) First, the flow of operations performed by the information processing system 10 according to the second embodiment will be described with reference to Fig. 7. Fig. 7 is a flowchart showing the flow of operations performed by the information processing system according to the second embodiment. In Fig. 7, the same processes as those shown in Fig. 5 are denoted by the same reference numerals.

[0047] 7, when the information processing system 10 according to the second embodiment operates, the image acquisition unit 110 first acquires an oblique image of the target (step S101). Then, the center detection unit 120 detects the pupil center 23 and the iris center 24 from the oblique image acquired by the image acquisition unit 110 (step S102).

[0048] Next, the spoofing determination unit 130 calculates a first vector having the iris center 24 and the pupil center 23 detected by the center detection unit 120 as its start point and end point (step S201). Then, the spoofing determination unit 130 determines whether the first vector is larger than a first predetermined value (step S202). The "first predetermined value" here is a threshold value for determining whether the deviation between the pupil center 23 and the iris center 24 is large enough to determine that there is a possibility of spoofing, and it is sufficient that an appropriate value is set in advance.

[0049] If the first vector is greater than the first predetermined value (step S202: YES), the spoofing determination unit 130 calculates the cosine value of the angle between the first vector and a second vector indicating the gaze direction of the target (step S203). Here, the second vector is a two-dimensional vector obtained by estimating the gaze direction and projecting the obtained direction onto an image. For example, various existing methods can be applied to estimate the gaze direction. Then, the spoofing determination unit 130 determines whether or not the cosine value of the angle between the first vector and the second vector is greater than the second predetermined value (step S204). Here, the "second predetermined value" is a threshold value for determining whether or not the calculated cosine value is large enough to be determined as spoofing, and it is sufficient that an appropriate value is set in advance.

[0050] If the cosine value of the angle between the first vector and the second vector is greater than the second predetermined value (step S204: YES), the spoofing determination unit 130 determines that the target is a spoofed object (step S205). On the other hand, if the first vector is smaller than the first predetermined value (step S202: NO) or if the cosine value of the angle between the first vector and the second vector is smaller than the second predetermined value (step S204: NO), the spoofing determination unit 130 determines that the target is not a spoofed object (step S206).

[0051] (Technical effect) Next, technical effects obtained by the information processing system 10 according to the second embodiment will be described.

[0052] 7, in the information processing system 10 according to the second embodiment, a first vector indicating the deviation between the pupil center 23 and the iris center 24 and a second vector indicating the gaze direction of the target are used to determine whether or not the target is impersonating someone else. In this way, it is possible to appropriately determine whether or not the target is impersonating someone else based on the deviation between the pupil center 23 and the iris center 24.

[0053] <Third embodiment> An information processing system 10 according to the third embodiment will be described with reference to Fig. 8. Note that the third embodiment differs in some operations from the first and second embodiments described above, and other parts may be the same as the first and second embodiments. Therefore, hereinafter, parts that differ from the embodiments already described will be described in detail, and explanations of other overlapping parts will be omitted as appropriate.

[0054] (Operation flow) First, the flow of operations performed by the information processing system 10 according to the third embodiment will be described with reference to Fig. 8. Fig. 8 is a flowchart showing the flow of operations performed by the information processing system according to the third embodiment. In Fig. 8, the same processes as those shown in Fig. 5 are denoted by the same reference numerals.

[0055] 8, when the information processing system 10 according to the third embodiment operates, the image acquisition unit 110 first captures an image of the target's eye from the front to acquire a front image (step S301). Then, the center detection unit 120 detects the pupil center 23 and the iris center 24 from the front image acquired by the image acquisition unit 110 (step S302). After that, the masquerade determination unit 130 calculates the deviation between the pupil center 23 and the iris center 24 detected by the center detection unit 120 (step S303).

[0056] Next, the image acquisition unit 110 acquires an oblique image of the target (step S101). Then, the center detection unit 120 detects the pupil center and the iris center from the oblique image acquired by the image acquisition unit 110 (step S102). After that, the masquerade determination unit 130 calculates the deviation between the pupil center 23 and the iris center 24 detected by the center detection unit 120 (step S103).

[0057] Next, the spoofing determination unit 130 calculates the difference between the deviation between the pupil center 23 and the iris center 24 in the front image and the deviation between the pupil center 23 and the iris center 24 in the oblique image (step S304). Then, the spoofing determination unit 130 determines whether the target is a spoof based on the difference calculated in step S304 (step S305). The spoofing determination unit 130 may determine that the target is a spoof, for example, when the difference calculated in step S304 is greater than a predetermined threshold value.

[0058] Although an example in which an oblique image is captured after a front image has been given here, a front image may be captured after an oblique image, that is, steps S101 to S303 may be executed before steps S301 to S303.

[0059] (Technical effect) Next, technical effects obtained by the information processing system 10 according to the third embodiment will be described.

[0060] 8, the information processing system 10 according to the third embodiment judges spoofing by comparing the deviation between the pupil center 23 and the iris center 24 in the front image and the deviation between the pupil center 23 and the iris center 24 in the oblique image. In this way, even if the pupil center 23 and the iris center 24 of the target are originally misaligned (i.e., deviation occurs even in cases other than oblique images), spoofing can be appropriately judged.

[0061] <Fourth embodiment> An information processing system 10 according to the fourth embodiment will be described with reference to Figures 9 and 10. The fourth embodiment differs from the first to third embodiments in part of its configuration and operation, and other parts may be the same as the first to third embodiments. Therefore, hereinafter, parts that differ from the embodiments already described will be described in detail, and other overlapping parts will be omitted as appropriate.

[0062] (Functional configuration) First, the functional configuration of the information processing system 10 according to the fourth embodiment will be described with reference to Fig. 9. Fig. 9 is a block diagram showing the functional configuration of the information processing system according to the fourth embodiment. In Fig. 9, the same elements as those shown in Fig. 2 are denoted by the same reference numerals.

[0063] As shown in Fig. 9, the information processing system 10 according to the fourth embodiment is configured to include, as components for realizing its functions, an image acquisition unit 110, a center detection unit 120, a spoofing determination unit 130, and a first direction determination unit 140. That is, the information processing system 10 according to the fourth embodiment is configured to further include a first direction determination unit 140 in addition to the configuration of the first embodiment (see Fig. 2). The first direction determination unit 140 may be a processing block realized by, for example, the above-mentioned processor 11 (see Fig. 1).

[0064] The first direction determination unit 140 is configured to be capable of determining at least one of the imaging direction and the magnitude of the angle when capturing an oblique image based on the deviation between the pupil center 23 and the iris center 24 in a front image captured from the front of the eye of the subject. For example, when there is a deviation to the right between the pupil center 23 and the iris center 24 in the front image, the first direction determination unit 140 may capture an oblique image from the right obliquely, and when there is a deviation to the left, the first direction determination unit 140 may capture an oblique image from the left obliquely. That is, when a vector is obtained with the iris center 24 as the start point and the pupil center 23 as the end point, if the vector is directed to the right as one faces, the image may be captured from the right (i.e., the line of sight or face may be turned to the left as one faces). As a result, if the pupil center 23 and the iris center 24 are originally misaligned, the degree of misalignment does not change even if the image is taken from an oblique angle, but in the case of pattern contact, the degree of misalignment changes (in the case of pattern contact, the center is misaligned when taken from the front, which is thought to be caused by the line of sight being directed obliquely, and can be easily determined by facing the opposite direction), making it possible to determine whether or not there is pattern contact. Furthermore, the first direction determination unit 140 may, for example, reduce the imaging angle of the oblique image (i.e., the inclination in the oblique direction) when there is a relatively large misalignment between the pupil center 23 and the iris center 24 in the front image, and may increase the imaging angle of the oblique image when there is a relatively small misalignment (or no misalignment).

[0065] (Operation flow) Next, the flow of operations performed by the information processing system 10 according to the fourth embodiment will be described with reference to Fig. 10. Fig. 10 is a flowchart showing the flow of operations performed by the information processing system according to the fourth embodiment. In Fig. 10, the same processes as those shown in Fig. 8 are denoted by the same reference numerals.

[0066] 10, when the information processing system 10 according to the fourth embodiment operates, the image acquisition unit 110 first captures an image of the target eye from the front to acquire a front image (step S301). Then, the center detection unit 120 detects the pupil center 23 and the iris center 24 from the front image acquired by the image acquisition unit 110 (step S302).

[0067] Next, the first determination unit 140 calculates the deviation between the pupil center 23 and the iris center 24 detected by the center detection unit 120 (step S401). Then, the first determination unit 401 determines at least one of the imaging direction and the angle of the oblique image based on the calculated deviation between the pupil center 23 and the iris center 24 (step S402).

[0068] Next, the image acquisition unit 110 acquires an oblique image of the target (step S101). Then, the center detection unit 120 detects the pupil center and the iris center from the oblique image acquired by the image acquisition unit 110 (step S102). After that, the masquerade determination unit 130 calculates the deviation between the pupil center 23 and the iris center 24 detected by the center detection unit 120 (step S103). Then, the masquerade determination unit 130 determines whether the target is a masquerade based on the deviation between the pupil center and the iris center (step S104).

[0069] (Technical effect) Next, technical effects obtained by the information processing system 10 according to the fourth embodiment will be described.

[0070] 9 and 10, in the information processing system 10 according to the fourth embodiment, at least one of the imaging direction and angle of the oblique image is set based on the deviation in the front image between the pupil center 23 and the iris center 24. In this way, the oblique image can be more appropriately captured, taking into account the deviation that originally occurs between the pupil center 23 and the iris center 24 of the subject.

[0071] <Fifth embodiment> An information processing system 10 according to the fifth embodiment will be described with reference to Fig. 11 and Fig. 13. The fifth embodiment differs from the first to fourth embodiments described above only in part of the configuration and operation, and other parts may be the same as the first to fourth embodiments. Therefore, hereinafter, parts that differ from the embodiments already described will be described in detail, and explanations of other overlapping parts will be omitted as appropriate.

[0072] (Functional configuration) First, the functional configuration of the information processing system 10 according to the fifth embodiment will be described with reference to Fig. 11. Fig. 11 is a block diagram showing the functional configuration of the information processing system according to the fifth embodiment. Fig. 12 is a front view showing an example of an imaging direction when imaging an obliquely viewed object. In Fig. 11, the same reference numerals are used to designate the same components as those shown in Fig. 2.

[0073] As shown in Fig. 11, the information processing system 10 according to the fifth embodiment is configured to include, as components for realizing its functions, an image acquisition unit 110, a center detection unit 120, a spoofing determination unit 130, and a first direction determination unit 150. That is, the information processing system 10 according to the fifth embodiment is configured to further include a second direction determination unit 150 in addition to the configuration of the first embodiment (see Fig. 2). The second direction determination unit 150 may be a processing block realized by, for example, the above-mentioned processor 11 (see Fig. 1).

[0074] The second direction determination unit 150 is configured to be able to determine the imaging direction when capturing an oblique image based on the deviation of the iris center 24 caused by the strabismus (specifically, the deviation between the center position of the eye and the iris center 24) when the target has strabismus. For example, when the iris center 24 of the target is deviated to the right from the center of the eye, the second direction determination unit 150 may capture an oblique image from a rightward oblique direction (i.e., the direction of deviation caused by the strabismus) (i.e., direct the gaze to the leftward direction where the movement margin is larger) (see FIG. 12). The second direction determination unit 150 may have a function of determining whether or not the target has strabismus. In this case, the second direction determination unit 150 may determine whether or not the target has strabismus from a front image obtained by capturing the face of the target from the front. The method of determining strabismus is not particularly limited, but it can be determined based on the difference in the gaze direction of both eyes, for example.

[0075] (Operation flow) Next, the flow of operations performed by the information processing system 10 according to the fifth embodiment will be described with reference to Fig. 13. Fig. 13 is a flowchart showing the flow of operations performed by the information processing system according to the fifth embodiment. In Fig. 13, the same processes as those shown in Fig. 5 are denoted by the same reference numerals.

[0076] 13, when the information processing system 10 according to the fifth embodiment operates, the second determination unit 150 first performs strabismus determination for the target (step S501). The second determination unit 150 may perform the strabismus determination using an image of the target acquired by the image acquisition unit 110. Then, the second determination unit 150 determines the imaging direction of the oblique image based on the deviation of the iris center 24 caused by the strabismus (step S502).

[0077] Next, the image acquisition unit 110 acquires an oblique image of the target (step S101). Then, the center detection unit 120 detects the pupil center and the iris center from the oblique image acquired by the image acquisition unit 110 (step S102). After that, the masquerade determination unit 130 calculates the deviation between the pupil center 23 and the iris center 24 detected by the center detection unit 120 (step S103). Then, the masquerade determination unit 130 determines whether the target is a masquerade based on the deviation between the pupil center and the iris center (step S104).

[0078] (Technical effect) Next, technical effects obtained by the information processing system 10 according to the fifth embodiment will be described.

[0079] 11 and 13, in the information processing system 10 according to the fifth embodiment, the imaging direction of the oblique image is determined based on the deviation of the iris center 24 caused by strabismus. In this way, when the line of sight direction is moved to capture an oblique image, the margin for movement is increased, so that the oblique image can be captured more appropriately.

[0080] As in the fourth and fifth embodiments described above, the direction and angle when capturing an oblique image can be appropriately changed to capture the oblique image. The direction and angle when capturing an oblique image may use information other than the information listed here. For example, when the subject wears glasses, the angle when capturing an oblique image may be made larger than when the subject does not wear glasses. When capturing an oblique image, the subject may move his / her line of sight to set the angle, or the camera 18 itself may move to set the angle. Also, the image may be captured multiple times instead of just once. By capturing images multiple times and making a judgment, the accuracy of the judgment can be increased.

[0081] Sixth embodiment An information processing system according to the sixth embodiment will be described with reference to Figures 14 to 16. The sixth embodiment differs from the first to fifth embodiments in part of its configuration and operation, and other parts may be the same as the first to fifth embodiments. Therefore, hereinafter, parts that differ from the embodiments already described will be described in detail, and other overlapping parts will be omitted as appropriate.

[0082] (Functional configuration) First, the functional configuration of the information processing system according to the sixth embodiment will be described with reference to Fig. 14. Fig. 14 is a block diagram showing the functional configuration of the information processing system according to the sixth embodiment.

[0083] 14, the information processing system 20 according to the sixth embodiment is configured to include, as components for realizing its functions, an image acquisition unit 210, an eye information detection unit 220, and a spoofing determination unit 230. Each of the image acquisition unit 210, the eye information detection unit 220, and the spoofing determination unit 230 may be a processing block realized by, for example, the above-mentioned processor 11 (see FIG. 1). Also, the image acquisition unit 210 may acquire an image using the above-mentioned camera 18.

[0084] The image acquiring section 210 is configured to be able to acquire an eye image of the subject (i.e., an image including the subject's eye and the area around the eye). The eye image may be acquired, for example, as a visible light image or as a near-infrared image. In this case, the image acquiring section 210 may be configured to be able to irradiate the subject with near-infrared light. The image acquiring section 210 may be configured to be able to image the subject's eye from the front. The image acquiring section 210 may also be configured to be able to image the subject's eye from an angle different from the front (i.e., obliquely). The eye image captured by the image acquiring section 210 is configured to be output to the eye information detecting section 220.

[0085] The eye information detection unit 220 is configured to be able to detect the pupil 21 of the subject and the colored contact lens worn by the subject from the eye image captured by the image acquisition unit 210. The "colored contact lens" here refers to a contact lens that is colored or has a pattern drawn on its surface, such as a lens called a colored contact lens or a cosmetic contact lens. Note that colored contact lenses usually have no pattern in the center, and many of them have a pattern printed in a donut-shaped area avoiding the center. For this reason, the inner boundary of the pattern area of ​​the colored contact lens may be referred to as an inner circle (not an actual circle, but a virtual circle representing the pattern boundary) below. The eye information detection unit 220 may be configured to be able to detect position information (coordinate information) and size information (for example, the radius of the inner circle, etc.) of the detected pupil 21 and colored contact lens of the subject. The eye information detection unit 220 may be configured to be able to detect information about the eye other than the pupil 21 and the colored contact lens (for example, information about the iris, etc.).

[0086] The spoofing determination unit 230 is configured to be able to determine whether or not the target is a spoof based on a gap between the pupil 21 and the pattern of the colored contact lens detected by the eye information detection unit 220 (sometimes simply referred to as a gap between the pupil and the colored contact lens). The spoofing determination unit 230 may be configured to be able to detect whether or not a gap exists between the pupil 21 and the colored contact lens. In this case, the spoofing determination unit 230 may determine whether or not the target is a spoof based on the presence or absence of a gap. In addition, the spoofing determination unit 230 may be configured to be able to detect the size of the gap between the pupil 21 and the colored contact lens. In this case, the spoofing determination unit 230 may determine whether or not the target is a spoof based on the size of the gap. The gap between the pupil 21 and the colored contact lens will be described in detail later.

[0087] (Operation flow) Next, the flow of operations performed by the information processing system 20 according to the sixth embodiment will be described with reference to Fig. 15. Fig. 15 is a flowchart showing the flow of operations performed by the information processing system according to the sixth embodiment.

[0088] 15, when the information processing system 20 according to the sixth embodiment operates, the image acquisition unit 210 first acquires an image of the subject's eye (step S601). Then, the eye information detection unit 220 detects the pupil 21 of the subject and the colored contact lens worn by the subject from the eye image acquired by the image acquisition unit 210 (step S602).

[0089] Next, spoofing determination unit 230 detects a gap occurring between pupil 21 and the colored contact lens based on the information detected by eye information detection unit 220 (step S603). Then, spoofing determination unit 230 determines whether or not the target is a spoof based on the gap detection result in step S603 (step S604).

[0090] The spoofing determination unit 230 may output the result of the spoofing determination to a user (for example, a system administrator or a security guard). The result of the spoofing determination may be made using, for example, the output device 16 (see FIG. 1). For example, the result of the spoofing determination may be displayed as an image using a display, or may be output as an audio output using a speaker. In addition, when the target is determined to be a spoofed object, a warning (alert) may be output. Alternatively, when the target is determined to be a spoofed object, iris authentication of the target may not be performed, or iris authentication may be performed but the authentication result may always be a failure. Note that, in consideration of the possibility of a false determination due to detection of normal colored contact lenses (i.e., a state in which a non-spoofed object is determined to be a spoofed object), an instruction to remove the contact lenses may be output when the target is determined to be a spoofed object.

[0091] (Gap between pupil and lens) Next, a gap detected by the information processing system 20 according to the sixth embodiment (specifically, a gap occurring between the pupil and a pattern on the contact lens) will be specifically described with reference to Fig. 16. Fig. 16 is a plan view showing an example of a gap occurring between the pupil and the contact lens.

[0092] As shown in FIG. 16, even when a subject is wearing a tinted contact lens 50, a gap is created between the pupil 21 and the tinted contact lens 50, and the iris 22 can be seen through this gap. However, the size of this visible iris area changes depending on the size of the inner circle that represents the inner boundary of the pattern area of ​​the tinted contact lens 50, the size of the pupil (in other words, the degree of pupil contraction), and the like. For example, in FIG. 1 As shown in FIG. 6(a), when the size of the pupil 21 is relatively small or the hole in the center of the colored contact lens 50 is large, the gap that occurs is large. In such a case, it is considered that the colored contact lens 50 is used normally, and that the pattern contact lens is not used for the purpose of impersonation. Even if the pattern contact lens is used for the purpose of impersonation, since the actual iris 22 is visible through the gap, it is possible to prevent fraud by performing authentication using only the actual iris information. When determining the gap, it is also possible to detect whether the pattern is different between the gap area and the colored contact area. For example, in the case of colored contact lenses, a regular pattern may be printed, and this feature may be used to separate the pattern area of ​​the colored contact lens from the original iris area and determine the gap area.

[0093] On the other hand, Fig. 1 As shown in FIG. 6(b), when the size of the pupil 21 is relatively large, or when the central hole of the colored contact lens is small, the resulting gap becomes small. 1 As shown in 6(c), no gaps are created. In such a case, it can be determined that there is a possibility of spoofing.

[0094] (Technical effect) Next, technical effects obtained by the information processing system 20 according to the sixth embodiment will be described.

[0095] As described in Fig. 14 to Fig. 16, in the information processing system 20 according to the sixth embodiment, whether or not a target is impersonating is determined based on the gap between the pupil 21 and the colored contact lens 50. In this way, it is possible to appropriately determine only impersonations using pattern contact lenses other than normal colored contact lenses. Therefore, it is possible to prevent fraudulent breakthroughs in iris authentication without reducing convenience for colored contact lens users.

[0096] Seventh embodiment An information processing system 20 according to the seventh embodiment will be described with reference to Fig. 17 and Fig. 18. The seventh embodiment differs from the sixth embodiment in only some of its operations, and other parts may be the same as the first to sixth embodiments. Therefore, hereinafter, parts that differ from the embodiments already described will be described in detail, and other overlapping parts will be omitted as appropriate.

[0097] (Operation flow) First, the flow of operations performed by the information processing system 20 according to the seventh embodiment will be described with reference to Fig. 17. Fig. 17 is a flowchart showing the flow of operations performed by the information processing system according to the seventh embodiment. In Fig. 17, the same processes as those shown in Fig. 15 are denoted by the same reference numerals.

[0098] 17, when the information processing system 20 according to the seventh embodiment operates, the image acquisition unit 210 first acquires a front image of the subject (step S701). Then, the eye information detection unit 220 detects the pupil 21 of the subject and the colored contact lens 50 worn by the subject from the front image acquired by the image acquisition unit 210 (step S702).

[0099] Next, the spoofing determination unit 230 determines whether or not a gap is present between the pupil 21 and the colored contact lens 50 based on the information detected from the front image by the eye information detection unit 220 (step S703). If a gap is present (step S703: YES), the spoofing determination unit 230 determines that the target is not a spoof (step S708).

[0100] On the other hand, if no gap exists (step S703: NO), the image acquisition unit 210 acquires an oblique image of the subject (step S704). Then, the eye information detection unit 220 detects the pupil 21 of the subject and the colored contact lens 50 worn by the subject from the oblique image acquired by the image acquisition unit 210 (step S705).

[0101] Next, the spoofing determination unit 230 determines whether or not there is a gap between the pupil 21 and the colored contact lens 50 based on the information detected from the oblique image by the eye information detection unit 220 (step S706). If there is no gap even in the oblique image (step S706: NO), the spoofing determination unit 230 determines that the target is a spoof (step S707). However, if there is a gap (step S706: YES), the spoofing determination unit 230 determines that the target is not a spoof (step S708).

[0102] (Gap in diagonal image) Next, gaps occurring in oblique images will be specifically described with reference to Fig. 18. Fig. 18 is a plan view showing an example of a gap occurring between a pupil and a contact lens in an oblique image.

[0103] 18(a), (b), (c), and (d) show how the iris 22 appears when the gaze is directed to the right, left, up, and down, respectively. As already explained, the iris 22 is flat and is located deeper in the eye than the tinted contact lens 50, so when an image of the eye is taken from a slight angle, a gap appears due to the difference in depth between the tinted contact lens 50 and the iris 22. Specifically, even if no gap can be seen in a frontal image, a gap appears between the pupil 21 and the tinted contact lens 50 in the oblique image, and the iris 22 that was previously invisible becomes visible.

[0104] By utilizing such a property, it becomes possible to determine whether a target is spoofing a person based on gaps that appear in the oblique image. Specifically, if there are gaps in the oblique image, it can be determined that the target is wearing normal colored contact lenses 50 (i.e., contact lenses that are not intended for spoofing). On the other hand, if there are no gaps in the oblique image, it can be determined that the target is wearing patterned contact lenses (i.e., contact lenses intended for spoofing).

[0105] (Technical effect) Next, technical effects obtained by the information processing system 20 according to the seventh embodiment will be described.

[0106] As described in Fig. 17 and Fig. 18, in the information processing system 20 according to the seventh embodiment, whether or not a target is a spoof is determined based on gaps that occur in the oblique image. In this way, spoofing using pattern contact lenses can be appropriately determined. Specifically, it is possible to distinguish between normal colored contact lenses 50 and pattern contact lenses intended for spoofing, and to accurately determine spoofing.

[0107] Eighth embodiment An information processing system according to the eighth embodiment will be described with reference to FIG. 19 and FIG. 20. The eighth embodiment describes a specific example of a guidance display for photographing an iris from an oblique angle in the first to seventh embodiments described above, and the configuration of the system and the flow of operations other than the guidance may be the same as those of the first to seventh embodiments. Therefore, hereinafter, the parts different from the already described embodiments will be described in detail, and the description of other overlapping parts will be omitted as appropriate. The generation of the guidance information may be executed by, for example, the above-mentioned processor 11 (see FIG. 1). The presentation of the guidance information may be configured to be outputtable by the above-mentioned output device 16 (see FIG. 1). The guidance information may be displayed, for example, as an image or a message on a display. Alternatively, it may be output as voice information or acoustic information using a speaker or the like.

[0108] (Point Leading) First, a first display example by the information processing system according to the eighth embodiment will be described with reference to Fig. 19. Fig. 19 is a plan view (part 1) showing an example of a guidance display by the information processing system according to the eighth embodiment.

[0109] As shown in FIG. 19, the guidance information when capturing an oblique image may be such that the subject gazes at a point displayed on the screen and moves the point in a direction in which the gaze is to be guided. For example, in the example shown in FIG. 19(a), the point moves successively from the center of the screen to the top, bottom, left, and right. In this way, it is possible to obtain an image in which the subject's eyes are directed up, down, left, and right. In the example shown in FIG. 19(b), the point moves around the screen. In this way, it is possible to obtain an image in which the subject's eyes are directed in various directions. In addition to the above-mentioned display, a message such as "Follow the moving point on the screen with your eyes" may be displayed. Such a message may be output by voice.

[0110] (Guidance by arrows) Next, a second display example by the information processing system according to the eighth embodiment will be described with reference to Fig. 20. Fig. 20 is a plan view (part 2) showing an example of guidance display by the information processing system according to the eighth embodiment.

[0111] As shown in FIG. 20, the guidance information when capturing an oblique image may display multiple arrows indicating the direction to which the user is to be guided around the face of the target displayed on the screen. For example, as shown in FIG. 20(a), eight arrows in the following directions are displayed around the face of the target: up, upper right, right, lower right, down, lower left, left, and upper left. In this way, an image in which the user's eyes are directed up, upper right, right, lower right, down, lower left, left, and upper left can be acquired. Note that, as shown in FIG. 20(b), an arrow corresponding to the direction in which the target is currently facing may be highlighted. In this example, since the target is facing right, the arrow in the right direction is highlighted (for example, displayed in a color different from the other arrows). Also, for a direction in which guidance has already been completed, the arrow may be made to disappear. In this example, since guidance to the upper and upper right has been completed, the arrows pointing up and to the upper right have disappeared. Note that, in addition to the above-mentioned display, a message such as "look to the right" may be displayed. Such a message may be output by voice. Furthermore, the message may be output in a display + audio format (that is, the message may be displayed and output as audio at the same time).

[0112] Although an example of guiding the gaze direction has been given here, a display guiding the face direction, for example, may be performed. Information indicating the specific extent to which the gaze should be moved may be displayed. For example, messages such as "Please move 30 degrees" or "Please move 5 cm" may be output. Furthermore, the extent to which the gaze has been moved may be estimated using gaze estimation technology, and if the amount of movement is insufficient, a message such as "Please move more" may be displayed, or conversely, if the movement is too large, a message such as "Please reduce the amount of movement" may be displayed. Alternatively, instead of displaying the information, the information may be output by voice.

[0113] The above-mentioned guidance is merely an example, and guidance may be performed by other configurations. For example, LED lights may be provided around the screen, and the LED lights in the direction to be guided may be turned on or blinked. Alternatively, a message such as "Move your gaze to the right" may be displayed without displaying an image, or a message such as "Move your gaze to the right" may simply be output by voice.

[0114] (Technical effect) Next, technical effects obtained by the information processing system according to the eighth embodiment will be described.

[0115] As described with reference to FIGS. 19 and 20, in the information processing system according to the ninth embodiment, by displaying guidance information, it becomes possible to guide the user's line of sight and appropriately capture an oblique image.

[0116] Instead of guiding the user's line of sight, the position of the camera 18 can also be changed to capture an oblique image. Specifically, the camera 18 may be placed in front of the target when capturing a front image, and may be placed at an oblique position when capturing an oblique image. Alternatively, after starting to capture an image with the camera 18 placed in front of the target, the camera 18 may be gradually moved to an oblique position while continuing to capture the image (i.e., the position of the camera 18 may be moved while capturing a video). In this case, the movement of the camera 18 and the capture may be stopped at the point when an image that can be determined to be a spoofed image is captured.

[0117] In addition, when a plurality of cameras 18 are provided, the camera 18 used for imaging may be changed to substantially change the position of the camera. For example, the first camera may first image the target's eyes, and then the second camera disposed at a different position from the first camera may image the target. Alternatively, the first camera and the second camera disposed at different angles to the target may simultaneously image the target.

[0118] The scope of each embodiment also includes a processing method in which a program that operates the configuration of each embodiment to realize the functions of the above-mentioned embodiments is recorded on a recording medium, the program recorded on the recording medium is read as code, and executed on a computer. That is, a computer-readable recording medium is also included in the scope of each embodiment. Furthermore, not only the recording medium on which the above-mentioned program is recorded, but also the program itself is included in each embodiment. Furthermore, the program itself may be stored in a server, and part or all of the program may be downloaded from the server to a user terminal.

[0119] Examples of recording media that can be used include floppy disks, hard disks, optical disks, magneto-optical disks, CD-ROMs, magnetic tapes, non-volatile memory cards, and ROMs. In addition, the scope of each embodiment is not limited to programs recorded on the recording media that execute processes by themselves, but also includes programs that operate on an OS in cooperation with other software and functions of an extension board to execute processes. Furthermore, the program itself may be stored in a server, and part or all of the program may be downloaded from the server to a user terminal.

[0120] <Additional Notes> The above-described embodiment may be further described as follows, but is not limited to the following.

[0121] (Appendix 1) The information processing system described in Appendix 1 is an information processing system including: an image acquisition means for acquiring an oblique image of a target's eye captured from an angle other than the front; a center detection means for detecting the center position of the pupil and the center position of the iris from the oblique image; and a determination means for determining whether or not the target is impersonating someone else based on the deviation between the center position of the pupil and the center position of the iris.

[0122] (Appendix 2) The information processing system described in Appendix 2 is the information processing system described in Appendix 1, wherein the determination means determines whether a first vector having the center position of the iris and the center position of the pupil as its starting point and end point, respectively, is greater than a first predetermined value, and if the first vector is greater than the first predetermined value, determines whether the cosine value of the angle between the first vector and a second vector indicating the gaze direction of the target is greater than a second predetermined value, and if the cosine value is greater than the second predetermined value, determines that the target is an impersonator.

[0123] (Appendix 3) The information processing system described in Supplementary Note 3 is the information processing system described in Supplementary Note 1 or 2, wherein the image acquisition means acquires, in addition to the oblique image, a front image of the target's eye taken from the front, the center detection means detects, in addition to the oblique image, the center position of the pupil and the center position of the iris from the front image, and the determination means compares the deviation between the center position of the pupil and the center position of the iris in the oblique image and the front image to determine whether the target is an impersonator.

[0124] (Appendix 4) The information processing system described in Appendix 4 is the information processing system described in any one of Appendixes 1 to 3, further comprising a first direction determination means for determining at least one of an imaging direction and an angle magnitude when capturing the oblique image based on a deviation between the center position of the pupil and the center position of the iris in a frontal image captured from the front of the subject's eye.

[0125] (Appendix 5) The information processing system described in Appendix 5 is the information processing system described in any one of Appendixes 1 to 4, further comprising a second direction determination means for determining an imaging direction when capturing the oblique image based on a shift in the center position of the iris caused by the strabismus when the subject has strabismus.

[0126] (Appendix 6) The information processing system described in Appendix 6 is an information processing system comprising: an image acquisition means for acquiring an eye image of a target's eye; a detection means for detecting the target's pupil and any tinted contact lenses worn by the target from the eye image; and a determination means for determining whether the target is an impersonator based on a gap that occurs between the pupil and the pattern of the tinted contact lens.

[0127] (Appendix 7) The information processing system described in Appendix 7 is the information processing system described in Appendix 7, wherein the image acquisition means further acquires an oblique image of the subject's eye from an angle different from the front when there is no gap between the pupil and the pattern of the tinted contact lens in a front image of the subject's eye captured from the front, and the determination means determines that the subject is an impersonator when there is no gap between the pupil and the pattern of the tinted contact lens in the oblique image.

[0128] (Appendix 8) The information processing device described in Appendix 8 is an information processing device that includes an image acquisition means for acquiring an oblique image of a target's eye captured from an angle other than the front, a center detection means for detecting the center position of the pupil and the center position of the iris from the oblique image, and a determination means for determining whether or not the target is impersonating someone else based on the deviation between the center position of the pupil and the center position of the iris.

[0129] (Appendix 9) The information processing device described in Appendix 9 is an information processing device comprising: an image acquisition means for acquiring an eye image of a target's eye; a detection means for detecting the target's pupil and any tinted contact lenses worn by the target from the eye image; and a determination means for determining whether or not the target is an impersonator based on a gap that occurs between the pupil and the pattern of the tinted contact lens.

[0130] (Appendix 10) The information processing method described in Appendix 10 is an information processing method executed by at least one computer, which obtains an oblique image of a target's eye from an angle other than the front, detects the center position of the pupil and the center position of the iris from the oblique image, and determines whether or not the target is impersonating someone else based on the deviation between the center position of the pupil and the center position of the iris.

[0131] (Appendix 11) The information processing method described in Appendix 11 is an information processing method executed by at least one computer, which obtains an eye image of a target's eye, detects the target's pupil and any tinted contact lenses worn by the target from the eye image, and determines whether the target is an impersonator based on a gap between the pupil and the pattern of the tinted contact lens.

[0132] (Appendix 12) The recording medium described in Appendix 12 is a recording medium having recorded thereon a computer program for causing at least one computer to execute an information processing method of acquiring an oblique image of a target's eye captured from an angle other than the front, detecting a center position of the pupil and a center position of the iris from the oblique image, and determining whether or not the target is impersonating someone else based on the deviation between the center position of the pupil and the center position of the iris.

[0133] (Appendix 13) The recording medium described in Appendix 13 is a recording medium having recorded thereon a computer program for causing at least one computer to execute an information processing method of acquiring an eye image of a subject's eye, detecting the subject's pupil and any tinted contact lenses worn by the subject from the eye image, and determining whether or not the subject is impersonating someone else based on a gap between the pupil and a pattern on the tinted contact lenses.

[0134] (Appendix 14) The computer program described in Appendix 14 is a computer program that causes at least one computer to execute an information processing method of acquiring an oblique image of a target's eye captured from an angle other than the front, detecting a center position of the pupil and a center position of the iris from the oblique image, and determining whether or not the target is impersonating someone else based on a deviation between the center position of the pupil and the center position of the iris.

[0135] (Appendix 15) The computer program described in Appendix 15 is a computer program that causes at least one computer to execute an information processing method of acquiring an eye image of a subject's eye, detecting the subject's pupil and any tinted contact lenses worn by the subject from the eye image, and determining whether or not the subject is impersonating someone else based on a gap between the pupil and a pattern on the tinted contact lenses.

[0136] This disclosure may be modified as appropriate within the scope that does not contradict the gist or idea of ​​the invention that can be read from the claims and the entire specification, and information processing systems, information processing devices, information processing methods, and recording media that involve such modifications are also included in the technical ideas of this disclosure. [Explanation of symbols]

[0137] 10, 20 Information Processing Systems 11 Processors 18 Camera 21 Pupil 22 Iris 23 Pupil center 24 Iris center 50 Colored Contact Lenses 110 Image acquisition unit 120 Center detection unit 130 Spoofing Detection Unit 140 First direction determination unit 150 Second direction determination unit 210 Image acquisition unit 220 Eye information detection unit 230 Spoofing Detection Unit

Claims

1. an image acquisition means for acquiring an oblique image of a subject's eye captured from an angle different from the front and a front image of the subject's eye captured from the front; a center detection means for detecting a center position of a pupil and a center position of an iris from the oblique image and the front image; a determination means for determining whether the subject is impersonating another person by comparing a deviation between a center position of the pupil and a center position of the iris in the oblique image and the front image; An information processing system comprising:

2. The determination means is determining whether a first vector having a start point and an end point at the center position of the iris and the center position of the pupil, respectively, is greater than a first predetermined value; When the first vector is greater than the first predetermined value, determining whether or not a cosine value of an angle between the first vector and a second vector indicating a line of sight of the target is greater than a second predetermined value; If the cosine value is greater than the second predetermined value, the target is determined to be a spoofed object. The information processing system according to claim 1 .

3. 3. The information processing system according to claim 1, further comprising a first direction determination means for determining at least one of an imaging direction and an angle when capturing the oblique image based on a deviation between a center position of the pupil and a center position of the iris in the front image.

4. 4. The information processing system according to claim 1, further comprising a second direction determination means for determining an imaging direction when capturing the oblique image based on a shift in the center position of the iris caused by the strabismus when the subject has strabismus.

5. 1. An information processing method executed by at least one computer, comprising: Obtaining an oblique image of a subject's eye captured from an angle different from a frontal view and a frontal image of the subject's eye captured from a frontal view; Detecting a center position of a pupil and a center position of an iris from the oblique image and the front image; comparing a deviation between a center position of the pupil and a center position of the iris between the oblique image and the front image to determine whether the target is a spoof; Information processing methods.

6. At least one computer Obtaining an oblique image of a subject's eye captured from an angle different from a frontal view and a frontal image of the subject's eye captured from a frontal view; Detecting a center position of a pupil and a center position of an iris from the oblique image and the front image; comparing a deviation between a center position of the pupil and a center position of the iris between the oblique image and the front image to determine whether the target is a spoof; A computer program for executing an information processing method.

Images