Information processing device, information processing method, and recording medium

Abstract

An information processing device (10) comprises: an acquiring means (110) that acquires an eye image including an iris area of a subject; and a determining means (120) that determines whether or not the subject is wearing color contact lenses on the basis of iris color information pertaining to the color of the iris area of the subject and light environment information pertaining to the light environment when the eye image was captured. According to such an information processing device, an eye image including an iris area of a subject can be used to appropriately determine whether color contact lenses are being worn or not.

Description

Information processing device, information processing method, and recording medium

[0001] The present disclosure relates to the technical fields of an information processing device, an information processing method, and a recording medium.

[0002] Iris authentication may not be performed properly if the subject is wearing colored contact lenses. Colored contact lenses may also be used in spoofing attacks that imitate iris patterns. Therefore, when performing iris authentication, it is desirable to be able to detect whether or not colored contact lenses are being worn. For example, Patent Document 1 discloses a technology for detecting whether or not colored contact lenses are being worn by comparing the reflectance of light in multiple wavelength bands.

[0003] International Publication No. 2020 / 121520

[0004] An object of this disclosure is to provide an information processing device, an information processing method, and a recording medium that are capable of appropriately detecting whether or not color contact lenses are being worn.

[0005] A first aspect of the information processing device disclosed herein comprises an acquisition means for acquiring an eye image including an iris region of a subject, and a determination means for determining whether the subject is wearing color contact lenses based on iris color information relating to the color of the iris region of the subject and light environment information relating to the light environment when the eye image was captured.

[0006] A second aspect of the information processing device of this disclosure comprises an acquisition means for acquiring an eye image including an iris region of a subject, and a determination means for determining whether or not the subject is wearing colored contact lenses based on periodicity information regarding the periodicity of the pattern in the iris region.

[0007] A third aspect of the information processing device disclosed herein comprises an acquisition means for acquiring an eye image including an iris region of a subject, and a determination means for determining whether or not the subject is wearing colored contact lenses based on pupil information regarding the pupil included in the eye image.

[0008] A first aspect of the information processing method disclosed herein involves using at least one computer to acquire an eye image including an iris region of a subject, and determining whether the subject is wearing colored contact lenses based on iris color information related to the color of the iris region of the subject and light environment information related to the light environment when the eye image was captured.

[0009] A second aspect of the information processing method of this disclosure involves using at least one computer to acquire an eye image including an iris region of a subject, and determining whether the subject is wearing colored contact lenses based on periodicity information regarding the periodicity of patterns in the iris region.

[0010] A third aspect of the information processing method of this disclosure involves using at least one computer to acquire an eye image of a subject that includes an iris region, and determining whether the subject is wearing colored contact lenses based on pupil information regarding the pupil included in the eye image.

[0011] A first aspect of the recording medium of this disclosure has recorded thereon a computer program that causes at least one computer to execute an information processing method that acquires an eye image including an iris region of a subject, and determines whether the subject is wearing color contact lenses based on iris color information related to the color of the iris region of the subject and light environment information related to the light environment when the eye image was captured.

[0012] A second aspect of the recording medium of this disclosure has recorded thereon a computer program that causes at least one computer to execute an information processing method that acquires an eye image including an iris region of a subject, and determines whether the subject is wearing colored contact lenses based on periodicity information regarding the periodicity of patterns in the iris region.

[0013] A third aspect of the recording medium of this disclosure is a recording medium having a computer program recorded thereon that causes at least one computer to execute an information processing method that acquires an eye image including an iris region of a subject, and determines whether the subject is wearing colored contact lenses based on pupil information regarding the pupil contained in the eye image.

[0014] 1 is a block diagram showing a hardware configuration of a first information processing device. 2 is a block diagram showing a functional configuration of the first information processing device. 3 is a block diagram showing a functional configuration of a second information processing device. 4 is a flowchart showing a flow of operation in the second information processing device. 5 is a block diagram showing a functional configuration of a third information processing device. 6 is a flowchart showing a flow of operation in the third information processing device. 7 is a flowchart showing a flow of operation in the fourth information processing device. 8 is a flowchart showing a flow of operation in the fifth information processing device. 9 is a block diagram showing a functional configuration of a sixth information processing device. 10 is a flowchart showing a flow of operation in the sixth information processing device. 11 is a block diagram showing a functional configuration of a seventh information processing device. 12 is a flowchart showing a flow of operation in the seventh information processing device. 13 is a block diagram showing a functional configuration of an eighth information processing device. 14 is a flowchart showing a flow of operation in the eighth information processing device. 15 is a block diagram showing a functional configuration of a ninth information processing device. 16 is a flowchart showing a flow of operation in the ninth information processing device. 17 is a block diagram showing a functional configuration of a tenth information processing device. 18 is a flowchart showing a flow of operation in the tenth information processing device. 19 is a block diagram showing a functional configuration of an eleventh information processing device. 20 is a flowchart showing a flow of operation in the eleventh information processing device.

[0015] Hereinafter, embodiments of an information processing device, an information processing method, and a recording medium will be described with reference to the drawings.

[0016] First Embodiment A first information processing apparatus will be described with reference to FIGS. 1 to 3. FIG.

[0017] (Hardware Configuration) First, the hardware configuration of the first information processing apparatus will be described with reference to Fig. 1. Fig. 1 is a block diagram showing the hardware configuration of the first information processing apparatus.

[0018] 1, a first information processing device 10 includes a processor 11, a RAM (Random Access Memory) 12, a ROM (Read Only Memory) 13, and a storage device 14. The information processing device 10 may further include an input device 15 and an output device 16. The processor 11, RAM 12, ROM 13, storage device 14, input device 15, and output device 16 are connected to each other via a data bus 17. The data bus 17 may be an interface other than a data bus (for example, a LAN, a USB, etc.).

[0019] The processor 11 loads a computer program. For example, the processor 11 is configured to load a computer program stored in at least one of the RAM 12, the ROM 13, and the storage device 14. Alternatively, the processor 11 may load a computer program stored in a computer-readable storage medium using a storage medium reading device (not shown). The processor 11 may acquire (i.e., load) the computer program from a device (not shown) located outside the information processing device 10 via a network interface. The processor 11 controls the RAM 12, the storage device 14, the input device 15, and the output device 16 by executing the loaded computer program. In particular, in this embodiment, when the processor 11 executes the loaded computer program, a functional block for determining whether the subject is wearing color contact lenses (hereinafter referred to as "color contacts") is realized within the processor 11. In other words, the processor 11 may function as a controller that executes each control in the information processing device 10.

[0020] The processor 11 may be configured as, for example, a central processing unit (CPU), a graphics processing unit (GPU), a field-programmable gate array (FPGA), a digital signal processor (DSP), an application-specific integrated circuit (ASIC), or a quantum processor. The processor 11 may be configured as one of these, or may be configured to use multiple processors in parallel.

[0021] The RAM 12 temporarily stores computer programs executed by the processor 11. The RAM 12 temporarily stores data that the processor 11 temporarily uses while it is executing the computer programs. The RAM 12 may be, for example, a dynamic random access memory (D-RAM) or a static random access memory (SRAM). Alternatively, other types of volatile memory may be used instead of the RAM 12.

[0022] The ROM 13 stores computer programs executed by the processor 11. The ROM 13 may also store fixed data. The ROM 13 may be, for example, a programmable read-only memory (PROM) or an erasable read-only memory (EPROM). Alternatively, other types of non-volatile memory may be used instead of the ROM 13.

[0023] The storage device 14 stores data that the information processing device 10 stores for a long period of time. The storage device 14 may operate as a temporary storage device for the processor 11. The storage device may store computer programs executed by the processor 11. The storage device 14 may include, for example, at least one of a hard disk device, a magneto-optical disk device, an SSD (Solid State Drive), and a disk array device.

[0024] The input device 15 is a device that receives input instructions from a user of the information processing device 10. The input device 15 may include, for example, at least one of a keyboard, a mouse, and a touch panel. The input device 15 may be configured as a mobile terminal such as a smartphone or a tablet. The input device 15 may be, for example, a device that includes a microphone and is capable of voice input. The input device 15 may be, for example, a device that is used only for maintenance. In such a case, the input device 15 may be omitted as appropriate from the components used when operating the information processing device 10.

[0025] The output device 16 is a device that outputs information related to the information processing device 10 to the outside. For example, the output device 16 may be a display device (e.g., a display) that can display information related to the information processing device 10. The output device 16 may also be a speaker or the like that can output information related to the information processing device 10 as audio. The output device 16 may be configured as a mobile terminal such as a smartphone or a tablet.

[0026] 1 shows an example of an information processing device 10 including multiple devices, but all or some of the functions may be realized by a single device. Such an information processing device may be configured to include only the above-mentioned processor 11, RAM 12, and ROM 13, and the other components (i.e., the storage device 14, input device 15, output device 16, etc.) may be provided by an external device connected to the information processing device 10. Furthermore, some of the calculation functions of the information processing device 10 may be realized by an external device (e.g., an external server, a cloud, etc.).

[0027] (Functional Configuration) Next, the functional configuration of the first information processing device 10 will be described with reference to Fig. 2. Fig. 2 is a block diagram showing the functional configuration of the first information processing device.

[0028] 2, the first information processing device 10 is configured as a device that acquires an eye image including the iris region of a subject and determines whether the subject is wearing colored contact lenses. The first information processing device 10 is configured with, as components for realizing its functions, an image acquisition unit 110 and a wear determination unit 120. Each of the image acquisition unit 110 and the wear determination unit 120 may be a processing block realized by, for example, the above-mentioned processor 11 (see FIG. 1).

[0029] The image acquisition unit 110 is configured to acquire an eye image including the subject's iris region. The "iris region" refers not only to the region of the subject's eye where the iris is located, but also to the region where the color contact lenses are located if the subject is wearing them. The eye image may include not only the subject's eye but also the area around the eye or other parts of the eye (e.g., eyebrows, nose, etc.). The image acquisition unit 110 may be configured to acquire the eye image directly from a camera that captured the eye image. Alternatively, the image acquisition unit 110 may be configured to acquire the eye image from a storage device that stores the subject's eye image captured by the camera. The eye image may be automatically captured upon detection of the subject. For example, the eye image may be captured when a moving subject reaches a predetermined position. Alternatively, the eye image may be captured when the subject performs a predetermined operation. For example, the eye image may be captured when the subject presses a capture button. The eye image acquired by the image acquisition unit 110 is configured to be output to the wear determination unit 120.

[0030] The wear determination unit 120 is configured to be able to determine whether or not a subject is wearing colored contact lenses, using the eye image acquired by the image acquisition unit 110. That is, the wear determination unit 120 is configured to be able to determine whether or not colored contact lenses are being worn on the eye of the subject included in the eye image. In addition to the eye image acquired by the image acquisition unit 110, the wear determination unit 120 is configured to receive inputs of information regarding the color of the subject's iris region (hereinafter referred to as "iris color information" as appropriate) and information regarding the lighting environment when the eye image was captured (hereinafter referred to as "light environment information" as appropriate).

[0031] The iris color information is information that indicates the original color of the subject's iris region (i.e., the color of the iris region when colored contact lenses are not being worn). The iris color information may be obtained from an image of the subject captured in advance. Specifically, an image of the subject's eyes not wearing colored contact lenses may be captured in advance, and the iris color information may be obtained from that image. The iris color information may be stored for each subject in, for example, a storage device. In this case, the wear determination unit 120 may be configured to appropriately read out iris color information corresponding to the subject from the storage device.

[0032] The light environment information is information about the light environment when the eye image acquired by the image acquisition unit 110 was captured. The light environment information may include various light-related parameters (specifically, parameters that may affect the capture of the eye image) in addition to the intensity, direction, and type of light. The light environment information may be acquired from a camera that captured the eye image. In this case, the light environment information may be acquired by the image acquisition unit 110 together with the eye image. Alternatively, the light environment information may be acquired from various sensors other than a camera. Alternatively, the light environment information may be estimated from the eye image acquired by the image acquisition unit 110. For example, the light environment information can be estimated from white areas in the image or the entire image.

[0033] The wear determination unit 120 is configured to determine whether or not the subject is wearing colored contact lenses based on the iris color information and light environment information described above. For example, the wear determination unit 120 determines whether or not the subject is wearing colored contact lenses by comparing the color of the iris region in the eye image acquired by the image acquisition unit 110 with the color of the iris region indicated by the iris color information. In this case, the wear determination unit 120 makes the determination based on the light environment information. For example, the wear determination unit 120 may adjust the white balance using the light environment information before comparing the color of the iris region. Note that if the lighting color is uniform, the white balance may also be adjusted based on the light of the lighting reflected by the iris. The white balance may also be adjusted based on the color of the white of the eye. The wear determination unit 120 may output a likelihood of wearing colored contact lenses using, for example, a neural network, and compare the likelihood of wearing with a predetermined threshold to determine whether or not the subject is wearing colored contact lenses.

[0034] In a situation where it is not possible to determine whether colored contact lenses are being worn due to the lighting environment (for example, a situation where the lighting environment is too bright or too dark), the wear determining unit 120 may determine that it is unable to detect whether colored contact lenses are being worn. In this case, guidance information, which will be described in another embodiment below, may be output.

[0035] The wearing assessment unit 120 may have a function of outputting a determination result as to whether or not the subject is wearing colored contact lenses. For example, the wearing assessment unit 120 may display information (e.g., an image or a message) indicating the determination result on a display. In this case, the information indicating the determination result may be displayed so as to be superimposed on an image of the subject's eyes. Alternatively, the wearing assessment unit 120 may output the information indicating the determination result as sound via a speaker. Alternatively, the wearing assessment unit 120 may output the information indicating the determination result to an external device (e.g., a device that executes processing according to the determination result). Specific examples of processing that uses the determination result will be described in detail in other embodiments described below.

[0036] (Flow of Operation) Next, the flow of operation of the first information processing device 10 will be described with reference to Fig. 3. Fig. 3 is a flowchart showing the flow of operation in the first information processing device.

[0037] 3 , when the operation of the first information processing device 10 starts, the image acquisition unit 110 first acquires an image of the target's eye (step S101). The image acquisition unit 110 outputs the acquired image of the target's eye to the wearing determination unit 120.

[0038] Next, the wearing assessment unit 120 acquires iris color information and light environment information (step S102). That is, the wearing assessment unit 120 acquires information about the color of the subject's original iris region and information about the light environment when the subject's eye image was captured.

[0039] Next, the wear determination unit 120 determines whether the subject is wearing colored contact lenses based on the iris color information and the light environment information (step S103), and outputs the determination result (i.e., information indicating whether the subject is wearing colored contact lenses) (step S104).

[0040] (Technical Effects) Next, technical effects obtained by the first information processing device 10 will be described.

[0041] 1 to 3, the first information processing device 10 determines whether or not a subject is wearing colored contact lenses based on iris color information and light environment information. In this way, it is possible to appropriately determine whether or not a subject is wearing colored contact lenses based on the environment in which the eye image was captured. In other words, it is possible to appropriately determine whether or not a subject is wearing colored contact lenses regardless of the light environment in which the eye image was captured.

[0042] Second Embodiment A second information processing device 10 will be described with reference to Figures 4 and 5. The second information processing device 10 differs only in part of its configuration and operation from the first information processing device 10 described above, and other parts may be similar to the first information processing device 10. Therefore, hereinafter, only the parts that differ from the first embodiment will be described in detail, and descriptions of other overlapping parts will be omitted as appropriate.

[0043] (Functional Configuration) First, the functional configuration of the second information processing device 10 will be described with reference to Fig. 4. Fig. 4 is a block diagram showing the functional configuration of the second information processing device. Note that in Fig. 4, the same elements as those shown in Fig. 2 are denoted by the same reference numerals.

[0044] 4, the second information processing device 10 is configured to include, as components for realizing its functions, an image acquisition unit 110 and a wearing determination unit 120. In particular, the image acquisition unit 110 in the second information processing device 10 is configured to be able to acquire an eye image captured using near-infrared light (hereinafter referred to as a "near-infrared eye image"). The wearing determination unit 120 in the second information processing device 10 is configured to receive input of iris color information in a shooting environment using near-infrared light (hereinafter referred to as a "near-infrared iris color information") and light environment information when the near-infrared eye image is captured (hereinafter referred to as a "near-infrared light environment information").

[0045] The wear determination unit 120 in the second information processing device 10 determines whether the subject is wearing color contact lenses based on the near-infrared eye image, near-infrared iris color information, and near-infrared light environment information acquired by the image acquisition unit 110. For example, the wear determination unit 120 determines whether the subject is wearing color contact lenses by comparing the color of the iris region in the near-infrared eye image with the actual color of the iris region indicated by the near-infrared iris color information, based on the light environment related to near-infrared light. Note that eye images captured using near-infrared light are usually monochrome images, but color information can be obtained from the shading of the image.

[0046] (Operation Flow) Next, the operation flow of the second information processing device 10 will be described with reference to Fig. 5. Fig. 5 is a flowchart showing the operation flow in the second information processing device. Note that in Fig. 5, the same processes as those shown in Fig. 3 are denoted by the same reference numerals.

[0047] 5 , when the operation of the second information processing device 10 starts, the image acquisition unit 110 first acquires a near-infrared eye image captured using near-infrared light (step S201). The image acquisition unit 110 outputs the acquired near-infrared eye image to the wear determination unit 120.

[0048] Next, the wearing assessment unit 120 acquires near-infrared iris color information, which is iris color information in an imaging environment using near-infrared light, and near-infrared light environment information, which is light environment information related to near-infrared light (step S202). That is, the wearing assessment unit 120 acquires information about the original color of the subject's iris region when irradiated with near-infrared light, and information about the light environment when the near-infrared eye image was captured.

[0049] Next, the wear determining unit 120 determines whether the subject is wearing color contact lenses based on the near-infrared iris color information and the near-infrared light environment information (step S203).The wear determining unit 120 then outputs the determination result (i.e., information indicating whether the subject is wearing color contact lenses) (step S104).

[0050] (Technical Effects) Next, technical effects obtained by the second information processing device 10 will be described.

[0051] 4 and 5, the second information processing device 10 captures an eye image using near-infrared light. The second information processing device 10 then determines whether or not the subject is wearing colored contact lenses based on iris color information in the imaging environment using near-infrared light and light environment information related to near-infrared light. In this way, it is possible to appropriately determine whether or not the subject is wearing colored contact lenses based on the imaging environment using near-infrared light.

[0052] <Third Embodiment> A third information processing device 10 will be described with reference to Figures 6 and 7. Note that the third information processing device 10 differs only in part of the configuration and operation from the first and second information processing devices 10 described above, and other parts may be similar to the first and second information processing devices 10. Therefore, hereinafter, parts that differ from the embodiments already described will be described in detail, and explanations of other overlapping parts will be omitted as appropriate.

[0053] (Functional Configuration) First, the functional configuration of the third information processing device 10 will be described with reference to Fig. 6. Fig. 6 is a block diagram showing the functional configuration of the third information processing device. Note that in Fig. 6, the same elements as those shown in Fig. 2 are denoted by the same reference numerals.

[0054] 6, the third information processing device 10 includes, as components for realizing its functions, an image acquisition unit 110 and an attachment determination unit 120. In particular, the image acquisition unit 110 in the third information processing device 10 is configured to be capable of acquiring a first eye image captured using visible light and a second eye image captured using near-infrared light.

[0055] In addition, the wearing determination unit 120 in the third information processing device 10 is configured to receive as input iris color information in an imaging environment using visible light (hereinafter referred to as "visible light iris color information" as appropriate) and light environment information when the first image was captured (hereinafter referred to as "visible light light environment information" as appropriate).

[0056] The wearing determination unit 120 in the third information processing device 10 further includes a pattern acquisition unit 121. The pattern acquisition unit 121 is configured to be able to acquire the pattern of the iris region from the second image (i.e., the eye image captured using near-infrared light). The pattern acquisition unit 121 may be configured to detect a pattern of dots or lines in the iris region by analyzing the second image, for example. Note that a specific method for acquiring the pattern of the iris region from the eye image can be achieved by appropriately adopting existing technology, and therefore a detailed description thereof will be omitted here.

[0057] The wear determination unit 120 in the third information processing device 10 determines whether the subject is wearing colored contact lenses based on the first eye image, visible light iris color information, and visible light light environment information. For example, the wear determination unit 120 determines whether the subject is wearing colored contact lenses by comparing the color of the iris region in the first eye image with the actual color of the iris region indicated by the iris color information, based on the light environment. In this case, the wear determination unit 120 also determines whether the subject is wearing colored contact lenses based on the pattern of the iris region acquired from the second eye image. For example, if the pattern of the iris region acquired by the pattern acquisition unit 121 matches the pattern of the colored contact lenses, it can be determined that there is a high possibility that the subject is wearing colored contact lenses.

[0058] (Operation Flow) Next, the operation flow of the third information processing device 10 will be described with reference to Fig. 7. Fig. 7 is a flowchart showing the operation flow in the third information processing device. Note that in Fig. 7, the same processes as those shown in Fig. 3 are denoted by the same reference numerals.

[0059] 7 , when the operation of the third information processing device 10 starts, the image acquisition unit 110 first acquires a first eye image captured using visible light (step S301). The image acquisition unit 110 also acquires a second eye image captured using near-infrared light (step S302). Note that the process of step S301 and the process of step S302 may be executed in tandem. That is, either the first eye image or the second eye image may be acquired first. The image acquisition unit 110 outputs each of the acquired first eye image and second eye image to the wearing determination unit 120.

[0060] Next, the wearing assessment unit 120 acquires visible light iris color information, which is iris color information in an imaging environment using visible light, and visible light light environment information, which is light environment information related to visible light (step S303). That is, the wearing assessment unit 120 acquires information about the original color of the subject's iris region when irradiated with visible light, and information about the light environment when the first eye image was captured.

[0061] Next, the pattern acquisition unit 121 in the wearing assessment unit 120 acquires the pattern of the iris region from the second image (step S304). Note that the process of step S304 may be executed before or after the process of step S303. That is, it does not matter whether the pattern of the iris region or the visible light iris color information and visible light light environment information is acquired first.

[0062] Next, the wear determination unit 120 determines whether or not the subject is wearing colored contact lenses based on the visible light iris color information, the visible light light environment information, and the pattern of the iris region acquired by the pattern acquisition unit 121 (step S305).The wear determination unit 120 then outputs the determination result (i.e., information indicating whether or not the subject is wearing colored contact lenses) (step S104).

[0063] (Technical Effects) Next, technical effects obtained by the third information processing apparatus 10 will be described.

[0064] As described with reference to FIGS. 6 and 7 , the third information processing device 10 acquires a first eye image captured using visible light and a second eye image captured using near-infrared light. The third information processing device 10 then determines whether or not the subject is wearing colored contact lenses based on the visible light iris color information, the visible light light environment information, and the pattern of the iris region. Here, color information is more easily acquired from eye images captured using visible light than from eye images captured using near-infrared light. On the other hand, the iris pattern is more easily detected from eye images captured using near-infrared light than from eye images captured using visible light. Therefore, by using the first eye image captured using visible light and the second eye image captured using near-infrared light separately for different purposes, it is possible to appropriately determine whether or not the subject is wearing colored contact lenses.

[0065] <Fourth embodiment> A fourth information processing device 10 will be described with reference to Figures 8 and 9. Note that the fourth information processing device 10 differs only in part of the configuration and operation from the first to third information processing devices 10 described above, and other parts may be similar to the first to third information processing devices 10. Therefore, hereinafter, parts that differ from the embodiments already described will be described in detail, and descriptions of other overlapping parts will be omitted as appropriate.

[0066] (Functional Configuration) First, the functional configuration of the fourth information processing device 10 will be described with reference to Fig. 8. Fig. 8 is a block diagram showing the functional configuration of the fourth information processing device. Note that in Fig. 8, the same elements as those shown in Fig. 2 are denoted by the same reference numerals.

[0067] 8, the fourth information processing device 10 is configured to include, as components for realizing its functions, an image acquisition unit 110 and an attachment determination unit 120. In particular, the attachment determination unit 120 in the fourth information processing device 10 is configured to include a periodicity acquisition unit 122.

[0068] The periodicity acquisition unit 122 is configured to be able to acquire the periodicity of the pattern in the iris region from the eye image of the subject acquired by the image acquisition unit 110. The periodicity acquisition unit 122 may acquire the periodicity of the pattern in the iris region by, for example, performing a Fourier transform on the eye image of the subject. Alternatively, the periodicity acquisition unit 122 may acquire the periodicity of the pattern in the iris region using a model learned by deep learning.

[0069] The wear determination unit 120 in the fourth information processing device 10 determines whether the subject is wearing colored contact lenses based on the periodicity of the pattern in the iris region acquired by the periodicity acquisition unit 122, in addition to the iris color information and light environment information already described. Because colored contact lenses are industrial products (i.e., products mass-produced using machines), their patterns often have a specific periodicity. Therefore, using the periodicity of the pattern acquired from the subject's eye image can more appropriately determine whether or not the subject is wearing colored contact lenses. For example, if the information acquired by the periodicity acquisition unit 122 shows that the pattern in the iris region has strong periodicity in a specific frequency range, it can be determined that the subject is likely to be wearing colored contact lenses. Conversely, if the information acquired by the periodicity acquisition unit 122 shows that the pattern in the iris region has almost no periodicity, it can be determined that the subject is unlikely to be wearing colored contact lenses.

[0070] However, some color contact lenses do not have a periodic pattern. Therefore, even if the pattern in the iris area does not have a periodic pattern, it may be determined that the subject is wearing color contact lenses based on the iris color information and the light environment information.

[0071] (Operation Flow) Next, the operation flow of the fourth information processing device 10 will be described with reference to Fig. 9. Fig. 9 is a flowchart showing the operation flow in the fourth information processing device. Note that in Fig. 9, the same processes as those shown in Fig. 3 are denoted by the same reference numerals.

[0072] 9 , when the operation of the fourth information processing device 10 starts, the image acquisition unit 110 first acquires an image of the target's eye (step S101). The image acquisition unit 110 outputs the acquired image of the target's eye to the wearing determination unit 120.

[0073] Next, the wearing assessment unit 120 acquires iris color information and light environment information (step S102). That is, the wearing assessment unit 120 acquires information about the color of the subject's original iris region and information about the light environment when the subject's eye image was captured.

[0074] Next, the periodicity acquisition unit 122 in the wearing determination unit 120 acquires the periodicity of the pattern in the iris region from the eye image of the target (step S401). Note that the process of step S401 may be executed before or after the process of step S102. That is, it does not matter whether the periodicity of the pattern in the iris region or the iris color information and light environment information is acquired first.

[0075] Next, the wear determination unit 120 determines whether the subject is wearing colored contact lenses based on the periodicity of the pattern in the iris region, the iris color information, and the light environment information (step S402).The wear determination unit 120 then outputs the determination result (i.e., information indicating whether the subject is wearing colored contact lenses) (step S104).

[0076] (Technical Effects) Next, technical effects obtained by the fourth information processing apparatus 10 will be described.

[0077] 8 and 9, the fourth information processing device 10 determines whether or not the subject is wearing colored contact lenses based on the periodicity of the pattern in the iris region, iris color information, and light environment information. In this way, it is possible to more appropriately determine whether or not the subject is wearing colored contact lenses based on the characteristic of colored contact lenses that their patterns have periodicity.

[0078] Fifth Embodiment A fifth information processing device 10 will be described with reference to Figures 10 and 11. The fifth information processing device 10 differs only in part of the configuration and operation from the first to fourth information processing devices 10 described above, and other parts may be similar to the first to fourth information processing devices 10. Therefore, the following will describe in detail the parts that differ from the embodiments already described, and will omit explanations of other overlapping parts as appropriate.

[0079] (Functional Configuration) First, the functional configuration of the fifth information processing device 10 will be described with reference to Fig. 10. Fig. 10 is a block diagram showing the functional configuration of the fifth information processing device. Note that in Fig. 10, the same elements as those shown in Fig. 2 are denoted by the same reference numerals.

[0080] 10 , the fifth information processing device 10 is configured to include, as components for realizing its functions, an image acquisition unit 110 and a wearing determination unit 120. In particular, the wearing determination unit 120 in the fifth information processing device 10 is configured to include a pupil information acquisition unit 123.

[0081] The pupil information acquisition unit 123 is configured to be able to acquire pupil information, which is information relating to the pupil, from the eye image of the subject acquired by the image acquisition unit 110. The wear determination unit 120 in the fifth information processing device 10 determines whether the subject is wearing colored contact lenses based on the pupil information acquired by the pupil information acquisition unit 123, in addition to the iris color information and light environment information already described.

[0082] The pupil information may be information about the size and ratio of the pupil. For example, the pupil information may include information about the area and diameter of the pupil. Alternatively, the pupil information may include information about the ratio of the pupil to the white of the eye or the ratio of the pupil to the entire face. The pupil information may also include information about the distance from the inner corner to the outer corner of the eye or the distance between the eyes.

[0083] The wear determination unit 120 in the fifth information processing device 10 may, for example, determine whether the subject is wearing colored contact lenses by comparing the pupil size and ratio acquired by the pupil information acquisition unit 123 with a typical pupil size and ratio. Alternatively, the wear determination unit 120 may determine whether the subject is wearing colored contact lenses by comparing the pupil size and ratio acquired by the pupil information acquisition unit 123 with a pupil size and ratio appropriate for the subject's age. Alternatively, the wear determination unit 120 may determine whether the subject is wearing colored contact lenses by comparing the pupil size and ratio acquired by the pupil information acquisition unit 123 with the subject's original pupil size and ratio acquired in advance. Note that the subject's original pupil size and ratio may be acquired in advance from an image of the subject's eyes captured without wearing colored contact lenses.

[0084] (Operation Flow) Next, the operation flow of the fifth information processing device 10 will be described with reference to Fig. 11. Fig. 11 is a flowchart showing the operation flow in the fifth information processing device. Note that in Fig. 11, the same processes as those shown in Fig. 3 are denoted by the same reference numerals.

[0085] 11 , when the operation of the fifth information processing device 10 starts, the image acquisition unit 110 first acquires an image of the target's eye (step S101). The image acquisition unit 110 outputs the acquired image of the target's eye to the wearing determination unit 120.

[0086] Next, the wearing assessment unit 120 acquires iris color information and light environment information (step S102). That is, the wearing assessment unit 120 acquires information about the color of the subject's original iris region and information about the light environment when the subject's eye image was captured.

[0087] Next, the pupil information acquisition unit 123 in the wearing determination unit 120 acquires pupil information from the eye image of the subject (step S501). Note that the process of step S501 may be executed before or after the process of step S102. That is, it does not matter whether the pupil information or the iris color information and light environment information is acquired first.

[0088] Next, the wear determination unit 120 determines whether the subject is wearing colored contact lenses based on the pupil information, iris color information, and light environment information (step S502).The wear determination unit 120 then outputs the determination result (i.e., information indicating whether the subject is wearing colored contact lenses) (step S104).

[0089] (Technical Effects) Next, technical effects obtained by the fifth information processing apparatus 10 will be described.

[0090] 10 and 11, the fifth information processing device 10 determines whether or not the subject is wearing colored contact lenses based on pupil information, iris color information, and light environment information. In this way, it is possible to appropriately determine whether or not the subject is wearing colored contact lenses based on information about the subject's pupils in addition to the environment in which the eye image was captured.

[0091] Sixth Embodiment A sixth information processing device 10 will be described with reference to Figures 12 and 13. The sixth information processing device 10 differs only in part of the configuration and operation from the fifth information processing device 10 described above, and other parts may be similar to the first to fifth information processing devices 10. Therefore, the following will describe in detail the parts that differ from the embodiments already described, and will omit explanations of other overlapping parts as appropriate.

[0092] (Functional Configuration) First, the functional configuration of the sixth information processing device 10 will be described with reference to Fig. 12. Fig. 12 is a block diagram showing the functional configuration of the sixth information processing device. Note that in Fig. 12, the same elements as those shown in Fig. 10 are denoted by the same reference numerals.

[0093] 12 , the sixth information processing device 10 is configured to include, as components for realizing its functions, an image acquisition unit 110 and a wearing determination unit 120. In particular, the wearing determination unit 120 in the sixth information processing device 10 is configured to further include a makeup / skin information acquisition unit 124 in addition to a pupil information acquisition unit 123.

[0094] The makeup / skin information acquisition unit 124 is configured to acquire at least one of makeup information related to the makeup of the subject and skin information related to the texture of the subject's skin. The makeup / skin information acquisition unit 124 may be configured to acquire the makeup information and skin information from, for example, an image of the subject's eyes. Alternatively, the makeup / skin information acquisition unit 124 may be configured to acquire the makeup information and skin information from an image of the subject other than an eye image (e.g., a face image captured separately). Note that makeup information and skin information can be easily acquired from an image captured using near-infrared light.

[0095] The wearing determination unit 120 in the sixth information processing device 10 determines whether or not the subject is wearing colored contact lenses based on the makeup information and skin information acquired by the makeup / skin information acquisition unit 124, in addition to the pupil information acquired by the pupil information acquisition unit 123. Specifically, the wearing determination unit 120 estimates the subject's age from the makeup information and skin information acquired by the makeup / skin information acquisition unit 124. Then, the wearing determination unit 120 determines whether or not the subject is wearing colored contact lenses by comparing the pupil size and ratio acquired by the pupil information acquisition unit 123 with the pupil size and ratio corresponding to the estimated age of the subject.

[0096] (Operation Flow) Next, the operation flow of the sixth information processing device 10 will be described with reference to Fig. 13. Fig. 13 is a flowchart showing the operation flow in the sixth information processing device. Note that in Fig. 13, the same processes as those shown in Fig. 11 are denoted by the same reference numerals.

[0097] 13 , when the operation of the sixth information processing device 10 starts, the image acquisition unit 110 first acquires an image of the target's eye (step S101). The image acquisition unit 110 outputs the acquired image of the target's eye to the wearing determination unit 120.

[0098] Next, the wearing assessment unit 120 acquires iris color information and light environment information (step S102). That is, the wearing assessment unit 120 acquires information about the color of the subject's original iris region and information about the light environment when the subject's eye image was captured.

[0099] Next, the pupil information acquisition unit 123 in the wearing assessment unit 120 acquires pupil information from the eye image of the subject (step S501). Then, the makeup / skin information acquisition unit 124 in the wearing assessment unit 120 acquires at least one of the makeup information and skin information of the subject (step S601). Note that the processing of steps S501, S601, and S102 may be executed in tandem. That is, the pupil information, makeup information and skin information, iris color information, and light environment information may be acquired in any order.

[0100] Next, the wear determination unit 120 determines whether the subject is wearing colored contact lenses based on the pupil information, makeup information, skin information, iris color information, and light environment information (step S602).The wear determination unit 120 then outputs the determination result (i.e., information indicating whether the subject is wearing colored contact lenses) (step S104).

[0101] (Technical Effects) Next, technical effects obtained by the sixth information processing apparatus 10 will be described.

[0102] 12 and 13, the sixth information processing device 10 determines whether or not a subject is wearing colored contact lenses based on pupil information, makeup information, and skin information. In this way, it is possible to more appropriately determine whether or not a subject is wearing colored contact lenses from pupil information based on the subject's age.

[0103] Seventh Embodiment A seventh information processing device 10 will be described with reference to Figures 14 and 15. The seventh information processing device 10 differs only in part of the configuration and operation from the first to sixth information processing devices 10 described above, and other parts may be similar to the first to sixth information processing devices 10. Therefore, hereinafter, parts that differ from the embodiments already described will be described in detail, and descriptions of other overlapping parts will be omitted as appropriate.

[0104] (Functional Configuration) First, the functional configuration of the seventh information processing device 10 will be described with reference to Fig. 14. Fig. 14 is a block diagram showing the functional configuration of the seventh information processing device. Note that in Fig. 14, the same elements as those shown in Fig. 2 are denoted by the same reference numerals.

[0105] 14, the seventh information processing device 10 is configured to include, as components for realizing its functions, an image acquisition unit 110, an attachment determination unit 120, and an identification unit 130. That is, the seventh information processing device 10 is configured to further include the identification unit 130 in addition to the components described in the first embodiment (see FIG. 2).

[0106] The identification unit 130 is configured to be able to identify the type of colored contact lenses worn by the subject when it is determined that the subject is wearing colored contact lenses. Here, "type" may be, for example, pattern, color, manufacturer, or product name. Note that the identification unit 130 may narrow down the types when it is unable to identify the type. Specifically, when it is unable to identify a single product name for the colored contact lenses, the identification unit 130 may narrow down the types to several products.

[0107] The identification unit 130 may identify the type of color contact lenses using, for example, dictionary information prepared in advance. For example, the identification unit 130 may be configured to identify the type of color contact lenses when the pattern of the iris region detected from the eye image matches a pattern registered in the dictionary. In this case, the comparison of the patterns of the color contact lenses may be performed using feature amounts extracted from the image.

[0108] The identification unit 130 may have a function to output the identification result (i.e., information indicating the type of colored contact lenses). For example, the identification unit 130 may display information indicating the identification result on a display. Alternatively, the identification unit 130 may output the information indicating the identification result as audio via a speaker. Alternatively, the identification unit 130 may output the information indicating the identification result to an external device (e.g., a device that executes processing according to the identification result).

[0109] (Operation Flow) Next, the operation flow of the seventh information processing device 10 will be described with reference to Fig. 15. Fig. 15 is a flowchart showing the operation flow in the seventh information processing device. Note that in Fig. 15, the same processes as those shown in Fig. 3 are denoted by the same reference numerals.

[0110] 15 , when the operation of the seventh information processing device 10 starts, the image acquisition unit 110 first acquires an image of the target's eye (step S101). The image acquisition unit 110 outputs the acquired image of the target's eye to the wearing determination unit 120.

[0111] Next, the wearing assessment unit 120 acquires iris color information and light environment information (step S102). That is, the wearing assessment unit 120 acquires information about the color of the subject's original iris region and information about the light environment when the subject's eye image was captured.

[0112] Next, the wear determination unit 120 determines whether the subject is wearing colored contact lenses based on the iris color information and the light environment information (step S103). If it is determined that the subject is wearing colored contact lenses (step S701: YES), the identification unit 130 identifies the type of colored contact lenses worn by the subject (step S702). The identification unit 130 then outputs the identification result (i.e., information indicating the type of colored contact lenses worn by the subject) (step S703).

[0113] If it is determined that the subject is not wearing colored contact lenses (step S701: NO), the processes of steps S702 and S703 described above are skipped. In other words, if the subject is not wearing colored contact lenses, the process of identifying the type of colored contact lenses and the process of outputting the identification result are not executed.

[0114] (Technical Effects) Next, technical effects obtained by the seventh information processing apparatus 10 will be described.

[0115] 14 and 15 , in the seventh information processing device 10, when it is determined that the subject is wearing colored contacts, the type of colored contacts is identified. In this way, information regarding the type of colored contacts can be used for various purposes. For example, the identification result may be used as feedback information for improving the determination accuracy of the wear determination unit 120. Alternatively, the identification result may be used as information for updating the wear determination unit 120 in line with trends.

[0116] Eighth Embodiment An eighth information processing device 10 will be described with reference to Figures 16 and 17. The eighth information processing device 10 differs only in part of the configuration and operation from the first to seventh information processing devices 10 described above, and other parts may be similar to the first to seventh information processing devices 10. Therefore, hereinafter, parts that differ from the embodiments already described will be described in detail, and descriptions of other overlapping parts will be omitted as appropriate.

[0117] (Functional Configuration) First, the functional configuration of the eighth information processing device 10 will be described with reference to Fig. 16. Fig. 16 is a block diagram showing the functional configuration of the eighth information processing device. Note that in Fig. 16, the same elements as those shown in Fig. 2 are denoted by the same reference numerals.

[0118] 16, the eighth information processing device 10 is configured to include, as components for realizing its functions, an image acquisition unit 110, an attachment determination unit 120, and an authentication unit 140. That is, the eighth information processing device 10 is configured to further include the authentication unit 140 in addition to the components described in the first embodiment (see FIG. 2).

[0119] The authentication unit 140 is configured to be able to perform authentication processing of a target. Specifically, the authentication unit 140 is configured to be able to perform iris authentication using an image of the target's eyes, and authentication using an image of a target other than an eye image. Examples of authentication using an image of a target other than an eye image include face authentication, fingerprint authentication, palm print authentication, and eye surrounding authentication. Note that, since existing technologies can be appropriately adopted as the specific methods of each authentication processing, detailed explanations will be omitted here. The following description will be given taking as an example a case where the authentication unit 140 is configured to be able to perform iris authentication and face authentication.

[0120] (Operational Flow) Next, the operational flow of the eighth information processing device 10 will be described with reference to Fig. 17. Fig. 17 is a flowchart showing the operational flow in the eighth information processing device. Note that in Fig. 17, the same processes as those shown in Fig. 3 are denoted by the same reference numerals.

[0121] 17 , when the operation of the eighth information processing device 10 starts, the image acquisition unit 110 first acquires an image of the target's eye (step S101). The image acquisition unit 110 outputs the acquired image of the target's eye to the wearing determination unit 120.

[0122] Next, the wearing assessment unit 120 acquires iris color information and light environment information (step S102). That is, the wearing assessment unit 120 acquires information about the color of the subject's original iris region and information about the light environment when the subject's eye image was captured.

[0123] Next, the wear determination unit 120 determines whether the subject is wearing colored contact lenses based on the iris color information and the light environment information (step S103). If it is determined that the subject is not wearing colored contact lenses (step S801: YES), the authentication unit 140 performs iris authentication using the subject's eye image (step S802). On the other hand, if it is determined that the subject is wearing colored contact lenses (step S801: NO), the authentication unit 140 acquires the subject's face image (step S803) and performs face authentication using the acquired face image (step S804). Note that the subject's face image may be acquired together by the image acquisition unit 110 when acquiring the subject's eye image (i.e., in step S101).

[0124] Thereafter, the authentication unit 140 outputs information indicating the authentication result of the target (step S805). The authentication unit 140 may also execute a process according to the authentication result. For example, if the authentication is successful, the authentication unit 140 may execute a process to open the gate through which the target is attempting to pass, and if the authentication is unsuccessful, the authentication unit 140 may execute a process to close the gate through which the target is attempting to pass.

[0125] (Technical Effects) Next, technical effects obtained by the eighth information processing apparatus 10 will be described.

[0126] 16 and 17, the eighth information processing device 10 executes different authentication processes depending on whether or not colored contact lenses are worn. In this way, it is possible to execute appropriate authentication processes depending on whether or not colored contact lenses are worn.

[0127] <Ninth embodiment> A ninth information processing device 10 will be described with reference to Figures 18 and 19. Note that the ninth information processing device 10 differs only in part of the configuration and operation from the above-described eighth information processing device 10, and other parts may be similar to the first to eighth information processing devices 10. Therefore, hereinafter, parts that differ from the embodiments already described will be described in detail, and explanations of other overlapping parts will be omitted as appropriate.

[0128] (Functional Configuration) First, the functional configuration of the ninth information processing device 10 will be described with reference to Fig. 18. Fig. 18 is a block diagram showing the functional configuration of the ninth information processing device. Note that in Fig. 18, the same elements as those shown in Fig. 16 are denoted by the same reference numerals.

[0129] 18, the ninth information processing device 10 is configured to include, as components for realizing its functions, an image acquisition unit 110, an attachment determination unit 120, an authentication unit 140, and a guiding unit 150. That is, the ninth information processing device 10 is configured to further include the guiding unit 150 in addition to the components described in the eighth embodiment (see FIG. 16).

[0130] The guiding unit 150 is configured to output guiding information for putting the target into a state suitable for authentication when it is determined that the target is wearing colored contact lenses. For example, the guiding unit 150 may display the guiding information on a display. Alternatively, the guiding unit 150 may output the guiding information as sound via a speaker.

[0131] The guiding unit 150 may output a message such as, "Please remove your colored contact lenses." In this case, the subject is guided to remove the colored contact lenses, which is expected to create a state suitable for iris authentication. Alternatively, the guiding unit 150 may guide the subject's gaze in multiple directions while keeping the face facing forward. By moving the gaze, the iris area obscured by the colored contact lenses changes, making it possible to capture multiple unobstructed iris areas. For example, the guiding unit 150 may output a message such as, "Keep your face facing forward and look up." In this case, the subject is guided to only look up, which creates a misalignment between the colored contact lenses and the iris area, making it easier to capture the iris area of ​​the lower half of the subject's eye. Alternatively, the guiding unit 150 may output a message such as, "Please face the camera (used for capturing facial images)." In this case, the subject is guided to look toward the camera, which is expected to create a state suitable for facial authentication. Alternatively, the guiding unit 150 may output a message such as, "Please move to a well-lit area." In this case, the subject is guided to move to a brighter location, which is expected to improve the lighting environment and create conditions suitable for various authentication methods. Furthermore, since the subject's pupils become smaller in brighter locations, it is expected that the iris area will be easier to obtain from the center of the colored contact lenses. Instead of moving the subject to a brighter location, the location of the subject may be brighter by adjusting the light intensity, for example.

[0132] (Operation Flow) Next, the operation flow of the ninth information processing device 10 will be described with reference to Fig. 19. Fig. 19 is a flowchart showing the operation flow in the ninth information processing device. Note that in Fig. 19, the same processes as those shown in Fig. 3 are denoted by the same reference numerals.

[0133] 19 , when the operation of the ninth information processing device 10 starts, the image acquisition unit 110 first acquires an image of the target's eye (step S101). The image acquisition unit 110 outputs the acquired image of the target's eye to the wearing determination unit 120.

[0134] Next, the wearing assessment unit 120 acquires iris color information and light environment information (step S102). That is, the wearing assessment unit 120 acquires information about the color of the subject's original iris region and information about the light environment when the subject's eye image was captured.

[0135] Next, the wearing determination unit 120 determines whether the subject is wearing colored contact lenses based on the iris color information and the light environment information (step S103). If it is determined that the subject is wearing colored contact lenses (step S901: YES), the guidance unit 150 outputs guidance information to the subject (step S902).

[0136] After the subject performs an action in accordance with the guidance information, the image acquisition unit 110 captures and reacquires an image of the subject (step S903). Note that the image acquired here may be an image in accordance with the guidance information. For example, if the subject is guided to remove colored contact lenses and iris authentication is to be performed, the image acquisition unit 110 may acquire an image of the subject's eyes. Alternatively, if the subject is guided to face the camera and facial authentication is to be performed, the image acquisition unit 110 may acquire an image of the subject's face.

[0137] Next, the authentication unit 140 executes authentication processing for the target (step S904). After that, the authentication unit 140 outputs information indicating the authentication result for the target (step S905). Note that if it is determined that the target is not wearing colored contact lenses (step S901: NO), the processing of steps S902 and S903 described above is omitted. That is, the guidance unit 150 does not output guidance information. In this case, iris authentication may be performed using the first acquired image of the target's eyes.

[0138] (Technical Effects) Next, technical effects obtained by the ninth information processing apparatus 10 will be described.

[0139] 18 and 19, in the ninth information processing device 10, when the target is wearing color contact lenses, guidance information is output to the target. In this way, even when the target is wearing color contact lenses, it is possible to properly execute the authentication process.

[0140] <Tenth embodiment> A tenth information processing device 10 will be described with reference to Figures 20 and 21. Note that the tenth information processing device 10 differs only in part of the configuration and operation from the first to ninth information processing devices 10 described above, and other parts may be similar to the first to ninth information processing devices 10. Therefore, hereinafter, parts that differ from the embodiments already described will be described in detail, and descriptions of other overlapping parts will be omitted as appropriate.

[0141] (Functional Configuration) First, the functional configuration of the tenth information processing device 10 will be described with reference to Fig. 20. Fig. 20 is a block diagram showing the functional configuration of the tenth information processing device. Note that in Fig. 20, the same elements as those shown in Fig. 2 and Fig. 8 are denoted by the same reference numerals.

[0142] As shown in Fig. 20 , the tenth information processing device 10 is configured to include an image acquisition unit 110 and a wearing determination unit 120 as components for realizing its functions. Note that the wearing determination unit 120 in the tenth information processing device 10 receives an eye image acquired by the image acquisition unit 110, but does not receive iris color information and light environment information as in the configuration described in the first embodiment (see Fig. 2 ). On the other hand, the wearing determination unit 120 in the tenth information processing device 10 includes a periodicity acquisition unit 122. The periodicity acquisition unit 122 may have the same configuration as that described in the fourth embodiment (see Fig. 8 ).

[0143] The wear determination unit 120 in the information processing device 10 of the tenth embodiment is configured to be able to determine whether or not the subject is wearing colored contact lenses based on the subject's eye image acquired by the image acquisition unit 110 and the periodicity of the pattern in the iris region acquired by the periodicity acquisition unit 122. For example, if the information acquired by the periodicity acquisition unit 122 indicates that the pattern in the iris region has strong periodicity, the wear determination unit 120 determines that there is a high possibility that the subject is wearing colored contact lenses. On the other hand, if the information acquired by the periodicity acquisition unit 122 indicates that the pattern in the iris region has almost no periodicity, the wear determination unit 120 determines that there is a low possibility that the subject is wearing colored contact lenses.

[0144] (Operation Flow) Next, the operation flow of the tenth information processing device 10 will be described with reference to Fig. 21. Fig. 21 is a flowchart showing the operation flow in the tenth information processing device. Note that in Fig. 21, the same processes as those shown in Fig. 3 are denoted by the same reference numerals.

[0145] 21 , when the operation of the tenth information processing device 10 starts, the image acquisition unit 110 first acquires an image of the target's eye (step S1001). The image acquisition unit 110 outputs the acquired image of the target's eye to the wearing determination unit 120.

[0146] Next, the periodicity acquisition unit 122 in the wear assessment unit 120 acquires the periodicity of the pattern in the iris region from the eye image of the subject (step S1002).The wear assessment unit 120 then determines whether the subject is wearing colored contact lenses based on the periodicity of the pattern in the iris region (step S1003).The wear assessment unit 120 then outputs the determination result (i.e., information indicating whether the subject is wearing colored contact lenses) (step S1004).

[0147] (Technical Effects) Next, technical effects obtained by the tenth information processing device 10 will be described.

[0148] 20 and 21, the tenth information processing device 10 determines whether or not the subject is wearing colored contact lenses based on the periodicity of the pattern in the iris region. In this way, it is possible to more appropriately determine whether or not the subject is wearing colored contact lenses based on the characteristic of colored contact lenses that the pattern has a periodicity.

[0149] <Eleventh embodiment> An eleventh information processing device 10 will be described with reference to Figures 22 and 23. Note that the eleventh information processing device 10 differs only in part of the configuration and operation from the first to tenth information processing devices 10 described above, and other parts may be similar to the first to tenth information processing devices 10. Therefore, hereinafter, parts that differ from the embodiments already described will be described in detail, and descriptions of other overlapping parts will be omitted as appropriate.

[0150] (Functional Configuration) First, the functional configuration of the eleventh information processing device 10 will be described with reference to Fig. 22. Fig. 22 is a block diagram showing the functional configuration of the eleventh information processing device. Note that in Fig. 22, the same elements as those shown in Fig. 2 and Fig. 10 are denoted by the same reference numerals.

[0151] As shown in Fig. 22 , the eleventh information processing device 10 is configured to include an image acquisition unit 110 and a wearing determination unit 120 as components for realizing its functions. Note that, although an eye image acquired by the image acquisition unit 110 is input to the wearing determination unit 120 in the eleventh information processing device 10, iris color information and light environment information are not input as in the configuration described in the first embodiment (see Fig. 2 ). On the other hand, the wearing determination unit 120 in the eleventh information processing device 10 includes a pupil information acquisition unit 123. The pupil information acquisition unit 123 may have the same configuration as that described in the fifth embodiment (see Fig. 10 ).

[0152] The wear determination unit 120 in the information processing device 10 of the eleventh embodiment is configured to determine whether or not the subject is wearing colored contact lenses based on the subject's eye image acquired by the image acquisition unit 110 and pupil information acquired by the pupil information acquisition unit 123. For example, the wear determination unit 120 may determine whether or not the subject is wearing colored contact lenses by comparing the pupil size and ratio acquired by the pupil information acquisition unit 123 with a typical pupil size and ratio. Alternatively, the wear determination unit 120 may determine whether or not the subject is wearing colored contact lenses by comparing the pupil size and ratio acquired by the pupil information acquisition unit 123 with a pupil size and ratio appropriate for the subject's age. Alternatively, the wear determination unit 120 may determine whether or not the subject is wearing colored contact lenses by comparing the pupil size and ratio acquired by the pupil information acquisition unit 123 with the subject's original pupil size and ratio acquired in advance. The subject's original pupil size and ratio may be acquired from an image of the subject's eyes captured in advance without wearing colored contact lenses.

[0153] (Operational Flow) Next, the operational flow of the eleventh information processing device 10 will be described with reference to Fig. 23. Fig. 23 is a flowchart showing the operational flow in the eleventh information processing device. Note that in Fig. 23, the same processes as those shown in Fig. 3 are denoted by the same reference numerals.

[0154] 23 , when the operation of the eleventh information processing device 10 starts, the image acquisition unit 110 first acquires an image of the target's eye (step S1101). The image acquisition unit 110 outputs the acquired image of the target's eye to the wearing determination unit 120.

[0155] Next, the pupil information acquisition unit 123 in the wear assessment unit 120 acquires pupil information from the subject's eye image (step S1102). Then, the wear assessment unit 120 determines whether the subject is wearing colored contact lenses based on the pupil information (step S1103). Thereafter, the wear assessment unit 120 outputs the assessment result (i.e., information indicating whether the subject is wearing colored contact lenses) (step S1104).

[0156] (Technical Effects) Next, technical effects obtained by the eleventh information processing device 10 will be described.

[0157] 22 and 23, the eleventh information processing device 10 determines whether or not the subject is wearing colored contact lenses based on pupil information. In this way, it is possible to appropriately determine whether or not the subject is wearing colored contact lenses based on information about the subject's pupils.

[0158] The scope of each embodiment also includes a processing method in which a program that operates the configuration of each embodiment to realize the functions of the above-described embodiments is recorded on a recording medium, the program recorded on the recording medium is read as code, and the program is executed on a computer. In other words, a computer-readable recording medium is also included in the scope of each embodiment. Furthermore, each embodiment includes not only a recording medium on which the above-described program is recorded, but also the program itself.

[0159] Examples of recording media that can be used include floppy disks, hard disks, optical disks, magneto-optical disks, CD-ROMs, magnetic tapes, non-volatile memory cards, and ROMs. Furthermore, the scope of each embodiment is not limited to programs that execute processes by themselves, but also includes programs that execute processes by operating on an OS in conjunction with other software or expansion board functions. Furthermore, the program itself may be stored on a server, and part or all of the program may be downloadable from the server to a user terminal. The program may be provided to the user in, for example, a SaaS (Software as a Service) format.

[0160] <Supplementary Notes> The above-described embodiment may be further described as in the following supplementary notes, but is not limited to the following.

[0161] (Supplementary Note 1) The information processing device described in Supplementary Note 1 is an information processing device that includes an acquisition means that acquires an eye image including an iris region of a subject, and a determination means that determines whether the subject is wearing color contact lenses based on iris color information related to the color of the iris region of the subject and light environment information related to the light environment when the eye image was captured.

[0162] (Supplementary Note 2) The information processing device described in Supplementary Note 2 is the information processing device described in Supplementary Note 1, wherein the acquisition means acquires the eye image captured using near-infrared light, and the determination means determines whether the subject is wearing color contact lenses based on the iris color information in a shooting environment using near-infrared light and the light environment information related to near-infrared light.

[0163] (Supplementary Note 3) The information processing device described in Supplementary Note 3 is the information processing device described in Supplementary Note 1, wherein the acquisition means acquires a first eye image captured using visible light and a second eye image captured using near-infrared light, and the determination means determines whether the subject is wearing color contact lenses based on the iris color information in a shooting environment using visible light, the light environment information related to the first eye image, and a pattern of the iris region detected from the second eye image.

[0164] (Supplementary Note 4) The information processing device described in Supplementary Note 4 is the information processing device described in any one of Supplements 1 to 3, wherein the determination means determines whether or not the subject is wearing color contact lenses based on periodicity information regarding the periodicity of the pattern in the iris region in addition to the iris color information and the light environment information.

[0165] (Supplementary Note 5) The information processing device described in Supplementary Note 5 is the information processing device described in any one of Supplements 1 to 4, wherein the determination means determines whether the subject is wearing color contact lenses based on pupil information regarding the pupil included in the eye image in addition to the iris color information and the light environment information.

[0166] (Supplementary Note 6) The information processing device described in Supplementary Note 6 is the information processing device described in Supplementary Note 5, in which the determination means determines whether the subject is wearing color contact lenses based on at least one of makeup information related to the subject's makeup and skin information related to the subject's skin, in addition to the iris color information, the light environment information, and the pupil information.

[0167] (Supplementary Note 7) The information processing device described in Supplementary Note 7 is the information processing device described in any one of Supplements 1 to 6, further comprising an identification means for identifying the type of color contact lenses based on the eye image when it is determined that the subject is wearing color contact lenses.

[0168] (Appendix 8) The information processing device described in Appendix 8 is the information processing device described in any one of Appendices 1 to 7, further comprising an authentication means that, when it is determined that the subject is not wearing color contact lenses, authenticates the subject using information of the subject's iris region, and, when it is determined that the subject is wearing color contact lenses, authenticates the subject using information other than the subject's iris region.

[0169] (Appendix 9) The information processing device described in Appendix 9 is the information processing device described in any one of Appendices 1 to 8, further comprising a guidance means that, when it is determined that the subject is wearing color contact lenses, outputs guidance information to put the subject in a state suitable for authentication.

[0170] (Supplementary Note 10) The information processing device described in Supplementary Note 10 is an information processing device that includes an acquisition means for acquiring an eye image including an iris region of a subject, and a determination means for determining whether or not the subject is wearing color contact lenses based on periodicity information regarding the periodicity of the pattern in the iris region.

[0171] (Supplementary Note 11) The information processing device described in Supplementary Note 11 is an information processing device that includes an acquisition means for acquiring an eye image including an iris region of a subject, and a determination means for determining whether or not the subject is wearing color contact lenses based on pupil information regarding the pupil included in the eye image.

[0172] (Supplementary Note 12) The information processing method described in Supplementary Note 12 is an information processing method that acquires an eye image including an iris region of a subject by at least one computer, and determines whether the subject is wearing color contact lenses based on iris color information related to the color of the iris region of the subject and light environment information related to the light environment when the eye image was captured.

[0173] (Supplementary Note 13) The information processing method described in Supplementary Note 13 is an information processing method that acquires an eye image including an iris region of a subject by at least one computer, and determines whether or not the subject is wearing color contact lenses based on periodicity information regarding the periodicity of a pattern in the iris region.

[0174] (Supplementary Note 14) The information processing method described in Supplementary Note 14 is an information processing method that acquires an eye image including an iris region of a subject by at least one computer, and determines whether the subject is wearing color contact lenses based on pupil information regarding the pupil included in the eye image.

[0175] (Supplementary Note 15) The recording medium described in Supplementary Note 15 is a recording medium having recorded thereon a computer program for causing at least one computer to execute an information processing method of acquiring an eye image including an iris region of a subject, and determining whether or not the subject is wearing color contact lenses based on iris color information relating to the color of the iris region of the subject and light environment information relating to the light environment when the eye image was captured.

[0176] (Supplementary Note 16) The recording medium described in Supplementary Note 16 is a recording medium having recorded thereon a computer program for causing at least one computer to execute an information processing method for acquiring an eye image including an iris region of a subject, and determining whether or not the subject is wearing color contact lenses based on periodicity information regarding the periodicity of the pattern in the iris region.

[0177] (Supplementary Note 17) The recording medium described in Supplementary Note 17 is a recording medium having recorded thereon a computer program for causing at least one computer to execute an information processing method for acquiring an eye image including an iris region of a subject, and determining whether or not the subject is wearing color contact lenses based on pupil information regarding the pupil included in the eye image.

[0178] (Supplementary Note 18) The computer program described in Supplementary Note 18 is a computer program that causes at least one computer to execute an information processing method that acquires an eye image including an iris region of a subject, and determines whether the subject is wearing color contact lenses based on iris color information related to the color of the iris region of the subject and light environment information related to the light environment when the eye image was captured.

[0179] (Supplementary Note 19) The computer program described in Supplementary Note 19 is a computer program that causes at least one computer to execute an information processing method that acquires an eye image including an iris region of a subject, and determines whether the subject is wearing color contact lenses based on periodicity information regarding the periodicity of a pattern in the iris region.

[0180] (Supplementary Note 20) The computer program described in Supplementary Note 20 is a computer program that causes at least one computer to execute an information processing method that acquires an eye image including an iris region of a subject, and determines whether the subject is wearing color contact lenses based on pupil information related to the pupil included in the eye image.

[0181] This disclosure may be modified as appropriate within the scope that does not contradict the gist or idea of ​​the invention that can be read from the claims and the entire specification, and information processing devices, information processing methods, and recording media that involve such modifications are also included in the technical idea of ​​this disclosure.

[0182] REFERENCE SIGNS LIST 10 Information processing device 11 Processor 110 Image acquisition unit 120 Wearing determination unit 121 Pattern acquisition unit 122 Periodicity acquisition unit 123 Pupil information acquisition unit 124 Makeup / skin information acquisition unit 130 Identification unit 140 Authentication unit 150 Guidance unit

Claims

1. An acquisition means for acquiring an eye image including the target iris region, A determination means for determining whether or not the subject is wearing colored contact lenses, based on iris color information relating to the color of the iris region of the subject and light environment information relating to the light environment when the eye image was captured, An information processing device equipped with the following features.

2. The acquisition means acquires the eye image captured using near-infrared light, The determination means determines whether or not the subject is wearing colored contact lenses based on the iris color information in a shooting environment using near-infrared light and the light environment information related to near-infrared light. The information processing apparatus according to claim 1.

3. The acquisition means acquires a first eye image captured using visible light and a second eye image captured using near-infrared light. The determination means determines whether or not the subject is wearing colored contact lenses based on the iris color information in a shooting environment using visible light, the light environment information relating to the first eye image, and the pattern of the iris region detected from the second eye image. The information processing apparatus according to claim 1.

4. The determination means determines whether or not the subject is wearing colored contact lenses, based on the iris color information and the light environment information, as well as periodic information relating to the periodicity of the pattern in the iris region. The information processing apparatus according to any one of claims 1 to 3.

5. The determination means determines whether or not the subject is wearing colored contact lenses based on the iris color information and the light environment information, as well as pupil information relating to the pupil included in the eye image. The information processing apparatus according to any one of claims 1 to 3.

6. The determination means determines whether the subject is wearing colored contact lenses based on at least one of the iris color information, the light environment information, and the pupil information, as well as the makeup information relating to the subject's makeup and the skin information relating to the subject's skin. The information processing apparatus according to claim 5.

7. If it is determined that the subject is wearing colored contact lenses, the system further includes identification means for identifying the type of colored contact lenses based on the eye image. The information processing apparatus according to any one of claims 1 to 3.

8. The system further includes authentication means that, if it is determined that the subject is not wearing colored contact lenses, authenticates the subject using information from the iris region of the subject, and if it is determined that the subject is wearing colored contact lenses, authenticates the subject using information other than that from the iris region of the subject. The information processing apparatus according to any one of claims 1 to 3.

9. By at least one computer, Obtain an eye image that includes the target iris region, Based on iris color information relating to the color of the iris region of the subject and light environment information relating to the light environment when the eye image was captured, it is determined whether or not the subject is wearing colored contact lenses. Information processing methods.

10. On at least one computer, Obtain an eye image that includes the target iris region, Based on iris color information relating to the color of the iris region of the subject and light environment information relating to the light environment when the eye image was captured, it is determined whether or not the subject is wearing colored contact lenses. A computer program that executes information processing methods.