Information processing device, information processing method, and recording medium

Abstract

An information processing device (10) is provided with: an imaging means (110) that captures an eye image including an iris region of a subject; an identification means (120) that identifies an unimaged area indicating the area of the iris region of the subject that was not able to be imaged by the imaging means due to an obstruction; and an output means (130) that outputs the eye image including information about the unimaged area. Such an information processing device makes it possible to allow a subject or the like to appropriately ascertain information about the portion of the iris region of the subject that has not yet been imaged.

Description

Information processing device, information processing method, and recording medium

[0001] The present disclosure relates to the technical fields of an information processing device, an information processing method, and a recording medium.

[0002] In a device that captures an iris image including the iris region of a target, various processes may be performed to increase the proportion of the iris region in the image. For example, Patent Document 1 discloses a device that provides guidance instructions to a target according to the degree to which the target's eyelids are open.

[0003] International Publication No. 2021 / 245823

[0004] An object of this disclosure is to provide an information processing device, an information processing method, and a recording medium that aim to improve upon the techniques related to the prior art documents mentioned above.

[0005] A first aspect of the information processing device disclosed herein comprises an imaging means for capturing an eye image including an iris region of a subject, an identification means for identifying an unimaged region of the iris region of the subject that indicates an area that could not be imaged by the imaging means due to an obstruction, and an output means for outputting the eye image including information regarding the unimaged region.

[0006] One aspect of the information processing method disclosed herein involves using at least one computer to capture an eye image including a target's iris region, identifying an unimaged region of the target's iris region that indicates an area that could not be imaged due to an obstruction, and outputting the eye image including information regarding the unimaged region.

[0007] One aspect of the recording medium of this disclosure is a recording medium having recorded thereon a computer program that causes at least one computer to execute an information processing method, which involves capturing an eye image including a target's iris region, identifying an unimaged region of the target's iris region that indicates an area that could not be imaged due to an obstruction, and outputting the eye image including information regarding the unimaged region.

[0008] 1 is a block diagram showing a hardware configuration of a first information processing device. 2 is a block diagram showing a functional configuration of the first information processing device. 3 is a block diagram showing a flow of operations in the first information processing device. 4 is a block diagram showing a functional configuration of the second information processing device. 5 is a block diagram showing a flow of operations in the second information processing device. 6 is a block diagram showing a functional configuration of the third information processing device. 7 is a block diagram showing a flow of operations in the third information processing device. 8 is a block diagram showing a flow of operations in the fourth information processing device. 9 is a block diagram showing a functional configuration of the fifth information processing device. 10 is a block diagram showing a flow of operations in the fifth information processing device. 11 is a block diagram showing a flow of operations in the sixth information processing device. 12 is a block diagram showing a flow of operations in the sixth information processing device. 13 is a plan view showing an example of display of guide information in a seventh information processing device. 14 is a block diagram showing a functional configuration of an eighth information processing device. 15 is a plan view (part 1) showing an example of display of guide information in a ninth information processing device. 16 is a plan view (part 2) showing an example of display of guide information in a ninth information processing device. 17 is a flow chart showing an example of display of guide information in a tenth information processing device. 18 is a plan view showing an example of display of a first guide in an eleventh information processing device. 19 is a plan view showing an example of display of a second guide in the eleventh information processing device. 20 is a flow chart showing an operation flow in a twelfth information processing device. 21 is a plan view showing an example of display of guide information in a thirteenth information processing device.

[0009] Hereinafter, embodiments of an information processing device, an information processing method, and a recording medium will be described with reference to the drawings.

[0010] First Embodiment A first embodiment will be described with reference to FIGS. 1 to 3. FIG.

[0011] (Hardware Configuration) First, the hardware configuration of the first information processing apparatus will be described with reference to Fig. 1. Fig. 1 is a block diagram showing the hardware configuration of the first information processing apparatus.

[0012] 1, a first information processing device 10 includes a processor 11, a RAM (Random Access Memory) 12, a ROM (Read Only Memory) 13, and a storage device 14. The information processing device 10 may further include an input device 15 and an output device 16. The processor 11, RAM 12, ROM 13, storage device 14, input device 15, and output device 16 are connected to each other via a data bus 17. The data bus 17 may be an interface other than a data bus (for example, a LAN, a USB, etc.).

[0013] The processor 11 loads a computer program. For example, the processor 11 is configured to load a computer program stored in at least one of the RAM 12, the ROM 13, and the storage device 14. Alternatively, the processor 11 may load a computer program stored in a computer-readable storage medium using a storage medium reading device (not shown). The processor 11 may acquire (i.e., load) the computer program from a device (not shown) located outside the information processing device 10 via a network interface. The processor 11 controls the RAM 12, the storage device 14, the input device 15, and the output device 16 by executing the loaded computer program. In particular, in this embodiment, when the processor 11 executes the loaded computer program, functional blocks that perform processing related to capturing an eye image including the target's iris region are realized within the processor 11. In other words, the processor 11 may function as a controller that executes each control in the information processing device 10.

[0014] The processor 11 may be configured as, for example, a central processing unit (CPU), a graphics processing unit (GPU), a field-programmable gate array (FPGA), a digital signal processor (DSP), an application-specific integrated circuit (ASIC), or a quantum processor. The processor 11 may be configured as one of these, or may be configured to use multiple processors in parallel.

[0015] The RAM 12 temporarily stores computer programs executed by the processor 11. The RAM 12 temporarily stores data that the processor 11 temporarily uses while it is executing the computer programs. The RAM 12 may be, for example, a dynamic random access memory (D-RAM) or a static random access memory (SRAM). Alternatively, other types of volatile memory may be used instead of the RAM 12.

[0016] The ROM 13 stores computer programs executed by the processor 11. The ROM 13 may also store fixed data. The ROM 13 may be, for example, a programmable read-only memory (PROM) or an erasable read-only memory (EPROM). Alternatively, other types of non-volatile memory may be used instead of the ROM 13.

[0017] The storage device 14 stores data that the information processing device 10 stores for a long period of time. The storage device 14 may operate as a temporary storage device for the processor 11. The storage device may store computer programs executed by the processor 11. The storage device 14 may include, for example, at least one of a hard disk device, a magneto-optical disk device, an SSD (Solid State Drive), and a disk array device.

[0018] The input device 15 is a device that receives input instructions from a user of the information processing device 10. The input device 15 may include, for example, at least one of a keyboard, a mouse, and a touch panel. The input device 15 may be configured as a mobile terminal such as a smartphone or a tablet. The input device 15 may be, for example, a device that includes a microphone and is capable of voice input. The input device 15 may be, for example, a device that is used only for maintenance. In such a case, the input device 15 may be omitted as appropriate from the components used when operating the information processing device 10.

[0019] The output device 16 is a device that outputs information related to the information processing device 10 to the outside. For example, the output device 16 may be a display device (e.g., a display) that can display information related to the information processing device 10. The output device 16 may also be a speaker or the like that can output information related to the information processing device 10 as audio. The output device 16 may be configured as a mobile terminal such as a smartphone or a tablet.

[0020] The camera 18 is a sensor device that captures an image of a target. Note that the target here is not limited to humans, but may include animals such as dogs and cats, robots, etc. The camera 18 may be fixedly disposed in a position where it can capture an image of the target. Alternatively, the camera 18 may be mounted on a terminal (e.g., a personal computer, a tablet, a smartphone) used by the target. The camera according to this embodiment is particularly configured to capture an image of the iris region of the target. The type of the camera 18 is not particularly limited, but may be, for example, a near-infrared camera. A plurality of cameras 18 may be provided. In this case, the plurality of cameras 18 may be of the same type or different types.

[0021] 1 shows an example of an information processing device 10 including multiple devices, but all or some of the functions may be realized by a single device. Such an information processing device may be configured to include only the above-mentioned processor 11, RAM 12, and ROM 13, and the other components (i.e., the storage device 14, input device 15, output device 16, etc.) may be provided by an external device connected to the information processing device 10. Furthermore, some of the calculation functions of the information processing device 10 may be realized by an external device (e.g., an external server, a cloud, etc.).

[0022] (Functional Configuration) Next, the functional configuration of the first information processing device 10 will be described with reference to Fig. 2. Fig. 2 is a block diagram showing the functional configuration of the first information processing device.

[0023] 2, the first information processing device 10 is configured as a device that captures an eye image including an iris region of a target and outputs information related to the eye image. The first information processing device 10 is configured to include an imaging unit 110, an unimaged region specifying unit 120, and an output unit 130 as components for realizing its functions.

[0024] The imaging unit 110 is configured to capture an eye image including the iris region of a subject. The eye image may include not only the subject's iris but also the eye, the area surrounding the eye, or parts other than the eye (e.g., eyebrows, nose, etc.). The imaging unit 110 includes the camera 18 (see FIG. 1 ). For example, the imaging unit 110 is configured to capture an image of the iris region of a subject present within the imaging range using the camera 18 and acquire the captured eye image. The imaging unit 110 may be configured to capture an eye image upon detecting the subject. For example, the imaging unit 110 may capture an eye image when a moving subject reaches a predetermined position. Alternatively, the imaging unit 110 may be configured to capture an eye image when the subject performs a predetermined operation. For example, the imaging unit 110 may capture an eye image when the subject presses a capture button. The eye image acquired by the imaging unit 110 is configured to be output to the unimaged region identification unit 120.

[0025] The unimaged region identifying unit 120 is configured to identify unimaged regions in the eye image captured by the imaging unit 110. The unimaged region refers to a region of the subject's iris region that could not be imaged by the imaging unit 110 due to an obstruction. Note that the "obstruction" here refers to a factor that prevents the imaging of the iris region. An example of an obstruction is the subject's eyelid. When the subject narrows their eyes, the eyelid obstructs at least a portion of the iris region. As the portion of the eyelid that overlaps the iris region increases, the unimaged region becomes larger. Other examples of obstructions include the subject's eyelashes and hair, as well as accessories such as glasses, contact lenses, masks, and hats. The unimaged region identifying unit 120 may, for example, extract the iris region from the eye image to identify the unimaged region, and then identify the unimaged region using separately acquired iris circle information. The iris circle information may be extracted, for example, using a regression model based on a neural network trained to extract circle information from an image. This regression model may be trained to directly extract a circle, or may be trained to extract points on the iris circle. If trained to extract points on the iris circle, the circle may be detected by fitting using points detected after regression. The iris circle may also be detected by circle detection using an iris region that has already been acquired (i.e., an iris region that has already been imaged). In this case, the circle may be detected by, for example, a Hough transform. Information regarding the unimaged region identified by the unimaged region identifying unit 120 is configured to be output to the output unit 130.

[0026] The output unit 130 outputs the eye image captured by the imaging unit 110, including information about the unimaged region identified by the unimaged region identifying unit 120. The output unit 130 outputs the eye image including information about the unimaged region to, for example, a display, which is an example of the above-mentioned output device 14 (see FIG. 1 ). In this case, the eye image and information about the unimaged region are displayed on the display. The information about the unimaged region may be displayed, for example, superimposed on the eye image. More specifically, the information about the unimaged region may be displayed as information indicating which part of the eye image is the unimaged region. Specific display examples of the eye image and the unimaged region will be described in other embodiments below.

[0027] (Flow of Operation) Next, the flow of operation of the first information processing device 10 will be described with reference to Fig. 3. Fig. 3 is a flowchart showing the flow of operation in the first information processing device.

[0028] 3, when the operation of the first information processing device 10 starts, the image capturing unit 110 first captures an eye image including the iris region of the target (step S101). Then, the unimaged region identifying unit 120 identifies an unimaged region in the eye image captured by the image capturing unit 110 (step S102).

[0029] Next, the output unit 130 outputs the eye image captured by the imaging unit 110, including information about the unimaged region identified by the unimaged region identifying unit 120 (step S103). The eye image and information about the unimaged region may be displayed, for example, toward a target. Alternatively, the eye image and information about the unimaged region may be displayed toward an administrator of the information processing device 10. Alternatively, the eye image and information about the unimaged region may be output to a device other than the information processing device 10 (i.e., an external device).

[0030] The eye image output from the output unit 130 may be used in authentication processing (matching processing) using information about the iris region. Specifically, the eye image may be used as a registered image or a match image in the authentication processing. Specific configurations and operations when using the eye image in the authentication processing will be described in detail in other embodiments below.

[0031] (Technical Effects) Next, technical effects obtained by the first information processing device 10 will be described.

[0032] 1 to 3, the first information processing device 10 identifies unimaged areas in the eye image and outputs the eye image including information about the unimaged areas. In this way, it is possible to allow the subject or the like to properly understand the unimaged areas in the eye image (i.e., areas that have not yet been imaged).

[0033] Second Embodiment A second embodiment will be described with reference to Figures 4 and 5. Note that the second embodiment differs from the first embodiment described above only in some configurations and operations, and other parts may be the same as the first embodiment. Therefore, the following will describe in detail the parts that differ from the first embodiment, and will omit a description of other overlapping parts as appropriate.

[0034] (Functional Configuration) First, the functional configuration of the second information processing device 10 will be described with reference to Fig. 4. Fig. 4 is a block diagram showing the functional configuration of the second information processing device. Note that in Fig. 4, the same elements as those shown in Fig. 2 are denoted by the same reference numerals.

[0035] 4, the second information processing device 10 is configured to include, as components for realizing its functions, an imaging unit 110, an unimaged region specifying unit 120, an output unit 130, and an imaging control unit 140. That is, the second information processing device 10 is configured to further include an imaging control unit 140 in addition to the configuration described in the first embodiment (see FIG. 2). The imaging control unit 140 may be a processing block realized by, for example, the above-mentioned processor 11 (see FIG. 1).

[0036] The imaging control unit 140 is configured to be able to output an instruction to the imaging unit 110 to capture an eye image. More specifically, when the unimaged region is equal to or greater than a first threshold, the imaging control unit 140 outputs an instruction to the imaging unit 110 to capture a new eye image. The "first threshold" here is a value that determines whether to output an instruction to the imaging unit 110 to acquire a new eye image. In other words, the "first threshold" is a value for determining whether there is too much unimaged region in the eye image (in other words, whether the imaged iris region is insufficient). The first threshold may be a predetermined fixed value or a variable value corresponding to some physical quantity or parameter. The first threshold may be set appropriately depending on, for example, the purpose of the eye image. The first threshold may be a threshold corresponding to the area of ​​the unimaged region. Alternatively, the first threshold may be a threshold corresponding to the ratio of the unimaged region to the entire iris region. When the first threshold is a variable value, the first threshold may be set as follows. For example, if the authentication success rate for iris authentication using eye images output from the output unit 130 is on a downward trend while the first threshold is set to a first value, the authentication success rate may be declining due to unimaged areas (in other words, there may be a lack of imaged iris areas). Therefore, in order to reduce the unimaged areas in the eye images (in other words, to increase the imaged iris areas), the first threshold may be set to a second value smaller than the first value. In other words, the first threshold may be dynamically set according to the authentication success rate for iris authentication.

[0037] (Operation Flow) Next, the operation flow of the second information processing device 10 will be described with reference to Fig. 5. Fig. 5 is a flowchart showing the operation flow in the second information processing device. Note that in Fig. 5, the same processes as those shown in Fig. 3 are denoted by the same reference numerals.

[0038] 5, when the operation of the second information processing device 10 is started, the image capturing unit 110 first captures an eye image including the iris region of the target (step S101). Thereafter, the unimaged region identifying unit 120 identifies an unimaged region in the eye image captured by the image capturing unit 110 (step S102).

[0039] Next, the output unit 130 outputs the eye image captured by the imaging unit 110, including information about the unimaged region identified by the unimaged region identifying unit 120 (step S103). After that, the imaging control unit 140 determines whether the unimaged region is equal to or larger than a first threshold value, using the information about the unimaged region identified by the unimaged region identifying unit 120 (step S204).

[0040] If the unimaged region is equal to or greater than the first threshold (step S204: YES), the image capture control unit 140 controls the image capture unit 110 to capture a new eye image. This causes the process to be executed again from step S101. In this way, if the unimaged region is equal to or greater than the first threshold, image capture of eye images is repeated. If the newly captured eye image includes an iris region that was not included in the previously captured eye image, the unimaged region will gradually decrease.

[0041] If the unimaged region is not equal to or larger than the first threshold (step S204: NO), the image capturing control unit 140 does not control the image capturing unit 110 to capture a new eye image. Therefore, when the unimaged region is no longer equal to or larger than the first threshold, the series of processes ends.

[0042] (Technical Effects) Next, technical effects obtained by the second information processing device 10 will be described.

[0043] 4 and 5, in the second information processing device 10, a new eye image is captured when the unimaged region is not equal to or larger than the first threshold. In this way, by repeatedly capturing eye images, it is possible to reduce the unimaged region (in other words, increase the imaged iris region).

[0044] Third Embodiment A third embodiment will be described with reference to Figures 6 and 7. The third embodiment differs from the second embodiment described above only in some configurations and operations, and other parts may be similar to the first and second embodiments. Therefore, the following will describe in detail the parts that differ from the embodiments already described, and will omit a description of other overlapping parts as appropriate.

[0045] (Functional Configuration) First, the functional configuration of the third information processing device 10 will be described with reference to Fig. 6. Fig. 6 is a block diagram showing the functional configuration of the third information processing device. Note that in Fig. 6, the same elements as those shown in Fig. 4 are denoted by the same reference numerals.

[0046] As shown in Fig. 6, the third information processing device 10 is configured to include, as components for realizing its functions, an imaging unit 110, an unimaged region specifying unit 120, an output unit 130, an imaging control unit 140, an iris region extraction unit 150, and an iris region storage unit 160. That is, the third information processing device 10 is configured to further include the iris region extraction unit 150 and the iris region storage unit 160 in addition to the components described in the second embodiment (see Fig. 4). The iris region extraction unit 150 may be a processing block realized by, for example, the above-described processor 11 (see Fig. 1). The iris region storage unit 160 may be configured to include, for example, the above-described storage device 14.

[0047] The iris region extraction unit 150 is configured to be able to extract the iris region of a target from the eye image captured by the imaging unit 110. That is, the iris region extraction unit 150 is configured to be able to extract the iris region that was captured by the imaging unit 110. The method for extracting the iris region is not particularly limited, and the iris region extraction unit 150 may extract the iris region using, for example, a trained machine learning model. More specifically, the iris region extraction unit 150 may extract the iris region from the eye image using a neural network trained to extract the iris region by semantic segmentation or the like. Information about the iris region extracted by the iris region extraction unit 150 is configured to be output to each of the unimaged region identification unit 120 and the iris region storage unit 160.

[0048] Iris region storage unit 160 is configured to be able to store the iris region extracted by iris region extraction unit 150 as an imaged iris region. Iris region storage unit 160 is configured to be able to store a plurality of imaged iris regions, including iris regions extracted by iris region extraction unit 150 in the past. Therefore, as described in the second embodiment, when eye images are repeatedly captured, imaged iris regions are accumulated in iris region storage unit 160, and the imaged iris regions gradually increase (i.e., the area of ​​the imaged iris regions gradually increases). Information related to the imaged iris regions stored in iris region storage unit 160 can be read out as needed by unimaged region identification unit 120.

[0049] The unimaged region specifying unit 120 in the third information processing device 10 specifies an unimaged region using the iris region extracted by the iris region extraction unit 150 and the imaged iris region stored in the iris region storage unit 160. That is, the unimaged region specifying unit 120 specifies an unimaged region using the iris region extracted from the eye image captured by the imaging unit 110 and a previously extracted iris region. The unimaged region specifying unit 120 may specify, as an unimaged region, a region of the target iris region that is not included in either the iris region extracted from the eye image or the imaged iris region.

[0050] (Operation Flow) Next, the operation flow of the third information processing device 10 will be described with reference to Fig. 7. Fig. 7 is a flowchart showing the operation flow in the third information processing device. Note that in Fig. 7, the same processes as those shown in Fig. 5 are denoted by the same reference numerals.

[0051] 7, when the operation of the third information processing device 10 starts, the image capturing unit 110 first captures an eye image including the iris region of the target (step S101). Then, the iris region extraction unit 150 extracts the iris region of the target from the eye image captured by the image capturing unit 110 (step S301).

[0052] Next, the unimaged region specifying unit 120 receives information about the iris region extracted by the iris region extraction unit 150 and reads information about the imaged iris region from the iris region storage unit 160 (step S302).Then, the unimaged region specifying unit 120 specifies an unimaged region based on the iris region extracted by the iris region extraction unit 150 and the imaged iris region read from the iris region storage unit 160 (step S303).

[0053] Next, the output unit 130 outputs the eye image captured by the imaging unit 110, including information about the unimaged region identified by the unimaged region identifying unit 120 (step S103). After that, the imaging control unit 140 determines whether the unimaged region is equal to or larger than a first threshold value, using the information about the unimaged region identified by the unimaged region identifying unit 120 (step S204).

[0054] If the unimaged region is equal to or larger than the first threshold (step S204: YES), the image capture control unit 140 controls the image capture unit 110 to capture a new eye image. This causes the process to be executed again from step S101. Furthermore, if the unimaged region is equal to or larger than the first threshold, the iris region storage unit 160 stores the iris region extracted by the iris region extraction unit 140 as an imaged iris region.

[0055] On the other hand, if the unimaged region is less than the first threshold (step S204: NO), the image capture control unit 140 does not control the image capture unit 110, and the series of processes ends.

[0056] (Technical Effects) Next, technical effects obtained by the third information processing apparatus 10 will be described.

[0057] 6 and 7, in the third information processing device 10, an iris region is extracted from an eye image and the extracted iris region is stored as an imaged iris region. In this way, by outputting information about an iris region that has already been imaged, the user can more appropriately identify an unimaged region.

[0058] <Fourth Embodiment> A fourth embodiment will be described with reference to Fig. 8. Note that the fourth embodiment differs from the third embodiment described above only in some of its operations, and other portions may be similar to the first to third embodiments. Therefore, the following will describe in detail the portions that differ from the embodiments already described, and will omit descriptions of other overlapping portions as appropriate.

[0059] (Operation Flow) First, the operation flow of the fourth information processing device 10 will be described with reference to Fig. 8. Fig. 8 is a flowchart showing the operation flow in the fourth information processing device. Note that in Fig. 8, the same processes as those shown in Fig. 7 are denoted by the same reference numerals.

[0060] 8, when the operation of the fourth information processing device 10 starts, the imaging unit 110 first captures an eye image including the iris region of the target (step S101). Then, the iris region extraction unit 150 extracts the iris region of the target from the eye image captured by the imaging unit 110 (step S301).

[0061] Next, the unimaged region specifying unit 120 receives information about the iris region extracted by the iris region extraction unit 150, and reads information about the imaged iris region from the iris region storage unit 160 (step S302).Then, the unimaged region specifying unit 120 determines whether the region obtained by combining the iris region extracted by the iris region extraction unit and the imaged iris region stored in the iris region storage unit 160 (hereinafter referred to as the "acquired iris region") is equal to or smaller than a second threshold (step S401).

[0062] The "second threshold" here is a threshold that is set in advance to determine whether the acquired region is insufficient. The second threshold may be set appropriately depending on, for example, the purpose of the eye image. The second threshold may be a threshold that corresponds to the area of ​​the acquired region. Alternatively, the second threshold may be a threshold that corresponds to the ratio of the acquired region to the entire iris region.

[0063] If the acquired region is not equal to or smaller than the second threshold (step S401: NO), the subsequent processing is omitted. That is, the series of processing ends without identifying an unimaged region. On the other hand, if the acquired region is equal to or smaller than the second threshold (step S401: YES), the unimaged region identifying unit 120 identifies an unimaged region based on the iris region extracted by the iris region extraction unit 150 and the imaged iris region (i.e., the acquired region) read from the iris region storage unit 160 (step S303).

[0064] Next, the output unit 130 outputs the eye image captured by the imaging unit 110, including information about the unimaged region identified by the unimaged region identifying unit 120 (step S103). After that, the imaging control unit 140 determines whether the unimaged region is equal to or larger than a first threshold value, using the information about the unimaged region identified by the unimaged region identifying unit 120 (step S204).

[0065] If the unimaged region is equal to or larger than the first threshold (step S204: YES), the image capture control unit 140 controls the image capture unit 110 to capture a new eye image. This causes the process to be executed again from step S101. Furthermore, if the unimaged region is equal to or larger than the first threshold, the iris region storage unit 160 stores the iris region extracted by the iris region extraction unit 140 as an imaged iris region.

[0066] On the other hand, if the unimaged region is not equal to or larger than the first threshold (step S204: NO), the image capturing control unit 140 does not control the image capturing unit 110 to capture a new eye image. Therefore, when the unimaged region is no longer equal to or larger than the first threshold, the series of processes ends.

[0067] (Technical Effects) Next, technical effects obtained by the fourth information processing apparatus 10 will be described.

[0068] As described in FIG. 8 , in the fourth information processing device 10, an unimaged area is identified when the acquired area is equal to or less than the second threshold. Here, if the acquired area is not equal to or less than the second threshold, it can be determined that the iris area has been sufficiently captured. On the other hand, if the acquired area is equal to or less than the second threshold, it can be determined that the captured iris area is insufficient. Therefore, if an unimaged area is identified in such a case, it becomes possible to allow the subject or the like to properly understand the insufficient iris area.

[0069] Fifth Embodiment A fifth embodiment will be described with reference to Figures 9 and 10. Note that the fifth embodiment differs from the first to fourth embodiments described above only in part of the configuration and operation, and other parts may be similar to the first to fourth embodiments. Therefore, the following will describe in detail the parts that differ from the embodiments already described, and will omit a description of other overlapping parts as appropriate.

[0070] (Functional Configuration) First, the functional configuration of the fifth information processing device 10 will be described with reference to Fig. 9. Fig. 9 is a block diagram showing the functional configuration of the fifth information processing device. Note that in Fig. 9, the same elements as those shown in Fig. 6 are denoted by the same reference numerals.

[0071] As shown in Fig. 9, the fifth information processing device 10 is configured to include, as components for realizing its functions, an imaging unit 110, an unimaged region specifying unit 120, an output unit 130, an imaging control unit 140, an iris region extraction unit 150, an iris region storage unit 160, a registration unit 170, and a registration information storage unit 180. That is, the fifth information processing device 10 is configured to further include the registration unit 170 and the registration information storage unit 180 in addition to the components described in the fourth embodiment (see Fig. 6). The registration unit 170 may be a processing block realized by, for example, the above-described processor 11 (see Fig. 1). The registration information storage unit 180 may be configured to include, for example, the above-described storage device 14.

[0072] The registration unit 170 is configured to register the eye image of the subject captured by the imaging unit 110 as a registered image to be used for matching. More specifically, when the difference between a new iris region included in a newly captured eye image and an unimaged region identified from the previously captured iris region is equal to or less than a third threshold, the registration unit 170 registers both the new iris region and the previously captured iris region (i.e., the acquired region) as a registered image to be used for matching. The previously captured iris region and the new iris region may be stored separately, or multiple images may be combined and stored. When combining, the iris regions extracted by the iris region extraction unit 150 may be normalized before combining the eye images so that the center and radius of the iris circle are the same in each image. The combination may be performed by filling in the iris regions in older images first. For example, when a new image is captured, the previously captured iris regions may be ignored and only the unimaged regions may be filled in. In addition to the image, the data to be registered may also include features extracted from the eye image for identifying an individual.

[0073] The "third threshold" here is a threshold that is set in advance to determine whether the unimaged region is sufficiently small. The third threshold may be set appropriately depending on the quality required for the registered image, etc. The third threshold may be a threshold that corresponds to the area of ​​the unimaged region. Alternatively, the third threshold may be a threshold that corresponds to the ratio of the unimaged region to the entire iris region.

[0074] The registration information storage unit 180 is configured to be able to store a plurality of registration images. The registration information storage unit 180 stores, as registration images, images that the registration unit 170 has determined to be registered as described above (i.e., acquired areas when the unimaged areas are equal to or less than the third threshold). The registration images stored in the registration image are read out as appropriate during matching. Matching using the registration images stored in the registration information storage unit 180 will be described in detail in other embodiments below. It is noted that what is registered in the registration information storage unit 180 does not have to be an image. For example, feature amounts for identifying an individual extracted from an image may be stored.

[0075] (Operation Flow) Next, the operation flow of the fifth information processing device 10 will be described with reference to Fig. 10. Fig. 10 is a flowchart showing the operation flow in the fifth information processing device. Note that in Fig. 10, the same processes as those shown in Fig. 7 are denoted by the same reference numerals.

[0076] 10 , when the operation of the fifth information processing device 10 starts, the image capturing unit 110 first captures an eye image including the iris region of the target (step S101). Then, the iris region extraction unit 150 extracts the iris region of the target from the eye image captured by the image capturing unit 110 (step S301).

[0077] Next, the unimaged region specifying unit 120 receives information about the iris region extracted by the iris region extraction unit 150 and reads information about the imaged iris region from the iris region storage unit 160 (step S302).Then, the unimaged region specifying unit 120 specifies an unimaged region based on the iris region extracted by the iris region extraction unit 150 and the imaged iris region read from the iris region storage unit 160 (step S303).

[0078] Next, the output unit 130 outputs the eye image captured by the imaging unit 110, including information about the unimaged region identified by the unimaged region identifying unit 120 (step S103). After that, the registration unit 170 determines whether the unimaged region is equal to or smaller than a third threshold value, using the information about the unimaged region identified by the unimaged region identifying unit 120 (step S501).

[0079] If the unimaged region is equal to or smaller than the third threshold (step S501: YES), the registration unit 170 registers both the new iris region and the photographed iris region included in the eye image as registered images in the registration information storage unit 180 (step S502). The registration unit 170 may register a composite image of the new iris region and the photographed iris region as the registered image. Furthermore, the registration unit 170 may register the new iris region and the photographed iris region as feature amounts extracted from the composite image, rather than registering the new iris region and the photographed iris region as images.

[0080] On the other hand, if the unimaged area is not equal to or less than the third threshold (step S501: NO), the image capture control unit 140 controls the image capture unit 110 to capture a new eye image. This causes the process to be executed again from step S101. That is, the third threshold here is essentially used as the first threshold described in the second embodiment (see FIG. 5). However, the first threshold and the third threshold may be set as separate values ​​and determined separately.

[0081] (Technical Effects) Next, technical effects obtained by the fifth information processing apparatus 10 will be described.

[0082] As described with reference to FIGS. 9 and 10 , in the fifth information processing device 10, when the unimaged area is equal to or smaller than the third threshold, the iris area acquired up to that point is registered as the registered image. In this way, an eye image with a sufficiently small unimaged area can be registered as the registered image. Therefore, a more appropriate matching process can be performed. Note that the registered image is not limited to an eye image, and for example, a feature for identifying an individual extracted from an eye image with a sufficiently small unimaged area may be registered. In this case, a more appropriate matching process can also be performed.

[0083] Sixth Embodiment A sixth embodiment will be described with reference to Figures 11 and 12. The sixth embodiment differs from the first to fifth embodiments described above only in part of the configuration and operation, and other parts may be similar to the first to fifth embodiments. Therefore, the following will describe in detail the parts that differ from the embodiments already described, and will omit a description of other overlapping parts as appropriate.

[0084] (Functional Configuration) First, the functional configuration of the sixth information processing device 10 will be described with reference to Fig. 11. Fig. 11 is a block diagram showing the functional configuration of the sixth information processing device. Note that in Fig. 11, the same elements as those shown in Fig. 9 are denoted by the same reference numerals.

[0085] 11 , the sixth information processing device 10 is configured to include, as components for realizing its functions, an imaging unit 110, an unimaged region specifying unit 120, an output unit 130, an imaging control unit 140, an iris region extraction unit 150, an iris region storage unit 160, a registration information storage unit 180, and a matching unit 190. That is, the sixth information processing device 10 is configured to further include a matching unit 190 instead of the registration unit 170 in the configuration described in the fifth embodiment (see FIG. 9 ). The matching unit 190 may be a processing block realized by, for example, the above-mentioned processor 11 (see FIG. 1 ).

[0086] The matching unit 190 is configured to be able to use the eye image of the subject captured by the imaging unit 110 as a match image for matching. More specifically, when a new iris region included in an eye image newly captured under the control of the imaging control unit 140 and an unimaged region identified from the photographed iris region are equal to or smaller than a fourth threshold, the matching unit 190 uses both the new iris region and the photographed iris region (i.e., the acquired region) as match images for matching with a pre-registered registered image (i.e., an image stored in the registration information storage unit 180).

[0087] The "fourth threshold" here is a threshold that is set in advance to determine whether the unimaged region is sufficiently small. The fourth threshold may be set appropriately depending on the quality required for the registered image, etc. The fourth threshold may be a threshold that corresponds to the area of ​​the unimaged region. Alternatively, the fourth threshold may be a threshold that corresponds to the ratio of the unimaged region to the entire iris region. The fourth threshold may be the same value as the third threshold described above, or may be a different value.

[0088] The matching unit 190 may use a combination of the new iris region and the previously photographed iris region as a matching image. Furthermore, the matching unit 190 may use feature amounts extracted from the images for matching, rather than using the new iris region and the previously photographed iris region as images directly.

[0089] (Operation Flow) Next, the operation flow of the sixth information processing device 10 will be described with reference to Fig. 12. Fig. 12 is a flowchart showing the operation flow in the sixth information processing device. Note that in Fig. 12, the same processes as those shown in Fig. 10 are denoted by the same reference numerals.

[0090] 12, when the operation of the sixth information processing device 10 starts, the image capturing unit 110 first captures an eye image including the iris region of the target (step S101). Then, the iris region extraction unit 150 extracts the iris region of the target from the eye image captured by the image capturing unit 110 (step S301).

[0091] Next, the unimaged region specifying unit 120 receives information about the iris region extracted by the iris region extraction unit 150 and reads information about the imaged iris region from the iris region storage unit 160 (step S302).Then, the unimaged region specifying unit 120 specifies an unimaged region based on the iris region extracted by the iris region extraction unit 150 and the imaged iris region read from the iris region storage unit 160 (step S303).

[0092] Next, the output unit 130 outputs the eye image captured by the imaging unit 110, including information about the unimaged region identified by the unimaged region identifying unit 120 (step S103). After that, the matching unit 190 determines whether the unimaged region is equal to or smaller than a fourth threshold value, using the information about the unimaged region identified by the unimaged region identifying unit 120 (step S601).

[0093] If the unimaged region is equal to or smaller than the fourth threshold (step S601: YES), the registration unit 170 uses both the new iris region and the photographed iris region included in the eye image as match images and matches them with the registered image stored in the registration information storage unit 180 (step S602). The matching unit 190 may also output the matching result. For example, the matching unit 190 may output information indicating whether the match was successful or unsuccessful. Alternatively, the matching unit 190 may output a matching score between the registered image and the match image. Alternatively, the matching unit 190 may output information about an individual identified by the match. Alternatively, the matching unit 190 may output information for executing a process (e.g., a process for opening or closing a gate) according to the match result.

[0094] On the other hand, if the unimaged area is not equal to or less than the fourth threshold (step S601: NO), the image capture control unit 140 controls the image capture unit 110 to capture a new eye image. This causes the process to be executed again from step S101. That is, the fourth threshold here is essentially used as the first threshold described in the second embodiment (see FIG. 5). However, the first threshold and the fourth threshold may be set as separate values ​​and determined separately.

[0095] (Technical Effects) Next, technical effects obtained by the sixth information processing apparatus 10 will be described.

[0096] 11 and 12, in the sixth information processing device 10, when the unimaged region is equal to or smaller than the fourth threshold, the iris region acquired up to that point is used as the match image for matching. In this way, an eye image with a sufficiently small unimaged region can be used for matching, making it possible to perform more appropriate matching processing.

[0097] Seventh Embodiment The seventh embodiment will be described with reference to Fig. 13. Note that the seventh embodiment describes specific output examples in the first to sixth embodiments described above, and the device configuration and operational flow may be similar to those of the first to sixth embodiments. Therefore, the following will describe in detail the parts that are different from the embodiments already described, and will omit explanations of other overlapping parts as appropriate.

[0098] (Highlighted Display) First, a display example of an eye image and an unimaged region by the seventh information processing device 10 will be specifically described with reference to Fig. 13. Fig. 13 is a plan view showing a display example of guidance information in the seventh information processing device.

[0099] As shown in FIG. 13 , in the seventh information processing device 10, the output unit 130 outputs an unimaged region superimposed on the eye image. Note that in FIG. 13( a ), the unimaged region is not displayed, and only the eye image is displayed. This is because the visible area of ​​the iris region is 90%, and therefore the unimaged region is not identified (see, for example, the fourth embodiment). On the other hand, in FIG. 13( b ), the portion hidden by the upper eyelid is displayed as the unimaged region. In this way, the unimaged region may be displayed as a region indicating a portion that is not actually visible (i.e., a portion that is not reflected in the eye image). In FIG. 13( c ), the portion hidden by the upper eyelid and the portion hidden by the lower eyelid are displayed as the unimaged region. In this way, the unimaged region may be displayed as multiple regions.

[0100] In particular, in the seventh information processing device 10, unimaged regions are displayed in an emphasized manner. For example, unimaged regions are displayed in a highly saturated, conspicuous color. More specifically, unimaged regions may be displayed as regions filled with a conspicuous color, or as regions surrounded by a conspicuous color line. Furthermore, unimaged regions may be displayed in a manner that includes movement, for example. Specifically, unimaged regions may be displayed by changing color or flashing. Note that the manner in which unimaged regions are highlighted is not limited to the examples given here, and other techniques may be appropriately adopted for highlighting.

[0101] (Technical Effects) Next, technical effects obtained by the seventh information processing apparatus 10 will be described.

[0102] 13, the seventh information processing device 10 highlights the unimaged area. In this way, the unimaged area can be made to stand out, and it is possible to allow the subject or the like to more appropriately grasp the area that has not yet been imaged.

[0103] Eighth Embodiment An eighth embodiment will be described with reference to Fig. 14. Note that the eighth embodiment differs from the first to seventh embodiments described above only in part of the configuration and operation, and other parts may be similar to the first and seventh embodiments. Therefore, the following will describe in detail the parts that differ from the embodiments already described, and will omit a description of other overlapping parts as appropriate.

[0104] (Functional Configuration) First, the functional configuration of the eighth information processing device 10 will be described with reference to Fig. 14. Fig. 14 is a block diagram showing the functional configuration of the eighth information processing device. Note that in Fig. 14, the same elements as those shown in Fig. 6 are denoted by the same reference numerals.

[0105] 14, the eighth information processing device 10 is configured to include, as components for realizing its functions, an imaging unit 110, an unimaged region specifying unit 120, an output unit 130, an imaging control unit 140, an iris region extracting unit 150, an iris region storage unit 160, and a guiding unit 200. That is, the eighth information processing device 10 is configured to further include the guiding unit 200 in addition to the configuration described in the third embodiment (see FIG. 6). The guiding unit 200 may be a processing block realized by, for example, the above-mentioned processor 11 (see FIG. 1).

[0106] The guidance unit 200 is configured to be capable of outputting guidance information that guides the subject so that the iris region included in the eye image changes. The guidance unit 200 may output, for example, information for the subject to change their gaze direction as guidance information. When the subject's gaze direction changes, the position of the iris region also changes, so that, for example, a part hidden by the eyelid can be imaged. For example, when the gaze direction changes upward, a part hidden by the lower eyelid can be imaged. Similarly, when the gaze direction changes downward, a part hidden by the upper eyelid can be imaged. More specific examples of guidance information will be described in other embodiments described below.

[0107] Although the guidance unit 200 and the output unit 130 are illustrated separately here, the guidance unit 200 may be configured as a part of the output unit 130. Specifically, the output unit 130 may be configured to have a function of outputting guidance information in addition to the eye image and information related to the unimaged region.

[0108] (Technical Effects) Next, technical effects obtained by the eighth information processing apparatus 10 will be described.

[0109] As described in Fig. 14, the eighth information processing device 10 outputs guidance information toward the target. In this way, by guiding the movement of the target, it becomes possible to capture an image of the iris area that was previously hidden. Therefore, it is possible to reduce the area that has not yet been captured.

[0110] Ninth Embodiment A ninth embodiment will be described with reference to Figures 15 and 16. Note that the ninth embodiment differs from the eighth embodiment described above only in some of its operations, and other parts may be similar to the first and eighth embodiments. Therefore, the following will describe in detail only the parts that differ from the embodiments already described, and will omit a description of other overlapping parts as appropriate.

[0111] (Display of Guidance Information) First, a display example of the guide information in the ninth information processing device 10 will be specifically described with reference to Fig. 15 and Fig. 16. Fig. 15 is a plan view (part 1) showing a display example of the guide information in the ninth information processing device. Fig. 16 is a plan view (part 2) showing a display example of the guide information in the ninth information processing device.

[0112] As shown in FIG. 15 , in the ninth information processing device 10, the guidance unit 200 outputs guidance information based on at least one of the area and position of the unimaged region. For example, in the example shown in FIG. 15( a), there is a relatively small unimaged region that is hidden by the upper eyelid and cannot be captured. In this case, a message such as "Please look down a little" may be displayed as guidance information. By displaying such a message, the subject can slightly move their gaze downward, allowing the portion hidden by the upper eyelid to be captured. Also, in the example shown in FIG. 15( b), there is a relatively large unimaged region that is hidden by the upper eyelid and cannot be captured. In this case, a message such as "Please look down widely" may be displayed as guidance information. By displaying such a message, the subject can significantly move their gaze downward, allowing the portion hidden by the upper eyelid to be captured.

[0113] As shown in FIG. 16 , the guidance unit 200 may output multiple pieces of guidance information. In the example shown in FIG. 16 , there is an unimaged area hidden by the upper eyelid and an unimaged area hidden by the lower eyelid. In this case, a message such as "Look up, then look down after a while" may be displayed as guidance information. By displaying such a message, the subject first shifts their gaze upward, allowing the area hidden by the lower eyelid to be captured. At this timing, the first eye image is captured. Then, the subject shifts their gaze downward, allowing the area hidden by the upper eyelid to be captured. If a second eye image is captured at this timing, the areas corresponding to the two unimaged areas can be captured together with the first image.

[0114] Although an example in which a text message is displayed as the guidance information has been given here, the guidance information is not limited to this form. For example, the guidance information may be displayed as an arrow indicating the guidance direction, or as a target guide that moves in the guidance direction. The target guide can guide only the line of sight by, for example, moving slowly. Conversely, the target guide can also guide only the line of sight by moving quickly. Note that if a sufficient image of the iris region cannot be captured in one shot, the target guide may be moved slowly and multiple eye images may be captured. Alternatively, the guidance information may be output as audio via a speaker or the like. Furthermore, the guidance information may be output as a combination of these different types of guidance information.

[0115] (Technical Effects) Next, technical effects obtained by the ninth information processing apparatus 10 will be described.

[0116] 15 and 16, the ninth information processing device 10 outputs guidance information based on the area and position of the unimaged region. In this way, it is possible to make the unimaged region more appropriately photographable.

[0117] Tenth Embodiment A tenth embodiment will be described with reference to Fig. 17. Note that the tenth embodiment differs from the eighth and ninth embodiments described above only in some of the operations, and other parts may be similar to the first and ninth embodiments. Therefore, the following will describe in detail the parts that differ from the embodiments already described, and will omit a description of other overlapping parts as appropriate.

[0118] (Operational Flow) First, the operational flow of the tenth information processing device 10 will be described with reference to Fig. 17. Fig. 17 is a flowchart showing the operational flow in the tenth information processing device. Note that in Fig. 17, the same processes as those shown in Fig. 7 are denoted by the same reference numerals.

[0119] 17 , when the operation of the tenth information processing device 10 starts, the image capturing unit 110 first captures an eye image including the iris region of the target (step S101). Then, the iris region extraction unit 150 extracts the iris region of the target from the eye image captured by the image capturing unit 110 (step S301).

[0120] Next, the unimaged region specifying unit 120 receives information about the iris region extracted by the iris region extraction unit 150 and reads information about the imaged iris region from the iris region storage unit 160 (step S302).Then, the unimaged region specifying unit 120 specifies an unimaged region based on the iris region extracted by the iris region extraction unit 150 and the imaged iris region read from the iris region storage unit 160 (step S303).

[0121] Next, the output unit 130 outputs the eye image captured by the imaging unit 110, including information about the unimaged region identified by the unimaged region identifying unit 120 (step S103). After that, the guidance unit 200 determines whether the unimaged region is equal to or smaller than a fifth threshold, using the information about the unimaged region identified by the unimaged region identifying unit 120 (step S1001).

[0122] The "fifth threshold" here is a threshold that is set in advance to determine whether the unimaged region is sufficiently small. The fifth threshold may be set appropriately depending on the purpose of the eye image, etc. The fifth threshold may be a threshold that corresponds to the area of ​​the unimaged region. Alternatively, the fifth threshold may be a threshold that corresponds to the ratio of the unimaged region to the entire iris region.

[0123] If the unimaged area is not equal to or smaller than the fifth threshold (step S1001: NO), the guidance unit 200 outputs guidance information corresponding to the unimaged area (step S1002). The imaging control unit 140 then controls the imaging unit 110 to capture a new eye image. This causes the process to be repeated from step S101. In other words, the fifth threshold here is essentially used as the first threshold described in the second embodiment (see FIG. 5). However, the first threshold and the fifth threshold may be set as separate values ​​and determined separately.

[0124] On the other hand, if the unimaged area is equal to or smaller than the fifth threshold (step S1001: NO), the guiding unit 200 does not output guidance information. Furthermore, the image capturing control unit 140 does not control the image capturing unit 110 to capture a new eye image. Therefore, when the unimaged area is equal to or smaller than the fifth threshold, the series of processes ends.

[0125] (Technical Effects) Next, technical effects obtained by the tenth information processing device 10 will be described.

[0126] 17 , in the tenth information processing device 10, the guidance information is repeatedly output until the unimaged area becomes equal to or smaller than the fifth threshold value. In this way, it is possible to gradually reduce the unimaged area by the guidance information until the unimaged area becomes sufficiently small.

[0127] Eleventh Embodiment An eleventh embodiment will be described with reference to Figures 18 and 19. Note that the eleventh embodiment differs from the eighth to tenth embodiments described above only in some of the operations, and other parts may be similar to the first and tenth embodiments. Therefore, the following will describe in detail the parts that differ from the embodiments already described, and will omit a description of other overlapping parts as appropriate.

[0128] (First Guidance) First, the first guidance display in the eleventh information processing device 10 will be described with reference to Fig. 18. Fig. 18 is a plan view showing an example of the first guidance display in the eleventh information processing device.

[0129] 18 , the eleventh information processing device 10 performs a first guidance that guides the user to change the line of sight while keeping the face facing in a fixed position. In the first guidance, for example, a text message is displayed as guidance information, and a target guide is displayed that prompts the user to change the line of sight.

[0130] In the example shown in FIG. 18(a), a message is displayed saying, "Please follow the target guide with your eyes without moving your face." Then, the target guide is displayed near the center of the screen. The target guide starts moving at a predetermined timing. In the example shown in FIG. 18(b), the target guide is moving downward. In this case, the gaze direction of the subject moves downward. Therefore, it becomes possible to capture an image of an area that was previously hidden by the upper eyelid, for example.

[0131] (Second Guidance) Next, the second guidance display in the eleventh information processing device 10 will be described with reference to Fig. 19. Fig. 19 is a plan view showing an example of the second guidance display in the eleventh information processing device.

[0132] 19 , the eleventh information processing device 10 performs a second guidance that guides the user to change the facial orientation while fixing the gaze direction. In the second guidance, for example, a text message is displayed as guidance information, and a target guide for fixing the gaze direction of the target is displayed.

[0133] In the example shown in Figure 19, a fixed target guide is displayed near the center of the screen. A message is then displayed saying, "Please move your face down while looking at the target guide." In this case, the subject's gaze direction remains fixed, but the facial direction changes downward. As a result, the gaze moves upward relative to the face, making it possible to capture an area that was previously hidden by the lower eyelid, for example.

[0134] (Technical Effects) Next, technical effects obtained by the eleventh information processing device 10 will be described.

[0135] As described in Figures 18 and 19, the eleventh information processing device 10 performs first and second guidance. In this way, guidance can be performed using a guidance method suitable for the target. For example, even if the target has difficulty responding to the first guidance, the area that can be imaged can be changed by performing the second guidance. Similarly, even if the target has difficulty responding to the second guidance, the area that can be imaged can be changed by performing the first guidance.

[0136] <Twelfth Embodiment> A twelfth embodiment will be described with reference to Fig. 20. Note that the twelfth embodiment differs from the eighth to eleventh embodiments described above only in some of the operations, and other parts may be similar to the first and eleventh embodiments. Therefore, the following will describe in detail the parts that differ from the embodiments already described, and will omit a description of other overlapping parts as appropriate.

[0137] (Operational Flow) First, the operational flow of the 12th information processing device 10 will be described with reference to Fig. 20. Fig. 20 is a flowchart showing the operational flow in the 12th information processing device. Note that in Fig. 20, the same processes as those shown in Fig. 17 are denoted by the same reference numerals.

[0138] 20 , when the operation of the twelfth information processing device 10 starts, the image capturing unit 110 first captures an eye image including the iris region of the target (step S101). Then, the iris region extraction unit 150 extracts the iris region of the target from the eye image captured by the image capturing unit 110 (step S301).

[0139] Next, the unimaged region specifying unit 120 receives information about the iris region extracted by the iris region extraction unit 150 and reads information about the imaged iris region from the iris region storage unit 160 (step S302).Then, the unimaged region specifying unit 120 specifies an unimaged region based on the iris region extracted by the iris region extraction unit 150 and the imaged iris region read from the iris region storage unit 160 (step S303).

[0140] Next, the output unit 130 outputs the eye image captured by the imaging unit 110, including information about the unimaged region identified by the unimaged region identifying unit 120 (step S103). After that, the guidance unit 200 determines whether the unimaged region is equal to or smaller than a fifth threshold, using the information about the unimaged region identified by the unimaged region identifying unit 120 (step S1001).

[0141] If the unimaged area is not equal to or less than the fifth threshold (step S1001: NO), the guidance unit 200 determines whether the amount of change in the unimaged area (i.e., the difference between the unimaged area identified when the previous eye image was captured and the unimaged area identified when the current eye image is captured) is equal to or less than the sixth threshold (step S1201).

[0142] The "sixth threshold" here is a threshold that is set in advance to determine whether the amount of change in the unimaged region is smaller than expected (in other words, whether the effect of the guidance is weak). The sixth threshold may be set appropriately depending on the type of guidance information provided last time, etc. The sixth threshold may be a threshold corresponding to the amount of change in the area of ​​the unimaged region. Alternatively, the sixth threshold may be a threshold corresponding to the amount of change in the ratio of the unimaged region to the entire iris region.

[0143] If the amount of change in the unimaged region is equal to or less than the sixth threshold (step S1201: YES), the guiding unit 200 switches the guiding method (step S1202). Specifically, if the first guiding (see FIG. 18) was performed up until the previous time, the second guiding (see FIG. 19) is performed from the next time. Conversely, if the second guiding was performed up until the previous time, the first guiding is performed from the next time. Note that if the amount of change in the unimaged region is not equal to or less than the sixth threshold (step S1201: NO), the processing of step S1202 is omitted. That is, the guiding unit 200 does not switch the guiding method.

[0144] Next, the guidance unit 200 outputs guidance information according to the unimaged region (step S1002). After that, the image capture control unit 140 controls the image capture unit 110 to capture a new eye image. This causes the process to be executed again from step S101.

[0145] On the other hand, if the unimaged area is equal to or smaller than the fifth threshold (step S1001: NO), the guiding unit 200 does not output guidance information. Furthermore, the image capturing control unit 140 does not control the image capturing unit 110 to capture a new eye image. Therefore, when the unimaged area is equal to or smaller than the fifth threshold, the series of processes ends.

[0146] (Technical Effects) Next, technical effects obtained by the twelfth information processing device 10 will be described.

[0147] 20, the twelfth information processing device 10 switches between the first guidance and the second guidance depending on the amount of change in the unimaged area. In this way, if one guidance method does not work well, the other guidance method is used. Therefore, ultimately, guidance is performed using a method suited to the target, making it possible to efficiently reduce the unimaged area.

[0148] <Thirteenth Embodiment> A thirteenth embodiment will be described with reference to Fig. 21. Note that the thirteenth embodiment differs from the eighth to twelfth embodiments described above only in some of the operations, and other parts may be similar to the first and twelfth embodiments. Therefore, the following will describe in detail the parts that differ from the embodiments already described, and will omit a description of other overlapping parts as appropriate.

[0149] (Guide Display) First, a display example of guide information in the thirteenth information processing device 10 will be specifically described with reference to Fig. 21. Fig. 21 is a plan view showing a display example of guide information in the thirteenth information processing device.

[0150] As shown in FIG. 21 , in the thirteenth information processing device 10, the guiding unit 200 displays a gaze guide, a face direction guide, and a target guide. The gaze guide is a guide that indicates the gaze direction of the target and moves in accordance with the gaze direction of the target. The face direction guide is a guide that indicates the facial direction of the target and moves in accordance with the facial direction of the target. The target guide is a guide that encourages a change in the gaze direction of the target. The target guide starts moving when both the gaze guide and the facial direction guide overlap.

[0151] 21A, the guiding unit 200 displays the message "1. Align the gaze guide and facial direction guide with the target guide." Therefore, the subject first adjusts the gaze direction and facial direction so that the gaze guide and facial direction guide overlap with the target guide.

[0152] The guidance unit 200 also displays the message "2. Follow the target guide with your eyes without moving your face." Therefore, when the gaze guide and face direction guide overlap the target guide and the target guide starts to move, the subject changes their gaze direction to match the target guide. In the example shown in FIG. 21(b), the target guide is moving downward, so the subject's facial direction remains fixed and their gaze direction changes downward. Note that after the target guide starts to move, the face direction guide and gaze guide may be hidden.

[0153] (Technical Effects) Next, technical effects obtained by the thirteenth information processing device 10 will be described.

[0154] 21 , in the thirteenth information processing device 10, when the gaze guide and face direction guide overlap the target, the target guide starts moving. As a result, it is possible to start guiding the gaze direction after aligning the gaze direction with the face direction. In this way, it is possible to more appropriately guide the gaze direction compared to when guidance is started when the gaze direction and face direction are not aligned.

[0155] The scope of each embodiment also includes a processing method in which a program that operates the configuration of each embodiment to realize the functions of the above-described embodiments is recorded on a recording medium, the program recorded on the recording medium is read as code, and the program is executed on a computer. In other words, a computer-readable recording medium is also included in the scope of each embodiment. Furthermore, each embodiment includes not only a recording medium on which the above-described program is recorded, but also the program itself.

[0156] Examples of recording media that can be used include floppy disks, hard disks, optical disks, magneto-optical disks, CD-ROMs, magnetic tapes, non-volatile memory cards, and ROMs. Furthermore, the scope of each embodiment is not limited to programs that execute processes by themselves, but also includes programs that execute processes by operating on an OS in conjunction with other software or expansion board functions. Furthermore, the program itself may be stored on a server, and part or all of the program may be downloadable from the server to a user terminal. The program may be provided to the user in, for example, a SaaS (Software as a Service) format.

[0157] <Supplementary Notes> The above-described embodiment may be further described as in the following supplementary notes, but is not limited to the following.

[0158] (Supplementary Note 1) The information processing device described in Supplementary Note 1 is an information processing device that includes an imaging means for capturing an eye image including an iris region of a target, an identification means for identifying an unimaged region of the iris region of the target that indicates an area that could not be imaged by the imaging means due to an obstruction, and an output means for outputting the eye image including information regarding the unimaged region.

[0159] (Appendix 2) The information processing device described in Appendix 2 is the information processing device described in Appendix 1, further comprising a control means for controlling the imaging means to newly capture the eye image when the unimaged area is equal to or greater than a first threshold.

[0160] (Appendix 3) The information processing device described in Appendix 3 is the information processing device described in Appendix 2, further comprising: an extraction means for extracting an iris area included in the eye image; and a storage means for storing the iris area extracted by the imaged area extraction means as an imaged iris area, wherein the identification means identifies the unimaged area based on the eye image and the imaged iris area.

[0161] (Appendix 4) The information processing device described in Appendix 4 is the information processing device described in Appendix 3, wherein the identification means identifies the unimaged area when the combined area of ​​the iris area extracted by the imaged area extraction means and the imaged iris area stored in the storage means is equal to or less than a second threshold.

[0162] (Appendix 5) The information processing device described in Appendix 5 is the information processing device described in Appendix 3 or 4, further comprising a registration means for registering both the new iris area included in the eye image newly captured under the control of the control means and the unimaged area identified from the photographed iris area as registered images to be used for matching when the new iris area and the photographed iris area are equal to or smaller than a third threshold.

[0163] (Supplementary Note 6) The information processing device described in Supplementary Note 6 is the information processing device described in Supplementary Note 3 or 4, further comprising a matching means for matching both the new iris area included in the eye image newly captured under the control of the control means and the unimaged area identified from the photographed iris area as matching images with a pre-registered registered image when the unimaged area identified from the new iris area included in the eye image newly captured under the control of the control means is equal to or less than a fourth threshold.

[0164] (Supplementary Note 7) The information processing device described in Supplementary Note 7 is the information processing device described in any one of Supplements 1 to 6, wherein the output means outputs information that displays the unimaged area in a manner that emphasizes the iris area of ​​the target.

[0165] (Appendix 8) The information processing device described in Appendix 8 is the information processing device described in any one of Appendices 2 to 7, further comprising a guidance means for guiding the subject so that the iris area included in the eye image changes based on the unimaged area.

[0166] (Supplementary Note 9) The information processing device according to Supplementary Note 9 is the information processing device according to Supplementary Note 8, wherein the guiding means guides the target based on at least one of an area and a position of the unimaged region.

[0167] (Supplementary Note 10) The information processing device according to Supplementary Note 10 is the information processing device according to Supplementary Note 8 or 9, wherein the guiding means repeatedly guides the target until the unimaged region becomes equal to or smaller than a fifth threshold.

[0168] (Appendix 11) The information processing device described in Appendix 11 is the information processing device described in any one of Appendices 8 to 10, wherein the guiding means performs a first guidance that fixes the facial direction and guides the gaze direction to change, and a second guidance that fixes the gaze direction and guides the facial direction to change.

[0169] (Appendix 12) The information processing device described in Appendix 12 is the information processing device described in Appendix 11, wherein the guidance means performs the other of the first guidance and the second guidance when the amount of change in the unimaged area when one of the first guidance and the second guidance is performed is less than a sixth threshold.

[0170] (Appendix 13) The information processing device described in Appendix 13 is the information processing device described in any one of Appendices 8 to 12, wherein the guiding means displays a gaze guide indicating the gaze direction of the target, a facial direction guide indicating the facial direction of the target, and a target guide for guiding the target, and when the gaze guide and the facial direction guide overlap with the target guide, starts moving the target guide.

[0171] (Supplementary Note 14) The information processing method described in Supplementary Note 14 is an information processing method that uses at least one computer to capture an eye image including an iris region of a target, identify an unimaged region of the iris region of the target that indicates an area that could not be imaged due to an obstruction, and output the eye image including information related to the unimaged region.

[0172] (Appendix 15) The recording medium described in Appendix 15 is a recording medium having recorded thereon a computer program for causing at least one computer to execute an information processing method, which comprises capturing an eye image including an iris region of a target, identifying an unimaged region of the iris region of the target that indicates an area that could not be imaged due to an obstruction, and outputting the eye image together with information relating to the unimaged region.

[0173] (Supplementary Note 16) The computer program described in Supplementary Note 16 is a computer program that causes at least one computer to execute an information processing method that captures an eye image including an iris region of a target, identifies an unimaged region of the iris region of the target that indicates an area that could not be imaged due to an obstruction, and outputs the eye image including information related to the unimaged region.

[0174] This disclosure may be modified as appropriate within the scope that does not contradict the gist or idea of ​​the invention that can be read from the claims and the entire specification, and information processing devices, information processing methods, and recording media that involve such modifications are also included in the technical idea of ​​this disclosure.

[0175] REFERENCE SIGNS LIST 10 Information processing device 11 Processor 110 Imaging unit 120 Unimaged region specifying unit 130 Output unit 140 Imaging control unit 150 Iris region extraction unit 160 Iris region storage unit 170 Registration unit 180 Registered image storage unit 190 Matching unit 200 Guidance unit

Claims

1. An information processing device comprising: an imaging means for capturing an eye image including an iris region of a target; a determination means for determining an unimaged region of the iris region of the target that indicates an area that could not be captured by the imaging means due to an obstruction; and an output means for outputting the eye image including information regarding the unimaged region.

2. The information processing device according to claim 1, further comprising a control means for controlling said imaging means to newly capture said eye image when said unimaged region is equal to or larger than a first threshold value.

3. The information processing device according to claim 2, further comprising: an extraction means for extracting an iris region included in the eye image; and a storage means for storing the iris region extracted by the imaged region extraction means as an imaged iris region, wherein the identification means identifies the unimaged region based on the eye image and the imaged iris region.

4. The information processing device according to claim 3, wherein the identification means identifies the unimaged area when the combined area of ​​the iris area extracted by the image capture area extraction means and the imaged iris area stored in the memory means is equal to or smaller than a second threshold.

5. An information processing device as described in claim 3 or 4, further comprising a registration means for registering both the new iris area and the photographed iris area as registered images to be used for matching when the unimaged area identified from a new iris area included in the eye image newly captured under the control of the control means and the photographed iris area is equal to or smaller than a third threshold value.

6. An information processing device as described in claim 3 or 4, further comprising a comparison means for comparing, when a new iris area included in the eye image newly captured under the control of the control means and the unimaged area identified from the photographed iris area are equal to or smaller than a fourth threshold, both the new iris area and the photographed iris area as comparison images with a registered image registered in advance.

7. The information processing device according to claim 1 or 2, wherein said output means outputs information that displays said unimaged region in a manner that emphasizes said iris region of the subject.

8. The information processing device according to claim 2 or 3, further comprising a guiding means for guiding the object so that an iris region included in the eye image changes based on the unimaged region.

9. The information processing device according to claim 8, wherein the guiding means guides the target based on at least one of the area and the position of the unimaged region.

10. The information processing device according to claim 8, wherein the guiding means repeatedly guides the target until the unimaged region becomes equal to or smaller than a fifth threshold value.

11. The information processing device according to claim 8, wherein the guiding means performs a first guidance that fixes the facial direction and guides the gaze direction to change, and a second guidance that fixes the gaze direction and guides the facial direction to change.

12. The information processing device according to claim 11, wherein the guidance means performs the other of the first guidance and the second guidance when the amount of change in the unimaged area when one of the first guidance and the second guidance is performed is equal to or less than a sixth threshold value.

13. The information processing device of claim 8, wherein the guiding means displays a gaze guide indicating the gaze direction of the target, a facial direction guide indicating the facial direction of the target, and a target guide for guiding the target, and starts moving the target guide when the gaze guide and the facial direction guide overlap with the target guide.

14. An information processing method, comprising: capturing an eye image including an iris region of a target by at least one computer; identifying an unimaged region of the iris region of the target that indicates an area that could not be imaged due to an obstruction; and outputting the eye image including information regarding the unimaged region.

15. A recording medium having recorded thereon a computer program for causing at least one computer to execute an information processing method, which comprises capturing an eye image including a target's iris region, identifying an unimaged region of the target's iris region that indicates an area that could not be imaged due to an obstruction, and outputting the eye image including information regarding the unimaged region.

Images