Information processing device, information processing method, and recording medium
By setting evaluation areas based on pixel variance and excluding pupil and reflection regions, the accuracy of focus determination and target authentication is improved, addressing the limitations of existing technologies in determining focused images for authentication.
Patent Information
- Application Number
- JP2024507295
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2022-03-16
- Publication Date
- 2026-01-16
- Estimated Expiration
- 2042-03-16
AI Technical Summary
Existing information processing devices for target authentication using body images suffer from reduced accuracy in determining focus and subsequent authentication due to the use of inappropriate evaluation parameters, particularly when evaluating images with varying brightness levels and regions like pupils and reflections.
The solution involves setting an evaluation area within a target image to assess focus based on the variance of brightness values of multiple pixels, excluding regions like pupils and reflections, thereby improving focus determination and authentication accuracy.
This approach enhances the accuracy of determining focused images and subsequent target authentication, particularly in iris and face recognition, by utilizing the variance of luminance values within defined evaluation areas, excluding regions that cause inaccuracies.
Smart Images

Figure 0007800650000001 
Figure 0007800650000002 
Figure 0007800650000003
Abstract
Description
[Technical Field]
[0001] The present disclosure relates to, for example, the technical field of an information processing device, an information processing method, and a recording medium that can determine whether a target image including at least the body of a target is a focused image in which a body region including a part of the body of the target is in focus.Furthermore, the present disclosure relates to, for example, the technical field of an information processing device, an information processing method, and a recording medium that can authenticate a target using a target image including at least the body of the target. [Background technology]
[0002] An example of an information processing device capable of authenticating a target using a target image including the target's body is described in Patent Document 1. In particular, the information processing device described in Patent Document 1 authenticates a person to be authenticated using an image output from an image capturing device. The image capturing device described in Patent Document 1 includes an image capturing unit that captures images of the person to be authenticated at positions with different shooting distances from each other by capturing an image of the person to be authenticated, a focus degree calculation unit that calculates the focus degree of the image captured by the image capturing unit, and a focus image determination unit that determines whether the focus degree is equal to or greater than a predetermined threshold value and thereby determines whether the image captured by the image capturing unit is a focused image.
[0003] Other prior art documents related to this disclosure include Patent Documents 2, 3, and 4. [Prior art documents] [Patent documents]
[0004] [Patent Document 1] Japanese Patent Application Laid-Open No. 2004-328367 [Patent Document 2] Japanese Patent Application Laid-Open No. 2007-093874 [Patent Document 3] Special Publication No. 2016-534474 [Patent Document 4] Japanese Patent Application Publication No. 2017-201303 Summary of the Invention [Problem to be solved by the invention]
[0005] An object of this disclosure is to provide an information processing device, an information processing method, and a recording medium that aim to improve upon the techniques described in prior art documents. [Means for solving the problem]
[0006] A first aspect of the information processing device disclosed herein includes a setting means for setting an evaluation area within a target image including at least the target body to evaluate the degree of focus of a body area including a part of the target body, and a determination means for determining whether the target image is a focused image in which the body area is in focus based on the variance of brightness values of multiple pixels included in the evaluation area.
[0007] A first aspect of the information processing method of this disclosure includes setting an evaluation area in a target image including at least a part of the target's body to evaluate the degree of focus of a body area including the part of the target's body, and determining whether the target image is a focused image in which the body area is in focus based on the variance of brightness values of multiple pixels included in the evaluation area.
[0008] A first aspect of the recording medium of this disclosure is a recording medium having recorded thereon a computer program that causes a computer to execute an information processing method, the information processing method including setting an evaluation area within a target image that includes at least the body of the target, for evaluating the degree of focus of a body area that includes a part of the body of the target, and determining whether the target image is a focused image in which the body area is in focus based on the variance of brightness values of multiple pixels included in the evaluation area.
[0009] A second aspect of the information processing device of this disclosure includes a setting means for setting an evaluation area in a target image including at least the body of the target to evaluate the degree of focus of a body area including a part of the body of the target, a determination means for determining whether the target image is a focused image in which the body area is in focus based on the variance of brightness values of multiple pixels included in the evaluation area, and an authentication means for authenticating the target using the target image determined to be the focused image.
[0010] A second aspect of the information processing method of this disclosure comprises setting an evaluation area in a target image including at least the body of the target to evaluate the degree of focus of a body area including a part of the body of the target, determining whether the target image is a focused image in which the body area is in focus based on the variance of brightness values of multiple pixels included in the evaluation area, and authenticating the target using the target image determined to be the focused image.
[0011] A second aspect of the recording medium of this disclosure is a recording medium having recorded thereon a computer program that causes a computer to execute an information processing method, the information processing method including: setting an evaluation area in a target image that includes at least the body of the target, for evaluating the degree of focus of a body area that includes a part of the body of the target; determining whether the target image is a focused image in which the body area is in focus based on the variance of brightness values of multiple pixels included in the evaluation area; and authenticating the target using the target image that has been determined to be the focused image. [Brief explanation of the drawings]
[0012] [Figure 1] FIG. 1 is a block diagram showing the configuration of an information processing device according to the first embodiment. [Figure 2] FIG. 2 is a block diagram showing the configuration of a modified example of the information processing device in the first embodiment. [Figure 3] FIG. 3 is a block diagram showing the configuration of an information processing device according to the second embodiment. [Figure 4] FIG. 4 is a block diagram showing the configuration of a modified example of the information processing device in the second embodiment. [Figure 5] FIG. 5 is a block diagram showing the configuration of an authentication system according to the third embodiment. [Figure 6] FIG. 6 is a block diagram showing the configuration of an information processing device according to the third embodiment. [Figure 7] FIG. 7 is a flowchart showing the flow of an authentication operation (particularly, an authentication operation including a focus determination operation) performed by an information processing device in the third embodiment. [Figure 8] Figure 8(a) shows a schematic diagram of how the positional relationship between the focal plane of the imaging device and the target person changes as the target person moves relative to the imaging device, Figure 8(b) shows a schematic diagram of how the positional relationship between the focal plane of the imaging device and the target person changes as the imaging device moves relative to the target person, and Figure 8(c) shows a schematic diagram of how the positional relationship between the focal plane of the imaging device and the target person changes as the focal length of the imaging device is changed. [Figure 9] FIG. 9 shows the focus evaluation area set in the eye image. [Figure 10] Figure 10(a) shows a focused image identified using the first focus determination condition that the focus evaluation value (variance) is greater than a predetermined threshold, and Figure 10(b) shows a focused image identified using the second focus determination condition that the focus evaluation value (variance) is maximized. [Figure 11] Each of FIGS. 11(a) to 11(d) shows a focus evaluation area set by the information processing device (focus determination unit) in the fourth embodiment. [Figure 12] FIG. 12 shows a focus evaluation area set by an information processing device (focus determination unit) in the fifth embodiment. [Figure 13] FIG. 13 shows an imaging device whose imaging range is changeable. [Figure 14] FIG. 14 shows an eye image generated by the imaging device capturing an image of the target person before the imaging range is changed, and an eye image generated by the imaging device capturing an image of the target person after the imaging range is changed. [Figure 15] FIG. 15 is a block diagram showing the configuration of an authentication system according to the seventh embodiment. [Figure 16] FIG. 16 shows an eye image generated by an imaging device capturing an image of a target person before the lighting conditions are changed, and an eye image generated by an imaging device capturing an image of the target person after the lighting conditions are changed. DETAILED DESCRIPTION OF THE INVENTION
[0013] Hereinafter, embodiments of an information processing device, an information processing method, and a recording medium will be described with reference to the drawings.
[0014] (1) First embodiment First, a first embodiment of an information processing device, an information processing method, and a recording medium will be described. Hereinafter, the first embodiment of the information processing device, the information processing method, and a recording medium will be described using an information processing device 1000 to which the first embodiment of the information processing device, the information processing method, and a recording medium is applied, with reference to Fig. 1. Fig. 1 is a block diagram showing the configuration of the information processing device 1000 in the first embodiment.
[0015] As shown in FIG. 1, the information processing device 1000 in the first embodiment includes a setting unit 1001, which is a specific example of a "setting means" described in the appendix, and a determination unit 1002, which is a specific example of a "determination means" described in the appendix. The setting unit 1001 sets an evaluation area in a target image that includes at least the body of the target. The evaluation area is an area for evaluating the degree of focus of a body area in the target image that includes a part of the body of the target. Note that "focus" in the embodiment may also mean a state in which "the focus of an imaging device that captures an image of the target to generate the target image is on the target (particularly a part of the body of the target)." The determination unit 1002 determines whether the target image is a focused image in which the body area is in focus based on the variance of the luminance values of multiple pixels included in the evaluation area. Note that the information processing device 1000 that can determine whether the target image is a focused image may be referred to as a focus determination device.
[0016] The information processing device 1000 according to the first embodiment can determine whether a target image is a focused image with higher accuracy than when an evaluation parameter other than the variance of the luminance values of multiple pixels included in the evaluation area is used to determine whether a target image is a focused image. This is because, when a target image is a focused image, the target's body is clearly visible in the target image. That is, the target's body appears with relatively high contrast in the target image. On the other hand, when the target image is not a focused image, the target's body appears blurred or blurred in the target image, with relatively low contrast. Therefore, when a target image is a focused image, the variance (variance) of the luminance values among multiple pixels is greater than when the target image is not a focused image. Based on this characteristic, the luminance values of multiple pixels can be used as a parameter for determining whether a target image is a focused image. As described above, the luminance values of multiple pixels can be used as a parameter for evaluating the degree of focus of a body region included in a target image. As a result, the information processing device 1000 can determine with higher accuracy whether or not the target image is a focused image. Therefore, the information processing device 1000 can solve the technical problem of a decrease in accuracy in determining whether or not the target image is a focused image.
[0017] As shown in FIG. 2 , which illustrates a modified example of the information processing device 1000 according to the first embodiment, the information processing device 1000 may include an authentication unit 1003, which is a specific example of the “authentication means” described in the appendix. The authentication unit 1003 may authenticate the target using a target image determined by the determination unit 1002 to be a focused image. For example, the authentication unit 1003 may perform biometric authentication to authenticate the target using a part of the target's body included in the target image determined to be a focused image. As an example, the authentication unit 1003 may perform iris authentication to authenticate the target using the target's iris included in the target image determined to be a focused image. As another example, the authentication unit 1003 may perform face authentication to authenticate the target using the target's face included in the target image determined to be a focused image. In this case, the information processing device 1000 can authenticate the target with higher accuracy compared to when the target is authenticated using a target image that is not a focused image. In other words, the accuracy of target authentication is improved. The information processing device 1000 capable of authenticating a target (for example, the information processing device 1000 including the authentication unit 1003) may be referred to as an authentication device.
[0018] (2) Second embodiment Next, a second embodiment of the information processing device, the information processing method, and the recording medium will be described. Hereinafter, the second embodiment of the information processing device, the information processing method, and the recording medium will be described with reference to Fig. 3, using an information processing device 2000 to which the second embodiment of the information processing device, the information processing method, and the recording medium is applied. Fig. 3 is a block diagram showing the configuration of the information processing device 2000 in the second embodiment.
[0019] As shown in FIG. 3 , the information processing device 2000 of the second embodiment includes a setting unit 2001, which is a specific example of the “setting means” described in the appendix, and a determination unit 2002, which is a specific example of the “determination means” described in the appendix. The setting unit 2001 sets an evaluation area in a target image that includes at least the body of the target. Similar to the evaluation area in the first embodiment, the evaluation area in the second embodiment is an area for evaluating the focus level of a body area in the target image that includes a part of the body of the target. In particular, in the second embodiment, the target image includes an eye image that includes the subject's eye as the body. Furthermore, the body area includes an iris area that includes the subject's iris as part of the body. In this case, the setting unit 2001 sets, as the evaluation area, an area in the eye image that is different from the pupil area that includes the subject's pupil and the reflection area that includes a reflected image of light incident on the subject's eye, but is included in the iris area. Therefore, in the second embodiment, the evaluation area is included in the iris area, but does not include at least one of the pupil area and the reflection area. The determination unit 2002 uses the evaluation area to calculate an evaluation value for evaluating the degree of focus of the iris area. The determination unit 2002 may calculate the "variance of luminance values of multiple pixels included in the evaluation area" described in the first embodiment as the evaluation value. In this case, the "variance of luminance values of multiple pixels included in the evaluation area" described in the first embodiment may be considered as a specific example of the "evaluation value" in the second embodiment. Alternatively, the determination unit 2002 may calculate an evaluation value different from the "variance of luminance values of multiple pixels included in the evaluation area" described in the first embodiment as the evaluation value. The determination unit 2002 further determines whether the eye image is a focused image in which the iris area is in focus, based on the calculated evaluation value. Note that the information processing device 2000 capable of determining whether a target image (the eye image in the second embodiment) is a focused image may be referred to as a focus determination device.
[0020] The information processing device 2000 in the second embodiment calculates an evaluation value for evaluating the focus level of the iris region (i.e., the body region) using an evaluation region that does not include the pupil region and the reflection region. That is, the information processing device 2000 determines whether the eye image is a focused image (i.e., whether the target image is a focused image) using an evaluation region that does not include the pupil region and the reflection region. Therefore, the information processing device 2000 can determine whether the eye image is a focused image with higher accuracy than when determining whether the eye image is a focused image using an evaluation region that includes at least one of the pupil region and the reflection region. This is because the pupil region is generally much darker than the iris region. Therefore, if the evaluation region includes the pupil region, the accuracy of determining whether the eye image is a focused image may be reduced due to the pupil region, which is much darker than the iris region, being included in the evaluation region. Similarly, the reflection region is generally much brighter than the iris region. Therefore, if the evaluation area includes a reflective area, the accuracy of determining whether the eye image is in focus may be reduced due to the inclusion of a reflective area that is much brighter than the iris area. However, in the second embodiment, the evaluation area does not include a pupil area or a reflective area, so there is no technical problem of reduced accuracy in determining whether the eye image is in focus due to the inclusion of at least one of the pupil area and the reflective area in the evaluation area. Therefore, the information processing device 2000 can solve the technical problem of reduced accuracy in determining whether the eye image is in focus.
[0021] As shown in FIG. 4 , which illustrates a modified example of the information processing device 2000 according to the second embodiment, the information processing device 2000 may include an authentication unit 2003, which is a specific example of the “authentication means” described in the appendix, which will be described later. The authentication unit 2003 may authenticate the target using an eye image determined by the determination unit 2002 to be a focused image. For example, the authentication unit 2003 may perform iris authentication, which authenticates the target using the iris of the target included in the eye image determined to be a focused image. In this case, the information processing device 2000 can authenticate the target with higher accuracy than when the target is authenticated using an eye image that is not a focused image. In other words, the accuracy of target authentication is improved. The information processing device 2000 capable of authenticating the target (e.g., an information processing device 2000 including the authentication unit 2003) may be referred to as an authentication device.
[0022] (3) Third embodiment Next, a third embodiment of an information processing device, an information processing method, and a recording medium will be described. Hereinafter, the third embodiment of the information processing device, the information processing method, and the recording medium will be described using an authentication system SYS to which the third embodiment of the information processing device, the information processing method, and the recording medium is applied.
[0023] (3-1) Overall configuration of authentication system SYS in the third embodiment First, the overall configuration of the authentication system SYS in the third embodiment will be described with reference to Fig. 5. Fig. 5 is a block diagram showing the overall configuration of the authentication system SYS in the third embodiment.
[0024] 5, the authentication system SYS includes an imaging device 1 and an information processing device 2. The imaging device 1 and the information processing device 2 can communicate with each other via a communication network 3. The communication network 3 may include a wired communication network. The communication network 3 may include a wireless communication network. However, the imaging device 1 and the information processing device 2 may be integrated. In other words, the authentication system SYS may be a device in which the imaging device 1 and the information processing device 2 are integrated.
[0025] The imaging device 1 is a device (so-called camera) capable of capturing an image of at least a portion of a target. The target may include, for example, a person. The target may include animals other than a person (for example, at least one of mammals such as dogs and cats, birds such as sparrows, reptiles such as snakes, amphibians such as frogs, and fish such as goldfish). The target may include an inanimate object. The inanimate object may include a robot that resembles a person or an animal. In the following explanation, an example will be described in which the target is a person (hereinafter referred to as "target person P").
[0026] The imaging device 1 is capable of generating a person image IMG in which at least a part of the target person P is captured by capturing an image of at least a part of the target person P. Specifically, the imaging device 1 is capable of generating a person image IMG including the body of the target person P by capturing an image of the body of the target person P. For example, the imaging device 1 may be capable of generating a person image IMG in which the face of the target person P is captured as part of the body of the target person P by capturing an image of the face of the target person P. In other words, the imaging device 1 may be capable of generating a person image IMG in which the face of the target person P is captured by capturing an image of the face of the target person P. For example, the imaging device 1 may be capable of generating a person image IMG in which the eyes of the target person P are captured as part of the body of the target person P by capturing an image of the eyes of the target person P. In other words, the imaging device 1 may be capable of generating a person image IMG in which the eyes of the target person P are captured by capturing an image of the eyes of the target person P. In the third embodiment, an example will be described in which the imaging device 1 captures an image of the eyes of a target person P, and is thereby able to generate an eye image IMG_E in which the eyes of the target person P are captured as a person image IMG.
[0027] Note that the eye image IMG_E may include a part of the target person P other than the eyes. Even in this case, as will be described in detail later, the target person P is authenticated using the iris of the target person P that appears in the eye image IMG_E as part of the body of the target person P, so there is no problem even if a part of the target person P other than the eyes appears in the iris image IMG_I.
[0028] The information processing device 2 acquires a person image IMG from the imaging device 1 and performs an authentication operation to authenticate the target person P using the person image IMG. For this reason, the information processing device 2 may be referred to as an authentication device. In the third embodiment, the information processing device 2 acquires an eye image IMG_E from the imaging device 1 and performs an authentication operation to authenticate the target person P using the eye image IMG_E. In particular, the information processing device 2 performs an authentication operation related to iris authentication. Specifically, the information processing device 2 identifies an iris area IA (see FIG. 9, which will be described later) that includes the iris of the target person P as part of the body of the target person P from the acquired eye image IMG_E. The information processing device 2 extracts iris features (i.e., iris pattern features) from the identified iris area IA. Based on the extracted iris features, the information processing device 2 determines whether the target person P appearing in the acquired eye image IMG_E is the same as a person registered in advance (hereinafter referred to as a "registered person"). If it is determined that the target person P reflected in the eye image IMG_E is the same as the registered person, it is determined that the authentication of the target person P has been successful. On the other hand, if it is determined that the target person P reflected in the eye image IMG_E is not the same as the registered person, it is determined that the authentication of the target person P has failed.
[0029] As part of the authentication operation, the information processing device 2 further performs a focus determination operation to determine whether the eye image IMG_E is a focused image. A focused image may mean an image in which the iris region IA is in focus. For this reason, the information processing device 2 may be referred to as a focus determination device. The information processing device 2 authenticates the target person P using the eye image IMG_E determined to be a focused image by the focus determination operation. As a result, the information processing device 2 can authenticate the target person P with high accuracy compared to when the target person P is authenticated using an eye image IMG_E that is not in focus (i.e., an eye image IMG_E in which the iris region IA is not in focus). In other words, the authentication accuracy of the information processing device 2 is improved compared to when the target person P is authenticated using an eye image IMG_E that is not in focus.
[0030] (3-2) Configuration of the information processing device 2 in the third embodiment Next, the configuration of the information processing device 2 in the third embodiment will be described with reference to Fig. 6. Fig. 6 is a block diagram showing the configuration of the information processing device 2 in the third embodiment.
[0031] 6, the information processing device 2 includes a calculation device 21 and a storage device 22. The information processing device 2 may further include a communication device 23, an input device 24, and an output device 25. However, the information processing device 2 does not necessarily include at least one of the communication device 23, the input device 24, and the output device 25. The calculation device 21, the storage device 22, the communication device 23, the input device 24, and the output device 25 may be connected via a data bus 26.
[0032] The arithmetic device 21 may be, for example, a central processing unit (CPU), a graphics processing unit (GPU), a field programmable gate array (FPGA), a digital signal processor (DSP), Digital Signal Processing) and an ASIC (Application Specific Integrated Circuit). The arithmetic device 21 reads a computer program. For example, the arithmetic device 21 may read a computer program stored in the storage device 22. For example, the arithmetic device 21 may read a computer program stored in a computer-readable, non-transitory recording medium using a recording medium reading device (not shown) included in the information processing device 2. The arithmetic device 21 may acquire (i.e., download or read) the computer program from a device (not shown) located outside the information processing device 2 via the communication device 23 (or another communication device). The arithmetic device 21 executes the read computer program. As a result, logical functional blocks for executing operations to be performed by the information processing device 2 (for example, the above-mentioned authentication operation, particularly the authentication operation including the focus determination operation) are realized within the arithmetic device 21. In other words, the arithmetic device 21 can function as a controller for realizing logical functional blocks for executing operations (in other words, processing) to be performed by the information processing device 2.
[0033] Fig. 6 shows an example of logical functional blocks realized in the arithmetic device 21 for executing authentication operations (particularly authentication operations including a focus determination operation). As shown in Fig. 6, a region setting unit 211 which is a specific example of "setting means" described in the appendix to be described later, a focus determination unit 212 which is a specific example of "determination means" described in the appendix to be described later, and an iris authentication unit 213 which is a specific example of "authentication means" described in the appendix to be described later are realized in the arithmetic device 21. Note that the operations of the region setting unit 211, focus determination unit 212, and iris authentication unit 213 will be described in detail later with reference to Fig. 7 etc., and therefore will not be described here.
[0034] The storage device 22 can store desired data. For example, the storage device 22 may temporarily store a computer program executed by the arithmetic device 21. The storage device 22 may temporarily store data that the arithmetic device 21 temporarily uses when the arithmetic device 21 is executing a computer program. The storage device 22 may store data that the information processing device 2 stores for a long period of time. The storage device 22 may include at least one of a RAM (Random Access Memory), a ROM (Read Only Memory), a hard disk device, a magneto-optical disk device, an SSD (Solid State Drive), and a disk array device. In other words, the storage device 22 may include a non-temporary recording medium.
[0035] The communication device 23 is capable of communicating with the imaging device 1 via a communication network (not shown). In the third embodiment, the communication device 23 receives (i.e., acquires) a person image IMG (specifically, an eye image IMG_E) from the imaging device 1.
[0036] The input device 24 is a device that accepts information input to the information processing device 2 from outside the information processing device 2. For example, the input device 24 may include an operation device (for example, at least one of a keyboard, a mouse, and a touch panel) that can be operated by an operator of the information processing device 2. For example, the input device 24 may include a reading device that can read information recorded as data on a recording medium that can be externally attached to the information processing device 2.
[0037] The output device 25 is a device that outputs information to the outside of the information processing device 2. For example, the output device 25 may output information as an image. That is, the output device 25 may include a display device (a so-called display) that can display an image showing the information to be output. For example, the output device 25 may output information as sound. That is, the output device 25 may include an audio device (a so-called speaker) that can output sound. For example, the output device 25 may output information on paper. That is, the output device 25 may include a printing device (a so-called printer) that can print desired information on paper.
[0038] (3-3) Authentication Operation Performed by Information Processing Device 2 in the Third Embodiment Next, an authentication operation (particularly, an authentication operation including a focus determination operation) performed by the information processing device 2 in the third embodiment will be described with reference to Fig. 7. Fig. 7 is a flowchart showing the flow of the authentication operation (particularly, an authentication operation including a focus determination operation) performed by the information processing device 2 in the third embodiment.
[0039] 7, the information processing device 2 acquires an eye image IMG_E from the imaging device 1 (step S101). For this reason, the imaging device 1 captures an image of the target person P for at least a part of the period during which the information processing device 2 performs the authentication operation. In this case, the information processing device 2 may start the authentication operation triggered by the imaging device 1 capturing an image of the target person P (that is, triggered by the imaging device 1 transmitting the eye image IMG_E to the information processing device 2).
[0040] The imaging device 1 may capture images of the target person P at a predetermined imaging rate. That is, the imaging device 1 may continuously capture images of the target person P. For example, the imaging device 1 may capture images of the target person P at an imaging rate of capturing images of the target person P tens to hundreds of times per second. That is, the imaging device 1 may capture images of the target person P at an imaging rate of generating tens to hundreds of eye images IMG_E per second. In this case, the imaging device 1 may generate a plurality of eye images IMG_E as time-series data. The information processing device 2 may acquire a plurality of eye images IMG_E as time-series data. In the following description, an example will be described in which the information processing device 2 acquires a plurality of eye images IMG_E as time-series data.
[0041] The imaging device 1 may capture an image of the target person P during at least a portion of a period in which the positional relationship between the focal plane FP of the imaging device 1 and the target person P is changing. The focal plane FP of the imaging device 1 may refer to an optical surface that intersects (typically, is perpendicular to) the optical axis of the optical system (e.g., a lens) of the imaging device 1 and is in focus with the imaging device 1. The focal plane FP of the imaging device 1 may refer to an optical surface that intersects (typically, is perpendicular to) the optical axis of the optical system (e.g., a lens) of the imaging device 1 and is included in the range of the depth of focus of the optical system of the imaging device 1.
[0042] As an example, as shown in FIG. 8(a), when the target person P moves relative to the imaging device 1, the positional relationship between the focal plane FP and the target person P changes. In particular, when the target person P moves relative to the imaging device 1 along the optical axis of the imaging device 1 (for example, an axis extending in the Y-axis direction in FIG. 8(a)), the positional relationship between the focal plane FP and the target person P changes. Therefore, the imaging device 1 may capture an image of the target person P during at least a portion of the period during which the target person P moves relative to the imaging device 1. Note that when the target person P moves relative to the imaging device 1, the relative positional relationship between the imaging device 1 and the target person P changes. Specifically, when the target person P moves along the optical axis of the imaging device 1 relative to the imaging device 1, the relative positional relationship between the imaging device 1 and the target person P in the direction along the optical axis of the imaging device 1 changes. Therefore, the imaging device 1 may be considered to be capturing an image of the target person P during at least a portion of the period during which the relative positional relationship between the imaging device 1 and the target person P is changing.
[0043] As another example, as shown in FIG. 8(b), when the imaging device 1 moves with respect to the target person P, the positional relationship between the focal plane FP and the target person P changes. In particular, when the imaging device 1 moves with respect to the target person P along the optical axis of the imaging device 1 (for example, an axis extending in the Y-axis direction in FIG. 8(b)), the positional relationship between the focal plane FP and the target person P changes. Therefore, the imaging device 1 may capture an image of the target person P during at least a portion of the period during which the imaging device 1 moves with respect to the target person P. Note that when the imaging device 1 moves with respect to the target person P, the relative positional relationship between the imaging device 1 and the target person P changes. Specifically, when the imaging device 1 moves with respect to the target person P along the optical axis of the imaging device 1, the relative positional relationship between the imaging device 1 and the target person P in the direction along the optical axis of the imaging device 1 changes. Therefore, the imaging device 1 may be considered to be capturing an image of the target person P during at least a portion of the period during which the relative positional relationship between the imaging device 1 and the target person P changes.
[0044] As another example, if the focal length of the imaging device 1 (specifically, the focal length of the optical system of the imaging device 1) is variable, as shown in FIG. 8(c), when the focal length of the imaging device 1 changes, the focal plane FP moves relative to the target person P. In particular, the focal plane FP moves relative to the target person P along the optical axis of the imaging device 1 (for example, an axis extending in the Y-axis direction in FIG. 8(c)). This changes the positional relationship between the focal plane FP and the target person P. Therefore, the imaging device 1 may image the target person P during at least a portion of the period during which the focal length of the imaging device 1 changes. Note that an example of an imaging device 1 with a variable focal length is an imaging device that includes at least one of a zoom lens and a variable-focus lens as at least a part of its optical system.
[0045] 7, area setting unit 211 sets a focus evaluation area FA in eye image IMG_E acquired in step S101 (step S102). The focus evaluation area FA is an area used to evaluate the degree of focus of iris area IA. As described above, an eye image IMG_E in which iris area IA is in focus is determined to be an in-focus image, and therefore, the focus evaluation area FA may be considered to be an area used to determine whether or not eye image IMG_E is an in-focus image.
[0046] An example of the focus evaluation area FA is shown in Fig. 9. As shown in Fig. 9, the area setting section 211 may set the focus evaluation area FA such that at least a portion of the focus evaluation area FA is included in the iris area IA. In other words, the area setting section 211 may set the focus evaluation area FA such that the focus evaluation area FA includes at least a portion of the iris area IA. When the focus evaluation area FA includes at least a portion of the iris area IA, the information processing device 2 can use the focus evaluation area FA to appropriately determine whether or not the eye image IMG_E is a focused image.
[0047] The region setting unit 211 may set the focus evaluation area FA so that it includes both at least a portion of the iris region IA and an area other than the iris region IA. Even in this case, as long as the focus evaluation area FA includes at least a portion of the iris region IA, the information processing device 2 can appropriately determine whether the eye image IMG_E is a focused image using the focus evaluation area FA. However, in this case, it is preferable that the proportion of the iris region IA in the focus evaluation area FA is larger than the proportion of the area other than the iris region IA in the focus evaluation area FA. In this case, the information processing device 2 can appropriately determine whether the eye image IMG_E is a focused image using the focus evaluation area FA, compared to when the proportion of the iris region IA in the focus evaluation area FA is smaller than the proportion of the area other than the iris region IA in the focus evaluation area FA.
[0048] Alternatively, as will be described in a fourth embodiment below, region setting unit 211 may set focus evaluation region FA so that focus evaluation region FA includes at least a portion of iris region IA but does not include any region different from iris region IA. In this case, information processing device 2 can use focus evaluation region FA to more appropriately determine whether eye image IMG_E is a focused image.
[0049] The size of the focus evaluation area FA may be any size. However, if the size of the focus evaluation area FA is excessively large, the computational cost required for the focus determination operation, which uses the focus evaluation area FA to determine whether the eye image IMG_E is a focused image, may become excessively high. On the other hand, if the size of the focus evaluation area FA is excessively small, the accuracy of the focus determination operation may become excessively low. For this reason, the area setting unit 211 may set the focus evaluation area FA to a size that can achieve both a reduction in the computational cost required for the focus determination operation and an improvement in the accuracy of the focus determination operation. In other words, the area setting unit 211 may set the focus evaluation area FA to a size that can realize a state in which the computational cost required for the focus determination operation is appropriate and the accuracy of the focus determination operation is appropriate.
[0050] The shape of the focus evaluation area FA may be any size. For example, the shape of the focus evaluation area FA may be rectangular. In this case, the computational cost required to calculate the focus evaluation value (described later) is lower than when the shape of the focus evaluation area FA is a complex shape other than a rectangle. This is because processing a rectangular image is simpler than processing an image with a complex shape other than a rectangle. However, the shape of the focus evaluation area FA may be a shape other than a rectangle. For example, the shape of the focus evaluation area FA may be polygonal. For example, the shape of the focus evaluation area FA may be circular or elliptical. For example, the shape of the focus evaluation area FA may be annular. If the shape of the focus evaluation area FA is annular, the shape of the focus evaluation area FA may be the same as the shape of the iris area IA. If the shape of the focus evaluation area FA is the same as the shape of the iris area IA, the focus evaluation area FA may include the entire iris area IA. In other words, the focus evaluation area FA may coincide with the iris area IA.
[0051] The iris region IA may be an annular region bounded by the inner contour of the iris (i.e., the contour of the pupil) and the outer contour of the iris. Preferably, the iris region IA may be a region obtained by excluding the region where the iris is hidden by the eyelid from the annular region bounded by the inner contour of the iris (i.e., the contour of the pupil) and the outer contour of the iris.
[0052] As described above, in step S101, information processing device 2 acquires a plurality of eye images IMG_E as time-series data. In this case, region setting unit 211 sets a focus evaluation area FA in each of the plurality of eye images IMG_E. For example, region setting unit 211 may set the focus evaluation area FA at the same position in each of the plurality of eye images IMG_E. That is, region setting unit 211 may set the focus evaluation area FA at a first coordinate position in a first eye image IMG_E, set the focus evaluation area FA at a second coordinate position that is the same as the first coordinate position in a second eye image IMG_E, and so on, set the focus evaluation area FA at an N-th coordinate position that is the same as the first to N-1-th coordinate positions in an N-th eye image IMG_E (note that N is a variable indicating the total number of eye images IMG_E acquired in step S101). Alternatively, for example, region setting unit 211 may set focus evaluation areas FA at at least two different positions in the multiple eye images IMG_E. As an example, region setting unit 211 may set focus evaluation areas FA at a first coordinate position in a first eye image IMG_E, and set focus evaluation areas FA at a second coordinate position different from the first coordinate position in a second eye image IMG_E.
[0053] 7, thereafter, focus determination unit 212 calculates a focus evaluation value for eye image IMG_E using focus evaluation area FA set in step S102 (step S103). The focus evaluation value is an evaluation parameter used to evaluate the degree of focus of iris area IA included in eye image IMG_E. As described above, eye image IMG_E in which iris area IA is in focus is determined to be an in-focus image, and therefore the focus evaluation value may be considered to be an evaluation parameter used to determine whether eye image IMG_E is an in-focus image.
[0054] The focus evaluation value may be any evaluation parameter as long as it is capable of evaluating the degree of focus of the iris area IA. For example, the focus evaluation value may be an evaluation parameter based on the pixel values of multiple pixels included in the focus evaluation area FA. An example of the pixel value is a luminance value.
[0055] In the third embodiment, an example will be described in which the variance of the luminance values of multiple pixels included in the focus evaluation area FA is used as the focus evaluation value. Below, we will explain why the variance of the luminance values of multiple pixels included in the focus evaluation area FA can be used to evaluate the focus degree of the iris area IA. In the following explanation, the "variance of the luminance values of multiple pixels included in the focus evaluation area FA" will be referred to as the "focus evaluation value (variance)." When the eye image IMG_E is a focused image, the eyes (particularly the iris) of the target person P are clearly reflected in the eye image IMG_E. In other words, the eyes (particularly the iris) of the target person P are reflected in the eye image IMG_E with a relatively high contrast. For this reason, the variation in the luminance values of multiple pixels included in the focus evaluation area FA becomes relatively large. As a result, the focus evaluation value (variance) becomes relatively large. On the other hand, if the eye image IMG_E is not a focused image, the eyes (particularly the irises) of the target person P appear blurred or blurred in the eye image IMG_E. In other words, the eyes (particularly the irises) of the target person P appear in the eye image IMG_E with relatively low contrast. This results in a relatively small variation in the brightness values of the multiple pixels included in the focus evaluation area FA. As a result, the focus evaluation value (variance) becomes relatively small. Therefore, the focus evaluation value (variance) of the eye image IMG_E, which is a focused image, is larger than the focus evaluation value (variance) of the eye image IMG_E, which is not a focused image. For this reason, the focus evaluation value (variance) can be used as an evaluation parameter capable of determining whether the eye image IMG_E is a focused image.
[0056] As described above, in step S101, information processing device 2 acquires multiple eye images IMG_E as time-series data. In this case, focus determination unit 212 calculates the focus evaluation value (variance) of each of the multiple eye images IMG_E. That is, focus determination unit 212 may calculate the focus evaluation value (variance) of the first eye image IMG_E using a focus evaluation area FA set in the first eye image IMG_E, calculate the focus evaluation value (variance) of the second eye image IMG_E using a focus evaluation area FA set in the second eye image IMG_E,..., calculate the focus evaluation value (variance) of the Nth eye image IMG_E using a focus evaluation area FA set in the Nth eye image IMG_E.
[0057] Thereafter, based on the focus evaluation value (variance) calculated in step S103, focus determination unit 212 determines whether or not the eye image IMG_E acquired in step S101 is an in-focus image (step S104). As described above, in step S101, information processing device 2 acquires a plurality of eye images IMG_E as time-series data. Therefore, in step S104, focus determination unit 212 identifies at least one eye image IMG_E that is an in-focus image from among the plurality of eye images IMG_E acquired in step S101.
[0058] The focus determination unit 212 may determine that the eye image IMG_E whose focus evaluation value (variance) satisfies a predetermined focus determination condition is a focused image. The focus determination unit 212 may determine that the eye image IMG_E whose focus evaluation value (variance) does not satisfy a predetermined focus determination condition is not a focused image.
[0059] As an example, as described above, when the eye image IMG_E is a focused image, the focus evaluation value (variance) becomes relatively large. Therefore, the focus determination unit 212 may use, as the predetermined focus determination condition, a first focus determination condition that the focus evaluation value (variance) is greater than a predetermined threshold value TH, as shown in FIG. 10(a), which is a graph showing the focus evaluation values (variances) of multiple eye images IMG_E. In this case, the focus determination unit 212 may determine that the eye image IMG_E whose focus evaluation value (variance) is greater than the predetermined threshold value TH is a focused image. The focus determination unit 212 may determine that the eye image IMG_E whose focus evaluation value (variance) is smaller than the predetermined threshold value TH is not a focused image. The focus determination unit 212 may identify, from the multiple eye images IMG_E acquired in step S101, at least one eye image IMG_E whose focus evaluation value (variance) is greater than the predetermined threshold value TH as a focused image.
[0060] The predetermined threshold value TH used in the first focus determination condition may be set to an appropriate value that enables an eye image IMG_E that can be considered to be a focused image to be distinguished from an eye image IMG_E that cannot be considered to be a focused image based on the focus evaluation value (variance). The predetermined threshold value TH may be set to a value obtained by multiplying the maximum value of the focus evaluation values (variance) of the multiple eye images IMG_E acquired in step S101 by a predetermined coefficient that is greater than 0 and less than 1. The predetermined threshold value TH may be a fixed value. The predetermined threshold value TH may be changeable. The predetermined threshold value TH may be set by a user of the information processing device 2.
[0061] The focusing determination unit 212 may change the predetermined threshold value TH based on the number of eye images IMG_E identified as in-focus images. For example, if the number of eye images IMG_E identified as in-focus images exceeds a predetermined upper limit, the focusing determination unit 212 may change the predetermined threshold value TH so that the predetermined threshold value TH becomes larger. As a result, the number of eye images IMG_E identified as in-focus images decreases compared to before the predetermined threshold value TH was changed, and it is expected that the number of eye images IMG_E identified as in-focus images will become a number below the predetermined upper limit (i.e., an appropriate number).
[0062] As another example, the focus determination unit 212 may use, as the predetermined focus determination condition, a second focus condition in which the focus evaluation value (variance) is maximized, as shown in FIG. 10(b), which is a graph showing the focus evaluation values (variance) of multiple eye images IMG_E. In this case, the focus determination unit 212 may determine that the eye image IMG_E with the maximized focus evaluation value (variance) is the focused image. The focus determination unit 212 may determine that the eye image IMG_E with the least maximized focus evaluation value (variance) is not the focused image. The focus determination unit 212 may identify, from the multiple eye images IMG_E acquired in step S101, one eye image IMG_E with the maximized focus evaluation value (variance) as the focused image.
[0063] The operations including the processes from step S102 to step S104 described above correspond to the focus determination operation, which is part of the authentication operation.
[0064] Returning to FIG. 7, thereafter, the iris authentication unit 213 authenticates the target person P using the eye image IMG_E determined to be the in-focus image in step S104 (step S105).
[0065] If it is determined in step S104 that each of the multiple eye images IMG_E is an in-focus image, the iris authentication unit 213 may authenticate the target person P using at least one of the multiple eye images IMG_E determined to be an in-focus image. For example, the iris authentication unit 213 may select one eye image IMG_E from the multiple eye images IMG_E determined to be in-focus images randomly or based on a predetermined selection criterion. Then, the iris authentication unit 213 may authenticate the target person P using the selected one eye image IMG_E. For example, the iris authentication unit 213 may select at least two eye images IMG_E from the multiple eye images IMG_E determined to be in-focus images randomly or based on a predetermined selection criterion. Then, the iris authentication unit 213 may authenticate the target person P using the at least two selected eye images IMG_E. As one example, the iris authentication unit 213 may determine that authentication of the target person P has been successful when at least one of at least two authentication attempts using the at least two selected eye images IMG_E is successful. As another example, the iris authentication unit 213 may determine that authentication of the target person P has been successful when all of at least two authentication attempts using the at least two selected eye images IMG_E are successful.
[0066] (3-4) Technical Effects of the Authentication System SYS of the Third Embodiment As described above, the information processing device 2 in the third embodiment uses the focus evaluation value (variance) to determine whether the eye image IMG_E is a focused image. Therefore, the information processing device 2 can determine whether the eye image IMG_E is a focused image with higher accuracy than when a focus evaluation value different from the focus evaluation value (variance) is used to determine whether the eye image IMG_E is a focused image. This is because, as described above, the focus evaluation value (variance) of the eye image IMG_E, which is a focused image, is larger than the focus evaluation value (variance) of the eye image IMG_E, which is not a focused image. Therefore, the information processing device 2 can solve the technical problem of reduced accuracy in determining whether the eye image IMG_E is a focused image.
[0067] Furthermore, when determining whether the eye image IMG_E is a focused image using the focus evaluation value (variance), even if the size of the focus evaluation area FA becomes correspondingly smaller, the information processing device 2 can determine with high accuracy whether the eye image IMG_E is a focused image. This is because even if the size of the focus evaluation area FA becomes smaller, the focus evaluation value (variance) of the eye image IMG_E, which is a focused image, remains larger than the focus evaluation value (variance) of the eye image IMG_E, which is not a focused image.
[0068] The smaller the size of the focus evaluation area FA, the lower the calculation cost required to calculate the focus evaluation value (variance). Therefore, the information processing device 2 can determine whether the eye image IMG_E is a focused image with low calculation cost compared to when a focus evaluation value other than the focus evaluation value (variance) is used to determine whether the eye image IMG_E is a focused image. Therefore, the information processing device 2 can solve the technical problem of high calculation cost for determining whether the eye image IMG_E is a focused image.
[0069] Furthermore, the smaller the size of the focus evaluation area FA, the shorter the time required to calculate the focus evaluation value (variance). Therefore, the information processing device 2 can determine whether the eye image IMG_E is a focused image at high speed compared to when a focus evaluation value other than the focus evaluation value (variance) is used to determine whether the eye image IMG_E is a focused image. Therefore, the information processing device 2 can solve the technical problem of the long time required to determine whether the eye image IMG_E is a focused image.
[0070] Furthermore, in the third embodiment, information processing device 2 may use a first focus determination condition that the focus evaluation value (variance) is greater than a predetermined threshold value TH as the focus determination condition for determining whether eye image IMG_E is a focused image. In this case, information processing device 2 can appropriately determine whether eye image IMG_E is a focused image.
[0071] Furthermore, in the third embodiment, the information processing device 2 may use a second focus determination condition, that is, the focus evaluation value (variance) is maximized, as the focus determination condition for determining whether the eye image IMG_E is a focused image. In this case, the information processing device 2 can appropriately determine whether the eye image IMG_E is a focused image. In particular, the information processing device 2 can narrow down the multiple eye images IMG_E to one eye image IMG_E that is likely to be a focused image.
[0072] Furthermore, in the third embodiment, the imaging device 1 may capture an image of the target person P during at least a part of a period in which the positional relationship between the focal plane FP of the imaging device 1 and the target person P is changing. In this case, the imaging device 1 can generate a plurality of eye images IMG_E with different focus evaluation values (variances). Therefore, the information processing device 2 can appropriately acquire at least one eye image IMG_E that corresponds to a focused image from the plurality of eye images IMG_E with different focus evaluation values (variances).
[0073] Furthermore, in the third embodiment, a period during which the relative positional relationship between the imaging device 1 and the target person P is changing may be used as the period during which the positional relationship between the focal plane FP of the imaging device 1 and the target person P is changing. In this case, if the imaging device 1 moves, the positional relationship between the focal plane FP of the imaging device 1 and the target person P changes. Therefore, the imaging device 1 can relatively easily change the positional relationship between the focal plane FP of the imaging device 1 and the target person P. Furthermore, if the target person P moves, the positional relationship between the focal plane FP of the imaging device 1 and the target person P changes. Therefore, the target person P can relatively easily change the positional relationship between the focal plane FP of the imaging device 1 and the target person P.
[0074] Furthermore, in the third embodiment, a period during which the focal length of the imaging device 1 is changing may be used as the period during which the positional relationship between the focal plane FP of the imaging device 1 and the target person P is changing. In this case, at least one of the imaging device 1 and the target person P does not necessarily have to move in order to change the positional relationship between the focal plane FP of the imaging device 1 and the target person P. Therefore, the imaging device 1 can change the positional relationship between the focal plane FP of the imaging device 1 and the target person P relatively easily.
[0075] (3-4) Modification of the authentication system SYS of the third embodiment (3-4-1) First Modification In the above description, the focus evaluation value (variance) is the variance of the luminance values of multiple pixels included in the focus evaluation area FA. In other words, the focus evaluation value (variance) is the variance of the luminance values of all pixels included in the focus evaluation area FA. However, the variance of the luminance values of multiple pixels corresponding to a portion of all pixels included in the focus evaluation area FA may also be used as the focus evaluation value (variance). In this case, the information processing device 2 can calculate the focus evaluation value (variance) at a lower calculation cost than when the variance of the luminance values of all pixels included in the focus evaluation area FA is calculated as the focus evaluation value (variance). In other words, the information processing device 2 can perform the focus determination operation at a lower calculation cost.
[0076] As one example, the information processing device 2 may calculate, as the focus evaluation value (variance), the variance of the luminance values of a plurality of pixels corresponding to a portion of pixels randomly selected from all pixels included in the focus evaluation area FA. As another example, the information processing device 2 may calculate, as the focus evaluation value (variance), the variance of the luminance values of a plurality of pixels corresponding to a portion of pixels selected based on a predetermined pixel selection criterion from all pixels included in the focus evaluation area FA. For example, the information processing device 2 may calculate, as the focus evaluation value (variance), the variance of the luminance values of a plurality of pixels included in the upper half of the focus evaluation area FA. For example, the information processing device 2 may calculate, as the focus evaluation value (variance), the variance of the luminance values of a plurality of pixels included in the lower half of the focus evaluation area FA. For example, the information processing device 2 may calculate, as the focus evaluation value (variance), the variance of the luminance values of a plurality of pixels selected based on a pixel selection criterion that selects one pixel from each pixel block including P (where P is a variable indicating an integer greater than or equal to 2) pixels arranged along at least one of the row and column directions in the focus evaluation area FA.
[0077] In the above description, in step S102 of Fig. 7, information processing device 2 sets a focus evaluation area FA for each of the plurality of eye images IMG_ acquired in step S101. That is, in step S103 of Fig. 7, information processing device 2 calculates a focus evaluation value (variance) for each of the plurality of eye images IMG_ acquired in step S101. However, in step S102 of Fig. 7, information processing device 2 may set a focus evaluation area FA for some of the plurality of eye images IMG_ acquired in step S101, while not setting a focus evaluation area FA for the remaining portion of the plurality of eye images IMG_ acquired in step S101. That is, in step S102 of Fig. 7, information processing device 2 may calculate a focus evaluation value (variance) for some of the plurality of eye images IMG_ acquired in step S101, while not calculating a focus evaluation value (variance) for the remaining portion of the plurality of eye images IMG_ acquired in step S101. The information processing device 2 may calculate the focus evaluation value (variance) of one eye image IMG_E, but may not calculate the focus evaluation value (variance) of the other eye images IMG_E. In this case, the information processing device 2 can calculate the focus evaluation value (variance) at a lower calculation cost than when a focus evaluation area FA is set for all of the multiple eye images IMG_ and the focus evaluation values (variance) of all of the multiple eye images IMG_ are calculated. In other words, the information processing device 2 can perform the focus determination operation at a lower calculation cost.
[0078] As one example, the information processing device 2 may set a focus evaluation area FA in some eye images IMG_E that are randomly selected from the plurality of eye images IMG_E, while not setting a focus evaluation area FA in the remaining unselected eye images IMG_E. As another example, the information processing device 2 may set a focus evaluation area FA in some eye images IMG_E that are selected from the plurality of eye images IMG_E based on predetermined image selection criteria, while not setting a focus evaluation area FA in the remaining unselected eye images IMG_E. For example, if the similarity between one eye image IMG_E and the other eye images IMG_E is equal to or greater than a predetermined value, the information processing device 2 may set a focus evaluation area FA in the one eye image IMG_E, while not setting a focus evaluation area FA in the other eye images IMG_E. For example, the information processing device 2 may set a focus evaluation area FA for an eye image IMG_E selected based on an image selection criterion of selecting one eye image IMG_E for each image block containing Q (where Q is a variable indicating an integer greater than or equal to 2) eye images IMG_E that are consecutive in time series, while not setting a focus evaluation area FA for the remaining unselected eye images IMG_E.
[0079] (3-4-2) Second Modification In the above description, the variance of the luminance values of the multiple pixels included in the focus evaluation area FA is used as the focus evaluation value. However, an evaluation parameter other than the variance of the luminance values of the multiple pixels included in the focus evaluation area FA may be used as the focus evaluation value.
[0080] As an example, the contrast of the focus evaluation area FA (i.e., the ratio between the maximum brightness value and the minimum brightness value) may be used as the focus evaluation value. The contrast of the focus evaluation area FA when the eye image IMG_E is an in-focus image will be higher than the contrast of the focus evaluation area FA when the eye image IMG_E is not an in-focus image. Therefore, the contrast of the focus evaluation area FA can be used as an evaluation parameter that can determine whether the eye image IMG_E is an in-focus image.
[0081] As another example, an evaluation parameter related to an edge detected by extracting high-frequency components from the spatial frequency components included in the focus evaluation area FA may be used as the focus evaluation value. The width of the edge when the eye image IMG_E is an in-focus image will be narrower than the width of the edge when the eye image IMG_E is not an in-focus image. Alternatively, if the eye image IMG_E is not an in-focus image, the edge may not be detected. For this reason, the evaluation parameter related to the edge can be used as an evaluation parameter capable of determining whether the eye image IMG_E is an in-focus image.
[0082] (3-4-3) Third Modification In the above description, the information processing device 2 includes the iris authentication unit 213. However, the information processing device 2 does not have to include the iris authentication unit 213. In other words, the information processing device 2 does not have to authenticate the target person P. In this case, the information processing device 2 may transmit (in other words, output) the eye image IMG_E determined to be a focused image to another information processing device for authenticating the target person P (or any target). The other information processing device may receive (in other words, acquire) the eye image IMG_E transmitted from the information processing device 2, and use the received eye image IMG_E to authenticate the target person P (or any target).
[0083] (3-4-4) Fourth Modification In the above description, the imaging device 1 captures an image of the eyes of the target person P to generate an eye image IMG_E in which the eyes of the target person P are captured as part of the body of the target person P as the person image IMG. In a fourth modified example, in addition to or instead of the eye image IMG_E, the imaging device 1 may capture an image of the face of the target person P to generate a face image in which the face of the target person P is captured as part of the body of the target person P as the person image IMG. In this case, the information processing device 2 may perform an authentication operation related to face authentication. Specifically, the information processing device 2 may identify a face region including the face of the target person P from the face image. The information processing device 2 may extract facial features from the identified facial region. The information processing device 2 may authenticate the target person P based on the extracted facial features.
[0084] Furthermore, the information processing device 2 may perform a focus determination operation to determine whether or not the face image is a focused image in which the face area is in focus. Even in this case, the information processing device 2 may perform an operation similar to the focus determination operation shown in FIG. 7. For example, the information processing device 2 may set a focus evaluation area FA in the face image (step S102 in FIG. 7). The focus evaluation area FA set in the face image is an area used to determine whether or not the face image is a focused image. The information processing device 2 may set the focus evaluation area FA so that at least a portion of the focus evaluation area FA is included in the face area. Thereafter, the information processing device 2 may calculate a focus evaluation value of the face image using the focus evaluation area FA (step S103 in FIG. 7). The focus evaluation value of the face image is an evaluation parameter used to determine whether or not the face image is a focused image. As with the focus evaluation value of the eye image IMG_E, the variance of the luminance values of multiple pixels included in the focus evaluation area FA may be used as the focus evaluation value of the face image. Thereafter, the information processing device 2 may determine whether or not the face image is a focused image based on the focus evaluation value (variance) (step S104 in FIG. 7). In this case, similar to the case of determining whether or not the eye image IMG_E is a focused image, the information processing device 2 may determine that a face image whose focus evaluation value (variance) satisfies the above-mentioned predetermined focus determination condition is a focused image. The information processing device 2 may authenticate the target person P using the face image determined to be a focused image by the focus determination operation.
[0085] The information processing device 2 may authenticate the target person P using both the eye image IMG_E and the face image. That is, the information processing device 2 may perform multimodal authentication. In this case, the information processing device 2 may separately perform a first focus determination operation for determining whether the eye image IMG_E is a focused image and a second focus determination operation for determining whether the face image is a focused image. In this case, the information processing device 2 may perform iris authentication of the target person P using the eye image IMG_E determined to be a focused image by the first focus determination operation, and perform face authentication of the target person P using the face image determined to be a focused image by the second focus determination operation. Alternatively, the information processing device 2 may perform the second focus determination operation for determining whether the face image is a focused image, but may not perform the first focus determination operation for determining whether the eye image IMG_E is a focused image. In this case, the information processing device 2 may perform face authentication of the target person P using the face image determined to be a focused image by the second focus determination operation. Furthermore, the information processing device 2 may extract an eye image IMG_E from the face image determined to be a focused image by the second focus determination operation, and perform iris authentication of the target person P using the extracted eye image IMG_E.
[0086] (4) Fourth embodiment Next, a fourth embodiment of an information processing device, an information processing method, and a recording medium will be described. Hereinafter, the fourth embodiment of the information processing device, the information processing method, and the recording medium will be described using an authentication system SYSb to which the fourth embodiment of the information processing device, the information processing method, and the recording medium is applied.
[0087] The authentication system SYSb in the fourth embodiment differs from the authentication system SYS in the third embodiment in that the method for setting the focus evaluation area FA by the information processing device 2 (focus determination unit 212) is different. Other features of the authentication system SYSb in the fourth embodiment may be the same as other features of the authentication system SYS in the third embodiment. Therefore, hereinafter, the focus evaluation area FA set by the information processing device 2 (focus determination unit 212) in the fourth embodiment will be described with reference to FIGS. 11(a) to 11(d). Each of FIGS. 11(a) to 11(d) shows the focus evaluation area FA set by the information processing device 2 (focus determination unit 212) in the fourth embodiment.
[0088] Fig. 11(a) shows a first setting method for the focus evaluation area FA in the fourth embodiment. As shown in Fig. 11(a), the focus determination unit 212 may set the focus evaluation area FA in an area different from the pupil area PA that includes the pupil of the target person P. In other words, the focus determination unit 212 may set the focus evaluation area FA so that the focus evaluation area FA does not include the pupil area PA. In other words, the focus determination unit 212 may set the focus evaluation area FA so that the focus evaluation area FA does not overlap with the pupil area PA.
[0089] In this case, the information processing device 2 calculates the focus evaluation value using the focus evaluation area FA that does not include the pupil area PA. That is, the information processing device 2 determines whether the eye image IMG_E is a focused image using the focus evaluation area FA that does not include the pupil area PA. Therefore, the information processing device 2 can determine whether the eye image IMG_E is a focused image with higher accuracy than when determining whether the eye image IMG_E is a focused image using the focus evaluation area FA that includes the pupil area PA. This is because the pupil area PA is generally much darker than the iris area IA. Therefore, if the focus evaluation area FA includes the pupil area PA, the focus evaluation value may unintentionally fluctuate due to the pupil area PA being included in the focus evaluation area FA. For example, the focus evaluation value calculated from the focus evaluation area FA that is set for the eye image IMG_E, which is a focused image, and that includes the pupil area PA, may be close to the focus evaluation value calculated from the focus evaluation area FA that is set for the eye image IMG_E, which is a non-focused image. As a result, the eye image IMG_E, which is a focused image, may be erroneously determined to be an unfocused image. For example, the focus evaluation value calculated from the focus evaluation area FA set for the unfocused eye image IMG_E and including the pupil area PA may be close to the focus evaluation value calculated from the focus evaluation area FA set for the focused eye image IMG_E. As a result, the unfocused eye image IMG_E may be erroneously determined to be an in-focus image. This may result in a technical problem of reduced accuracy in determining whether the eye image IMG_E is a focused image. However, if a focus evaluation area FA that does not include the pupil area PA is set, the technical problem of reduced accuracy in determining whether the eye image IMG_E is a focused image due to the pupil area PA being included in the focus evaluation area FA does not occur. Therefore, the information processing device 2 can accurately determine whether the eye image IMG_E is a focused image. In other words, the information processing device 2 can solve the technical problem of reduced accuracy in the focus determination operation.
[0090] 11(b) shows a second setting method for the focus evaluation area FA in the fourth embodiment. As shown in FIG. 11(b), the focus determination unit 212 may set the focus evaluation area FA in an area different from the reflection area RA that includes a reflected image of light incident on the eyes of the target person P. In other words, the focus determination unit 212 may set the focus evaluation area FA so that it does not include the reflection area RA. In other words, the focus determination unit 212 may set the focus evaluation area FA so that it does not overlap with the reflection area RA. Note that an example of light incident on the eyes of the target person P is at least one of ambient light and illumination light, which will be described in a seventh embodiment below.
[0091] In this case, the information processing device 2 calculates the focus evaluation value using the focus evaluation area FA that does not include the reflection area RA. That is, the information processing device 2 determines whether the eye image IMG_E is a focused image using the focus evaluation area FA that does not include the reflection area RA. Therefore, the information processing device 2 can determine whether the eye image IMG_E is a focused image with higher accuracy than when determining whether the eye image IMG_E is a focused image using the focus evaluation area FA that includes the reflection area RA. This is because the reflection area RA is generally much brighter than the iris area IA. Therefore, if the focus evaluation area FA includes the reflection area RA, the focus evaluation value may unintentionally fluctuate due to the inclusion of the reflection area RA, which is much brighter than the iris area IA. The reason for this is the same as the reason why the focus evaluation value may unintentionally fluctuate due to the inclusion of the pupil area PA in the focus evaluation area FA. As a result, a technical problem may arise in which the accuracy of determining whether the eye image IMG_E is a focused image decreases. However, when a focus evaluation area FA that does not include the reflection area RA is set, the technical problem of reduced accuracy in determining whether the eye image IMG_E is a focused image due to the reflection area RA being included in the focus evaluation area FA does not occur. Therefore, the information processing device 2 can determine with high accuracy whether the eye image IMG_E is a focused image. In other words, the information processing device 2 can solve the technical problem of reduced accuracy in the focus determination operation.
[0092] The focus determination unit 212 may identify (i.e., detect) the reflective area RA based on the luminance values (e.g., their average values) of pixels included in the sclera area SA, which includes the sclera (the so-called white of the eye) of the target person P. Specifically, the luminance values of pixels included in the sclera area SA are generally higher than the luminance values of pixels included in the iris area IA. Therefore, if an area in the iris area IA has a luminance value equal to or higher than the luminance values of pixels included in the sclera area SA, the area is likely not the iris area IA (e.g., it is a reflective area RA). Therefore, if an area of a certain size in the iris area IA has a luminance value equal to or higher than the luminance values of pixels included in the sclera area SA, the focus determination unit 212 may identify the area as the reflective area RA. As a result, the focus determination unit 212 can appropriately identify the reflective area RA.
[0093] Fig. 11(c) shows a third setting method for the focus evaluation area FA in the fourth embodiment. As shown in Fig. 11(c), the focus determination unit 212 may set the focus evaluation area FA in an area different from the eyelash area LA that includes the eyelashes of the target person P. In other words, the focus determination unit 212 may set the focus evaluation area FA so that the focus evaluation area FA does not include the eyelash area LA. In other words, the focus determination unit 212 may set the focus evaluation area FA so that the focus evaluation area FA does not overlap with the eyelash area LA.
[0094] In this case, the information processing device 2 calculates the focus evaluation value using the focus evaluation area FA that does not include the eyelash region LA. That is, the information processing device 2 determines whether the eye image IMG_E is a focused image using the focus evaluation area FA that does not include the eyelash region LA. Therefore, the information processing device 2 can determine whether the eye image IMG_E is a focused image with higher accuracy than when determining whether the eye image IMG_E is a focused image using the focus evaluation area FA that includes the eyelash region LA. This is because the eyelash region LA is generally much darker than the iris region IA. Therefore, if the focus evaluation area FA includes the eyelash region LA, the focus evaluation value may unintentionally fluctuate due to the inclusion of the eyelash region LA, which is much darker than the iris region IA. This is the same reason why the focus evaluation value may unintentionally fluctuate due to the inclusion of the pupil region PA in the focus evaluation area FA. As a result, a technical problem may arise in which the accuracy of determining whether the eye image IMG_E is a focused image decreases. However, when a focus evaluation area FA that does not include the eyelash area LA is set, the technical problem of reduced accuracy in determining whether the eye image IMG_E is a focused image due to the inclusion of the eyelash area LA in the focus evaluation area FA does not occur. Therefore, the information processing device 2 can determine with high accuracy whether the eye image IMG_E is a focused image. In other words, the information processing device 2 can solve the technical problem of reduced accuracy in the focus determination operation.
[0095] 11(d) shows a fourth setting method for the focus evaluation area FA in the fourth embodiment. As shown in FIG. 11(d), the focus determination unit 212 may set the focus evaluation area FA in a lower area DA, which corresponds to the lower half of the iris area IA. The lower area DA may refer to the area below a horizontal line CL that passes through the center of the iris area IA (i.e., the center of the pupil area PA).
[0096] The lower area DA is unlikely to include the upper eyelashes of the target person P. Furthermore, because human lower eyelashes extend downward (or droop), the lower area DA is unlikely to include the lower eyelashes of the target person P. For this reason, when the focus evaluation area FA is set in the lower area DA of the iris area IA, the eyelash area LA described in FIG. 11(c) is more likely not to be included in the focus evaluation area FA than when the focus evaluation area FA is set in an area of the iris area IA other than the lower area DA. Therefore, the information processing device 2 can determine with high accuracy whether the eye image IMG_E is a focused image.
[0097] The focus determination unit 212 may set the focus evaluation area FA by using at least two of the first to fourth setting methods in combination. For example, the focus determination unit 212 may use the first and second setting methods to set the focus evaluation area FA in an area different from both the pupil area PA and the reflection area RA. That is, the focus determination unit 212 may set a focus evaluation area FA that does not include both the pupil area PA and the reflection area RA. The focus determination unit 212 may set a focus evaluation area FA that does not overlap with both the pupil area PA and the reflection area RA. When the focus evaluation area FA is set by using at least two of the first to fourth setting methods in combination in this way, the information processing device 2 can more accurately determine whether the eye image IMG_E is a focused image than when the focus evaluation area FA is set by using only one of the first to fourth setting methods.
[0098] (5) Fifth embodiment Next, a fifth embodiment of an information processing device, an information processing method, and a recording medium will be described. Hereinafter, the fifth embodiment of the information processing device, the information processing method, and the recording medium will be described using an authentication system SYSc to which the fifth embodiment of the information processing device, the information processing method, and the recording medium is applied.
[0099] The authentication system SYSc in the fifth embodiment differs from at least one of the authentication systems SYS in the third embodiment to SYSb in the fourth embodiment in that the information processing device 2 (focus determination unit 212) may set multiple focus evaluation areas FA. For example, Fig. 12 shows an example in which the focus determination unit 212 sets two focus evaluation areas FA (specifically, a first focus evaluation area FA#1 and a second focus evaluation area FA#2). Other features of the authentication system SYSc in the fifth embodiment may be the same as other features of at least one of the authentication systems SYS in the third embodiment to SYSb in the fourth embodiment.
[0100] When multiple focus evaluation areas FA are set, focus determination section 212 may use the multiple focus evaluation areas FA to calculate multiple focus evaluation values for eye image IMG_E, respectively. In the example shown in Fig. 12, focus determination section 212 may use first focus evaluation area FA#1 to calculate a first focus evaluation value for eye image IMG_E, and may use second focus evaluation area FA#2 to calculate a second focus evaluation value for eye image IMG_E.
[0101] Thereafter, the focus determination unit 212 may determine whether the eye image IMG_E is a focused image based on the multiple focus evaluation values. For example, the focus determination unit 212 may determine that the eye image IMG_E is a focused image if at least one focus evaluation value satisfies the above-described focus determination condition. On the other hand, for example, the focus determination unit 212 may determine that the eye image IMG_E is not a focused image if all of the multiple focus evaluation values do not satisfy the focus determination condition. Alternatively, for example, the focus determination unit 212 may determine that the eye image IMG_E is a focused image if all of the multiple focus evaluation values satisfy the above-described focus determination condition. On the other hand, for example, the focus determination unit 212 may determine that the eye image IMG_E is not a focused image if at least one focus evaluation value does not satisfy the focus determination condition.
[0102] The focus determination unit 212 may determine whether the eye image IMG_E is a focused image based on a statistical value of a plurality of focus evaluation values. Examples of the statistical value include at least one of a simple average value, a weighted average value, a maximum value, a minimum value, an average value, and a mode value. In this case, the focus determination unit 212 may determine that the eye image IMG_E is a focused image if the statistical value of the plurality of focus evaluation values satisfies the above-mentioned focus determination condition. On the other hand, the focus determination unit 212 may determine that the eye image IMG_E is not a focused image if the statistical value of the plurality of focus evaluation values does not satisfy the above-mentioned focus determination condition.
[0103] As described above, information processing device 2 in the fifth embodiment can determine whether or not eye image IMG_E is a focused image based on a plurality of focus evaluation values. Therefore, information processing device 2 can determine whether or not eye image IMG_E is a focused image with higher accuracy.
[0104] (6) Sixth embodiment Next, a sixth embodiment of an information processing device, an information processing method, and a recording medium will be described. Hereinafter, the sixth embodiment of the information processing device, the information processing method, and the recording medium will be described using an authentication system SYSd to which the sixth embodiment of the information processing device, the information processing method, and the recording medium is applied.
[0105] The authentication system SYSd in the sixth embodiment differs from at least one of the authentication systems SYS in the third embodiment to SYSc in the fifth embodiment in that the imaging range of the imaging device 1 is changeable. Other features of the authentication system SYSd in the sixth embodiment may be the same as other features of at least one of the authentication systems SYS in the third embodiment to SYSc in the fifth embodiment.
[0106] For example, the imaging device 1 may be able to change the imaging range so that the imaging range moves in the vertical direction, as shown in Fig. 13. For example, the imaging device 1 may be able to change the imaging range so that the imaging range moves in the horizontal direction in addition to or instead of the vertical direction.
[0107] The imaging device 1 may change the imaging range during at least a part of the period during which the target person P is imaged at a constant imaging rate. The imaging device 1 may change the imaging range before imaging the target person P. The imaging device 1 may change the imaging range after imaging the target person P.
[0108] The imaging device 1 may change the imaging range by changing the orientation of the imaging device 1. In this case, the authentication system SYSd may include a drive device (e.g., an actuator) that can move the imaging device 1 (typically, rotate it around a predetermined rotation axis) so as to change the orientation of the imaging device 1. Alternatively, if the imaging device 1 includes a mirror that can reflect light from the target person P toward an imaging element (e.g., a charge coupled device (CCD) sensor or a complementary metal oxide semiconductor (CMOS) sensor) of the imaging device 1, the imaging device 1 may change the imaging range by moving the mirror (typically, rotating it around a predetermined rotation axis).
[0109] Furthermore, if the imaging device 1 is capable of changing the imaging range, the information processing device 2 (area setting unit 211) may set the focus evaluation area FA in accordance with the change in the imaging range. Specifically, as described above, if the imaging range is changed during at least a portion of the period during which the imaging device 1 is imaging the target person P at a constant imaging rate, the positions at which the eyes of the target person P appear will change in the multiple eye images IMG_E generated as time-series data. For example, FIG. 14 shows an eye image IMG_E generated by the imaging device 1 imaging the target person P before changing the imaging range, and an eye image IMG_E generated by the imaging device 1 imaging the target person P after changing the imaging range. In the following description, the eye image IMG_E generated by the imaging device 1 imaging the target person P before changing the imaging range will be referred to as the eye image IMG_E (before change), and the eye image IMG_E generated by the imaging device 1 imaging the target person P after changing the imaging range will be referred to as the eye image IMG_E (after change). As shown in Fig. 14, the position of the eyes in the eye image IMG_E (before change) differs from the position of the eyes in the eye image IMG_E (after change). In this case, as shown in Fig. 14, the focus evaluation area FA that was set to the iris area IA in the eye image IMG_E (before change) may no longer be set to the iris area IA in the eye image IMG_E (after change). As a result, the focus evaluation value of the eye image IMG_E (after change) may not be calculated appropriately. Therefore, the area setting unit 211 may change the position of the focus evaluation area FA between the multiple eye images IMG_E in accordance with the change in the imaging range.
[0110] 14, the position of the focus evaluation area FA may be changed between the eye image IMG_E (before change) and the eye image IMG_E (after change) so that the focus evaluation area FA is set in the iris area IA in both the eye image IMG_E (before change) and the eye image IMG_E (after change). In this case, the area setting unit 211 may change the position of the focus evaluation area FA based on the amount of change in the imaging range. The area setting unit 211 may change the position of the focus evaluation area FA based on the direction in which the imaging range is changed.
[0111] For example, the position of the focus evaluation area FA may be changed between the eye image IMG_E (before modification) and the eye image IMG_E (after modification) so that the focus evaluation area FA in both the eye image IMG_E (before modification) and the eye image IMG_E (after modification) does not include at least one of the pupil area PA, the reflection area RA, and the eyelash area LA described in the fourth embodiment. For example, the position of the focus evaluation area FA may be changed between the eye image IMG_E (before modification) and the eye image IMG_E (after modification) so that the focus evaluation area FA in both the eye image IMG_E (before modification) and the eye image IMG_E (after modification) is set to the lower area DA, which corresponds to the lower half of the iris area IA described in the fourth embodiment.
[0112] As described above, information processing device 2 in the sixth embodiment can appropriately set focus evaluation area FA even when the imaging range of imaging device 1 is changed. As a result, information processing device 2 can appropriately determine whether eye image IMG_E is a focused image even when the imaging range of imaging device 1 is changed.
[0113] (7) Seventh embodiment Next, a seventh embodiment of an information processing device, an information processing method, and a recording medium will be described with reference to Fig. 15. Hereinafter, the seventh embodiment of the information processing device, the information processing method, and a recording medium will be described using an authentication system SYSe to which the seventh embodiment of the information processing device, the information processing method, and a recording medium is applied. Fig. 15 is a block diagram showing the configuration of the authentication system SYSe in the seventh embodiment.
[0114] 15, the authentication system SYSe in the seventh embodiment differs from at least one of the authentication systems SYS in the third embodiment to SYSd in the sixth embodiment in that the authentication system SYSe includes a lighting device 3e. Other features of the authentication system SYSe in the seventh embodiment may be the same as other features of at least one of the authentication systems SYS in the third embodiment to SYSd in the sixth embodiment.
[0115] The lighting device 3e emits illumination light for illuminating the target person P. The lighting device 3e illuminates the target person P with the illumination light. In this case, the imaging device 1 may capture an image of the target person P illuminated by the illumination light.
[0116] The lighting device 3e may have changeable lighting conditions. The lighting conditions may include an emission angle of the lighting light emitted from the lighting device 3e. The lighting conditions may include an emission direction of the lighting light emitted from the lighting device 3e. The lighting conditions may include an emission position of the lighting light emitted from the lighting device 3e. In the case where the lighting device 3e is provided with a plurality of light sources (e.g., a plurality of LEDs (Light Emitting Diodes)) each capable of emitting lighting light, the lighting conditions may include the number of light sources that actually emit lighting light. In the case where the lighting device 3e is provided with a plurality of light sources each capable of emitting lighting light, the lighting conditions may include the positions of the light sources that actually emit lighting light.
[0117] Furthermore, if the lighting device 3e is capable of changing the lighting conditions, the information processing device 2 (area setting unit 211) may set the focus evaluation area FA in accordance with the change in lighting conditions. Specifically, as described above, if the lighting conditions are changed during at least a portion of the period during which the imaging device 1 captures an image of the target person P at a constant imaging rate, the position of the reflection area RA, including the reflected image of the illumination light, may change in the multiple eye images IMG_E generated as time-series data. For example, FIG. 16 shows an eye image IMG_E generated by the imaging device 1 capturing an image of the target person P before the lighting conditions are changed, and an eye image IMG_E generated by the imaging device 1 capturing an image of the target person P after the lighting conditions are changed. In the following description, the eye image IMG_E generated by the imaging device 1 capturing an image of the target person P before the lighting conditions are changed will be referred to as the eye image IMG_E (before change), and the eye image IMG_E generated by the imaging device 1 capturing an image of the target person P after the lighting conditions are changed will be referred to as the eye image IMG_E (after change). As shown in Fig. 15, the position of the reflection region RA in the eye image IMG_E (before change) differs from the position of the reflection region RA in the eye image IMG_E (after change). In this case, as shown in Fig. 16, the focus evaluation region FA that did not include the reflection region RA in the eye image IMG_E (before change) may include the reflection region RA in the eye image IMG_E (after change). As a result, the focus evaluation value of the eye image IMG_E (after change) may not be calculated appropriately. Therefore, the region setting unit 211 may change the position of the focus evaluation region FA between the multiple eye images IMG_E in accordance with changes in lighting conditions.
[0118] 16, the position of the focus evaluation area FA may be changed between the eye image IMG_E (before change) and the eye image IMG_E (after change) so that the focus evaluation area FA does not include the reflection area RA in both the eye image IMG_E (before change) and the eye image IMG_E (after change). In this case, the area setting unit 211 may change the position of the focus evaluation area FA based on the change in the illumination conditions.
[0119] As described above, information processing device 2 in the seventh embodiment can appropriately set focus evaluation area FA even when the illumination conditions of illumination device 3e change. As a result, information processing device 2 can appropriately determine whether eye image IMG_E is a focused image even when the illumination conditions of illumination device 3e change.
[0120] (8) Supplementary Notes The following additional notes are provided regarding the above-described embodiment. [Appendix 1] a setting means for setting an evaluation area in a target image including at least a body of the target, the evaluation area being used to evaluate a focus degree of a body area including a part of the body of the target; a determining means for determining whether the target image is a focused image in which the body region is in focus, based on the variance of luminance values of a plurality of pixels included in the evaluation region; An information processing device comprising: [Appendix 2] the object image includes an eye image including the object's eye as the object's body; The body region includes an iris region that includes the subject's iris as part of the subject's body. 10. The information processing device according to claim 1. [Appendix 3] The setting means sets, as the evaluation region, a region in the eye image that is different from a pupil region including the pupil of the subject and a reflection region including a reflection image of light incident on the eye and that is included in the iris region. 3. The information processing device according to claim 2. [Appendix 4] The setting means identifies the reflection area based on the luminance values of pixels included in a sclera area of the eye image, the sclera area including the sclera of the target eye, and sets an area in the eye image that is different from the identified reflection area as the evaluation area. 4. The information processing device according to claim 3. [Appendix 5] The determining means determines that the target image is the focused image when the variance is greater than a predetermined threshold. 5. The information processing device according to any one of claims 1 to 4. [Appendix 6] the target image is generated by an imaging device capable of imaging the target, The determining means determines that one of the plurality of target images generated by the imaging device successively capturing images of the target, which has the largest variance, is the in-focus image. 6. An information processing device according to any one of appendices 1 to 5. [Appendix 7] the target image is generated by an imaging device capable of imaging the target, When a relative positional relationship between an imaging range of the imaging device and the target changes during a period in which the imaging device continuously captures images of the target to generate a plurality of target images, the setting means changes the position of the evaluation area between the plurality of target images based on the change in the relative positional relationship. 7. An information processing device according to any one of claims 1 to 6. [Appendix 8] the target image is generated by an imaging device capable of imaging the target, When an illumination condition of an illumination device that illuminates the target changes during a period in which the imaging device continuously captures images of the target to generate a plurality of target images, the setting means changes the position of the evaluation area among the plurality of target images based on the change in the illumination condition. 8. An information processing device according to any one of appendices 1 to 7. [Appendix 9] the setting means sets at least a first evaluation area and a second evaluation area within the target image; The determining means determines whether the target image is a focused image based on a variance of luminance values of a plurality of pixels included in the first evaluation area and a variance of luminance values of a plurality of pixels included in the second evaluation area. 9. An information processing device according to any one of appendices 1 to 8. [Appendix 10] The determining means determines whether the target image is a focused image based on a variance of brightness values of the plurality of pixels that are a portion of all pixels included in the evaluation area. 10. An information processing device according to any one of appendices 1 to 9. [Appendix 11] the target image is generated by an imaging device capable of imaging the target, The setting means sets the evaluation area in a part of the plurality of target images when the imaging device generates a plurality of target images by successively capturing images of the target. 11. The information processing device according to any one of Supplementary Notes 1 to 10. [Appendix 12] The target image is generated by an imaging device capable of imaging the target while the relative positional relationship between the target and the imaging device is changing. 12. An information processing device according to any one of Supplementary Notes 1 to 11. [Appendix 13] The target image is generated by an imaging device capable of imaging the target, while the focal length of the imaging device is changing. 13. An information processing device according to any one of appendices 1 to 12. [Appendix 14] the object image includes an eye image including the object's eye as the object's body; the body region includes an iris region that includes the iris of the subject as part of the subject's body; The setting means sets, as the evaluation region, a region in the eye image that is different from an eyelash region that includes the eyelashes of the subject and that is included in the iris region. 14. An information processing device according to any one of claims 1 to 13. [Appendix 15] the object image includes an eye image including the object's eye as the object's body; the body region includes an iris region that includes the iris of the subject as part of the subject's body; The setting means sets the evaluation area in the lower half of an iris area including the iris in the eye image. 15. An information processing device according to any one of appendices 1 to 14. [Appendix 16] setting an evaluation area in a target image including at least a body of the target, for evaluating a focus degree of a body area including a part of the body of the target; determining whether the target image is a focused image in which the body region is in focus based on the variance of luminance values of a plurality of pixels included in the evaluation region; An information processing method including: [Appendix 17] A recording medium on which a computer program for causing a computer to execute an information processing method is recorded, The information processing method includes: setting an evaluation area in a target image including at least a body of the target, for evaluating a focus degree of a body area including a part of the body of the target; determining whether the target image is a focused image in which the body region is in focus based on the variance of luminance values of a plurality of pixels included in the evaluation region; Contains Recording medium. [Appendix 18] a setting means for setting an evaluation area in a target image including at least a body of the target, the evaluation area being used to evaluate a focus degree of a body area including a part of the body of the target; a determining means for determining whether the target image is a focused image in which the body region is in focus, based on the variance of the luminance values of a plurality of pixels included in the evaluation region; an authentication means for authenticating the object using the object image determined to be the focused image; An information processing device comprising: [Appendix 19] setting an evaluation area in a target image including at least a body of the target, for evaluating a focus degree of a body area including a part of the body of the target; determining whether the target image is a focused image in which the body region is in focus based on a variance of brightness values of a plurality of pixels included in the evaluation region; authenticating the object using the object image determined to be the focused image; An information processing method including: [Appendix 20] A recording medium on which a computer program for causing a computer to execute an information processing method is recorded, The information processing method includes: setting an evaluation area in a target image including at least a body of the target, for evaluating a focus degree of a body area including a part of the body of the target; determining whether the target image is a focused image in which the body region is in focus based on a variance of brightness values of a plurality of pixels included in the evaluation region; authenticating the object using the object image determined to be the focused image; Contains Recording medium.
[0121] At least some of the components of each of the above-described embodiments can be appropriately combined with at least some of the other components of each of the above-described embodiments. Some of the components of each of the above-described embodiments may not be used. Furthermore, to the extent permitted by law, the disclosures of all documents (e.g., published patent applications) cited in this disclosure are incorporated by reference as part of the description of this disclosure.
[0122] This disclosure may be modified as appropriate within the scope of the claims and the technical idea that can be read from the entire specification. Information processing devices, information processing methods, and recording media that involve such modifications are also included in the technical idea of this disclosure. [Explanation of symbols]
[0123] 1. Imaging device 2. Information processing equipment 21 Arithmetic unit 211 Area setting section 212 Focus judgment section 213 Iris Recognition Unit 1000, 2000 Information Processing Devices 1001, 2001 setting section 1002, 2002 Judgment section 1003, 2003 Certification Department SYS Authentication System P Target person IMG_E Eye image
Claims
1. a setting means for setting an evaluation area in an object image including at least a body of the object, the evaluation area being used to evaluate a focus level of a body area including a part of the body of the object; a determining means for determining whether the target image is a focused image in which the body region is in focus, based on the variance of luminance values of a plurality of pixels included in the evaluation region; Equipped with the determining means determines that one of the plurality of target images generated by the imaging device successively capturing images of the target, which has the largest variance, is the focused image; the imaging device images the object during at least a portion of a period during which a positional relationship between a focal plane of the imaging device and the object is changing due to the object moving relative to the imaging device; When an illumination condition of an illumination device that illuminates the target changes during a period in which the imaging device continuously captures images of the target to generate the plurality of target images, the setting means changes the position of the evaluation area among the plurality of target images based on the change in the illumination condition. Information processing device.
2. the object image includes an eye image including the object's eye as the object's body; The body region includes an iris region that includes the subject's iris as part of the subject's body. The information processing device according to claim 1 .
3. The setting means sets, as the evaluation region, a region in the eye image that is different from a pupil region including the pupil of the subject and a reflection region including a reflection image of light incident on the eye and that is included in the iris region. The information processing device according to claim 2 .
4. The setting means identifies the reflection area based on the luminance values of pixels included in a sclera area of the eye image, the sclera area including the sclera of the target eye, and sets an area in the eye image that is different from the identified reflection area as the evaluation area. The information processing device according to claim 3 .
5. The determining means determines that the target image is the focused image when the variance is greater than a predetermined threshold. The information processing device according to claim 1 .
6. the target image is generated by an imaging device capable of imaging the target, When a relative positional relationship between an imaging range of the imaging device and the target changes during a period in which the imaging device continuously captures images of the target to generate the plurality of target images, the setting means changes the position of the evaluation area between the plurality of target images based on the change in the relative positional relationship. The information processing device according to claim 1 .
7. setting an evaluation area for evaluating a focus degree of a body area including a part of the body of the target in a target image including at least the body of the target generated by an imaging device capable of imaging the target; determining whether the target image is a focused image in which the body region is in focus based on the variance of the brightness values of a plurality of pixels included in the evaluation region, and determining that one target image with the maximum variance among a plurality of target images generated by the imaging device by continuously capturing images of the target is the focused image; The imaging device captures an image of the object during at least a portion of a period during which a positional relationship between a focal plane of the imaging device and the object is changing due to the object moving relative to the imaging device. Including, The setting includes, when an illumination condition of an illumination device that illuminates the target changes during a period in which the imaging device continuously captures images of the target to generate the plurality of target images, changing the position of the evaluation area among the plurality of target images based on the change in the illumination condition. Information processing methods.
8. A computer program for causing a computer to execute an information processing method, The information processing method includes: setting an evaluation area for evaluating a focus degree of a body area including a part of the body of the target in a target image including at least the body of the target generated by an imaging device capable of imaging the target; determining whether the target image is a focused image in which the body region is in focus based on the variance of the brightness values of a plurality of pixels included in the evaluation region, and determining that one target image with the maximum variance among a plurality of target images generated by the imaging device by continuously capturing images of the target is the focused image; The imaging device captures an image of the object during at least a portion of a period during which a positional relationship between a focal plane of the imaging device and the object is changing due to the object moving relative to the imaging device. Including, The setting includes, when an illumination condition of an illumination device that illuminates the target changes during a period in which the imaging device continuously captures images of the target to generate the plurality of target images, changing the position of the evaluation area among the plurality of target images based on the change in the illumination condition. Computer program.
9. a setting means for setting an evaluation area in an object image including at least a body of the object, the evaluation area being used to evaluate a focus level of a body area including a part of the body of the object; a determining means for determining whether the target image is a focused image in which the body region is in focus, based on the variance of the luminance values of a plurality of pixels included in the evaluation region; an authentication means for authenticating the object using the object image determined to be the focused image; Equipped with the determining means determines that one of the plurality of target images generated by the imaging device successively capturing images of the target, which has the largest variance, is the focused image; the imaging device images the object during at least a portion of a period during which a positional relationship between a focal plane of the imaging device and the object is changing due to the object moving relative to the imaging device; When an illumination condition of an illumination device that illuminates the target changes during a period in which the imaging device continuously captures images of the target to generate the plurality of target images, the setting means changes the position of the evaluation area among the plurality of target images based on the change in the illumination condition. Information processing device.
Citation Information
Patent Citations
Image pickup device
JP2001257932A
Individual authentication method and iris authentication device
JP2004206444A
Image photographic device and authentication device
JP2004328367A
Autofocus system
JP2007093874A
Image processing method
JP2011210712A