Information acquisition device, information acquisition method, and storage medium

Abstract

To provide an information acquisition apparatus capable of further reducing effects caused by an iris being obscured by eyelids, etc.SOLUTION: Provided is an information acquisition apparatus comprising output means for outputting guidance information for guiding a subject to move a head while gazing at a prescribed position, and image acquisition means for acquiring an image including an iris of the subject after outputting the guidance information, wherein the guidance information includes information for guiding the subject to move the head upward while gazing at the prescribed position. Accordingly, the information acquisition apparatus is able to further reduce effects caused by the iris being obscured by eyelids, etc.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present disclosure relates to an information acquisition device, an information acquisition method, and a storage medium. [Background technology]

[0002] Patent Document 1 discloses an iris authentication device that captures an iris image of a person to be authenticated and performs iris authentication. The iris authentication device is equipped with a display unit that displays a warning above an imaging unit that captures an iris image. Patent Document 1 describes that this makes it possible to open the subject's eyes wide, thereby reducing the possibility of erroneous authentication due to the iris being covered by eyelashes or upper eyelids. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] International Publication No. 2018 / 052003 Summary of the Invention [Problem to be solved by the invention]

[0004] In an iris authentication device such as that described in Patent Document 1, there are cases where the influence of the iris being covered by the eyelid or the like is not sufficiently reduced.

[0005] An object of the present disclosure is to provide an information acquisition device, an information acquisition method, and a storage medium that can further reduce the effect of the iris being covered by the eyelids or the like. [Means for solving the problem]

[0006] According to one aspect of the present disclosure, there is provided an information acquisition device comprising: an output means for outputting guidance information for guiding a subject to move his / her head while gazing at a predetermined position; and an image acquisition means for acquiring an image including the iris of the subject after outputting the guidance information.

[0007] According to another aspect of the present disclosure, there is provided an information acquisition method comprising: a step of outputting guidance information for guiding a subject to move his / her head while gazing at a predetermined position; and a step of acquiring an image including the iris of the subject after outputting the guidance information.

[0008] According to another aspect of the present disclosure, there is provided a storage medium having stored therein a program for causing a computer to execute an information acquisition method including the steps of: outputting guidance information for guiding a subject to move his / her head while gazing at a predetermined position; and acquiring an image including the iris of the subject after outputting the guidance information. [Brief description of the drawings]

[0009] [Figure 1] 1 is a schematic diagram showing an overall configuration of an iris matching system according to a first embodiment. [Diagram 2] 1 is a block diagram showing a hardware configuration of an iris image acquisition device according to a first embodiment. [Diagram 3] 2 is a block diagram showing a hardware configuration of a matching server according to the first embodiment. FIG. [Figure 4] 1 is a functional block diagram of an iris matching system according to a first embodiment. [Diagram 5] 3 is a flowchart showing an outline of a matching process performed in the iris matching system according to the first embodiment. [Figure 6] 11 is an example of a guidance instruction displayed on the display device during the matching process according to the first embodiment. [Figure 7A] FIG. 13 is a schematic diagram showing an example of imaging when a subject faces forward. [Figure 7B] FIG. 13 is a close-up view of the eyes in an example image of a subject facing forward. [Figure 8A] 11 is a schematic diagram showing an example of an image captured when a subject moves his / her head up while gazing straight ahead; [Figure 8B] FIG. 13 is a close-up view of the eyes in an example image taken when a subject moves their head up while gazing straight ahead. [Figure 9]FIG. 11 is a functional block diagram of an iris matching system according to a second embodiment. [Figure 10] 10 is a flowchart showing an outline of a matching process performed in an iris matching system according to a second embodiment. [Figure 11] FIG. 11 is a functional block diagram of an iris matching system according to a third embodiment. [Figure 12] 13 is a flowchart showing an outline of a matching process performed in an iris matching system according to a third embodiment. [Figure 13] 13 is a flowchart showing an outline of a matching process performed in an iris matching system according to a fourth embodiment. [Figure 14] 13 is an example of a stillness instruction displayed on the display device during the matching process according to the fourth embodiment. [Figure 15] 13 is an example of a stillness instruction displayed on the display device during the matching process according to the fifth embodiment. [Figure 16] 13 is a flowchart showing an outline of a matching process performed in an iris matching system according to a sixth embodiment. [Figure 17] 23 is an example of a guidance instruction displayed on the display device during the matching process according to the sixth embodiment. [Figure 18] 13 is a flowchart showing an outline of a matching process performed in an iris matching system according to a seventh embodiment. [Figure 19] 23 is an example of a guidance instruction displayed on the display device during the matching process according to the seventh embodiment. [Figure 20] 23 is a flowchart showing an outline of a matching process performed in an iris matching system according to an eighth embodiment. [Figure 21] 23 is an example of a guidance instruction displayed on the display device during the matching process according to the eighth embodiment. [Figure 22] 13 is a flowchart showing an outline of a matching process performed in an iris matching system according to a ninth embodiment. [Diagram 23] FIG. 13 is a schematic diagram showing an overview of a feature amount synthesis process performed in the iris matching system according to the ninth embodiment. [Figure 24]FIG. 23 is a functional block diagram of an information acquisition device according to a tenth embodiment. [Diagram 25] FIG. 23 is a functional block diagram of an information acquisition device according to a thirteenth embodiment. [Figure 26] FIG. 23 is a functional block diagram of an information acquisition device according to a fourteenth embodiment. [Figure 27] FIG. 23 is a functional block diagram of an information acquisition device according to a fifteenth embodiment. [Figure 28] FIG. 23 is a functional block diagram of an information acquisition device according to a seventeenth embodiment. [Figure 29] FIG. 27 is a functional block diagram of an information acquisition device according to a 27th embodiment. [Diagram 30] FIG. 28 is a functional block diagram of an information acquisition device according to a 28th embodiment. [Diagram 31] FIG. 29 is a functional block diagram of an information acquisition device according to a 29th embodiment. [Diagram 32] 13 is an example of a guidance instruction displayed on a display device during a matching process according to a modified embodiment. [Diagram 33] 13 is an example of a guidance instruction displayed on a display device during a matching process according to a modified embodiment. [Diagram 34] FIG. 13 is a schematic diagram showing the configuration of an iris image acquisition device according to a modified embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] Hereinafter, exemplary embodiments of the present disclosure will be described with reference to the drawings. In the drawings, similar or corresponding elements are denoted by the same reference numerals, and descriptions thereof may be omitted or simplified.

[0011] [First embodiment] 1 is a schematic diagram showing the overall configuration of an iris matching system according to this embodiment. The iris matching system includes an iris image acquisition device 1 and a matching server 2. The iris image acquisition device 1 and the matching server 2 are connected to each other via a network NW so as to be able to communicate with each other.

[0012] An iris matching system is a biometric authentication system that captures an iris image of a subject and determines whether the subject and a registered person are the same person by comparing the features of the captured iris image with the features of the iris image of a pre-registered person.

[0013] The iris image acquisition device 1 is an information acquisition device that captures an iris image of a subject and extracts features. The iris image acquisition device 1 may be, for example, an identity verification terminal used at immigration inspection points, government agencies, entrance gates of facilities, etc. In this case, the iris image acquisition device 1 is used to determine whether or not the subject is a person who has the authority to enter the country, use government agencies, enter facilities, etc. In addition, the iris image acquisition device 1 may be, for example, an information processing device such as a smartphone or a PC (Personal Computer). In this case, the iris image acquisition device 1 can perform identity verification by iris authentication when logging in, using application software, making electronic payments, etc. In this way, the user of the iris image acquisition device 1 may be the subject himself or herself, or may be an identity verifying person who performs identity verification of the subject.

[0014] The matching server 2 is a matching device that acquires the feature amount of the subject from the iris image acquisition device 1 and matches the feature amount of the subject with the feature amount of a registrant.

[0015] The network NW may be various networks such as a local area network (LAN), a wide area network (WAN), etc. The network NW may be, for example, the Internet or a closed network of an institution that uses the results of iris matching.

[0016] 1, the iris matching system is configured with an iris image acquisition device 1 and a matching server 2, but the configuration of the iris matching system is not limited to this. For example, the iris matching system may be a single device that combines the functions of the iris image acquisition device 1 and the matching server 2, or may be a system including three or more devices.

[0017] 2 is a block diagram showing an example of the hardware configuration of iris image acquisition device 1. Iris image acquisition device 1 includes a processor 101, a RAM (Random Access Memory) 102, a ROM (Read Only Memory) 103, and a HDD (Hard Disk Drive) 104. Iris image acquisition device 1 also includes a communication I / F (Interface) 105, an operation device 106, an imaging device 107, and a display device 108. Note that the various components of iris image acquisition device 1 are connected to each other via a bus, wiring, a drive device, etc. (not shown).

[0018] 2, the components constituting the iris image acquisition device 1 are illustrated as an integrated device, but some of these functions may be provided by external devices. For example, the operation device 106, the image capture device 107, and the display device 108 may be external devices separate from the components constituting the functions of a computer including the processor 101, etc.

[0019] The processor 101 performs a predetermined calculation according to a program stored in the ROM 103, the HDD 104, etc., and also has a function of controlling each part of the iris image acquisition device 1. The processor 101 may be one of a central processing unit (CPU), a graphics processing unit (GPU), a field-programmable gate array (FPGA), a digital signal processor (DSP), and an application specific integrated circuit (ASIC), or may be a plurality of them in parallel. The RAM 102 is made of a volatile storage medium and provides a temporary memory area required for the operation of the processor 101. The ROM 103 is made of a non-volatile storage medium and stores necessary information such as a program used for the operation of the iris image acquisition device 1. The HDD 104 is made of a non-volatile storage medium and is a storage device that stores a database, a program for operating the iris image acquisition device 1, etc.

[0020] The communication I / F 105 is a communication interface based on standards such as Ethernet (registered trademark), Wi-Fi (registered trademark), etc. The communication I / F 105 is a module for communicating with other devices such as the matching server 2.

[0021] The operation device 106 is a user interface device such as a button or a touch panel for allowing a subject, an administrator, or the like to operate the iris image acquisition device 1.

[0022] The imaging device 107 is a digital camera having a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor, a CCD (Charge Coupled Device) image sensor, or the like as a light receiving element. The imaging device 107 captures an image including the iris of a subject to obtain digital image data. The imaging device 107 may be a visible light camera that captures an optical image using visible light, or an infrared light camera that captures an optical image using infrared light.

[0023] The display device 108 is a liquid crystal display, an OLED (Organic Light Emitting Diode) display, or the like, and is used to display information, a GUI (Graphical User Interface) for operation input, etc. The operation device 106 and the display device 108 may be integrally formed as a touch panel.

[0024] The iris image acquisition device 1 may further include a light source device that irradiates the iris of the subject with light of a wavelength suitable for imaging with visible light or infrared light. This light source device irradiates the subject with light in synchronization with imaging by the imaging device 107.

[0025] 3 is a block diagram showing an example of the hardware configuration of the matching server 2. The matching server 2 includes a processor 201, a RAM 202, a ROM 203, a HDD 204, a communication I / F 205, an input device 206, and an output device 207. The components of the matching server 2 are connected to each other via a bus, wiring, a drive device, etc. (not shown). The processor 201, RAM 202, ROM 203, HDD 204, and communication I / F 205 are similar to the processor 101, RAM 102, ROM 103, HDD 104, and communication I / F 105, and therefore description thereof will be omitted.

[0026] The input device 206 is a keyboard, a pointing device, etc., and is used by an administrator of the matching server 2 to operate the matching server 2. Examples of the pointing device include a mouse, a trackball, a touch panel, a pen tablet, etc. The output device 207 is, for example, a display device having a similar configuration to the display device 108. The input device 206 and the output device 207 may be integrally formed as a touch panel.

[0027] The hardware configurations of the iris image acquisition device 1 and the matching server 2 are illustrative, and other devices may be added, or some devices may not be provided. Some devices may be replaced with other devices having similar functions. Some functions of this embodiment may be provided by other devices via a network, or the functions of this embodiment may be distributed and realized among a plurality of devices. For example, the HDDs 104 and 204 may be replaced with SSDs (Solid State Drives) using semiconductor memories. The HDDs 104 and 204 may be replaced with cloud storage. In this way, the hardware configurations of the iris image acquisition device 1 and the matching server 2 can be changed as appropriate.

[0028] 4 is a functional block diagram of the iris matching system according to this embodiment. The iris image acquisition device 1 includes an output unit 111, a display control unit 112, an image acquisition unit 113, a feature generation unit 114, and an I / F unit 115. The matching server 2 includes an I / F unit 211, a matching unit 212, and a feature storage unit 213.

[0029] The processor 101 performs a predetermined calculation process by loading a program stored in the ROM 103, the HDD 104, etc., into the RAM 102 and executing the program. The processor 101 also controls each unit of the iris image acquisition device 1, such as the communication I / F 105, the operation device 106, the imaging device 107, and the display device 108, based on the program. With these, the processor 101 realizes the functions of the output unit 111, the display control unit 112, the image acquisition unit 113, the feature amount generation unit 114, and the I / F unit 115. The output unit 111, the display control unit 112, the image acquisition unit 113, and the feature amount generation unit 114 are sometimes more generally referred to as an output means, a display control means, an image acquisition means, and a feature amount generation means, respectively.

[0030] The processor 201 performs a predetermined arithmetic processing by loading a program stored in the ROM 203, the HDD 204, etc., into the RAM 202 and executing it. The processor 201 also controls each unit of the matching server 2, such as the communication I / F 205, the input device 206, and the output device 207, based on the program. With these, the processor 201 realizes the functions of the I / F unit 211, the matching unit 212, and the feature storage unit 213. The matching unit 212 and the feature storage unit 213 are sometimes more generally referred to as a matching means and a feature storage means, respectively. The specific processing contents performed by each functional block will be described later.

[0031] 4, some or all of the functions of the functional blocks described in the iris image acquisition device 1 and the matching server 2 may be provided in devices external to the iris image acquisition device 1 and the matching server 2. That is, the above-mentioned functions may be realized by cooperation between the iris image acquisition device 1 and the matching server 2 and other devices. Also, the iris image acquisition device 1 and the matching server 2 may be an integrated device, and some of the functions of the functional blocks described in one of the iris image acquisition device 1 and the matching server 2 may be realized by the other device. That is, the device in which the functional blocks in FIG. 4 are provided is not limited to that shown in FIG. 4.

[0032] 5 is a flowchart showing an outline of the matching process performed in the iris matching system according to this embodiment. The process of this embodiment starts when a user performs an operation for performing iris authentication on the subject on the iris image acquisition device 1. In this case, it is assumed that the subject faces the imaging device 107 of the iris image acquisition device 1, and the iris of the subject is included within the imaging range of the imaging device 107.

[0033] In step S101, the output unit 111 outputs guidance information for guiding the subject to move his / her head while gazing at a predetermined position. This guidance information may be, for example, display information for displaying guidance instructions such as a message or an image for encouraging the subject to move on the display device 108.

[0034] In step S102, the display control unit 112 controls the display device 108 based on the guidance information, so that the display device 108 displays a guidance instruction for guiding the user to move his / her head while gazing at a predetermined position.

[0035] 6 is an example of a guidance instruction displayed on the display device 108 during the matching process according to this embodiment. The imaging device 107 and the display device 108 are arranged in front of the iris image acquisition device 1. The imaging device 107 and the display device 108 are arranged close to each other so that when the subject turns his / her face towards the iris image acquisition device 1, the iris of the subject is included in the shooting range of the imaging device 107 and the subject can visually recognize the display device 108. As a result, when the subject looks at the display device 108, the subject's line of sight is generally directed in the direction of the imaging device 107.

[0036] The display device 108 displays a message saying, "Please move your head up slowly while looking straight ahead," in response to control by the display control unit 112. The subject reads this message and moves his / her head up while gazing straight ahead (in the direction of the imaging device 107).

[0037] In step S103, the image acquisition unit 113 controls the imaging device 107 in synchronization with the guidance in step S102. As a result, the imaging device 107 captures an image including the iris of the subject at a timing synchronized with the guidance. In this way, the image acquisition unit 113 acquires an iris image of the subject. Note that the timing synchronized with the guidance in step S103 may be, for example, a time point when the subject moves his / her head sufficiently upward in response to the guidance. Alternatively, it may be a time point when the subject moves his / her head sufficiently upward in response to the guidance and then stops moving his / her head. Furthermore, it may be a time point a predetermined time before or after these times.

[0038] In step S104, the feature generating unit 114 generates the feature of the iris of the subject by performing a process of extracting the feature from the acquired iris image. For example, the Daugman algorithm can be adopted for this feature extraction process, but the present invention is not limited to this and other algorithms may be used. The generated feature is transmitted from the iris image acquiring device 1 to the matching server 2 by the I / F unit 115.

[0039] In step S105, the matching unit 212 matches the feature of the subject acquired from the iris image acquisition device 1 via the I / F unit 211 with the feature of the registrant stored in advance in the feature storage unit 213, and determines whether the subject and the registrant are the same person. The matching process here may, for example, calculate a matching score based on the degree of agreement between the two feature amounts, and determine that the subject and the registrant are the same person if the matching score is equal to or greater than a threshold. The matching process performed by the matching unit 212 may be one-to-one matching in which the feature of the subject is matched with the feature of one registrant, or one-to-N matching in which the feature of the subject is matched with the feature of multiple registrants. In one-to-N matching, it is determined which of the multiple registrants the subject is the same person as, or whether the subject is not included in the registrants.

[0040] In step S106, matching unit 212 outputs the matching result to iris image acquisition device 1 via I / F unit 211. Iris image acquisition device 1 notifies the user of the matching result. The matching result can be notified, for example, by display control unit 112 controlling display device 108 to display a message indicating the matching result. Furthermore, the matching result may be used to control equipment such as opening and closing a passage gate depending on the matching result. Through the above processing, the iris matching system of this embodiment can perform iris matching of a subject and notify the result.

[0041] The effect of performing the process of guiding the user to move his / her head while gazing at a predetermined position in step S101 described above will be described with reference to FIGS. 7A, 7B, 8A, and 8B.

[0042] FIG. 7A is a schematic diagram showing an example of imaging when the subject faces forward. FIG. 7B is an enlarged view of the eye EY in an example of imaging when the subject faces forward. FIG. 7B shows the iris IRS, pupil PPL, upper eyelid UELD, upper eyelashes UELS, etc., included in the subject's eye EY. As shown in FIG. 7B, a wide area above the iris IRS is covered by the upper eyelid UELD or upper eyelashes UELS, making it impossible to distinguish the pattern and making it unavailable for iris matching. Therefore, if the area covered by the upper eyelid UELD or upper eyelashes UELS is wide, there are cases where sufficient accuracy in iris matching cannot be obtained.

[0043] FIG. 8A is a schematic diagram showing an example of imaging when a subject moves his / her head up while gazing forward. FIG. 8B is an enlarged view of the eye EY in an example of imaging when a subject moves his / her head up while gazing forward. When the subject moves his / her head up while gazing forward, the position of the upper eyelid UELD does not change much, and the pupil PPL moves downward. Therefore, as shown in FIG. 8B, the area of ​​the iris IRS covered by the upper eyelid UELD or the upper eyelashes UELS decreases. Here, "moving the head up" refers to moving the head so that the face faces up as shown in FIG. 8B, but this movement can also be expressed as "moving the neck up," "tilting the head up," "turning the face up," "shaking the head up," "leaning the head back," "raising the chin," and the like. In the following, the movement shown in FIG. 8B is expressed as "moving the head up."

[0044] Therefore, according to the present embodiment, an information acquisition device is provided that can further reduce the influence of the iris being covered by the eyelids, etc. Also, according to the present embodiment, an iris matching system is provided in which deterioration of matching accuracy caused by the iris being covered by the eyelids, etc. is reduced. The iris matching system of the present embodiment is more effective in improving the accuracy of iris matching for subjects whose irises are likely to be partially covered by the eyelids, eyelashes, etc., such as people with narrow eyes or people whose upper eyelids are positioned low due to ptosis.

[0045] In the process of step S101, instead of the method of inducing the head to move while gazing at a predetermined position, a method of inducing the head to move without moving the head can be applied, but the method of moving the head of this embodiment is more effective. In the method of moving the gaze position, in order to capture the upper side of the iris as in Figs. 8A and 8B, it is necessary to induce the pupil PPL to move downward. In this case, the upper eyelid also moves downward in conjunction with the downward rotation of the eyeball, so there is little change in the positional relationship between the upper eyelid and the iris. Therefore, the effect of reducing the area of ​​the iris IRS covered by the upper eyelid UELD or upper eyelashes UELS is not obtained. Therefore, it is desirable to adopt the method of inducing the head to move while gazing at a predetermined position of this embodiment.

[0046] Specific examples of the method for synchronizing the guidance and the imaging in step S103 include the following: First, video, continuous images, etc. of the subject are sequentially acquired by the imaging device 107 or another camera, and an image for iris matching is captured by the imaging device 107 at the time when it is confirmed by image analysis, video analysis, etc. that the subject has moved his / her head up.

[0047] Another example is that the imaging device 107 captures an image after a predetermined time has elapsed since the message was displayed on the display device 108. This predetermined time is set taking into consideration the time it takes the subject to read the message and move his / her head.

[0048] As yet another example, when the subject moves his / her head up sufficiently, the subject or a user other than the subject operates the operation device 106 of the iris image acquisition device 1 to manually instruct the capture of an image. In this example, a message prompting the capture operation such as "Press the button after moving your head up" may be additionally displayed on the display device 108.

[0049] As yet another example, the imaging device 107 sequentially acquires video, continuous images, etc. of the subject, and when image analysis confirms that the subject has moved his / her head upwards sufficiently, an image is extracted from the video, continuous images, etc. to obtain an image for iris matching.

[0050] In the present embodiment, an example has been described in which the user is guided to move the head upward, but the user may be guided in other directions. The guided direction may be, for example, diagonally upward, horizontal, diagonally downward, downward, etc. In particular, when the user is guided downward, the lower side of the iris is more likely to be exposed, as opposed to when the user moves the head upward, and iris information of this portion can be obtained more reliably.

[0051] [Second embodiment] Hereinafter, the second embodiment will be described. Since the second embodiment is a modified example of the first embodiment, the description of the same elements as those in the first embodiment may be omitted or simplified.

[0052] 9 is a functional block diagram of the iris matching system according to this embodiment. In addition to the configuration of the first embodiment, the iris image acquisition device 1 of this embodiment further includes an eyelid detection unit 116. The processor 101 functions as the eyelid detection unit 116 by loading a program stored in the ROM 103, HDD 104, etc., into the RAM 102 and executing it. The eyelid detection unit 116 is sometimes more generally called an eyelid detection means.

[0053] 10 is a flowchart showing an outline of the matching process performed in the iris matching system according to this embodiment. In step S107, the image acquisition unit 113 controls the imaging device 107 to capture an image including the subject's eyes. In this manner, the image acquisition unit 113 acquires an image including the subject's eyes. This image including the eyes may be the same as the iris image described in the description of step S103 in the first embodiment, or may have a lower resolution than the above-mentioned iris image.

[0054] In step S108, the eyelid detection unit 116 detects the degree of eyelid opening of the subject based on the image including the subject's eyes acquired in step S107, and determines whether the degree of eyelid opening is equal to or greater than a predetermined value. If the degree of eyelid opening is equal to or greater than the predetermined value (YES in step S108), the process proceeds to step S109. If the degree of eyelid opening is smaller than the predetermined value (NO in step S108), the process proceeds to step S101.

[0055] Specific examples of methods for detecting the degree of eyelid opening include the following. First, the location of the subject's eyes is detected from an image, and parameters such as the vertical length of the eyes, the aspect ratio of the eyes, and the area of ​​the eyes are used to determine the degree of eyelid opening. Another example is to detect the iris in the eye and use parameters such as the shape and area of ​​the iris to determine the degree of eyelid opening. Still another example is to detect the pupil and upper eyelid in the eye and use parameters such as the distance between the pupil and the upper eyelid to determine the degree of eyelid opening. The above-mentioned length, area, distance, etc. may be based on the number of pixels as a reference unit. Alternatively, the above-mentioned length, area, distance, etc. may be normalized by the diameter (horizontal width) of the iris or the length between the outer corner and the inner corner of the eye. In addition, the determination may be made using not only one image, but also multiple images taken in a time series. This makes it possible to distinguish and determine whether the eyes are temporarily closed due to blinking from cases where the eyes are originally narrow.

[0056] In step S109, the image acquisition unit 113 controls the imaging device 107 to capture an image including the iris of the subject. In this manner, the image acquisition unit 113 acquires the iris image of the subject. After acquiring the iris image, the process proceeds to step S104. The processes from step S101 to step S106 are the same as those in the first embodiment, and therefore the description will be omitted.

[0057] As described above, in this embodiment, when the eyelids are not sufficiently open, the guidance instructions of steps S101 and S102 are issued, and when the eyelids are sufficiently open, the guidance instructions of steps S101 and S102 are omitted and an iris image is captured. This not only provides the same effects as the first embodiment, but also makes it possible to speed up the matching process by omitting the guidance instructions when they are not necessary. Also, when guidance instructions are not necessary, there is no need to issue guidance instructions to the subject, improving the convenience of the iris image acquisition device 1.

[0058] In step S107, if an iris image with sufficient resolution for iris matching can be acquired, and if the degree of eyelid opening is equal to or greater than a predetermined value in step S108, the process of step S109 may be omitted. In this case, the iris image acquired in step S107 is used in step S104.

[0059] [Third embodiment] Hereinafter, the third embodiment will be described. Since this embodiment is a modification of the first embodiment, the description of the same elements as those in the first embodiment may be omitted or simplified.

[0060] 11 is a functional block diagram of the iris matching system according to this embodiment. In addition to the configuration of the first embodiment, the iris image acquisition device 1 of this embodiment further includes an angle detection unit 117. The processor 101 functions as the angle detection unit 117 by loading a program stored in the ROM 103, HDD 104, etc. into the RAM 102 and executing the program. The angle detection unit 117 may also be more generally called angle detection means.

[0061] 12 is a flowchart showing an outline of the matching process performed in the iris matching system according to this embodiment. In step S110, the image acquisition unit 113 controls the imaging device 107 to capture an image including the face of the subject. In this manner, the image acquisition unit 113 acquires an image including the face of the subject. The resolution of this image including the face may be approximately the same as that of the iris image described in the description of step S103 in the first embodiment, or may be lower than that of the iris image described above.

[0062] In step S111, angle detection unit 117 detects the angle of the subject's head based on the image including the subject's face acquired in step S110, and determines whether the head angle is within a predetermined range. If the head angle is within the predetermined range (YES in step S111), the process proceeds to step S109. If the head angle is outside the predetermined range (NO in step S111), the process proceeds to step S101. Here, "head angle" refers to, for example, the elevation angle of the direction in which the subject's face is facing, but can also be expressed as "face direction angle," "head direction angle relative to the horizontal direction," "neck angle," etc. Hereinafter, it will be referred to as "head angle."

[0063] A specific example of a head angle detection method is to estimate the face direction from an image including the subject's face, and detect the head angle by adding or subtracting a predetermined value to the face direction. The head angle may be detected directly from the shape of the face outline, the coordinates of feature points, etc., without estimating the face direction. The face direction may be used instead of the face angle. In this case, like the angle, it is determined whether the direction in which the face is facing is within a predetermined range.

[0064] The above-mentioned predetermined range may be an angle range above the front that is suitable for capturing an image of the upper part of the iris, or conversely, may be an angle range below the front that is suitable for capturing an image of the lower part of the iris.

[0065] The processes in steps S101 and S102 are the same as those in the first embodiment, and therefore the description will be omitted. After step S102, the process proceeds to step S110, where the head angle is estimated again.

[0066] In step S109, the image acquisition unit 113 controls the imaging device 107 to capture an image including the iris of the subject. In this manner, the image acquisition unit 113 acquires the iris image of the subject. After acquiring the iris image, the process proceeds to step S104. The subsequent processes from step S104 to step S106 are the same as those in the first embodiment, and therefore will not be described.

[0067] As described above, in this embodiment, an iris image is captured after detecting that the head angle is within a predetermined range. This not only provides the same effects as the first embodiment, but also makes it possible to more reliably obtain an iris image suitable for iris matching.

[0068] [Fourth embodiment] Hereinafter, the fourth embodiment will be described. Since this embodiment is a modification of the third embodiment, the description of the same elements as those in the third embodiment may be omitted or simplified.

[0069] 13 is a flowchart showing an outline of the matching process performed in the iris matching system according to this embodiment. In steps S110 and S111, the head angle detection process is performed in the same manner as in the third embodiment. If the head angle is within a predetermined range (YES in step S111), the process proceeds to step S112. If the head angle is outside the predetermined range (NO in step S111), the process proceeds to step S101. The process when the head angle is outside the predetermined range is the same as in the third embodiment, and therefore will not be described.

[0070] In step S112, the output unit 111 outputs stillness instruction information for instructing the subject to keep his / her head still. This stillness instruction information may be, for example, display information for causing the display device 108 to display a message, image, or the like that prompts the subject to keep his / her head still.

[0071] In step S113, the display control unit 112 controls the display device 108 based on the stillness instruction information, so that the display device 108 displays an instruction for the subject to keep his / her head still.

[0072] 14 is an example of a stillness instruction displayed on the display device 108 during the matching process according to this embodiment. The display device 108 displays a message saying "Please keep your head still at that position for a while" in response to the control of the display control unit 112. The subject reads this message and keeps his / her head still. After step S113, the process proceeds to step S109.

[0073] In step S109, the image acquisition unit 113 controls the imaging device 107 to capture an image including the iris of the subject. In this manner, the image acquisition unit 113 acquires the iris image of the subject. After acquiring the iris image, the process proceeds to step S104. The subsequent processes from step S104 to step S106 are the same as those in the first embodiment, and therefore will not be described.

[0074] As described above, in this embodiment, when it is detected that the head angle is within a predetermined range, the subject is instructed to keep his / her head still before capturing an iris image. In addition to providing the same effects as the third embodiment, this embodiment can obtain a high-quality iris image with reduced subject shake because the iris is captured with the head still.

[0075] [Fifth embodiment] Hereinafter, the fifth embodiment will be described. Since the present embodiment is a modified example of the fourth embodiment, the description of the same elements as those in the fourth embodiment may be omitted or simplified.

[0076] FIG. 15 is an example of a stillness instruction displayed on the display device 108 during the matching process according to this embodiment. Before reaching step S112, the display device 108 displays a star-marked object OB1. At this point, the color of the star-marked object OB1 is red. The subject reads this message and moves his / her head while looking at the object OB1. When the stillness instruction information is output in step S112, the color of the object OB1 displayed on the display device 108 changes from red to green in step S113. The subject sees this color change and stills his / her head.

[0077] In this embodiment, in addition to obtaining the same effect as the fourth embodiment, a user interface is realized that can inform the user whether the head angle is appropriate or not by a more intuitive and easy-to-understand display. The shape of OB1, the change in the display state, and the like are not limited to those shown in FIG. 15. For example, the shape and / or color of a symbol such as a circle, an X, or a check mark may be changed. The color of the entire screen of the display device 108, the outer frame of the screen, and the like may be changed. The color of the text of a message may be changed. In step S102, the display device 108 may display a message such as "Move your head up and down while looking at the star. When the star changes from red to green, keep your head still in that position for a while." according to the control of the display control unit 112. This makes it easier for the user to understand the meaning of the object OB1.

[0078] In addition, the user interface that detects whether the head angle is appropriate as shown in the fourth and fifth embodiments and outputs information indicating this is not necessarily limited to being used in combination with the processing of steps S101 and S102. For example, the processing of guiding the subject to move his / her head may be omitted. In addition, the displayed information may also include information indicating the degree of tilt, such as how much further the subject should tilt to reach a predetermined angle. For example, if the head angle at a certain point in time is slightly lower than the predetermined angle, a sentence indicating the degree of tilt, such as "Please tilt your head up a little more," may be included in the guidance message. Alternatively, the degree may be indicated using other means rather than expressing the degree verbally. For example, the message may be made to flash, and when the angle is significantly different from the predetermined angle, the message may be made to flash quickly, and when the deviation becomes smaller, the message may be made to flash slowly, indicating the degree. Alternatively, the color of the message may be changed to indicate the degree. Alternatively, the brightness at which the message is displayed may be changed according to the degree. In addition, the object that flashes or changes color may not be the message itself, but may be the background of the message or a frame surrounding the message.

[0079] [Sixth embodiment] Hereinafter, the sixth embodiment will be described. Since this embodiment is a modified example of the fourth embodiment, the description of the same elements as those in the first embodiment may be omitted or simplified.

[0080] FIG. 16 is a flowchart showing an outline of the matching process performed in the iris matching system according to this embodiment.

[0081] In step S114, the output unit 111 outputs guidance information for guiding the subject to change the gaze position. This guidance information may be, for example, display information for displaying on the display device 108 a message, an image, or the like, that prompts the subject to move his / her gaze.

[0082] In step S115, the display control unit 112 controls the display device 108 based on the guidance information, so that the display device 108 displays an instruction to guide the subject to change the gaze position.

[0083] FIG. 17 is an example of a stillness instruction displayed on the display device 108 during the matching process according to this embodiment. In response to the control of the display control unit 112, the display device 108 displays a stillness instruction such as "Keep your head in place." Please lower your gaze." The subject reads this message and lowers his gaze while keeping his head in the same position. After step S113, the process proceeds to step S109.

[0084] In step S109, the image acquisition unit 113 controls the imaging device 107 to capture an image including the iris of the subject. In this manner, the image acquisition unit 113 acquires the iris image of the subject. After acquiring the iris image, the process proceeds to step S104. The subsequent processes from step S104 to step S106 are the same as those in the first embodiment, and therefore will not be described.

[0085] As described above, in this embodiment, when it is detected that the head angle is within a predetermined range, the subject is instructed to change the gaze position without changing the head position, and then an iris image is captured. This not only provides the same effect as the fourth embodiment, but also captures the iris with the gaze moved. This makes it possible to obtain an iris image in a state where the area of ​​the iris that is not covered by the eyelids or the like has been further changed. For example, when an instruction is given to lower the gaze as shown in FIG. 17, the eyeball rotates downward, making it even more difficult for the upper part of the iris to be covered by the eyelids or the like, which is more effective in capturing an image of the upper part of the iris.

[0086] [Seventh embodiment] Hereinafter, the seventh embodiment will be described. Since this embodiment is a modification of the first embodiment, the description of the same elements as those in the first embodiment may be omitted or simplified.

[0087] FIG. 18 is a flowchart showing an outline of the matching process performed in the iris matching system according to this embodiment. In this embodiment, the process from step S101 to step S103 is performed multiple times in a loop process. In this loop process, guidance is given to steps S101 and S102 so that the angle of the head is different for each process when the iris image is photographed in step S103. This makes it possible to obtain multiple iris images with different head angles. A specific example of multiple iris images is obtaining at least two iris images, one with the head raised and one with the head lowered. When the acquisition of a predetermined type or number of iris images is completed, this loop process ends and the process proceeds to step S104. The subsequent processes from step S104 to step S106 are generally similar to those in the first embodiment, and therefore will not be described.

[0088] 19 is an example of a guidance display displayed on the display device 108 during the matching process according to this embodiment. The display device 108 displays a message to the effect of "Please move your head up slowly" in accordance with the control of the display control unit 112. This message may change for each processing iteration of the loop from step S101 to step S103. For example, when the iris image is captured for the first time, "Please move your head up slowly" is displayed, and when the iris image is captured for the second time, "Please move your head down slowly" is displayed, thereby realizing guidance for the subject to move his head up and down.

[0089] The effect of acquiring multiple iris images with different head angles will be described. As shown in FIG. 8B, when an iris image is captured with the subject's head raised, the upper side of the iris is less likely to be covered by the upper eyelid or upper eyelashes, but instead the lower side of the iris may be more likely to be covered by the lower eyelid or lower eyelashes. In contrast, as shown in FIG. 7B, when the subject holds his / her head straight or lowered, the upper side of the iris is more likely to be covered by the upper eyelid or upper eyelashes, but the lower side of the iris is less likely to be covered by the lower eyelid or lower eyelashes. Therefore, the range of the iris covered by the eyelids or the like may vary depending on the head angle. Therefore, in this embodiment, multiple iris images with different head angles are acquired. As a result, in addition to obtaining the same effect as the first embodiment, multiple iris images with different ranges covered by the eyelids or the like can be acquired. By performing iris matching using these multiple iris images, the accuracy of iris matching is improved.

[0090] In addition to the message "Please move your head up slowly," a message such as "Keep looking straight ahead and move your head up and down slowly according to the guidance on the screen" may be displayed. This makes it easier for the subject to understand the meaning of the guidance instructions.

[0091] An example of a matching method using multiple iris images is a method of performing matching on each of multiple feature quantities generated from multiple iris images. The matching results obtained in this way can be integrated to determine whether the subject and the registered person are the same person. The method of integrating the matching results may be, for example, a method of using the logical sum or logical product of each matching result as the final judgment result, or a method of determining the final judgment result using the sum of the scores obtained in each matching.

[0092] [Eighth embodiment] Hereinafter, the eighth embodiment will be described. Since this embodiment is a modification of the seventh embodiment, the description of the same elements as those in the seventh embodiment may be omitted or simplified.

[0093] 20 is a flowchart showing an outline of the matching process performed in the iris matching system according to this embodiment. In this embodiment, step S116 is added in the loop process from step S101 to step S103. In this embodiment, the guidance information includes information indicating an area where an iris image of the subject has been acquired. In step S116, the display control unit 112 controls the display device 108 based on the guidance information. As a result, the display device 108 displays information indicating an area where an iris image has been captured, in addition to guidance instructions for guiding the user to move his / her head while gazing at a predetermined position.

[0094] 21 is an example of a guidance display displayed on display device 108 during the matching process according to this embodiment. Display device 108 displays a schematic diagram showing an area where an iris image has been acquired, according to the control of display control unit 112. This schematic diagram includes object OB2 including an annular area imitating an iris, and object OB2 includes colored area R1 and non-colored area R2. Colored area R1 indicates an area where an iris image not covered by eyelids or the like has already been acquired, and non-colored area R2 indicates an area where an iris image not covered by eyelids or the like has not been acquired.

[0095] While looking at the object OB2, the subject moves his / her head up and down while checking that the colored range of the object OB2 is expanding. The subject can know the range in which the iris image has been acquired, and can move his / her head while checking that the image capturing is progressing. In this way, in addition to obtaining the same effect as the seventh embodiment, multiple iris images can be captured more smoothly.

[0096] For example, a guidance message such as "Move your head up and down until your irises are completely colored" may be displayed together with the object OB2. This makes it easier for the subject to understand what the object OB2 means.

[0097] Note that the display device 108 may further display a message, object, etc., indicating the direction in which to move the head, instead of the object OB2 shown in Fig. 21. Alternatively, the display device 108 may display both the object OB2 shown in Fig. 21 and a message, object, etc., indicating the direction in which to move the head. This allows the subject to more clearly understand in which direction to move his / her head.

[0098] [Ninth embodiment] Hereinafter, the ninth embodiment will be described. Since this embodiment is a modification of the seventh embodiment, the description of the same elements as those in the seventh embodiment may be omitted or simplified.

[0099] 22 is a flowchart showing an outline of the matching process performed in the iris matching system according to this embodiment. In this embodiment, step S117 is added after feature amounts are generated for each of the captured iris images in step S104.

[0100] In step S117, the feature generating unit 114 performs a process of synthesizing the feature amounts extracted from the multiple iris images in step S104 to generate a feature amount for iris matching.

[0101] An example of the process of step S117 will be described with reference to FIG. 23. FIG. 23 is a schematic diagram showing an outline of the feature synthesis process performed in the iris matching system of this embodiment. First, feature values ​​are extracted from the iris region R3 of the iris image P1 when the subject faces forward, and the iris region R4 of the iris image P2 when the subject moves his / her head up while gazing forward. The iris region R3 and the iris region R4 are different regions due to the difference in the range covered by the eyelids, etc. However, the iris region R3 and the iris region R4 have a common region R5. Since the iris image P1 and the iris image P2 are acquired from the same person, the feature values ​​extracted from the common region R5 are generally the same between the iris image P1 and the iris image P2, except for differences due to noise, etc.

[0102] Therefore, the iris region R3 and the iris region R4 are aligned and superimposed using a part or all of the feature values ​​extracted from the common region R5. The alignment may include processes such as translation, enlargement, reduction, and rotation. The region obtained by superimposition is the composite region R6 in FIG. 23. The feature value of the composite region R6 can be generated by combining the feature value of the iris region R3 and the feature value of the iris region R4. In addition, for a region where only one of the feature values ​​of the iris region R3 and the feature value of the iris region R4 can be extracted (i.e., a region outside the common region R5), the feature value of that one is adopted as the feature value of the composite region R6 as it is. For the feature value of the common region R5, either the feature value of the iris region R3 or the feature value of the iris region R4 may be adopted as the feature value of the composite region R6, or both may be combined and adopted as the feature value of the composite region R6. In another example, the feature value of the common region R5 may be an average of the feature values ​​of the iris region R3 and the feature values ​​of the iris region R4. As yet another example, images may be synthesized and then feature amounts may be extracted, rather than synthesizing images after feature amounts are extracted. That is, when pixel values ​​exist in only one of the iris regions R3 and R4, the pixel values ​​may be used as they are, and in the synthesis region R6, pixel values ​​may be calculated using either the pixel values ​​of the iris region R3 or the iris region R4, or by combining both. Then, iris feature amounts may be extracted from the resulting synthetic image.

[0103] According to this embodiment, in addition to obtaining the same effects as those of the seventh embodiment, by using two iris images, it is possible to generate features from a wide range of the iris, thereby realizing more accurate iris matching.

[0104] The feature synthesis process as shown in the ninth embodiment is not necessarily limited to being used in combination with the processes in steps S101 and S102. For example, the process of inducing the subject to move his / her head may be omitted.

[0105] The device or system described in the above-mentioned embodiments can also be configured as in the following tenth to twenty-ninth embodiments.

[0106] [Tenth embodiment] 24 is a functional block diagram of an information acquisition device 3 according to a tenth embodiment. The information acquisition device 3 includes an output means 301 and an image acquisition means 302. The output means 301 outputs guidance information for guiding a subject to move his / her head while gazing at a predetermined position. After outputting the guidance information, the image acquisition means 302 acquires an image including the iris of the subject.

[0107] According to this embodiment, an information acquisition device 3 is provided that can further reduce the influence of the eyelids or the like covering the iris.

[0108] [Eleventh embodiment] The information acquisition device 3 according to this embodiment has the following configuration in addition to the configuration of the tenth embodiment: The guidance information of this embodiment includes information for guiding the subject to move his / her head up.

[0109] According to the present embodiment, in addition to obtaining the effects of the tenth embodiment, an information acquisition device 3 is provided that can further reduce the influence of the upper side of the iris being covered by the eyelid or the like.

[0110] [Twelfth embodiment] The information acquisition device 3 according to this embodiment has the following configuration in addition to the configuration of the tenth or eleventh embodiment: The image acquisition means 302 of this embodiment acquires a plurality of images in which the angles of the subject's head are different from each other.

[0111] According to this embodiment, in addition to obtaining the effects of the tenth or eleventh embodiment, an information acquisition device 3 is provided that can acquire multiple iris images in which the areas covered by the eyelids, etc. are different.

[0112] [Thirteenth embodiment] 25 is a functional block diagram of an information acquisition device 3 according to the 13th embodiment. In addition to the components of the information acquisition device 3 of the 12th embodiment, the information acquisition device 3 further includes a feature generating means 303. The feature generating means 303 extracts feature amounts from each of a plurality of images to generate a plurality of feature amounts for iris matching.

[0113] According to this embodiment, in addition to obtaining the effects of the twelfth embodiment, an information acquisition device 3 is provided that can acquire multiple features based on multiple iris images in which the areas covered by the eyelids, etc. are different.

[0114] [Fourteenth embodiment] 26 is a functional block diagram of an information acquisition device 3 according to the 14th embodiment. In addition to the components of the information acquisition device 3 of the 12th embodiment, the information acquisition device 3 further includes a feature generating means 303. The feature generating means 303 generates a feature for iris matching by synthesizing feature amounts extracted from each of a plurality of images.

[0115] According to the present embodiment, in addition to obtaining the effects of the twelfth embodiment, an information acquisition device 3 capable of generating feature amounts from a wide range of the iris is provided.

[0116] [Fifteenth embodiment] 27 is a functional block diagram of an information acquisition device 3 according to the fifteenth embodiment. The information acquisition device 3 includes the components of the information acquisition device 3 according to any one of the tenth to fourteenth embodiments, and further includes eyelid detection means 304. The eyelid detection means 304 detects the degree to which the subject's eyelids are open.

[0117] According to the present embodiment, in addition to obtaining the effects of any one of the tenth to fourteenth embodiments, an information acquisition device 3 capable of acquiring information on the degree of eyelid opening is provided.

[0118] [Sixteenth embodiment] The information acquisition device 3 according to this embodiment has the following configuration in addition to the configuration of the fifteenth embodiment. The output means 301 of this embodiment outputs guidance information when the degree of eyelid opening detected by the eyelid detection means 304 is smaller than a predetermined value.

[0119] According to the present embodiment, in addition to obtaining the effects of the fifteenth embodiment, an information acquisition device 3 is provided that can speed up the matching process by omitting a guidance instruction when it is unnecessary.

[0120] [Seventeenth embodiment] 28 is a functional block diagram of an information acquisition device 3 according to the seventeenth embodiment. The information acquisition device 3 includes an angle detection means 305 in addition to the components of the information acquisition device 3 according to any one of the tenth to sixteenth embodiments. The angle detection means 305 detects the angle of the subject's head.

[0121] According to the present embodiment, in addition to obtaining the effects of any one of the tenth to sixteenth embodiments, an information acquisition device 3 capable of acquiring information on the angle of the head is provided.

[0122] [Eighteenth embodiment] The information acquisition device 3 according to this embodiment has the following configuration in addition to the configuration of the 17th embodiment. The guidance information of this embodiment includes information indicating whether the angle of the subject's head is appropriate for image acquisition.

[0123] According to the present embodiment, in addition to obtaining the effects of the seventeenth embodiment, an information acquisition device 3 is provided that can acquire information indicating whether the head angle is appropriate.

[0124] [Nineteenth embodiment] The information acquisition device 3 according to this embodiment has the following configuration in addition to the configuration of the 17th or 18th embodiment. The guidance information of this embodiment includes information for guiding the subject to keep his / her head still when the angle of the subject's head is appropriate for acquiring the image.

[0125] According to this embodiment, in addition to obtaining the effects of the seventeenth or eighteenth embodiment, an information acquisition device 3 is provided that can acquire a high-quality iris image with reduced subject blurring in the image.

[0126] [Twentieth embodiment] The information acquisition device 3 according to this embodiment has the following configuration in addition to the configuration of the 19th embodiment. The guidance information of this embodiment includes information for guiding the subject to move his / her line of sight while keeping his / her head still.

[0127] According to the present embodiment, in addition to obtaining the effects of the nineteenth embodiment, there is provided an information acquisition device 3 capable of acquiring an iris image in a state in which the area of ​​the iris not covered by the eyelids or the like has been further changed.

[0128] [Twenty-first embodiment] The information acquisition device 3 according to this embodiment has the following configuration in addition to the configuration of any one of the seventeenth to twentieth embodiments. The output means 301 of this embodiment changes the display on the display device when the angle of the subject's head is appropriate for image acquisition.

[0129] According to this embodiment, in addition to obtaining the effects of any one of the 17th to 20th embodiments, an information acquisition device 3 is provided that realizes a user interface that can inform the user whether or not the head angle is appropriate through a more intuitive and easy-to-understand display.

[0130] [Twenty-second embodiment] The information acquisition device 3 according to this embodiment has the following configuration in addition to the configuration of any one of the tenth to twenty-first embodiments. The guidance information of this embodiment includes information indicating an area of ​​the iris of the subject where an image has been captured.

[0131] According to this embodiment, in addition to obtaining the effects of any one of the tenth to twenty-first embodiments, an information acquisition device 3 is provided that allows the user to move his / her head while checking the progress of imaging, thereby enabling iris images to be captured more smoothly.

[0132] [Twenty-third embodiment] The information acquisition device 3 according to this embodiment has the following configuration in addition to the configuration of any one of the tenth to twenty-second embodiments. The output means 301 of this embodiment displays on a display device a message or an image that prompts the subject to move his / her head.

[0133] According to the present embodiment, in addition to obtaining the effects of any one of the tenth to twenty-second embodiments, an information acquisition device 3 capable of conveying guidance information in a visually easy-to-understand manner is provided.

[0134] [Twenty-fourth embodiment] The information acquisition device 3 according to this embodiment has the following configuration in addition to the configuration of any one of the tenth to twenty-third embodiments. The output means 301 of this embodiment causes an audio device to emit a voice prompting the subject to move his / her head.

[0135] According to this embodiment, in addition to obtaining the effects of any one of the tenth to twenty-third embodiments, an information acquisition device 3 is provided in which guidance information is conveyed by voice, thereby reducing eye movement and potentially obtaining a more suitable iris image.

[0136] [Twenty-fifth embodiment] The information acquisition device 3 according to this embodiment has the following configuration in addition to the configuration of any one of the tenth to twenty-fourth embodiments. The output means 301 of this embodiment operates a guidance member so as to prompt the subject to move his / her head.

[0137] According to the present embodiment, in addition to obtaining the effects of any one of the tenth to twenty-fourth embodiments, an information acquisition device 3 capable of conveying instructions in a more easily understandable manner is provided.

[0138] [Twenty-sixth embodiment] The information acquiring device 3 according to this embodiment has the following configuration in addition to the configuration of any one of the tenth to twenty-fifth embodiments. The output means 301 of this embodiment displays information indicating a place where a subject should gaze on a display device.

[0139] According to this embodiment, in addition to obtaining the effects of any one of the tenth to twenty-fifth embodiments, an information acquisition device 3 is provided in which eye movement is reduced and a more suitable iris image may be obtained.

[0140] [Twenty-seventh embodiment] 29 is a functional block diagram of an iris matching system 10 according to the 27th embodiment. The iris matching system 10 includes an information acquisition device 3 according to any one of the 10th to 26th embodiments, and a matching device 11 that performs matching based on an image acquired by the information acquisition device 3.

[0141] According to the present embodiment, there is provided an iris matching system 10 that can realize iris matching with reduced influence of the iris being covered by the eyelids or the like.

[0142] [Twenty-eighth embodiment] 30 is a functional block diagram of an information acquisition device 4 according to the 28th embodiment. The information acquisition device 4 includes an image acquisition means 401 and an output means 402. The image acquisition means 401 acquires an image including the iris of a subject. The output means 402 outputs information indicating whether or not the angle of the subject's head is appropriate for acquiring an image.

[0143] According to this embodiment, an information acquisition device 4 is provided that can further reduce the influence of the eyelids or the like covering the iris.

[0144] [Twenty-ninth embodiment] 31 is a functional block diagram of an information acquisition device 5 according to the 29th embodiment. The information acquisition device 5 includes an image acquisition means 501 and a feature amount generation means 502. The image acquisition means 501 acquires a plurality of images each including an iris of a subject. The feature amount generation means 502 generates a feature amount for iris matching by synthesizing the feature amounts extracted from each of the plurality of images.

[0145] According to this embodiment, there is provided an information acquisition device 5 that can further reduce the influence of the iris being covered by the eyelids or the like.

[0146] [Modified embodiment] The present disclosure is not limited to the above-described embodiments, and may be modified as appropriate within the scope of the present disclosure. For example, an example in which a part of the configuration of any of the embodiments is added to another embodiment, or an example in which a part of the configuration of any of the embodiments is replaced with another embodiment, is also an embodiment of the present disclosure. In addition, although the present disclosure has described the acquisition of iris information for matching, the guidance of the present disclosure may be used in the acquisition of iris information for registration.

[0147] The display examples of the guidance instruction, the stillness instruction, and the like in each of the above-described embodiments are merely examples, and are not limited to those exemplified. Furthermore, the method of presenting the guidance instruction, the stillness instruction, and the like is not limited to display on the display device 108.

[0148] 6 shows an example in which a message is displayed on the display device 108, but the message may be audibly output from an audio device such as a speaker to provide guidance, standstill, etc. In this method, the subject does not need to read the message, so eye movement that may occur when reading a message is reduced, and a more suitable iris image may be obtained.

[0149] Also, an audio device that outputs a voice message and a display on the display device 108 may be combined. FIG. 32 shows an example of a guidance instruction displayed on the display device 108 during a matching process according to a modified embodiment. The iris image acquisition device 1 shown in FIG. 32 further includes an audio device 109 that outputs a sound. An object OB3 for fixing the subject's gaze is displayed on the display device 108. In this state, the audio device 109 issues a message such as "Please move your head up slowly while looking at the star on the screen," so that the subject can be instructed to move his / her head while fixing his / her gaze on the object OB3. With this method, a more suitable iris image may be obtained.

[0150] In addition, when a guidance instruction, a stillness instruction, or the like is presented on the display device 108, the instruction may be presented by a figure, a symbol, an illustration, or the like, instead of a character. FIG. 33 shows an example of a guidance instruction displayed on the display device 108 during a matching process according to a modified embodiment. On the display device 108, an object OB4 imitating a subject and an object OB5 imitating an iris image acquisition device 1 are shown by illustrations. The object OB4 shows a state in which the subject moves his / her head while gazing at the iris image acquisition device 1. This display may be a still image or a video. In this method, instructions to the subject can be visually conveyed more clearly. In addition, unlike a message, figures, symbols, illustrations, and the like have the advantage of being language independent. Therefore, they are more effective in iris matching in situations such as immigration inspections where speakers of various languages ​​may use the system.

[0151] In the example of Fig. 33, object OB4 imitating the target person is an image displayed on display device 108, but object OB4 may be a physical guiding member instead of an image. A guiding member such as a doll imitating the target person similar to object OB4 may be placed near imaging device 107, and instructions may be conveyed to the target person by making the guiding member move its head similar to the case of object OB4. With this technique, instructions can be conveyed to the target person in a way that is easier to understand than with an image.

[0152] In the above-described embodiment, the influence of the eyelids, eyelashes, etc. obscuring the iris by moving the head is reduced, but the influence of other factors obscuring the iris may also be reduced. For example, when the iris is obscured by the frame of glasses, the iris may be obscured by the reflected image on the lenses of the glasses. In such a case, the influence of the iris being obscured may also be reduced by moving the head to change the angle. Instead of the angle detection in the third embodiment, a process may be performed to detect whether the subject is wearing glasses, and if the subject is wearing glasses, a guidance instruction to move the head may be given.

[0153] In the above-described embodiment, an example has been described in which the subject is instructed to move his / her neck, but the embodiment may be modified so that the iris image acquisition device 1 is moved instead. FIG. 34 is a schematic diagram showing the configuration of the iris image acquisition device 1 according to the modified embodiment. The iris image acquisition device 1 is supported by a movable member 9. The movable member 9 expands and contracts in response to control from the iris image acquisition device 1, thereby changing the height of the iris image acquisition device 1. This allows the iris image acquisition device 1 to move in the vertical direction.

[0154] In this modified embodiment, instead of the instruction to guide the subject to move his / her head while gazing at a predetermined position in steps S101 and S102, the subject is instructed to move his / her line of sight following the movement of the iris image acquisition device 1, and the movable member 9 is extended or contracted. More specifically, the iris image acquisition device 1 is moved downward while the subject is gazing at the imaging device 107 of the iris image acquisition device 1. As the subject follows the movement of the imaging device 107 with his / her eyes, the line of sight L1 in FIG. 34 moves to the line of sight L2. The imaging device 107 then captures an iris image from below. At this time, if the movement causes the iris area to go beyond the range that the imaging device 107 can capture, the direction of the imaging device 107 may be adjusted so that it faces the direction of the iris area.

[0155] In this modified embodiment, the line of sight is moved downward with the movement of the imaging device 107, so that the subject's eyeball rotates downward. In this case, the iris moves downward, and the area above the iris that is covered by the upper eyelid or the like may decrease. Therefore, even in this modified embodiment, an information acquisition device that can reduce the influence of the iris being covered by the eyelid or the like can be provided.

[0156] Note that the configuration in which the movable member 9 moves the iris image acquisition device 1 may be replaced with a configuration in which the position of the imaging device 107 for capturing an iris image is changed. In this modified example, an iris image acquisition device 1 in which a plurality of imaging devices 107 are arranged vertically may be used. Instead of moving the iris image acquisition device 1 downward, the imaging device 107 performing the image capture may be switched from an upper imaging device 107 to a lower imaging device 107, thereby achieving the same processing. This configuration has the advantage of simplifying the device mechanism since the movable member 9 is not necessary.

[0157] The scope of each embodiment also includes a processing method in which a program that operates the configuration of the embodiment to realize the functions of the above-mentioned embodiment is recorded on a storage medium, the program recorded on the storage medium is read as code, and executed on a computer. That is, a computer-readable storage medium is also included in the scope of each embodiment. In addition, not only the storage medium on which the above-mentioned program is recorded, but also the program itself is included in each embodiment. Furthermore, one or more components included in the above-mentioned embodiments may be circuits such as ASICs (Application Specific Integrated Circuits) and FPGAs (Field Programmable Gate Arrays) configured to realize the functions of each component.

[0158] Examples of the storage medium that can be used include a floppy disk, a hard disk, an optical disk, a magneto-optical disk, a CD (Compact Disk)-ROM, a magnetic tape, a non-volatile memory card, and a ROM. In addition, the scope of each embodiment does not include those that execute processing by themselves recorded on the storage medium, but also those that execute processing by operating on an OS (Operating System) in cooperation with other software and functions of an expansion board.

[0159] The services realized by the functions of the above-described embodiments can also be provided to users in the form of SaaS (Software as a Service).

[0160] It should be noted that the above-described embodiments are merely examples of the implementation of the present disclosure, and the technical scope of the present disclosure should not be interpreted as being limited by these embodiments. In other words, the present disclosure can be implemented in various forms without departing from its technical concept or main features.

[0161] A part or all of the above-described embodiments can be described as, but is not limited to, the following supplementary notes.

[0162] (Appendix 1) an output means for outputting guidance information for guiding a subject to move his / her head while gazing at a predetermined position; an image acquisition unit that acquires an image including an iris of the subject after the guidance information is output; An information acquisition device comprising:

[0163] (Appendix 2) The guidance information includes information for guiding the subject to move his / her head up. 2. The information acquisition device according to claim 1.

[0164] (Appendix 3) The image acquisition means acquires a plurality of images in which the head angles of the subject are different from each other. 3. The information acquisition device according to claim 1 or 2.

[0165] (Appendix 4) a feature generating unit for generating a plurality of feature values ​​for iris matching by extracting feature values ​​from each of the plurality of images; 4. The information acquisition device according to claim 3.

[0166] (Appendix 5) a feature generating unit configured to generate a feature for iris matching by synthesizing the feature extracted from each of the plurality of images, 4. The information acquisition device according to claim 3.

[0167] (Appendix 6) The apparatus further includes an eyelid detection means for detecting an opening degree of the eyelids of the subject. 6. An information acquisition device according to any one of claims 1 to 5.

[0168] (Appendix 7) The output means outputs the guidance information when the degree of eyelid opening detected by the eyelid detection means is smaller than a predetermined value. 7. The information acquisition device according to claim 6.

[0169] (Appendix 8) An angle detection means for detecting an angle of the subject's head is further provided. 8. An information acquisition device according to any one of claims 1 to 7.

[0170] (Appendix 9) The guidance information includes information indicating whether or not a head angle of the subject is appropriate for acquiring the image. 9. The information acquisition device according to claim 8.

[0171] (Appendix 10) The guidance information includes information for guiding the subject to keep his / her head still when the angle of the subject's neck is appropriate for acquiring the image. 10. The information acquisition device according to claim 8 or 9.

[0172] (Appendix 11) The guidance information includes information for guiding the subject to move his / her gaze while keeping his / her head still. 11. The information acquisition device according to claim 10.

[0173] (Appendix 12) The output means changes a display on a display device when the angle of the subject's head is appropriate for acquiring the image. 12. An information acquisition device according to any one of claims 8 to 11.

[0174] (Appendix 13) The guidance information includes information indicating a region of the iris of the subject where an image has been captured. 13. An information acquisition device according to any one of claims 1 to 12.

[0175] (Appendix 14) The output means displays, on a display device, a message or an image prompting the subject to move his / her head. 14. An information acquisition device according to any one of claims 1 to 13.

[0176] (Appendix 15) The output means causes an audio device to emit a voice prompting the subject to move his / her head. 15. An information acquisition device according to any one of claims 1 to 14.

[0177] (Appendix 16) The output means operates a guidance member to prompt the subject to move his / her head. 16. An information acquisition device according to any one of claims 1 to 15.

[0178] (Appendix 17) The output means displays information indicating a place where the subject should gaze on a display device. 17. An information acquisition device according to any one of claims 1 to 16.

[0179] (Appendix 18) An image acquisition means for acquiring an image including an iris of a subject; an output means for outputting information indicating whether the angle of the subject's head is appropriate for acquiring the image; An information acquisition device comprising:

[0180] (Appendix 19) image capture means for capturing a plurality of images each including an iris of a subject; a feature generating means for generating a feature for iris matching by synthesizing the feature extracted from each of the plurality of images; An information acquisition device comprising:

[0181] (Appendix 20) An information acquisition device according to any one of Supplementary Notes 1 to 19; A matching device that performs matching based on the image; An iris matching system comprising:

[0182] (Appendix 21) outputting guidance information for guiding the subject to move his / her head while gazing at a predetermined position; acquiring an image including an iris of the subject after outputting the guidance information; An information acquisition method comprising:

[0183] (Appendix 22) acquiring an image including an iris of a subject; outputting information indicating whether the subject's head angle is correct for acquisition of the image; An information acquisition method comprising:

[0184] (Appendix 23) acquiring a plurality of images, each including an iris of a subject; generating a feature for iris matching by combining the feature amounts extracted from each of the plurality of images; An information acquisition method comprising:

[0185] (Appendix 24) On the computer, outputting guidance information for guiding the subject to move his / her head while gazing at a predetermined position; acquiring an image including an iris of the subject after outputting the guidance information; A storage medium storing a program for executing an information acquisition method comprising the steps of:

[0186] (Appendix 25) On the computer, acquiring an image including an iris of a subject; outputting information indicating whether the subject's head angle is correct for acquisition of the image; A storage medium storing a program for executing an information acquisition method comprising the steps of:

[0187] (Appendix 26) On the computer, acquiring a plurality of images, each including an iris of a subject; generating a feature for iris matching by combining the feature amounts extracted from each of the plurality of images; A storage medium storing a program for executing an information acquisition method comprising the steps of: [Explanation of symbols]

[0188] 1. Iris image acquisition device 2. Matching Server 3, 4, 5 Information acquisition device 9 Movable parts 10 Iris matching system 11. Verification device 101, 201 processors 102, 202 RAM 103, 203 ROM 104, 204 HDD 105, 205 Communication I / F 106 Operating device 107 Imaging Device 108 Display device 109 Sound equipment 111 Output section 112 Display control unit 113 Image acquisition unit 114 Feature Generation Unit 115, 211 I / F section 116 Eyelid detection unit 117 Angle detection unit 206 Input Device 207 Output Device 212 Collation Unit 213 Feature memory unit 301, 402 Output means 302, 401, 501 Image acquisition means 303, 502 Feature generation means 304 Eyelid detection means 305 Angle detection means EY Eyes IRS Iris L1, L2 line of sight NW Network OB1, OB2, OB3, OB4, OB5 objects PPL Pupil P1, P2 Iris images R1 colored area R2 Uncolored area R3, R4 iris area R5 Common Areas R6 Synthesis Field UELD Upper eyelid UELS upper eyelashes

Claims

1. an output means for outputting guidance information for guiding a subject to move his / her head while keeping his / her gaze fixed on a predetermined position; an image acquisition unit that acquires an image including an iris of the subject after the guidance information is output; Equipped with An information acquisition device, wherein the guidance information includes information for guiding the subject to move his / her head upward while gazing at the specified position.

2. The output means outputs information indicating a location where the subject should gaze. The information acquisition device according to claim 1 .

3. The output means outputs a message or an image to the subject, prompting the subject to move his / her head while gazing at the predetermined position. The information acquisition device according to claim 1 or 2.

4. The output means outputs information instructing to perform imaging. The information acquisition device according to claim 1 .

5. The output means outputs information instructing the subject to move his / her head before imaging. The information acquisition device according to claim 1 .

6. The method further includes an eyelid detection means for detecting an opening degree of the eyelids of the subject, The output means outputs the guidance information when the degree of eyelid opening detected by the eyelid detection means is smaller than a predetermined value. The information acquisition device according to claim 1 .

7. The image acquisition means acquires the image after the guidance information is output when the degree of eyelid opening is smaller than a predetermined value, and acquires the image in a state where the guidance information is not output when the degree of eyelid opening is equal to or larger than a predetermined value. The information acquisition device according to claim 6.

8. An angle detection means for detecting an angle of the subject's head is further provided, When the angle of the head of the subject is outside a predetermined range, the output means outputs the guidance information. The information acquisition device according to claim 1 .

9. outputting guidance information for guiding the subject to move his / her head while keeping his / her gaze fixed on a predetermined position; acquiring an image including an iris of the subject after outputting the guidance information; Equipped with An information acquisition method in which the guidance information includes information for guiding the subject to move his / her head upward while gazing at the specified position.

10. On the computer, outputting guidance information for guiding the subject to move his / her head while keeping his / her gaze fixed on a predetermined position; acquiring an image including an iris of the subject after outputting the guidance information; Equipped with A program for executing an information acquisition method, wherein the guidance information includes information for guiding the subject to move his / her head upward while gazing at the specified position.

Images