Iris imaging device, iris imaging method and program

The iris imaging device employs a rotatable mirror to efficiently capture high-resolution iris images by rotating and combining images, addressing the inefficiencies of existing multi-step, multi-camera methods, thereby improving speed and cost-effectiveness.

JP7590005B2Active Publication Date: 2024-11-26NEC CORP
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
JP2022145813
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Priority Date
2016-08-24
Filing Date
2022-09-14
Publication Date
2024-11-26
Estimated Expiration
2037-08-23

AI Technical Summary

Technical Problem

Existing iris authentication technologies require multiple imaging steps and multiple types of cameras, leading to inconvenient and time-consuming processes for obtaining high-resolution iris images, especially when imaging is performed from a distance with varying user positions and heights.

Method used

An iris imaging device that uses a rotatable movable mirror to capture images of different face areas, allowing high-resolution iris images to be obtained quickly by rotating the mirror and combining images using either a split or composite image method, without the need for multiple cameras.

Benefits of technology

The device enables rapid acquisition of high-resolution iris images by reducing the time required for imaging and eliminating the need for multiple cameras, thus enhancing user convenience and reducing manufacturing costs.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007590005000001
    Figure 0007590005000001
  • Figure 0007590005000002
    Figure 0007590005000002
  • Figure 0007590005000003
    Figure 0007590005000003
Patent Text Reader

Abstract

To provide a technology for acquiring an iris image with higher resolution more quickly than before. [Solution] An iris imaging device according to one embodiment of the present invention comprises an imaging unit that images a person, a detection unit that detects a person present within an area of ​​the imaging unit where iris photography is possible, an irradiation unit that irradiates the person with infrared light, and a control unit, wherein the control unit causes the imaging unit to capture an image in a first imaging range, and if an iris image that can be iris-recognized cannot be captured, causes the imaging unit to capture an image in a second imaging range that is different vertically from the first imaging range, and if an iris image that can be iris-recognized is obtained, performs iris authentication.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to an apparatus, method and program for capturing an image of a human iris. [Background technology]

[0002] In recent years, iris recognition technology has been put to practical use to perform personal authentication using a person's iris. Because iris recognition uses the minute patterns of the iris, a high-resolution iris image is required to achieve iris recognition with sufficient accuracy. A high-resolution image is, for example, an image of the iris of one eye with about 400 pixels vertically and 400 pixels horizontally.

[0003] One method for obtaining a high-resolution iris image is to use a camera with a close-up lens close to the eye to capture the image. However, it is inconvenient to have to bring the user's eye close to the camera or vice versa every time iris authentication is performed.

[0004] In order to improve user convenience, it is desirable to capture a high-resolution iris image at a position away from the user. When capturing an iris image at a position away from the user, there are difficulties in that the position of the user is uncertain and there are individual differences in height and the like between users. In addition, since there is a limit to how high the resolution of a camera can be, it is difficult to capture an image of the entire range in which the user's iris may exist at high resolution in a short period of time. Therefore, there is a demand for a technology for acquiring a high-resolution iris image at a position away from the user.

[0005] The technology described in Patent Document 1 first uses a wide-angle camera to capture multiple images covering a wide range, and then identifies the position of a person's eyes from a combined image of the multiple images. The technology then focuses a telephoto camera on the eye position to capture an image including the iris. With this configuration, it is possible to capture a high-resolution iris image even if there is a positional shift or individual differences between users.

[0006] The technology described in Patent Document 2 first uses two person position cameras to obtain an image including a person, and then detects the vertical position of the iris from the image. Next, the technology adjusts the vertical angle of a mirror installed on the optical path of the iris camera to the position of the iris, and then captures multiple images using the iris camera while rotating the mirror left and right. The technology then selects an image including the iris from the multiple images. With this configuration, a high-resolution iris image can be obtained even if there is a positional deviation or individual differences between users. [Prior art documents] [Patent documents]

[0007] [Patent Document 1] Japanese Patent Application Publication No. 10-137224 [Patent Document 2] JP 2000-237169 A Summary of the Invention [Problem to be solved by the invention]

[0008] However, both of the techniques described in Patent Documents 1 and 2 require at least two imaging steps using multiple types of cameras, including a step of capturing a wide range of images to identify the position of the iris, and a step of capturing an iris image by capturing an image of only the iris. Therefore, the techniques described in Patent Documents 1 and 2 require a long time for capturing images and detecting the iris, which is inconvenient for users, and is difficult to apply to walk-through authentication, which performs iris authentication on a user who is moving.

[0009] The present invention has been made in consideration of the above problems, and has an object to provide a technique for acquiring a high-resolution iris image more quickly than ever before. [Means for solving the problem]

[0010] A first aspect of the present invention is an iris imaging device comprising an imaging unit that images a person, a detection unit that detects a person present within an area of ​​the imaging unit where iris photography is possible, an irradiation unit that irradiates the person with infrared light, and a control unit, wherein the control unit causes the imaging unit to capture an image in a first imaging range, and if an iris image capable of iris authentication cannot be captured, causes the imaging unit to capture an image in a second imaging range that is vertically different from the first imaging range, and if an iris image capable of iris authentication is obtained, performs iris authentication.

[0011] A second aspect of the present invention is an iris imaging method using an apparatus including an imaging unit that images a person, a detection unit that detects a person present within an area of ​​the imaging unit where iris photography is possible, and an irradiation unit that irradiates the person with infrared light, wherein the imaging unit is caused to image in a first imaging range, and if an iris image capable of iris authentication cannot be captured, the imaging unit is caused to image in a second imaging range that is vertically different from the first imaging range, and if an iris image capable of iris authentication is obtained, iris authentication is performed.

[0012] A third aspect of the present invention is a program that causes a computer to have an apparatus including an imaging unit that images a person, a detection unit that detects a person present within an area of ​​the imaging unit where iris photography is possible, and an irradiation unit that irradiates the person with infrared light, and causes the imaging unit to capture an image in a first imaging range, and if an iris image capable of iris authentication cannot be captured, causes the imaging unit to capture an image in a second imaging range that is vertically different from the first imaging range, and if an iris image capable of iris authentication is obtained, causes iris authentication to be performed.

[0013] According to the present invention, different areas of the user's face are repeatedly captured while the movable mirror is rotated, and an image of the user's iris is obtained from a group of output images. Since the movable mirror can be rotated faster than a camera, an iris image can be obtained quickly. Furthermore, since different areas of the user's face are captured while the movable mirror is rotated, a high-resolution iris image can be obtained without the need for multiple types of cameras. [Brief description of the drawings]

[0014] [Figure 1] 1 is a schematic diagram of an iris imaging device according to a first embodiment. [Diagram 2] 1 is a schematic diagram illustrating the configuration of an iris image pickup device according to a first embodiment. [Diagram 3] 2A to 2C are schematic diagrams illustrating an imaging method using the iris imaging device according to the first embodiment. [Figure 4] 1 is a block diagram of an iris imaging device according to a first embodiment. [Diagram 5] FIG. 2 is a schematic diagram of a divided image type iris image acquisition method according to the first embodiment. [Figure 6] FIG. 2 is a schematic diagram of an iris image acquisition method using a synthetic image method according to the first embodiment. [Figure 7] FIG. 2 is a flowchart illustrating an iris imaging method according to the first embodiment. [Figure 8] FIG. 4 is a flowchart showing an imaging process according to the first embodiment. [Figure 9] FIG. 4 is a flowchart showing a process of acquiring an iris image by a divided image method according to the first embodiment. [Figure 10] FIG. 4 is a flowchart showing a synthetic image type iris image acquisition process according to the first embodiment. [Figure 11] FIG. 11 is a schematic diagram of an iris image pickup device according to a second embodiment. [Figure 12] 7A to 7C are schematic diagrams illustrating an imaging method using an iris imaging device according to a second embodiment. [Figure 13] FIG. 11 is a block diagram of an iris image pickup device according to a second embodiment. [Figure 14] FIG. 11 is a flowchart illustrating an iris imaging method according to a second embodiment. [Figure 15] 1 is a schematic diagram illustrating the configuration of an iris image pickup device according to each embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0015] Hereinafter, an embodiment of the present invention will be described with reference to the drawings, but the present invention is not limited to this embodiment. In the drawings described below, parts having the same functions are given the same reference numerals, and repeated description thereof may be omitted.

[0016] (First embodiment) 1 is a schematic diagram of an iris image capture device 100 according to this embodiment. The iris image capture device 100 includes a camera 110 that captures an image of the iris of a user A, a rotatable movable mirror 120, a light source 130 that irradiates light toward the user A, and a human sensor 140 that detects the presence of the user A.

[0017] Camera 110 is an imaging unit that captures an image using reflected light B that is irradiated from light source 130 onto user A and reflected therefrom, and outputs the captured image as digital data. Any imaging device such as a CCD (Charge Coupled Device) camera or a CMOS (Complementary Metal Oxide Semiconductor) camera may be used as camera 110. Camera 110 includes an imaging element, an electric circuit, a lens, and the like required for capturing images. Camera 110 is a narrow-angle camera, and is adjusted to capture an image of a part of the face of user A at one time via movable mirror 120.

[0018] In this embodiment, the light source 130 is an LED (Light Emitting Diode) that generates infrared light (wavelength 0.7 μm to 1.0 mm). The light source 130 irradiates the user A with infrared light when the camera 110 captures an image. The light source 130 is provided near the lens of the camera 110, and the light from the light source 130 is irradiated to the user A via the movable mirror 120. The number of light sources 130 is arbitrary, and it is preferable that a plurality of light sources 130 are provided so as to surround the side surface of the lens of the camera 110. The light source 130 is not limited to being near the camera 110, and may be provided at any position between the camera 110 and the mirror 120. Alternatively, the light source 130 may be provided between the mirror 120 and the user A. The light source 130 is not limited to an LED, and may be any light source such as an LD (Laser Diode) or a lamp. The light that the light source 130 irradiates to the user A is not limited to infrared light, and may be light of any wavelength depending on the purpose and environment of iris imaging.

[0019] Movable mirror 120 is provided on the optical path of light incident on camera 110. Movable mirror 120 is a mirror that guides light from light source 130 to user A, and further reflects reflected light B reflected on user A and guides it to the lens of camera 110. As movable mirror 120, any optical system capable of guiding reflected light B to the lens of camera 110, such as a plane mirror, a curved mirror, or a prism, may be used.

[0020] The movable mirror 120 includes a driving unit, and is rotated about a predetermined axis by being driven by the driving unit. In this embodiment, the driving unit is a stepping motor. The driving unit rotates the movable mirror 120, thereby changing the imaging range of the camera 110 on the user A. In other words, the rotation of the movable mirror 120 allows the camera 110 to scan the entire area of ​​the face of the user A.

[0021] The movable mirror 120 may rotate not only about one axis but also about two or more axes. Any other driving unit such as a motor or actuator may be used as the driving unit of the movable mirror 120 as long as it can change the angle of the reflecting surface of the movable mirror 120. Also, as the movable mirror 120, a galvanometer mirror may be used, which uses a mirror connected to a permanent magnet and an electromagnet provided facing the permanent magnet, and can rotate the mirror at high speed by controlling the current to the electromagnet.

[0022] The human sensor 140 is a sensor that detects the presence of user A within the imaging range of the camera 110. The iris imaging device 100 can start iris imaging when the presence of user A is detected by the human sensor 140. As the human sensor 140, any sensor capable of detecting the presence of a person, such as an infrared sensor or an ultrasonic sensor, may be used.

[0023] The iris image capturing device 100 captures an image of the user A's face with the camera 110 while rotating the movable mirror 120, thereby capturing an iris image of the user A by an iris image capturing method described below.

[0024] 2 is a schematic diagram of an iris imaging device 100 according to this embodiment. The iris imaging device 100 may be configured as a single device, or may be configured as two or more physically separated devices connected by wire or wirelessly. For example, the iris imaging device 100 may be a laptop computer, a desktop computer, a workstation, a personal digital assistant, a server, a blade server, a mainframe, an embedded system, or the like. The specific hardware configuration of the iris imaging device 100 is not limited to the following configuration, and may be of various types and forms.

[0025] The iris imaging device 100 has a processor 101, a memory 102, and a storage device 103. The iris imaging device 100 also has a high-speed controller 104 including a high-speed interface, and a low-speed controller 106 including a low-speed interface. The high-speed controller 104 is connected to the memory 102 and a high-speed expansion port 105. The high-speed controller 104 is also connected to a display device such as a display 108. On the other hand, the low-speed controller 106 is connected to a low-speed expansion port 107 and the storage device 103.

[0026] The processor 101, memory 102, storage device 103, high-speed controller 104, low-speed controller 106, and high-speed expansion port 105 are interconnected by various buses. The processor 101, memory 102, storage device 103, high-speed controller 104, low-speed controller 106, and high-speed expansion port 105 may be implemented on a common motherboard or in other suitable forms.

[0027] The processor 101 is, for example, a central processing unit (CPU) and is capable of processing instructions to be executed within the iris image capture device 100. Such instructions include instructions stored in the memory 102 or storage device 103 for displaying graphical information of a graphical user interface (GUI) on a display device such as the display 108.

[0028] Also, multiple processors, multiple buses, or multiple processors and multiple buses, along with multiple memories and types of memories, may be used as appropriate. Also, multiple iris imagers 100 may be connected together with each device performing some of the necessary processing. For example, multiple iris imagers 100 may be connected together as a server bank, a group of blade servers, or a multiprocessor system.

[0029] The memory 102 stores information in the iris imaging device 100. For example, the memory 102 is a volatile memory unit, a non-volatile memory unit, or a combination thereof. The memory 102 may be another computer-readable recording medium, such as a magnetic disk, an optical disk, etc.

[0030] The storage device 103 can provide mass storage for the iris imaging device 100. The storage device 103 is or includes a computer-readable recording medium, such as a floppy disk device, a hard disk device, an optical disk device, a tape device, a flash memory or other solid-state memory device, a disk array, etc. The storage device 103 may also be a storage area network or other configuration of device.

[0031] The high speed controller 104 manages the bandwidth intensive operations for the iris imager 100, while the low speed controller 106 manages the less bandwidth intensive operations. However, this allocation of functions is exemplary and not limiting. Also, some or all of the high speed controller 104 may be incorporated within the processor 101.

[0032] The high speed controller 104 is connected to the memory 102 and to a high speed expansion port 105 that can accept various expansion cards. The high speed controller 104 is also connected to a display 108, for example via a graphics processor or accelerator.

[0033] The low-speed controller 106 is connected to the storage device 103 and the low-speed expansion port 107. The low-speed expansion port 107 may include communication ports of various standards, such as USB (Universal Serial Bus), Bluetooth (registered trademark), and wired or wireless Ethernet (registered trademark). One or more input devices, such as a keyboard, a pointing device, and a scanner, are connected to the low-speed expansion port 107. Furthermore, the above-mentioned camera 110, the movable mirror 120, the light source 130, and the human sensor 140 are connected to the low-speed expansion port 107. Moreover, one or more network devices, such as a switch and a router, may be connected to the low-speed expansion port 107 via a network adapter, for example. That is, the low-speed expansion port 107 functions as a communication interface.

[0034] The iris imaging device 100 can be implemented in many different forms, including but not limited to the above. For example, the iris imaging device 100 can be implemented in a standard server or a group of such servers. The iris imaging device 100 can also be implemented as part of a rack server system. Furthermore, the iris imaging device 100 can be implemented in a personal computer, such as a laptop computer, a desktop computer, or the like.

[0035] In addition, some or all of the programs executed by the processor 101 of the iris imaging device 100 can be provided by a computer-readable recording medium such as a DVD-ROM (Digital Versatile Disc-Read Only Memory), a CD-ROM (Compact Disc-Read Only Memory), a USB memory, or other flash memory on which the programs are recorded.

[0036] FIG. 3 is a schematic diagram of an imaging method by the iris imaging device 100 according to this embodiment. FIG. 3 is a diagram showing the face of user A viewed from the front. In FIG. 3, the direction of gravity is the Y axis, and the direction perpendicular to the direction of gravity is the X axis. The movable mirror 120 is adjusted to rotate about the X axis. The camera 110 captures an image of an imaging area D1 including a part of the face of the user A at once. When the movable mirror 120 is rotated by a predetermined angle from the state of the imaging area D1, the camera 110 captures an image of an imaging area D2 moved a predetermined length in the Y axis direction. The camera 110 captures all areas of the face of the user A by rotating the movable mirror 120 a predetermined number of times and capturing images a predetermined number of times. After that, the iris imaging device 100 detects the iris A1 of the user A from the group of captured images and acquires an iris image.

[0037] The imaging areas D1 and D2 are rectangular areas that are longer in the X-axis direction (horizontal direction with respect to the face) than in the Y-axis direction (vertical direction with respect to the face). The camera 110 and the movable mirror 120 are arranged so that the vertical length of the imaging areas D1 and D2 is smaller than the vertical length of the face of the user A, and the horizontal length of the imaging areas D1 and D2 is larger than the horizontal length of the face of the user A. A preset size of a general human face may be used as the size of the face of the user A. With this configuration, the camera 110 can vertically scan the face of the user A, who may have various heights, and capture all areas, simply by rotating the movable mirror 120 about one axis (X-axis). In addition, since the vertical length of the imaging areas D1 and D2 is limited, a high-resolution iris image can be captured while suppressing the resolution required for the imaging element of the camera 110.

[0038] The adjacent imaging regions D1 and D2 form an overlapping region ΔD that overlaps a predetermined length along the vertical direction. By providing the overlapping region ΔD in this manner, the probability that the entire image of the iris A1 is included in at least one of the adjacent imaging regions D1 and D2 is improved, so that the probability that the iris A1 is divided and an iris image is not obtained can be reduced. The length of the overlapping region ΔD is preferably 1 / 2 or more of the vertical length of the imaging regions D1 and D2. As a result, each point on the face of the user A is included in both the adjacent imaging regions D1 and D2, so that the iris A1 can be effectively prevented from being divided.

[0039] For example, when using a camera 110 with an angle of view of 11 degrees, the distance between the camera 110 and the movable mirror 120 is 5 cm, and the distance between the movable mirror 120 and the user A is 30 cm, the vertical length of the imaging areas D1 and D2 is 2×tan(11 / 2)×(30+5)=6.7 cm. Since the vertical length of an average person's face is about 21 cm to 24 cm, even taking into account overlapping areas, an iris image of the user A can be obtained by rotating and capturing images about six times. The size of the imaging areas D1 and D2 may be set according to the arrangement of the iris imaging device 100 and the imaging environment.

[0040] Fig. 4 is a block diagram of the iris image capture device 100 according to this embodiment. In Fig. 4, the lines between blocks indicate main data flows, and there may be data flows other than those shown in Fig. 4. In Fig. 4, each block indicates a functional configuration, not a hardware (device) configuration.

[0041] The iris imaging device 100 includes a person detection unit 1001, a mirror control unit 1002, an imaging unit 1003, and an iris image acquisition unit 1004. In the iris imaging device 100, the person detection unit 1001, the mirror control unit 1002, the imaging unit 1003, and the iris image acquisition unit 1004 are stored in the memory 102 as programs executable by the processor 101. That is, when the iris imaging method according to this embodiment is executed, the processor 101 functions as the person detection unit 1001, the mirror control unit 1002, the imaging unit 1003, and the iris image acquisition unit 1004. At least some of these functions may be implemented as electric circuits rather than as programs.

[0042] The human detection unit 1001 uses the human sensor 140 to detect at predetermined time intervals (e.g., every 0.1 seconds) whether or not user A is present within the imaging range of the camera 110. The human detection unit 1001 stores the latest detection result in the memory 102 or the storage device 103. Based on the detection result by the human detection unit 1001, the mirror control unit 1002, the imaging unit 1003, and the iris image acquisition unit 1004 start iris imaging when user A is present.

[0043] The mirror control unit 1002 and the imaging unit 1003 capture an image of the face of the user A by the camera 110 while rotating the movable mirror 120. First, the mirror control unit 1002 transmits an electric signal to the movable mirror 120 to drive it and rotate the movable mirror 120 to a predetermined starting position. Next, the imaging unit 1003 irradiates light from the light source 130 to the user A and causes the camera 110 to capture a predetermined imaging range on the user A. Every time imaging is performed by the imaging unit 1003, the mirror control unit 1002 transmits an electric signal to the movable mirror 120 to drive it and rotate the movable mirror 120 by a predetermined angle. In this manner, the rotation by the mirror control unit 1002 and the imaging by the imaging unit 1003 are repeated. After the rotation by the mirror control unit 1002 and the imaging by the imaging unit 1003 are repeated a predetermined number of times, the imaging unit 1003 stores a group of captured images in the memory 102 or the storage device 103 and ends imaging. The start position of movable mirror 120, the angle of rotation of movable mirror 120, and the number of repetitions are set in advance according to the arrangement of camera 110 and movable mirror 120, and are recorded in storage device 103. The angle of one rotation of movable mirror 120 is preferably 7.5 degrees or less.

[0044] Furthermore, the number of times the movable mirror 120 rotates may be dynamically determined based on the position of the user A. In this case, the person detection unit 1001 measures the distance to the user A using the person sensor 140. Then, the mirror control unit 1002 determines the number of times the movable mirror 120 rotates based on the distance measured by the person detection unit 1001. This is because even if the movable mirror 120 is rotated at the same angle, the size of the imaging area on the user A changes depending on the distance from the camera 110. For example, the mirror control unit 1002 reduces the number of times the movable mirror 120 rotates when the user A is located far away, and increases the number of times the movable mirror 120 rotates when the user A is located close. With this configuration, it is possible to capture an image of the area including the top to bottom of the face of the user A an appropriate number of times.

[0045] The iris image acquisition unit 1004 acquires an iris image from the group of images acquired by the imaging unit 1003. The acquisition of an iris image from the group of images is performed by either a divided image method in which an image including an iris is selected from the group of images and the iris is extracted, or a composite image method in which one composite image is created from the group of images and the iris is extracted. Each method is described below.

[0046] FIG. 5 is a schematic diagram of an iris image acquisition method of the divided image method according to the present embodiment. First, the iris image acquisition unit 1004 acquires a group of divided images E captured by the imaging unit 1003 from the memory 102 or the storage device 103. The divided images E are images of different areas on the user A. Next, the iris image acquisition unit 1004 selects an image including a face area from the divided images E by performing a rough search for the face area. The rough search for the face area is performed based on the relative positional relationship between face parts such as eyebrows, eyes, nose, and mouth. For example, the rough positions of the eyebrows and mouth are acquired from the divided images E by template matching, and the divided images E including the eyebrows to the divided images E including the mouth are selected and used as the detection target for the iris. The rough search for the face area may be omitted and all the divided images E may be used as the detection target for the iris.

[0047] Next, the iris image acquisition unit 1004 calculates a feature amount F for each predetermined range centered on each point of the divided image E, which is the target of iris detection. The range used for calculating the feature amount F is large enough to include the iris. The iris image acquisition unit 1004 then calculates the similarity between the feature amount F of each point and the previously recorded iris feature amount, and detects the point where the similarity is equal to or greater than a predetermined threshold as the position of the iris. When a plurality of points where the similarity is equal to or greater than a predetermined threshold are detected, the point where the similarity is the highest may be regarded as the iris. The iris detection is performed for each of the left and right eyes. The feature amount F may be calculated by a known method for identifying facial parts. The iris feature amount to be compared with the feature amount F of the divided image E is calculated in advance from a general iris image and recorded in the storage device 103. The similarity threshold is determined in advance by experiments or simulations and recorded in the storage device 103.

[0048] Finally, the iris image acquisition unit 1004 cuts out a predetermined range including the position of the detected iris for each of the left and right eyes from the divided image E as an iris image G, and stores it in the memory 102 or the storage device 103. The range of the iris image G may be large enough to include only the iris, or may be large enough to include the entire eye.

[0049] 6 is a schematic diagram of an iris image acquisition method of the composite image type according to this embodiment. First, the iris image acquisition unit 1004 acquires a group of divided images E captured by the imaging unit 1003 from the memory 102 or storage device 103. The divided images E are images of different areas on the user A. Next, the iris image acquisition unit 1004 generates one composite image H from the divided images E so as to exclude the overlapping area ΔD in FIG. 3. For example, the composite image H is generated by deleting the vertical length of the overlapping area ΔD from the bottom end (or top end) of each divided image, and then vertically connecting the divided images E together.

[0050] Then, the iris image acquisition unit 1004 uses a known face recognition method to identify the positions of the eyes from the composite image H. Finally, the iris image acquisition unit 1004 cuts out a predetermined range including the positions of the detected left and right eyes from the composite image H as an iris image G, and stores it in the memory 102 or the storage device 103. The range of the iris image G may be large enough to include only the iris, or may be large enough to include the entire eye.

[0051] The split-image iris image acquisition method has the advantage that, even if the complete face of user A is not generated in the composite image due to facial movement during image capture, the iris image can be acquired if any of the split images E includes the iris. On the other hand, the composite image iris image acquisition method has the advantage that the iris image can be acquired with high accuracy because the eye position can be detected based on the arrangement of the entire face parts. As the iris image acquisition method, either the split-image method or the composite image method may be used, or a combination of the two may be used. As the iris image acquisition method, there is no need to use these methods, and any method capable of acquiring an iris image from a face image may be used.

[0052] FIG. 7 is a diagram showing a flowchart of the iris imaging method according to this embodiment. First, the person detection unit 1001 detects whether or not the user A is present within the imaging range of the camera 110 using the person sensor 140 (step S11). If the user A is not detected in step S11 (NO in step S12), step S11 is repeated at predetermined time intervals. If the user A is detected in step S11 (YES in step S12), the iris imaging device 100 acquires an image of the face of the user A by imaging processing described later with reference to FIG. 8 (step S100). Finally, the iris imaging device 100 acquires an iris image of the user A from the image of the face of the user A acquired in step S100 by iris image acquisition processing described later with reference to FIG. 9 and FIG. 10 (step S200). The iris image acquisition processing is implemented by at least one of a divided image method and a composite image method.

[0053] FIG. 8 is a diagram showing a flowchart of the imaging process according to this embodiment. First, the imaging unit 1003 turns on the light source 130 to irradiate light to the user A (step S101). The light source 130 may be always turned on during the imaging process, or may be turned on intermittently only while the camera 110 is imaging. Next, the mirror control unit 1002 drives the movable mirror 120 to rotate the movable mirror 120 to a predetermined start position (step S102). Next, the imaging unit 1003 causes the camera 110 to image a predetermined imaging range on the user A (step S103). If the imaging has not been completed a predetermined number of times (NO in step S104), the mirror control unit 1002 drives the movable mirror 120 to rotate the movable mirror 120 by a predetermined angle (step S105). Steps S103 to S105 are repeated until the imaging has been completed a predetermined number of times.

[0054] When the predetermined number of imaging operations have been completed (YES in step S104), the imaging unit 1003 records the group of images captured in steps S103 to S105 in the memory 102 or the storage device 103 (step S106). Then, the iris imaging device 100 ends the imaging process.

[0055] 9 is a diagram showing a flowchart of an iris image acquisition process of the divided image method according to this embodiment. First, the iris image acquisition unit 1004 reads out a group of images captured in the imaging process of step S100 from the memory 102 or the storage device 103 and acquires them as a divided image E (step S201). Next, the iris image acquisition unit 1004 performs a rough search for a face region in the divided images E acquired in step S201, and selects one that includes a face region from among them (step S202). If a face region is not detected in step S202 (NO in step S203), the iris imaging device 100 outputs a message indicating that an iris image could not be acquired, and ends the iris image acquisition process.

[0056] When a face region is detected in step S202 (YES in step S203), the iris image acquisition unit 1004 calculates a feature amount for each predetermined range centered on each point in one of the divided images E including the face region selected in step S202 (step S204). Then, the iris image acquisition unit 1004 calculates a similarity between the feature amount of each point calculated in step S204 and a prerecorded iris feature amount (step S205). When there is no point where the similarity calculated in step S205 is equal to or greater than a predetermined threshold (NO in step S206) and processing has not been completed for all divided images E including the face region selected in step S202 (NO in step S208), steps S204 to S206 are performed for the next divided image E. If there is no point where the similarity calculated in step S205 is equal to or greater than a predetermined threshold value (NO in step S206) and processing has been completed for all divided images E containing the face area selected in step S202 (YES in step S208), iris imaging device 100 outputs a message indicating that an iris image could not be acquired and terminates the iris image acquisition processing.

[0057] If there is a point where the similarity calculated in step S205 is equal to or greater than a predetermined threshold value (YES in step S206), the iris image acquisition unit 1004 cuts out a predetermined range including that point from the divided image E, and records it as an iris image G in the memory 102 or the storage device 103 (step S207). The iris image G is acquired for each of the left and right eyes. Then, the iris imaging device 100 ends the iris image acquisition process.

[0058] FIG. 10 is a diagram showing a flowchart of the iris image acquisition process of the composite image method according to the present embodiment. First, the iris image acquisition unit 1004 reads out a group of images captured in the imaging process of step S100 from the memory 102 or the storage device 103 and acquires them as a divided image E (step S211). Next, the iris image acquisition unit 1004 combines the divided images E acquired in step S211 to generate a composite image H (step S212). The iris image acquisition unit 1004 detects the positions of the eyes from the composite image H generated in step S212 using a known face recognition method (step S213). If the positions of the eyes are not detected in step S213 (NO in step S214), the iris imaging device 100 outputs a message indicating that the iris image could not be acquired, and ends the iris image acquisition process.

[0059] If the eye positions are detected in step S213 (YES in step S214), the iris image acquisition unit 1004 cuts out a predetermined range including the detected eye positions from the composite image H as an iris image G, and stores it in the memory 102 or the storage device 103 (step S215). The iris image G is acquired for each of the left and right eyes. Then, the iris imaging device 100 ends the iris image acquisition process.

[0060] Processor 101 of iris image capture device 100 is responsible for each step (process) included in the process shown in Figures 8 to 10. That is, processor 101 reads a program for executing the process shown in Figures 8 to 10 from memory 102 or storage device 103, and executes the program to control each unit of iris image capture device 100, thereby executing the process shown in Figures 8 to 10.

[0061] The iris imaging device 100 according to this embodiment obtains a high-resolution iris image by repeatedly imaging a part of the face of the user A while repeatedly rotating the movable mirror 120. Since the movable mirror 120 is generally lighter than the camera 110, the torque of the drive unit for rotating the movable mirror 120 is small. Therefore, the iris imaging device 100 can perform iris imaging at high speed by shortening the time required for rotation and the time required for stopping compared to the case of rotating the camera 110. In addition, the iris imaging device 100 does not require multiple types of cameras such as a wide-angle camera and a telephoto camera as in the techniques described in Patent Documents 1 and 2, and can obtain a high-resolution iris image using only one type of camera 110. Therefore, the iris imaging device 100 can perform iris imaging at high speed and can reduce manufacturing costs due to a simple device configuration.

[0062] Second embodiment In this embodiment, walk-through authentication is performed for performing iris authentication on a user A who is moving. Fig. 11 is a schematic diagram of an iris image pickup device 200 according to this embodiment. The iris image pickup device 200 includes a camera 210, a movable mirror 220, a light source 230, a human sensor 240, and a gate 250.

[0063] Camera 210, movable mirror 220, light source 230, and human sensor 240 are similar to camera 110, movable mirror 120, light source 130, and human sensor 140 according to the first embodiment, respectively. Gate 250 is an openable and closable gate equipped with a drive unit, and can be switched between an open state and a closed state by driving the drive unit.

[0064] The movable mirror 220 has a common configuration with the movable mirror 120 according to the first embodiment, but is different in that it rotates about two axes. The movable mirror 220 rotates about two predetermined axes by driving the driving unit. That is, the iris imaging device 200 can change the imaging range not only in the vertical direction but also in the horizontal direction. The movable mirror 220 may be a combination of two mirrors that rotate independently, instead of a single mirror. In this case, the movable mirror 220 includes a first mirror that rotates about a first axis, and a second mirror that rotates about a second axis different from the first axis. Then, the reflected light B from the user A enters the camera 210 via the first mirror and the second mirror.

[0065] The iris image capture device 200 repeatedly captures an image within a predetermined scanning area J by rotating the movable mirror 220. The scanning area J is located in the space between the detection range of the person sensor 240 and the gate 250. This allows the iris image capture device 200 to capture an iris image of the moving user A at the timing when the user A enters the scanning area J after being detected by the person sensor 240.

[0066] FIG. 12 is a schematic diagram of an imaging method by the iris imaging device 200 according to this embodiment. FIG. 12 is a diagram showing the face of user A viewed from the front. In FIG. 12, the direction of gravity is the Y axis, and the direction perpendicular to the direction of gravity is the X axis. The movable mirror 220 is adjusted to rotate about the X axis and the Y axis. The camera 210 captures an imaging area K1 including a part of the face of the user A at once. When the movable mirror 220 is rotated a predetermined angle about the X axis from the state of the imaging area K1, the camera 210 captures an imaging area K2 that has been moved a predetermined length in the Y axis direction. When the movable mirror 220 is rotated a predetermined angle about the Y axis from the state of the imaging area K1, the camera 210 captures an imaging area K3 that has been moved a predetermined length in the X axis direction. The camera 210 captures all areas in the scanning area J by repeatedly capturing images while rotating the movable mirror 220 by a predetermined angle about the X axis or the Y axis. Then, the iris image pickup device 200 detects the iris A1 of the user A from the group of captured images and acquires an iris image. The sizes of the imaging regions K1 to K3 and the scanning region J may be set according to the arrangement of the iris image pickup device 200 and the imaging environment.

[0067] An overlapping area ΔKy is formed between the imaging areas K1 and K2 that are adjacent to each other in the vertical direction, and overlaps a predetermined length along the vertical direction. An overlapping area ΔKx is formed between the imaging areas K1 and K3 that are adjacent to each other in the horizontal direction, and overlaps a predetermined length along the horizontal direction. By providing the overlapping areas ΔKx and ΔKy in this manner, the probability that the entire image of the iris A1 is included in at least one of the imaging areas K1 and K2 (or K3) that are adjacent to each other is improved, so that the probability that the iris A1 is divided and an iris image is not obtained can be reduced. The length of the overlapping area ΔKx is preferably 1 / 2 or more of the horizontal length of the imaging areas K1 and K3. The length of the overlapping area ΔKy is preferably 1 / 2 or more of the vertical length of the imaging areas K1 and K2. As a result, each point on the face of the user A is included in both of the imaging areas K1 and K2 (or K3) that are adjacent to each other, and therefore, the iris A1 can be effectively prevented from being divided.

[0068] The movable mirror 220 according to this embodiment rotates about two axes, but may rotate about one axis as in the first embodiment. In that case, the horizontal width of the imaging region K1 is made equal to the horizontal width of the scanning region J, and the movable mirror 220 is rotated about one axis (X-axis) to image the entire scanning region J.

[0069] The device configuration of iris imaging device 200 is similar to that of iris imaging device 100 shown in Fig. 2. Fig. 13 is a block diagram of iris imaging device 200 according to this embodiment. In Fig. 13, the lines between blocks indicate main data flows, and there may be data flows other than those shown in Fig. 13. In Fig. 13, each block indicates a configuration in functional units, not a configuration in hardware (device) units.

[0070] The iris imaging device 200 includes a person detection unit 2001, a mirror control unit 2002, an imaging unit 2003, an iris image acquisition unit 2004, an iris authentication unit 2005, and a gate control unit 2006. In the iris imaging device 100, the person detection unit 2001, the mirror control unit 2002, the imaging unit 2003, the iris image acquisition unit 2004, the iris authentication unit 2005, and the gate control unit 2006 are stored in the memory 102 as programs executable by the processor 101. That is, when the iris imaging method according to this embodiment is executed, the processor 101 functions as the person detection unit 2001, the mirror control unit 2002, the imaging unit 2003, the iris image acquisition unit 2004, the iris authentication unit 2005, and the gate control unit 2006. At least some of these functions may be implemented as electric circuits instead of programs.

[0071] The human detection unit 2001 uses the human sensor 240 to detect whether user A is present (i.e., has passed) within a predetermined detection range at predetermined time intervals (e.g., every 0.1 seconds). The detection range of the human sensor 240 is set to the space on the path of user A heading toward the gate 250. The human detection unit 2001 stores the latest detection result in the memory 102 or the storage device 103. After the presence of user A is detected by the human detection unit 2001, the mirror control unit 2002, the imaging unit 2003, and the iris image acquisition unit 2004 repeatedly acquire the iris image for a predetermined time (e.g., 5 seconds).

[0072] The mirror control unit 2002 and the imaging unit 2003 rotate the movable mirror 220 and use the camera 210 to capture an image of the scanning area J, which is closer to the gate 250 than the detection range of the person sensor 240 and is located in a space on the path of the user A toward the gate 250. First, the mirror control unit 2002 transmits an electric signal to the movable mirror 220 to drive it and rotate the movable mirror 220 to a predetermined start position. Next, the imaging unit 2003 irradiates light from the light source 230 to the scanning area J and causes the camera 210 to capture a predetermined imaging range within the scanning area J. Every time imaging is performed by the imaging unit 2003, the mirror control unit 2002 transmits an electric signal to the movable mirror 220 to drive it and rotate the movable mirror 220 by a predetermined angle in a predetermined direction. In this manner, the rotation by the mirror control unit 2002 and the imaging by the imaging unit 2003 are repeated. After the rotation by mirror control unit 2002 and the imaging by imaging unit 2003 are repeated a predetermined number of times, imaging unit 2003 holds the group of captured images (i.e., the entire image of scanning area J) in memory 102 or storage device 103, and performs the next iris image acquisition. Until the iris image acquisition is successful or a predetermined time has elapsed, mirror control unit 2002 again drives movable mirror 220 to return movable mirror 220 to the predetermined start position, and repeats the process from capturing the image of scanning area J to acquiring the iris image. The start position of movable mirror 220, the angle of rotation of movable mirror 220, and the number of repetitions are set in advance according to the arrangement of camera 210 and movable mirror 220, and recorded in storage device 103.

[0073] The iris image acquisition unit 2004 acquires an iris image from the group of images acquired by the imaging unit 2003. The acquisition of an iris image from the group of images is performed by either the divided image method or the composite image method described above.

[0074] The iris authentication unit 2005 authenticates whether or not user A is permitted to pass through gate 250 using a known iris authentication method based on the iris image acquired by the iris image acquisition unit 2004. Specifically, the iris authentication unit 2005 extracts the iris pattern from the iris image acquired by the iris image acquisition unit 2004, and extracts information similar to the pattern based on a predetermined criterion as information about user A. Then, the iris authentication unit 2005 permits user A to pass through gate 250 if the information about user A indicates the authority to pass through gate 250, and denies user A from passing through gate 250 if the information does not indicate the authority to pass through gate 250.

[0075] Based on the determination by the iris authentication unit 2005, the gate control unit 2006 transmits an electrical signal to the gate 250 to open or close it.

[0076] FIG. 14 is a diagram showing a flowchart of the iris imaging method according to this embodiment. First, the human detection unit 2001 detects whether or not the user A is present within the detection range using the human sensor 240 (step S21). If the user A is not detected in step S21 (NO in step S22), step S21 is repeated at predetermined time intervals. If the user A is detected (YES in step S22), the iris imaging device 200 acquires an image of the face of the user A in the scanning area J by the imaging process shown in FIG. 8 (step S100). Next, the iris imaging device 200 acquires an iris image of the user A from the image of the face of the user A acquired in step S100 by the iris image acquisition process shown in FIG. 9 and FIG. 10 (step S200). If the iris image is not acquired in step S200 (NO in step S23), the imaging process in step S100 and the iris image acquisition process in step S200 are repeated in the scanning area J.

[0077] If an iris image is acquired in step S200 (YES in step S23), the iris authentication unit 2005 authenticates whether or not user A may pass through gate 250 using a known iris authentication method based on the iris image acquired by the iris image acquisition unit 2004 (step S24). If user A is authenticated in step S24 (YES in step S25), the gate control unit 2006 opens gate 250 (step S26). If user A is not authenticated in step S24 (NO in step S25), the gate control unit 2006 closes gate 250 (step S27).

[0078] The present invention can quickly obtain a high-resolution iris image by rotating a mirror to capture an image of the user. Therefore, by repeatedly attempting to obtain an iris image in the space along the user's path as in this embodiment, it is possible to obtain an iris image even if the user is moving, thereby realizing walk-through authentication.

[0079] (Other embodiments) Fig. 15 is a schematic diagram of the iris imaging device 100, 200 according to each of the above-mentioned embodiments. Fig. 15 shows an example of the configuration for realizing the function of the iris imaging device 100, 200 to acquire an image of the iris of the user. The iris imaging device 100, 200 includes a rotatable movable mirror 120, 220, a control unit 1002, 2002 that controls the rotation of the movable mirror 120, 220, an imaging unit 1003, 2003 that captures different areas of the user's face via the movable mirror 120, 220 and outputs a group of images every time the control unit 1002, 2002 rotates the movable mirror 120, 220 by a predetermined angle, and an iris image acquisition unit 1004, 2004 that acquires an image of the user's iris from the group of images.

[0080] The present invention is not limited to the above-described embodiment, and can be modified as appropriate without departing from the spirit of the present invention.

[0081] The scope of each embodiment also includes a processing method in which a program that operates the configuration of the embodiment to realize the functions of the above-mentioned embodiment (more specifically, a program that causes a computer to execute the methods shown in Figs. 7 to 10 and 14) is recorded on a recording medium, the program recorded on the recording medium is read as code, and the program is executed on a computer. That is, a computer-readable recording medium is also included in the scope of each embodiment. Furthermore, not only a recording medium on which the above-mentioned program is recorded, but also the program itself is included in each embodiment.

[0082] Examples of the recording medium that can be used include a floppy disk, a hard disk, an optical disk, a magneto-optical disk, a CD-ROM, a magnetic tape, a non-volatile memory card, and a ROM. In addition, the scope of each embodiment is not limited to a program recorded on the recording medium that executes processing by itself, but also includes a program that executes processing by operating on an OS in cooperation with other software and functions of an extension board.

[0083] A part or all of the above-described embodiments can be described as, but is not limited to, the following supplementary notes.

[0084] (Appendix 1) A rotatable movable mirror; A control unit for controlling the rotation of the movable mirror; an imaging unit that captures images of different areas of the user's face through the movable mirror and outputs a group of images each time the control unit rotates the movable mirror by a predetermined angle; an iris image acquisition unit that acquires an iris image of the user from the group of images; An iris imaging device comprising:

[0085] (Appendix 2) 2. The iris imaging device of claim 1, wherein two adjacent ones of the regions partially overlap each other.

[0086] (Appendix 3) 3. The iris imaging device according to claim 1, wherein the iris image acquisition unit calculates features from the group of images and identifies the position of the user's iris by comparing the features with pre-recorded iris features.

[0087] (Appendix 4) The iris imaging device according to claim 1 or 2, wherein the iris image acquisition unit is configured to combine the group of images to generate a composite image, and identify the position of the user's iris by detecting the positions of the eyes contained in the composite image.

[0088] (Appendix 5) the movable mirror is rotatable about a first axis; The iris imaging device according to any one of claims 1 to 4, wherein the control unit rotates the movable mirror a predetermined number of times about the first axis, thereby causing the imaging unit to image the entire area of ​​the user's face.

[0089] (Appendix 6) the movable mirror is rotatable about a first axis and a second axis; The iris imaging device according to any one of claims 1 to 4, wherein the control unit rotates the movable mirror a predetermined number of times about the first axis and the second axis, thereby causing the imaging unit to image all areas of the user's face.

[0090] (Appendix 7) The iris image pickup device according to any one of claims 1 to 6, further comprising an iris authentication unit that authenticates the user based on an image of the iris.

[0091] (Appendix 8) It also has an openable and closable gate. 8. The iris imaging device according to claim 7, wherein the iris authentication unit authenticates whether or not the user is permitted to pass through the gate based on an image of the iris.

[0092] (Appendix 9) 9. The iris imaging device according to claim 8, wherein the imaging unit repeatedly images a space on a path of the user toward the gate until the iris image acquisition unit acquires an image of the iris.

[0093] (Appendix 10) Further comprising a light source for irradiating the user with light, 10. The iris image pickup device according to any one of claims 1 to 9, wherein the light source is disposed so that the light is irradiated onto the area via the movable mirror.

[0094] (Appendix 11) 11. The iris image pickup device according to any one of claims 1 to 10, wherein the movable mirror includes a stepping motor, and the control unit drives the stepping motor to rotate the movable mirror.

[0095] (Appendix 12) repeatedly rotating the rotatable movable mirror by a predetermined angle; capturing an image of a different area of ​​the user's face through the movable mirror each time the movable mirror rotates through the predetermined angle to output a set of images; obtaining an image of the user's iris from the set of images; An iris imaging method comprising:

[0096] (Appendix 13) On the computer, repeatedly rotating the rotatable movable mirror by a predetermined angle; capturing an image of a different area of ​​the user's face through the movable mirror each time the movable mirror rotates through the predetermined angle to output a set of images; obtaining an image of the user's iris from the set of images; A recording medium for executing the above.

[0097] This application claims priority based on Japanese Patent Application No. 2016-163434, filed on August 24, 2016, the disclosure of which is incorporated herein in its entirety.

Claims

1. An imaging unit that images a person; a detection unit that detects a person present within an area where an iris image can be captured by the imaging unit; an irradiation unit that irradiates a person with infrared light; A control unit; Equipped with The control unit is by repeatedly causing the imaging unit to capture an image including a first imaging area and a second imaging area moved vertically from the first imaging area by a predetermined length, the imaging unit captures a first face image of the person; determining whether an iris image capable of iris authentication of the person has been acquired from the first face image; responsive to determining that the iris image has not been acquired, performing the repeated imaging again to capture a second face image of the person; determining whether the iris image of the person was obtained from the second facial image; If it is determined that the second facial image includes the iris image, the iris imaging device performs iris authentication.

2. The iris image pickup device according to claim 1 , wherein the control unit is configured to calculate a feature amount from the iris image and identify the position of the user's iris by comparing the feature amount with prerecorded iris feature amounts.

3. Further comprising a rotatable movable mirror, the movable mirror is rotatable about a first axis; The control unit rotates the movable mirror a predetermined number of times about the first axis, whereby the imaging unit captures an image of the entire area of ​​the user's face.

3. The iris imaging device according to claim 1.

4. the movable mirror is rotatable about a second axis; The control unit rotates the movable mirror a predetermined number of times about the first axis and the second axis, whereby the imaging unit captures an image of the entire area of ​​the user's face. The iris imaging device of claim 3.

5. It also has an openable and closable gate. The control unit determines whether or not the user is permitted to pass through the gate based on an iris image. The iris imaging device according to any one of claims 1 to 4.

6. The iris image pickup device according to claim 3 , wherein the irradiating section is disposed so that the infrared light is irradiated onto a plurality of regions corresponding to a plurality of partial images via the movable mirror.

7. The detection unit measures the distance to the user, The control unit controls a change in an imaging area based on the distance. The iris imaging device according to any one of claims 1 to 6.

8. The iris imaging device according to any one of claims 1 to 7, wherein the control unit causes the imaging unit to repeatedly capture images including the first imaging area and the second imaging area that has been moved a predetermined distance vertically from the first imaging area, for a person whose face is moving.

9. An iris imaging method using an apparatus including an imaging unit that images a person, a detection unit that detects a person present within an area where an iris image can be captured by the imaging unit, and an irradiation unit that irradiates the person with infrared light, by repeatedly causing the imaging unit to capture an image including a first imaging area and a second imaging area moved vertically from the first imaging area by a predetermined length, the imaging unit captures a first face image of the person; determining whether an iris image capable of iris authentication of the person has been acquired from the first face image; responsive to determining that the iris image has not been acquired, performing the repeated imaging again to capture a second face image of the person; determining whether the iris image of the person was obtained from the second facial image; if it is determined that the second face image includes the iris image, performing iris authentication; Iris imaging method.

10. On the computer, An apparatus including an imaging unit that images a person, a detection unit that detects a person present within an area where an iris image can be captured by the imaging unit, and an irradiation unit that irradiates the person with infrared light, by repeatedly causing the imaging unit to capture an image including a first imaging area and a second imaging area moved vertically from the first imaging area by a predetermined length, the imaging unit captures a first face image of the person; determining whether an iris image capable of iris authentication of the person has been acquired from the first face image; responsive to determining that the iris image has not been acquired, performing the repeated imaging again to capture a second face image of the person; determining whether the iris image of the person has been obtained from the second facial image; if it is determined that the second face image includes the iris image, then iris authentication is performed; program.

Citation Information

Patent Citations

  • Individual identifying device using features of living body, and automatic transaction system using the same

    JP1998137224A

  • Mirror type iris camera

    JP2000237169A

  • Object tracking device

    JP2001257929A

  • Personal authentication device

    JP2009080706A

  • Iris imaging device, iris imaging method, and program

    JP2020194599A