Imaging system, imaging method, and imaging program
By controlling the iris camera's focal position to be fixed during initial authentication and scanned during re-authentication, the system addresses the challenge of re-authentication inefficiencies, ensuring accurate and efficient iris imaging and authentication without additional hardware.
Patent Information
- Application Number
- JP2023206102
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2023-12-06
- Publication Date
- 2024-12-03
- Estimated Expiration
- 2040-03-30
AI Technical Summary
Existing imaging systems face challenges in effectively performing re-authentication when iris authentication fails, leading to inefficiencies and complexities in the authentication process.
The system employs a control mechanism to fix the focal position of an iris camera during initial authentication and scan the focal position during re-authentication, using variable focus lenses and multiple cameras to ensure accurate iris imaging and authentication.
This approach allows for reliable and efficient re-authentication without the need for additional hardware, simplifying the process and improving the accuracy of iris image capture and authentication.
Smart Images

Figure 0007593465000001 
Figure 0007593465000002 
Figure 0007593465000003
Abstract
Description
[Technical field]
[0001] The present invention relates to an imaging system, an imaging method, and a non-transitory computer-readable medium having an imaging program stored thereon. [Background technology]
[0002] Iris authentication, which uses the iris of the eye, is known as one type of biometric authentication. In iris authentication, an image of a subject's iris is captured using an imaging system, and the subject is authenticated based on the captured iris image. In such an imaging system, if authentication of a subject fails, re-authentication is performed as necessary.
[0003] Related techniques are known, for example, in Patent Documents 1 to 3. Patent Document 1 describes providing a re-authentication area for subjects who have failed iris authentication to be re-authenticated. Patent Documents 2 and 3 describe face authentication systems that capture an image of the face of a subject passing through a gate and perform face authentication. [Prior art documents] [Patent documents]
[0004] [Patent Document 1] International Publication No. 2009 / 016846 [Patent Document 2] JP 2018-109935 A [Patent Document 3] JP 2016-53896 A Summary of the Invention [Problem to be solved by the invention]
[0005] In the above-mentioned imaging system, when authentication fails, it is required to effectively perform re-authentication.
[0006] An object of the present disclosure is to provide an imaging system, an imaging method, and a non-transitory computer-readable medium having an imaging program stored thereon that solves the above-mentioned problems. [Means for solving the problem]
[0007] The imaging system of the present disclosure comprises a first control means for controlling an iris imaging means for capturing an image focused on the iris of a subject to fix a focal position at a predetermined position, an authentication means for authenticating the subject based on the iris image of the subject captured by the controlled iris imaging means, and a second control means for controlling the iris imaging means to scan a focal position within a predetermined range to re-authenticate the subject if authentication of the subject fails.
[0008] The imaging method disclosed herein controls an iris imaging means for capturing an image focused on a subject's iris to fix a focal position at a predetermined position, authenticates the subject based on the iris image of the subject captured by the controlled iris imaging means, and, if authentication of the subject fails, controls the iris imaging means to scan a focal position within a predetermined range in order to re-authenticate the subject.
[0009] A non-transitory computer-readable medium storing an imaging program according to the present disclosure is a non-transitory computer-readable medium storing an imaging program for causing a computer to execute a process of controlling an iris imaging means for capturing an image focused on a subject's iris to fix a focal position at a predetermined position, authenticating the subject based on the iris image of the subject captured by the controlled iris imaging means, and if authentication of the subject fails, controlling the iris imaging means to scan a focal position within a predetermined range in order to re-authenticate the subject. [Brief description of the drawings]
[0010] [Figure 1] 1 is a configuration diagram showing an example of the configuration of an imaging system according to a first embodiment. [Diagram 2]FIG. 13 is a configuration diagram showing an example of the configuration of an imaging system according to a fifth embodiment. [Diagram 3] FIG. 13 is a configuration diagram showing a configuration example of a control device according to embodiment 5. [Figure 4] 13 is a flowchart showing an example of the operation of the imaging system according to the fifth embodiment. [Diagram 5] 13 is a flowchart showing an example of a walk-through authentication process according to the fifth embodiment. [Figure 6] FIG. 13 is a diagram for explaining an operation during walk-through authentication in the fifth embodiment. [Figure 7] 13 is a flowchart showing an example of a re-authentication process according to the fifth embodiment. [Figure 8] FIG. 13 is a diagram for explaining an operation at the time of re-authentication according to the fifth embodiment. [Figure 9] 23 is a flowchart showing an example of a re-authentication process according to the sixth embodiment. [Figure 10] FIG. 23 is a diagram for explaining a setting example of an iris camera according to the sixth embodiment. [Figure 11] FIG. 23 is a diagram for explaining a setting example of an iris camera according to the sixth embodiment. [Figure 12] 23 is a flowchart showing an example of re-authentication processing according to the seventh embodiment. [Figure 13] FIG. 2 is a configuration diagram showing an overview of the hardware of a computer according to an embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0011] Hereinafter, an embodiment will be described with reference to the drawings. For clarity of explanation, the following description and drawings are omitted and simplified as appropriate. In each drawing, the same elements are given the same reference numerals, and duplicate explanations are omitted as necessary.
[0012] (Embodiment 1) Fig. 1 shows an overview of an imaging system according to embodiment 1. As shown in Fig. 1, an imaging system (imaging device) 10 according to the present embodiment includes a first control unit 11, an authentication unit 12, and a second control unit 13.
[0013] The first control unit 11 controls the biometric camera for capturing an image focused on a part of the subject (a body part that can be captured, such as the iris, retina, eyelashes, fingerprint, or ear) to fix the focal position at a predetermined position (fixed focal position). The authentication unit 12 authenticates the subject based on the biometric image of the subject captured by the biometric camera controlled by the first control unit 11. If authentication of the subject fails, the second control unit 13 controls the biometric camera to scan the focal position within a predetermined range (scanning range) in order to re-authenticate the subject. In the following embodiment, an example will be described in which the iris is used as part of the subject, and an iris camera is used as the biometric camera.
[0014] In this manner, in this embodiment, by changing the control (setting) of the focus of the iris camera (biometric camera) at the time of the first authentication and the control (setting) of the focus of the iris camera at the time of the re-authentication, it is possible to effectively perform re-authentication. In particular, in the first authentication, the focus position of the iris camera is fixed to capture an image of the iris of the subject, and in the re-authentication, the focus position of the iris camera is scanned to capture an image of the iris of the subject, thereby making it possible to more simply and reliably capture an image of the iris and perform re-authentication.
[0015] (Embodiment 2) Next, a second embodiment will be described. In this embodiment, the authentication unit 12 of the imaging system according to the first embodiment determines whether or not the captured image can be used for authentication, regardless of whether the authentication is successful or unsuccessful. For example, if the captured image has low resolution, is blurred, is overexposed, the eyes are closed, or the like, it is determined that the captured image cannot be used for authentication. If the captured image cannot be used for authentication, the second control unit 13 controls the iris camera to scan the focal position within a predetermined range in order to re-authenticate the subject. Even in this case, re-authentication can be performed effectively in the same way as in the first embodiment.
[0016] (Embodiment 3) Next, a third embodiment will be described. In this embodiment, in the imaging system according to the first or second embodiment, the first control unit 11 controls the focal position to be fixed when authenticating a subject in the first authentication mode, and the second control unit 13 controls the focal position to be scanned when authenticating a subject in the second authentication mode. This makes it possible to appropriately control the focus of the iris camera according to the authentication mode.
[0017] (Embodiment 4) Next, a fourth embodiment will be described. In this embodiment, in the imaging system according to the third embodiment, the first control unit 11 controls the focal position to be fixed in the first authentication mode in which a moving subject is authenticated, and the second control unit 13 controls the focal position to be scanned in the second authentication mode in which a stationary subject is authenticated. This makes it possible to appropriately control the focus of the iris camera in each of the authentication modes in which a moving subject is authenticated and the authentication mode in which a stationary subject is authenticated. (Embodiment 5)
[0018] Next, a fifth embodiment will be described. This embodiment is an example in which, in an imaging system that performs walk-through authentication, when authentication fails, the setting of the focal position of the iris camera is changed and re-authentication is performed. Walk-through authentication is an authentication method that authenticates a subject who passes by while walking in front of the camera.
[0019] Fig. 2 shows a configuration example of an imaging system according to the present embodiment. As shown in Fig. 2, imaging system 100 includes multiple iris cameras 110, an overall bird's-eye view camera 120, multiple lighting devices 130, a human detection sensor 140, a gate 150, a display device 160, and a control device 200. Imaging system 100 authenticates subject P walking toward gate 150, and allows subject P to pass through gate 150 if authentication is successful.
[0020] Iris camera 110 is an iris imaging device for capturing an image of the iris of subject P. The resolution of iris camera 110 is a resolution capable of extracting the iris pattern of subject P, and the angle of view of iris camera 110 is an angle of view that includes at least both eyes of subject P. The angle of view is the imaging range (field of view) of the camera at the imaging point (position of the imaging subject). Iris camera 110 is configured, for example, with a general-purpose camera with 12M pixels (4000 pixels horizontally, 3000 pixels vertically) and 60 fps, which is becoming common in industrial cameras and the like.
[0021] The position (height) of the eyes of the subject P varies depending on the height of the subject P. For this reason, for example, multiple iris cameras 110 are arranged vertically according to the height of the subject P. In this example, three iris cameras 110-0 to 110-2 are arranged, but the number is not limited to three, and any number of iris cameras 110 may be arranged. For example, the number of iris cameras is set depending on the angle of view, resolution, etc. of the iris cameras 110.
[0022] Among the iris cameras 110-0 to 110-2, the iris camera 110 capable of capturing an image of the subject P's eye is selected by the control device 200, and an image captured by the selected iris camera 110 (iris camera image) is output to the control device 200. Here, an imaging method for capturing an image of the iris of the subject P by a camera selected from the multiple iris cameras 110 will be described, but a similar imaging method may be realized by moving one iris camera 110 in the vertical direction. For example, in the initial state, a camera may be placed at the position of iris camera 110-0, and the camera may be moved in the vertical direction according to the position of the iris of the subject P when capturing the iris. Note that an image captured by the iris camera 110 may be called an iris camera image, and an image focused on the iris among the iris camera images may be called an iris image, but unless otherwise specified, the iris camera image and the iris image may be interchangeable.
[0023] Further, each iris camera 110 is equipped with a variable-focus lens 111. The variable-focus lens 111 is, for example, a liquid lens, but may be any other lens capable of controlling the focal position. The liquid lens can adjust the focal position of the image incident on the lens to different depth positions by changing the image formation position of the image by utilizing the change in the curvature of the liquid droplet according to the input voltage. In this embodiment, the iris camera 110 performs "fixed-focus burst imaging" in which burst imaging is performed with the focal position fixed, or "scanning-focus burst imaging" in which burst imaging is performed by scanning the focal position. The burst imaging is to capture a specified number of images at a high frame rate and write them to a memory.
[0024] In fixed-focus burst imaging, the iris camera 110 performs burst imaging (continuous imaging) with the focal position of the variable-focus lens 111 fixed at a predetermined position (fixed focal position D1). In focus-scanning burst imaging, the iris camera 110 performs burst imaging while scanning the focal position (focus scanning) by moving the focal position of the variable-focus lens 111 in the forward and backward directions of the optical axis. For example, the depth of field (focus range) of the iris camera 110 is narrow at about 1 cm. For this reason, in the case of walk-through authentication, burst imaging is performed with a fixed focus for a subject passing through a fixed focal position, and in the case of re-authentication, burst imaging is performed with a scanned focus for a subject who is standing still, making it possible to extract an iris image focused on the subject's iris.
[0025] The overall overhead camera 120 is an overall imaging device for capturing an image (overhead) of the subject P over a wider range than the iris camera 110. The resolution of the overall overhead camera 120 is a resolution capable of recognizing the face and eyes of the subject P. The angle of view of the overall overhead camera 120 is a wider range than the angles of view of the multiple iris cameras 110 (e.g., including the angles of view of all the iris cameras 110), and is an angle of view capable of covering the entire subject, from tall subjects to short subjects.
[0026] For example, overall overhead camera 120 is disposed below iris cameras 110-0 to 110-2 arranged in a vertical direction, but the location is not limited thereto and may be disposed above iris cameras 110-0 to 110-2. Overall overhead camera 120 outputs to control device 200 an image (overall overhead image) captured of subject P walking toward gate 150 (subject who has passed trigger position D0) or subject P standing still in front of gate 150 (re-authentication position D2).
[0027] The lighting device 130 is a lighting device that irradiates illumination light to the subject P so that the iris camera 110 can capture an image of the iris of the subject P. For example, the lighting device 130 is an LED (Light Emitting Diode) that irradiates near-infrared light. The lighting device 130 irradiates (emits) illumination light at a light amount and timing according to the control from the control device 200. For example, light amount control information (light amount control value) that controls the light amount includes a current value supplied to the LED, a lighting time of the LED, a lighting cycle, and the like. Furthermore, in order to enable the iris of the subject P to be captured with high accuracy, a plurality of lighting devices 130 are arranged vertically. In this example, four lighting devices 130-0 to 130-3 are arranged, but the number of lighting devices 130 is not limited to four, and any number of lighting devices 130 may be arranged. Furthermore, the lighting devices may be arranged horizontally, not limited to vertically, or vertically and horizontally.
[0028] The human detection sensor 140 is a detection sensor capable of detecting the presence (passage) of a person, for example, an infrared sensor. In this example, the human detection sensor 140 is installed at a trigger position D0 at which the imaging system 100 starts an authentication process for the subject P. The human detection sensor 140 detects that the subject P has passed through the trigger position D0, and outputs a detection signal indicating the detection of the subject P to the control device 200.
[0029] Gate 150 is an authentication gate such as a ticket barrier through which subject P passes, and is controlled to open and close depending on the authentication result of subject P. Display device 160 is a display device such as a liquid crystal display or an organic EL display, and is an output device that outputs the authentication result and the like of subject P. Note that the authentication result and the like may be output by voice using audio output means such as a speaker, without being limited to a display device.
[0030] In this embodiment, the control device 200 authenticates the subject P while the subject P is walking from the trigger position D0 to the position of the gate 150, and controls opening / closing of the gate 150 and the display of the display device 160 according to the authentication result. The gate 150 and the display device 160 also serve as a guidance device that guides the subject P to stop in front of the gate 150 when authentication of the walking subject P fails. The subject P may be guided to stop by both the gate 150 and the display device 160, or may be guided to stop by either the gate 150 or the display device 160.
[0031] The control device 200 is a control device that controls the operation of each device in the imaging system 100, and executes processes required for authenticating the subject P. In this embodiment, the control device 200 performs a walk-through authentication process (first authentication process), and further performs a re-authentication process (second authentication process) when authentication fails.
[0032] The control device 200 also includes a database 300 that registers iris information based on an iris image of a subject in order to authenticate the subject. The database 300 is a non-volatile memory such as a flash memory or a hard disk drive, and may be provided inside the control device 200 or outside the control device 200.
[0033] FIG. 3 shows a configuration example of the control device according to the present embodiment. As shown in FIG. 3, the control device 200 includes a storage unit 201, an overall bird's-eye image acquisition unit 202, an eye detection unit 203, an illumination control unit 204, an iris camera setting unit 205, a lens focus control unit 206, an iris image acquisition unit 207, a focused image extraction unit 208, an authentication unit 209, an authentication result output unit 210, and a gate control unit 211. The control device 200 is realized by a computer device such as a server or a personal computer, for example, but may be realized by one device or multiple devices. For example, the illumination control unit 204, the gate control unit 211, etc. may be devices separate from the control device 200.
[0034] The storage unit 201 stores information necessary for processing by the control device 200. For example, the storage unit 201 stores a lens focus control value for controlling the focal position to a predetermined position, a light amount control value for controlling the amount of illumination light to a predetermined light amount, camera parameters of each camera, a transformation matrix for transforming camera parameters (angle of view, etc.) between the overall overhead camera 120 and the iris camera 110, and the like.
[0035] The overall overhead image acquiring unit 202 acquires an overall overhead image (overall overhead video) captured by the overall overhead camera 120 of the subject P. The overall overhead image acquiring unit 202 can also be said to be a capture unit that acquires an image (video) captured by the overall overhead camera 120 of the subject P walking toward the gate 150 or the subject P standing still at a position in front of the gate 150 (re-authentication position D2).
[0036] The eye detection unit 203 detects the eye area of the subject P from the overall overhead image acquired by the overall overhead image acquisition unit 202. The eye detection unit 203 may directly detect the eye area from the overall overhead image, or may detect a face area from the overall overhead image and detect the eye area from the detected face area. For example, the eye detection unit 203 recognizes a face pattern from the image to extract the face area, and also recognizes an eye (iris) pattern from the image to extract the eye (iris) area.
[0037] Illumination control unit 204 controls the irradiation (emission) of illumination light from multiple illumination devices 130-0 to 130-3. For example, illumination control unit 204 sets a predetermined light amount control value stored in advance in storage unit 201 to multiple illumination devices 130-0 to 130-3.
[0038] The iris camera setting unit 205 performs settings required for capturing an image of the iris of the subject P in one of the multiple iris cameras 110 based on the position of the eye area in the overall overhead image detected by the eye detection unit 203. The iris camera setting unit 205 selects the iris camera 110 corresponding to the position of the eye in the overall overhead image, and sets an ROI (Region of Interest) in the angle of view of the selected iris camera 110. The ROI is an area (iris imaging area) for capturing an image of both eyes of the subject P within the angle of view of the iris camera 110.
[0039] Lens focus control unit 206 drives variable focus lens 111 of iris camera 110 selected by iris camera setting unit 205 to set the focus position of iris camera 110. For example, during walk-through authentication, a fixed focus position is set in iris camera 110 so as to capture fixed-focus burst images, and during re-authentication, a focus scanning range is set in iris camera 110 so as to capture focus scanning burst images. Lens focus control unit 206 is a first control unit that controls the focus of iris camera 110 to be fixed, and can also be said to be a second control unit that controls the focus of iris camera 110 to be scanned.
[0040] The iris image acquisition unit 207 acquires an iris camera image (iris image) captured by the iris camera 110 selected and set by the iris camera setting unit 205. The iris image acquisition unit 207 can also be said to be a capture unit that acquires an image captured by the iris camera 110 within the range of the ROI. The iris image acquisition unit 207 acquires multiple iris camera images obtained by continuously capturing images of the ROI using fixed-focus burst imaging during walk-through authentication, and acquires multiple iris camera images obtained by continuously capturing images of the ROI using focused scanning burst imaging during re-authentication. The focused image extraction unit 208 extracts an iris image focused on the iris from the multiple iris camera images acquired by the iris image acquisition unit 207.
[0041] The authentication unit 209 performs authentication processing of the subject P using the iris image extracted by the focused image extraction unit 208. For example, the authentication unit 209 compares iris information based on the iris image extracted by the focused image extraction unit 208 with iris information registered in the database 300 to authenticate the subject.
[0042] For example, the authentication process includes evaluation of the iris imaging state and matching of iris information extracted from the iris image. The authentication unit 209 determines that the authentication is successful if the iris imaging state is successful (imaging successful) and the matching result of the iris information is successful (matching successful). The authentication unit 209 also determines that the authentication is unsuccessful if the iris imaging state is unsuccessful (imaging unsuccessful) or the matching result of the iris information is unsuccessful (matching unsuccessful).
[0043] The authentication result output unit 210 displays (outputs) the authentication result by the authentication unit 209 on the display device 160. The authentication result output unit 210 displays authentication success or authentication failure on the display device 160, and when authentication fails, displays a message to guide the subject P to stop. When authentication fails, it may display an image capture failure or a matching failure so that the cause of the failure can be understood. The gate control unit 211 controls the opening and closing of the gate 150 according to the authentication result by the authentication unit 209. When authentication is successful, the gate control unit 211 opens the gate 150, and when authentication fails, closes the gate 150.
[0044] Fig. 4 shows an example of the operation of the imaging system according to the present embodiment. As shown in Fig. 4, first, the control device 200 performs a walk-through authentication process on a walking subject P (S101).
[0045] Fig. 5 shows a specific example of the walk-through authentication process (S101) in Fig. 4. As shown in Fig. 5, first, the overall overhead camera 120 captures an overall overhead image including a walking subject P (S201). For example, when the subject P passes through the trigger position D0, the human detection sensor 140 detects the subject P and outputs a detection signal indicating the detection of the subject P to the control device 200. When the overall overhead image acquisition unit 202 receives the detection signal from the human detection sensor 140, it instructs the overall overhead camera 120 to start capturing images, and acquires an overall overhead image including the subject P from the overall overhead camera 120.
[0046] Next, the control device 200 detects the position of the eyes of the subject P from the captured overall overhead image (S202). When the overall overhead image is acquired from the overall overhead camera 120, the eye detection unit 203 detects the eyes of the subject P in the overall overhead image. For example, when detecting a face, the eye detection unit 203 extracts edges (contours) from the overall overhead image, and detects the face area by matching an image pattern of the area surrounded by the extracted edges with a predetermined face image pattern. Furthermore, the eye detection unit 203 extracts an eye (iris) pattern from the image of the face area or the overall overhead image. For example, a process of extracting a circular pattern from the image of the target is performed, and the position of the extracted circle is detected as the position of the eye (iris).
[0047] Next, the lighting device 130 irradiates the subject P with the illumination light (S203). The timing at which the lighting device 130 starts irradiating the illumination light may be any timing from when the subject P passes through the trigger position D0 until when the iris camera 110 starts capturing an image. For example, after the human detection sensor 140 detects the subject P or after the eyes of the subject P are detected, the illumination control unit 204 sets a predetermined light amount control value for the multiple lighting devices 130-0 to 130-3, and controls them to start irradiating with a predetermined light amount.
[0048] Next, the control device 200 selects and sets the iris camera 110 (S204). When the eyes of the subject P are detected from the overall overhead image, the iris camera setting unit 205 converts the coordinates of the eyes in the overall overhead image (angle of view of the overall overhead camera) into coordinates of the iris camera image of the iris camera 110 (angle of view of the iris camera) in order to select the optimal iris camera 110. At this time, the eye coordinates are converted using a coordinate conversion matrix that is previously obtained assuming that the subject P is at a fixed focusing position D1. The iris camera setting unit 205 selects the iris camera 110 corresponding to the angle of view that includes the converted eye coordinates, and further sets the ROI so as to include the converted eye coordinates.
[0049] Next, the control device 200 sets the focal position of the iris camera 110 to a fixed focus (S205). After the iris camera 110 is selected and the ROI is set, the lens focus control unit 206 sets the focal position of the variable focus lens 111 of the selected and set iris camera 110. The lens focus control unit 206 sets the focal position of the variable focus lens 111 to a fixed in-focus position so as to perform fixed-focus burst imaging during walk-through authentication.
[0050] Next, iris camera 110 captures a burst image of the iris of walking subject P (S206). Iris camera setting unit 205 selects iris camera 110 and sets the ROI, and outputs an image capture start trigger to iris camera 110, and further lens focus control unit 206 sets the focal position of variable focus lens 111 of selected iris camera 110 to a fixed position. Then, iris camera 110 starts burst image capture of the ROI at the fixed focal position, and outputs the captured iris camera image (burst image) to control device 200.
[0051] 6, with the focus of iris camera 110 fixed at fixed focusing position D1, burst imaging (fixed focus burst imaging) is performed for a predetermined period of time on subject P who approaches and passes by fixed focusing position D1. This makes it possible to obtain an image focused on the iris as subject P approaches fixed focusing position D1.
[0052] Next, the control device 200 extracts an iris image focused on the iris (S207). When the iris camera 110 outputs a burst image (iris camera image) obtained by burst imaging of the subject P, the iris image acquisition unit 207 acquires the captured iris camera images, and the focused image extraction unit 208 extracts an iris image focused on the iris of the subject P from the acquired iris camera images. The focused image extraction unit 208 evaluates the focus of the multiple iris camera images and extracts the most focused iris image. For example, an image with the greatest contrast is detected from the multiple iris camera images, and the detected image is extracted as the focused iris image.
[0053] Next, the control device 200 performs authentication of the subject P (S208). When the focused iris image is extracted, the authentication unit 209 performs authentication processing based on the extracted iris image. Note that the feature amount extracted from the iris image of the subject is registered in the database 300 in advance.
[0054] As the authentication process, the authentication unit 209 performs an evaluation process of the imaging state of the iris and a comparison process of the iris information. For example, the authentication unit 209 detects the inner circle of the iris and the outer circle of the iris in the iris image to detect a doughnut-shaped iris area. If the authentication unit 209 can detect the iris area from the iris image, it determines that the imaging is successful, and if the authentication unit 209 cannot detect the iris area from the iris image, it determines that the imaging is unsuccessful. Note that if a focused iris image is not obtained in S207, it may be determined that the imaging is unsuccessful.
[0055] Furthermore, the authentication unit 209 extracts iris features by dividing the iris area detected from the iris image and converting the obtained brightness into numerical values. The authentication unit 209 compares the features extracted from the iris image with features registered in the database 300 and determines whether they match or not based on the similarity score. If the features extracted from the iris image match the features in the database 300, the authentication unit 209 determines that the matching is successful, and if the features extracted from the iris image do not match the features in the database 300, the authentication unit 209 determines that the matching is unsuccessful.
[0056] When the walk-through authentication process is completed, as shown in Fig. 4, the control device 200 determines whether or not authentication of the subject P has been successful (S102), and if authentication is successful, outputs a message indicating successful authentication to the display device 160 (S103), and opens the gate 150 (S104). If authentication is successful in the walk-through authentication (if iris imaging and matching are successful), the authentication result output unit 210 displays (outputs) characters, marks, etc. indicating successful authentication on the display device 160. Furthermore, the gate control unit 211 controls the gate 150 to be opened. This allows the subject P to pass through the gate 150.
[0057] On the other hand, if the walk-through authentication fails (if the iris image capture or matching fails), the control device 200 outputs a failure to the authentication to the display device 160 (S105) and closes the gate 150 (S106). In this case, the authentication result output unit 210 displays (outputs) characters, marks, etc. indicating the failure to authenticate on the display device 160. Furthermore, the gate control unit 211 controls the gate 150 to be closed. This makes it possible to guide the subject P to stop at the re-authentication position D2 just before the gate 150. For example, a guidance message saying "Please stop in front of the gate" may be displayed on the display device 160.
[0058] Next, the control device 200 performs a re-authentication process on the target person P who is standing still (S107). Fig. 7 shows a specific example of the re-authentication process (S107) in Fig. 4. Note that in Fig. 7, S301 to S304 and S306 to S308 are basically the same as S201 to S204 and S206 to S208 in Fig. 5.
[0059] That is, when authentication of the subject P fails in the walk-through authentication, the overall overhead camera 120 captures an overall overhead image including the subject P who is standing still at the re-authentication position D2 (S301), and the control device 200 detects the position of the eyes of the subject P from the captured overall overhead image (S302). In addition, the lighting device 130 irradiates the subject P with a predetermined amount of illumination light (S303).
[0060] Next, the control device 200 selects and sets the iris camera 110 (S304). The iris camera setting unit 205 converts the eye coordinates of the overall overhead image into coordinates of the iris camera image using a coordinate transformation matrix previously obtained on the assumption that the subject P is at the re-authentication position D2. Furthermore, the iris camera setting unit 205 selects the iris camera 110 and sets the ROI using the converted coordinates.
[0061] For example, re-authentication position D2 is a predetermined position in front of gate 150. Note that the position is not limited to a predetermined position, and the position of subject P may be measured using a depth sensor, a human detection sensor, or the like, and the measured position may be used as re-authentication position D2 in the re-authentication process. The position of D2 may be predicted from the position and time of trigger position D0 (the time when the subject passed through) and the walking speed of subject P (a predetermined walking speed).
[0062] Next, the control device 200 sets the focal position of the iris camera 110 to perform focal scanning (S305). When the iris camera setting unit 205 selects the iris camera 110 and sets the ROI, the lens focus control unit 206 sets the focal position of the variable focus lens 111 of the selected and set iris camera 110. The lens focus control unit 206 sets the focal scanning range of the variable focus lens 111 to perform focal scanning burst imaging at the time of re-authentication. For example, the scanning range is a predetermined range from the scanning start position to the scanning end position of the focus, including a predetermined re-authentication position D2. In other words, the scanning range is a range (focal position) according to the position of the subject P.
[0063] Next, iris camera 110 captures a burst image of the iris of walking subject P (S306). Iris camera setting unit 205 selects iris camera 110 and sets the ROI, and outputs an image capture start trigger to iris camera 110, and further lens focus control unit 206 starts focus scanning drive of variable focus lens 111 of the selected iris camera 110. Then, iris camera 110 starts burst image capture of the ROI in a predetermined scanning range, and outputs the captured iris camera image (burst image) to control device 200.
[0064] 8, burst imaging (focus scanning burst imaging) is performed on subject P standing at re-authentication position D2 while scanning the focus of iris camera 110 in a scanning range including re-authentication position D2. This makes it possible to obtain an image focused on the iris of subject P within a predetermined scanning range.
[0065] Next, the control device 200 extracts an iris image focused on the iris (S307) and authenticates the subject P (S308). When the re-authentication process is completed, as shown in Fig. 4, the control device 200 outputs the result of the re-authentication (S108). For example, the control device 200 outputs the authentication result to the display device 160 in the same manner as in S103 and S105. Also, the control device 200 may control the opening and closing of the gate 150 in the same manner as in S104 and S106.
[0066] As described above, in this embodiment, during walk-through authentication, the focal position of the iris camera is fixed and a burst image of a subject passing through the fixed focal position is captured, and during re-authentication after authentication has failed, the focal position of the iris camera is scanned and a burst image of a subject standing still is captured. This allows a subject to be smoothly re-authenticated when authentication has failed, and also allows iris images to be captured more reliably to perform re-authentication processing.
[0067] For example, in a related system, even if the iris information of a subject is registered in advance, if the subject fails to be photographed due to blinking, looking away, not knowing the authentication method, etc., the subject must proceed to another gate for re-authentication and be re-authenticated, or pass through the same gate again for re-authentication. For this reason, in the related system, a gate for re-authentication must be installed, and a passage for returning to the same gate must be secured. When authentication fails, passing through the gate again is not a smooth authentication process for the subject. Therefore, in this embodiment, when walk-through authentication fails, the subject is made to stop in front of the gate, and the settings of the iris camera are changed and re-authentication is performed. This eliminates the need to install a gate for re-authentication, and also eliminates the need to pass through the same gate again. Therefore, the complexity of the authentication process during re-authentication can be reduced, and re-authentication can be performed smoothly. In addition, since the settings of the same iris camera are changed to perform re-authentication, there is no need to increase the installation location or the number of cameras.
[0068] (Embodiment 6) Next, a sixth embodiment will be described. This embodiment is an example in which re-authentication is performed by changing the angle of view and imaging direction of the iris camera in the imaging system of the fifth embodiment. The configuration of the imaging system and the configuration of the control device according to this embodiment are the same as those of the fifth embodiment, and the operation during walk-through authentication is also the same as that of the fifth embodiment.
[0069] Fig. 9 shows a re-authentication process according to the present embodiment. In Fig. 9, a process for setting the angle of view or the imaging direction of the iris camera (S310) is added to the process in Fig. 7 of the fifth embodiment.
[0070] That is, in the re-authentication process according to the present embodiment, as in FIG. 7, capturing an overall bird's-eye image (S301), detecting eyes (S302), and emitting illumination light (S303) are performed. Next, control device 200 sets the angle of view or the imaging direction of iris camera 110 (S310). As shown in FIG. 10, fixed focus position D1 during walk-through authentication and re-authentication position D2 during re-authentication are different in distance from iris camera 110, so the angle of view of iris camera 110 changes. That is, since re-authentication position D2 is closer to iris camera 110 than fixed focus position D1, angle of view A2 of re-authentication position D2 is narrower than angle of view A1 of fixed focus position D1. Then, if iris camera 110 is selected or an ROI is set at re-authentication position D2 while angle of view A1 of fixed focus position D1 is kept, there is a risk that the target's eyes cannot be accurately captured. For this reason, iris camera setting unit 205 sets the angle of view of iris camera 110 according to a predetermined re-authentication position D2 (position of subject P). As a method for setting (changing) the angle of view, for example, a controllable zoom lens or the like may be used to change the lens focal length of the camera. Note that the lens focal length is a lens parameter for determining the angle of view that can be captured by the camera.
[0071] Also, instead of the angle of view, the imaging direction of iris camera 110 may be changed. For example, as shown in FIG. 11, the angle at which the eyes of subject P are viewed from iris camera 110 is different between fixed focus position D1 and re-authentication position D2. For example, if the angles (angles with respect to the horizontal direction) viewed from iris camera 110 at fixed focus position D1 and re-authentication position D2 are θ1 and θ2, respectively, θ2 is larger than θ1. Then, similar to the angle of view, if the image is captured at re-authentication position D2 in the same imaging direction as fixed focus position D1, there is a risk that the subject's eyes cannot be accurately captured. For this reason, iris camera setting unit 205 sets the imaging direction of iris camera 110 according to a predetermined re-authentication position D2 (position of subject P). The imaging direction may be changed by changing the orientation of the camera itself, or by changing the orientation of the optical axis using a mirror or the like.
[0072] Next, control device 200 selects and sets iris camera 110 (S304). Iris camera setting unit 205 converts the coordinates of the eyes in the overall overhead image into coordinates in the iris camera image based on the angle of view or imaging direction of the iris camera set as described above, and selects iris camera 110 and sets the ROI using the converted coordinates. For example, coordinate conversion may be performed using a coordinate conversion matrix according to the angle of view or imaging direction. Thereafter, as in the fifth embodiment, iris camera 110 captures an image of the iris of the subject and authenticates the subject (S305 to S308).
[0073] As described above, in this embodiment, the angle of view and the image capturing direction of the iris camera are further changed during re-authentication. Since the angle of view and the angle from the camera change between walk-through authentication and re-authentication, by appropriately setting the angle of view and the image capturing direction during re-authentication, it is possible to more reliably capture an image of the subject's iris during re-authentication and further improve the accuracy of the re-authentication process.
[0074] (Embodiment 7) Next, a seventh embodiment will be described. This embodiment is an example in which re-authentication is performed by changing the amount of illumination light during re-authentication in the imaging system of the fifth or sixth embodiment. The configuration of the imaging system and the configuration of the control device according to this embodiment are the same as those of the fifth or sixth embodiment, and the operation during walk-through authentication is also the same as those of the fifth or sixth embodiment.
[0075] Fig. 12 shows the re-authentication process according to the present embodiment. In Fig. 12, a process for setting the amount of illumination light (S311) is added, compared to the process in Fig. 9 of the sixth embodiment. Note that, in this example, the present embodiment is applied to the re-authentication process of the sixth embodiment, but the present embodiment may also be applied to the re-authentication process of the fifth embodiment.
[0076] That is, in the re-authentication process according to the present embodiment, as in FIG. 9, capturing an overall bird's-eye image (S301) and detecting eyes (S302) are performed. Next, the control device 200 sets the amount of illumination light (S311). Since the fixed focus position D1 during walk-through authentication and the re-authentication position D2 during re-authentication are different in distance from the illumination device 130, the intensity (brightness) of the illumination light changes. Then, if an image is captured at the re-authentication position D2 with the same amount of illumination light as that at the fixed focus position D1, there is a risk that the feature amount cannot be extracted accurately from the iris image of the subject. For this reason, the illumination control unit 204 sets the amount of light of the multiple illumination devices 130 according to a predetermined re-authentication position D2 (position of the subject P). Thereafter, the illumination light is irradiated to the subject with the set amount of light (S303), and as in the sixth embodiment, the iris camera 110 captures an image of the iris of the subject and authenticates the subject (S301, S304 to S308).
[0077] As described above, in this embodiment, the intensity of the illumination light is further changed during re-authentication. Since the intensity of the illumination light changes between walk-through authentication and re-authentication, the accuracy of the re-authentication process can be further improved by appropriately setting the intensity of the illumination light during re-authentication. Note that, during re-authentication, not only the intensity of the illumination light but also the irradiation direction of the illumination light may be changed depending on the re-authentication position.
[0078] (Other embodiments) For example, in the imaging system according to any one of the fifth to seventh embodiments, it is not necessary to capture an overall overhead image during re-authentication. That is, in the re-authentication processes of Figs. 7, 9, and 12, capturing an overall overhead image (S301) and detecting the eyes (S302) may be omitted.
[0079] In this case, in S304, the iris camera 110 may be selected and set based on the eye position detected from the overall overhead image during walk-through authentication. If the eye coordinates detected from the overall overhead image during walk-through authentication are converted to the coordinates of the iris camera image during re-authentication, there is a risk that the iris of the subject P at the re-authentication position D2 cannot be accurately captured. For this reason, it is preferable to predict the eye position of the overall overhead image at the re-authentication position D2 from the eye position detected from the overall overhead image during walk-through authentication. For example, the eye position of the overall overhead image at the re-authentication position D2 can be predicted according to the distance from the position (trigger position D0) where the overall overhead image is captured to the re-authentication position D2. The predicted eye coordinates of the overall overhead image are converted to the coordinates of the iris camera image, and the iris camera 110 is selected and the ROI is set using the converted coordinates.
[0080] The present disclosure is not limited to the above-described embodiment, and can be modified as appropriate without departing from the spirit and scope of the present disclosure.
[0081] Moreover, each configuration in the above-mentioned embodiment is configured by hardware or software, or both, and may be configured by one hardware or software, or may be configured by multiple hardware or software. Each device and each function (processing) may be realized by a computer 20 having a processor 21 and a memory 22 as a storage device as shown in FIG. 13. For example, a program for performing a method in the embodiment (e.g., an imaging method in a control device) may be stored in the memory 22, and each function may be realized by executing the program stored in the memory 22 by the processor 21. Note that, as the processor 21, a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), an FPGA (field-programmable gate array), a DSP (digital signal processor), an ASIC (application specific integrated circuit), or the like may be used. Also, a plurality of these may be used in parallel.
[0082] These programs can be stored and provided to a computer using various types of non-transitory computer readable media. Non-transitory computer readable media include various types of tangible storage media. Examples of non-transitory computer readable media include magnetic recording media (e.g., flexible disks, magnetic tapes, hard disk drives), magneto-optical recording media (e.g., magneto-optical disks), CD-ROM (Read Only Memory), CD-R, CD-R / W, and semiconductor memory (e.g., mask ROM, PROM (Programmable ROM), EPROM (Erasable PROM), flash ROM, RAM (random access memory)). The programs may also be provided to a computer by various types of transitory computer readable media. Examples of transitory computer readable media include electric signals, optical signals, and electromagnetic waves. The transitory computer readable media can provide the programs to a computer via a wired communication path such as an electric wire and an optical fiber, or via a wireless communication path.
[0083] Although the present disclosure has been described above with reference to the embodiments, the present disclosure is not limited to the above-mentioned embodiments. Various modifications that can be understood by a person skilled in the art can be made to the configuration and details of the present disclosure within the scope of the present disclosure.
[0084] A part or all of the above-described embodiments can be described as, but is not limited to, the following supplementary notes. (Appendix 1) a first control means for controlling an iris imaging means for imaging an iris of a subject so as to fix a focal position at a predetermined position; an authentication means for authenticating the subject based on an iris image of the subject captured by the controlled iris image capturing means; a second control means for controlling the iris image capturing means to scan a focal position within a predetermined range in order to re-authenticate the subject when authentication of the subject has failed; An imaging system comprising: (Appendix 2) the first control means controls to fix the focus position when authenticating the target person in a first authentication mode; the second control means controls the focus position to be scanned when authenticating the target person in a second authentication mode; 2. The imaging system of claim 1. (Appendix 3) the first authentication mode is an authentication mode for authenticating the subject while moving, The second authentication mode is an authentication mode for authenticating the subject who is stopped. 3. The imaging system of claim 2. (Appendix 4) Further comprising a guidance control means for controlling a guidance means for guiding the movement of the subject, The guidance control means controls the guidance means to stop the moving target person when authentication of the target person fails. 4. The imaging system of claim 3. (Appendix 5) the guiding means is a gate through which the subject passes, The guidance control means controls the gate to be closed if authentication of the target person fails. 5. The imaging system of claim 4. (Appendix 6) the guidance means is an output means for outputting an authentication result of the subject person, The guidance control means outputs information for stopping the movement of the target person from the output means when authentication of the target person fails. 5. The imaging system of claim 4. (Appendix 7) The iris imaging means includes a variable focus lens; the first and second control means control a lens focus drive value of the variable focus lens; 7. An imaging system according to any one of claims 1 to 6. (Appendix 8) The second control means sets a focal position of the iris image capturing means in accordance with a position of the subject. 8. An imaging system according to any one of claims 1 to 7. (Appendix 9) the second control means changes an angle of view of the iris image capturing means when authentication of the subject person fails. An imaging system according to any one of claims 1 to 8. (Appendix 10) the second control means changes an imaging direction of the iris imaging means when authentication of the subject person fails. An imaging system according to any one of claims 1 to 8. (Appendix 11) The first control means sets a ROI (Region Of Interest) including the eyes of the subject for the iris imaging means based on a whole image captured by a whole imaging means for capturing an image of the subject in a wider range than the iris imaging means. 11. An imaging system according to any one of claims 1 to 10. (Appendix 12) the first control means transforms coordinates of the subject's eyes in the entire image into coordinates in the iris image using a coordinate transformation matrix corresponding to the fixed focus position, and sets the ROI based on the transformed coordinates. 12. The imaging system of claim 11. (Appendix 13) The second control means sets the ROI for the iris imaging means based on the transformed coordinates. 13. The imaging system of claim 12. (Appendix 14) The iris imaging means includes a plurality of iris imaging means, the first control means selects the iris imaging means to be set from among the plurality of iris imaging means based on the converted coordinates. 14. The imaging system according to claim 12 or 13. (Appendix 15) the second control means selects the iris imaging means to be set from among the plurality of iris imaging means based on the converted coordinates. 15. The imaging system of claim 14. (Appendix 16) The second control means sets an ROI including the eyes of the subject for the iris imaging means based on a whole image captured by a whole imaging means for capturing an image of the subject in a wider range than the iris imaging means. 11. An imaging system according to any one of claims 1 to 10. (Appendix 17) the second control means transforms the coordinates of the subject's eyes in the entire image into coordinates in the iris image using a coordinate transformation matrix corresponding to the position of the subject, and sets the ROI based on the transformed coordinates. 17. The imaging system of claim 16. (Appendix 18) The iris imaging means includes a plurality of iris imaging means, the second control means selects the iris imaging means to be set from among the plurality of iris imaging means based on the converted coordinates. 18. The imaging system of claim 17. (Appendix 19) and a lighting control means for controlling a change in the amount of light of a lighting means for irradiating the subject with light when authentication of the subject fails. 19. An imaging system according to any one of claims 1 to 18. (Appendix 20) Controlling an iris imaging means for imaging the iris of the subject so as to fix a focal position at a predetermined position; authenticating the subject based on an iris image of the subject captured by the controlled iris imaging means; If authentication of the subject fails, the control unit controls the iris image capturing unit to scan a focal position within a predetermined range in order to re-authenticate the subject. Imaging method. (Appendix 21) When authenticating the subject in a first authentication mode, control is performed to fix the focus position; When authenticating the subject in a second authentication mode, controlling the focus position to be scanned. 21. The imaging method according to claim 20. (Appendix 22) Controlling an iris imaging means for imaging the iris of the subject so as to fix a focal position at a predetermined position; authenticating the subject based on an iris image of the subject captured by the controlled iris imaging means; If authentication of the subject fails, the control unit controls the iris image capturing unit to scan a focal position within a predetermined range in order to re-authenticate the subject. An imaging program for causing a computer to execute the processing. (Appendix 23) When authenticating the subject in a first authentication mode, control is performed to fix the focus position; When authenticating the subject in a second authentication mode, controlling the focus position to be scanned. 23. The imaging program according to claim 22. [Explanation of symbols]
[0085] 10. Imaging System 11 First control section 12 Authentication Section 13 Second control section 20. Computers 21 Processors 22 Memory 100 Imaging System 110 Iris Camera 111 Variable Focus Lens 120 Overall View Camera 130 Lighting Equipment 140 Human detection sensor 150 Gates 160 Display device 200 Control device 201 Storage section 202 Overall bird's-eye view image acquisition unit 203 Eye detection unit 204 Lighting control unit 205 Iris camera setting section 206 Lens focus control unit 207 Iris image acquisition unit 208 Focused image extraction unit 209 Authentication Department 210 Authentication result output section 211 Gate control section 300 Databases
Claims
1. An imaging system connected to a display device that guides a user and a gate device that blocks the progress of the user, A control means for controlling a focal position of an iris image capturing means for capturing an image including an iris of a subject to a predetermined position; an authentication means for authenticating a moving subject based on an iris image of the subject captured by the iris image capturing means with the focus position controlled to a first position; a guidance control means for controlling the display device and the gate device so that the display device and the gate device stop at a second position closer to the iris image capturing means than the first position when authentication of the moving target person fails, the control means controls the focal position of the iris image capturing means to a position including the second position; The iris image capturing means captures an image of the subject while the subject is stationary; The authentication means re-authenticates the subject based on an iris image of the subject who is stopped and captured by the iris image capturing means. Imaging system.
2. The iris imaging means includes a variable focus lens; The control means controls a lens focus drive value of the variable focus lens. The imaging system according to claim 1 .
3. the control means changes an angle of view of the iris image capturing means when authentication of the moving subject fails. The imaging system according to claim 1 .
4. the control means changes an imaging direction of the iris imaging means when authentication of the moving subject fails. The imaging system according to claim 1 .
5. the control means sets a ROI (Region Of Interest) including the eyes of the subject with respect to the iris imaging means based on a whole image captured by a whole imaging means for capturing an image of the subject over a wider range than the iris imaging means; The imaging system according to claim 1 .
6. the control means transforms coordinates of the subject's eyes in the entire image into coordinates in the iris image using a coordinate transformation matrix corresponding to the first position or the second position, and sets the ROI based on the transformed coordinates. The imaging system according to claim 5 .
7. The control means sets the ROI for the iris imaging means based on the converted coordinates. The imaging system according to claim 6 .
8. The iris imaging means includes a plurality of iris imaging means, the control means selects the iris imaging means to be set from among the plurality of iris imaging means based on the converted coordinates.
8. The imaging system according to claim 6 or 7.
9. and a lighting control means for controlling a change in the amount of light of a lighting means for irradiating the subject with light when authentication of the subject fails. The imaging system according to claim 1 .
10. An imaging method in an imaging system connected to a display device that guides a user and a gate device that obstructs the progress of the user, comprising: Controlling a focal position of an iris imaging means for capturing an image including the iris of the subject to a predetermined position; performing authentication of the target person based on an iris image of the target person while moving, the iris image being captured by the iris image capturing means with the focus position controlled to a first position; If authentication of the moving subject fails, the display device and the gate device are controlled to stop at a second position closer to the iris image capturing means than the first position; controlling the focal position of the iris image capturing means to a position including the second position; The iris image capturing means captures an image of the subject while the subject is stationary; re-authenticate the subject based on the iris image of the subject during the stop, captured by the iris capturing means; Imaging method.
11. An imaging program for causing an imaging system connected to a display device that guides a user and a gate device that blocks the progress of the user to execute an imaging method, the imaging method comprising the steps of: Controlling a focal position of an iris imaging means for capturing an image including the iris of the subject to a predetermined position; performing authentication of the target person based on an iris image of the target person while moving, the iris image being captured by the iris image capturing means with the focus position controlled to a first position; If authentication of the moving subject fails, the display device and the gate device are controlled to stop at a second position closer to the iris image capturing means than the first position; controlling the focal position of the iris image capturing means to a position including the second position; The iris image capturing means captures an image of the subject while the subject is stationary; re-authenticate the subject based on the iris image of the subject during the stop, captured by the iris capturing means; Imaging program.
Citation Information
Patent Citations
Imaging apparatus for authentication
JP2005244549A
Eye image imaging device and authentication device using the same
JP2006338236A
Method and apparatus for iris authentication from one image
JP2007504562A
Authentication apparatus and authentication method
JP2008052317A
Gate system and method of controlling passage of gate
JP2016053896A
