Device for capturing images of a person on board a vehicle
A dual-camera and dual-infrared-light-source system addresses iris imaging challenges by using varied illumination angles to reduce reflections, ensuring clear iris capture and improved detection reliability.
Patent Information
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- IDEMIA PUBLIC SECURITY FRANCE
- Filing Date
- 2024-10-31
- Publication Date
- 2026-05-07
AI Technical Summary
Existing iris imaging devices in vehicles struggle to clearly capture iris images due to obstructions such as reflections from glasses, which hinder subsequent processing.
A dual-camera and dual-infrared-light-source system that includes a first and second camera to capture initial images, followed by an infrared camera oriented towards the iris, using two separate infrared illumination sources to enhance visibility by varying illumination angles, reducing the likelihood of reflections.
The system significantly improves iris detection reliability by minimizing reflections, ensuring clear iris images are obtained even in the presence of obstructions like glasses, enhancing the accuracy of subsequent processing.
Smart Images

Figure FR2024051438_07052026_PF_FP_ABST
Abstract
Description
[0001] DESCRIPTION
[0002] TITLE: Device for acquiring images of an individual inside a vehicle
[0003] TECHNICAL FIELD
[0004] This disclosure relates to a device for acquiring images of an individual inside a vehicle.
[0005] STATE OF THE ART
[0006] Prior art exists for a device that acquires images of an individual's iris inside a vehicle. The device comprises a camera and a light source configured to illuminate the iris while the camera acquires an image of the iris. The iris image can then be used in subsequent processing, for example, to authenticate the individual.
[0007] However, the iris may not be clearly visible in the acquired image, preventing further processing. For example, if the individual is wearing glasses, a reflection on the glasses may obscure the iris.
[0008] DESCRIPTION OF THE INVENTION
[0009] One aim of the invention is to detect the iris of an individual on board a vehicle more reliably.
[0010] This goal is achieved by a device for acquiring images of an individual on board a vehicle, the device comprising: a first camera configured to acquire a first image showing the individual on board the vehicle; a second camera configured to acquire a second image showing the individual on board the vehicle; a processing unit to determine indicative data of a position of an iris of the individual from the first and second images; an infrared camera configured to be oriented towards the iris of the individual using the data, then to acquire a third and a fourth image while the infrared camera is oriented towards the iris; a first infrared illumination source configured to illuminate the iris during the acquisition of the third image;and a second infrared illumination source configured to illuminate the iris during the acquisition of the fourth image, the second infrared illumination source being separate from the first infrared illumination source. The device, which is the first subject of this disclosure, may also include the following optional features, taken alone or in combination whenever technically feasible.
[0011] Preferably, the first camera, the second camera, and the infrared camera have respective optical inputs; the first infrared light source has a first optical output; the second infrared light source has a second optical output; the first optical output and the optical inputs together define a first working area visible in a front view of the device, the first working area having, in the front view, a first dimension measured in a first direction, and a second dimension measured in a second direction perpendicular to the first direction. Furthermore, the second optical output and the optical inputs together define a second working area visible in the front view, the second working area having, in the front view, a first dimension measured in the first direction, and a second dimension measured in the second direction.The first dimension of the second zone is greater than the first dimension of the first zone and / or the second dimension of the second zone is less than the second dimension of the first zone.
[0012] Preferably, the first dimension of the first zone is between 200 and 250 millimeters.
[0013] Preferably, the second dimension of the first zone is between 250 and 260 millimeters.
[0014] Preferably, the first dimension of the second zone is between 250 and 320 millimeters.
[0015] Preferably, the second dimension of the second zone is between 120 and 130 millimeters.
[0016] Preferably, the optical inputs are included in an acquisition zone, the first optical output is included in a first infrared illumination zone separated from the acquisition zone by a first line parallel to the first direction, the first working zone being the union of the acquisition zone and the first infrared illumination zone, and the second optical output is included in a second infrared illumination zone separated from the acquisition zone by a second line parallel to the second direction, the second working zone being the union of the acquisition zone and the second infrared illumination zone. Preferably, the second direction is vertical to the ground.
[0017] Preferably, the first infrared lighting source has a first optical output spaced at least 13 centimeters apart from an optical input of the infrared camera.
[0018] Preferably, the second infrared lighting source has a second optical output spaced at least 13 centimeters apart from the optical input of the infrared camera.
[0019] Preferably, the first camera and the second camera have respective optical inputs that are separated by a distance of at least 20 centimeters.
[0020] Preferably, the first camera and the second camera have respective optical inputs having optical axes that are secant or intersecting.
[0021] Preferably, the device further includes a visible light source configured to illuminate the individual during the acquisition of the first image or the acquisition of the second image, wherein the first camera and the second camera are sensitive to wavelengths emitted by the visible light source.
[0022] Preferably, the infrared camera is configured to acquire a sequence of images comprising at least three images while the infrared camera is pointed at the iris, and the first light source and the second light source are configured to alternately illuminate the iris during the acquisition of the sequence of images.
[0023] Preferably, the processing unit is configured to detect whether the iris is visible or not in the third image, and the infrared camera is configured to acquire the fourth image provided that the processing unit has detected that the iris is visible in the third image.
[0024] Preferably, the device includes a frame suitable for fixing to the ground, and a support mounted movable in vertical translation relative to the frame and / or in rotation around a vertical axis relative to the frame, the support including the first camera, the second camera, the infrared camera, the first infrared lighting source and the second infrared lighting source.
[0025] Preferably, the processing unit is further configured to: detect the vehicle in an image, determine a mount position suitable for viewing the face of an individual inside the vehicle, and move the mount relative to the frame to that position. A second subject of this disclosure is a system comprising two image acquisition devices for an individual inside a vehicle, each of the two devices conforming to the first subject of the disclosure, and the two devices being located on either side of a vehicle passageway.
[0026] A third object of this disclosure is a method for acquiring images of an individual in a vehicle, the method comprising the following steps: acquiring a first image showing the individual in the vehicle, using a first camera; acquiring a second image showing the individual in the vehicle, using a second camera; determining indicative data of a position of an iris of the individual from the first and second images; directing an infrared camera towards the iris of the individual using the data, and then acquiring a third and fourth image showing the iris, using the infrared camera directed towards the iris; illuminating the iris during the acquisition of the third image, using a first infrared illumination source; and illuminating the iris during the acquisition of the fourth image, using a second infrared illumination source separate from the first infrared illumination source.
[0027] DESCRIPTION OF THE FIGURES
[0028] Other features, purposes and advantages of the invention will become apparent from the following description, which is purely illustrative and not limiting, and which should be read in conjunction with the accompanying drawings on which:
[0029] Figure 1 schematically illustrates a road control system according to one embodiment.
[0030] Figure 2 is a front view of an image acquisition device according to one embodiment.
[0031] Figure 3 is a front view of a support that is part of the image acquisition device shown in Figure 2.
[0032] Figure 4 is a schematic, cavalier perspective view of the support of Figure 3, and of a vehicle window.
[0033] Figure 5 is a schematic representation of components of an image acquisition device according to one embodiment.
[0034] Across all figures, similar elements bear identical references.
[0035] DETAILED DESCRIPTION OF THE INVENTION With reference to figure 1, a road control system includes an image acquisition device 1.
[0036] The image acquisition device 1 includes a frame 2, also called a kiosk, intended to be fixed to the ground, typically at the edge of a passage 3 for a vehicle, and a support 4 that is movable in vertical translation relative to the frame 2. Thus, the support 4 can be placed at different altitudes relative to the ground.
[0037] Device 1 also includes a motor to move the support 4 vertically relative to the frame 2.
[0038] In the following, we will refer to three characteristic directions parallel to three axes X, Y and Z forming together an orthonormal frame (the X axis is visible in figure 2).
[0039] The Z-axis is a vertical axis (normal to the ground). It is parallel to the Z-axis that the support 4 is mobile in translation relative to the frame 2 by means of the motorization.
[0040] The support 4 can also be mobile in rotation around an axis parallel to the Z axis. Such a rotation allows the support to be visible from a vehicle more or less advanced in the passage 3. This rotation also makes it possible to increase the field of acquisition by the optical device, in particular in order to visualize a person in the middle of a rear row of the vehicle, who will thus no longer be hidden by the person closest to the kiosk, or in order to allow visualization of a person facing away from the road, for example in the case of a row facing in the opposite direction to the direction of travel of the vehicle.
[0041] The system includes a second image acquisition device 1'. The second image acquisition device 1' may have the same characteristics as the image acquisition device 1.
[0042] The two devices 1 and 1' are located on either side of a passage 3 for a vehicle. We will see later that these two devices 1 and 1' are each intended to represent individuals inside the vehicle when the vehicle is in passage 3.
[0043] Referring to Figure 2, support 4 has a front face. The front face has a height measured parallel to the Z-axis, and a width measured parallel to the X-axis. The Y-axis is normal to the front face.
[0044] The front face is, for example, rectangular or square.
[0045] The front panel is oriented so that it is visible from passageway 3. For example, the front panel is oriented parallel to an edge of passageway 3. Alternatively, the panel is set at a fixed angle (for example, 20°) to such an edge, so that a user in the passageway does not have to turn 90° to view the front panel. In this case, the kiosk can be positioned slightly further forward, which is more comfortable for users.
[0046] The support 4 includes a first camera 6 with a field of view directed towards the road. As will be seen later, the first camera 6 is intended to acquire an image of an individual in a vehicle located on the crossing 3.
[0047] The first camera 6 has a first optical input opening into the front face of the support 4. The first optical input has a first optical axis extending parallel to the Y axis or not.
[0048] The first optical axis is fixed relative to support 4.
[0049] The first camera 6 has a viewing angle of at least 40 degrees in the (Y, Z) plane parallel to the ground, for example 53 degrees.
[0050] The support 4 also includes a second camera 8 with a field of view directed towards the road. As will be seen later, the second camera 8 is designed to acquire an image of an individual inside a vehicle on the road.
[0051] The second camera 8 has a second optical input also opening into the front face of the support 4. The second optical input has a second optical axis extending parallel to the Y axis or not.
[0052] The second optical axis is fixed relative to support 4.
[0053] The second camera 8 has a viewing angle of at least 40 degrees in the (Y, Z) plane parallel to the ground, for example 53 degrees.
[0054] In one embodiment of Figure 2, the first optical axis and the second optical axis are parallel (to the Y-axis). In another embodiment, the first optical axis and the second optical axis intersect. For example, the first optical axis and the second optical axis intersect at a point located in passage 3. In particular, one axis of the first and second optical axes may be parallel to the Y-axis (and therefore normal to the direction of the road), and the other axis of the first and second optical axes may be oriented slightly backward, with reference to a direction of vehicle traffic on the road.
[0055] The two cameras 6, 8 are intended to image the same individual on board a vehicle, and possibly several individuals, in particular their faces.
[0056] The second camera 8 can be identical to the first camera 6 (apart from their respective positions). Both the first camera 6 and the second camera 8 operate in the visible spectrum, meaning they are sensitive to wavelengths within the visible range.
[0057] The device also includes an infrared camera 10, which is separate from the first camera 6 and the second camera 8.
[0058] The infrared camera 10 includes a third optical input which also opens into the front face of the support 4.
[0059] The infrared camera has a narrower viewing angle than cameras 6, 8.
[0060] The optical input of the infrared camera has a third optical axis that is movable and rotates about the support 4, preferably about two orthogonal axes (e.g., parallel to the X and Z axes, respectively). In this way, the infrared camera 10 can perform a horizontal scan, for example, over at least 40 degrees, or e.g., 53 degrees, and a vertical scan, for example, over at least 40 degrees, or e.g., 53 degrees.
[0061] The infrared camera 10 includes a motor to change the orientation of the third optical axis relative to the support 4.
[0062] The infrared camera includes a focusing system allowing the position of a plane of focus to be varied within a range of positions, for example a range of 100 centimeters in length, for example the distance between the position of the plane of focus and the support 4 extends over a range from 50 centimeters to 150 centimeters.
[0063] In one embodiment, the infrared camera 10 comprises a reflecting mirror and two lenses. The mirror forms the third optical input of the infrared camera 10, in that a light ray from outside the device is reflected by the mirror before reaching the lenses. The reflecting mirror is rotatable relative to the support 4. The two lenses of the infrared camera 10 are oriented so that their optical axes are vertical. This arrangement reduces the depth of the support 4 (measured parallel to the Y-axis).
[0064] The infrared camera 10 is sensitive to wavelengths in the infrared range. It is not sensitive to wavelengths in the visible range.
[0065] Device 1 also includes a first infrared lighting source 12 configured to illuminate the iris during image acquisition by the infrared camera 10. The first infrared lighting source 12 is configured to emit light having infrared wavelengths to which the infrared camera 10 is sensitive.
[0066] The first infrared light source 12 includes a first optical output which opens into the front face of the support 4. In this way, the light emitted by the first infrared light source 12 illuminates the road, and possibly a vehicle located in the passage 3.
[0067] In one embodiment, the first infrared light source 12 comprises a plurality of infrared light-emitting diodes (LEDs). The LEDs are, for example, arranged in horizontal rows and vertical columns to form an LED array. An LED array has the advantage of not generating excessively wide reflections on eyeglass lenses.
[0068] Device 1 also includes a second infrared lighting source 14 configured to illuminate the iris during image acquisition by the infrared camera 10. The second infrared lighting source 14 is separate from the first infrared lighting source 12.
[0069] The second infrared lighting source 14 is configured to emit light having infrared wavelengths to which the infrared camera 10 is sensitive.
[0070] The second infrared light source 14 includes a second optical output which opens into the front face of the support 4. In this way, the light emitted by the first infrared light source 14 illuminates the road, and possibly a vehicle located in the passage 3.
[0071] In one embodiment, the second infrared lighting source 14 comprises a plurality of infrared light-emitting diodes (LEDs). The LEDs are, for example, arranged in horizontal rows and vertical columns to form an LED matrix.
[0072] The second infrared lighting source 14 can be identical to the first infrared lighting source 12, apart from their respective positions.
[0073] Device 1 also includes a first visible light source 16. This first visible light source 16 has an optical output opening onto the front face of the support 4. The optical output of the first visible light source 16 has, for example, a horizontally elongated band shape (parallel to the X-axis). Device 1 also includes a second visible light source 18. This second visible light source 18 has an optical output opening onto the front face of the support 4. The optical output of the second visible light source 18 has, for example, a horizontally elongated band shape (parallel to the X-axis).
[0074] Device 1 also includes a display screen 20. This display screen 20 opens into the front face of the support 4, so that it can be seen from passage 3, in particular by an individual on board a vehicle located in passage 3. The display screen is, for example, touch-sensitive.
[0075] Support 4 may also feature a front glass panel to camouflage all or part of the optical components listed above.
[0076] In one embodiment, the glass is transparent to the infrared wavelengths discussed previously and opaque to wavelengths in the visible range. The infrared optical components are masked by the glass. Thus, the following are arranged behind the glass: the optical outputs of the light sources 12 and 14, and the optical input of the infrared camera 10. Conversely, the glass has openings for the optical components operating in the visible range: the respective optical inputs of the first camera 6 and the second camera 8, as well as the display screen 20.
[0077] Relative positioning of the sources and cameras in a front view of the device
[0078] We will now discuss the relative positioning of the optical inputs of the different cameras 6, 8, 10 and the optical outputs of the different lighting sources 12, 14, 16, 18 in a front view of the support 4, this front view being illustrated in Figure 2 and in Figure 3. The front view is perpendicular to the Y axis, and parallel to the (X, Z) plane.
[0079] The first optical input (of the first camera 6), the second optical input (of the second camera 8) and the third optical input (of the infrared camera 10) are located between the optical outputs of the light sources in the visible range 14, 16.
[0080] The first optical input (of the first camera 8), the second optical input (of the second camera 10), the third optical input (of the infrared camera 10) and the optical output of the first infrared lighting source 12 together define a first working area.
[0081] The first work area is rectangular.
[0082] The first work area is divided into two zones A and B by a first line X1 parallel to a first direction. In the embodiment illustrated in Figure 3, the first direction is parallel to the X axis, therefore perpendicular to the direction of translation of the support 4 relative to the frame 2.
[0083] Area A includes the first optical input (of the first camera 8), the second optical input (of the second camera 10), and the third optical input (of the infrared camera 10). By convention, area A can be called the "acquisition zone" since rays must pass through this zone to reach any of the cameras 6, 8, and 10. Area A is rectangular.
[0084] Zone B includes the optical output of the first infrared light source 12. Therefore, the rectangular zone B can be called the "first infrared light zone," since infrared rays emanating from the first light source 12 pass through this zone. Zone B is rectangular.
[0085] Furthermore, the first optical input (of the first camera 8), the second optical input (of the second camera 10), the third optical input (of the infrared camera 10) and the optical output of the second infrared lighting source 14 together delimit a second working area different from the second working area.
[0086] The second work area is divided into two zones A and C by a first line Z1 parallel to a second direction perpendicular to the first direction. In the embodiment illustrated in Figure 3, the second direction is parallel to the Z-axis, and therefore corresponds to the direction of translation of the support 4 relative to the frame 2.
[0087] Zone C includes the optical output of the second infrared lighting source 14. We can therefore call zone C the "second infrared lighting zone", since infrared rays emanating from the first lighting source 12 pass into this zone C. Zone C is rectangular.
[0088] With the preceding arrangement, the three zones A, B, and C together form an L shape (zone A forming the "corner" of the L). Such an arrangement offers an advantageous compromise between reducing the footprint of support 4 in the (X, Z) plane and the performance of device 1. Indeed, this arrangement satisfies several constraints simultaneously:
[0089] • It allows support 4 to have a relatively reduced height and width.
[0090] • The second infrared lighting source 14 remains relatively far from the first lighting source 12, to reduce the risks of non-detection of the iris (for example due to a reflection on a pair of glasses).
[0091] • Each of the lighting sources 12 and 14 remains relatively far from the infrared camera 10. The first working area, which is conventionally denoted "A+B" to signify that it constitutes the union of areas A and B, is delimited by two other lines parallel to the first direction, denoted X2 and X3.
[0092] Zone A is delimited along the Z axis by line X1 and by line X2. In other words, the first optical input (of the first camera 8), the second optical input (of the second camera 10), the third optical input (of the infrared camera 10) are located between lines X1, X2.
[0093] Zone B is delimited along the Z axis by line X1 and by line X3. In other words, the optical output of the first infrared lighting source 12 is located between lines X1, X3.
[0094] The second work zone, which is conventionally denoted "A+C" to signify that it constitutes the union of zones A and C, is delimited by two other lines parallel to the first direction, denoted Z2 and Z3.
[0095] Sub-zone A is delimited along the X axis by line Z1 and by line Z2. In other words, the first optical input (of the first camera 8), the second optical input (of the second camera 10), the third optical input (of the infrared camera 10) are located between lines Z1, Z2.
[0096] Zone B is delimited along the X axis by line Z1 and by line Z3. In other words, the optical output of the second infrared lighting source 14 is located between lines Z1, Z3.
[0097] The first zone A+B has a first dimension DX1, measured in the first direction, constituting a distance between lines Z1 and 12.
[0098] The first zone A+B has a second dimension DZ1, measured in the second direction, constituting a distance between lines X2 and X3.
[0099] The second zone A+C has a first dimension DX2, measured in the first direction, constituting a distance between the lines Z2 and Z3.
[0100] The second zone A+C has a second dimension DZ2, measured in the second direction, constituting a distance between lines X1 and X2.
[0101] We have DX2 > DX1. When the first direction is horizontal, as in the embodiment shown in Figure 3, this implies that the second zone A+C is wider than the first zone A+B. Furthermore, we have DZ2 < DZ1. When the second direction is vertical, as in the embodiment shown in Figure 3, this implies that the second zone A+C is shorter (narrower in height) than the first zone A+B.
[0102] Preferably, DX1 is between 200 and 250 millimeters, for example equal to 245 millimeters.
[0103] Preferably, DZ1 is between 250 and 260 millimeters, for example equal to 255 millimeters.
[0104] Preferably, DX2 is between 250 and 320 millimeters, for example equal to 317 millimeters.
[0105] Preferably, DZ2 is between 120 and 130 millimeters, for example equal to 121 millimeters.
[0106] These preceding characteristics each contribute in their own way to being able to picture an individual standing behind a window of a vehicle in passage 3. Figure 4 schematically shows that the second zone A+C is projected into a medium-sized vehicle window (whose outline is represented by a dotted line closed on itself).
[0107] In particular, the fact that the first zone and the second zone have different dimensions allows the device to adjust to different vehicle windows, thus allowing device 1 to be used for vehicles of different dimensions.
[0108] Furthermore, the first infrared light source 12 has an optical output spaced at least 13 centimeters apart from an optical input of the infrared camera 10, and / or the second infrared light source 14 has an optical output spaced at least 13 centimeters apart, or even 20 centimeters apart, from the optical input of the infrared camera 10. The inventors were able to observe that this minimum distance of 13 centimeters makes it possible to avoid a "red-eye" effect in an image acquired by the infrared camera 10. Indeed, with such a distance, the angle between a line going from the light source 12 or 14 to an iris of an individual in a vehicle in passage 3 and a line going from the iris to the optical input of the infrared camera is greater than 5 degrees when the iris is less than 1.5 meters away.However, the inventors observed that, in practice, a driver will tend to position their vehicle at a distance such that the irises of any individual inside the vehicle are within 1.5 meters of a side-mounted device. Furthermore, the first camera 6 and the second camera 8 are preferably separated by at least 20 centimeters. This improves the ability of the device 1 to detect fraud using images acquired by the two cameras 6 and 8.
[0109] With reference to Figure 5, the device 1 also includes a processing unit 22 capable of interacting with the components 6, 8, 10, 12, 14, 16, 18, 20 described previously.
[0110] The processing unit 22 is in particular capable of controlling the acquisition of images by cameras 6, 8, 10, and of obtaining these images.
[0111] The processing unit 22 is also capable of controlling the lighting sources 14, 16, 18, so that these lighting sources emit light or not, and this independently.
[0112] The processing unit 22 is also capable of controlling the display, by the display screen 20, of information intended for an individual on board a vehicle in passage 3.
[0113] The processing unit includes a localization module whose function is to apply localization processing taking as input images provided respectively by the first camera 6 and the second camera 8. The operation of this module will be described later.
[0114] The processing unit 22 can have any structure. The processing unit can in particular include a memory storing a processing program comprising code instructions, and at least one processor to execute these code instructions, in order to cause one or the other of the aforementioned processing, which will be described in more detail later.
[0115] Device 1' may include all the features of device 1 as described above.
[0116] We will now describe a process implemented by the system, in particular by device 1.
[0117] In a detection step, the processing unit 22 detects the entry of a vehicle into the passage 3. This detection can be done, for example, using a vehicle detection camera, which can be one of the cameras 6 or 8, or another camera with a wider field of view than cameras 6, 8.
[0118] Detection can be performed when the vehicle is stationary, or when the vehicle is approaching. The processing unit 22 determines a position for the support 4 that is suitable for viewing the face of an individual inside the vehicle.
[0119] In one embodiment, the processing unit 22 analyzes the image produced by the vehicle detection camera to identify the vehicle class to which the vehicle belongs (motorcycle, car, truck, or bicycle). Class detection may involve artificial intelligence trained for this purpose. When the class relates to vehicles with windows (truck, car), the processing unit detects the outline of a vehicle window in the image. Based on this outline, the processing unit determines the altitude of the window's center. The position that the support 4 must reach is deduced from the position of the window's center.
[0120] In a vertical adjustment step, the processing unit 22 commands a translational movement parallel to the Z-axis of the support towards the determined position. When such mobility is possible, the processing unit 22 can also command a rotation of the support 4 relative to the frame 2 around an axis of rotation also parallel to the X-axis.
[0121] Next, the processing unit 22 activates the visible light sources 16, 18 (or only one of the two). The vehicle and its occupants are then illuminated by light in the visible range.
[0122] During this illumination, the first camera 6 acquires a first image showing an individual on board the vehicle, and the second camera 8 acquires a second image showing the individual on board the vehicle.
[0123] Processing unit 22 uses the first and second images to determine, through stereoscopy, indicative data about the position of an individual's iris, using a known method. During this step, processing unit 22 can begin by detecting faces in the images and matching them. The indicative positional data might be, for example, Cartesian coordinates or angles.
[0124] Next, the processing unit 22 commands an orientation of the optical input of the infrared camera 10, towards the determined iris position, so that this infrared camera points at the individual's iris.
[0125] The processing unit can also command the infrared camera 10 to use its focusing system to focus on the position in question, in order to image this iris clearly (i.e. adjust the focal length of the infrared camera 10 to a distance separating the camera 10 from the position of the iris.
[0126] The processing unit 22 activates the first infrared light source 12. Infrared radiation is thus emitted towards the vehicle, and specifically towards the determined iris position. During this illumination, the infrared camera acquires a third image. Afterwards, the processing unit 22 deactivates the first infrared light source 12.
[0127] Next, the processing unit 22 activates the second infrared light source 14. Infrared radiation is thus emitted towards the vehicle, and in particular towards the determined iris position, but at a different angle than before. During this illumination, the infrared camera acquires a fourth image. Then, the processing unit 22 deactivates the second light source 1.
[0128] Thus, the processing unit 22 obtains two different images, which in a normal situation show the iris since the infrared camera was pointed at the iris during their acquisition. However, the iris may be obscured by an obstacle in the third or fourth image, for example by a reflection on a pair of glasses.
[0129] Indeed, when wearing glasses, there can be a direct reflection of our own lighting onto the glasses (on one or two diopters) which, seen by the camera, is superimposed on the iris. Approximately 15% of images are affected by this problem. The position of the second light source allows for a significantly different geometry and ensures that, for the same glasses position, the reflection is "shifted" compared to the reflection obtained with the first light source.
[0130] Thus, the presence in device 1 of the two infrared light sources 12 and 14 increases the chances of correctly imaging the iris of a passenger wearing glasses. The probability of a reflection falling on the iris with both available lights is much lower than the probability of a reflection on the iris with a single light source.
[0131] In one embodiment, the two images are acquired successively in an unconditional manner, and their content is checked by the processing unit 22 in a second step.
[0132] In another embodiment, the processing unit acquires the third image (under illumination from the first infrared light source 12) and checks its content. If the processing unit 22 determines that the iris is not visible in the third image, it then commands the acquisition of the fourth image (under illumination from the second infrared light source 14). If the iris is visible in the third image, the second infrared light source 14 is not activated.
[0133] Of course, the infrared camera may not be limited to acquiring just two images of the iris, but more generally a succession of images, the number of which is greater than or equal to three. The processing unit 22 uses sources 12 and 14 alternately, so that one image out of two is acquired under the illumination of the first infrared light source 12, and one image out of two is acquired under the illumination of the second light source 14.
[0134] In addition, the processing unit 22 can select only one of the two sources 12 and 14, for example source 14, when it has been determined that the height of a window of the vehicle is less than a certain threshold H2 (for example 255 millimeters).
[0135] All the preceding steps have been described for an individual on board the vehicle.
[0136] During the process, the processing unit 22 can command the display of messages to an individual on board the vehicle, for example the driver, on the display screen 20. These messages can, for example, invite the driver to lower the window of his vehicle or give him other instructions on how to position his face in view of the device 1.
[0137] These steps can be implemented for several individuals on board the same vehicle. Indeed, several faces of people can be detected by the processing unit 22 in images acquired by cameras 6, 8.
[0138] Furthermore, the preceding steps can be performed not only by device 1 but also by device 1' located on the other side of passage 3 in which the vehicle is situated. Device 1' can thus image the iris of an individual that device 1 cannot see, for example because the individual's face is turned to the side, towards device 1', or because there is an obstacle between the individual and device 1 (such as another individual standing next to them).
[0139] In a particular application, device 1 (or more generally the system comprising devices 1 and 1') verifies that the number of individuals on board the vehicle in passage 3 conforms to a predefined number. Processing unit 22 can count the individuals whose faces are visible in the images acquired by cameras 6 and 8, and produce a list of detected individuals. Then, iris images can be acquired individual by individual, according to an order predefined by processing unit 22. In particular, processing unit 22 can use the following criteria for ordering the detected individuals:
[0140] • an estimated distance between the individual and device 1,
[0141] • a difference in pixels, in one of the acquired images, between the individual's face and a center of the image.
[0142] The above provision is applicable to all vehicles, not just those equipped with windows.
[0143] A system with two acquisition devices, 1 and 1', was presented above. However, the number of acquisition devices differs in other embodiments. In one embodiment, the system comprises only acquisition device 1. In another embodiment with four acquisition devices, devices 1 and 1' are arranged opposite each other so as to be able to simultaneously image the passages of a front row of the vehicle (thus including the driver of the vehicle), and the system further comprises two additional acquisition devices arranged opposite each other so as to be able to simultaneously image a rear row of the vehicle.
[0144] It was previously assumed that the first camera 6 and the second camera 8 operate in the visible spectrum. However, this is not mandatory: either camera 6 or 8 could alternatively be an infrared camera (or even both), in which case one or both of the light sources 14 and 16 would also be infrared.
[0145] It has also been assumed that the infrared camera 10 sequentially acquires two images using the infrared light sources 12 and 14 one after the other. This is straightforward to achieve. However, in another embodiment, the camera 10 can acquire these two images with the light sources 12 and 14 active simultaneously. For this purpose, the wavelengths emitted by the sources 12 and 14 can be different, and the device 1 can include filters with corresponding wavelengths. Alternatively, or as a complement, the camera 10 can be capable of distinguishing different polarizations of light, for example, using a monochrome camera or one or more suitable polarizers.
Claims
DEMANDS 1. Device (1) for acquiring images of an individual on board a vehicle, the device (1) comprising: • a first camera (6) configured to acquire a first image showing the individual on board the vehicle, • a second camera (8) configured to acquire a second image showing the individual on board the vehicle, • a processing unit (22) configured to determine indicative data of the position of an individual's iris from the first and second images, • an infrared camera (10) configured to be pointed at the individual's iris using the data, then to acquire a third and fourth image while the infrared camera (10) is pointed at the iris, • a first infrared lighting source (12) configured to illuminate the iris during the acquisition of the third image, • a second infrared lighting source (14) configured to illuminate the iris during the acquisition of the fourth image, the second infrared lighting source (14) being separate from the first infrared lighting source (12).
2. Device (1) according to the preceding claim, wherein: • The first camera (6), the second camera (8) and the infrared camera (10) have respective optical inputs, • the first infrared lighting source (12) has a first optical output, • The second infrared lighting source (14) has a second optical output, • The first optical output and the optical inputs together define a first working area (A+B) visible in a front view of the device (1), the first working area (A+B) having, in the front view: • a first dimension (DX1) measured in a first direction (X), and • a second dimension (DZ1) measured in a second direction (Z) perpendicular to the first direction (X), • The second optical output and the optical inputs together define a second working area (A+C) visible in the front view, the second working area (A+C) having, in the front view: • a first dimension (DX2) measured in the first direction (X), and • a second dimension (DZ2) measured in the second direction (Z), • in which the first dimension (DX2) of the second zone (A+C) is greater than the first dimension (DX1) of the first zone (A+B) and / or the second dimension (DZ2) of the second zone (A+C) is less than the second dimension (DZ1) of the first zone (A+B).
3. Device (1) according to the preceding claim, wherein: • the first dimension (DX1) of the first zone (A+B) is between 200 and 250 millimeters, and / or • the second dimension (DZ1) of the first zone (A+B) is between 250 and 260 millimeters, and / or, • the first dimension (DX2) of the second zone (A+C) is between 250 and 320 millimeters, and / or. • the second dimension (DZ2) of the second zone (A+C) is between 120 and 130 millimeters.
4. Device (1) according to any one of claims 2 and 3, wherein: • the optical inputs are included in an acquisition zone (A), • The first optical output is included in a first infrared illumination zone (B) separated from the acquisition zone (A) by a first line (X1) parallel to the first direction (X), the first working zone (A+B) being the union of the acquisition zone (A) and the first infrared illumination zone (B), • The second optical output is included in a second infrared lighting zone (C) separated from the acquisition zone (A) by a second line (Z1) parallel to the second direction (Z), the second working zone (A+C) being the union of the acquisition zone (A) and the second infrared lighting zone (C).
5. Device (1) according to any one of claims 2 to 4, wherein the second direction is vertical with respect to the ground.
6. Device (1) according to any one of the preceding claims, wherein: • the first infrared lighting source (12) has a first optical output spaced at least 13 centimeters apart from an optical input of the infrared camera (10), and / or • the second infrared lighting source (14) has a second optical output spaced at least 13 centimeters apart from the optical input of the infrared camera (10).
7. Device (1) according to any one of the preceding claims, wherein the first camera (6) and the second camera (8) have respective optical inputs which are separated by a distance of at least 20 centimeters.
8. Device (1) according to any one of the preceding claims, wherein the first camera (6) and the second camera (8) have respective optical inputs having optical axes that are secant or intersecting.
9. Device (1) according to any one of the preceding claims, further comprising: • a light source in the visible range (14, 16) configured to illuminate the individual during the acquisition of the first image or the acquisition of the second image, • in which the first camera (6) and the second camera (8) are sensitive to wavelengths emitted by the light source in the visible range (14, 16).
10. Device (1) according to any one of the preceding claims, wherein the infrared camera (10) is configured to acquire a succession of images comprising at least three images while the infrared camera (10) is directed towards the iris, and the first lighting source (12) and the second lighting source (14) are configured to alternately illuminate the iris, during the acquisition of the image succession.
11. Device (1) according to any one of claims 1 to 9, wherein: • The processing unit (22) is configured to detect whether the iris is visible or not in the third image, • The infrared camera (8) is configured to acquire the fourth image provided that the processing unit (22) has detected that the iris is visible in the third image.
12. Device (1) according to any one of the preceding claims, comprising: • a frame (2) suitable for being fixed to the ground, • a support (4) mounted movable in vertical translation relative to the frame (2) and / or in rotation around a vertical axis relative to the frame (2), the support (4) comprising the first camera (6), the second camera (8), the infrared camera (10), the first infrared lighting source (12) and the second infrared lighting source (14).
13. Device (1) according to the preceding claim, wherein the processing unit (22) is further configured to: • detect the vehicle in an image, • determine a position for the support (4) suitable for viewing the face of an individual on board the vehicle, • move the support (4) relative to the frame (2) towards the position.
14. System comprising two devices (1, 1') for acquiring images of an individual on board a vehicle, each of the two devices (1, 1') being according to any one of the preceding claims, the two devices (1, 1') being located on either side of a passage (3) for the vehicle.
15. A method for acquiring images of an individual in a vehicle, the method comprising the following steps: • acquire a first image showing the individual on board the vehicle, using a first camera (6), • acquire a second image showing the individual on board the vehicle, using a second camera (8), • to determine indicative data of the position of an individual's iris from the first and second images, • orient an infrared camera (10) towards the individual's iris using the data, then acquire a third and fourth image showing the iris, using the infrared camera (10) oriented towards the iris, • illuminate the iris during the acquisition of the third image, using a first infrared light source (12), • illuminate the iris during the acquisition of the fourth image, using a second infrared lighting source (14) separate from the first infrared lighting source (12).
Citation Information
Patent Citations
Apparatus and method for adjusting focus position in iris recognition system
JP2002352235A
Vehicle vision system with driver monitoring
US20150296135A1
Multi-camera biometric imaging system
US20230377370A1