Biometric Authentication Device
Through matrix-arranged photoelectric conversion elements and light emitting elements, the lighting position is controlled, stray light incident is reduced, and the signal quality of the biological authentication device is improved. The problem of low signal S/N ratio is solved, and high-precision biological information is achieved. Test.
Patent Information
- Application Number
- CN202210012396.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2021-01-07
- Filing Date
- 2022-01-07
- Publication Date
- 2024-11-01
- Estimated Expiration
- 2042-01-07
AI Technical Summary
In the existing biological authentication device, the signal-to-noise ratio (S/N ratio) of the signal of the imaging operation is low, resulting in insufficient accuracy and contrast of the detection results, making it difficult to detect biological information with high accuracy.
The photoelectric conversion element and light emitting element arranged in matrix form are used to control the operation of the photoelectric conversion element and light emitting element, and only the combination of corresponding positions is lit, so as to reduce stray light incident and improve signal quality.
The S/N ratio of the signals output in the biological authentication device is significantly improved, and images with higher contrast are generated, and biological information, such as blood vessel patterns and pulse wave data can be detected with high precision.
Smart Images

Figure CN114723926B_ABST
Abstract
Description
[0001] This application is based on Japanese Patent Application No. 2021-001470 (filing date: January 7, 2021), and claims the priority benefit of the Japanese Patent Application No. 2021-001470. The present application incorporates the entire contents of the Japanese Patent Application No. 2021-001470 by reference. Technical Field
[0002] Embodiments of the present invention relate to a biometric authentication device. Background Art
[0003] In recent years, optical biometric authentication devices have been known as biometric authentication devices used for personal authentication, etc. For example, a biometric authentication device is known in which a unit light source included in a light source is periodically lit by time division, and a camera unit group located near the lit unit light source is stopped, while a camera unit group located far away is observed from the lit unit light source. In this way, the reception of reflected light that may become a noise component during the camera operation can be reduced.
[0004] However, there is room for improvement in methods for improving the S / N ratio of a signal output as a result of an imaging operation in a biometric authentication device. Summary of the invention
[0005] One of the objects of the present application is to provide a biometric authentication device capable of improving the S / N ratio of a signal outputted from the biometric authentication device.
[0006] A biometric authentication device according to one embodiment includes a sensor and a lighting device. The sensor includes a first substrate, a plurality of photoelectric conversion elements arranged in a matrix on the first substrate and outputting a signal corresponding to the amount of light received, and a first control unit for controlling the operation of the plurality of photoelectric conversion elements. The lighting device includes a second substrate, a plurality of light-emitting elements arranged in a matrix on the second substrate and irradiating the light received by the plurality of photoelectric conversion elements, and a second control unit for controlling the operation of the plurality of light-emitting elements. The plurality of photoelectric conversion elements and the plurality of light-emitting elements are respectively divided into a plurality of groups corresponding to each other. The first control unit controls the operation of the plurality of photoelectric conversion elements in the following manner: if the light-emitting elements at the specified positions of each group of the light-emitting elements are respectively lit by the second control unit, signals are respectively obtained from the photoelectric conversion elements at the specified positions of each group of the photoelectric conversion elements and at the positions corresponding to the light-emitting elements that are lit. BRIEF DESCRIPTION OF THE DRAWINGS
[0007] Figure 1 It is a cross-sectional view showing a schematic configuration example of the biometric authentication device according to the first embodiment.
[0008] Figure 2It is a cross-sectional view showing another schematic configuration example of the biometric authentication device according to the embodiment.
[0009] Figure 3 It is a plan view showing a configuration example of a sensor included in the biometric authentication device according to this embodiment.
[0010] Figure 4 This is a block diagram showing a configuration example of a sensor included in the biometric authentication device according to this embodiment.
[0011] Figure 5 It is a circuit diagram showing an example of the circuit configuration of a sensor included in the biometric authentication device according to this embodiment.
[0012] Figure 6 This is a circuit diagram showing an example of the circuit configuration of a first pixel included in the sensor constituting the biometric authentication device according to this embodiment.
[0013] Figure 7 It is a plan view showing a configuration example of a lighting device included in the biometric authentication device according to this embodiment.
[0014] Figure 8 It is a plan view showing an example of the circuit configuration of a second pixel included in the illumination device constituting the biometric authentication device according to this embodiment.
[0015] Fig. 9 FIG. 1 is a schematic diagram showing an image of a detection target generated by a normal detection process.
[0016] Fig.10 It is a schematic diagram for explaining the first detection process executed in the biometric authentication device of this embodiment.
[0017] Fig.11 FIG. 1 is a schematic diagram showing an image of a detection object generated by the first detection process executed in the biometric authentication device of this embodiment.
[0018] Fig.12 This is a circuit diagram showing another configuration example of the biometric authentication device according to the embodiment.
[0019] Fig.13 This is a flowchart showing an example of the sequence of the second detection process executed in the biometric authentication device according to the second embodiment.
[0020] Fig.14 It is a schematic diagram for explaining the second detection process executed in the biometric authentication device of this embodiment.
[0021] Fig.15 FIG. 1 is a schematic diagram showing another example of the shape of the biometric authentication device. DETAILED DESCRIPTION
[0022] Hereinafter, embodiments will be described with reference to the drawings.
[0023] In addition, the disclosed content is only an example, and appropriate changes that can be easily thought of by those skilled in the art without departing from the main purpose of the invention are of course also included in the scope of the present invention. In addition, sometimes the drawings are schematically shown compared with the implementation method in order to make the description clearer, but it is only an example and does not limit the interpretation of the present invention. In addition, in this specification and each figure, the same reference figure number is marked for the components that perform the same or similar functions as described in the previous figure, and repeated detailed descriptions are sometimes omitted.
[0024] (First Embodiment)
[0025] Figure 1 1 is a cross-sectional view showing a schematic structure of a biometric authentication device 1 according to an embodiment. Figure 1 As shown, the biometric authentication device 1 includes a sensor 2 and a lighting device 3 , and the lighting device 3 and the sensor 2 are stacked in this order in a direction perpendicular to the surface of the sensor 2 .
[0026] The light L1 emitted from the lighting device 3 passes through the sensor 2. The sensor 2 is, for example, a light reflection type optical sensor, and can detect the biological information of the finger Fg by detecting the light L2 reflected by the finger Fg. The biological information is, for example, fingerprints, blood vessel images such as veins (venous images), pulses, pulse waves, blood conditions (blood oxygen concentration, etc.). The color of the light L1 from the lighting device 3 can also be made different depending on the detection object. For example, in the case of fingerprint detection, the lighting device 3 can emit visible light (such as blue or green) L1, and in the case of vein detection, the lighting device 3 can emit infrared light L1.
[0027] In addition, Figure 1 FIG. 1 shows a biometric authentication device 1 in which the illumination device 3 and the sensor 2 are stacked in this order in a direction perpendicular to the surface of the sensor 2. Figure 2 As shown, the biometric authentication device 1 may also be stacked in the order of the sensor 2 and the lighting device 3 in the direction perpendicular to the surface of the sensor 2. In the case of this configuration, the light L1 irradiated from the lighting device 3 is reflected by the finger Fg, and the reflected light L2 passes through the lighting device 3. The sensor 2 can detect the biometric information of the finger Fg by detecting the light L2 reflected by the finger Fg and passing through the lighting device 3.
[0028] In addition, Figure 1 as well as Figure 2 2 shows a case where the detection object (authentication object) is a finger Fg, but the detection object is not limited to this, and may be, for example, a palm or the like.
[0029] Figure 3 FIG. 2 is a top view showing a configuration example of the sensor 2 included in the biometric authentication device 1. Figure 3 As shown, the sensor 2 includes a sensor substrate 20 , a sensor unit 21 , a gate line driving circuit GD1 , a signal line selecting circuit SD1 , a detection circuit 48 , a control circuit 102 , and a power supply circuit 103 .
[0030] The sensor substrate 20 is electrically connected to the control substrate 101 via the flexible printed substrate FPC1. The flexible printed substrate FPC1 is provided with a detection circuit 48. The control substrate 101 is provided with a control circuit 102 and a power supply circuit 103. The control circuit 102 is, for example, an FPGA (Field Programmable Gate Array). The control circuit 102 supplies a control signal to the sensor unit 21, the gate line drive circuit GD1, and the signal line selection circuit SD1 to control the detection operation of the sensor unit 21. The power supply circuit 103 supplies a sensor power supply signal VDDSNS (see Figure 6 ) and other voltage signals.
[0031] The sensor substrate 20 has a detection area AA1 and a peripheral area SA1. The detection area AA1 is an area where a plurality of first pixels PX1 constituting the sensor unit 21 are provided. The first pixels PX1 may also be referred to as sensor pixels or imaging pixels. The plurality of first pixels PX1 are arranged in a matrix along a first direction X and a second direction Y. A photodiode PD (see Figure 6 The peripheral area SA1 is an area outside the detection area AA1 and is an area that does not overlap with the first pixel PX1.
[0032] The gate line drive circuit GD1 and the signal line selection circuit SD1 are provided in the peripheral area SA1. Specifically, the gate line drive circuit GD1 is provided in a region of the peripheral area SA1 extending along the second direction Y. The signal line selection circuit SD1 is provided in a region of the peripheral area SA1 extending along the first direction X and is provided between the sensor unit 21 and the detection circuit 48.
[0033] In addition, the first direction X is a direction in a plane parallel to the sensor substrate 20. The second direction Y is a direction in a plane parallel to the sensor substrate 20, and is a direction orthogonal to the first direction X. In addition, the second direction Y may intersect with the first direction X instead of being orthogonal. In addition, the third direction Z is a direction orthogonal to the first direction X and the second direction Y, and is a normal direction of the sensor substrate 20.
[0034] Figure 41 is a block diagram showing a configuration example of the sensor 2 included in the biometric authentication device 1. Figure 4 As shown, the sensor 2 further includes a detection control unit 11 and a detection unit 40. A part or all of the functions of the detection control unit 11 are included in the control circuit 102. In addition, a part or all of the functions of the detection unit 40 other than the detection circuit 48 are included in the control circuit 102.
[0035] The sensor unit 21 is a light sensor having a photodiode PD as a photoelectric conversion element. The photodiode PD of the sensor unit 21 outputs an electrical signal corresponding to the amount of light irradiated to the signal line selection circuit SD1. The signal line selection circuit SD1 selects the signal line SLA (see Figure 5 ). Thus, the above-mentioned electric signal is output as the detection signal Vdet to the detection unit 40 via the signal line selection circuit SD1. In addition, the sensor unit 21 performs detection according to the gate drive signal Vgla supplied from the gate line drive circuit GD1.
[0036] The detection control unit 11 is a circuit that supplies control signals to the gate line drive circuit GD1, the signal line selection circuit SD1, and the detection unit 40, and controls their operations. The detection control unit 11 supplies various control signals such as a start signal STV, a clock signal CK, and a reset signal RST1 to the gate line drive circuit GD1. In addition, the detection control unit 11 supplies various control signals such as a selection signal ASW to the signal line selection circuit SD1.
[0037] The gate line driving circuit GD1 drives a plurality of gate lines GLA based on various control signals (see Figure 5 The gate line driving circuit GD1 selects a plurality of gate lines GLA sequentially or simultaneously and supplies a gate driving signal Vgla to the selected gate line GLA. Thus, the gate line driving circuit GD1 selects a plurality of photodiodes PD connected to the gate line GLA.
[0038] The signal line selection circuit SD1 selects a plurality of signal lines SLA in sequence or simultaneously (see Figure 5 ) is a switch circuit. The signal line selection circuit SD1 is, for example, a multiplexer. The signal line selection circuit SD1 connects the selected signal line SLA to the detection circuit 48 based on the selection signal ASW supplied from the detection control unit 11. Thus, the signal line selection circuit SD1 outputs the detection signal Vdet from the photodiode PD to the detection unit 40.
[0039] The detection unit 40 includes a detection circuit 48, a signal processing unit 44, a coordinate extraction unit 45, a storage unit 46, and a detection timing control unit 47. The detection timing control unit 47 controls the detection circuit 48, the signal processing unit 44, and the coordinate extraction unit 45 to operate synchronously based on a control signal supplied from the detection control unit 11.
[0040] The detection circuit 48 is, for example, an analog front end circuit (AFE). The detection circuit 48 is, for example, a signal processing circuit having the functions of a detection signal amplifier 42 and an A / D converter 43. The detection signal amplifier 42 amplifies the detection signal Vdet. The A / D converter 43 converts the analog signal output from the detection signal amplifier 42 into a digital signal. In the following description, the signal amplified by the detection signal amplifier 42 and converted from an analog signal to a digital signal by the A / D converter 43 and output is sometimes referred to as the detection signal Vdet for description.
[0041] The signal processing unit 44 is a logic circuit that detects a predetermined physical quantity input to the sensor unit 21 based on the output signal of the detection circuit 48. When the finger Fg contacts or approaches the detection area AA1, the signal processing unit 44 can detect the surface unevenness (i.e., fingerprint) of the finger Fg based on the output signal from the detection circuit 48.
[0042] The storage unit 46 temporarily stores the signal calculated by the signal processing unit 44. The storage unit may be, for example, a RAM (Random Access Memory) or a register circuit.
[0043] The coordinate extraction unit 45 is a logic circuit that obtains the detection coordinates of the concavo-convex surface of the finger Fg, etc., when the contact or approach of the finger Fg is detected in the signal processing unit 44. The coordinate extraction unit 45 combines the detection signal Vdet output from the photodiode PD of the sensor unit 21 to generate two-dimensional information (such as an image, etc.) representing the shape of the concavo-convex surface of the finger Fg (i.e., fingerprint) and the shape of the blood vessel pattern of the finger Fg. This two-dimensional information is the user's biological information. In addition, the coordinate extraction unit 45 may output the detection signal Vdet as the sensor output Vo instead of calculating the detection coordinates. In this case, the detection signal Vdet may also be referred to as the user's biological information. Alternatively, the coordinate extraction unit 45 may output information related to the biological body (such as pulse wave data, etc.) that can be calculated based on the detection signal Vdet as the sensor output Vo instead of calculating the detection coordinates. In this case, the information related to the biological body that can be calculated based on the detection signal Vdet is also referred to as the user's biological information.
[0044] Next, a circuit configuration example of the sensor 2 included in the biometric authentication device 1 will be described. Figure 5 is a circuit diagram showing the sensor 2 . Figure 6 is a circuit diagram showing a plurality of first pixels PX1 included in the sensor 2. Figure 6 , the circuit configuration of the detection circuit 48 is also shown.
[0045] like Figure 5 As shown in FIG. 1 , the sensor unit 21 includes a plurality of first pixels PX1 arranged in a matrix. A photodiode PD is provided in each of the plurality of first pixels PX1 .
[0046] The gate line GLA extends along the first direction X and is connected to a plurality of first pixels PX1 arranged along the first direction X. In addition, a plurality of gate lines GLA1, GLA2, ..., GLA8 are arranged along the second direction Y and are respectively connected to the gate line driving circuit GD1. In addition, in the following description, when it is not necessary to distinguish between the plurality of gate lines GLA1 to GLA8, they are simply referred to as the gate line GLA. In addition, in Figure 5 In order to make the description easier to understand, 8 gate lines GLA are shown, but this is only an example, and M gate lines GLA may be arranged (M is greater than or equal to 8, for example, M=256).
[0047] The signal line SLA extends along the second direction Y and is connected to the photodiodes PD of the plurality of first pixels PX1 arranged along the second direction Y. In addition, the plurality of signal lines SLA1, SLA2, ..., SLA12 are arranged along the first direction X and are respectively connected to the signal line selection circuit SD1 and the reset circuit RC. In addition, in the following description, when it is not necessary to distinguish between the plurality of signal lines SLA1 to SLA12, they are simply referred to as the signal line SLA. In addition, in Figure 5 In order to make the description easier to understand, 12 signal lines SLA are shown, but this is only an example, and N signal lines SLA may be arranged (N is greater than or equal to 12, for example, N=252).
[0048] In addition, Figure 5 In the embodiment, the sensor unit 21 is provided between the signal line selection circuit SD1 and the reset circuit RC, but the present invention is not limited thereto. The signal line selection circuit SD1 and the reset circuit RC may be respectively connected to the ends of the signal line SLA in the same direction.
[0049] The gate line driving circuit GD1 receives various control signals such as a start signal STV, a clock signal CK, and a reset signal RST1 from the control circuit 102. The gate line driving circuit GD1 sequentially selects a plurality of gate lines GLA1 to GLA8 in a time-division manner based on the various control signals. The gate line driving circuit GD1 supplies a gate driving signal Vgla to the selected gate line GLA. As a result, the gate driving signal Vgla is supplied to a plurality of switching elements Tr connected to the gate line GLA, and a plurality of first pixels PX1 arranged along the first direction X are selected as objects for obtaining the detection signal Vdet.
[0050] In addition, the gate line driving circuit GD1 may be driven differently according to the detection mode of fingerprint detection and each of the detection modes of a plurality of different biological information (such as pulse wave, pulse, blood vessel image, blood oxygen concentration, etc.).
[0051] The signal line selection circuit SD1 has a plurality of selection signal lines Lsel, a plurality of output signal lines Lout, and a switch element TrS. The plurality of switch elements TrS are respectively provided corresponding to the plurality of signal lines SLA. The six signal lines SLA1 to SLA6 are connected to a common output signal line Lout1. The six signal lines SLA7 to SLA12 are connected to a common output signal line Lout2. The output signal lines Lout1 and Lout2 are respectively connected to the detection circuit 48.
[0052] Here, the signal lines SLA1 to SLA6 are the first signal line block, and the signal lines SLA7 to SLA12 are the second signal line block. A plurality of selection signal lines Lsel are connected to the gates of the switch elements TrS included in one signal line block. In addition, one selection signal line Lsel is connected to the gates of the switch elements TrS of a plurality of signal line blocks.
[0053] Specifically, the selection signal lines Lsel1 to Lsel6 are connected to the switch elements TrS corresponding to the signal lines SLA1 to SLA6, respectively. In addition, the selection signal line Lsel1 is connected to the switch element TrS corresponding to the signal line SLA1 and the switch element TrS corresponding to the signal line SLA7. The selection signal line Lsel2 is connected to the switch element TrS corresponding to the signal line SLA2 and the switch element TrS corresponding to the signal line SLA8.
[0054] The control circuit 102 sequentially supplies the selection signal ASW to the selection signal line Lsel. Thus, the signal line selection circuit SD1 sequentially selects the signal line SLA in a signal line block in a time-division manner through the operation of the switch element TrS. In addition, the signal line selection circuit SD1 selects the signal line SLA one by one in a plurality of signal line blocks. With this configuration, the sensor 2 can reduce the number of ICs (Integrated Circuits) including the detection circuit 48 or the number of IC terminals.
[0055] In addition, here, the example shows that six signal lines SLA are connected to one output signal line Lout to form a signal line block, but the number of signal lines SLA connected to one output signal line Lout to form a signal line block can be arbitrarily set. For example, four signal lines SLA can be connected to one output signal line Lout to form a signal line block.
[0056] like Figure 5 As shown, the reset circuit RC has a reference signal line Lvr, a reset signal line Lrst and a switch element TrR. The switch element TrR is provided corresponding to the plurality of signal lines SLA. The reference signal line Lvr is connected to one of the source or drain of the plurality of switch elements TrR. The reset signal line Lrst is connected to the gate of the plurality of switch elements TrR.
[0057] The control circuit 102 supplies a reset signal RST2 to the reset signal line Lrst. As a result, the plurality of switch elements TrR are turned on, and the plurality of signal lines SLA are electrically connected to the reference signal line Lvr. The power supply circuit 103 supplies a reference signal COM to the reference signal line Lvr. As a result, the capacitor elements Ca (refer to Figure 6 ) supplies reference signal COM.
[0058] like Figure 6 As shown in FIG. 1 , the first pixel PX1 includes a photodiode PD, a capacitor Ca, and a switch element Tr. Figure 6 , two gate lines GLA(m) and GLA(m+1) arranged along the second direction Y among the plurality of gate lines GLA are shown. In addition, two signal lines SLA(n) and SLA(n+1) arranged along the first direction X among the plurality of signal lines SLA are shown. The first pixel PX1 is arranged in an area surrounded by the gate lines GLA and the signal lines SLA. The switching element Tr is provided corresponding to the photodiode PD. The switching element Tr is composed of a thin film transistor, and in this example, is composed of an n-channel MOS (Metal Oxide Semiconductor) type TFT (Thin Film Transistor).
[0059] The gates of the switching elements Tr belonging to the plurality of first pixels PX1 arranged along the first direction X are connected to the gate line GLA. The sources of the switching elements Tr belonging to the plurality of first pixels PX1 arranged along the second direction Y are connected to the signal line SLA. The drains of the switching elements Tr are connected to the cathode of the photodiode PD and the capacitor Ca.
[0060] The anode of the photodiode PD is supplied with a sensor power supply signal VDDSNS from the power supply circuit 103. The signal line SLA and the capacitor Ca are supplied with a reference signal COM which is an initial potential of the signal line SLA and the capacitor Ca from the power supply circuit 103.
[0061] When light is irradiated to the first pixel PX1, a current corresponding to the amount of light flows through the photodiode PD included in the first pixel PX1. As a result, charge is accumulated in the capacitor Ca. When the switch element Tr is turned on, a current flows through the signal line SLA according to the charge accumulated in the capacitor Ca. The signal line SLA is connected to the detection circuit 48 via the switch element TrS of the signal line selection circuit SD1. As a result, the sensor 2 can detect a signal corresponding to the amount of light irradiated to the photodiode PD for each first pixel PX1.
[0062] During the readout period, the switch SSW becomes conductive, and the detection circuit 48 is connected to the signal line SLA. The detection signal amplifier 42 of the detection circuit 48 converts the change of the current supplied from the signal line SLA into a change of voltage and amplifies it. A reference potential (Vref) having a fixed potential is input to the in-phase input portion (+) of the detection signal amplifier 42, and the signal line SLA is connected to the inverting input terminal (-). Here, a signal identical to the reference signal COM is input as the reference potential (Vref). In addition, the detection signal amplifier 42 has a capacitor Cb and a reset switch RSW. During the reset period after the readout period, the reset switch RSW becomes conductive, and the charge of the capacitor Cb is reset.
[0063] Next, the lighting device 3 included in the biometric authentication device 1 will be described. Figure 7 1 is a plan view showing a configuration example of the illumination device 3 included in the biometric authentication device 1. The illumination device 3 includes a light source substrate 30, a light emitting unit 31, a light source gate line driving circuit GD2, a light source signal line selecting circuit SD2, a control circuit 112, and a power supply circuit 113.
[0064] The control substrate 111 is electrically connected to the light source substrate 30 via the flexible printed substrate FPC2. A control circuit 112 and a power circuit 113 are provided on the control substrate 111. The control circuit 112 is, for example, an FPGA. The control circuit 112 supplies control signals to the light-emitting unit 31, the light source gate line driving circuit GD2, and the light source signal line selection circuit SD2 to control the lighting operation of the plurality of light-emitting elements LED included in the light-emitting unit 31. The power circuit 103 supplies voltage signals such as light source power signals to the light-emitting unit 31, the light source gate line driving circuit GD2, and the light source signal line selection circuit SD2.
[0065] The light source substrate 30 has a light emitting area AA2 and a peripheral area SA2. Figure 1 as well as Figure 2 In the case of the biometric authentication device 1 of the structure shown, the light emitting area AA2 of the light source substrate 30 overlaps with the detection area AA1 of the sensor substrate 20 when viewed from above. In addition, the peripheral area SA2 of the light source substrate 30 overlaps with the peripheral area SA2 of the sensor substrate 20 when viewed from above. The light emitting area AA2 is an area where a plurality of second pixels PX2 constituting the light emitting unit 31 are provided. The plurality of second pixels PX2 are arranged in a matrix along the first direction X and the second direction Y. Light emitting elements LED (see Figure 8 ). The light emitting element LED is, for example, a micro LED or a mini (sub-millimeter) LED, and irradiates light to the finger Fg to be detected. The peripheral area SA2 is an area outside the light emitting area AA2 and is an area that does not overlap with the second pixel PX2.
[0066] The light source gate line driving circuit GD2 and the light source signal line selection circuit SD2 are provided in the peripheral area SA2. Specifically, the light source gate line driving circuit GD2 is provided in the area extending along the second direction Y in the peripheral area SA2. The light source signal line selection circuit SD2 is provided in the area extending along the first direction X in the peripheral area SA2.
[0067] The light source gate line driving circuit GD2 drives a plurality of light source gate lines GLB based on various control signals (refer to Figure 8 The light source gate line driving circuit GD2 selects a plurality of light source gate lines GLB sequentially or simultaneously and supplies a gate driving signal to the selected light source gate line GLB. Thus, the light source gate line driving circuit GD2 selects a plurality of light emitting elements LED connected to the light source gate line GLB.
[0068] The light source signal line selection circuit SD2 selects a plurality of light source signal lines SLB in sequence or simultaneously (refer to Figure 8) is a switch circuit. The light source signal line selection circuit SD2 is, for example, a multiplexer. The light source signal line selection circuit SD2 selects a plurality of light source signal lines SLB sequentially or simultaneously, and supplies a selection signal to the selected light source signal line SLB. Thus, the light source signal line selection circuit SD2 selects one or more light emitting elements LED among the plurality of light emitting elements LED selected by the light source gate line driving circuit GD2.
[0069] like Figure 8 As shown, the second pixel PX2 is arranged in an area surrounded by the light source gate line GLB and the light source signal line SLB. The plurality of second pixels PX2 are respectively connected to the light source gate line GLB extending along the first direction X and arranged at intervals along the second direction Y, and the light source signal line SLB extending along the second direction Y and arranged at intervals along the first direction X. The light emitting elements LED included in the plurality of second pixels PX2 are selectively lit by control signals supplied from the light source gate line driving circuit GD2 and the light source signal line selecting circuit SD2.
[0070] Here, the process of detecting biometric information performed in a conventional biometric authentication device (hereinafter referred to as detection processing) is described. In the conventional detection process, first, a plurality of light-emitting elements provided in a lighting device are lit together, and light is irradiated to the fingers and palms of the detection object through the plurality of light-emitting elements. The light irradiated from the plurality of light-emitting elements is diffusely reflected in the fingers and palms of the detection object. Thereafter, a plurality of photodiodes provided in the sensor receive the light diffusely reflected by the fingers and palms of the detection object, and output a detection signal corresponding to the amount of light received. Thus, the biometric authentication device can detect biometric information based on the detection signals from the plurality of photodiodes.
[0071] However, in the above-mentioned conventional detection process, since a plurality of light emitting elements provided in the lighting device are lit together, a plurality of lights diffusely reflected at various positions of the fingers and palms of the detection object are mixed and incident on each of the plurality of photodiodes provided in the sensor. As a result, there arises a problem that the S / N ratio of the detection signals from the plurality of photodiodes is reduced. In addition, if the S / N ratio of the detection signal is reduced, there also arises a problem that the temporal changes of the biological information (such as pulse wave data) cannot be detected with high accuracy. Moreover, if the S / N ratio of the detection signal is reduced, for example, even though an image is generated based on the detection signal, Fig. 9 As shown, a blurred image I1 with low contrast is generated.
[0072] Therefore, in the biometric authentication device 1 of the present embodiment, the control circuit 112 of the lighting device 3 has the following function: dividing the plurality of second pixels PX2 provided in the lighting device 3 into a plurality of groups, and controlling the operation of the light source gate drive circuit GD2 and the light source signal line selection circuit SD2 in such a manner that only the light-emitting elements LED contained in the second pixels PX2 at specified positions of each group are lit.
[0073] In addition, the control circuit 102 of the sensor 2 has the following function: dividing the multiple first pixels PX1 provided in the sensor 2 into multiple groups, and controlling the operation of the gate line driving circuit GD1 and the signal line selecting circuit SD1 in such a manner that the detection signal Vdet is obtained only from the photodiode PD contained in the first pixel PX1 at a specified position of each group.
[0074] In addition, the control circuit 112 of the lighting device 3 and the control circuit 102 of the sensor 2 operate synchronously with each other. In addition, it is assumed here that the number of pixels of the plurality of second pixels PX2 provided in the lighting device 3 is the same as the number of pixels of the plurality of first pixels PX1 provided in the sensor 2, and it is assumed that the grouping of the second pixels PX2 by the control circuit 112 of the lighting device 3 is performed corresponding to the grouping of the first pixels PX1 by the control circuit 102 of the sensor 2 (the area of a group of second pixels PX2 is the same as the area of a group of first pixels PX1, and the grouping is performed in such a way that a group of first pixels PX1 exists corresponding to a group of second pixels PX2).
[0075] Fig.10 1 is a schematic diagram for explaining the above functions of the control circuit 112 of the lighting device 3 and the above functions of the control circuit 102 of the sensor 2. Fig.10 , a case where a plurality of second pixels PX2 provided in the lighting device 3 and a plurality of first pixels PX1 provided in the sensor 2 are grouped into 16 pixels of 4×4. Fig.10 The described series of processing is referred to as a first detection processing.
[0076] like Fig.10 As shown in the upper part of (a), the control circuit 112 of the lighting device 3 controls the operation of the light source gate drive circuit GD2 and the light source signal line selection circuit SD2 in such a manner that the light emitting element LED (hereinafter referred to as the first light emitting element LED) contained in the second pixel PX2 located in the first row and first column of each group is lit together. At this time, the light emitting element LED contained in the other second pixels PX2 of each group (i.e., the 15 second pixels PX2 located in the first row and second column to the fourth row and fourth column) is not lit and remains in an off state. Accordingly, Fig.10 As shown in the upper part of (a), only the first light emitting element LED of each group is turned on.
[0077] In synchronization with the timing at which the first light-emitting element LED of each group of the lighting device 3 is turned on, the control circuit 102 of the sensor 2 controls the operation of the gate line drive circuit GD1 and the signal line selection circuit SD1 in such a manner that the detection signal Vdet is obtained from the photodiode PD included in the first pixel PX1 located in the first row and first column of each group (hereinafter referred to as the first photodiode PD). At this time, the detection signal Vdet is not obtained from the photodiode PD included in the other first pixels PX1 of each group (i.e., the 15 first pixels PX1 located in the first row and second column to the fourth row and fourth column). Accordingly, Fig.10 As shown in the lower part of (a), the detection signal Vdet is acquired only from the first photodiode PD of each group. The acquired detection signal Vdet is stored in the storage unit 46.
[0078] Next, if Fig.10 As shown in the upper part of (b), the control circuit 112 of the lighting device 3 controls the operation of the light source gate drive circuit GD2 and the light source signal line selection circuit SD2 in such a manner that the first light emitting element LED of each group is extinguished and the light emitting element LED (hereinafter referred to as the second light emitting element LED) contained in the second pixel PX2 located in the first row and second column of each group is illuminated. At this time, the light emitting element LED contained in the other second pixels PX2 of each group (i.e., the 15 second pixels PX2 located in the first row and first column, and the first row and third column to the fourth row and fourth column) is not illuminated and remains in an extinguished state. Accordingly, Fig.10 As shown in the upper part of (b), only the second light emitting element LED of each group is turned on.
[0079] In synchronization with the timing at which the second light-emitting element LED of each group of the lighting device 3 is turned on, the control circuit 102 of the sensor 2 controls the operation of the gate line drive circuit GD1 and the signal line selection circuit SD1 in such a manner that the detection signal Vdet is obtained from the photodiode PD (hereinafter referred to as the second photodiode PD) contained in the first pixel PX1 located in the first row and second column of each group. At this time, the detection signal Vdet is not obtained from the photodiode PD contained in the other first pixels PX1 of each group (i.e., the 15 first pixels PX1 located in the first row and first column, and the first row and third column to the fourth row and fourth column). Accordingly, Fig.10 As shown in the lower part of (b), the detection signal Vdet is acquired only from the second photodiode PD of each group. The acquired detection signal Vdet is stored in the storage unit 46.
[0080] Thereafter, the control circuit 112 of the lighting device 3 performs the same control on the light-emitting element LED contained in the second pixel PX2 located in the first row, third column and the first row, fourth column, and the control circuit 102 of the sensor 2 performs the same control on the photodiode PD contained in the first pixel PX1 located in the first row, third column and the first row, fourth column.
[0081] After the control circuit 112 of the lighting device 3 and the control circuit 102 of the sensor 2 have executed the above control in the first row and first column to the first row and fourth column (each column of the first row) of each group, the same control is executed for each column of the next row. That is, the control circuit 112 of the lighting device 3 also executes the same control for the light emitting element LED included in the second pixel PX2 located in the second row and first column to the second row and fourth column, and the control circuit 102 of the sensor 2 also executes the same control for the photodiode PD included in the first pixel PX1 located in the second row and first column to the second row and fourth column.
[0082] In addition, after executing the above-mentioned control in the second row, first column to the second row, fourth column (each column of the second row) of each group, the control circuit 112 of the lighting device 3 and the control circuit 102 of the sensor 2 further execute the same control for each column of the next row. That is, the control circuit 112 of the lighting device 3 executes the same control for the light-emitting element LED included in the second pixel PX2 located in the third row, first column to the third row, fourth column, and the control circuit 102 of the sensor 2 executes the same control for the photodiode PD included in the first pixel PX1 located in the third row, first column to the third row, fourth column.
[0083] Furthermore, after executing the above-mentioned control in the third row, first column to the third row, fourth column (each column of the third row) of each group, the control circuit 112 of the lighting device 3 and the control circuit 102 of the sensor 2 further execute the same control for each column of the following row. That is, the control circuit 112 of the lighting device 3 also executes the same control for the light emitting element LED contained in the second pixel PX2 located in the fourth row, first column to the fourth row, fourth column, and the control circuit 102 of the sensor 2 also executes the same control for the photodiode PD contained in the first pixel PX1 located in the fourth row, first column to the fourth row, fourth column. Hereinafter, referring to Fig.10 (c) describes in detail the control performed on the fourth row and fourth column of each group.
[0084] like Fig.10As shown in the upper part of (c), the control circuit 112 of the lighting device 3 controls the operation of the light source gate drive circuit GD2 and the light source signal line selection circuit SD2 in such a manner that the fifteenth light emitting element LED of each group is extinguished and the light emitting element LED contained in the second pixel PX2 located in the fourth row and fourth column of each group (hereinafter referred to as the sixteenth light emitting element LED) is illuminated together. At this time, the light emitting element LED contained in the other second pixels PX2 of each group (i.e., the 15 second pixels PX2 located in the first row and first column to the fourth row and third column) is not illuminated and remains in an extinguished state. Accordingly, Fig.10 As shown in the upper part of (c), only the sixteenth light emitting element LED of each group is turned on.
[0085] In synchronization with the timing at which the sixteenth light-emitting element LED of each group of the lighting device 3 is turned on, the control circuit 102 of the sensor 2 controls the operation of the gate line drive circuit GD1 and the signal line selection circuit SD1 in such a manner that the detection signal Vdet is obtained from the photodiode PD included in the first pixel PX1 located in the fourth row and fourth column of each group (hereinafter referred to as the sixteenth photodiode PD). At this time, the detection signal Vdet is not obtained from the photodiode PD included in the other first pixels PX1 of each group (i.e., the 15 first pixels PX1 located in the first row and first column to the fourth row and third column). Accordingly, Fig.10 As shown in the lower part of (c), the detection signal Vdet is acquired only from the sixteenth photodiode PD of each group. The acquired detection signal Vdet is stored in the storage unit 46.
[0086] After the above series of control is performed and the detection signals Vdet obtained from the first to sixteenth photodiodes PD of each group are stored in the storage unit 46, the coordinate extraction unit 45, which is a function of the control circuit 102 of the sensor 2, generates an image I2 (see FIG. 1 ) representing the shape of the blood vessel pattern of the finger Fg to be detected based on the detection signals Vdet of the first to sixteenth photodiodes PD of each group stored in the storage unit 46. Fig.11 ).
[0087] In the first detection process performed in the biometric authentication device 1 of the present embodiment described above, the plurality of second pixels PX2 provided in the lighting device 3 and the plurality of first pixels PX1 provided in the sensor 2 are divided into a plurality of groups corresponding to each other. In addition, in the lighting device 3, one light-emitting element LED is controlled to be lit for each group. That is, the light-emitting element LEDs other than one of the plurality of light-emitting element LEDs included in each group are controlled to be extinguished. Accordingly, it is possible to suppress the light from the other light-emitting element LEDs included in each group from being incident as stray light on the photodiode PD that operates synchronously with the light-emitting element LED that is lit.
[0088] In addition, in the first detection process performed in the biometric authentication device 1 of the present embodiment, one light emitting element LED is controlled to be lit for each group, and the light emitting element LED lit in one group and the light emitting element LED lit in a group adjacent to the one group are grouped in such a manner that they are sufficiently separated (for example, in Fig.10 , the pixels are grouped in a manner of separating 4 pixels.) Therefore, the n-th photodiode PD of each group can be mainly incident with the light from the n-th light emitting element LED of each group that overlaps when viewed from above. That is, according to the first detection processing of this embodiment, it is possible to suppress the light from the n-th light emitting element LED of another group that does not overlap when viewed from above from being incident as stray light on the n-th photodiode PD of each group.
[0089] As described above, by suppressing the incidence of stray light on the plurality of photodiodes PD, it is possible to suppress a decrease in the S / N ratio of the detection signal Vdet from the plurality of photodiodes PD. Fig.11 The image I2 showing the shape of the blood vessel pattern as shown can generate an image with a higher contrast than that of the above-mentioned conventional biometric authentication device.
[0090] In addition, in the present embodiment, it is envisaged that the plurality of second pixels PX2 provided in the lighting device 3 and the plurality of first pixels PX1 provided in the sensor 2 are grouped into groups of 16 pixels of 4×4 each, but the second pixels PX2 and the first pixels PX1 are not limited to being divided into groups of a few pixels each, and any number of pixels can be grouped as long as the light-emitting element LED lit in one group and the light-emitting element LED lit in a group adjacent to the one group are separated by the following distance, which is the distance from the photodiode PD at which the light from the light-emitting element LED lit in the one group does not enter as stray light and overlaps with the light-emitting element LED lit in the adjacent group when viewed from above.
[0091] In addition, in the present embodiment, a case is described in which the number of pixels of the plurality of second pixels PX2 provided in the lighting device 3 is the same as the number of pixels of the plurality of first pixels PX1 provided in the sensor 2, but the present invention is not limited thereto. The number of pixels of the second pixels PX2 provided in the lighting device 3 and the number of pixels of the first pixels PX1 provided in the sensor 2 may also be different.
[0092] For example, the first pixels PX1 of the sensor 2 are arranged at a pitch of 235 μm, whereas the second pixels PX2 of the lighting device 3 may be arranged at a pitch of 100 μm. That is, the number of the second pixels PX2 of the lighting device 3 may be greater than the number of the first pixels PX1 of the sensor 2. However, in this case, it is also desirable that the area of a group of the first pixels PX1 and the area of a group of the second pixels PX2 are the same (that is, although the number of pixels contained in a group is different, the area of a group is the same).
[0093] In this case, the control circuit 112 of the lighting device 3 controls the operation of the light source gate line driving circuit GD2 and the light source signal line selecting circuit SD2 in a manner that lights up the light-emitting elements LED contained in the plurality of second pixels PX2 corresponding to one of the plurality of first pixels PX1 provided in the sensor 2 (i.e., the plurality of second pixels PX2 overlapping with the one first pixel PX1 when viewed from above).
[0094] The control circuit 102 of the sensor 2 controls the operation of the gate line driving circuit GD1 and the signal line selecting circuit SD1 in synchronization with the timing of lighting up the light-emitting elements LED included in the plurality of second pixels PX2 provided in the lighting device 3, by obtaining a detection signal Vdet from the photodiode PD included in the first pixel PX1 corresponding to the plurality of second pixels PX2 including the light-emitting elements LED that are lit.
[0095] In this configuration, each group is controlled so that only the light-emitting element LED contained in one area is lit, and the light-emitting element LEDs in other areas are controlled to be extinguished, thereby preventing light from the light-emitting element LEDs contained in other areas of each group from being incident as stray light on the photodiode PD operating synchronously with the lit light-emitting element LED.
[0096] In addition, there is no change in the fact that the grouping is performed in a manner that the area where the light-emitting element LED is lit in one group and the area where the light-emitting element LED is lit in a group adjacent to the one group are sufficiently separated, so it is also possible to suppress the light from the light-emitting element LED lit in the group adjacent to the one group from being incident as stray light on the photodiode PD corresponding to the area where the light-emitting element LED is lit in one group.
[0097] That is, even when the number of pixels of the first pixel PX1 provided in the sensor 2 is different from the number of pixels of the second pixel PX2 provided in the lighting device 3, the above-mentioned series of first detection processing can suppress stray light from being incident on the multiple photodiodes PD, and the reduction in the S / N ratio of the detection signal Vdet from the multiple photodiodes PD can be suppressed, and even an image with a higher contrast can be generated based on the above-mentioned detection signal Vdet.
[0098] In addition, in the present embodiment, the control of the first pixel PX1 and the second pixel PX2 in each group is performed sequentially from the first row and the first column to the first row and the fourth column, from the second row and the first column to the second row and the fourth column, from the third row and the first column to the third row and the fourth column, and from the fourth row and the first column to the fourth row and the fourth column, but the control order of the first pixel PX1 and the second pixel PX2 in each group is not limited to this.
[0099] In the present embodiment described above, a biometric authentication device 1 is described in which the sensor 2 and the lighting device 3 are stacked (the sensor 2 and the lighting device 3 are provided on different substrates), but the present invention is not limited to this. The biometric authentication device 1 may also be provided in which the sensor 2 and the lighting device 3 are provided on the same substrate.
[0100] Fig.12 1 is a circuit diagram showing an example of a circuit configuration of a biometric authentication device 1 in which the photodiode PD of the sensor 2 and the light emitting element LED of the lighting device 3 are provided on the same substrate. Fig.12 As shown, the gate line GLA for selecting the photodiode PD extends along the first direction X and is arranged at intervals along the second direction Y. In addition, the signal line SLA for selecting the photodiode PD extends along the second direction Y and is arranged at intervals along the first direction X. The light source gate line GLB for selecting the light emitting element LED extends in a direction parallel to the gate line GLA for selecting the photodiode PD. In addition, the light source signal line SLB for selecting the light emitting element LED extends in a direction parallel to the signal line SLA for selecting the photodiode PD. In this case, the area surrounded by the gate line GLA, the light source gate line GLB, the signal line SLA, and the light source signal line SLB is equivalent to 1 pixel.
[0101] In this configuration, the biometric authentication device 1 also operates as follows: a plurality of pixels arranged in a matrix are grouped, and one light emitting element LED is turned on for each group, and a detection signal Vdet is obtained from one photodiode PD included in the same pixel as the turned-on light emitting element LED. That is, even when the sensor 2 and the lighting device 3 are provided on the same substrate, it is possible to suppress the incidence of stray light on the plurality of photodiodes PD through the above-mentioned series of first detection processing, suppress the reduction of the S / N ratio of the detection signal Vdet from the plurality of photodiodes PD, and even generate an image with a high contrast based on the above-mentioned detection signal Vdet.
[0102] According to the first embodiment described above, the biometric authentication device 1 does not light up the light-emitting elements LED included in the plurality of second pixels PX2 provided in the lighting device 3 together, and does not obtain the detection signal Vdet from the photodiode PD included in the plurality of first pixels PX1 provided in the sensor 2 together, but groups the first pixels PX1 and the second pixels PX2 through the above-mentioned series of first detection processing, and then only lights up the light-emitting elements LED included in the second pixels PX2 at the specified positions of each group, and obtains the detection signal Vdet only from the photodiode PD included in the first pixel PX1 corresponding to the second pixel PX2 including the lit light-emitting element LED.
[0103] This can suppress stray light from entering the plurality of photodiodes PD, suppress a decrease in the S / N ratio of the detection signal Vdet from the plurality of photodiodes PD, and even generate a high-contrast image based on the detection signal Vdet.
[0104] (Second Embodiment)
[0105] Next, the second embodiment will be described. In the first embodiment described above, the first detection process that can improve the contrast of an image generated based on the detection signal Vdet from the photodiode PD is mainly described, but in this embodiment, a detection process (hereinafter referred to as the second detection process) that can accurately detect the time change of biological information (for example, pulse wave data) calculated based on the detection signal Vdet from the photodiode PD is described.
[0106] In addition, since the configuration of the biometric authentication device 1 is the same as that of the first embodiment described above, a detailed description thereof will be omitted here, and the second detection process described above will be mainly described below.
[0107] Fig.13 1 is a flowchart showing an example of the sequence of the second detection process executed in the biometric authentication device 1 according to the present embodiment.
[0108] First, in the biometric authentication device 1, if the contact or approach of the detection object such as the finger Fg is detected, the sensor 2 and the lighting device 3 constituting the biometric authentication device 1 generate an image of the detection object through the first detection process shown in the first embodiment (step S1). Here, it is assumed that the process of step S1 generates an image such as Fig.14 The case of the grayscale image I2 shown in (b).
[0109] Next, the control circuit 102 of the sensor 2 generates an image obtained by binarizing the image generated by the process of step S1 (step S2). Fig.14The binarized image I3 shown in (c).
[0110] Next, the control circuit 102 of the sensor 2 extracts the center line of the black portion of the binary image generated by the process of step S2, and generates an image depicting only the extracted center line (step S3). Fig.14 The line image I4 shown in (d).
[0111] If the control circuit 102 of the sensor 2 generates Fig.14 If the linear image is shown in (d), the control circuit 112 of the lighting device 3 controls the operation of the light source gate line driving circuit GD2 and the light source signal line selecting circuit SD2 in such a manner that the light emitting element LED contained in the second pixel PX2 arranged at a position overlapping with the center line drawn in the linear image is lit (step S4).
[0112] In addition, it is assumed here that the control circuit 102 of the sensor 2 and the control circuit 112 of the lighting device 3 operate synchronously and can share each other's information by sending and receiving signals. Accordingly, as shown in the process of step S4, the control circuit 112 of the lighting device 3 can refer to the line image I4 generated by the control circuit 102 of the sensor 2 and select the second pixel PX2 to light the light emitting element LED.
[0113] The control circuit 102 of the sensor 2 controls the operation of the gate line driving circuit GD1 and the signal line selecting circuit SD1 by obtaining a detection signal Vdet from the photodiode PD included in the first pixel PX1 corresponding to the second pixel PX2 including the light-emitting element LED that is turned on (more specifically, the first pixel PX1 that overlaps with the second pixel PX2 including the light-emitting element LED that is turned on when viewed from above) (step S5).
[0114] After that, the control circuit 102 of the sensor 2 calculates the biological information (pulse wave data) based on the acquired detection signal Vdet (step S6), and ends the series of second detection processing here. By repeatedly executing the series of second detection processing described above, the temporal change of the biological information calculated based on the detection signal Vdet can be detected with high accuracy.
[0115] According to the second embodiment described above, the biometric authentication device 1 generates a binary image I3 based on the grayscale image I2 as an image with high contrast through the above-mentioned second detection processing, and generates a linear image I4 based on the binary image I3, on which only the light-emitting element LED contained in the second pixel PX2 arranged at a position overlapping with the center line drawn in the linear image I4 is lit, and the detection signal Vdet is obtained only from the photodiode PD contained in the first pixel PX1 corresponding to the second pixel PX2 including the lit light-emitting element LED.
[0116] According to this, the light of the light emitting element LED can be irradiated only to the position where the object of the biological information to be calculated (for example, a vein) passes, so that, for example, the S / N ratio of the detection signal Vdet obtained from the photodiode PD can be improved compared with the case where the entire surface of the light emitting element LED provided in the lighting device 3 is illuminated. Thus, the temporal change of the biological information calculated based on the detection signal Vdet can also be detected with high accuracy.
[0117] In the first and second embodiments described above, Figure 1 as well as Figure 2 As shown in the figure, it is assumed that the biometric authentication device 1 is in the form of a flat plate, but the shape of the biometric authentication device 1 is not limited thereto. For example, it may be in the form of Fig.15 In this case, Fig.15 As shown in (a) of FIG. 1 , by placing a finger Fg in the ring of the ring-shaped biometric authentication device 1, as shown in FIG. Fig.15 As shown in (b), the light irradiated from the light emitting element LED to the finger Fg can be detected in the oppositely arranged photodiode PD. In this configuration, by performing the above-mentioned first and second detection processes, the same effects as those shown in the above-mentioned first and second embodiments can be obtained. In addition, the biometric authentication device 1 is ring-shaped, and the light emitting element LED and the photodiode PD are arranged on the entire circumference of the ring, thereby being able to calculate the detection coordinates of the two sides of the finger Fg (the surface (fingerprint side) and the back side (nail side) of the finger Fg), and even to generate three-dimensional information (three-dimensional image).
[0118] According to at least one of the embodiments described above, it is possible to provide a biometric authentication device 1 capable of improving the S / N ratio of the detection signal Vdet outputted from the biometric authentication device 1 .
[0119] Although several embodiments of the present invention have been described, these embodiments are provided as examples and are not intended to limit the scope of the invention. These new embodiments can be implemented in various other ways, and various omissions, substitutions, and changes can be made without departing from the scope of the subject matter of the invention. These embodiments and their variations are included in the scope and subject matter of the invention, and are also included in the invention described in the claims and their equivalents.
Claims
1. A biometric authentication device comprising: The sensor comprises: a first substrate; a plurality of photoelectric conversion elements arranged in a matrix on the first substrate and outputting a signal corresponding to the amount of light received; and a first control unit controlling the operation of the plurality of photoelectric conversion elements; as well as A lighting device, comprising: a second substrate; a plurality of light emitting elements arranged in a matrix on the second substrate and irradiating the light received by the plurality of photoelectric conversion elements; and a second control unit controlling the operation of the plurality of light emitting elements, The plurality of photoelectric conversion elements and the plurality of light emitting elements are each divided into a plurality of groups corresponding to each other, The first control unit controls the operation of the plurality of photoelectric conversion elements in the following manner: if the light emitting elements at the specified positions of each group of the light emitting elements are respectively lit by the second control unit, a signal is obtained from the photoelectric conversion elements at the specified positions of each group of the photoelectric conversion elements and at the positions corresponding to the light emitting elements that are lit, The sensor further includes a plurality of first gate lines extending along a first direction and arranged at intervals along a second direction intersecting the first direction, a plurality of first signal lines extending along the second direction and arranged at intervals along the first direction, a first gate line driving circuit connected to the plurality of first gate lines, and a first signal line selecting circuit connected to the plurality of first signal lines. The lighting device further includes a plurality of second gate lines extending along the first direction and arranged at intervals along the second direction, a plurality of second signal lines extending along the second direction and arranged at intervals along the first direction, a second gate line driving circuit connected to the plurality of second gate lines, and a second signal line selecting circuit connected to the plurality of second signal lines. The plurality of photoelectric conversion elements are respectively disposed in a region surrounded by the first gate line and the first signal line. The plurality of light emitting elements are respectively disposed in areas surrounded by the second gate lines and the second signal lines. The first control unit controls the operations of the plurality of photoelectric conversion elements by controlling the operations of the first gate line driving circuit and the first signal line selecting circuit. The second control unit controls operations of the plurality of light emitting elements by controlling operations of the second gate line driving circuit and the second signal line selecting circuit.
2. The biometric authentication device according to claim 1, The light-emitting element that is lit overlaps with the photoelectric conversion element at a position corresponding to the light-emitting element that is lit in a plan view.
3. The biometric authentication device according to claim 1 or 2, The second control unit controls the operation of the plurality of light emitting elements so that the plurality of light emitting elements included in each group of the light emitting elements are sequentially lit as light emitting elements at the predetermined positions.
4. The biometric authentication device according to claim 1 or 2, The number of the light emitting elements included in each group of the light emitting elements is the same as the number of the photoelectric conversion elements included in each group of the photoelectric conversion elements, and the light emitting elements are arranged so that one light emitting element overlaps one photoelectric conversion element in a plan view.
5. The biometric authentication device according to claim 1 or 2, The number of the plurality of light emitting elements included in each group of the light emitting elements is different from the number of the plurality of photoelectric conversion elements included in each group of the photoelectric conversion elements, and the plurality of light emitting elements are arranged so as to overlap with one photoelectric conversion element in a plan view.
6. The biometric authentication device according to claim 1 or 2, The first control unit generates a first image representing an authentication object based on signals obtained from the plurality of photoelectric conversion elements.
7. The biometric authentication device according to claim 6, The first control unit generates a second image obtained by binarizing the first image based on the generated first image, and generates a third image in which only a center line of a black portion of the second image is drawn based on the generated second image. The second control unit controls the operation of the plurality of light emitting elements so that the light emitting elements arranged at positions overlapping with the center line drawn in the third image generated by the first control unit are lit.
8. The biometric authentication device according to claim 1 or 2, The photoelectric conversion element is a photodiode, The light emitting element is a micro LED.
