Detection system and detection device

Abstract

A detection system 1 comprises: a detection device 10 having a contact region TR with which a predetermined portion F of a user comes into contact; and a control device 50 that operates in an authentication mode for authenticating the user. The detection device 10 includes: an optical sensor 40 for capturing an image of the predetermined portion F in contact with the contact region TR; and a pressure sensor 20 for detecting pressure generated by the contact of the predetermined portion F with the contact region TR. The control device 50 generates a biological information image on the basis of the image of the predetermined portion F captured by the optical sensor 40 in the authentication mode, and determines whether a registered image which is a biological information image stored in advance matches an acquired image which is the biological information image generated in the authentication mode, in consideration of pressure corresponding to the registered image and pressure corresponding to the acquired image.

Description

Detection system and detection device

[0001] The present disclosure relates to detection systems and devices.

[0002] Patent Document 1 discloses, as an example of a detection system, a vein authentication system that captures an image of the vein pattern of a user's finger and authenticates the user by comparing the image with a registered vein pattern.

[0003] Japanese Patent Application Laid-Open No. 2017-157421

[0004] In the detection system of Patent Document 1, an image of a finger or the like is captured using an imaging element configured with a CMOS (Complementary Metal Oxide Semiconductor) camera. In this case, due to the characteristics of the imaging element, the imaging element and the finger must be separated from each other. This makes it difficult to miniaturize the system.

[0005] The present disclosure aims to achieve miniaturization in a detection system for authenticating a user.

[0006] The detection system disclosed herein comprises a detection device having a contact area that is in contact with a specific part of a user's body, and a control device that operates in an authentication mode to authenticate the user. The detection device comprises an optical sensor that captures an image of the specific part including the contact area of ​​the specific part that contacts the contact area, and a pressure sensor that detects the pressure generated when the specific part contacts the contact area. The control device comprises an image processing circuit that generates a biometric image including the user's biometric information based on the image of the specific part captured by the optical sensor, a memory circuit that stores the biometric image and the pressure detected by the pressure sensor when the image of the specific part corresponding to the biometric image is captured as a registered image and registered pressure information corresponding to the registered image, and a determination circuit that acquires the biometric image generated by the image processing circuit in the authentication mode, and the pressure detected by the pressure sensor when the image of the specific part corresponding to the biometric image is captured as an acquired image and acquired pressure information corresponding to the acquired image, and determines whether the acquired image and the registered image match, taking into account the acquired pressure information and the registered pressure information.

[0007] In addition, the detection device of the present disclosure includes an optical sensor and a pressure sensor that come into direct or indirect contact with a specific part of the user, the optical sensor having an imaging area that captures an image of the specific part, and the pressure sensor having a detection area that detects the pressure generated by the specific part coming into contact, the imaging area and the detection area overlap in a planar view, and the timing at which the optical sensor outputs the image and the timing at which the pressure sensor outputs the pressure are synchronized.

[0008] FIG. 1 is a diagram illustrating a configuration of a detection system according to an embodiment of the present disclosure. FIG. 2 is a side view of a detection device. FIG. 3 is a plan view of a pressure sensor illustrated in FIG. 2. FIG. 4 is a cross-sectional view of the pressure sensor illustrated in FIG. 3. FIG. 5 is a diagram illustrating a circuit configuration of the pressure sensor illustrated in FIG. 3. FIG. 6 is a plan view of an optical sensor illustrated in FIG. 2. FIG. 7 is a cross-sectional view of the optical sensor illustrated in FIG. 6. FIG. 8 is a diagram illustrating a circuit configuration of the optical sensor illustrated in FIG. 6. FIG. 9 is a block diagram of a detection system. FIG. 10 is a diagram illustrating pressure distribution information when a predetermined portion is in contact with a contact area. FIG. 11A is a diagram illustrating a vascular pattern of a first biometric information image. FIG. 11B is a diagram illustrating a vascular pattern of a second biometric information image. FIG. 11C is a diagram illustrating a vascular pattern of a third biometric information image. FIG. 11D is a diagram illustrating a vascular pattern of a fourth biometric information image. FIG. 11E is a diagram illustrating a vascular pattern of a fifth biometric information image. FIG. 12 is a flowchart executed by a control device in a registration mode. FIG. 13 is a flowchart executed by a control device in an authentication mode. Fig. 14 is a side view of a detection device according to a modified example of the embodiment of the present disclosure, Fig. 15 is a schematic diagram showing the configuration of a pressure sensor according to a modified example of the present disclosure, and Fig. 16 is a cross-sectional view of the pressure sensor shown in Fig. 15.

[0009] Each embodiment of the present disclosure will be described below with reference to the drawings. The present disclosure is not limited to the contents described in the following embodiments. Furthermore, the components described below include those that can be easily imagined by a person skilled in the art and those that are substantially the same. Furthermore, the components described below can be combined as appropriate.

[0010] It should be noted that the disclosure is merely an example, and appropriate modifications that a person skilled in the art can easily conceive of while maintaining the gist of the present disclosure are naturally included within the scope of the present disclosure. Furthermore, in order to clarify the explanation, the drawings may show the width, thickness, shape, etc. of each part schematically compared to the actual embodiment, but these are merely examples and do not limit the interpretation of the present disclosure. Furthermore, in this specification and each drawing, elements similar to those described above with respect to the previous drawings may be given the same reference numerals, and detailed descriptions may be omitted as appropriate.

[0011] The X and Y directions shown in the drawings correspond to directions parallel to the plate surface of the substrate included in the detection device 10. The +X side and -X side of the X direction and the +Y side and -Y side of the Y direction correspond to the sides of the detection device 10. The Z direction corresponds to the thickness direction of the detection device 10, the +Z side of the Z direction corresponds to the front side of the detection device 10, and the -Z side of the Z direction corresponds to the back side of the detection device 10. Furthermore, in this specification, "plan view" refers to viewing the detection device 10 from the +Z side toward the -Z side along the Z direction. Note that the X, Y, and Z directions are merely examples, and the present disclosure is not limited to these directions.

[0012] FIG. 1 is a diagram illustrating a configuration of a detection system 1 according to an embodiment of the present disclosure. The detection system 1 is a system that detects biometric information of a user and authenticates the identity of the user. The biometric information is a blood vessel pattern. The biometric information may also be a fingerprint pattern. The detection system 1 includes a detection device 10 and a control device 50. The detection device 10 and the control device 50 are electrically connected to each other.

[0013] 2 is a side view of the detection device 10. As shown in FIGS. 1 and 2, the detection device 10 has a contact area TR on its front surface (hereinafter referred to as the contact surface 10a) that is in contact with a predetermined part F of the user. The predetermined part F is the user's finger. The predetermined part F contacts the contact area TR while extending along the Y direction. Note that the predetermined part F may be the entire hand or a part of the hand (e.g., the palm).

[0014] The detection device 10 includes a pressure sensor 20, a light source device 30, and an optical sensor 40. The optical sensor 40 and the pressure sensor 20 are flat and rectangular in shape with the Y direction as the longitudinal direction in a plan view. The optical sensor 40 and the pressure sensor 20 overlap each other in the Z direction.

[0015] 3 is a plan view of the pressure sensor 20 shown in FIG. 2. The pressure sensor 20 detects pressure generated when a predetermined portion F comes into contact with a contact region TR. The pressure sensor 20 has a detection region DR for detecting pressure on its front surface (hereinafter referred to as the detection surface 20a). The detection surface 20a of the pressure sensor 20 corresponds to the contact surface 10a of the detection device 10. The detection region DR coincides with the contact region TR. The predetermined portion F of the user comes into direct contact with the detection region DR of the pressure sensor 20.

[0016] The detection region DR is divided into a plurality of individual detection regions DRa. The plurality of individual detection regions DRa are arranged in a matrix along the X and Y directions. The pressure sensor 20 also includes a first gate line driving circuit GC1 and a first signal line selection circuit SC1 at positions outside the detection region DR in a plan view.

[0017] Fig. 4 is a cross-sectional view of the pressure sensor 20 shown in Fig. 3. Fig. 5 is a diagram showing the circuit configuration of the pressure sensor 20 shown in Fig. 3.

[0018] 4, the pressure sensor 20 includes an array substrate 21, an array electrode 22, a common electrode 23, a first sensor layer 24, and a first protective layer 25. The first sensor layer 24 corresponds to the "sensor layer."

[0019] The array substrate 21 includes a first substrate 21a and an array layer 21b. The first substrate 21a has electrical insulation properties. The first substrate 21a has relatively high rigidity. The first substrate 21a is, for example, a glass substrate, a resin substrate, or a resin film. The back surface of the first substrate 21a corresponds to the back surface 20b of the pressure sensor 20.

[0020] The array layer 21b is disposed on the front surface of the first substrate 21a. The array layer 21b includes an insulating layer IL shown in Fig. 4, a first transistor T1 shown in Figs. 4 and 5, a first gate line GL1 and a first signal line SL1 shown in Fig. 5, and a first gate line driving circuit GC1 and a first signal line selecting circuit SC1 shown in Fig. 3. The first gate line GL1, the first signal line SL1, the first transistor T1, the first gate line driving circuit GC1, and the first signal line selecting circuit SC1 are disposed on the front surface of the first substrate 21a.

[0021] 4 has electrical insulation properties and covers the first gate line GL1, the first signal line SL1, the first transistor T1, the first gate line driving circuit GC1, and the first signal line selection circuit SC1. The front surface of the insulating layer IL is planar. The front surface of the insulating layer IL corresponds to the front surface 21c of the array substrate 21. The front surface 21c of the array substrate 21 corresponds to the "first surface."

[0022] As shown in FIG. 5 , the plurality of first gate lines GL1 extend along the X direction and are arranged side by side along the Y direction on the front surface of the first substrate 21a. The plurality of first gate lines GL1 are electrically connected to a first gate line driving circuit GC1. The plurality of first signal lines SL1 extend along the Y direction and are arranged side by side along the X direction on the front surface of the first substrate 21a. The plurality of first signal lines SL1 are electrically connected to a first signal line selection circuit SC1. The first signal line selection circuit SC1 is, for example, a multiplexer. An area surrounded by two adjacent first gate lines GL1 and two adjacent first signal lines SL1 corresponds to one individual detection area DRa.

[0023] In one individual detection region DRa, one array electrode 22 and one common electrode 23 are arranged. That is, a plurality of array electrodes 22 and a plurality of common electrodes 23 are arranged in a matrix in the detection region DR in a plan view.

[0024] The first transistor T1 is disposed in each individual detection region DRa, and includes a semiconductor layer T1a, a gate insulating film T1b, a gate electrode T1c, a drain electrode T1d, and a source electrode T1e, as shown in FIG.

[0025] 5, the gate electrode T1c is electrically connected to the first gate line GL1, the drain electrode T1d is electrically connected to the array electrode 22, and the source electrode T1e is electrically connected to the first signal line SL1.

[0026] 4, the array electrode 22 and the common electrode 23 are disposed on the front surface 21c of the array substrate 21. The array electrode 22 and the common electrode 23 are formed of a metal material such as ITO (Indium Tin Oxide). Note that the array electrode 22 and the common electrode 23 may be formed of different metal materials.

[0027] The first sensor layer 24 faces the front surface 21c of the array substrate 21 and is disposed at a distance from the array substrate 21 on the +Z side. The first sensor layer 24 is supported by spacers (not shown) disposed on the array substrate 21. The first sensor layer 24 faces the array electrode 22 and the common electrode 23 at a distance from them. The first sensor layer 24 has flexibility such that it deforms when a predetermined portion F comes into contact with the detection region DR.

[0028] The first sensor layer 24 contains a plurality of conductive microparticles and is made of a resin material with relatively high electrical insulation. The microparticles are dispersed and spaced apart inside the first sensor layer 24. When a predetermined part F of the user comes into contact with the detection region DR (contact region TR), the first sensor layer 24 deforms and comes into contact with the array substrate 21 and is compressed.

[0029] When the first sensor layer 24 is compressed, the spacing between the multiple microparticles becomes smaller, decreasing the electrical resistance value of the first sensor layer 24. The greater the compression amount of the first sensor layer 24, the smaller the electrical resistance value of the first sensor layer 24. In this way, the electrical resistance value of the first sensor layer 24 changes when the predetermined portion F comes into contact with the detection region DR (contact region TR).

[0030] The first protective layer 25 is disposed on the front surface of the first sensor layer 24. The first protective layer 25 has electrical insulation properties. The first protective layer 25 has flexibility such that it deforms together with the first sensor layer 24 when the predetermined portion F comes into contact with the detection region DR. The front surface of the first protective layer 25 corresponds to the detection surface 20a of the pressure sensor 20.

[0031] The pressure sensor 20 is also translucent. Specifically, at least the material of the components of the pressure sensor 20 that overlap the detection region DR in a plan view is translucent.

[0032] Next, the operation of the pressure sensor 20 will be described.

[0033] A constant amount of current is supplied to the common electrode 23 from the control device 50 via a conductor (not shown) arranged on the array substrate 21. The first gate line drive circuit GC1 sequentially or simultaneously selects the multiple first gate lines GL1 based on a control signal output from the control device 50, and supplies a gate drive signal that drives the gate of the first transistor T1 to the selected first gate line GL1. The first signal line selection circuit SC1 selects the first signal line SL1 based on the control signal output from the control device 50, and electrically connects the selected first signal line SL1 to the control device 50. As a result, current is supplied to the control device 50 from the first gate line GL1 to which the gate drive signal is supplied and the array electrodes 22 in the individual detection regions DRa corresponding to the selected first signal line SL1.

[0034] When the predetermined part F of the user is not in contact with the individual detection area DRa, the first sensor layer 24 is not deformed, and there is no electrical connection between the common electrode 23 and the array electrode 22. In this case, no current flows through the array electrode 22, and the current value of the array electrode 22 is zero.

[0035] Meanwhile, when a predetermined part F of the user comes into contact with the individual detection area DRa, the first sensor layer 24 deforms and comes into contact with the array substrate 21, electrically connecting the common electrode 23 and the array electrode 22 via the first sensor layer 24. In this case, a current is supplied to the array electrode 22 from the common electrode 23 via the first sensor layer 24. Furthermore, the greater the pressure acting on the individual detection area DRa, the greater the compression amount of the first sensor layer 24, and the smaller the electrical resistance value of the first sensor layer 24. Therefore, the greater the pressure acting on the individual detection area DRa, the greater the current value of the array electrode 22.

[0036] In this way, the current value of the array electrode 22 changes depending on the magnitude of the pressure acting on the individual detection area DRa. The current of the array electrode 22 is supplied to the control device 50. The control device 50 acquires the current value of the array electrode 22 as the magnitude (pressure value) of the pressure acting on the individual detection area DRa. In other words, the pressure sensor 20 detects the magnitude of the pressure acting on the individual detection area DRa and outputs it to the control device 50. Also, as described above, multiple individual detection areas DRa are arranged in a matrix in the detection area DR. Therefore, the pressure sensor 20 supplies the current of the array electrode 22 for each of the multiple individual detection areas DRa to the control device 50. As a result, the control device 50 acquires the output of the pressure sensor 20 as pressure distribution information of the detection area DR. In other words, the pressure sensor 20 detects the pressure acting on the detection area DR and outputs it to the control device 50 as pressure distribution information.

[0037] 1 and 2, the light source device 30 is disposed on the contact surface 10a side. The light source device 30 has a plurality of light sources 31. The light sources 31 are, for example, light-emitting diodes (LEDs). The plurality of light sources 31 are arranged side by side along the Y direction on both sides of the contact region TR (detection region DR) in the X direction.

[0038] The light source 31 emits light toward a predetermined portion F that contacts the contact area TR. The light from the light source 31 is reflected inside the predetermined portion F and enters the pressure sensor 20 as reflected light. As described above, the pressure sensor 20 is translucent. Therefore, the reflected light passes through the pressure sensor 20 and enters the optical sensor 40.

[0039] 6 is a plan view of the optical sensor 40 shown in FIG. 2. The optical sensor 40 captures an image of the predetermined portion F in contact with the contact region TR. The image of the predetermined portion F captured by the optical sensor 40 includes the contact range of the predetermined portion F in contact with the contact region TR. As shown in FIG. 2, the optical sensor 40 is disposed on the surface (i.e., the back surface 20b) opposite the detection surface 20a of the pressure sensor 20. In other words, the predetermined portion F of the user indirectly contacts the optical sensor 40 via the pressure sensor 20.

[0040] 6, the optical sensor 40 has an imaging region PR on its front surface (hereinafter referred to as an imaging surface 40a) for capturing an image of the predetermined portion F. The imaging region PR coincides with the detection region DR of the pressure sensor 20 in a plan view.

[0041] The imaging region PR is divided into a plurality of individual imaging regions PRa. The individual imaging regions PRa are arranged in a matrix along the X and Y directions. The photosensor 40 also includes a second gate line driving circuit GC2 and a second signal line selection circuit SC2 at positions outside the imaging region PR in a plan view.

[0042] Fig. 7 is a cross-sectional view of the optical sensor 40 shown in Fig. 6. Fig. 8 is a diagram showing the circuit configuration of the optical sensor 40 shown in Fig. 6.

[0043] As shown in FIG. 7, the optical sensor 40 includes a second substrate 41, a circuit formation layer 42, an organic insulating film 43, an inorganic insulating film 44, a second sensor layer 45, and a second protective layer 46.

[0044] The second substrate 41 has electrical insulation properties. The second substrate 41 has relatively high rigidity. The second substrate 41 is, for example, a glass substrate, a resin substrate, or a resin film. The back surface of the second substrate 41 corresponds to the back surface 40b of the optical sensor 40.

[0045] The circuit formation layer 42 is disposed on the front surface of the second substrate 41. The circuit formation layer 42 has disposed thereon the second gate line driving circuit GC2 and the second signal line selection circuit SC2 shown in Fig. 6, as well as the second gate line GL2, the second signal line SL2, and the second transistor T2 shown in Fig. 8.

[0046] The organic insulating film 43 is disposed on the front surface of the circuit formation layer 42. The organic insulating film 43 is made of an electrically insulating organic insulating material. The organic insulating film 43 covers the second gate line GL2, the second signal line SL2, the second transistor T2, the second gate line driving circuit GC2, and the second signal line selection circuit SC2.

[0047] The inorganic insulating film 44 is disposed on the front surface of the organic insulating film 43. The inorganic insulating film 44 is made of an inorganic insulating material having electrical insulating properties.

[0048] 8 , the plurality of second gate lines GL2 extend along the X direction and are arranged side by side along the Y direction on the front surface of the second substrate 41. The plurality of second gate lines GL2 are electrically connected to a second gate line driving circuit GC2. The plurality of second signal lines SL2 extend along the Y direction and are arranged side by side along the X direction on the front surface of the second substrate 41. The plurality of second signal lines SL2 are electrically connected to a second signal line selection circuit SC2. The second signal line selection circuit SC2 is, for example, a multiplexer. An area surrounded by two adjacent second gate lines GL2 and two adjacent second signal lines SL2 corresponds to one individual imaging area PRa.

[0049] Each individual imaging region PRa includes a capacitive element Ca, a second transistor T2, and a photodiode PD. That is, the photodiodes PD overlap the contact region TR (detection region DR) in plan view and are arranged in a matrix.

[0050] The capacitance element Ca is a capacitance (sensor capacitance) formed in the photodiode PD, and is equivalently electrically connected in parallel to the photodiode PD.

[0051] The gate of the second transistor T2 is electrically connected to the second gate line GL2. One of the source and drain of the second transistor T2 is electrically connected to the second signal line SL2. The other of the source and drain of the second transistor T2 is electrically connected to the anode of the photodiode PD and the capacitance element Ca.

[0052] 7 includes a lower electrode 45 a, a lower buffer layer 45 b, an active layer 45 c, an upper buffer layer 45 d, and an upper electrode 45 e. In plan view, the portion of the second sensor layer 45 overlapping with the lower electrode 45 a corresponds to the photodiode PD shown in FIG.

[0053] A plurality of lower electrodes 45a are arranged on the front surface of the inorganic insulating film 44. One lower electrode 45a is arranged in each individual imaging region PRa. That is, the plurality of lower electrodes 45a are arranged in a matrix in the imaging region PR in a plan view. The lower electrodes 45a correspond to the anode electrodes of the photodiodes PD. The lower electrodes 45a are formed of a metal material such as ITO (Indium Tin Oxide).

[0054] The lower buffer layer 45b is disposed on the front surface of the inorganic insulating film 44 in a state where it covers the lower electrode 45a. The lower buffer layer 45b functions as a hole transport layer. The lower buffer layer 45b is made of, for example, tungsten oxide (WO ３ ), molybdenum oxide, etc.

[0055] The active layer 45c is disposed on the front surface of the lower buffer layer 45b. The electrical characteristics (e.g., electrical resistance value) of the active layer 45c change depending on the light incident on the active layer 45c. An organic semiconductor is used for the active layer 45c. In other words, the photodiode PD is an OPD (organic photodiode). The active layer 45c has a bulk heterostructure in which, for example, a p-type organic semiconductor and an n-type fullerene derivative (PCBM), which is an n-type organic semiconductor, are mixed.

[0056] The upper buffer layer 45d is disposed on the front surface of the active layer 45c and functions as an electron transport layer. The upper buffer layer 45d is made of, for example, ethoxylated polyethyleneimine (PEIE).

[0057] The upper electrode 45e is disposed on the front surface of the upper buffer layer 45d. The upper electrode 45e is a cathode electrode of the photodiode PD. The upper electrode 45e is disposed continuously across the entire imaging region PR in a plan view. The upper electrode 45e faces the plurality of lower electrodes 45a, with the upper buffer layer 45d, active layer 45c, and lower buffer layer 45b interposed therebetween. The upper electrode 45e is formed of a metal material such as ITO (Indium Tin Oxide).

[0058] 7 and 8 are merely examples, and the photodiode PD is not limited to the above configuration. For example, the upper electrode 45e may correspond to the anode electrode, and the lower electrode 45a may correspond to the cathode electrode.

[0059] The second protective layer 46 is disposed on the front surface of the second sensor layer 45. The second protective layer 46 has electrical insulation properties. The front surface of the second protective layer 46 corresponds to the imaging surface 40a of the optical sensor 40.

[0060] Next, the operation of the optical sensor 40 will be described.

[0061] A predetermined voltage is applied to the anode (lower electrode 45 a) of the photodiode PD from the control device 50 via a conductor (not shown) disposed in the circuit formation layer 42. The second gate line drive circuit GC2 sequentially or simultaneously selects the multiple second gate lines GL2 based on a control signal output from the control device 50, and supplies a gate drive signal that drives the gate of the second transistor T2 to the selected second gate line GL2. The second signal line selection circuit SC2 selects the second signal line SL2 based on the control signal output from the control device 50, and electrically connects the selected second signal line SL2 to the control device 50. As a result, a current corresponding to the capacitance accumulated in the capacitive element Ca in the individual imaging region PRa corresponding to the second gate line GL2 to which the gate drive signal is supplied and the selected second signal line SL2 is supplied to the control device 50.

[0062] When a predetermined part F of the user is in contact with the contact area TR, light from the light source 31 reflected by the predetermined part F (reflected light) is incident on the individual imaging area PRa. The amount of reflected light varies depending on the shape and internal structure (e.g., the position of blood vessels) of the predetermined part F. The capacitance of the capacitive element Ca varies depending on the amount of reflected light.

[0063] Furthermore, as described above, a current corresponding to the capacitance of the capacitive element Ca is supplied to the control device 50. Furthermore, as described above, a plurality of individual imaging regions PRa are arranged in a matrix in the imaging region PR. That is, the optical sensor 40 supplies a current corresponding to the capacitance of the capacitive element Ca for each of the plurality of individual imaging regions PRa to the control device 50. As a result, when the predetermined portion F of the user is in contact with the contact region TR, the control device 50 acquires a current corresponding to the capacitance of the plurality of capacitive elements Ca as an image of the predetermined portion F in contact with the contact region TR. That is, when the predetermined portion F of the user is in contact with the contact region TR, the optical sensor 40 outputs an image of the predetermined portion F to the control device 50.

[0064] Furthermore, the timing at which the pressure sensor 20 outputs the pressure distribution information and the timing at which the optical sensor 40 outputs the image of the predetermined region F are synchronized. Specifically, the interval at which the pressure sensor 20 outputs the pressure distribution information are equal to the interval at which the optical sensor 40 outputs the image of the predetermined region F. Furthermore, the timing at which the pressure sensor 20 outputs the pressure distribution information and the timing at which the optical sensor 40 outputs the image of the predetermined region F may be simultaneous. This allows the control device 50 to associate the pressure distribution information output by the pressure sensor 20 with the image of the predetermined region F output by the optical sensor 40. Note that the pressure sensor 20 may continuously output the pressure distribution information, and the optical sensor 40 may continuously output the image of the predetermined region F.

[0065] As described above, the optical sensor 40 captures an image of the predetermined part F including the contact area of ​​the predetermined part F that is in contact with the contact region TR. Therefore, compared to a case where the detection device 10 includes a camera that captures an image of the predetermined part F and the camera captures an image of the predetermined part F while the camera is spaced apart from the predetermined part F, the detection device 10 does not need to include a support base that supports the predetermined part F. This allows the detection device 10 to be made smaller.

[0066] FIG. 9 is a block diagram of the detection system 1. The control device 50 is a computer and includes, for example, a central processing unit (CPU), a read-only memory (ROM), a random access memory (RAM), a storage circuit 53 (described later), an input interface, and an output interface. The CPU, ROM, RAM, and storage circuit 53 are connected via an internal bus. The ROM stores programs such as a BIOS. The storage circuit 53 is, for example, a hard disk drive (HDD) or flash memory, and stores an operating system program and application programs. The CPU uses the RAM as a work area and executes programs stored in the ROM or storage circuit 53 to realize various functions.

[0067] The control device 50 includes an acquisition circuit 51 , an image processing circuit 52 , a memory circuit 53 , a determination circuit 54 , an output circuit 55 , and a display circuit 56 .

[0068] The acquisition circuit 51 acquires the pressure distribution information output by the pressure sensor 20 and the image of the predetermined portion F output by the optical sensor 40 .

[0069] 10 is a diagram showing pressure distribution information PDI when a predetermined portion F is in contact with the contact region TR. The pressure distribution information PDI is divided into four pressure ranges. The magnitude of the pressure in the pressure distribution information PDI increases in the order of the first pressure range H1, the second pressure range H2, the third pressure range H3, and the fourth pressure range H4. The pressure value in the first pressure range H1 is zero. Note that the pressure distribution information PDI shown in FIG. 10 is an example, and it goes without saying that the number and shape of the pressure ranges are not limited to those in the pressure distribution information PDI shown in FIG. 10.

[0070] Further, the acquisition circuit 51 shown in FIG. 9 acquires the image of the predetermined portion F captured by the optical sensor 40 in a state synchronized with the pressure distribution information output by the pressure sensor 20 .

[0071] The image processing circuit 52 generates a biometric information image including biometric information of the user based on the image of the predetermined part F captured by the optical sensor 40. The biometric information is a blood vessel pattern (vein pattern).

[0072] The image processing circuit 52 acquires an image of the specified area F captured by the optical sensor 40 from the acquisition circuit 51. The image processing circuit 52 adjusts the brightness, contrast, etc. of the image of the specified area F to extract the blood vessel pattern (vein pattern) of the specified area F and generate a biometric information image.

[0073] Fig. 11A is a diagram showing the blood vessel pattern of a first biometric information image G1. Fig. 11B is a diagram showing the blood vessel pattern of a second biometric information image G2. Fig. 11C is a diagram showing the blood vessel pattern of a third biometric information image G3. Fig. 11D is a diagram showing the blood vessel pattern of a fourth biometric information image G4. Fig. 11E is a diagram showing the blood vessel pattern of a fifth biometric information image G5.

[0074] The first biometric information image G1, the second biometric information image G2, the third biometric information image G3, the fourth biometric information image G4, and the fifth biometric information image G5 have, in this order, the largest maximum pressure values ​​in the pressure distribution information output by the pressure sensor 20 synchronized with the image of the original predetermined part F. Among the first biometric information image G1, the second biometric information image G2, the third biometric information image G3, the fourth biometric information image G4, and the fifth biometric information image G5, the first biometric information image G1 has the smallest maximum pressure value, and the fifth biometric information image G5 has the largest maximum pressure value. In other words, the pressing force with which the predetermined part F is pressed against the contact area TR when the image of the original predetermined part F is captured increases in the order of the first biometric information image G1, the second biometric information image G2, the third biometric information image G3, the fourth biometric information image G4, and the fifth biometric information image G5.

[0075] Therefore, in the first biometric information image G1 shown in Fig. 11A, the blood vessel patterns disappear or become blurred on both sides in the X direction compared to the third biometric information image G3 shown in Fig. 11C. In the area A1 on both sides in the X direction of the first biometric information image G1 shown in Fig. 11A, the blood vessel patterns disappear compared to the third biometric information image G3 shown in Fig. 11C.

[0076] Furthermore, in the second biometric information image G2 shown in Fig. 11B, the blood vessel pattern disappears or becomes blurred on both sides in the X direction compared to the third biometric information image G3 shown in Fig. 11C. In the region A2 on both sides in the X direction of the second biometric information image G2 shown in Fig. 11B, the blood vessel pattern disappears compared to the third biometric information image G3 shown in Fig. 11C. The length in the X direction of the region A2 is shorter than the length in the X direction of the region A1 in Fig. 11A.

[0077] Furthermore, in the fourth biometric information image G4 shown in Fig. 11D, the blood vessel pattern has disappeared in the area A3 shown in Fig. 11D compared to the third biometric information image G3 shown in Fig. 11C. This occurs because the pressing force corresponding to the fourth biometric information image G4 shown in Fig. 11D is greater than the pressing force corresponding to the third biometric information image G3 shown in Fig. 11C, resulting in a deterioration in the blood flow state at the predetermined site F.

[0078] Furthermore, in the fifth biometric information image G5 shown in Fig. 11E, the vascular pattern has disappeared in the area A4 shown in Fig. 11E compared to the third biometric information image G3 shown in Fig. 11D. This occurs because the pressing force corresponding to the fifth biometric information image G5 shown in Fig. 11E is greater than the pressing force corresponding to the fourth biometric information image G4 shown in Fig. 11D, resulting in a deterioration in the blood flow state at the predetermined site F.

[0079] In this way, the vascular pattern changes depending on the pressure corresponding to the biometric information image. As described above, the greater the pressure corresponding to the biometric information image, the greater the pressure output by the pressure sensor 20. In other words, the vascular pattern changes depending on the pressure output by the pressure sensor 20.

[0080] The image processing circuit 52 may extract the contour of the predetermined part F in the biometric information image. Specifically, the image processing circuit 52 first extracts the contour of the predetermined part F in pressure distribution information synchronized with the original image of the predetermined part F in the biometric information image. For example, the image processing circuit 52 extracts the boundary RL between the first pressure range H1 and the second pressure range H2, where the pressure value is zero, in the pressure distribution information PDI shown in FIG. 10 as the contour of the predetermined part F. Furthermore, in a biometric information image generated from the image of the predetermined part F synchronized with the pressure distribution information from which the contour of the predetermined part F has been extracted, the image processing circuit 52 extracts a line (e.g., the dashed line OL shown in FIG. 11C ) corresponding to the contour (boundary RL) of the predetermined part F in the pressure distribution information as the contour of the predetermined part F in the biometric information image.

[0081] By extracting the contour of the predetermined part F as described above, the image processing circuit 52 can clearly distinguish between the contour of the predetermined part F and the vascular pattern in the biometric information image. Furthermore, the vascular pattern is located inside the contour of the predetermined part F. Therefore, the image processing circuit 52 can appropriately extract the vascular pattern.

[0082] The storage circuitry 53 stores the biometric information image and the pressure distribution information output by the pressure sensor 20 in association with each other (details will be described later).

[0083] The determination circuit 54 determines whether the user is the correct person using the biometric information image (details will be described later). If the determination circuit 54 determines that the user is the correct person, it authenticates that the user is the correct person.

[0084] The output circuit 55 outputs the determination result of the determination circuit 54. The output circuit 55 outputs the determination result to the display circuit 56. The display circuit 56 displays the determination result. The display circuit 56 is, for example, a display.

[0085] The control device 50 operates in either a registration mode or an authentication mode. The registration mode is a mode in which a user registers with the detection system 1 so that the user can use the detection system 1. The authentication mode is a mode in which the detection system 1 authenticates that the user is the authorized user.

[0086] The switching between the registration mode and the authentication mode is performed, for example, by the user inputting a selection instruction into an input device (such as a keyboard and a touch panel: not shown) provided in the control device 50.

[0087] 12 is a flowchart executed in the registration mode by the control device 50. The control device 50 executes the flowchart shown in FIG.

[0088] In step S1, the control device 50 (display circuit 56) displays a message indicating that the predetermined portion F is to be brought into contact with the contact area TR. At this time, the control device 50 also displays a message on the display circuit 56 indicating that the pressing force of the predetermined portion F against the contact area TR is to be changed.

[0089] The user brings the predetermined portion F into contact with the contact area TR and changes the pressure in accordance with the display on the display circuit 56. At this time, as described above, the optical sensor 40 captures multiple images of the predetermined portion F and outputs them to the control device 50. Furthermore, the pressure sensor 20 detects multiple pressures acting on the detection area DR and outputs them to the control device 50. As described above, the images of the predetermined portion F output from the optical sensor 40 and the pressures output from the pressure sensor 20 are synchronized.

[0090] Next, in step S2, the control device 50 (acquisition circuit 51) acquires a plurality of images of the predetermined area F output by the optical sensor 40 and a plurality of pieces of pressure distribution information output by the pressure sensor 20. As described above, by the user changing the pressure of the predetermined area F against the contact area TR, the plurality of images of the predetermined area F acquired by the control device 50 differ from one another, and the plurality of pieces of pressure distribution information acquired by the control device 50 differ from one another.

[0091] Furthermore, in step S3, the control device 50 selects multiple pieces of pressure distribution information from the multiple pieces of pressure distribution information acquired. First, the control device 50 (image processing circuit 52) ​​calculates the area occupied by a predetermined pressure range in the detection region DR for each of the multiple pieces of pressure distribution information acquired in step S2. The predetermined pressure range is a range of pressure values ​​within which the blood flow state at the predetermined site F in contact with the contact region TR is appropriate and the image processing circuit 52 can appropriately extract a blood vessel pattern from the image of the predetermined site F. For example, in the pressure distribution information PDI shown in FIG. 10 , if the first pressure range H1 and the second pressure range H2 are outside the predetermined pressure range and the third pressure range H3 and the fourth pressure range H4 are within the predetermined pressure range, the control device 50 calculates the area occupied by the combined range of the third pressure range H3 and the fourth pressure range H4 in the detection region DR.

[0092] The control device 50 selects a predetermined number (an integer equal to or greater than two, for example, five) of pieces of pressure distribution information whose calculated areas fall within a predetermined area range from the plurality of pieces of pressure distribution information acquired in step S2. The predetermined area range is an area range in which the determination circuit 54 can appropriately make a determination, which will be described later. Note that, if the number of pieces of pressure distribution information whose calculated areas fall within the predetermined area range exceeds a predetermined number, the control device 50 may select the pressure distribution information in descending order of calculated area. Furthermore, if the number of pieces of pressure distribution information whose calculated areas fall within the predetermined area range is one, or if the number of pieces of pressure distribution information to be selected does not reach the predetermined number, the control device 50 may return the program to step S1.

[0093] Furthermore, in step S4, the control device 50 selects images of the predetermined region F that are synchronized with the selected pressure distribution information from the multiple images of the predetermined region F acquired in step S2. The number of selected images of the predetermined region F is equal to the number of selected pressure distribution information (predetermined number).

[0094] Next, in step S5, the control device 50 (image processing circuit 52) ​​generates a biometric information image based on the image of the predetermined part F selected in step S4. The biometric information image generated by the control device 50 in step S4 corresponds to, for example, the biometric information images shown in Figures 11A, 11B, 11C, 11D, and 11E. Each of the multiple biometric information images corresponds to pressure distribution information synchronized with the original image of the predetermined part F.

[0095] Furthermore, the control device 50 (storage circuitry 53) stores the biometric information image and the pressure distribution information in step S6. Specifically, the control device 50 associates the biometric information image generated in step S5 with the pressure distribution information corresponding to the biometric information image (the pressure distribution information selected in step S3), and stores a plurality of each.

[0096] The control device 50 also stores the plurality of biometric images and the plurality of pressure distribution information in association with identification information (e.g., an identification number) that identifies the user. This allows the control device 50 to identify the user corresponding to the plurality of biometric images and the plurality of pressure distribution information stored in the memory circuitry 53 as the user corresponding to the identification information. The control device 50 (acquisition circuitry 51) acquires the identification information when the user inputs the identification information into the input device. After completing step S6, the control device 50 terminates the program.

[0097] In this way, in the registration mode, a plurality of biometric information images, a plurality of pieces of pressure distribution information, and identification information are stored in the memory circuitry 53 in a state in which they correspond to one another. Hereinafter, the biometric information images and pressure distribution information stored in the memory circuitry 53 are referred to as registered images and registered pressure information. The registered images and registered pressure information correspond to one another. The registered pressure information is pressure distribution information detected by the pressure sensor 20 when the image of the predetermined portion F that is the original of the registered image is captured by the optical sensor 40. Note that the memory circuitry 53 stores a plurality of registered images, a plurality of pieces of registered pressure information, and identification information corresponding to at least one user in a state in which they correspond to one another.

[0098] Fig. 13 is a flowchart executed by the control device 50 in the authentication mode. The control device 50 executes the flowchart shown in Fig. 13 in response to selection of the authentication mode. When authenticating a user, the control device 50 performs one-to-one authentication using registered images and registered pressure information corresponding to the user. When selecting the authentication mode, the user inputs the above-mentioned identification information into the input device.

[0099] In step S11, the control device 50 (display circuitry 56) displays a message to the effect that the predetermined portion F should be brought into contact with the contact region TR. In response to the display on the display circuitry 56, the user brings the predetermined portion F into contact with the contact region TR.

[0100] Next, in step S12, the control device 50 (acquisition circuit 51) acquires the image of the predetermined area F output by the optical sensor 40 and the pressure distribution information output by the pressure sensor 20. The control device 50 acquires the image and pressure distribution information of the predetermined area F one by one. The acquired image and pressure distribution information of the predetermined area F are synchronized with each other as described above and correspond to each other.

[0101] Furthermore, in step S13, the control device 50 determines whether the area occupied by the predetermined pressure range in the detection region DR for the acquired pressure distribution information is within a predetermined area range. Specifically, the control device 50 (image processing circuit 52) ​​calculates the area occupied by the predetermined pressure range in the detection region DR for the pressure distribution information acquired in step S12, similar to step S3 above.

[0102] If the calculated area is outside the predetermined area range (No in step S13), the control device 50 returns the program to step S11. As a result, if the calculated area is outside the predetermined area range, the control device 50 again acquires the image of the predetermined portion F output by the optical sensor 40 and the pressure distribution information output by the pressure sensor 20 in step S12. In other words, if the area occupied by the predetermined pressure range in the detection region DR in the pressure distribution information acquired in step S12 is outside the predetermined area range, no judgment is made by the judgment circuit 54, which will be described later.

[0103] On the other hand, if the calculated area is within the predetermined area range (Yes in step S13), the control device 50 proceeds to step S14. At this time, the control device 50 has acquired pressure distribution information in which the calculated area is within the predetermined area range, and an image of the predetermined part F corresponding to the pressure distribution information. If the calculated area is within the predetermined area range, the control device 50 can acquire an image of the predetermined part F in which the blood flow state of the predetermined part F is appropriate and the vascular pattern can be appropriately recognized in the biometric information image. Therefore, the judgment circuit 54 can appropriately make the judgment described below.

[0104] In step S14, the control device 50 (image processing circuit 52) ​​generates a biometric information image based on the acquired image of the predetermined part F. Hereinafter, the biometric information image generated in step S14 will be referred to as the acquired image. Also, the pressure distribution information acquired in step S12 above will be referred to as the acquired pressure information. The acquired pressure information is pressure distribution information detected by the pressure sensor 20 when the image of the predetermined part F, which is the source of the acquired image, is captured by the optical sensor 40. In other words, the acquired image and the acquired pressure information correspond to each other.

[0105] Next, in step S15, the control device 50 selects one piece of registered pressure information from the plurality of pieces of registered pressure information based on the acquired pressure information. Specifically, the control device 50 selects one piece of registered pressure information that is closest to the acquired pressure information from the plurality of pieces of registered pressure information corresponding to the input identification information. For example, the control device 50 calculates the range in which the pressure values ​​of the registered pressure information and the pressure values ​​of the acquired pressure information overlap for each of the plurality of pieces of registered pressure information, and selects the registered pressure information with the largest area of ​​that range in the detection region DR from the plurality of pieces of registered pressure information.

[0106] Furthermore, in step S16, the control device 50 selects one registered image (for example, the biometric information image shown in FIG. 11C) corresponding to one registered pressure information.

[0107] Next, in step S17, the control device 50 (determination circuit 54) determines whether the acquired image matches one registered image. The control device 50 compares the acquired image with one registered image and determines whether they match using a known method. For example, the control device 50 extracts multiple feature points of the vascular pattern of the acquired image and one registered image, and determines that the acquired image matches one registered image if the rate at which the feature points match is equal to or greater than a first predetermined rate. The first predetermined rate is the rate at which the vascular pattern of the acquired image and the vascular pattern of one registered image can be recognized as matching. If the acquired image matches one registered image, the control device 50 authenticates the user.

[0108] If the control device 50 determines that the acquired image matches one of the registered images (Yes in step S17), the control device 50 causes the program to proceed to step S18. In step S18, the control device 50 (display circuit 56) displays a message indicating that the user has been authenticated. When step S18 ends, the control device 50 terminates the program.

[0109] On the other hand, in step S17, if the rate at which both feature points match is smaller than the first predetermined rate (No in step S17), the control device 50 determines that the acquired image does not match one registered image, and returns the program to step S11. Note that the control device 50 may end the program if the number of times it determines No in step S16 is equal to or greater than a predetermined number (for example, five times).

[0110] In this way, the control device 50 selects one registered image from the multiple registered images while taking into account the acquired pressure information and the registered pressure information, compares the acquired image with the one registered image, and authenticates the user's identity. If the control device 50 does not take into account the acquired pressure information and the registered pressure information, the pressure of the specified part F acting on the contact area TR may vary, resulting in a relatively large difference between the shape of the vascular pattern in the registered image and the shape of the vascular pattern in the acquired image. For example, if one registered image corresponds to the biometric information image shown in FIG. 11A and the acquired image corresponds to the biometric information image shown in FIG. 11C, the rate at which the two feature points match is less than a first predetermined rate. In this case, the user will not be authenticated as the user, even though they are the actual user.

[0111] In other words, even if the pressure acting on a specific area F on the contact area TR varies, the control device 50 can properly authenticate the user as the person in question by selecting one registered image from multiple registered images while taking into account the acquired pressure information and registered pressure information as described above.

[0112] As described above, in the registration mode and the authentication mode, the image processing circuit 52 generates a biometric information image containing the user's biometric information based on the image of the predetermined part F captured by the optical sensor 40. Furthermore, in the registration mode, the memory circuit 53 stores the biometric information image generated by the image processing circuit 52 and the pressure detected by the pressure sensor 20 when the image of the predetermined part F corresponding to the biometric information image was captured as a registered image and registered pressure information corresponding to the registered image. Furthermore, in the authentication mode, the determination circuit 54 acquires the biometric information image generated by the image processing circuit 52 and the pressure detected by the pressure sensor 20 when the image of the predetermined part F corresponding to the biometric information image was captured as an acquired image and acquired pressure information corresponding to the acquired image, and determines whether the acquired image matches the registered image in consideration of the acquired pressure information and the registered pressure information.

[0113] Although preferred embodiments of the present disclosure have been described above, the present disclosure is not limited to such embodiments. The contents disclosed in the embodiments are merely examples, and various modifications are possible within the scope of the present disclosure. Appropriate modifications made within the scope of the present disclosure also naturally fall within the technical scope of the present disclosure.

[0114] For example, the detection system 1 does not need to include the light source device 30. In this case, external light is reflected at the predetermined portion F and enters the optical sensor 40 as reflected light.

[0115] Furthermore, the pressure detected by the pressure sensor 20 may not be the force per unit area generated by the specific part F contacting the contact area TR, but may be the load (pressure) generated by the specific part F contacting the contact area TR.

[0116] The photodiode PD may also be a PIN (Positive Intrinsic Negative) photodiode.

[0117] The control device 50 may also be configured to register biometric information images and pressure distribution information for multiple people (N people). In this case, when authenticating a user in the authentication mode, the control device 50 may perform one-to-N authentication using the registered images and registered pressure information of the multiple people (N people) stored in the memory circuitry 53. In other words, if the user is included in any of the multiple people (N people) registered, the user is identified as the user corresponding to the identification information.

[0118] 12, if the calculated area is outside the predetermined area range (No in step S13), the control device 50 may issue a warning. Specifically, the control device 50 (display circuit 56) warns the user by displaying a message that the pressing force of the predetermined portion F against the contact portion is inappropriate. The control device 50 may further include a speaker and may warn the user by outputting sound from the speaker.

[0119] 12, when selecting a plurality of pieces of pressure distribution information from the plurality of pieces of acquired pressure distribution information, the control device 50 may select, from the plurality of pieces of acquired pressure distribution information, pressure distribution information in which the proportion of the pressure value range of the pressure distribution information that falls within a predetermined pressure range is equal to or greater than a second predetermined proportion. The second predetermined proportion is a range of pressure values ​​that corresponds to an area in the detection region DR where the determination circuit 54 can appropriately make the above determination.

[0120] Furthermore, in step S3 of FIG. 12, the control device 50 may select, from the acquired plurality of pieces of pressure distribution information, pressure distribution information whose maximum (or median) pressure value is within a predetermined pressure range.

[0121] Furthermore, the control device 50 may select one piece of pressure distribution information from the multiple pieces of pressure distribution information acquired in step S3 of Fig. 12. For example, the control device 50 may select the pressure distribution information in which the area occupied by the predetermined pressure range in the detection region DR is the largest. In this case, the piece of pressure distribution information selected in step S13 corresponds to the piece of registered pressure information shown in step S15 of Fig. 13.

[0122] 13, the control device 50 may determine whether the proportion of the predetermined pressure range in the range of pressure values ​​in the acquired pressure distribution information (acquired pressure information) is equal to or greater than the second predetermined proportion. If the proportion of the predetermined pressure range in the range of pressure values ​​in the acquired pressure information is equal to or greater than the second predetermined proportion (Yes in step S13), the control device 50 causes the program to proceed to step S14. On the other hand, if the proportion of the predetermined pressure range in the range of pressure values ​​in the acquired pressure information is smaller than the second predetermined proportion (No in step S13), the control device 50 returns the program to step S11.

[0123] 13, the control device 50 may calculate the overlap range between the pressure values ​​of the registered pressure information and the pressure values ​​of the acquired pressure distribution information (acquired pressure information) for each of the plurality of registered pressure information, and select the one registered pressure information with the largest overlap range. The control device 50 may also compare the maximum pressure value of the plurality of registered pressure information with the maximum pressure value of the acquired pressure information, and select the registered pressure information having the maximum pressure value closest to the maximum pressure value of the acquired pressure information. The control device 50 may also compare the median pressure value of the plurality of registered pressure information with the median pressure value of the acquired pressure information, and select the registered pressure information having the median pressure value closest to the median pressure value of the acquired pressure information.

[0124] Furthermore, the control device 50 (image processing circuit 52) ​​may correct the acquired image in step S17 of FIG. 13 and determine whether the corrected acquired image matches one registered image. Specifically, the control device 50 first extracts the contour of the predetermined portion F in one registered image selected in step S16 as described above based on the registered pressure information corresponding to the registered image. Next, the control device 50 extracts the contour of the predetermined portion F in the acquired image as described above based on the acquired pressure information. Furthermore, the control device 50 corrects the position and orientation of the predetermined portion F in the acquired image so that the position of the contour of the predetermined portion F in the acquired image matches the contour of the predetermined portion F in one registered image. This causes the position and orientation of the vascular pattern in the acquired image to match the position and orientation of the vascular pattern in one registered image. Therefore, even if there is variation in the position and orientation of the predetermined portion F relative to the contact area TR, the control device 50 (determination circuit 54) can accurately determine whether the acquired image matches one registered image.

[0125] Furthermore, in the registration mode, the control device 50 may generate pressure distribution information having a pressure distribution intermediate between two sets of pressure distribution information selected in step S3 of FIG. 12 based on the two sets of pressure distribution information. In this case, the control device 50 (image processing circuit 52) ​​generates a biometric image having biometric information intermediate between the two sets of biometric information images based on two sets of biometric information images corresponding to the two sets of pressure distribution information. For example, if the control device 50 acquires the first biometric information image G1 shown in FIG. 11A and the third biometric information image G3 shown in FIG. 11C but has not acquired the second biometric information image G2 shown in FIG. 11B, the control device 50 generates the second biometric information image G2 shown in FIG. 11B based on the first biometric information image G1 and the third biometric information image G3. The control device 50 (storage circuit 53) stores the intermediate biometric information image and the intermediate pressure distribution information in association with each other.

[0126] The pressure sensor 20 may also have flexibility such that it deforms when a predetermined portion F comes into contact with the contact region TR. In this case, the array substrate 21, the array electrode 22, and the common electrode 23 have flexibility such that it deforms when a predetermined portion F comes into contact with the contact region TR, and thus the pressure sensor 20 has this flexibility as a whole. In this case, the optical sensor 40 may have relatively high rigidity as a whole, for example, by having the second substrate 41 have relatively high rigidity, or all of the members constituting the optical sensor 40 may have flexibility such that it deforms when a predetermined portion F comes into contact with the contact region TR, thereby having this flexibility as a whole.

[0127] FIG. 14 is a side view of a detection device 10 according to a modified example of an embodiment of the present disclosure. In this modified example, the pressure sensor 20 is disposed on the surface opposite the imaging surface 40a of the optical sensor 40 (i.e., the back surface 40b). In this case, the imaging surface 40a of the optical sensor 40 corresponds to the contact surface 10a of the detection device 10, and the imaging region PR of the optical sensor 40 coincides with the contact region TR of the detection device 10. In this case, the optical sensor 40 may have relatively high rigidity as a whole, for example, by having the second substrate 41 have relatively high rigidity, or all of the components constituting the optical sensor 40 may have flexibility such that they deform when a predetermined portion F comes into contact with the contact region TR, thereby providing the entire sensor with flexibility. In this case, the light source device 30 is disposed on the imaging surface 40a of the optical sensor 40. In this case, the pressure sensor 20 does not need to be translucent. Furthermore, in this case, the pressure sensor 20 may have a relatively high rigidity as a whole, for example, by having the first substrate 21a have a relatively high rigidity, or all of the members constituting the pressure sensor 20 may have flexibility such that they deform when the predetermined portion F comes into contact with the contact region TR. In this way, one of the optical sensor 40 and the pressure sensor 20 may have flexibility such that they deform when the predetermined portion F comes into contact with the contact region TR.

[0128] Fig. 15 is a schematic diagram showing the configuration of a pressure sensor 120 according to a modified example of the present disclosure. Fig. 16 is a cross-sectional view of the pressure sensor 120 shown in Fig. 15. The pressure sensor 120 according to this modified example is a capacitance-type pressure sensor. The pressure sensor 120 detects the presence or absence of pressure in each individual detection area DRa. The pressure sensor 120 includes a third substrate 126 (corresponding to "substrate"), a plurality of electrodes 127, and a third protective layer 128.

[0129] The third substrate 126 has a configuration similar to the first substrate 21a of the pressure sensor 20 of the above embodiment. A shield 126a is disposed on the back surface of the third substrate 126. The shield 126a suppresses the influence of the back surface side of the pressure sensor 120 on the capacitance of the electrode 127. The back surface of the shield 126a corresponds to the back surface 120b of the pressure sensor 120.

[0130] The plurality of electrodes 127 are arranged on the front surface 126b (corresponding to the "second surface") of the third substrate 126. One electrode 127 is arranged in one individual detection region DRa. In other words, the plurality of electrodes 127 are arranged in a matrix in the detection region DR in a plan view. The plurality of electrodes 127 are formed of a conductive material such as ITO.

[0131] The third protective layer 128 is disposed on the front surface 126b side of the third substrate 126, with the adhesive layer OC sandwiched therebetween. The third protective layer 128 is formed in the same manner as the first protective layer 25 of the pressure sensor 20 of the above embodiment. The front surface of the third protective layer 128 corresponds to the detection surface 120a having the detection region DR.

[0132] Furthermore, each of the multiple electrodes 127 is connected to the control device 50 via a signal line (not shown). When the predetermined portion F is not in contact with the detection region DR, the control device 50 detects the capacitance of the electrode 127 in each of the multiple individual detection regions DRa. On the other hand, when the predetermined portion F is in contact with the detection region DR, the capacitance increases in the individual detection region DRa with which the predetermined portion F is in contact. The pressure sensor 120 detects a change in capacitance caused by the predetermined portion F being in contact with the detection region DR. Based on this change in capacitance, the control device 50 identifies the individual detection region DRa with which the predetermined portion F is in contact.

[0133] Furthermore, the greater the pressure acting on the detection region DR when the predetermined site F comes into contact with the detection region DR, the greater the area of ​​the detection region DR that the predetermined site F comes into contact with, and therefore the greater the number of individual detection regions DRa that the predetermined site F comes into contact with. In other words, the control device 50 can calculate and acquire the magnitude of the pressure acting on the detection region DR (i.e., pressure value: equivalent to the pressing force of the predetermined site F per unit area in the detection region DR) based on the number of individual detection regions DRa that the predetermined site F comes into contact with. In other words, the pressure sensor 120 detects the pressure acting on the detection region DR and outputs it to the control device 50 as pressure value information.

[0134] In this modification, the control device 50 selects, from the acquired plurality of pieces of pressure value information, a plurality of pieces of pressure value information whose pressure values ​​are within a predetermined pressure range in step S3 of Fig. 12. Furthermore, in step S6 of Fig. 12, the control device 50 stores the pressure value information selected in step S3 as registered pressure information.

[0135] In this modification, the control device 50 may determine whether the pressure value indicated by the acquired pressure value information (acquired pressure information) is within a predetermined pressure range in step S13 of Fig. 13. If the pressure value indicated by the acquired pressure information is within the predetermined pressure range (Yes in step S13), the control device 50 causes the program to proceed to step S14. On the other hand, if the pressure value of the acquired pressure information is outside the predetermined pressure range (No in step S13), the control device 50 returns the program to step S11.

[0136] In addition, in this modified example, when the control device 50 selects one piece of registered pressure information from multiple pieces of registered pressure information in step S15 of Figure 13, it selects the registered pressure information having a pressure value closest to the pressure value indicated by the acquired pressure information.

[0137] Furthermore, other effects and advantages brought about by the aspects described in the above embodiments that are clear from the description in this specification or that can be appropriately thought of by a person skilled in the art are naturally understood to be brought about by the present disclosure.

[0138] 1 Detection system 10 Detection device 10a Contact surface 20 Pressure sensor 20a Detection surface 21 Array substrate 21c Front surface (first surface) 22 Array electrode 23 Common electrode 24 First sensor layer (sensor layer) 30 Light source device 40 Optical sensor 40a Imaging surface 50 Control device 52 Image processing circuit 53 Memory circuit 54 Determination circuit 120 Pressure sensor 126 Third substrate (substrate) 126b Front surface (second surface) 127 Electrode DR Detection area F Predetermined portion G1 First biometric information image G2 Second biometric information image G3 Third biometric information image G4 Fourth biometric information image G5 Fifth biometric information image PDI Pressure distribution information PR Imaging area TR Contact area

Claims

1. A detection system comprising: a detection device having a contact area that is contacted by a specific part of a user; and a control device operating in an authentication mode to authenticate the user, wherein the detection device comprises: an optical sensor that captures an image of the specific part including a contact area of ​​the specific part that contacts the contact area; and a pressure sensor that detects pressure generated when the specific part contacts the contact area, and the control device comprises: an image processing circuit that generates a biometric image including biometric information of the user based on the image of the specific part captured by the optical sensor; a memory circuit that pre-stores the biometric image and the pressure detected by the pressure sensor when the image of the specific part corresponding to the biometric image is captured as a registered image and registered pressure information corresponding to the registered image, and a determination circuit that, in the authentication mode, acquires the biometric image generated by the image processing circuit and the pressure detected by the pressure sensor when the image of the specific part corresponding to the biometric image is captured as an acquired image and acquired pressure information corresponding to the acquired image, and determines whether the acquired image and the registered image match, taking into account the acquired pressure information and the registered pressure information.

2. The detection system of claim 1, wherein said control device further operates in a registration mode to store said registration image and said registration pressure information of at least one person in said memory circuitry.

3. The detection system of claim 1, wherein the memory circuit stores a plurality of the registered images and the registered pressure information corresponding to the registered images, and the judgment circuit selects one of the plurality of registered images based on the acquired pressure information and judges whether the acquired image matches the one registered image.

4. The detection system according to claim 1, wherein the biometric information is a blood vessel pattern or a fingerprint pattern.

5. The detection system according to claim 1, wherein the determination circuit does not execute the determination when an area occupied by a predetermined pressure range in the contact area for the acquired pressure information is outside a predetermined area range.

6. The detection system according to claim 1, wherein the control device issues a warning when an area occupied by a predetermined pressure range in the contact area for the acquired pressure information falls outside a predetermined area range.

7. The detection system according to claim 1, wherein the detection device further comprises a light source device that emits light toward the predetermined portion.

8. The detection system of claim 1, wherein, in the authentication mode, the image processing circuit: extracts a contour of the specified part in the registered image based on the registered pressure information; extracts a contour of the specified part in the acquired image based on the acquired pressure information; and corrects the position and orientation of the specified part in the acquired image so that the position of the contour of the specified part in the acquired image matches the contour of the specified part in the registered image.

9. The detection system according to claim 1, wherein the pressure sensor has a contact surface including the contact area and is optically transparent, and the optical sensor is disposed on an opposite surface of the pressure sensor opposite to the contact surface.

10. The detection system according to claim 1, wherein one of the optical sensor and the pressure sensor has flexibility such that it deforms when the predetermined portion comes into contact with the contact area.

11. The detection system according to claim 1, wherein the optical sensor includes a plurality of photodiodes arranged in a matrix and overlapping the contact area in a plan view.

12. The detection system according to claim 11, wherein the photodiode is an OPD (Organic Photodiode).

13. The detection system of claim 1, wherein the pressure sensor comprises: an array substrate; a plurality of array electrodes arranged in a matrix on a first surface of the array substrate; a common electrode arranged on the first surface; and a sensor layer facing the first surface, the electrical resistance value of which changes when the specific portion comes into contact with the contact area.

14. The detection system of claim 1, wherein the pressure sensor comprises: a substrate; and a plurality of electrodes arranged in a matrix on a second surface of the substrate; and detects a change in capacitance caused by the specific portion contacting the contact area.

15. A detection device comprising an optical sensor and a pressure sensor with which a specific part of a user comes into direct or indirect contact, the optical sensor having an imaging area for capturing an image of the specific part, the pressure sensor having a detection area for detecting pressure generated by contact with the specific part, the imaging area and the detection area overlap in a planar view, and the timing at which the optical sensor outputs the image and the timing at which the pressure sensor outputs the pressure are synchronized.

16. The detection device according to claim 15, wherein the pressure sensor has a detection surface including the detection region and is optically transparent, and the optical sensor is disposed on a surface of the pressure sensor opposite the detection surface.

17. The detection device according to claim 15, wherein one of the optical sensor and the pressure sensor has flexibility such that it deforms when the predetermined portion comes into contact with the optical sensor.

Images