In-screen fingerprint recognition device and electronic device with liveness detection function

Abstract

The present application provides an in-screen fingerprint recognition device, which is arranged inside a display panel, the display panel includes an upper surface for touch control, the upper surface includes a detection area, and the in-screen fingerprint recognition device includes: fingerprint recognition pixels, which are arranged on the substrate of the display panel, and are used to sense the fingerprint information of the finger through the display panel; and light-sensing pixels, which are arranged on the substrate of the display panel, and are used to sense the spectral information of the detection light returned by the finger through the display panel, and the spectral information is used to determine whether the finger is alive. In addition, the present application also provides an electronic device and a fingerprint recognition method. The technical solution of the present application can effectively improve the security of the under-screen fingerprint application.

Description

Technical Field

[0001] The present application relates to the field of biometric identification technology, and in particular to an in-screen fingerprint identification device and electronic device with a liveness detection function. Background Art

[0002] At present, fingerprint recognition methods include capacitive sensing and optical sensing. Among them, capacitive sensing can distinguish between real fingers and sampled fake fingers through capacitive circuits. Since optical sensing uses optical principles to obtain fingerprint information for feature recognition, it cannot distinguish between real fingers and sampled fake fingers through electrical characteristics. Therefore, compared with capacitive sensing, optical sensing is easier to crack.

[0003] With the popularity of full-screen mobile phones, under-screen fingerprint technology has provided great convenience to users. However, due to the development of counterfeit fingerprint technology, sampling fake fingers can obtain images that are highly similar to real fingers through optical sensing, resulting in greater security risks in under-screen fingerprint applications. Therefore, improving the security of under-screen fingerprint applications is an urgent problem to be solved. Moreover, under-screen fingerprint technology also requires the installation of a detection device for fingerprint recognition under the display screen, which will increase the thickness of the display screen and is not conducive to the thinning of electronic devices. Summary of the invention

[0004] The present application provides an in-screen fingerprint recognition device and an electronic device with a liveness detection function, which can effectively improve the security of fingerprint applications.

[0005] In a first aspect, an embodiment of the present application provides an in-screen fingerprint recognition device, which is arranged inside a display panel, wherein the display panel includes an upper surface for touch control, wherein the upper surface includes a detection area, and the in-screen fingerprint recognition device includes:

[0006] A fingerprint recognition pixel, disposed on the substrate of the display panel, for recognizing fingerprint information of a finger on the detection area according to light reflected from the detection area; and

[0007] The light-sensing pixels are arranged on the substrate of the display panel and are used to sense the spectrum information of the detection light returned by the finger, and the spectrum information is used to determine whether the finger is alive.

[0008] In a second aspect, an embodiment of the present application provides an electronic device, the electronic device comprising:

[0009] A display panel, wherein the display panel includes a detection area, and the detection area is used to contact with a finger to be detected during detection;

[0010] The in-screen fingerprint recognition device as described above, wherein the in-screen fingerprint recognition device is configured on a substrate of the display panel; and

[0011] A processing module is connected to the in-screen fingerprint recognition device and is used to:

[0012] Determining whether the finger is alive according to the sensed spectral information and preset spectral information;

[0013] Determine whether the sensed fingerprint information matches a preset fingerprint information template;

[0014] Whether the identity of the finger is legal is confirmed based on whether the finger is alive and whether the fingerprint information matches a preset fingerprint information template.

[0015] The above-mentioned in-screen fingerprint recognition device and method, as well as the electronic device, use the light-sensing pixels to sense the spectral information of the finger without affecting the original function of the light-sensing pixels, and judge whether the finger is alive through the spectral information, so as to cooperate with the fingerprint recognition pixels to identify the identity of the finger. Among them, the fingerprint information is used to judge whether the finger matches the electronic device, and the spectral information is used to judge whether the finger is alive, such as a human finger. When the fingerprint information matches the preset fingerprint information template and the finger is confirmed to be alive, the identity of the finger is judged to be legal.

[0016] Under the action of the same detection beam, different types of objects will form different spectral information. For example, in the spectral information formed by living and non-living objects under the same detection beam, the proportion of different colors of light is different. Based on this difference, the spectral information can be used to distinguish whether the finger is alive. Therefore, the recognition rate of using spectral information to judge whether the finger is alive is higher. On the basis of fingerprint recognition pixels recognizing fingerprints, using light-sensitive pixels for anti-counterfeiting detection can effectively improve the security of fingerprint applications, and in. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on the structures shown in these drawings without paying any creative work.

[0018] Figure 1 A schematic diagram of the functional modules of an electronic device provided in an embodiment of the present application.

[0019] Figure 2 A three-dimensional diagram of an electronic device provided in an embodiment of the present application.

[0020] Figure 3 Schematic diagram of the optical path of the in-screen fingerprint recognition device under a fake finger provided in an embodiment of the present application.

[0021] Figure 4 Schematic diagram of the optical path of the in-screen fingerprint recognition device under a real finger provided in an embodiment of the present application.

[0022] Figure 5a-5d for Figure 3 The diagram shows the position relationship between fingerprint recognition pixels and light sensing pixels.

[0023] Figure 6a-6c for Figure 3 Another position relationship diagram of the fingerprint recognition pixel and the light sensing pixel is shown.

[0024] The realization of the purpose, functional features and advantages of this application will be further explained in conjunction with embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION

[0025] In order to make the purpose, technical solutions and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not intended to limit the present application. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in the field without making creative work are within the scope of protection of the present application.

[0026] The terms "first", "second", "third", "fourth", etc. (if any) in the specification and claims of this application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate. In other words, the described embodiments are implemented according to a sequence other than that illustrated or described herein. In addition, the terms "including" and "having" and any of their variations may also include other content. For example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to only those steps or units that are clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0027] It should be noted that the descriptions involving "first", "second", etc. in this application are only for descriptive purposes and cannot be understood as indicating or implying their relative importance or implicitly indicating the number of technical features indicated. Therefore, the features defined as "first" and "second" may explicitly or implicitly include one or more of the features. In addition, the technical solutions between the various embodiments can be combined with each other, but they must be based on the ability of ordinary technicians in this field to implement them. When the combination of technical solutions is contradictory or cannot be implemented, it should be deemed that such combination of technical solutions does not exist and is not within the scope of protection required by this application.

[0028] It should be understood that the embodiments of the present application can be applied to fingerprint recognition systems based on optical sensing technology, such as optical fingerprint recognition systems or other optical systems based on optical sensing technology. The embodiments of the present application are described using the optical fingerprint system as an example, but are also applicable to other systems based on optical sensing technology, such as medical diagnostic products using optical fingerprint sensing.

[0029] As a common application scenario, the in-screen fingerprint recognition device of the embodiment of the present application can be applied to smart phones, tablet computers, smart door locks and other electronic devices with display panels. More specifically, in the above electronic devices, the in-screen fingerprint recognition device can be set in a partial area or the entire area below the display panel, thereby forming an inner-display fingerprint system.

[0030] Figure 1 A schematic diagram of functional modules of an electronic device to which the embodiments of the present application can be applied is shown. Figure 2 FIG. 1 shows a three-dimensional diagram of an electronic device provided by an embodiment of the present application. Figure 1 and Figure 2 As shown, the electronic device 1000 has a display panel 300, and the display panel 300 includes a detection area 310, for example, but not limited to, the detection area 310 is formed on the outer surface of the display panel. The detection area 310 is used to contact with a finger F, such as a finger, during detection. The detection area 310 can be configured to be located at any position on the upper surface of the display panel 300 or at the side of the display panel 300. The in-screen fingerprint recognition device 100 is arranged below the display panel 300, and the specific position of the in-screen fingerprint recognition device 100 can be opposite to the detection area 310, or can be staggered with the detection area 310. When the positions of the in-screen fingerprint recognition device 100 and the detection area 310 are staggered, at least part of the optical signal returned through the detection area 310 can be guided to the in-screen fingerprint recognition device 100 for detection by an optical path design between the detection area 310 and the in-screen fingerprint recognition device 100.

[0031] The in-screen fingerprint recognition device 100 based on optical sensing technology obtains the fingerprint image by obtaining the light returned by the finger, and cannot distinguish the authenticity of the fingerprint through electrical characteristics, so it is more vulnerable to attacks by fake fingers. Based on this, the present application aims to provide an in-screen fingerprint recognition device based on optical sensing technology, which can also distinguish the authenticity of the tested finger when recognizing fingerprint information.

[0032] Figure 3 and Figure 4 FIG. 1 is a schematic diagram showing the optical path of the in-screen fingerprint recognition device 100 of an embodiment of the present application. Figure 3The in-screen fingerprint recognition device 100 includes a fingerprint recognition pixel 10 and a light-sensing pixel 20. The fingerprint recognition pixel 10 is configured on the substrate of the display panel 300, and is used to sense the fingerprint information of the finger F through the display panel 300. The light-sensing pixel 20 is configured on the substrate of the display panel 300, and is used to sense the spectrum information of the detection light returned by the finger F through the display panel 300. The spectrum information of the finger F can be used to determine whether the finger F is alive.

[0033] It should be understood that in the embodiment of the present application, the finger F is used as an example for illustration, but the same is true for palm prints, blood vessels or other objects with biological characteristics. Figure 3 As shown, if the finger F is a fake finger with no blood vessels inside, the light emitted by the light emitting unit 301 will not be reflected after entering the fake finger due to the lack of blood vessels, but will be scattered inside the fake finger and disappear. At this time, the light sensing pixel 20 will not receive the light. Figure 4 As shown, if the finger F is a real finger, the blood vessels inside it will reflect the light emitted by the light-emitting unit 30 back to the light-sensitive pixel 20 for reception.

[0034] It should be understood that the spectral information of the finger F is, for example, the reflection spectral information of the reflected light formed on the surface of the finger F or the scattering spectral information of the scattered light formed by scattering inside the finger F. For the sake of convenience of description, the reflection spectral information formed by the reflected light and the scattering spectral information formed by the scattered light are both described as spectral information.

[0035] Under the action of the same detection light beam, different types of objects will form different spectral information. For example, in the spectral information formed by living and non-living objects under the same detection light beam, the proportion of different colors of light is different. Based on this difference, it is possible to distinguish whether the finger F is a living object through the spectral information. Specifically, the fingerprint information combined with the spectral information can be used to determine whether the identity of the finger F is legal, wherein, when the fingerprint information matches the preset fingerprint information template, and the spectral information of the finger F confirms that the finger F is a living object, the identity of the finger is determined to be legal. Therefore, by confirming whether the finger F is a living object, it can assist in distinguishing the authenticity of the fingerprint information during fingerprint recognition to improve security.

[0036] In an optional embodiment, the above-mentioned program for determining whether the identity of the finger F is legal can be executed by a processor, and the processor can be selected as a processor of the in-screen fingerprint recognition device, such as a microcontroller (Micro Control Unit, MCU), which is used to process or analyze the information obtained by the fingerprint recognition pixels and / or light-sensitive pixels and control the operation of the fingerprint recognition pixels and / or light-sensitive pixels; or, the processor can also be a processor in an electronic device, such as a main control (HOST) module.

[0037] Figure 4 The structure diagram of the in-screen fingerprint recognition device 100 of the embodiment of the present application is shown in FIG. Figure 3 The in-screen fingerprint recognition device 100 according to an embodiment of the present application is described.

[0038] The fingerprint recognition pixel 10 and the light sensing pixel 20 are arranged side by side below the display panel 300. Optionally, the orthographic projections of the fingerprint recognition pixel 10 and the light sensing pixel 20 on the display panel 300 are located within the detection area 310.

[0039] It can be understood that when performing fingerprint recognition, the finger F contacts the detection area 310, and the fingerprint recognition pixel 10 and the light-sensitive pixel 20 respectively sense part of the detection light returned through the finger F, and then respectively collect the fingerprint information and spectral information of the finger F. When the fingerprint recognition pixel 10 and the light-sensitive pixel 20 are configured at the position of this embodiment, the optical path between the detection area 310 and the in-screen fingerprint recognition device 100 is simplified, and the complexity of the optical system will be significantly reduced.

[0040] It should be noted that if some simple adjustments are made to the positions of the fingerprint recognition pixel 10 and the light-sensing pixel 20, for example: the positive projections of the fingerprint recognition pixel 10 and the light-sensing pixel 20 on the detection area 310 are made slightly larger than the detection area 310, or the fingerprint recognition pixel 10 and / or the light-sensing pixel 20 are slightly staggered relative to the detection area 310, as well as other adjustments mainly made using the concepts of the embodiments of the present application, these should be within the scope of protection of the present application.

[0041] Optionally, when the in-screen fingerprint recognition device 100 is applied under the display panel 300 , the fingerprint recognition pixel 10 and the light-sensing pixel 20 may have a certain distance from the display panel 300 .

[0042] To this end, in an optional embodiment of the present application, a cavity is opened in the in-screen fingerprint recognition device 100, and the cavity is configured below the detection area 310, and the fingerprint recognition pixel 10 and the light-sensing pixel 20 are both arranged in the same cavity.

[0043] In another optional embodiment of the present application, a first cavity 410 and a second cavity 420 are respectively provided in the in-screen fingerprint recognition device 100, and the first cavity 410 and the second cavity 420 are both arranged below the detection area 310, the fingerprint recognition pixel 10 is arranged in the first cavity 410, and the light-sensing pixel 20 is arranged in the second cavity 420. The first cavity 410 and the second cavity 420 are configured to be separated from each other to reduce the optical crosstalk between the fingerprint recognition pixel 10 and the light-sensing pixel 20, which is beneficial to improve the quality of sensing.

[0044] Specifically, in some embodiments, the in-screen fingerprint recognition device 100 further includes a circuit board 110 and a spacer layer 120 disposed on the circuit board 110. The fingerprint recognition pixel 10 and the light-sensing pixel 20 are disposed on the circuit board 110 and can be electrically connected to the outside through the circuit board 110. The spacer layer 120 is provided with the cavity corresponding to the position of the fingerprint recognition pixel 10 and the light-sensing pixel 20 on the circuit board 110, and the fingerprint module 10 and the light-sensing pixel 20 are located in the cavity. When the in-screen fingerprint recognition device 100 is applied below the display panel 300, the side surface of the spacer layer 120 away from the circuit board 110 abuts against the bottom surface of the display panel 300 facing the in-screen fingerprint recognition device 100. Optionally, the spacer layer 120 is made of a soft material to buffer and protect the in-screen fingerprint recognition device 100. Optionally, the spacer layer 120 may be opaque. The spacer layer 120 may be, for example, foam.

[0045] It can be understood that, in some embodiments, if there is a certain distance between the fingerprint recognition pixel 10 and the light-sensing pixel 20 and the display panel 300, the thickness of the spacer layer 120 is greater than the thickness of the fingerprint recognition pixel 10 and the light-sensing pixel 20, so that when the spacer layer 120 is against the display panel 300, there is still a certain distance between the fingerprint recognition pixel 10 and the light-sensing pixel 20 and the display panel 300.

[0046] It is understandable that in some other embodiments, the fingerprint recognition pixel 10 and / or the light-sensing pixel 20 may also be in direct contact with the display panel 300 . In this case, the thickness of the spacer layer 120 is equivalent to the thickness of the fingerprint recognition pixel 10 and / or the light-sensing pixel 20 .

[0047] It should be understood that the number of fingerprint recognition pixels 10 is not limited to one, but may be two or more, and the number of light-sensing pixels 20 is not limited to one, but may be two or more, and this application does not limit this. For example, the fingerprint recognition pixel 10 and the light-sensing pixel 20 are both one, and the light-sensing pixel 20 can be located below the fingerprint recognition pixel 10 (e.g. Figure 5a The light-sensing pixel 20 may be located above the fingerprint recognition pixel 10 (as shown); Figure 5b The light-sensing pixel 20 may be located to the left of the fingerprint recognition pixel 10 (as shown); Figure 5c The light-sensing pixel 20 may be located to the right of the fingerprint recognition pixel 10 (as shown); Figure 5dAs shown); the fingerprint recognition pixel 10 and the light-sensing pixel 20 may also be arranged in other suitable ways, which is not limited in this application. Taking the example of one fingerprint recognition pixel 10 and multiple light-sensing pixels 20, the multiple light-sensing pixels 20 may, for example, surround the fingerprint recognition pixel 20, or the multiple light-sensing pixels 20 and the fingerprint recognition pixel 10 may be arranged side by side, or in other suitable ways, which is not limited in this application. For example, there is one fingerprint recognition pixel 10 and two light-sensing pixels 20, and the two light-sensing pixels 20 may be located above and below the fingerprint recognition pixel 10, respectively (as shown in FIG. 1 ). Figure 6a The two light-sensing pixels 20 may be located on the left and right of the fingerprint recognition pixel 10, respectively (as shown in FIG. Figure 6b The two light-sensing pixels 20 can be arranged below the fingerprint recognition pixel 10 at intervals (as shown); Figure 6c shown).

[0048] In the embodiment of the present application, the distance D between the fingerprint recognition pixel 10 and the photosensitive pixel 20 has a value range of 0 to 10 mm. In order to facilitate full finger pressing, the detection area 310 has an area covering, for example, an area of ​​10 mm × 10 mm. The distance D between the fingerprint recognition pixel 10 and the photosensitive pixel 20 can ensure that good fingerprint information and spectral information can be collected. When the value of the distance D is 0 mm, the fingerprint recognition pixel 10 and the photosensitive pixel 20 are adjacently arranged; when the value of the distance D is greater than 0 mm, the fingerprint recognition pixel 10 and the photosensitive pixel 20 are spaced apart. Optionally, in some embodiments, the distance D has a value range of 0 to 7 mm. That is to say, when the fingerprint recognition pixel 10 and the photosensitive pixel 20 are spaced apart, the maximum distance between the two closest sides of the fingerprint recognition pixel 10 and the photosensitive pixel 20 does not exceed 7 mm.

[0049] In some embodiments, a light-emitting unit 30 may be configured in the in-screen fingerprint recognition device 100 or the electronic device 1000 to which the in-screen fingerprint recognition device 100 is applied to project detection light to the finger F. The detection light is returned by the finger F and sensed by the fingerprint recognition pixel 10 and the light-sensing pixel 20.

[0050] In one embodiment of the present application, the in-screen fingerprint recognition device 100 further includes a light emitting unit 30, which is used to project detection light to the finger F during detection to illuminate the finger F. The fingerprint recognition pixel 10 is used to receive the detection light returned by the finger F to sense the fingerprint information of the finger F, and the light-sensing pixel 20 is used to receive the detection light reflected by the finger F to sense the spectral information of the finger F. In this embodiment, the light emitting unit 30 can be integrated in the fingerprint recognition pixel 10, or can be integrated in the light-sensing pixel 20, or can be configured in the in-screen fingerprint recognition device 100 independently of the fingerprint recognition pixel 10 and the light-sensing pixel 20, and the present application does not limit this. The light emitting unit 30 can be one, that is, the detection light projected by one light emitting unit 30 is received by the fingerprint recognition pixel 10 and the light-sensing pixel 20 respectively after being returned by the finger F. The light emitting unit 30 can also be two or even more, that is, two or more light emitting units 30 respectively project detection light to the finger F, and the detection light returned by the finger F is received by the fingerprint recognition pixel 10 and the light-sensing pixel 20 respectively.

[0051] In another embodiment of the present application, the light-emitting unit 30 is configured in other parts of the electronic device except for the in-screen fingerprint recognition device 100. When identifying fingerprint information, the light-emitting unit 30 cooperates with the fingerprint recognition pixel 10 and the light-sensing pixel 20 to perform sensing. For example, during detection, the electronic device 1000 or specifically the processor of the electronic device 1000 controls the light-emitting unit 30 to project detection light to the finger F, and the fingerprint recognition pixel 10 and the light-sensing pixel 20 respectively receive the detection light returned by the finger F to respectively sense the fingerprint information and spectral information.

[0052] The type of the display panel 300 is an important reference factor when considering how to configure the light emitting unit 30. The embodiments of the present application are mainly described in three cases where the display panel 300 is a self-luminous display panel, a passive light emitting display panel, and a transparent cover plate.

[0053] If the display panel 300 is a self-luminous display panel, for example, the display panel 300 is an organic light emitting display panel (OLED Panel), a sub-millimeter light emitting diode display panel (Mini-LED Display Panel), or a micro-LED display panel (Micro-LED Display Panel), in some examples, it can be selected that: when the finger F contacts the detection area 310, the display panel 300 emits detection light to illuminate the finger F, the fingerprint recognition pixel 10 receives the detection light returned from the finger F to sense the fingerprint information of the finger F, and the light-sensitive pixel 20 receives the detection light reflected from the finger F to sense the spectral information of the finger F.

[0054] like Figure 4 As shown, in some embodiments, the OLED panel 300 has a display unit 301 for emitting display light inside, and the display unit 301 can be driven to emit display light to display the picture, so that the area on the OLED panel 300 corresponding to the display unit 301 is the display area. Since the OLED panel 300 can transmit part of the visible light, the detection area 310 can be located in the display area of ​​the OLED panel 300. Therefore, in this embodiment, the display unit 301 in the OLED panel 300 can be selected as the above-mentioned light-emitting unit 30 to illuminate the detection area 310 during detection (i.e., project the detection light to the finger F). Specifically, for example, when the finger F contacts the detection area 310, the display unit 301 corresponding to the detection area 310 is driven to project the detection light to the finger F.

[0055] If the display panel 300 is a passive light-emitting display panel, for example, the display panel 300 is a liquid crystal display (LCD) panel. Since the passive light-emitting display panel itself cannot emit light, an additional light-emitting unit 30 can be configured to project detection light to the finger F. The additional light-emitting unit 30 can be configured in the in-screen fingerprint recognition device 100, for example; or, the additional light-emitting unit 30 can be configured in other locations in the electronic device 1000 except the in-screen fingerprint recognition device 100; or, the additional light-emitting unit 30 can be selected as an external type independent of the electronic device 1000.

[0056] In a specific example of the present application, if the display panel 300 is a passive light-emitting display panel, the light-emitting unit 30 is configured in the in-screen fingerprint recognition device 100. That is, the in-screen fingerprint recognition device 100 also includes a light-emitting unit 30. The light-emitting unit 30 is used to project detection light to the finger F to illuminate the finger F during detection. The fingerprint recognition pixel 10 is used to receive the detection light returned by the finger F to sense the fingerprint information of the finger F. The photosensitive pixel 20 is used to receive the detection light reflected by the finger F to sense the spectral information of the finger F. Optionally, in some embodiments, the light-emitting unit 30 can be a light-emitting module having one or more light-emitting units, and the light-emitting unit 30 can be set on the same circuit board 110 with the fingerprint recognition pixel 10 and the photosensitive pixel 20, and is located in a cavity correspondingly opened on the spacer layer 120.

[0057] If the display panel 300 is a light-transmitting cover plate, the light-transmitting cover plate itself does not emit light, and an additional light-emitting unit 30 may be configured, for example, in the in-screen fingerprint recognition device 100, or in other locations in the electronic device 1000 other than the in-screen fingerprint recognition device 100, or an external light-emitting unit 30 may be configured. Optionally, in some embodiments, the light-transmitting cover plate may be made of a light-transmitting material, such as but not limited to glass or resin.

[0058] Optionally, in some embodiments, in order to avoid seeing the in-screen fingerprint recognition device 100 under the transparent cover from the outside, a shielding film layer that can block visible light but transmit the detection light can also be provided at the surface of the transparent cover corresponding to the in-screen fingerprint recognition device 100. In this case, the detection light emitted by the light-emitting unit 30 can be non-visible light, so that it can be sensed through the shielding film layer. For example: the detection light emitted by the light-emitting unit 30 is infrared or near-infrared light, and the shielding film layer is infrared ink that can transmit infrared light but block visible light.

[0059] Different types of display panels 300 have different transmittances to visible light, and the detection light projected by the light-emitting unit 30 is also different accordingly. For example, the OLED panel 300 can transmit visible light, and thus the detection light projected by the light-emitting unit 30 can be selected to be, for example, visible light, infrared light, near-infrared light, or light of other wavelengths. The LCD panel is not transparent to visible light, and thus the detection light projected by the light-emitting unit 30 can be selected to be, for example, infrared light, near-infrared light, or other transparent light. The light-transmitting cover plate can transmit visible light, and the detection light projected by the light-emitting unit 30 can be, for example, visible light, infrared light, near-infrared light, or light of other wavelengths. However, considering that the shielding film layer is provided on the light-transmitting cover plate, the detection light projected by the light-emitting unit 30 is infrared light, near-infrared light, or other non-visible light.

[0060] In an optional embodiment of the present application, the fingerprint recognition pixel 10 and the light-sensing pixel 20 can be selected to work simultaneously, or can be selected to work in time-sharing. The fingerprint recognition pixel 10 and the light-sensing pixel 20 correspond to different areas in the detection area 310, respectively. When configuring the detection area 310, the detection area 310 can be further divided. For example, in an example of the present application, the detection area 310 includes a first sub-detection area 311 and a second sub-detection area 312, the first sub-detection area 311 corresponds to the fingerprint recognition pixel 10, and the second sub-detection area 312 corresponds to the light-sensing pixel 20; or in some embodiments, the first sub-detection area 311 corresponds to the first cavity 410, and the second sub-detection area 312 corresponds to the second cavity 420. It can be understood that the size of the first cavity 410 can be comparable to or larger than the first sub-detection area 311, the size of the second cavity 420 can be comparable to or larger than the second sub-detection area 312, and the positions of the fingerprint recognition pixel 10 and the light-sensing pixel 20 in their respective corresponding cavities can be directly opposite to their respective corresponding sub-detection areas, or can be staggered with their respective corresponding sub-detection areas, as long as the detection light returned by the finger F can be received by the fingerprint recognition pixel 10 and the light-sensing pixel 20 accordingly.

[0061] Based on the above configuration of the detection area 310, the first sub-detection area 311 and the second sub-detection area 312 may have different working modes. For example, the first sub-detection area 311 and the second sub-detection area 312 are illuminated at the same time, that is, the detection light projected by the light-emitting unit 30 simultaneously passes through the first sub-detection area 311 and the second sub-detection area 312 to illuminate the finger F in contact therewith; or, the first sub-detection area 311 and the second sub-detection area 312 are illuminated in time division. For an OLED panel, it is sufficient to control the operation of the display unit 301 corresponding to the OLED panel. For other types of panels, the first sub-detection area 311 and the second sub-detection area 312 can be illuminated in time division by controlling the corresponding multiple light-emitting units 30, or by adjusting the projection position of the detection light of the same light-emitting unit 30.

[0062] Equipped with a suitable display panel 300 and a light-emitting unit 30, during detection, when the finger F contacts the detection area 310, the light-emitting unit 30 projects a suitable detection light to the finger F, and after the detection light is projected onto the finger F through the detection area 310, it passes through the finger F and passes through the detection area 310 and returns to the in-screen fingerprint recognition device 100. Among them, the fingerprint recognition pixel 10 receives the detection light returned from the finger F to sense the fingerprint information of the finger F, and the fingerprint information is used to compare with the preset fingerprint information template to determine the identity of the finger F. The light-sensing pixel 20 receives the detection light returned from the finger F to sense the spectral information of the finger F, and the spectral information is used to compare with the preset spectral information to determine whether the finger F is alive. When the fingerprint information matches the preset spectral information, it is confirmed that the finger F is alive. When the fingerprint information matches the preset fingerprint information template and the finger F has been confirmed to be alive, the identity of the finger F can be confirmed to be legal.

[0063] The principle of the light-sensing pixel 20 sensing the spectral information of the finger F is described in detail below.

[0064] The light-sensing pixel 20 includes a spectral channel, which is used to collect light signals of a preset frequency band in the detection light returned by the finger F, and output an electrical signal corresponding to the energy of the light signals of the preset frequency band.

[0065] Taking the red light channel as an example, the red light channel can filter out light signals of other color bands except the red color band in the collected detection light, and allow the red light signal to pass through. The red band light signal is captured in the red light channel, and the red light channel converts the captured red band light signal into a corresponding electrical signal. The output electrical signal is related to the energy of the red light signal. If the energy of the red band light signal in the spectral information formed by the returned detection light of the finger is different from that of other non-living objects, it can be used to distinguish whether the finger F is alive.

[0066] Studies have shown that the reflection performance of human skin tissue to some wavelengths of light is significantly different from that of non-living materials such as silicone and paper, which may be affected by factors such as the thickness of the skin layer, hemoglobin concentration, and melanin content of human skin tissue. Therefore, based on the difference between the light signal reflected by the finger and the light signal reflected by the non-living object, it is possible to identify whether the finger F is alive.

[0067] Generally speaking, a single spectral channel can identify most non-living objects, but there are still a small amount of materials whose spectral information in a single color band is very close to that of a finger. To this end, in an optional embodiment, the light-sensitive pixel 20 includes multiple spectral channels, and the multiple spectral channels respectively collect light signals in different preset frequency bands, and output electrical signals corresponding to the energy of the light signals in the preset frequency bands as the spectral information. The embodiment of the present application uses the proportion of energy in different preset frequency bands in the spectral information of the finger F to determine whether the finger F is a living object. The use of multiple spectral channels can effectively solve the problem that the spectral information of some materials in a single color band is close to that of the finger and is difficult to distinguish, thereby improving the accuracy of recognition.

[0068] Optionally, in some embodiments, there should be at least two types of spectral channels. When there are two spectral channels, they can be selected as a blue light channel and a red light channel, or other light channels. Increasing the types of spectral channels can improve the accuracy of identifying non-living objects, but it will increase the amount of calculation and the physical structure will be more complicated. Therefore, in practice, the selection can be considered based on the application scenario.

[0069] In some embodiments of the present application, the light-sensitive pixel 20 includes a red light channel, a green light channel, and a blue light channel, wherein the red light channel is used to collect red light signals and output electrical signals corresponding to the energy of the red light signals, the green light channel is used to collect green light signals and output electrical signals corresponding to the energy of the green light signals, and the blue light channel is used to collect blue light signals and output electrical signals corresponding to the energy of the blue light signals. The red, green, and blue spectral information of the finger F acquired by the light-sensitive pixel can be used to compare with the preset spectral information to determine whether the finger F is a living body. It is understandable that the comparison content between the acquired spectral information of the finger F and the preset spectral information can include the spectral value or value range of a single color and the spectral value ratio of multiple different colors, and can also include other content that can reflect the difference in spectral information between a living body and a non-living body, and the present application does not limit this.

[0070] When the display panel 300 cannot transmit visible light, the type of spectral channel can be selected from invisible light, such as an infrared spectral channel, and the light-emitting unit 30 is configured to project corresponding detection light including the invisible light to the finger F. When the display panel 300 can transmit visible light, the type of spectral channel can be selected from visible light and invisible light, or can include both visible light and invisible light, and the light-emitting unit 30 can be configured accordingly.

[0071] For the light-sensitive pixel 20, in some embodiments, the light-sensitive pixel 20 may include one or more light-sensitive pixels, one of which may form the above-mentioned multiple spectral channels, such as a red light channel, a green light channel, a blue light channel, an infrared spectral channel, etc. Thus, one or more pixels on the light-sensitive pixel 20 may be configured to sense the spectral information of the finger F, so as to distinguish whether the finger F is alive. It is understandable that, in some other embodiments, the spectral channel on the light-sensitive pixel 20 may also be used to obtain the spectral information of other light signals for analysis to realize the corresponding control function. For example, but not limited to, the spectral channel on the light-sensitive pixel is also used to obtain the spectral information of the ambient light, so as to obtain the light intensity and color temperature value of the ambient light after analysis, and then the brightness and color temperature of the display may be adjusted accordingly, or proximity sensing may be realized according to the change of the light intensity of the ambient light.

[0072] Therefore, in the embodiment of the present application, the light-sensing pixel 20 and the fingerprint recognition pixel 10 are integrated under the same detection area 310 of the display panel 300. Without adding additional devices, the light-sensing pixel 20 is used to obtain the spectral information of the finger F to introduce the function of distinguishing whether the finger F is alive in the fingerprint recognition, which not only improves the accuracy and security of fingerprint recognition, but also avoids increasing the overall cost. Moreover, the light-sensing pixel 20 and the fingerprint module 10 are arranged under the display panel 300, which can avoid competing with the display panel 300 for the front area of ​​the electronic device 1000 as much as possible, which is conducive to improving the aesthetics of the overall design.

[0073] The above describes the in-screen fingerprint recognition device of the embodiment of the present application in detail. The working process thereof is described below to help further understand the in-screen fingerprint recognition device of the embodiment of the present application.

[0074] When the finger F contacts the detection area 310, the processor controls the display panel 300 or the light-emitting unit 30 to project detection light to the finger F. The fingerprint recognition pixel 10 receives the detection light returned by the finger F to sense the fingerprint information of the finger F. The processor matches the sensed fingerprint information with the pre-stored fingerprint information template. If the match is successful, the fingerprint information is legal. If the match fails, the fingerprint information is illegal. It can be confirmed whether the identity of the finger F is legal. The light-sensing pixel 20 receives the detection light reflected by the finger F to sense the spectral information of the finger F. The processor matches the sensed spectral information with the pre-stored spectral information. If the match is successful, it is confirmed that the finger F is alive. If the match fails, it is confirmed that the finger F is not alive. It can be confirmed whether the finger F is alive. When the fingerprint information is legal and the finger F is alive, the identity of the finger F is confirmed to be legal.

[0075] Fingerprint recognition and liveness recognition can be executed simultaneously or in different time periods, for example, fingerprint recognition can be executed first and then liveness recognition, or liveness recognition can be executed first and then fingerprint recognition. Different execution modes have positive application significance for different application scenarios. For example, when fingerprint recognition and liveness recognition are executed simultaneously, the amount of data processed is large and the resources occupied are high, but the recognition process takes a short time, which is suitable for occasions requiring fast processing; when fingerprint recognition and liveness recognition are executed in different time periods, if the matching of the first recognition process fails, there is no need to proceed to the next recognition process, which can reduce the amount of data processed and reduce resource occupation.

[0076] When fingerprint recognition and liveness recognition are performed in time-sharing, the detection area 310 can be irradiated simultaneously or in time-sharing, for example, the first sub-detection area 311 and the second sub-detection area 312 are irradiated in time-sharing, or the first sub-detection area 311 and the second sub-detection area 312 are irradiated simultaneously. When fingerprint recognition is performed first, the first sub-detection area 311 can be controlled to be irradiated first, or the detection light is projected to the finger F through the first sub-detection area 311 first, and when liveness recognition is performed after the fingerprint recognition is completed, the second sub-detection area 312 is irradiated, or the detection light is projected to the finger F through the second sub-detection area 312. Similarly, when liveness recognition is performed first, the second sub-detection area 312 is irradiated first, or the detection light is projected to the finger F through the second sub-detection area 312 first, and the first sub-detection area 311 is irradiated or the detection light is projected to the finger F through the first sub-detection area 311 when fingerprint recognition is performed later.

[0077] In addition to identifying whether the finger F is alive during the fingerprint recognition process, the light-sensing pixel 20 can also sense relevant information of the external ambient light for reference by the electronic device 1000 for making corresponding adjustments. The sensing process can be performed when fingerprint recognition is being performed or when fingerprint recognition is not being performed. When the fingerprint recognition process is performed simultaneously, the relevant information of the sensed external ambient light, such as light intensity value, color temperature value, whether there is a target approaching, etc., can also be used to further provide external environment parameter information for fingerprint recognition, so as to more accurately identify the finger F.

[0078] The embodiment of the present application also provides an electronic device 1000, which includes a display panel 300, an in-screen fingerprint recognition device 100 and a processing module 500. The display panel 300 includes a detection area 310, and the detection area 310 is used to contact the finger F under detection during detection; the in-screen fingerprint recognition device 100 can be the in-screen fingerprint recognition device 100 described in the above embodiment, wherein the in-screen fingerprint recognition device 100 is configured below the display panel 300, and the processing module 500 is used to: confirm whether the finger is alive based on the sensed spectral information and the preset spectral information; determine whether the sensed fingerprint information matches the preset fingerprint information template; and confirm whether the identity of the finger F is legal based on whether the finger F is alive and whether the fingerprint information matches the preset fingerprint information template.

[0079] In the embodiment of the present application, the electronic device 1000 is, for example, a portable electronic product, a home electronic product, a vehicle-mounted electronic product, or other suitable types of electronic products. The portable electronic product may be a mobile terminal, such as a mobile phone, a tablet computer, a laptop computer, a wearable product, or other suitable types of electronic products; the home electronic product may be a smart door lock, a television, a refrigerator, a desktop computer, or other suitable types of electronic products; the vehicle-mounted electronic product may be a vehicle-mounted navigation system, a vehicle-mounted DVD, or other suitable types of electronic products.

[0080] Specifically, in some embodiments, the display panel 300 is, for example, a self-luminous display panel or a passively luminous display panel. The electronic device 1000 may be an electronic device equipped with a display device, such as a mobile phone, a display, a smart watch, a tablet computer, or a laptop computer. Optionally, in some other embodiments, the display panel 300 may be a light-transmitting cover plate without a display function, the electronic device 1000 may be a smart door lock, the display panel 300 is a glass cover plate of the smart door lock, and the in-screen fingerprint recognition device 100 is arranged under the glass cover plate, so that a fingerprint recognition function capable of identifying a living body can be provided without opening a hole in the glass cover plate.

[0081] In some embodiments, the processing module 500 is, for example, a processor, which can be selected as a processor of an in-screen fingerprint recognition device, such as a microcontroller (MCU), for processing or analyzing the information obtained by the fingerprint recognition pixels and / or light-sensitive pixels and controlling the operation of the fingerprint recognition pixels, light-sensitive pixels and / or light-emitting units; or, the processor can also be a processor in an electronic device, such as a host control (HOST) module.

[0082] It should be understood that the processor of the embodiment of the present application may be an integrated circuit chip with signal processing capabilities. In the implementation process, the above-mentioned related steps may be completed by instructions formed by the integrated logic circuit of the hardware or software in the processor. The processor may be a general-purpose processor, a digital signal processor, an application-specific integrated circuit, a readily available programmable gate array or other programmable logic device, a discrete gate or transistor logic device, or a discrete hardware component. The disclosed steps in the embodiment of the present application may be implemented or executed. The general-purpose processor may be a microprocessor or the processor may also be any conventional processor, etc. The in-screen fingerprint recognition device of the embodiment of the present application may also include a memory, which may be a volatile memory or a non-volatile memory, or may include a volatile and non-volatile memory.

[0083] Optionally, the display panel 300 is a self-luminous display panel, and the processing module 500 is further used to control the display panel 300 to illuminate the detection area 310 when the finger F contacts the detection area 310 , so as to emit detection light to illuminate the finger F.

[0084] Optionally, the electronic device 1000 further includes a touch detection module 600 electrically connected to the processing module 500. The touch detection module 600 is used to detect whether the finger F contacts the detection area 310. When the finger F contacts the detection area 310, the touch detection module 600 generates a touch signal and sends the touch signal to the processing module 500. In some embodiments, the touch detection module 600 includes but is not limited to a pressure sensor, a capacitive touch sensor, a resistive touch sensor, an infrared touch sensor, and a surface acoustic wave touch sensor. The touch detection module 600 can be a touch detection module of an in-screen fingerprint recognition device, a touch detection module in an electronic device, or a touch detection module of an in-screen fingerprint recognition device and an electronic device.

[0085] Optionally, the processing module 500 first determines whether the finger is alive according to the sensed spectral information and then controls the fingerprint recognition pixel 10 to sense the fingerprint information of the finger F.

[0086] It should be understood that the type of display panel 300 and the processing flow of the processing module are only optional examples of the present application, and do not limit the electronic device to be configured only in the above form. With reference to the description of the in-screen fingerprint recognition device above, it can be understood that other forms of configuration can also be applied to the electronic device of the embodiment of the present application.

[0087] Obviously, those skilled in the art can make various changes and modifications to the present application without departing from the spirit and scope of the present application. Thus, if these modifications and variations of the present application fall within the scope of the claims of the present application and their equivalents, the present application is also intended to include these modifications and variations.

[0088] The above examples are only preferred embodiments of the present application, and certainly cannot be used to limit the scope of rights of the present application. Therefore, equivalent changes made according to the claims of the present application still fall within the scope covered by the present application.

Claims

1. An in-screen fingerprint recognition device with a liveness detection function, characterized in that: The display panel includes an upper surface for touch control, the upper surface includes a detection area, and the in-screen fingerprint recognition device includes: A fingerprint recognition pixel, disposed on the substrate of the display panel, for recognizing fingerprint information of a finger on the detection area according to light reflected from the detection area; and The light-sensing pixels are arranged on the substrate of the display panel and are used to sense the spectrum information of the detection light returned by the finger, and the spectrum information is used to determine whether the finger is alive.

2. The in-screen fingerprint recognition device according to claim 1, characterized in that: The fingerprint information and the spectral information are used to determine whether the identity of the finger is legal. When the fingerprint information matches a preset fingerprint information template and the finger is confirmed to be alive through the spectral information of the finger, the identity of the finger is determined to be legal.

3. The in-screen fingerprint recognition device according to claim 1, characterized in that: The fingerprint recognition pixel and the light sensing pixel are arranged side by side on a substrate of the display panel, wherein the orthographic projections of the fingerprint recognition pixel and the light sensing pixel on the substrate are located within the detection area.

4. The in-screen fingerprint recognition device according to claim 1, characterized in that: The display panel is a self-luminous display panel. When the finger contacts the detection area, the display panel emits detection light to illuminate the finger. The fingerprint recognition pixel receives the detection light returned by the finger to sense the fingerprint information of the finger. The light-sensitive pixel receives the detection light returned by the finger to sense the spectral information of the finger.

5. The in-screen fingerprint recognition device according to claim 1, characterized in that: The in-screen fingerprint recognition device also includes a light-emitting unit, which is used to emit detection light to illuminate the finger during detection, the fingerprint recognition pixel is used to receive the detection light returned by the finger to sense the fingerprint information of the finger, and the light-sensitive pixel is used to receive the detection light reflected back by the finger to sense the spectral information of the finger.

6. The in-screen fingerprint recognition device according to claim 5, characterized in that: The light emitting unit also emits light for display.

7. The in-screen fingerprint recognition device according to claim 1, characterized in that: The photosensitive pixel includes a plurality of spectral channels, each of which is used to collect light signals in different preset frequency bands and output an electrical signal corresponding to the energy of the light signal in the preset frequency band as the spectral information.

8. The in-screen fingerprint recognition device according to claim 1, characterized in that: The photosensitive pixel includes a red light channel, a green light channel and a blue light channel. The red light channel is used to collect red light signals and output electrical signals corresponding to the energy of the red light signals. The green light channel is used to collect green light signals and output electrical signals corresponding to the energy of the green light signals. The blue light channel is used to collect blue light signals and output electrical signals corresponding to the energy of the blue light signals.

9. The in-screen fingerprint recognition device according to claim 7, characterized in that: The energy proportions of different preset frequency bands in the spectral information of the finger are used to determine whether the finger is alive.

10. The in-screen fingerprint recognition device according to claim 1, characterized in that: The light-sensitive pixels are also used for: Sensing the light intensity value of the external ambient light to provide a reference for adjusting the brightness of the display; and / or, Sensing the color temperature value of the external ambient light to provide a reference for adjusting the color temperature of the display; and / or, Proximity sensing is performed based on changes in the intensity of the received light.

11. An electronic device, characterized in that: The electronic device comprises: A display panel, wherein the display panel includes a detection area, and the detection area is used to contact with a finger to be detected during detection; The in-screen fingerprint recognition device according to any one of claims 1 to 10, wherein the in-screen fingerprint recognition device is configured inside the display panel; and A processing module is connected to the in-screen fingerprint recognition device and is used to: Determining whether the finger is alive according to the sensed spectral information and preset spectral information; Determine whether the sensed fingerprint information matches a preset fingerprint information template; Whether the identity of the finger is legal is confirmed based on whether the finger is alive and whether the fingerprint information matches a preset fingerprint information template.

12. The electronic device according to claim 11, characterized in that: The display panel is a self-luminous display panel, and the processing module is further used to: when the finger contacts the detection area, control the display panel to illuminate the detection area, so as to emit detection light to illuminate the finger.

13. The electronic device according to claim 11, characterized in that: The processing module first confirms whether the finger is alive according to the sensed spectrum information and then controls the fingerprint recognition pixel to sense the fingerprint information of the finger.

14. The electronic device according to claim 13, characterized in that: The processing module determines whether the finger is alive according to energy proportions of different preset frequency bands in the spectral information of the finger.

Images