Fingerprint recognition device and electronic device

Abstract

A fingerprint recognition device and an electronic device are provided. The fingerprint recognition device includes: a microlens array, at least one light blocking layer, a pixel unit array, and a filter unit group array; wherein each filter unit group of the filter unit group array includes at least two filter units, and the at least two filter units are respectively used to transmit light signals of at least two colors; wherein the pixel unit array includes a pixel unit group corresponding to the filter unit group, at least two pixel units in the pixel unit group receive a first light signal through the at least two filter units respectively, and the pixel units in the pixel unit group other than the at least two pixel units receive a second light signal through a transparent area between the at least two filter units, or the pixel units between the pixel unit groups receive the second light signal through a transparent area between the filter unit groups. The fingerprint recognition device can improve the security of fingerprint recognition without affecting the fingerprint recognition effect.

Description

[0001] This application is a divisional application of the invention application with the application date of November 4, 2019, application number 201980004317.3, and name “Fingerprint recognition device and electronic device”. Technical Field

[0002] The present application relates to the field of optical fingerprint technology, and more specifically, to a fingerprint recognition device and an electronic device. Background Art

[0003] The application of optical fingerprint recognition devices brings users a safe and convenient user experience, but forged fingerprints such as fingerprint molds made of artificial materials (such as silicone, white glue, etc.) and printed fingerprint images are a security risk in fingerprint applications. Therefore, how to identify the authenticity of fingerprints to improve the security of fingerprint recognition is an urgent problem to be solved. Summary of the invention

[0004] Provided are a fingerprint recognition device and an electronic device, which can recognize the authenticity of a fingerprint, thereby improving the security of fingerprint recognition.

[0005] In a first aspect, a fingerprint recognition device is provided, wherein the fingerprint recognition device is suitable for being placed below a display screen to implement under-screen optical fingerprint recognition, and the fingerprint recognition device comprises:

[0006] A microlens array, used for being arranged below the display screen;

[0007] At least one light-blocking layer is disposed below the microlens array, and each of the at least one light-blocking layer is provided with a pinhole array;

[0008] A pixel unit array is arranged below the pinhole array of the bottom light blocking layer in the at least one light blocking layer, so that the light signal returned from the finger above the display screen is converged by the microlens array and then transmitted to the pixel unit array through the pinhole array arranged in the at least one light blocking layer;

[0009] A filter unit group array, wherein each filter unit group in the filter unit group array comprises at least two filter units, and the at least two filter units are respectively used to transmit light signals of at least two colors;

[0010] In which, the pixel unit array includes a pixel unit group corresponding to the filter unit group, at least two pixel units in the pixel unit group respectively receive a first light signal through the at least two filter units, and the first light signal is used to detect whether the finger is a real finger, and the pixel units in the pixel unit group other than the at least two pixel units receive a second light signal through a transparent area between the at least two filter units, or the pixel units between the pixel unit groups receive the second light signal through a transparent area between the filter unit groups, and the second light signal is used to identify the fingerprint information of the finger.

[0011] Through the fingerprint image collected by the at least two pixel units, it can be determined whether the finger located above the display screen is a real finger, and through the pixel units other than the at least two pixel units, a fingerprint image for fingerprint recognition can be obtained. That is, the fingerprint recognition device collects a fingerprint image once, which can be used not only for true and false recognition, but also for fingerprint recognition, and the security of fingerprint recognition can be improved without affecting the fingerprint recognition effect. For example, the fingerprint image collected by the at least two pixel units is a fingerprint image of two colors. Since fingerprint images of different colors have obvious differences for different materials, the authenticity of the fingerprint image can be determined by comparing fingerprint images of different colors, thereby improving the security of fingerprint recognition.

[0012] In some possible implementations, each filter unit in the filter unit group corresponds to a plurality of adjacent pixel units in the pixel unit group.

[0013] In some possible implementations, the pixel unit group is a 20*20 pixel unit rectangular array, the filter unit group is a 4*4 filter unit rectangular array, each filter unit in the 4*4 filter unit rectangular array corresponds to a 2*2 pixel unit rectangular array in the 20*20 pixel unit rectangular array, and two adjacent filter units in the 4*4 filter unit rectangular array are separated by 4 pixel units.

[0014] In some possible implementations, the first light signals received by the plurality of adjacent pixel units are used to synthesize a pixel value.

[0015] Using the first light signals received by a plurality of adjacent pixel units to synthesize a pixel value can not only improve the brightness of fingerprint images of different colors, but also simplify the preparation complexity of the filter unit group matrix.

[0016] In some possible implementations, each filter unit in the filter unit group corresponds to a pixel unit in the pixel unit group.

[0017] By corresponding each filter unit to a pixel unit in the pixel unit group, not only the resolution of fingerprint images of different colors can be improved, but also the at least two pixel units can be evenly distributed in the pixel unit group.

[0018] In some possible implementations, the pixel unit group is a 20*20 pixel unit rectangular array, the filter unit group is a 4*4 filter unit rectangular array, and two adjacent filter units in the 4*4 filter unit rectangular array are separated by 5 pixel units.

[0019] In some possible implementations, the pixel unit group is a 2*2 pixel unit rectangular array, and the filter unit group is a 2*2 filter unit rectangular array.

[0020] In some possible implementations, the ratio of the pixel units corresponding to the filter unit group array to all the pixel units in the pixel unit array is greater than or equal to a first preset value, and the ratio of the pixel units corresponding to the filter unit group array to all the pixel units in the pixel unit array is greater than or equal to a minimum threshold and less than or equal to a second preset value.

[0021] By using the first preset value, it is possible to ensure that the fingerprint image used for real and fake fingerprint identification has sufficient characteristic information, and by using the second preset value, it is possible to ensure that the fingerprint image used for fingerprint information identification has sufficient characteristic information. In other words, by setting the first preset value and the second preset value, it is possible to ensure that the accuracy or correctness of the real and fake fingerprint judgment is improved without affecting the effect of fingerprint identification.

[0022] In some possible implementations, the first preset value is 1%, and / or the second preset value is 2%.

[0023] In some possible implementations, the number of pixel units between two adjacent filter unit groups in the filter unit group array is greater than or equal to a third preset value, and the number of pixel units between two adjacent filter unit groups in the filter unit group array is less than or equal to a fourth preset value.

[0024] At least two pixel units in a pixel unit group are used for real and fake fingerprint identification. During the fingerprint identification process, the positions of the at least two pixel units can be restored by interpolation. Considering the influence of the filter unit group, the pixel values ​​of the pixel units between the pixel unit groups (for example, the pixel units adjacent to the pixel unit group above, below, left, and right) will be attenuated to a certain extent. Through the third preset value, it can be ensured that there are not only attenuated pixel units but also non-attenuated pixel units between the pixel unit groups. Through the fourth preset, the correlation between two adjacent pixel unit groups can be ensured, so that for the same position of the finger, it can be determined whether the finger located above the display screen is a real finger by at least two colors of pixel values.

[0025] In some possible implementations, the third preset value is 2, and / or the fourth preset value is 6.

[0026] In some possible implementations, the filter unit group array is a 9*6 filter unit group rectangular array, or the filter unit group array is a 6*6 filter unit group rectangular array, or the filter unit group array is a 7*7 filter unit group rectangular array, or the filter unit group array is a 6*4 filter unit group rectangular array.

[0027] In some possible implementations, the filter unit group array is disposed above the microlens array, or the filter unit group array is disposed between the microlens array and the pixel unit array.

[0028] In some possible implementations, the fingerprint recognition device further includes:

[0029] An infrared filter layer is disposed above the microlens array, or between the microlens array and the pixel unit array, and is used to filter out infrared light signals.

[0030] In some possible implementations, the number of the at least two filter units for transmitting red light signals is greater than the number of the at least two filter units for transmitting other color light signals.

[0031] The number of filter units for transmitting red light signals is designed to be greater than the number of filter units for transmitting other color light signals, so that even if an infrared filter layer is provided between the filter unit group array and the pixel unit array in the fingerprint recognition device, the red fingerprint image used for distinguishing true from false fingerprints can be ensured to have sufficient brightness, thereby improving the recognition effect of the red fingerprint image.

[0032] In some possible implementations, the at least one light-blocking layer is a plurality of light-blocking layers, and an opening in the small hole array in the top light-blocking layer of the plurality of light-blocking layers corresponds to one or more pixel units in the pixel unit array.

[0033] In some possible implementations, the apertures of the openings in the multiple light-blocking layers corresponding to the same pixel unit decrease sequentially from top to bottom.

[0034] In some possible implementations, the metal wiring layer of the pixel unit array is disposed at a rear focal plane position of the microlens array, and the metal wiring layer forms an opening above each pixel unit in the pixel unit array to form the bottom light blocking layer.

[0035] In some possible implementations, the fingerprint recognition device further includes:

[0036] A transparent dielectric layer;

[0037] Wherein, the transparent medium layer is used to connect the microlens array, the at least one light blocking layer and the pixel unit array.

[0038] In a second aspect, an electronic device is provided, including:

[0039] Display screen; and

[0040] The fingerprint recognition device described in the first aspect or any possible implementation of the first aspect, wherein the device is arranged below the display screen to realize under-screen optical fingerprint detection. BRIEF DESCRIPTION OF THE DRAWINGS

[0041] Figure 1 It is a schematic diagram of the structure of an electronic device to which the embodiments of the present application are applicable.

[0042] Figure 2 It is a difference comparison chart of the color fingerprint images corresponding to the real and fake fingerprints.

[0043] Figure 3 is a schematic structural diagram of a fingerprint recognition device according to an embodiment of the present application.

[0044] Figure 4 is a schematic diagram of the arrangement of the filter unit group according to an embodiment of the present application.

[0045] Figure 5 It is a schematic diagram of a design method of a filter unit in a filter unit group.

[0046] Figure 6 It is a schematic diagram of another design method of the filter unit in the filter unit group.

[0047] Figure 7 It is a structural diagram of the convolutional neural network of an embodiment of the present application.

[0048] Figure 8 is a schematic flow chart of a fingerprint recognition method according to an embodiment of the present application.

[0049] Fig. 9 is a schematic flow chart of a fingerprint recognition method according to another embodiment of the present application.

[0050] Fig.10 is a schematic block diagram of an electronic device according to an embodiment of the present application.

[0051] Fig.11 is another schematic structural diagram of a fingerprint recognition device according to an embodiment of the present application.

[0052] Figures 12 to 15 is an example of an array of filter unit groups according to an embodiment of the present application.

[0053] Figures 16 to 18 is an example of a filter unit in a filter unit group array according to an embodiment of the present application.

[0054] Fig.19 It is a schematic structural diagram showing that the pixel values ​​of the pixel units around the pixel unit group according to an embodiment of the present application are attenuated. DETAILED DESCRIPTION

[0055] The technical solutions in the embodiments of the present application will be described below in conjunction with the accompanying drawings.

[0056] It should be understood that the embodiments of the present application can be applied to optical fingerprint systems, including but not limited to optical fingerprint recognition systems and medical diagnostic products based on optical fingerprint imaging. The embodiments of the present application are only described using the optical fingerprint system as an example, but should not constitute any limitation to the embodiments of the present application. The embodiments of the present application are also applicable to other systems that use optical imaging technology, etc.

[0057] As a common application scenario, the optical fingerprint system provided in the embodiment of the present application can be applied to smart phones, tablet computers and other mobile terminals or other terminal devices with display screens; more specifically, in the above-mentioned terminal devices, the fingerprint recognition device can be specifically an optical fingerprint device, which can be set in a partial area or the entire area below the display screen, thereby forming an under-display optical fingerprint system. Alternatively, the fingerprint recognition device can also be partially or fully integrated into the display screen of the terminal device, thereby forming an in-display optical fingerprint system.

[0058] like Figure 1The structure diagram of the terminal device to which the embodiment of the present application can be applied is shown, the terminal device 10 includes a display screen 120 and an optical fingerprint device 130, wherein the optical fingerprint device 130 is arranged in a local area below the display screen 120. The optical fingerprint device 130 includes an optical fingerprint sensor, and the optical fingerprint sensor includes a sensing array 133 having a plurality of optical sensing units 131, and the area where the sensing array 133 is located or its sensing area is the fingerprint detection area 103 of the optical fingerprint device 130. Figure 1 As shown, the fingerprint detection area 103 is located in the display area of ​​the display screen 120. In an alternative embodiment, the optical fingerprint device 130 can also be set in other positions, such as the side of the display screen 120 or the edge non-light-transmissive area of ​​the terminal device 10, and the optical signal of at least part of the display area of ​​the display screen 120 is guided to the optical fingerprint device 130 through the optical path design, so that the fingerprint detection area 103 is actually located in the display area of ​​the display screen 120.

[0059] It should be understood that the area of ​​the fingerprint detection area 103 may be different from the area of ​​the sensing array of the optical fingerprint device 130. For example, through the optical path design of lens imaging, reflective folded optical path design or other optical path designs such as light convergence or reflection, the area of ​​the fingerprint detection area 103 of the optical fingerprint device 130 may be larger than the area of ​​the sensing array of the optical fingerprint device 130. In other alternative implementations, if, for example, light collimation is used for light path guidance, the fingerprint detection area 103 of the optical fingerprint device 130 may also be designed to be substantially consistent with the area of ​​the sensing array of the optical fingerprint device 130.

[0060] Therefore, when the user needs to unlock the terminal device or perform other fingerprint verification, the user only needs to press the finger on the fingerprint detection area 103 located on the display screen 120 to input the fingerprint. Since the fingerprint detection can be realized in the screen, the terminal device 10 adopting the above structure does not need to reserve a special space on the front to set the fingerprint button (such as the Home button), so that a full-screen solution can be adopted, that is, the display area of ​​the display screen 120 can be basically extended to the front of the entire terminal device 10.

[0061] As an optional implementation, Figure 1As shown, the optical fingerprint device 130 includes a light detection part 134 and an optical component 132. The light detection part 134 includes the sensing array and a reading circuit and other auxiliary circuits electrically connected to the sensing array, which can be made on a chip (Die) through a semiconductor process, such as an optical imaging chip or an optical fingerprint sensor. The sensing array is specifically a photodetector (Photo detector) array, which includes a plurality of photodetectors distributed in an array, and the photodetectors can be used as the optical sensing unit as described above; the optical component 132 can be arranged above the sensing array of the light detection part 134, which can specifically include a filter layer (Filter), a light guide layer or a light path guiding structure and other optical elements. The filter layer can be used to filter out the ambient light that penetrates the finger, and the light guide layer or the light path guiding structure is mainly used to guide the reflected light reflected from the finger surface to the sensing array for optical detection.

[0062] In a specific implementation, the optical component 132 can be packaged in the same optical fingerprint component as the light detection part 134. For example, the optical component 132 can be packaged in the same optical fingerprint chip as the optical detection part 134, or the optical component 132 can be arranged outside the chip where the light detection part 134 is located, such as attaching the optical component 132 above the chip, or integrating some components of the optical component 132 into the above chip.

[0063] Among them, there are multiple implementation schemes for the light-guiding layer or light-path guiding structure of the optical component 132. For example, the light-guiding layer can be specifically a collimator layer made on a semiconductor silicon wafer, which has multiple collimating units or a microhole array. The collimating unit can be specifically a small hole. Among the reflected light reflected from the finger, the light perpendicularly incident to the collimating unit can pass through and be received by the optical sensing unit below it, while the light with an incident angle that is too large is attenuated after multiple reflections inside the collimating unit. Therefore, each optical sensing unit can basically only receive the reflected light reflected from the fingerprint pattern directly above it, so that the sensing array can detect the fingerprint image of the finger.

[0064] In another embodiment, the light guide layer or light path guiding structure may also be an optical lens (Lens) layer, which has one or more lens units, such as a lens group composed of one or more aspherical lenses, which is used to converge the reflected light reflected from the finger to the sensing array of the light detection part 134 below it, so that the sensing array can be imaged based on the reflected light, thereby obtaining the fingerprint image of the finger. Optionally, the optical lens layer may also form a pinhole in the light path of the lens unit, and the pinhole may cooperate with the optical lens layer to expand the field of view of the optical fingerprint device to improve the fingerprint imaging effect of the optical fingerprint device 130.

[0065] In other embodiments, the light-guiding layer or the light-path guiding structure may also specifically adopt a micro-lens layer, wherein the micro-lens layer has a micro-lens array formed by a plurality of micro-lenses, which may be formed above the sensing array of the light detection part 134 by a semiconductor growth process or other processes, and each micro-lens may correspond to one of the sensing units of the sensing array. In addition, other optical film layers, such as a dielectric layer or a passivation layer, may be formed between the micro-lens layer and the sensing unit. More specifically, a light-blocking layer having micro-holes may be included between the micro-lens layer and the sensing unit, wherein the micro-holes are formed between the micro-lenses and the sensing units corresponding thereto, and the light-blocking layer may block the optical interference between the adjacent micro-lenses and the sensing units, and allow the light corresponding to the sensing units to converge into the micro-holes through the micro-lenses and be transmitted to the sensing units via the micro-holes for optical fingerprint imaging. It should be understood that the above-mentioned several implementation schemes of the light-path guiding structure may be used alone or in combination, for example, a micro-lens layer may be further provided below the collimator layer or the optical lens layer. Of course, when the collimator layer or the optical lens layer is used in combination with the microlens layer, the specific stacking structure or optical path may need to be adjusted according to actual needs.

[0066] As an optional embodiment, the display screen 120 may be a display screen having a self-luminous display unit, such as an organic light-emitting diode (OLED) display screen or a micro-light-emitting diode (Micro-LED) display screen. Taking the OLED display screen as an example, the optical fingerprint device 130 may use the display unit (i.e., OLED light source) of the OLED display screen 120 located in the fingerprint detection area 103 as an excitation light source for optical fingerprint detection. When the finger 140 presses on the fingerprint detection area 103, the display screen 120 emits a beam of light 111 to the target finger 140 above the fingerprint detection area 103. The light 111 is reflected on the surface of the finger 140 to form reflected light or is scattered inside the finger 140 to form scattered light. In the relevant patent application, for the convenience of description, the above-mentioned reflected light and scattered light are collectively referred to as reflected light. Since the ridges and valleys of the fingerprint have different reflective capabilities for light, the reflected light 151 from the fingerprint ridges and the reflected light 152 from the fingerprint valleys have different light intensities. After passing through the optical component 132, the reflected light is received by the sensing array 133 in the optical fingerprint device 130 and converted into a corresponding electrical signal, i.e., a fingerprint detection signal. Based on the fingerprint detection signal, fingerprint image data can be obtained, and fingerprint matching verification can be further performed, thereby realizing the optical fingerprint recognition function in the terminal device 10.

[0067] In other embodiments, the optical fingerprint device 130 may also use a built-in light source or an external light source to provide an optical signal for fingerprint detection. In this case, the optical fingerprint device 130 may be applicable to a non-self-luminous display screen, such as a liquid crystal display screen or other passive light-emitting display screens. Taking the application in a liquid crystal display screen having a backlight module and a liquid crystal panel as an example, in order to support the under-screen fingerprint detection of the liquid crystal display screen, the optical fingerprint system of the terminal device 10 may also include an excitation light source for optical fingerprint detection, and the excitation light source may be specifically an infrared light source or a light source of non-visible light of a specific wavelength, which may be arranged below the backlight module of the liquid crystal display screen or arranged at the edge area below the protective cover of the terminal device 10, and the optical fingerprint device 130 may be arranged below the edge area of ​​the liquid crystal panel or the protective cover and guided through the optical path so that the fingerprint detection light can reach the optical fingerprint device 130; or, the optical fingerprint device 130 may also be arranged below the backlight module, and the backlight module may allow the fingerprint detection light to pass through the liquid crystal panel and the backlight module and reach the optical fingerprint device 130 by opening holes or other optical designs in the film layers such as the diffuser, the brightness enhancement sheet, and the reflector. When the optical fingerprint device 130 uses a built-in light source or an external light source to provide an optical signal for fingerprint detection, its detection principle is consistent with the above description.

[0068] It should be understood that, in a specific implementation, the terminal device 10 further includes a transparent protective cover plate, which may be a glass cover plate or a sapphire cover plate, which is located above the display screen 120 and covers the front of the terminal device 10. Because, in the embodiment of the present application, the so-called finger pressing on the display screen 120 actually refers to pressing the cover plate above the display screen 120 or the surface of the protective layer covering the cover plate.

[0069] On the other hand, in some embodiments, the optical fingerprint device 130 may include only one optical fingerprint sensor. In this case, the fingerprint detection area 103 of the optical fingerprint device 130 is small in area and fixed in position. Therefore, when the user inputs a fingerprint, the user needs to press the finger to a specific position of the fingerprint detection area 103. Otherwise, the optical fingerprint device 130 may not be able to collect the fingerprint image, resulting in a poor user experience. In other alternative embodiments, the optical fingerprint device 130 may specifically include multiple optical fingerprint sensors; the multiple optical fingerprint sensors may be arranged side by side under the display screen 120 in a splicing manner, and the sensing areas of the multiple optical fingerprint sensors together constitute the fingerprint detection area 103 of the optical fingerprint device 130. That is, the fingerprint detection area 103 of the optical fingerprint device 130 may include multiple sub-areas, each of which corresponds to the sensing area of ​​one of the optical fingerprint sensors, so that the fingerprint detection area 103 of the optical fingerprint device 130 can be expanded to the main area of ​​the lower half of the display screen, that is, to the area where the finger is usually pressed, thereby realizing a blind fingerprint input operation. Alternatively, when the number of the optical fingerprint sensors is sufficient, the fingerprint detection area 103 can also be expanded to half of the display area or even the entire display area, thereby achieving half-screen or full-screen fingerprint detection.

[0070] It should also be understood that in the embodiments of the present application, the sensing array in the optical fingerprint device may also be referred to as a pixel array, and the optical sensing unit or sensing unit in the sensing array may also be referred to as a pixel unit.

[0071] It should be noted that the optical fingerprint device in the embodiment of the present application can also be called an optical fingerprint recognition module, a fingerprint recognition device, a fingerprint recognition module, a fingerprint module, a fingerprint collection device, etc., and the above terms are interchangeable.

[0072] Generally speaking, affected by factors such as the thickness of the human skin tissue, hemoglobin concentration, and melanin content, the reflective performance of human skin tissue to specific wavelengths of light, such as red light, is significantly different from that of artificial materials such as silicone, paper, and tape.

[0073] Based on this, the present application provides a fingerprint recognition solution, in which a filter unit with at least two colors is set above some pixel units (referred to as feature pixel units) in the fingerprint recognition device, so that the fingerprint image collected by the feature pixel unit is a low-resolution color fingerprint image. For different materials (for example, human fingers and artificial materials such as silicone), the low-resolution color fingerprint image has obviously different characteristics, such as Figure 2 As shown, therefore, the authenticity of the fingerprint image can be determined based on the difference of the low-resolution color fingerprint image collected by the feature pixel unit.

[0074] The following, combined Figures 3 to 10 , a fingerprint recognition device according to an embodiment of the present application is introduced in detail.

[0075] It should be noted that, for ease of understanding, in the embodiments shown below, the same structures are denoted by the same reference numerals, and detailed descriptions of the same structures are omitted for brevity.

[0076] It should be understood that the number and arrangement of pixel units, filter units, and filter unit groups in the embodiments of the present application shown below are only exemplary and should not constitute any limitation to the present application.

[0077] Figure 3 is a schematic structural diagram of a fingerprint recognition device 20 provided in an embodiment of the present application, and the fingerprint recognition device 20 includes:

[0078] The optical fingerprint sensor 200 includes a plurality of pixel units, for example, Figure 3 The pixel unit 211 and the pixel unit 212;

[0079] At least two filter units 221 are disposed above at least two pixel units 212 among the plurality of pixel units, each filter unit 221 corresponds to one pixel unit 212, and the at least two filter units 221 include filter units of at least two colors.

[0080] Optionally, in the embodiment of the present application, the fingerprint recognition device may be a fingerprint module, or the fingerprint recognition device may be an electronic device including a fingerprint module, which is not limited in the embodiment of the present application.

[0081] It should be understood that in the embodiment of the present application, the at least two filter units 221 can constitute at least one filter unit group 220, and the design of the filter units in each filter unit group and the arrangement of the at least one filter unit group in the optical fingerprint sensor are described in detail below.

[0082] For the convenience of distinction and description, in the embodiment of the present application, the pixel unit with the filter unit 221 disposed above, that is, Figure 3 The pixel unit 212 in the image is recorded as a characteristic pixel unit; the other pixel units other than the at least two pixel units, namely Figure 3 The pixel unit 211 in FIG. 2 is recorded as a common pixel unit, or a background pixel unit. It should be understood that Figure 3 The positions, quantities and distributions of the characteristic pixel units 212 and the background pixel units 211 are merely examples and should not constitute any limitation to the embodiments of the present application.

[0083] In the embodiment of the present application, when collecting fingerprint images, the fingerprint detection area of ​​the display screen can display a light spot of a specific color, such as a white light spot or a cyan light spot, etc. When the object to be identified presses the fingerprint detection area, the light signal corresponding to the light spot can be reflected on the surface of the object to be identified to form a fingerprint detection signal. Since at least two filter units 221 are arranged above the at least two feature pixel units 212, and the at least two filter units 221 include filter units of at least two colors, after the fingerprint detection signal passes through the at least two color filter units 221, the at least two feature pixel units 212 can collect a color fingerprint image with at least two colors, and after passing through the filter unit 221, the light signal of a part of the wavelength band is filtered out. Compared with the fingerprint image collected by the pixel unit without the filter unit, the resolution of the fingerprint image is reduced. Therefore, the fingerprint image collected by the feature pixel unit is a low-resolution color fingerprint image. Further, the true and false fingerprints can be determined based on the low-resolution color fingerprint image.

[0084] It should be understood that in the embodiment of the present application, it is only necessary to collect the fingerprint image once, and a color fingerprint image with different colors can be obtained through filter units of different colors, without having to collect the fingerprint image multiple times, which is beneficial to reducing the collection time and improving the collection efficiency.

[0085] Optionally, in the embodiment of the present application, the filter unit usually only allows light signals within a specific wavelength range to pass through. For a single filter unit, the wavelength range of the emitted light of the light source used for fingerprint detection needs to include the wavelength of the filter unit and at least part of other wavelengths other than this wavelength. In other words, the wavelength of a single filter unit only includes part of the wavelength of the emitted light. In this way, after the emitted light is reflected on the surface of the object to be identified, it enters the filter unit, and after passing through the filter unit, a part of the light signal is filtered out, while a part of the light signal is allowed to pass through, and further imaged on the feature pixel unit, thereby obtaining a low-resolution color fingerprint image.

[0086] For example, if the light source emits white light, that is, a white light spot is displayed in the fingerprint detection area, then the filter unit can be a red filter unit that only allows the red light band to pass through, or it can also be a blue filter unit that only allows the blue light band to pass through, or it can also be a cyan filter unit that allows both the green light and blue light bands to pass through, and so on. As long as the filter unit can filter out light signals of some bands while allowing light signals of other bands to pass through, the embodiments of the present application are not limited to this.

[0087] As an optional embodiment, if the filter unit 221 is a red filter unit, the red filter unit may be a red filter material or a red filter, that is, a red filter material may be coated on the top of the characteristic pixel unit or a red filter may be set to achieve the purpose of allowing only the red light band to pass through. The implementation method for the filter units of other colors is similar and will not be repeated here.

[0088] For example, the wavelength range of the blue filter can be a central band of 440nm to 475nm, an upper cut-off band of approximately 550nm, and the transmittance of blue light is higher than that of green light and red light; the wavelength range of the green filter can be a central band of 520nm to 550nm, upper and lower cut-off bands of approximately 620nm and 460nm, and the transmittance of green light is higher than that of blue light and red light; the wavelength range of the red filter can be a lower cut-off band of approximately 550nm, and the transmittance of red light is higher than that of green light and blue light.

[0089] Optionally, in the embodiment of the present application, the light source used for fingerprint detection may be a self-luminous source from a display screen, or may be an excitation light source integrated into the fingerprint recognition device or other external excitation light source, which is not limited in the embodiment of the present application.

[0090] In an optional implementation, no other structure may be arranged above the background pixel unit 211, or no material may be coated, that is, the upper part of the background pixel unit 211 is transparent and not processed. In other words, there is an air gap between the background pixel unit and the optical component above it.

[0091] In another optional implementation, a light-transmitting material may be disposed above the background pixel unit 211. In this case, the fingerprint detection signal entering the background pixel unit 211 is not affected or is less affected.

[0092] In other optional implementations, a filter layer 222, such as a green filter layer, may also be provided above the background pixel unit 211. Optionally, a green filter material may be coated on the background pixel unit 211, or a green filter may be provided. Thus, after the fingerprint detection signal passes through the green filter layer, the fingerprint image collected by the background pixel unit 211 is a green fingerprint image, i.e., the fingerprint detection signals in the red band and the blue band are filtered out, which is beneficial to reduce the influence of ambient light signals such as infrared light, thereby improving the fingerprint recognition performance.

[0093] The following describes the design of the positions and colors of the at least two filter units in the optical fingerprint sensor 200 in conjunction with specific embodiments.

[0094] It should be understood that in the embodiment of the present application, the at least two filtering units may be continuous filtering units, or may be partially continuous filtering units, or may be discrete filtering units, and the embodiment of the present application does not specifically limit this.

[0095] Optionally, in an embodiment of the present application, the number of continuous filter units can be set to be less than or equal to a specific threshold, for example, 6, and correspondingly, the number of continuous feature pixel units is also not greater than the specific threshold, thereby avoiding affecting the fingerprint recognition performance.

[0096] Optionally, in some embodiments, the at least two filter units 221 may constitute a plurality of filter unit groups 220, each filter unit group 220 may include filter units of at least two colors, and as an optional embodiment, the plurality of filter unit groups 220 may be discretely distributed in the photosensitive area of ​​the optical fingerprint sensor, and accordingly, it may be considered that the characteristic pixel unit groups corresponding to the filter unit groups are discretely distributed in the pixel array of the optical fingerprint sensor, thereby preventing the number of pixel units continuously covered by the filter unit groups from being too large and affecting the fingerprint recognition performance. It should be understood that the photosensitive area of ​​the optical fingerprint sensor may be understood as the area where the pixel units of the optical fingerprint sensor are located, or the pixel area.

[0097] Combination Figure 4 , illustrating several possible implementations of the filter unit group 220 in the optical fingerprint sensor.

[0098] In one implementation, the filter unit group 220 may be arranged in a checkerboard pattern with equal spacing, for example, Figure 4 The rectangular or square checkerboard pattern shown. In this case, the filter unit group is a filter array M*N, where M and N can be determined according to the number of rows and columns of the pixel array of the optical fingerprint sensor. Optionally, M can be M=5, 6, 7, ..., 32, etc., and N can be 5, 6, 7, ..., 32, etc., which is not limited in the embodiments of the present application.

[0099] In other optional implementations, the filter unit group 220 may also be arranged in a rhombus, circle, or other regular or irregular pattern in the photosensitive area of ​​the optical fingerprint sensor, which is not limited in the embodiment of the present application.

[0100] It should be understood that Figure 4 Several typical arrangements of the filter unit group 220, or preferred arrangements, are shown, but they should not constitute any limitation to the embodiments of the present application. The embodiments of the present application may also use other arrangements to set the filter unit group, as long as the fingerprint recognition performance is not affected or the impact on the fingerprint recognition performance is small.

[0101] In the following, a single filter unit group is taken as an example to explain the design method of the filter units in the filter unit group.

[0102] Optionally, in some embodiments, the adjacent filter units in the filter unit group include at least a red filter unit and a blue filter unit, and optionally, in some cases, a green filter unit may also be included. It should be understood that the adjacent filter units here may be physically adjacent, or may be separated by one or more background pixel units, which is not limited in the embodiments of the present application.

[0103] From the above description, it can be known that a filter layer can be set above the background pixel unit (recorded as case 1), or it can also be made transparent (recorded as case 2). The following describes the design method of the filter unit in the filter unit in combination with the two cases.

[0104] For case 1, a filter layer is arranged above the background pixel unit adjacent to the filter unit in the filter unit group, then the filter unit group may not include a filter unit of the same color as the filter layer. Assuming that a green filter layer is arranged above the background pixel unit, the adjacent filter unit may only include filter units of red and blue colors, thereby avoiding the impact on the fingerprint recognition performance. Of course, in this case, a green filter unit may also be included, as long as the number of green filter units does not affect the fingerprint recognition performance, or has a small impact on the fingerprint recognition performance.

[0105] For case 2, the upper part of the background pixel unit adjacent to the filter unit in the filter unit group is transparent. In this case, the filter unit adjacent to the background pixel unit can include any two or three of the red filter unit, the blue filter unit and the green filter unit.

[0106] Generally speaking, compared with the red light band and the blue light band, the fingerprint recognition performance is better when the fingerprint image of the green light band is used for fingerprint recognition. Therefore, in the embodiment of the present application, when the background pixel unit uses the fingerprint image of the green light band for fingerprint recognition, avoiding the use of the green filter unit when setting the filter unit can reduce the impact on the fingerprint recognition performance.

[0107] Figure 5 and Figure 6 Several design modes of the filter units in the filter unit group in the above two situations are respectively shown.

[0108] Specifically, Figure 5 When a green filter layer is set above the background pixel unit, there are several design methods for the filter units in the filter unit group. Figure 5As shown, the filter unit group can be a regular array such as 1*2, 2*2, 4*4, or an irregular array. When a green filter layer is set above the background pixel unit, that is, the background color is green, in this case, the filter unit group can only have red and blue filter units, thereby avoiding affecting the fingerprint recognition performance.

[0109] Figure 6 The figure shows a possible design method of the filter unit in the filter unit group when the background pixel unit is transparent. Figure 6 As shown, the filter unit can also be a regular array such as 1*2, 2*2, 4*4, or an irregular array. When the background pixel unit is transparent, that is, the background is transparent, the filter units in the filter unit group can include filter units of three colors: red, blue and green. Of course, it can also include filter units of only two colors.

[0110] It should be understood that in the embodiment of the present application, the filter units in a single filter unit group may be continuous, for example Figure 5 or Figure 6 Design methods a to e in the above; or it can be partially discontinuous, for example, Figure 5 or Figure 6 Design methods f to g in the above are that some filter units are separated by background pixel units; or they can be discrete, that is, all filter units are separated by background pixel units, for example, Figure 5 or Figure 6 Design method h~i.

[0111] Optionally, in an embodiment of the present application, the fingerprint image collected by the background pixel unit can be used for fingerprint matching verification. Due to the existence of the feature pixel unit, the fingerprint image collected by the background pixel unit is not a complete fingerprint image. Therefore, before fingerprint recognition, the complete fingerprint image can be restored based on the fingerprint image collected by the background pixel unit. For example, the fingerprint image at the position of the feature pixel unit can be restored by interpolation or fitting to obtain a complete fingerprint image.

[0112] It can be understood that the more non-background color pixel units there are, the more missing information there is in the fingerprint image collected by the background pixel units, which is not conducive to restoring or restoring the complete fingerprint image based on the fingerprint image collected by the background pixel units.

[0113] It can also be understood that when the number of consecutive pixel units in the non-background color pixel unit is large, that is, when the interval between adjacent background color pixel units is far, too much fingerprint information is lost in the middle, which is not conducive to the recovery or restoration of the complete fingerprint image.

[0114] Therefore, in the embodiment of the present application, the number of non-background color filter units can be set to meet at least one of the following conditions to reduce the impact on fingerprint recognition performance:

[0115] 1. The number of non-background color filter units is less than a specific threshold, such as 20;

[0116] 2. The ratio of the non-background color filter unit to the total number of pixel units in the optical fingerprint sensor is less than a first threshold, such as 5% or 2%;

[0117] 3. The number of consecutive non-background color filter units is less than a second threshold.

[0118] Since the non-background color filter units and the non-background color pixel units correspond one to one, in other words, in the embodiment of the present application, the number of non-background color pixel units can be set to meet at least one of the following conditions to reduce the impact on the fingerprint recognition performance:

[0119] 1. The number of non-background color pixel units is less than a specific threshold, such as 20;

[0120] 2. The ratio of non-background color pixel units to the total number of pixel units in the optical fingerprint sensor is less than a first threshold, such as 5% or 2%;

[0121] 3. The number of consecutive non-background color pixel units is less than a second threshold.

[0122] It should be understood that in the embodiment of the present application, the color of the filter layer arranged above the non-background color filter unit and the background pixel unit is different. For example, the non-background color filter unit is a red filter unit, or the background pixel unit is transparent.

[0123] Correspondingly, the color of the filter unit set above the non-background color pixel unit is different from the color of the filter layer set above the background pixel unit. For example, a red filter unit is set above the non-background color pixel unit, and a green filter layer is set above the background pixel unit, or no filter layer is set above the background pixel unit.

[0124] It should be understood that in the embodiment of the present application, the second threshold value can be the number of pixel units continuous in the horizontal direction, for example, 6, or it can also be the number of pixel units continuous in the vertical direction, for example, 6, or it can also be the number of pixel units continuous in the horizontal direction and the number of pixel units continuous in the vertical direction, that is, the area of ​​continuous pixel units, for example, 6*6, and the embodiment of the present application is not limited to this.

[0125] It should be noted that in the embodiment of the present application, the color and position of the filter unit in each filter unit group in the multiple filter unit groups can be set in the same way, or the color and / or position of one or more filter units in one or several filter unit groups can be changed. In other words, the color and / or position of the filter unit in the filter unit group can be locally adjusted as long as it does not affect the fingerprint recognition performance, and the embodiment of the present application is not limited to this.

[0126] Optionally, in the embodiment of the present application, the fingerprint recognition device 20 may further include:

[0127] The processor 230 is used to determine whether the fingerprint image is from a real finger according to the fingerprint image collected by the at least two pixel units.

[0128] Specifically, the multiple pixel units of the optical fingerprint sensor can image the fingerprint detection signal reflected from the surface of the object to be identified. Further, the processor can extract and reorganize the fingerprint image collected by the feature pixel units in the multiple pixel units to obtain a low-resolution color fingerprint image. Then, the processor 230 can input the low-resolution color fingerprint image into a successfully trained deep learning network, and process the color fingerprint image through the deep learning network to determine whether the color fingerprint image comes from a real finger.

[0129] Optionally, in the embodiment of the present application, the processor 230 may be a processor in a fingerprint module, such as a microcontroller (MCU), or may be a processor in an electronic device, such as a host module, which is not limited in the embodiment of the present application.

[0130] Optionally, in the embodiment of the present application, the deep learning network may be a convolutional neural network, or other deep learning networks, which is not limited in the embodiment of the present application. Below, the specific training process is described by taking the convolutional neural network as an example.

[0131] First, construct a convolutional neural network structure, for example, Figure 7 The two-layer convolutional neural network shown may also adopt a three-layer network structure or a network structure of more layers. The composition of each layer of the convolutional network structure may also be adjusted according to the fingerprint information to be extracted, which is not limited in the embodiments of the present application.

[0132] Secondly, the initial training parameters and convergence conditions of the convolutional neural network are set.

[0133] Optionally, in an embodiment of the present application, the initial training parameters may be randomly generated, or obtained based on empirical values, or may be parameters of a convolutional neural network model pre-trained based on a large amount of true and false fingerprint data, and the embodiment of the present application is not limited to this.

[0134] Optionally, in the embodiment of the present application, the convergence condition may include at least one of the following:

[0135] 1. The probability of determining that the color fingerprint image of the real finger is the fingerprint image of the real finger is greater than a first probability, for example, 98%;

[0136] 2. The probability that the color fingerprint image of the fake finger is judged to be the fingerprint image of the fake finger is greater than a second probability, for example, 95%;

[0137] 3. The probability of determining that the color fingerprint image of the real finger is the fingerprint image of the fake finger is less than a third probability, for example, 2%;

[0138] 4. The probability of judging the color fingerprint image of the fake finger as the fingerprint image of the real finger is less than a fourth probability, for example, 3%.

[0139] Then, a large number of color fingerprint images of real fingers and fake fingers are input into the convolutional neural network. The convolutional neural network can process the above color fingerprint images based on the initial training parameters to determine the judgment result of each color fingerprint image. Further, according to the judgment result, the structure of the convolutional neural network and / or the training parameters of each layer are adjusted until the judgment result meets the convergence condition.

[0140] Afterwards, other color fingerprint images collected by the feature pixel unit can be input into the convolutional neural network, so that the convolutional neural network can process the color fingerprint image using the trained parameters to determine whether the color fingerprint image comes from a real finger.

[0141] Optionally, in an embodiment of the present application, the processor 230 can further determine whether the object to be identified is a real finger when the fingerprint image captured by the background pixel unit matches the registered fingerprint template of the object to be identified, and determine that the fingerprint authentication is successful when the object to be identified is a real finger, thereby executing the operation that triggers the fingerprint identification, such as terminal unlocking or payment.

[0142] Optionally, in an embodiment of the present application, the processor 230 may also further determine whether the fingerprint image captured by the background pixel unit matches the registered fingerprint template of the object to be identified when the object to be identified is a real finger, and determine that the fingerprint authentication is successful if a match is found, and further execute an operation that triggers the fingerprint identification, such as terminal unlocking or payment.

[0143] Optionally, in the embodiment of the present application, the fingerprint recognition device 20 may further include an optical component, which may correspond to Figure 1 The optical component 132 is not described in detail here.

[0144] Combination of the above Figures 3 to 7 , describes in detail the device embodiment of the present application, and the following is combined with Figure 8 , the method embodiments of the present application are described in detail. It should be understood that the method embodiments and the device embodiments correspond to each other, and similar descriptions can refer to the device embodiments.

[0145] Figure 8 is a schematic flow chart of a fingerprint recognition method according to an embodiment of the present application. It should be understood that the method 400 can be applied to Figure 3 In the fingerprint recognition device 20 shown in FIG. Figure 8 As shown, the method 400 includes:

[0146] S401, collecting a fingerprint image of an object to be identified through multiple pixel units of an optical fingerprint sensor, wherein at least two filter units are arranged above at least two pixel units among the multiple pixel units, each filter unit corresponds to one pixel unit, and the at least two filter units include filter units of at least two colors.

[0147] Optionally, the method 400 can be executed by a processor in the fingerprint recognition device, such as a microcontroller (MCU) in a fingerprint module, or can also be executed by a processor in an electronic device, such as a host module, which is not limited in the embodiments of the present application.

[0148] Optionally, in some embodiments, the method 400 may further include:

[0149] According to the fingerprint image of the object to be identified collected by the at least two pixel units, it is determined whether the object to be identified is a real finger.

[0150] Optionally, in some embodiments, determining whether the object to be identified is a real finger according to the fingerprint image of the object to be identified collected by the at least two pixel units includes:

[0151] The fingerprint image of the object to be identified collected by the at least two pixel units is processed through a deep learning network to determine whether the object to be identified is a real finger.

[0152] Optionally, in some embodiments, the method further comprises:

[0153] Collecting fingerprint images of multiple real fingers and fake fingers through the optical fingerprint sensor;

[0154] Extracting the sampling values ​​of the pixel units corresponding to the filter units in each fingerprint image, and recombining to obtain a color fingerprint image;

[0155] The color fingerprint image is input into a deep learning network for training to obtain a model and parameters of the deep learning network.

[0156] Optionally, in some embodiments, the method further comprises:

[0157] Fingerprint recognition is performed based on fingerprint images collected by other pixel units among the multiple pixel units except the at least two pixel units.

[0158] Optionally, in an embodiment of the present application, it is possible to first determine whether the object to be identified is a real finger, and then, if the object to be identified is a real finger, determine whether the fingerprint information of the object to be identified matches the entered fingerprint information of the object to be identified. If the above two conditions are met at the same time, it is determined that the fingerprint authentication is successful, and further perform the operation that triggers the fingerprint identification, such as terminal unlocking or payment.

[0159] Alternatively, it is also possible to first determine whether the fingerprint information of the object to be identified matches the fingerprint information of the object to be identified that has been entered. If the fingerprint match is successful, further determine whether the object to be identified is a real finger. Then, if the object to be identified is a real finger, determine that the fingerprint authentication is successful, and further execute the operation that triggers the fingerprint identification, such as terminal unlocking or payment.

[0160] Optionally, in some embodiments, the at least two filter units include a plurality of first filter units, wherein the colors of the plurality of first filter units are different from the colors of the filter layers arranged above other pixel units among the plurality of pixel units except the at least two pixel units, or no filter layer is arranged above the other pixel units.

[0161] Optionally, in some embodiments, a ratio of the number of the plurality of first filter units to the total number of the plurality of pixel units is less than a first threshold.

[0162] Optionally, in some embodiments, the first threshold is 5%.

[0163] Optionally, in some embodiments, the number of consecutive filter units in the plurality of first filter units is less than a second threshold.

[0164] Optionally, in some embodiments, the second threshold is 8.

[0165] Optionally, in some embodiments, the at least two filter units constitute at least one filter unit group, each filter unit group includes at least two filter units, and adjacent filter units in the filter unit group include filter units of at least two colors.

[0166] Optionally, in some embodiments, if a green filter layer is disposed on other pixel units among the plurality of pixel units except the at least two pixel units, adjacent filter units in the filter unit group include only a red filter unit and a blue filter unit; or

[0167] If no filter layer is disposed above the other pixel units, the adjacent filter units in the filter unit group include at least two of a red filter unit, a green filter unit and a blue filter unit.

[0168] Optionally, in some embodiments, the wavelength range of each of the at least two filter units only includes a portion of the wavelength range of the optical signal used for fingerprint detection.

[0169] Optionally, in some embodiments, the at least two filter units constitute a plurality of filter unit groups, and the plurality of filter unit groups are discretely distributed in a pixel array constituted by the plurality of pixel units.

[0170] Optionally, in some embodiments, the plurality of filter unit groups are evenly distributed in the pixel array of the optical fingerprint sensor in the shape of a rectangle, a square, a diamond or a circle.

[0171] Optionally, in some embodiments, the filter unit is a color filter material, and the color filter material includes at least one of a red filter material, a green filter material and a blue filter material.

[0172] Optionally, in some embodiments, the filter unit is a color filter, and the color filter is one of a red filter, a green filter and a blue filter.

[0173] The following, combined Fig. 9 The specific embodiment shown in the figure illustrates the fingerprint recognition method according to the embodiment of the present application. Fig. 9 As shown, the method may include the following contents:

[0174] S41, collecting a fingerprint image through an optical fingerprint sensor;

[0175] The fingerprint image includes the fingerprint image collected by the common pixel unit and the fingerprint image collected by the characteristic pixel unit.

[0176] Further, in S42, the fingerprint image collected by the ordinary pixel unit in the fingerprint image is extracted and reorganized as a grayscale fingerprint image, and the fingerprint image collected by the characteristic pixel unit is recorded as a color fingerprint image;

[0177] Then in S43, the grayscale fingerprint image is matched with the registered fingerprint template to determine whether the match is successful.

[0178] If the match is successful, S44 is executed, otherwise, S46 is executed to determine that the authentication fails and refuse to execute the operation that triggers the fingerprint authentication, such as unlocking the screen or payment operations.

[0179] It should be understood that in S43, before fingerprint matching, the fingerprint information at the missing feature pixel unit position in the grayscale fingerprint image may be interpolated or fitted to obtain a complete fingerprint image. For specific implementation, reference may be made to the relevant description of the aforementioned embodiment.

[0180] In S44, determining whether the color fingerprint image is from a real finger;

[0181] Specifically, the color fingerprint image can be input into a deep learning network to determine whether the color fingerprint image comes from a real finger.

[0182] If it is from a real finger, S45 is executed to determine that the authentication is successful, and then an operation that triggers fingerprint authentication is performed, such as unlocking the screen or payment operations.

[0183] It should be understood that in the embodiment of the present application, after S42, S44 may be executed first, and if it is determined to be from a real finger, S43 may be executed, otherwise it is directly determined that the fingerprint authentication has failed. The specific execution process is not specifically limited here.

[0184] like Fig.10 As shown, the embodiment of the present application further provides an electronic device 700, the electronic device 700 may include a fingerprint recognition device 710, the fingerprint recognition device 710 may be the fingerprint recognition device 20 in the aforementioned device embodiment, which can be used to perform Figures 8 to 9 For the sake of brevity, the contents of the method embodiment described in are not repeated here.

[0185] It should be understood that the processor of the embodiment of the present application can be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above method embodiment can be completed by the hardware integrated logic circuit or software instructions in the processor. The above processor can be a general processor, a digital signal processor (Digital Signal Processor, DSP), an application specific integrated circuit (Application Specific Integrated Circuit, ASIC), a field programmable gate array (Field Programmable Gate Array, FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components. The methods, steps and logic block diagrams disclosed in the embodiments of the present application can be implemented or executed. The general processor can be a microprocessor or the processor can also be any conventional processor, etc. The steps of the method disclosed in the embodiment of the present application can be directly embodied as a hardware decoding processor to perform, or the hardware and software modules in the decoding processor are combined and performed. The software module can be located in a random access memory, a flash memory, a read-only memory, a programmable read-only memory or an electrically erasable programmable memory, a register, and other mature storage media in the art. The storage medium is located in the memory, and the processor reads the information in the memory and completes the steps of the above method in combination with its hardware. The fingerprint recognition of the embodiment of the present application may also include a memory, which may be a volatile memory or a non-volatile memory, or may include both volatile and non-volatile memories.

[0186] The embodiment of the present application also provides a computer-readable storage medium, which stores one or more programs, wherein the one or more programs include instructions, which, when executed by a portable electronic device including a plurality of application programs, enable the portable electronic device to execute Figure 8 The method of the illustrated embodiment.

[0187] The present application also provides a computer program, which includes instructions. When the computer program is executed by a computer, the computer can execute Figure 8 The method of the illustrated embodiment.

[0188] The embodiment of the present application also provides a chip, which includes an input and output interface, at least one processor, at least one memory and a bus, wherein the at least one memory is used to store instructions, and the at least one processor is used to call the instructions in the at least one memory to execute Figure 8 The method of the illustrated embodiment.

[0189] The above introduces the relative position relationship (also referred to as the structural relationship) between the filter unit and the pixel unit and the fingerprint recognition method. The fingerprint recognition device of the embodiment of the present application is described below in combination with the microlens array and at least one light blocking layer.

[0190] Fig.11 It is a schematic side cross-sectional view of a fingerprint recognition device 80 according to an embodiment of the present application.

[0191] like Fig.11 As shown, the fingerprint recognition device 80 may include a microlens array, at least one light-blocking layer located below the microlens array, and a pixel unit array located below the at least one light-blocking layer. The microlens array may include a plurality of microlenses 81 distributed in an array, the at least one light-blocking layer may include a light-blocking layer 83, and the pixel unit array 84 may include a plurality of pixel units distributed in an array. The microlens array is used to be arranged below the display screen; the at least one light-blocking layer is arranged below the microlens array, and each light-blocking layer in the at least one light-blocking layer is provided with a pinhole array; the pixel unit array is arranged below the pinhole array of the bottom light-blocking layer in the at least one light-blocking layer. For example, the pinholes in the pinhole array in the bottom light-blocking layer correspond one-to-one to the pixel units in the pixel unit array.

[0192] Wherein, the microlens array may include a plurality of microlenses distributed in an array, and each of the plurality of microlenses may be a hemispherical lens or a non-hemispherical lens, such as a square lens. In some embodiments, the at least one light-blocking layer is a plurality of light-blocking layers, and an opening in the pinhole array in the top light-blocking layer of the plurality of light-blocking layers corresponds to one or more pixel units in the pixel unit array. Optionally, the apertures of the openings corresponding to the same pixel unit in the plurality of light-blocking layers decrease sequentially from top to bottom. In other embodiments, the at least one light-blocking layer is a light-blocking layer, and the thickness of the first light-blocking layer is greater than a preset threshold to ensure imaging quality. Optionally, the metal wiring layer of the pixel unit array is arranged at the rear focal plane position of the microlens array, and the metal wiring layer is formed with an opening above each pixel unit in the pixel unit array to form the bottom light-blocking layer.

[0193] It should be understood that the microlens array and the at least one light blocking layer may be Figure 3 or Figure 4 The optical assembly 132 shown includes a light guide structure, and the pixel unit array may be Figures 1 to 4 The sensing array 133 shown has a plurality of optical sensing units 131 (also referred to as optical sensing pixels, photosensitive pixels, pixel units, etc.), which will not be described again here to avoid repetition.

[0194] like Fig.11 As shown, in some embodiments of the present application, the fingerprint recognition device 80 may further include an array of filter units 82. Each filter unit group in the filter unit group array 82 includes at least two filter units, and the at least two filter units are respectively used to transmit light signals of at least two colors; in other words, the filter unit group array 82 may include at least two filter units for transmitting at least two colors. For example, each filter unit group in the filter unit group array 82 may include a first filter unit 821, a second filter unit 822, and a third filter unit 823. The first filter unit 821, the second filter unit 822, and the third filter unit 823 may be used to transmit red light signals, green light signals, and blue light signals.

[0195] In some embodiments of the present application, the pixel unit array includes a pixel unit group corresponding to the filter unit group, at least two pixel units in the pixel unit group respectively receive a first light signal through the at least two filter units, and the first light signal is used to detect whether the finger is a real finger, and the pixel units in the pixel unit group other than the at least two pixel units receive a second light signal through a transparent area between the at least two filter units, or the pixel units between the pixel unit groups receive the second light signal through a transparent area between the filter unit groups, and the second light signal is used to identify the fingerprint information of the finger.

[0196] Through the fingerprint image collected by the at least two pixel units, it can be determined whether the finger located above the display screen is a real finger, and through the pixel units other than the at least two pixel units, a fingerprint image for fingerprint recognition can be obtained. That is, the fingerprint recognition device collects a fingerprint image once, which can be used not only for true and false recognition, but also for fingerprint recognition, and the security of fingerprint recognition can be improved without affecting the fingerprint recognition effect. For example, the fingerprint image collected by the at least two pixel units is a fingerprint image of two colors. Since fingerprint images of different colors have obvious differences for different materials, the authenticity of the fingerprint image can be determined by comparing fingerprint images of different colors, thereby improving the security of fingerprint recognition.

[0197] It should be noted that the filter unit group array 82 can be arranged above the microlens array, or the filter unit group array 82 can be arranged between the microlens array and the pixel unit array.

[0198] It should also be noted that a transparent area may be provided between the filter element groups in the filter element group array 82, and the transparent area may be a transparent medium or an air gap. For example, the transparent area may be a medium whose transmittance for red, green and blue light signals is greater than or equal to a preset threshold.

[0199] In some embodiments of this application, please continue to refer to Fig.11 The fingerprint recognition device 80 may further include a transparent medium layer 86. The transparent medium layer 86 is used to connect the microlens array, the at least one light blocking layer and the pixel unit array. For example, the transparent medium layer 86 is used to connect the filter unit group array, the at least one light blocking layer and the pixel unit array.

[0200] In some embodiments of this application, please continue to refer to Fig.11 , the fingerprint recognition device 80 may also include a first bonding layer 851, and the first bonding layer 851 is used to bond the microlens array to the upper surface of the filter unit group array 82. Optionally, the fingerprint recognition device 80 may also include a second bonding layer 852, and the second bonding layer 852 is used to set the filter unit group array 82 above the at least one light blocking layer. For example, the second bonding layer 852 is used to bond the filter unit group array 82 to the upper surface of the transparent medium layer 86. The filter unit group array can be embedded in the fingerprint recognition device 80 through the first bonding layer 851 and the second bonding layer 852. The first bonding layer 851 and the second bonding layer 852 can be any form of transparent glue to reduce the loss of optical signals during transmission.

[0201] In some embodiments of this application, please continue to refer to Fig.11 The fingerprint recognition device 80 may further include a first flat layer 881, and the first flat layer 881 is arranged above the pixel unit array to facilitate the setting of the light blocking layer 83.

[0202] For example, the fingerprint recognition device 80 further includes an infrared filter layer 87, which is disposed above the microlens array, or between the microlens array and the pixel unit array, and is used to filter out infrared light signals. Optionally, the first flat layer 881 is disposed on the upper surface of the infrared filter layer 87. Optionally, the fingerprint recognition device 80 may further include a second flat layer 882, which may be disposed above the pixel unit array to facilitate the setting of the infrared filter layer 87. For example, the second flat layer 882 may be disposed between the first flat layer 881 and the infrared filter layer 87.

[0203] At this time, the number of the filter units for transmitting the red light signal in the at least two filter units is greater than the number of the filter units for transmitting the other color light signals in the at least two filter units.

[0204] The number of filter units for transmitting red light signals is designed to be greater than the number of filter units for transmitting other color light signals, so that even if an infrared filter layer is provided between the filter unit group array and the pixel unit array in the fingerprint recognition device, the red fingerprint image used for distinguishing true from false fingerprints can be ensured to have sufficient brightness, thereby improving the recognition effect of the red fingerprint image.

[0205] In some embodiments of this application, please continue to refer to Fig.11 The fingerprint recognition device 80 may also include a pad 841 of the pixel unit array 84, which is used to connect to a circuit board to achieve electrical interconnection within the fingerprint recognition device 80 or to achieve electrical interconnection between the fingerprint recognition device 80 and external devices (such as other devices of the electronic device where the fingerprint recognition device 80 is located).

[0206] It should be understood that Fig.11 The positional relationship between the various components or devices is only an example, and appropriate modifications that can achieve the design requirements of this application are within the scope of protection of this application.

[0207] It should also be noted that, in the above description of the pattern design of the filter unit, the array distribution with the filter unit as the particle size and the array distribution with the filter unit group as the particle size can be used interchangeably, and the embodiments of the present application do not specifically limit this. For ease of description, the following description is based on an example in which the filter unit group array includes a plurality of filter unit groups distributed in an array.

[0208] For example, the filter element group array may include a plurality of filter element groups 90 distributed in an array. Fig.12 As shown, the filter unit group array is a 9*6 filter unit group rectangular array. Fig.13 As shown, the filter unit group array is a 6*6 filter unit group rectangular array. Fig.14 As shown, the filter unit group array is a 7*7 filter unit group rectangular array. Fig.15 As shown, the filter element group array is a 6*4 filter element group rectangular array. Of course, each filter element group in the filter element group array may include a filter element group for transmitting at least two colors of light signals.

[0209] It should be noted that Figures 12 to 15 The filter element group array shown is only an example and should not be construed as limiting the present application.

[0210] For example, the filter unit group array may be a P*L filter unit group array, wherein P and L may be determined according to the number of rows and columns of the pixel unit array, for example, P may be 5, 6, 7, ..., 32, etc., and L may be 5, 6, 7, ..., 32, etc.

[0211] In some embodiments of the present application, each filter unit in the filter unit group corresponds to a plurality of adjacent pixel units in the pixel unit group. For example, the plurality of adjacent pixel units may refer to a plurality of pixel units distributed in a rectangular array, or the plurality of adjacent pixel units may refer to a plurality of continuous pixel units. Optionally, the first light signal received by the plurality of adjacent pixel units is used to synthesize a pixel value. Using the first light signal received by the plurality of adjacent pixel units to synthesize a pixel value can not only improve the brightness of fingerprint images of different colors, but also simplify the preparation complexity of the filter unit group matrix.

[0212] For example, Fig.16 As shown, the pixel unit group is a 20*20 pixel unit rectangular array, the filter unit group is a 4*4 filter unit rectangular array, each filter unit in the 4*4 filter unit rectangular array corresponds to a 2*2 pixel unit rectangular array in the 20*20 pixel unit rectangular array, and two adjacent filter units in the 4*4 filter unit rectangular array are separated by 4 pixel units.

[0213] In other embodiments of the present application, each filter unit in the filter unit group corresponds to a pixel unit in the pixel unit group. For example, the filter units in the filter unit group array are distributed in an array. In other words, the filter unit group array can be distributed in an array with the filter unit group as the granularity, or can be distributed in an array with the filter unit as the granularity.

[0214] By corresponding each filter unit to a pixel unit in the pixel unit group, not only the resolution of fingerprint images of different colors can be improved, but also the at least two pixel units can be evenly distributed in the pixel unit group.

[0215] For example, Fig.17 As shown, the pixel unit group is a 20*20 pixel unit rectangular array, the filter unit group is a 4*4 filter unit rectangular array, and two adjacent filter units in the 4*4 filter unit rectangular array are separated by 5 pixel units. For example, the 4*4 filter unit rectangular array is aligned close to the left and top edges of the 20*20 pixel unit rectangular array.

[0216] Of course, in other alternative embodiments, the 4*4 filter unit rectangular array may also be aligned close to the right side or bottom side of the 20*20 pixel unit rectangular array.

[0217] For example, Fig.18As shown, the pixel unit group is a 2*2 pixel unit rectangular array, and the filter unit group is a 2*2 filter unit rectangular array. In other words, two adjacent filter units in the filter unit group array correspond to two adjacent pixel units in the pixel unit group.

[0218] In some embodiments of the present application, the ratio of the pixel unit corresponding to the filter unit group array to all the pixel units in the pixel unit array is greater than or equal to a first preset value, and the ratio of the pixel unit corresponding to the filter unit group array to all the pixel units in the pixel unit array is greater than or equal to a minimum threshold and less than or equal to a second preset value. For example, the first preset value is 1%, and / or the second preset value is 2%.

[0219] By using the first preset value, it is possible to ensure that the fingerprint image used for real and fake fingerprint identification has sufficient characteristic information, and by using the second preset value, it is possible to ensure that the fingerprint image used for fingerprint information identification has sufficient characteristic information. In other words, by setting the first preset value and the second preset value, it is possible to ensure that the accuracy or correctness of the real and fake fingerprint judgment is improved without affecting the effect of fingerprint identification.

[0220] Of course, the specific values ​​of the first preset value and the second preset value are only examples and should not be understood as limiting the present application. For example, the first preset value may also be 2%, and the second preset value may also be 5%.

[0221] In some embodiments of the present application, the number of pixel units between two adjacent filter unit groups in the filter unit group array is greater than or equal to a third preset value, and the number of pixel units between two adjacent filter unit groups in the filter unit group array is less than or equal to a fourth preset value. For example, the third preset value is 2, and / or the fourth preset value is 6.

[0222] At least two pixel units in the pixel unit group are used for real and fake fingerprint identification. In the fingerprint identification process, the positions of the at least two pixel units can be restored by interpolation. Considering the influence of the filter unit group, the pixel units between the pixel unit groups (for example, Fig.19 As shown, the pixel values ​​of the pixel units adjacent to the pixel unit group above, below, left, and right will be attenuated to a certain extent. Through the third preset value, it can be ensured that there are not only attenuated pixel units but also non-attenuated pixel units between the pixel unit groups (which can be used to restore the pixel values ​​of the pixel units corresponding to the filter units in the filter unit group through interpolation). Through the fourth preset, the correlation between two adjacent pixel unit groups can be ensured, so that for the same position of the finger, it can be determined whether the finger located above the display screen is a real finger through the pixel values ​​of at least two colors.

[0223] Of course, the specific values ​​of the third preset value and the fourth preset value are only examples and should not be construed as limiting the present application. For example, the third preset value may also be 4, and the second preset value may also be 8.

[0224] The preferred embodiments of the present application are described in detail above in conjunction with the accompanying drawings; however, the present application is not limited to the specific details in the above embodiments. Within the technical concept of the present application, a variety of simple modifications can be made to the technical solution of the present application, and these simple modifications all fall within the protection scope of the present application.

[0225] For example, the various specific technical features described in the above specific embodiments can be combined in any suitable manner without contradiction. In order to avoid unnecessary repetition, this application will not further explain various possible combinations.

[0226] For another example, the various implementation modes of the present application may be arbitrarily combined, and as long as they do not violate the concept of the present application, they should also be regarded as the contents disclosed in the present application.

[0227] It should be understood that in the various method embodiments of the present application, the size of the serial numbers of the above-mentioned processes does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.

[0228] An embodiment of the present application also provides an electronic device, which may include a display screen and a fingerprint detection device of the above-mentioned embodiment of the present application, wherein the fingerprint detection device is arranged under the display screen to realize under-screen optical fingerprint detection.

[0229] The electronic device may be any electronic device having a display screen. For example, the electronic device may be Figure 1 The terminal device 10 shown in FIG.

[0230] The display screen may be the display screen described above, such as an OLED display screen or other display screens. For the relevant description of the display screen, please refer to the description of the display screen in the above description. For the sake of brevity, it will not be repeated here.

[0231] It should be understood that the specific examples in the embodiments of the present application are only intended to help those skilled in the art to better understand the embodiments of the present application, rather than to limit the scope of the embodiments of the present application.

[0232] It should be understood that the terms used in the embodiments of the present application and the appended claims are only for the purpose of describing specific embodiments, and are not intended to limit the embodiments of the present application. For example, the singular forms "a", "above", and "the" used in the embodiments of the present application and the appended claims are also intended to include plural forms, unless the context clearly indicates other meanings.

[0233] Those of ordinary skill in the art will appreciate that the units of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of the two. In order to clearly illustrate the interchangeability of hardware and software, the composition and steps of each example have been generally described in terms of function in the above description. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0234] In the several embodiments provided in the present application, it should be understood that the disclosed systems and devices can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces, devices or units, or it can be an electrical, mechanical or other form of connection.

[0235] The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the embodiments of the present application.

[0236] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0237] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions to enable a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), disk or optical disk and other media that can store program codes.

[0238] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of various equivalent modifications or replacements within the technical scope disclosed in the present application, and these modifications or replacements should be included in the protection scope of the present application. Therefore, the protection scope of the present application shall be based on the protection scope of the claims.

Claims

1. A fingerprint recognition device, characterized in that: The fingerprint recognition device is suitable for the bottom of the display screen to realize the under-screen optical fingerprint recognition, and the fingerprint recognition device includes: A microlens array, used for being arranged below the display screen; At least one light-blocking layer is disposed below the microlens array, and each of the at least one light-blocking layer is provided with a pinhole array; A pixel unit array, wherein a metal wiring layer of the pixel unit array is formed with a small hole above each pixel unit in the pixel unit array to form a bottom light blocking layer in the at least one light blocking layer, and the pixel unit array is arranged below the small hole array of the bottom light blocking layer, so that the light signal returned from the finger above the display screen is converged by the microlens array and then transmitted to the pixel unit array through the small hole array arranged in the at least one light blocking layer; A filter unit group array, wherein each filter unit group in the filter unit group array comprises at least two filter units, wherein the at least two filter units are respectively used to transmit light signals of at least two colors, and there is a transparent area between the at least two filter units, or there is a transparent area between the filter unit groups; In which, the pixel unit array includes a pixel unit group corresponding to the filter unit group, at least two pixel units in the pixel unit group respectively receive a first light signal through the at least two filter units, and the first light signal is used to detect whether the finger is a real finger, and the pixel units in the pixel unit group other than the at least two pixel units receive a second light signal through a transparent area between the at least two filter units, or the pixel units between the pixel unit groups receive the second light signal through a transparent area between the filter unit groups, and the second light signal is used to identify the fingerprint information of the finger.

2. The fingerprint recognition device according to claim 1, characterized in that: The ratio of the pixel units corresponding to the filter units in the filter unit group array to all the pixel units in the pixel unit array is less than or equal to 5%.

3. The fingerprint recognition device according to claim 1, characterized in that: The ratio of the pixel units corresponding to the filter unit group array to all the pixel units in the pixel unit array is greater than or equal to 1%.

4. The fingerprint recognition device according to claim 1, characterized in that: The number of pixel units between two adjacent filter unit groups in the filter unit group array is greater than or equal to 2.

5. The fingerprint recognition device according to claim 1, characterized in that: The number of pixel units between two adjacent filter unit groups in the filter unit group array is greater than or equal to 4.

6. The fingerprint recognition device according to claim 1, characterized in that: The number of pixel units between two adjacent filter unit groups in the filter unit group array is less than or equal to 6.

7. The fingerprint recognition device according to claim 1, characterized in that: The number of pixel units between two adjacent filter unit groups in the filter unit group array is less than or equal to 8.

8. The fingerprint recognition device according to claim 1, characterized in that: A plurality of pixel unit groups corresponding to a plurality of filter unit groups in the filter unit group array are discretely distributed in the pixel unit array.

9. The fingerprint recognition device according to claim 1, characterized in that: The at least two filter units are arranged continuously, or some of the at least two filter units are arranged continuously, or the at least two filter units are arranged discretely.

10. The fingerprint recognition device according to claim 1, characterized in that: Among the at least two filter units, the number of consecutive filter units is less than or equal to 8.

11. The fingerprint recognition device according to claim 1, characterized in that: Among the at least two filter units, adjacent filter units include at least a red filter unit and a blue filter unit.

12. The fingerprint recognition device according to claim 11, characterized in that: Among the at least two filter units, adjacent filter units further include a green filter unit.

13. The fingerprint recognition device according to any one of claims 1 to 12, characterized in that: The fingerprint information of the positions of the characteristic pixel units corresponding to the at least two filter units in the pixel unit group is used for restoration through interpolation or fitting calculation.

14. The fingerprint recognition device according to any one of claims 1 to 12, characterized in that: The filter unit group array is arranged between the microlens array and the pixel unit array.

15. The fingerprint recognition device according to any one of claims 1 to 12, characterized in that: The fingerprint recognition device further comprises: The infrared filter layer is arranged between the microlens array and the pixel unit array, and the infrared filter layer is used to filter out infrared light signals.

16. The fingerprint recognition device according to claim 15, characterized in that: The number of the filter units for transmitting red light signals in the at least two filter units is greater than the number of the filter units for transmitting other color light signals in the at least two filter units.

17. The fingerprint recognition device according to any one of claims 1 to 12, characterized in that: The at least one light-blocking layer comprises a plurality of light-blocking layers, and an opening in the small hole array in the top light-blocking layer among the plurality of light-blocking layers corresponds to one or more pixel units in the pixel unit array.

18. The fingerprint recognition device according to claim 17, characterized in that: The apertures of the openings in the plurality of light-blocking layers corresponding to the same pixel unit decrease in sequence from top to bottom.

19. The fingerprint recognition device according to claim 17, characterized in that: The metal wiring layer of the pixel unit array is arranged at the back focal plane position of the microlens array.

20. The fingerprint recognition device according to any one of claims 1 to 12, characterized in that: The fingerprint recognition device further comprises: A transparent dielectric layer; Wherein, the transparent medium layer is used to connect the microlens array, the at least one light blocking layer and the pixel unit array.

21. The fingerprint recognition device according to any one of claims 1 to 12, characterized in that: Each filter unit in the filter unit group corresponds to a plurality of adjacent pixel units in the pixel unit group.

22. The fingerprint recognition device according to claim 21, characterized in that: The pixel unit group is a 20*20 pixel unit rectangular array, the filter unit group is a 4*4 filter unit rectangular array, each filter unit in the 4*4 filter unit rectangular array corresponds to a 2*2 pixel unit rectangular array in the 20*20 pixel unit rectangular array, and two adjacent filter units in the 4*4 filter unit rectangular array are separated by 4 pixel units.

23. The fingerprint recognition device according to any one of claims 1 to 12, characterized in that: Each filter unit in the filter unit group corresponds to a pixel unit in the pixel unit group.

24. The fingerprint recognition device according to claim 23, characterized in that: The pixel unit group is a 20*20 pixel unit rectangular array, the filter unit group is a 4*4 filter unit rectangular array, and two adjacent filter units in the 4*4 filter unit rectangular array are spaced 5 pixel units apart.

25. The fingerprint recognition device according to claim 24, characterized in that: The pixel unit group is a 2*2 pixel unit rectangular array, and the filter unit group is a 2*2 filter unit rectangular array.

26. The fingerprint recognition device according to any one of claims 1 to 12, characterized in that: The filter unit group array is a 9*6 filter unit group rectangular array, or the filter unit group array is a 6*6 filter unit group rectangular array, or the filter unit group array is a 7*7 filter unit group rectangular array, or the filter unit group array is a 6*4 filter unit group rectangular array.

27. An electronic device, characterized in that: include: Display screen; as well as According to any one of claims 1 to 26, the fingerprint recognition device is arranged below the display screen to realize under-screen optical fingerprint detection.

28. A fingerprint recognition method, characterized in that: A fingerprint recognition device is applied to a fingerprint recognition device arranged below a display screen, the fingerprint recognition device is the fingerprint recognition device according to any one of claims 1 to 26, the fingerprint recognition device comprises: an optical fingerprint sensor and at least two filter units, the optical fingerprint sensor comprises a pixel unit array, the pixel unit array comprises a plurality of pixel units, each filter unit in the at least two filter units corresponds to one pixel unit, and the at least two filter units comprise filter units of at least two colors, the at least two filter units are arranged above a characteristic pixel unit in the plurality of pixel units, and the pixel units in the plurality of pixel units other than the characteristic pixel unit are ordinary pixel units; The fingerprint recognition method comprises: Collecting a fingerprint image of the object to be identified by the optical fingerprint sensor, wherein the fingerprint image includes: a fingerprint image collected by the ordinary pixel unit and a fingerprint image collected by the feature pixel unit; Extracting and recombining the grayscale fingerprint image collected by the ordinary pixel unit and the color fingerprint image collected by the characteristic pixel unit; Performing fingerprint matching between the grayscale fingerprint image and the registered fingerprint template to determine whether the match is successful; Determine whether the color fingerprint image comes from a real finger according to the color fingerprint image.

29. The fingerprint recognition method according to claim 28, characterized in that: The step of determining whether the color fingerprint image comes from a real finger according to the color fingerprint image comprises: The color fingerprint image is input into a deep learning network to determine whether the color fingerprint image is from a real finger.

30. The fingerprint recognition method according to claim 28, characterized in that: Before performing fingerprint matching between the grayscale fingerprint image and the registered fingerprint template to determine whether the match is successful, the fingerprint recognition method further includes: Interpolate or fit the fingerprint information that is missing at the position of the characteristic pixel unit in the grayscale fingerprint image.

31. The fingerprint recognition method according to claim 28, characterized in that: The step of performing fingerprint matching between the grayscale fingerprint image and the registered fingerprint template to determine whether the match is successful; and determining whether the color fingerprint image is from a real finger according to the color fingerprint image, comprises: In the case where the grayscale fingerprint image successfully matches the registered fingerprint template, determining whether the color fingerprint image is from a real finger according to the color fingerprint image; or, In the case where it is determined from the color fingerprint image that the color fingerprint image comes from a real finger, the grayscale fingerprint image is matched with a registered fingerprint template to determine whether the match is successful.

32. The fingerprint recognition method according to claim 28, characterized in that: A ratio of the characteristic pixel unit to a total number of pixel units in the optical fingerprint sensor is less than or equal to 5%.

33. The fingerprint recognition method according to claim 28, characterized in that: A ratio of the characteristic pixel unit to a total number of pixel units in the optical fingerprint sensor is greater than or equal to 1%.

Images