Method for registering fingerprint, method for performing fingerprint identification, and electronic device

Abstract

A system and method for registering a fingerprint based on optical fingerprint recognition is described. A fingerprint recognition window is displayed, and a fingerprint recognition sensor driven using a pixel binning scheme based on a first binning size is used to analyze the fingerprint frequency of a user's fingerprint based on reflected light received through the fingerprint recognition window. The first binning size can be evaluated based on the fingerprint frequency. If the first binning size is not suitable for registering the user's fingerprint, a second binning size is selected. Fingerprint information of the user's fingerprint can be obtained again based on the fingerprint recognition sensor driven using the pixel binning scheme based on the second binning size.

Description

[0001] Cross-reference to related applications

[0002] This application claims the benefit of Korean Patent Application No. 10-2019-0081809 filed on July 8, 2019, in the Korean Intellectual Property Office (KIPO), the contents of which are hereby incorporated by reference in their entirety. Technical Field

[0003] Example embodiments relate generally to semiconductor integrated circuits, and more particularly, to a method of registering a fingerprint based on optical fingerprint recognition, a method of performing optical fingerprint recognition using the method of registering a fingerprint, and an electronic device performing the method of registering a fingerprint and the method of performing optical fingerprint recognition. Background Art

[0004] Secure access to personal or commercial electronic devices is an important privacy and security feature. Electronic devices use passwords, personal identification numbers (PINs), patterns, fingerprints, and other technologies to ensure restricted access to user interfaces. In particular, fingerprints are used as a useful method to determine the identity of a user for device access.

[0005] Fingerprint recognition uses an image sensor to identify a user's fingerprint based on the differences in light reflected by the ridges and valleys of the fingertip. Because the differences in reflected light from the finger can be small, accurate fingerprint imaging can be difficult.

[0006] When the pixel size of an image sensor used in fingerprint recognition is large, a large amount of light enters the sensor. This large amount of light helps decipher the light reflected by the valleys and ridges of a fingerprint. However, using large pixels can make it difficult to distinguish fine features of a fingerprint.

[0007] Furthermore, the characteristics of the light reflected by the display panel may vary depending on the pixel size or panel structure. Therefore, the performance of the image sensor may vary in different electronic devices. Changing the design of the fingerprint sensor for each device may increase costs and reduce reliability. Therefore, there is a need in the art for a fingerprint recognition system that can be used for various display devices, regardless of the display structure, without redesigning the fingerprint recognition system. Summary of the Invention

[0008] At least one exemplary embodiment of the present disclosure provides a method for registering a fingerprint based on optical fingerprint recognition, which can efficiently enroll a fingerprint using a pixel binning scheme. At least one exemplary embodiment of the present disclosure provides a method for performing optical fingerprint recognition, which can efficiently detect a fingerprint using a pixel binning scheme. At least one exemplary embodiment of the present disclosure provides an electronic device that performs the method for registering a fingerprint and the method for performing optical fingerprint recognition.

[0009] According to an exemplary embodiment, in a method for registering a fingerprint based on optical fingerprint recognition, a fingerprint recognition window is displayed on at least a portion of a display panel. A fingerprint recognition sensor driven by a pixel binning scheme based on a first binning size is used to analyze a first fingerprint frequency of a first user fingerprint to be registered based on reflected light received through the fingerprint recognition window. Based on the first fingerprint frequency, a determination is made as to whether the first binning size is suitable for registering the first user fingerprint. When the first binning size is not suitable for registering the first user fingerprint, a second binning size different from the first binning size is selected. First fingerprint information of the first user fingerprint is obtained based on the reflected light received through the fingerprint recognition window using a fingerprint recognition sensor driven by a pixel binning scheme based on the second binning size.

[0010] According to an example embodiment, in a method for performing optical fingerprint recognition, during a fingerprint registration mode, at least one user fingerprint is registered based on a fingerprint recognition window displayed on a display panel and a fingerprint recognition sensor driven using a pixel binning scheme. During a fingerprint recognition mode subsequent to the fingerprint registration mode, an input fingerprint is recognized using the fingerprint recognition sensor based on the fingerprint recognition window. When registering the at least one user fingerprint, the fingerprint recognition window is displayed on at least a portion of the display panel. Using the fingerprint recognition sensor driven using a pixel binning scheme based on a first binning size, a first fingerprint frequency of a first user fingerprint to be registered is analyzed based on reflected light received through the fingerprint recognition window. Based on the first fingerprint frequency, a determination is made as to whether the first binning size is suitable for registering the first user fingerprint. If the first binning size is not suitable for registering the first user fingerprint, a second binning size different from the first binning size is selected. Using the fingerprint recognition sensor driven using a pixel binning scheme based on the second binning size, first fingerprint information of the first user fingerprint is obtained based on reflected light received through the fingerprint recognition window, and the first fingerprint information is stored.

[0011] According to an example embodiment, an electronic device includes a display panel, a fingerprint recognition sensor, and a processor. The display panel displays an image and displays a fingerprint recognition window on a partial area. The fingerprint recognition sensor is driven by a pixel merging scheme and performs fingerprint registration and fingerprint recognition. The processor controls the operation of the display panel and the fingerprint recognition sensor. The processor uses a fingerprint recognition sensor driven by a pixel merging scheme based on a first merging size to analyze a first fingerprint frequency of a first user fingerprint to be registered based on reflected light received through the fingerprint recognition window; based on the first fingerprint frequency, determines whether the first merging size is suitable for registering the first user fingerprint; when the first merging size is not suitable for registering the first user fingerprint, selects a second merging size different from the first merging size; and uses a fingerprint recognition sensor driven by a pixel merging scheme based on the second merging size to obtain first fingerprint information of the first user fingerprint based on the reflected light received through the fingerprint recognition window to store the first fingerprint information.

[0012] In a method for registering a fingerprint based on optical fingerprint recognition and a method for performing optical fingerprint recognition according to an exemplary embodiment, fingerprint registration / recognition can be performed by using a fingerprint recognition sensor driven based on a pixel binning scheme. The pixel binning scheme can be applied basically, and thus, a pixel signal of a desired size can be output by combining pixels of a small size to generate a pixel signal. Therefore, since the influence of each pixel in the fingerprint recognition sensor is reduced, the compatibility between the fingerprint recognition sensor and the display panel can be improved, and the performance of fingerprint recognition can be improved.

[0013] In addition, the fingerprint recognition sensor can be driven by an active, adaptive, or intelligent pixel binning scheme, in which the binning size is changed according to the fingerprint frequency of the user's fingerprint. The binning size associated with the pixel binning scheme can be adaptively changed, and an optimized pixel size that meets the characteristics required by the fingerprint sensor and the electronic device can be efficiently determined, thereby further improving the performance of fingerprint recognition.

[0014] According to another embodiment, a method for fingerprint recognition is described. The method may include: selecting a first pixel binning scheme for a fingerprint recognition sensor; identifying first fingerprint information using the fingerprint recognition sensor based on the first pixel binning scheme; determining, based on the first fingerprint information, that the first pixel binning scheme is not suitable; selecting a second pixel binning scheme for the fingerprint sensor based on the determination, wherein the second pixel binning scheme includes a binning size different from the first pixel binning scheme; and identifying second fingerprint information using the fingerprint recognition sensor based on the second pixel binning scheme. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] Illustrative, non-limiting example embodiments will be more clearly understood from the following detailed description taken in conjunction with the accompanying drawings.

[0016] Figure 1 is a flowchart illustrating a method of registering a fingerprint based on optical fingerprint recognition according to example embodiments.

[0017] Figure 2 is a plan view of an electronic device according to example embodiments.

[0018] Figure 3A 、 Figure 3B and Figure 3C It is along Figure 2 1 is a cross-sectional view of an example of an electronic device taken along line AA′.

[0019] Figure 4A 、 Figure 4B 、 Figure 4C and Figure 4D is a diagram for describing a pixel binning scheme of a fingerprint recognition sensor used in a method of registering a fingerprint based on optical fingerprint recognition according to example embodiments.

[0020] Figure 5 It shows Figure 2 A block diagram of an example of an electronic device.

[0021] Figure 6 is a flowchart illustrating a method of registering a fingerprint based on optical fingerprint recognition according to example embodiments.

[0022] Figure 7 It shows Figure 6 Flowchart of an example of setting the first merge size in .

[0023] Figure 8 is a flowchart illustrating a method of registering a fingerprint based on optical fingerprint recognition according to example embodiments.

[0024] Figure 9 It shows Figure 8 Flowchart of an example of registering a second user fingerprint in .

[0025] Figure 10 is a flowchart illustrating a method of performing optical fingerprint recognition according to example embodiments.

[0026] Figure 11 and Figure 12 It shows Figure 10 Flowchart of an example of identifying an input fingerprint in .

[0027] Figure 13 and Figure 14 is a flowchart illustrating a method of performing optical fingerprint recognition according to example embodiments.

[0028] Figure 15A and Figure 15B is a diagram illustrating an example process of a method for performing optical fingerprint recognition according to example embodiments.

[0029] Figure 16 is a block diagram illustrating an electronic device according to example embodiments. DETAILED DESCRIPTION

[0030] According to embodiments of the present disclosure, a fingerprint sensor can be adjusted to have desired pixel size characteristics by combining smaller pixels. This dynamic adjustment capability improves the compatibility between the fingerprint sensor and the display panel during mobile device manufacturing. Consequently, by reducing the impact of each pixel in the fingerprint sensor, fingerprint recognition performance can be improved and manufacturing defect rates can be reduced.

[0031] In addition, a pixel binning scheme that can be used in an image sensor to perform various functions is described. As an example, in this disclosure, the pixel binning scheme is applied to a fingerprint recognition sensor, but it may also have a variety of other applications.

[0032] Various example embodiments will be described more fully with reference to the accompanying drawings that illustrate embodiments. However, the present disclosure can be embodied in many different forms and should not be construed as being limited to the embodiments set forth herein. Throughout this application, the same reference numerals refer to the same elements.

[0033] Figure 1 is a flowchart illustrating a method of registering a fingerprint based on optical fingerprint recognition according to example embodiments.

[0034] refer to Figure 1 , the method for registering a fingerprint based on optical fingerprint recognition according to an exemplary embodiment is performed by an electronic device. The electronic device includes a display panel and a fingerprint recognition sensor. The display panel includes a plurality of light sources, and the fingerprint recognition sensor performs optical fingerprint recognition using light provided from the plurality of light sources. Reference will be made to Figures 2 to 5 Describe the detailed configuration of the electronic device.

[0035] In a method for registering a fingerprint based on optical fingerprint recognition according to an exemplary embodiment, a fingerprint recognition window is displayed on at least a portion of a display panel (step S100). For example, a subset of light sources among a plurality of light sources included in the display panel may be driven to display the fingerprint recognition window. The subset of light sources may be arranged to correspond to the fingerprint recognition window, which is a partial area of the display panel. For example, all of the subset of light sources may be turned on or emit light substantially simultaneously or concurrently.

[0036] A fingerprint recognition sensor driven by a pixel binning scheme based on a first binning size is used to analyze a first fingerprint frequency of a first user fingerprint to be registered based on reflected light received through a fingerprint recognition window (step S200). For example, light generated from a subset of light sources may be reflected by an object on the fingerprint recognition window (e.g., a user's finger including the first user fingerprint). The reflected light from the object may be provided to the fingerprint recognition sensor. As a result, the fingerprint recognition sensor may obtain data associated with the first fingerprint frequency based on the reflected light from the object.

[0037] For example, the fingerprint frequency may correspond to the density of ridges and valleys in the fingerprint. If the fingerprint frequency is high (corresponding to a high density of fingerprint features, which may be relatively small), it may be appropriate to use smaller pixels (or smaller pixel bins). On the other hand, if the fingerprint frequency is low (corresponding to a low density of fingerprint features, which may be relatively large), it may be appropriate to use larger pixels (or larger pixel bins).

[0038] In some example embodiments, the first merged size may be one of the values between the minimum merged size and the maximum merged size. In other words, the first merged size may be greater than or equal to the minimum merged size and less than or equal to the maximum merged size. For example, when manufacturing an electronic device including a display panel and a fingerprint recognition sensor, the first merged size may be pre-set, pre-determined, and pre-stored. The first merged size may be referred to as an initial merged size and / or a default merged size. Figures 4A to 4D Describe the pixel binning scheme.

[0039] To register a first user fingerprint (step S300), a first merge size is determined based on a first fingerprint frequency. For example, the determination operation of step S300 can be performed based on a pre-stored lookup table including a relationship between fingerprint frequency and merge size.

[0040] When the first binning size is not suitable for registering the first user's fingerprint (step S300: No), a second binning size different from the first binning size is selected (step S400). First fingerprint information about the first user's fingerprint is obtained based on the reflected light received through the fingerprint recognition window using a fingerprint recognition sensor driven by a pixel binning scheme based on the second binning size to store the first fingerprint information (step S500). In other words, the binning size associated with the pixel binning scheme can be changed to be suitable for registering the first user's fingerprint. As a result, fingerprint registration can be performed based on the changed binning size. For example, like the first binning size, the second binning size can be one of the values between the minimum binning size and the maximum binning size.

[0041] If the first binning size is suitable for registering the first user's fingerprint (step S300: Yes), the fingerprint recognition sensor is used to obtain first fingerprint information based on the reflected light received through the fingerprint recognition window. The fingerprint recognition sensor is driven using a pixel binning scheme based on the first binning size to store the first fingerprint information (step S600). In other words, the binning size associated with the pixel binning scheme can be maintained, and fingerprint registration can be performed while maintaining the binning size.

[0042] In a method for registering a fingerprint based on optical fingerprint recognition according to an example embodiment, fingerprint registration / recognition can be performed by using a fingerprint recognition sensor. In this case, the fingerprint recognition sensor is driven based on a pixel merging scheme. Unlike conventional techniques that rely on the characteristics of a display panel to design pixels included in a fingerprint recognition sensor, a pixel merging scheme can be applied in the present disclosure. As a result, a pixel signal having a specific size can be output by generating one pixel signal by combining pixels of small sizes. Therefore, the compatibility between the fingerprint recognition sensor and the display panel can be improved. As a result, the performance of fingerprint recognition can be improved due to the reduction of the influence of each pixel in the fingerprint recognition sensor.

[0043] Furthermore, in a method for registering fingerprints based on optical fingerprint recognition according to an exemplary embodiment, the fingerprint recognition sensor can be driven by an active, adaptive, or intelligent pixel binning scheme. The active, adaptive, or intelligent pixel binning scheme provides a binning size to be varied based on the fingerprint frequency of the user's fingerprint. The binning size associated with the pixel binning scheme can be adaptively varied. As a result, an optimized pixel size that meets the characteristics of the fingerprint recognition sensor and the electronic device used can be efficiently determined. As a result, fingerprint recognition performance can be further improved.

[0044] Figure 2 is a plan view of an electronic device according to example embodiments.

[0045] refer to Figure 2 , the electronic device 100 includes a display panel 110 to interact with the user. The display panel 110 outputs visual information to the user. Although not in Figure 2 , the electronic device 100 may further include a touch sensor panel for sensing a user's touch input. The user may input a signal to the electronic device 100 through the touch sensor panel.

[0046] A fingerprint recognition window FRW may be provided on the display panel 110. Figure 3A As described above, the fingerprint recognition sensor for fingerprint detection can be arranged to correspond spatially to the position of the fingerprint recognition window FRW. Figure 2The fingerprint recognition window FRW is illustrated as a rectangle in and subsequent drawings, but according to example embodiments, the shape of the fingerprint recognition window FRW may be changed.

[0047] In some example embodiments, the electronic device 100 may be or include any mobile system, such as a mobile phone, a smart phone, a tablet computer, a laptop computer, a personal digital assistant (PDA), a portable multimedia player (PMP), a digital camera, a portable game console, a music player, a camcorder, a video player, a navigation device, a wearable device, an Internet of Things (IoT) device, an Internet of Everything (IoE) device, an e-book reader, a virtual reality (VR) device, an augmented reality (AR) device, a robotic device, etc.

[0048] The present disclosure may provide an interface for detecting fingerprints. For example, when a user contacts or approaches the touch sensor panel or the display panel 110, the function of fingerprint detection may be performed. According to the present disclosure, the interface for fingerprint detection and the fingerprint recognition sensor may share an area on the electronic device 100 with the touch sensor panel and the display panel 110. As a result, the interface and the fingerprint recognition sensor may not use an additional area on the electronic device 100. Therefore, a reduced size of the electronic device 100 may be possible. Additionally, the spare area of the electronic device 100 may be used for other features.

[0049] Figure 3A 、 Figure 3B and Figure 3C It is along Figure 2 1 is a cross-sectional view of an example of an electronic device taken along line AA′.

[0050] refer to Figure 3A In the fingerprint registration mode and / or fingerprint recognition mode, the fingerprint recognition window FRW may be displayed on a partial area (or portion) of the display panel 110. The display panel 110 may include a plurality of light sources 112. For example, as shown in FIG. Figure 5 As described, the plurality of light sources 112 may be included in a plurality of pixels included in the display panel 110 .

[0051] Among the plurality of light sources 112, a subset 114 of light sources arranged to correspond to the fingerprint recognition window FRW may be driven substantially simultaneously. Figure 3A In FIG. 1 , the light source 114 that is driven and emits light is hatched.

[0052] The fingerprint recognition sensor 130a can be arranged below the display panel 110 so that the fingerprint recognition sensor 130a can overlap with the fingerprint recognition window FRW in the vertical direction. In other words, the display panel 110 can include a first surface on which an image is displayed and a second surface opposite to the first surface. Additionally, the fingerprint recognition sensor 130a can be arranged below the second surface of the display panel 110.

[0053] The fingerprint recognition sensor 130a may include an image sensor 132a. The image sensor 132a may be an optical sensor. The image sensor 132a may be arranged under the display panel 110 and may generate an image signal for an object on the partial area based on reflected light received through the fingerprint recognition window FRW. Figure 3A The fingerprint recognition sensor 130a in FIG. 1 may be implemented in a direct manner in which the image sensor 132a directly receives reflected light.

[0054] For example, Figure 3A As shown, when a user places a finger 10 on the fingerprint recognition window FRW, light generated by the light source 114 within the fingerprint recognition window FRW can be reflected by the fingerprint of the finger 10. The reflected light of the fingerprint can be provided to the fingerprint recognition sensor 130a. The fingerprint recognition sensor 130a can capture an image signal for the fingerprint or information associated with the shape of the fingerprint (e.g., a fingerprint image) based on the reflected light of the fingerprint received through the fingerprint recognition window FRW.

[0055] In some example embodiments, the display panel 110 may be implemented as a rigid or flexible configuration. The size of the image sensor 132 a may correspond to the size of the fingerprint recognition window FRW. The effective pixel size of the image sensor 132 a may be implemented to meet the characteristics of the display panel 110.

[0056] refer to Figure 3B ,Apart from Figure 3B The fingerprint recognition sensor 130b includes an image sensor 132b and a lens 134b. Figure 3B The example can be compared with Figure 3A The examples are basically the same. Therefore, repeated descriptions will be omitted.

[0057] The lens 134b may be disposed below the display panel 110 (e.g., between the display panel 110 and the image sensor 132b). The lens 134b may focus reflected light received through the fingerprint recognition window FRW onto the image sensor 132b. The image sensor 132b may be disposed below the lens 134b and may generate an image signal for an object in a partial area based on the reflected light focused by the lens 134b. Figure 3BThe fingerprint recognition sensor 130b in FIG. 1 may be implemented in the form of a compact camera module (CCM) including an image sensor 132b and a lens 134b.

[0058] In some example embodiments, the size of the image sensor 132b may vary depending on the distance between the display panel 110, the lens 134b, and the image sensor 132b, or may vary depending on the structure of the lens 134b. Specifically, because the lens 134b concentrates the reflected light, when the size of the fingerprint recognition window FRW is the same, in a plan view or on a plane, Figure 3B The area of the image sensor 132b may be smaller than Figure 3A The area of the image sensor 132a in FIG.

[0059] refer to Figure 3C ,Apart from Figure 3C The fingerprint recognition sensor 130c includes an image sensor 132c and an optical filter 136c. Figure 3C The example can be compared with Figure 3A The examples are basically the same. Therefore, repeated descriptions are omitted.

[0060] The optical filter 136c may be disposed below the display panel 110 (e.g., between the display panel 110 and the image sensor 132c). The optical filter 136c may adjust the frequency characteristics and / or polarization characteristics of the reflected light received through the fingerprint recognition window FRW. The image sensor 132c may be disposed below the optical filter 136c and may generate an image signal for an object on a partial area based on the reflected light filtered by the optical filter 136c.

[0061] In some example embodiments, the optical filter 136c may be embedded in the image sensor 132c or attached to the surface of the image sensor 132c.

[0062] Although not in Figure 3A 、 Figure 3B and Figure 3C , but the fingerprint recognition sensor may include part of the image sensor, lens, and optical filter. For example, the lens, optical filter, and image sensor may be sequentially arranged below the display panel. According to example embodiments, the optical filter may be arranged in a lens barrel.

[0063] Figure 4A 、 Figure 4B 、 Figure 4C and Figure 4Dis a diagram for describing a pixel binning scheme of a fingerprint recognition sensor used in a method of registering a fingerprint based on optical fingerprint recognition according to example embodiments.

[0064] refer to Figure 4A , an image sensor included in a fingerprint recognition sensor (e.g., Figure 3A The image sensor 132a) in may include a pixel array 131a.

[0065] Figure 4A The pixel array 131a is shown as being driven by a general driving scheme rather than a pixel merging scheme. The pixel array 131a may include a plurality of pixels (or unit pixels) P arranged in a matrix form. Each of the plurality of pixels P may be connected to a corresponding one of a plurality of rows and a corresponding one of a plurality of columns. For the convenience of explanation, Figure 4A A pixel array 131 a including 144 pixels P is shown.

[0066] Each of the plurality of pixels P may perform photoelectric conversion based on incident light and may generate a corresponding one of a plurality of analog pixel signals corresponding to the incident light. The plurality of pixels P may be physically separated or distinguished from each other. As a result, an analog pixel signal may be generated from each pixel.

[0067] refer to Figure 4B , shows a 2×2 pixel binning scheme driven by Figure 4A In other words, Figure 4B The pixel array 131b is shown being driven by a pixel binning scheme based on a binning size of "2".

[0068] Figure 4B Each of the plurality of merged pixels PA included in the pixel array 131b may correspond to Figure 4A Among the multiple pixels P in the image, four pixels are arranged in a 2×2 matrix. Figure 4A The four analog pixel signals generated by the four pixels arranged in a 2×2 matrix are summed to generate the Figure 4B As a result, the pixel array 131b can be driven using a reduced number of binning pixels PA (eg, from 144 to 36). Therefore, even if the amount of incident light is reduced, efficient sensing can be performed.

[0069] In some example embodiments, a pixel merging scheme may be implemented by changing a readout method from the pixel array 131 b or by changing a digital processing method of an image sensor including the pixel array 131 b. For example, the pixel merging scheme may be implemented as a charge merging scheme in which photocharges collected in pixels are summed and read out. Additionally or alternatively, a digital merging scheme may be implemented in which analog pixel signals output from pixels are summed after digital conversion.

[0070] refer to Figure 4C , shows a 3×3 pixel binning scheme driven by Figure 4A In other words, Figure 4C The pixel array 131c is shown being driven by a pixel binning scheme based on a binning size of "3".

[0071] Figure 4C Each of the plurality of merged pixels PB included in the pixel array 131c may correspond to Figure 4A Among the plurality of pixels P in the image, nine pixels are arranged in a 3×3 matrix. Figure 4A The nine analog pixel signals generated by the nine pixels arranged in a 3×3 matrix are summed to generate the Figure 4C As a result, 16 binning pixels PB can be used instead of 144 pixels P to drive the pixel array 131 c.

[0072] refer to Figure 4D , shows a 4×4 pixel binning scheme driven by Figure 4A In other words, Figure 4C The pixel array 131d is shown being driven by a pixel binning scheme based on a binning size of "4".

[0073] Figure 4D Each of the plurality of binning pixels PC included in the pixel array 131d may correspond to Figure 4A Sixteen pixels are arranged in a 4×4 matrix among the plurality of pixels P in Figure 4A The sixteen analog pixel signals generated by the sixteen pixels arranged in a 4×4 matrix are summed to generate the signal for Figure 4D As a result, 9 binning pixels PC can be used instead of 144 pixels P to drive the pixel array 131d.

[0074] Although referenced Figures 4A to 4DThe pixel merging scheme based on a specific number of pixels and a specific binning size is described, but the example embodiments are not limited thereto. Therefore, according to the example embodiments, the number of pixels and the binning size may be changed. In addition, although reference has been made to Figures 4B to 4D An N×N pixel binning scheme is described, where N is a natural number greater than or equal to 2, but example embodiments are not limited thereto. An N×M pixel binning scheme, where M is a natural number different from N, may also be employed.

[0075] Figure 5 It shows Figure 2 A block diagram of an example of an electronic device.

[0076] refer to Figure 5 The electronic device 100 includes a display panel 110, a fingerprint recognition sensor 130, and a processor 140. The electronic device 100 may further include a display driver 120 and a memory 150.

[0077] The display panel 110 outputs visual information to the user. The display panel 110 may include a plurality of pixels PX arranged along rows and columns to display an image. Each pixel may be configured to emit light of a specific color that forms an image. When the plurality of pixels PX emit light together, the display panel 110 may display an image. For example, the plurality of pixels PX may correspond to Figure 4A Multiple pixels P in .

[0078] In some example embodiments, the display panel 110 may be an electroluminescent display panel. The electroluminescent display panel may be driven with a fast response speed and low power consumption using a light-emitting diode (LED) or an organic light-emitting diode (OLED) that generates light through the recombination of electrons and holes. Compared to a liquid crystal display panel using a backlight unit, the pixels PX of the electroluminescent display panel can emit light by themselves. As a result, the reflected light received through the fingerprint recognition window FRW can be provided to the fingerprint recognition sensor 130 under the display panel 110 through the space (gap) between the pixels PX. The light-emitting diode or organic light-emitting diode included in the pixel PX may correspond to the light source included in the display panel according to the example embodiment. However, the example embodiment is not limited thereto, and the display panel 110 may be any display panel having a structure in which the reflected light received through the fingerprint recognition window FRW can be provided to the fingerprint recognition sensor 130.

[0079] The display driver 120 may control the operation of the display panel 110 and may drive the display panel 110. For example, the display driver 120 may appropriately drive each pixel of the display panel 110 in response to a command of the processor 140 so that an image is displayed on the display panel 110. For example, the display driver 120 may partially drive the display panel 110 so that the pixels corresponding to the fingerprint recognition window FRW emit light. Figure 5 , but the display driver 120 may include a data driver, a scan driver, a timing controller, a gamma circuit, and the like.

[0080] The fingerprint recognition sensor 130 may be used to detect a fingerprint. The fingerprint recognition sensor 130 may generate / output an image signal associated with an object on the fingerprint recognition window FRW. For example, the fingerprint recognition sensor 130 may be operable to obtain an image signal associated with a fingerprint of a finger that is in contact with or close to the fingerprint recognition window FRW. For example, the fingerprint recognition sensor 130 may correspond to Figure 3A 、 Figure 3B and Figure 3C The fingerprint recognition sensors 130a, 130b and 130c in.

[0081] The fingerprint recognition sensor 130 may provide optical fingerprint recognition or optical-based fingerprint detection. For example, the image sensor included in the fingerprint recognition sensor 130 may include a photodiode that generates current in response to light.

[0082] The processor 140 may control the overall operation of the electronic device 100. The processor 140 may process / perform various arithmetic / logical operations to provide the functions of the electronic device 100.

[0083] The processor 140 can communicate with the display driver 120, the fingerprint sensor 130, and the memory 150. The processor 140 can control the operation of the display driver 120, the fingerprint sensor 130, and the memory 150. The processor 140 can process commands, requests, responses, and / or the like associated with the operation of the display driver 120, the fingerprint sensor 130, and the memory 150. For example, the processor 140 can provide various information to the display driver 120 to display an image on the display panel 110. For example, the processor 140 can control the timing / sequence of the operation of the display panel 110 and the fingerprint sensor 130 so that the fingerprint sensor 130 generates an image signal associated with the fingerprint. For example, the processor 140 can generate and analyze image information associated with the fingerprint based on the image signal output from the fingerprint sensor 130. For example, the processor 140 can store the associated data in the memory 150 or load the associated data from the memory 150.

[0084] In some example embodiments, the processor 140 may include one or more dedicated circuits to perform various operations. The dedicated circuits may include a field programmable gate array (FPGA), an application specific integrated circuit (ASIC), and / or the like. For example, the processor 140 may include one or more processor cores that can perform various operations. For example, the processor 140 may be implemented using a general-purpose processor, a dedicated processor, or an application processor.

[0085] The memory 150 may store data related to the operation of the electronic device 100. For example, the memory 150 may store a minimum combined size, a maximum combined size, a first combined size, a second combined size, a lookup table, etc. for performing the method of registering a fingerprint based on optical fingerprint recognition according to an example embodiment.

[0086] In some example embodiments, the memory 150 may include at least one of various volatile memories, such as dynamic random access memory (DRAM), static random access memory (SRAM), etc. The memory 150 may also include at least one of various nonvolatile memories, such as flash memory, phase change random access memory (PRAM), resistive random access memory (RRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), nano-floating gate memory (NFGM), polymer random access memory (PoRAM), etc.

[0087] In some example embodiments, the display driver 120, the fingerprint recognition sensor 130, the processor 140, and the memory 150 may be implemented as separate circuits / modules / chips. In other example embodiments, based on their functions, some of the display driver 120, the fingerprint recognition sensor 130, the processor 140, and the memory 150 may be combined into one circuit / module / chip, or may be further separated into multiple circuits / modules / chips.

[0088] The electronic device 100 may perform a reference Figure 1 For example, the display panel 110 and the display driver 120 may perform Figure 1 In step S100, the fingerprint recognition sensor 130 may perform Figure 1 Steps S200, S500 and S600 in the process, and the processor 140 may execute Figure 1 In addition, the electronic device 100 may execute the reference Figures 6 to 9 The method of registering fingerprints described, and / or will refer to Figures 10 to 14 A method of performing optical fingerprint recognition is described.

[0089] Figure 6 is a flowchart illustrating a method for registering a fingerprint based on optical fingerprint recognition according to an example embodiment. Figure 1 Duplicate description.

[0090] refer to Figure 6 In the method of registering a fingerprint based on optical fingerprint recognition according to example embodiments, a first merge size may be set based on a minimum merge size and a maximum merge size (step S700). Figure 6 Steps S100, S200, S300, S400, S500 and S600 after step S700 in the process can be respectively Figure 1 Steps S100, S200, S300, S400, S500 and S600 in FIG. 1 are substantially the same.

[0091] In some example embodiments, the operation of setting the first merged size in step S700 may be performed when the electronic device is manufactured. In this case, the electronic device may include a display panel and a fingerprint recognition sensor. For example, step S700 may be performed by an external testing device and / or design device when the electronic device is manufactured. The first merged size may be set and stored when the electronic device is manufactured. Thereafter, the operation of loading the first merged size already stored in the memory 150 may be performed in step S700. In this example, steps S100, S200, S300, S400, S500, and S600 may be performed by loading the stored first merged size.

[0092] Figure 7 It shows Figure 6 Flowchart of an example of setting the first merge size in .

[0093] refer to Figure 6 and Figure 7 , when the first binning size is set (step S700), the minimum binning size may be determined based on the optical characteristics of the display panel (step S710). For example, the optical characteristics of the display panel may include the transmittance of reflected light. If the size of the pixels included in the display panel is relatively large, the transmittance of the display panel is relatively low. Additionally, if the amount of incident light is relatively small, a valid signal for fingerprint recognition may not be obtained from a single pixel of the fingerprint recognition sensor. As a result, a minimum binning size corresponding to the minimum pixel size for obtaining a valid signal may be determined.

[0094] The maximum binning size may be determined based on the target fingerprint frequency (step S720). For example, the target fingerprint frequency may include an average of frequencies resulting from ridges and valleys of the fingerprint obtained from various samples of the fingerprint image. The ridges and valleys of the fingerprint may be distinguishable to perform fingerprint recognition. As a result, a maximum binning size corresponding to the maximum pixel size for distinguishing the ridges and valleys of the fingerprint may be determined.

[0095] A value between the minimum binning size and the maximum binning size that minimizes sensing noise may be selected as the first binning size (step S730). For example, the first binning size may be relatively large compared to the size of a pixel in the fingerprint recognition sensor. The relatively large first binning size may be used to accurately receive a fingerprint image signal while being smaller than the maximum size sufficient to distinguish between ridges and valleys of a fingerprint.

[0096] Figure 8 is a flowchart illustrating a method for registering a fingerprint based on optical fingerprint recognition according to an example embodiment. Figure 1 Duplicate description.

[0097] refer to Figure 8 , in the method of registering a fingerprint based on optical fingerprint recognition according to an example embodiment, Figure 8 Step S100 can be Figure 1 The step S100 in is basically the same.

[0098] A first user fingerprint is registered or recorded based on a fingerprint recognition sensor driven by a pixel binning scheme based on a first binning size or a second binning size (step S1100). Figure 8 Step S1100 may include Figure 1 Steps S200, S300, S400, S500 and S600 in FIG.

[0099] A second user fingerprint different from the first user fingerprint is registered or recorded based on the fingerprint recognition sensor driven by the pixel binning scheme based on the first binning size or the third binning size (step S1200). Figure 9 Descriptively, Figure 8 Step S1200 in can be similar to Figure 8 Step S1100 in .

[0100] Figure 9 It shows Figure 8 Flowchart of an example of registering a second user fingerprint in .

[0101] refer to Figure 8 and Figure 9When registering a second user fingerprint (step S1200), a second fingerprint frequency of the second user fingerprint to be registered may be analyzed. The second user fingerprint analysis may be based on reflected light received through the fingerprint recognition window using a fingerprint recognition sensor driven by a pixel binning scheme based on a first binning size (step S1210). Alternatively, to register the second user fingerprint (step S1220), the first binning size is determined based on the second fingerprint frequency.

[0102] If the first binning size is not suitable for registering the second user's fingerprint (step S1220: No), a third binning size different from the first binning size may be selected (step S1230). A fingerprint recognition sensor driven by a pixel binning scheme based on the third binning size may be used to obtain second fingerprint information about the second user's fingerprint based on reflected light received through the fingerprint recognition window, and the second fingerprint information may be stored (step S1240).

[0103] When the first binning size is suitable for registering the second user's fingerprint (step S1220: Yes), second fingerprint information may be obtained. The second fingerprint information may be stored based on the reflected light received through the fingerprint recognition window using a fingerprint recognition sensor driven by a pixel binning scheme based on the first binning size (step S1250).

[0104] Figure 9 Steps S1210, S1220, S1230, S1240 and S1250 in Figure 1 Steps S200, S300, S400, S500, and S600 in FIG. 1 are substantially the same. Therefore, repeated descriptions will be omitted.

[0105] In some example embodiments, the third merged size may be substantially equal to the second merged size. In other words, the first user fingerprint and the second user fingerprint may be registered based on the same merged size. In other example embodiments, the third merged size may be different from the second merged size. In other words, the first user fingerprint and the second user fingerprint may be registered based on different merged sizes.

[0106] In the method for registering a fingerprint based on optical fingerprint recognition according to an exemplary embodiment, when multiple user fingerprints are to be registered, an optimized combined size may be determined for each user fingerprint, and fingerprint registration may be performed based on the optimized combined size.

[0107] Although not in Figure 8 shown in , but when Figure 8In the example of registering a third user fingerprint different from the first user fingerprint and the second user fingerprint, an operation of registering the third user fingerprint may be further performed. Registering the third user fingerprint may be based on a fingerprint recognition sensor driven by a pixel binning scheme based on the first binning size or the fourth binning size. In addition, additional user fingerprints may be registered in a similar manner. In addition, although not in Figure 8 shown in , but can be Figure 8 Further implementation reference in the example Figure 6 Step S700 is described.

[0108] Figure 10 is a flowchart illustrating a method of performing optical fingerprint recognition according to example embodiments.

[0109] refer to Figure 10 , the method of performing optical fingerprint recognition according to an example embodiment is performed by an electronic device including a display panel and a fingerprint recognition sensor. The electronic device may be a reference Figures 2 to 5 Description of electronic equipment.

[0110] In a method for performing optical fingerprint recognition according to an example embodiment, during a fingerprint registration mode, at least one user fingerprint is registered based on a fingerprint recognition window displayed on a display panel and a fingerprint recognition sensor driven by a pixel binning scheme (step S2100). For example, the fingerprint registration mode may be entered based on a predetermined request. For example, the fingerprint registration mode may be entered based on a reference signal. Figure 1 as well as Figures 6 to 9 The method described herein for registering fingerprints based on optical fingerprint recognition is performed Figure 10 An optimized combined size may be determined for each user fingerprint, and fingerprint registration may be performed efficiently based on the optimized combined size.

[0111] During the fingerprint recognition mode following the fingerprint registration mode, the fingerprint recognition sensor is used to recognize an input fingerprint based on the fingerprint recognition window (step S2200). For example, the fingerprint recognition mode may be entered based on a predetermined request. For example, the request may be associated with a signal or action that directs the detection of a fingerprint.

[0112] For example, the request may occur when any input is received from the user via the electronic device 100, based on received input and / or similarly generating a signal / command in the electronic device 100. For example, the request may occur when the user contacts or approaches any area on the touch sensor panel or display panel 110 with the finger 10 (e.g., the request may occur in response to the touch of the finger 10 or any other suitable object). For example, the request may occur when the finger 10 performs a specific motion or gesture near the electronic device 100. For example, the request may occur when the electronic device 100 moves in a specific manner. However, example embodiments are not limited thereto, and the request may be changed or modified to identify guidance for fingerprint detection.

[0113] For example, the request may occur when the electronic device 100 is in an idle state or the display panel 110 is not driven. For example, the request may occur when the display panel 110 is in standby mode. Here, standby mode may mean an operating mode in which the display panel 110 displays a reduced or minimal amount of information (e.g., the current time, date, and / or the like), and may also be referred to as an “always ON display (AOD)” mode, an “active display mode,” and / or the like. For example, the request may occur when the display panel 110 is in normal mode. Here, normal mode may mean an operating mode in which the display panel 110 displays various information according to the user's intention.

[0114] Figure 11 and Figure 12 It shows Figure 10 Flowchart of an example of identifying an input fingerprint in . Figure 11 Shows that when based on Figure 1 Example execution of Figure 10 Step S2100 in FIG. 1 is an example of identifying an input fingerprint. Figure 12 Shows that when based on Figure 8 Example execution of Figure 10 Step S2100 in FIG. 1 is an example of identifying an input fingerprint.

[0115] refer to Figure 10 and Figure 11 When the input fingerprint is recognized (step S2200), a fingerprint recognition window may be displayed on a partial area of the display panel (step S2210). Figure 11 Step S2210 in Figure 1 Step S100 in FIG. 1 is substantially the same as that in FIG. 1 . Therefore, repeated description will be omitted.

[0116] The fingerprint recognition sensor driven by the pixel binning scheme based on the first binning size or the second binning size may be used to obtain information about the input fingerprint based on the reflected light received through the fingerprint recognition window (step S2220). Figure 1 When registering the first fingerprint information about the first user's fingerprint in step S500, the information about the input fingerprint can be obtained based on the fingerprint recognition sensor driven by the pixel binning scheme based on the second binning size. Figure 1 When registering the first fingerprint information in step S600, information about the input fingerprint may be obtained based on the fingerprint recognition sensor driven by the pixel binning scheme based on the first binning size.

[0117] refer to Figure 10 and Figure 12 When an input fingerprint is recognized (step S2200), a fingerprint recognition window may be displayed on a partial area of the display panel (step S2210). A fingerprint recognition sensor driven by a pixel binning scheme based on a first binning size or a second binning size may be used to obtain first information about the input fingerprint based on reflected light received through the fingerprint recognition window (step S2220a). Figure 12 Steps S2210 and S2220a in Figure 11 Steps S2210 and S2220 in FIG. 2 are substantially the same. Therefore, repeated descriptions will be omitted.

[0118] The second information about the input fingerprint can be obtained based on the reflected light received through the fingerprint recognition window using the fingerprint recognition sensor driven by the pixel binning scheme based on the first binning size or the second binning size (step S2230). Figure 9 When registering the second fingerprint information about the second user's fingerprint in step S1240, the second information about the input fingerprint can be obtained based on the fingerprint recognition sensor driven by the pixel binning scheme based on the third binning size. Figure 9 When registering the second fingerprint information in step S1250, the second information about the input fingerprint may be obtained based on the fingerprint recognition sensor driven by the pixel binning scheme based on the first binning size.

[0119] When registering a first user fingerprint and a second user fingerprint based on different merge sizes, the input fingerprint may not be confirmed as the first user fingerprint or the second user fingerprint. As a result, information about the input fingerprint may be obtained twice based on different merge sizes, and the input fingerprint may be identified based on the obtained information. Similarly, when registering multiple user fingerprints based on three or more different merge sizes, information about the input fingerprint may be obtained multiple times based on different merge sizes.

[0120] In some example embodiments, when the first user fingerprint and the second user fingerprint are registered based on the same combined size, step S2230 may be omitted. For example, when the third combined size is substantially equal to the second combined size, or when both the first user fingerprint and the second user fingerprint are registered based on the first combined size, the operation of step S2230 is omitted.

[0121] Figure 13 and Figure 14 is a flowchart illustrating a method of performing optical fingerprint recognition according to an example embodiment. Figure 10 Duplicate description.

[0122] refer to Figure 13 , in a method of performing optical fingerprint recognition according to example embodiments, Figure 13 Steps S2100 and S2200 in Figure 10 Steps S2100 and S2200 in FIG. 5 are substantially the same.

[0123] The fingerprint recognition mode can determine whether the input fingerprint matches at least one user fingerprint registered in the fingerprint registration mode (step S2300). For example, a pre-stored authenticated user's fingerprint can be compared with the input fingerprint recognized in the fingerprint recognition mode to determine whether the two fingerprints are substantially consistent or identical.

[0124] When the input fingerprint matches at least one registered user fingerprint (step S2300: YES), the fingerprint recognition is determined to be successful (step S2310), and appropriate subsequent fingerprint recognition operations may be performed.

[0125] When the input fingerprint does not match any registered user fingerprint (step S2300: No), the fingerprint recognition is determined to have failed (step S2320), and the fingerprint recognition operation may be terminated. In some example embodiments, the fingerprint recognition may be repeated until the number of fingerprint recognition failures exceeds a predetermined number.

[0126] refer to Figure 14 , in a method of performing optical fingerprint recognition according to example embodiments, Figure 14 The steps S2100 and S2200 can be respectively Figure 10 Steps S2100 and S2200 in FIG. 5 are substantially the same.

[0127] An image may be displayed on at least a portion of the display panel (step S2400). In some example embodiments, step S2400 may be performed substantially simultaneously with at least one of steps S2100 and S2200, and / or the image may be displayed on a partial area in which the fingerprint recognition window is arranged.

[0128] Figure 15A and Figure 15B is a diagram illustrating an example process of a method for performing optical fingerprint recognition according to example embodiments. Figure 15A Operation in fingerprint registration mode is shown. Figure 15B Operation in fingerprint recognition mode is shown.

[0129] refer to Figure 15A , a predetermined first request may be generated or a predetermined first request may occur to enter the fingerprint registration mode and perform fingerprint registration (step S2100). For example, the first request may occur by selecting a fingerprint recognition menu (FRM) displayed on the display panel 110 and used to enter the fingerprint registration mode.

[0130] For example, the user may not know where the fingerprint recognition sensor 130 is located. As a result, in some cases, the user may touch or approach an area other than the fingerprint recognition window FRW with the finger 10. The electronic device 100 may determine that the touched area does not coincide with the fingerprint recognition window FRW. The electronic device 100 may then display a reference image RI by partially driving the display panel 110 under the control of the display driver 120. The reference image RI may be displayed to inform the user of the location where the fingerprint recognition sensor 130 is located. The reference image RI may be displayed on some or part of the fingerprint recognition window FRW.

[0131] Afterwards, the user can touch or approach the fingerprint recognition window FRW in which the reference image RI is displayed with the finger 10. The electronic device 100 can determine that the touched area is consistent with the fingerprint recognition window FRW. Then, the electronic device 100 can emit light by partially driving the display panel 110 under the control of the display driver 120. The electronic device 100 can generate an image signal associated with the finger 10 on the fingerprint recognition window FRW based on the emitted light. The electronic device 100 can register the fingerprint based on the reflected light of the fingerprint received through the fingerprint recognition window FRW.

[0132] refer to Figure 15B , a predetermined second request may be generated or a predetermined second request may occur to enter the fingerprint registration mode and perform fingerprint registration (step S2200). For example, in response to the finger 10 contacting any area on the display panel 110 or approaching any area on the display panel 110, the second request may occur. For example, the second request may occur when the display panel 110 is in the standby mode (for example, when the display panel 110 displays information such as the current time decreasing or the minimum amount).

[0133] With reference Figure 15ASimilar to those described above, the user may not be aware of the location of the fingerprint recognition sensor 130. As a result, in some cases, the user may touch or approach an area other than the fingerprint recognition window FRW with the finger 10. The electronic device 100 may determine that the touched area does not coincide with the fingerprint recognition window FRW. Then, the electronic device 100 may display the reference image RI by partially driving the display panel 110 under the control of the display driver 120.

[0134] Afterwards, the user may touch or approach the fingerprint recognition window FRW in which the reference image RI is displayed with the finger 10. The electronic device 100 may determine that the touched area is consistent with the fingerprint recognition window FRW, and may emit light by partially driving the display panel 110 under the control of the display driver 120. The electronic device 100 may generate an image signal associated with the finger 10 on the fingerprint recognition window FRW based on the emitted light. The electronic device 100 may recognize the fingerprint based on the reflected light of the fingerprint received through the fingerprint recognition window FRW. In addition, the electronic device 100 may determine whether the fingerprint recognized in the fingerprint recognition mode is the fingerprint of the authenticated user (step S2300).

[0135] In some example embodiments, a reference image RI may be provided in association with a function of fingerprint detection. For example, because the function of fingerprint detection is associated with issues of user authentication and security, the function of fingerprint detection may be processed with the highest priority. In some example embodiments, the electronic device 100 may appropriately drive the display panel 110 under the control of the display driver 120 so that an interface associated with the reference image RI (e.g., contact or approach of the finger 10) is processed before an interface associated with the standby mode (e.g., time setting). In some cases, even if the reference image RI is displayed, the user may again contact or approach an area other than the fingerprint recognition window FRW. In this case, the electronic device 100 may display an error response to notify the user that the touched area is inconsistent with the fingerprint recognition window FRW.

[0136] As will be appreciated by those skilled in the art, the present inventive concept may be embodied as a system, method, computer program product, and / or a computer program product embodied in one or more computer-readable media having computer-readable program code embodied thereon. The computer-readable program code may be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device. The computer-readable medium may be a computer-readable signal medium or a computer-readable storage medium. A computer-readable storage medium may be any tangible medium that may contain or store a program for use with an instruction execution system, apparatus, or device, or a program for use with an instruction execution system, apparatus, or device. For example, the computer-readable medium may be a non-transitory computer-readable medium.

[0137] Figure 16 is a block diagram illustrating an electronic device according to example embodiments.

[0138] refer to Figure 16 , the electronic device 1000 may include a processor 1010, a memory device 1020, a fingerprint recognition sensor 1030, an input / output (I / O) device 1040, a power supply 1050, and a display device 1060. The electronic device 1000 may further include a plurality of ports for communicating with a video card, a sound card, a memory card, a universal serial bus (USB) device, other electronic devices, and the like.

[0139] The processor 1010 controls the operation of the electronic device 1000. The processor 1010 may run an operating system and at least one application to provide an internet browser, games, videos, etc. The memory device 1020 may store data used for the operation of the electronic device 1000. The I / O device 1040 may include input devices such as a keyboard, keypad, mouse, touchpad, touch screen, remote control, etc., as well as output devices such as a printer, speakers, etc. The power supply 1050 may provide power for the operation of the electronic device 1000.

[0140] The display device 1060 includes a display panel. Figure 16 The display device 1060, the fingerprint recognition sensor 1030, the processor 1010 and the memory device 1020 may correspond to Figure 5 The display panel 110, the fingerprint recognition sensor 130, the processor 140 and the memory 150 in the embodiment can perform: the method of registering a fingerprint according to the example embodiment and the method of performing optical fingerprint recognition according to the example embodiment.

[0141] The present invention can be applied to various electronic devices and systems that perform optical fingerprint recognition. For example, the present invention can be applied to systems such as mobile phones, smart phones, tablet computers, laptop computers, personal digital assistants (PDAs), portable multimedia players (PMPs), digital cameras, portable game consoles, music players, camcorders, video players, navigation devices, wearable devices, Internet of Things (IoT) devices, Internet of Everything (IoE) devices, e-book readers, virtual reality (VR) devices, augmented reality (AR) devices, robotic devices, etc.

[0142] The foregoing is illustrative of example embodiments and should not be construed as limiting thereof. Although a few example embodiments have been described, those skilled in the art will readily appreciate that many modifications to the example embodiments are possible without materially departing from the novel teachings and advantages of the example embodiments. Therefore, all such modifications are intended to be included within the scope of the example embodiments as defined in the claims. Therefore, it will be understood that the foregoing is illustrative of various example embodiments and should not be construed as limiting the specific example embodiments disclosed, and it will be understood that modifications of the disclosed example embodiments as well as other example embodiments are intended to be included within the scope of the appended claims.

Claims

1. A method for registering a fingerprint based on optical fingerprint recognition, the method comprising: displaying a fingerprint recognition window on at least a portion of the display panel; analyzing, using a fingerprint recognition sensor driven by a pixel binning scheme based on a first binning size, a first fingerprint frequency of a first user fingerprint to be registered based on reflected light received through a fingerprint recognition window, wherein the first fingerprint frequency corresponds to a density of ridges and valleys in the first user fingerprint; determining, based on the first fingerprint frequency, whether a first merged size is suitable for registering the first user fingerprint, wherein when the first fingerprint frequency is higher than a threshold frequency, the first merged size is determined to be suitable, and when the first fingerprint frequency is lower than the threshold frequency, the first merged size is determined to be unsuitable; When the first binning size is not suitable for registering the first user fingerprint based on the first fingerprint frequency being lower than a threshold frequency, selecting a second binning size that is larger than the first binning size, wherein the second binning size includes larger pixels or more pixels than the first binning size; and Using a fingerprint recognition sensor driven by a pixel binning scheme based on a second binning size, first fingerprint information of a first user's fingerprint is obtained based on reflected light received through the fingerprint recognition window.

2. The method according to claim 1, further comprising: The first merge size is set based on the minimum merge size and the maximum merge size.

3. The method according to claim 2, wherein: Setting the first merge size includes: determining a minimum binning size based on optical characteristics of the display panel; determining a maximum merge size based on a target fingerprint frequency; and A value that minimizes sensing noise among values between the minimum binning size and the maximum binning size is selected as the first binning size.

4. The method according to claim 2, wherein: Setting the first merged size is performed during manufacturing of an electronic device including a display panel and a fingerprint recognition sensor.

5. The method according to claim 2, wherein: The first merge size and the second merge size are between the minimum merge size and the maximum merge size.

6. The method according to claim 1, further comprising: When the first binning size is suitable for registering a first user fingerprint, first fingerprint information is obtained based on reflected light received through the fingerprint recognition window using a fingerprint recognition sensor driven by a pixel binning scheme based on the first binning size to store the first fingerprint information.

7. The method according to claim 1, further comprising: analyzing, using a fingerprint recognition sensor driven by a pixel binning scheme based on a first binning size, a second fingerprint frequency of a second user fingerprint to be registered based on reflected light received through the fingerprint recognition window, the second user fingerprint being different from the first user fingerprint; determining, based on the second fingerprint frequency, whether the first combined size is suitable for registering a second user fingerprint; When the first combined size is not suitable for registering the second user fingerprint, selecting a third combined size different from the first combined size; as well as Using a fingerprint recognition sensor driven by a pixel binning scheme based on a third binning size, second fingerprint information of a second user's fingerprint is obtained based on reflected light received through the fingerprint recognition window to store the second fingerprint information.

8. The method according to claim 7, wherein: The third merge size is equal to the second merge size.

9. The method according to claim 7, wherein: The third merge size is different from the second merge size.

10. The method according to claim 7, further comprising: When the first binning size is suitable for registering a second user fingerprint, second fingerprint information is obtained based on reflected light received through the fingerprint recognition window using a fingerprint recognition sensor driven by a pixel binning scheme based on the first binning size to store the second fingerprint information.

11. The method according to claim 1 , wherein: The display panel includes a first surface on which an image is displayed and a second surface opposite to the first surface, and The fingerprint recognition sensor is arranged under the second surface of the display panel.

12. The method according to claim 11, wherein The fingerprint recognition sensor includes: The image sensor is arranged below the second surface of the display panel.

13. The method according to claim 12, wherein: The fingerprint recognition sensor further includes: The lens is arranged between the second surface of the display panel and the image sensor.

14. The method according to claim 12, wherein: The fingerprint recognition sensor further includes: The optical filter is arranged between the second surface of the display panel and the image sensor.

15. A method for performing optical fingerprint recognition, the method comprising: During a fingerprint registration mode, registering at least one user fingerprint based on a fingerprint recognition window displayed on the display panel and a fingerprint recognition sensor driven by a pixel binning scheme; as well as During a fingerprint recognition mode following the fingerprint registration mode, an input fingerprint is recognized based on the fingerprint recognition window using the fingerprint recognition sensor, Registering at least one user fingerprint includes: displaying a fingerprint recognition window on at least a portion of the display panel; analyzing, using a fingerprint recognition sensor driven by a pixel binning scheme based on a first binning size, a first fingerprint frequency of a first user fingerprint to be registered based on reflected light received through a fingerprint recognition window, wherein the first fingerprint frequency corresponds to a density of ridges and valleys in the first user fingerprint; determining, based on the first fingerprint frequency, whether a first merged size is suitable for registering the first user fingerprint, wherein when the first fingerprint frequency is higher than a threshold frequency, the first merged size is determined to be suitable, and when the first fingerprint frequency is lower than the threshold frequency, the first merged size is determined to be unsuitable; When the first binning size is not suitable for registering the first user fingerprint based on the first fingerprint frequency being lower than a threshold frequency, selecting a second binning size that is larger than the first binning size, wherein the second binning size includes larger pixels or more pixels than the first binning size; and Using a fingerprint recognition sensor driven by a pixel binning scheme based on a second binning size, first fingerprint information of a first user's fingerprint is obtained based on reflected light received through the fingerprint recognition window to store the first fingerprint information.

16. The method according to claim 15, wherein Recognizing input fingerprints includes: displaying a fingerprint recognition window on a portion of the display panel; and Using a fingerprint recognition sensor driven by a pixel binning scheme based on a second binning size, information of an input fingerprint is obtained based on reflected light received through the fingerprint recognition window.

17. The method according to claim 15, wherein: Registering at least one user fingerprint further includes: analyzing, using a fingerprint recognition sensor driven by a pixel binning scheme based on a first binning size, a second fingerprint frequency of a second user fingerprint to be registered based on reflected light received through the fingerprint recognition window, the second user fingerprint being different from the first user fingerprint; determining, based on the second fingerprint frequency, whether the first combined size is suitable for registering a second user fingerprint; When the first merged size is not suitable for registering the second user fingerprint, selecting a third merged size different from the first merged size; and Using a fingerprint recognition sensor driven by a pixel binning scheme based on a third binning size, second fingerprint information of a second user's fingerprint is obtained based on reflected light received through the fingerprint recognition window to store the second fingerprint information.

18. The method according to claim 17, wherein Recognizing input fingerprints includes: Displaying a fingerprint recognition window on a portion of the display panel; obtaining first information of an input fingerprint based on reflected light received through a fingerprint recognition window using a fingerprint recognition sensor driven by a pixel binning scheme based on a second binning size; and Using a fingerprint recognition sensor driven by a pixel binning scheme based on a third binning size, second information of the input fingerprint is obtained based on reflected light received through the fingerprint recognition window.

19. The method of claim 15, further comprising: It is determined whether the input fingerprint recognized in the fingerprint recognition mode matches at least one user fingerprint registered in the fingerprint registration mode.

20. An electronic device comprising: A display panel configured to display an image and display a fingerprint recognition window on a partial area; a fingerprint recognition sensor configured to be driven by a pixel binning scheme and to perform fingerprint registration and fingerprint recognition; as well as a processor configured to control the operation of the display panel and the fingerprint recognition sensor, The processor is configured to analyze a first fingerprint frequency of a first user fingerprint to be registered based on reflected light received through the fingerprint recognition window using a fingerprint recognition sensor driven by a pixel binning scheme based on a first binning size, wherein the first fingerprint frequency corresponds to a density of ridges and valleys in the first user fingerprint. determining whether a first merged size is suitable for registering the first user fingerprint based on the first fingerprint frequency, wherein the first merged size is determined to be suitable when the first fingerprint frequency is higher than a threshold frequency, and the first merged size is determined to be unsuitable when the first fingerprint frequency is lower than the threshold frequency, When the first binning size is not suitable for registering the first user fingerprint based on the first fingerprint frequency being lower than a threshold frequency, selecting a second binning size that is larger than the first binning size, wherein the second binning size includes larger pixels or more pixels than the first binning size, and Using a fingerprint recognition sensor driven by a pixel binning scheme based on a second binning size, first fingerprint information of a first user's fingerprint is obtained based on reflected light received through the fingerprint recognition window to store the first fingerprint information.

Images