Setting a light source in a display panel and using it to perform optical fingerprint recognition

Abstract

A method for setting light sources in a display panel for optical fingerprint recognition is provided. The method includes: driving a portion of light sources arranged to correspond to a fingerprint recognition window, which is a partial area of ​​the display panel, based on an initial light source setting value; while driving the portion of light sources, obtaining initial calibration data based on reflected light of an object received by a fingerprint recognition sensor through the fingerprint recognition window; and determining a final light source setting value such that different powers are used to drive light sources of different colors in the portion of light sources, and determining the final light source setting value to minimize the contrast of interference signals included in the initial calibration data.

Description

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS

[0002] This application claims priority from Korean Patent Application No. 10-2019-0066482 filed on June 5, 2019, in the Korean Intellectual Property Office (KIPO), the entire contents of which are incorporated herein by reference. Technical Field

[0003] Example embodiments relate generally to semiconductor integrated circuits, and more particularly to a method of setting a light source in a display panel for optical fingerprint recognition, and a method of performing optical fingerprint recognition using the method of setting the light source. Background Art

[0004] Biometric information is widely used for personal authentication due to its immutability and uniqueness. One type of biometric information is fingerprints. Fingerprint recognition can be easily performed and serves as an excellent method for determining a person's identity. Optical fingerprint recognition obtains a fingerprint image based on the differences in light reflected from the ridges and valleys of a finger. However, because the differences in reflected light tend to be very small, obtaining an accurate fingerprint image has proven difficult. Summary of the Invention

[0005] On the one hand, a method for setting a light source in a display panel for optical fingerprint recognition is provided, which can support efficient optical fingerprint recognition.

[0006] Another aspect is to provide a method for performing optical fingerprint recognition using a method for setting a light source.

[0007] According to an aspect of one or more example embodiments, there is provided a method for setting a light source in a display panel for optical fingerprint recognition, the method comprising: driving a portion of a plurality of light sources included in the display panel based on an initial light source setting value, the portion of the light sources being arranged to correspond to a fingerprint recognition window which is a portion of an area of ​​the display panel; obtaining initial calibration data based on reflected light of an object received by a fingerprint recognition sensor through the fingerprint recognition window while driving the portion of the light sources based on the initial light source setting value; and determining a final light source setting value so that power used to drive light sources of different colors in the portion of the light sources is different, the final light source setting value being determined to minimize a contrast ratio of an interference signal included in the initial calibration data.

[0008] According to another aspect of one or more example embodiments, there is provided a method for setting a light source in a display panel for optical fingerprint recognition, the method comprising: driving a portion of a plurality of light sources included in the display panel based on an initial light source setting value, the portion of the light sources being arranged to correspond to a fingerprint recognition window which is a portion of an area of ​​the display panel; obtaining initial calibration data based on reflected light of an object received by a fingerprint recognition sensor through the fingerprint recognition window while driving the portion of the light sources based on the initial light source setting value; and determining a final light source setting value so that the power used to drive the light sources at different positions in the portion of the light sources is different, the final light source setting value being determined to optimize the amplitude of an interference signal included in the initial calibration data.

[0009] According to another aspect of one or more example embodiments, there is provided a method for performing optical fingerprint recognition, the method comprising: obtaining a light source setting value and calibration data; and in a fingerprint recognition mode, displaying a fingerprint recognition window on a partial area of ​​a display panel based on the light source setting value; and in the fingerprint recognition mode, recognizing a fingerprint based on reflected light of a fingerprint received through the fingerprint recognition window and based on the calibration data, wherein obtaining the light source setting value and the calibration data comprises: driving a portion of light sources set to correspond to the fingerprint recognition window among a plurality of light sources included in the display panel based on an initial light source setting value; while driving the portion of light sources based on the initial light source setting value, receiving a fingerprint recognition sensor through the fingerprint recognition window based on reflected light of the fingerprint. obtaining initial calibration data based on reflected light of an object; determining a final light source setting value so that the power used to drive light sources of different colors in some light sources is different and / or the power used to drive light sources at different positions in some light sources is different, and the final light source setting value is determined to respectively minimize the contrast of interference signals included in the initial calibration data and / or optimize the amplitude of interference signals included in the initial calibration data; driving some light sources based on the final light source setting value; while driving some light sources based on the final light source setting value, obtaining final calibration data based on reflected light of the object received by the fingerprint recognition sensor through the fingerprint recognition window; and storing the final light source setting value and the final calibration data as the light source setting value and calibration data. BRIEF DESCRIPTION OF THE DRAWINGS

[0010] Illustrative, non-limiting example embodiments will be more clearly understood from the following detailed description taken in conjunction with the accompanying drawings, in which:

[0011] Figure 1 is a flowchart illustrating a method of setting a light source in a display panel for optical fingerprint recognition according to an example embodiment;

[0012] Figure 2 is a plan view of an electronic device according to an example embodiment;

[0013] Figure 3 is along the Figure 2 A cross-sectional view of an example of an electronic device taken along line AA';

[0014] Figure 4 is a diagram showing a method according to an example embodiment Figure 2 a block diagram of an example of an electronic device;

[0015] Figure 5A 、 Figure 5B 、 Figure 5C and Figure 5D is a schematic diagram for describing a method of providing a light source in a display panel for optical fingerprint recognition according to an example embodiment;

[0016] Figure 6 、 Figure 7A 、 Figure 7B and Figure 7C is a method for describing the Figure 1 A schematic diagram of an example of driving some light sources based on initial light source setting values ​​and obtaining initial calibration data in a method;

[0017] Figure 8 is a diagram showing a method for performing a multi-processor circuit according to an example embodiment. Figure 1 A flowchart of an example of determining a final light source setting value in a method;

[0018] Figure 9 、 Figure 10A 、 Figure 10B and Figure 10C is used to describe the Figure 1 A schematic diagram of an example of driving some light sources based on final light source setting values ​​and obtaining final calibration data in a method;

[0019] Figure 11 is a diagram showing a method for performing a multi-processor circuit according to an example embodiment. Figure 1 A flowchart of another example of determining a final light source setting value in a method;

[0020] Figure 12 is used to describe the Figure 1 A schematic diagram of another example of driving some light sources based on final light source setting values ​​and obtaining final calibration data in the method;

[0021] Figure 13 is a flowchart illustrating a method of setting a light source in a display panel for optical fingerprint recognition according to an example embodiment;

[0022] Figure 14 is a diagram showing a method for performing a multi-processor circuit according to an example embodiment. Figure 13 A flowchart of an example of determining a final light source setting value in a method;

[0023] Figure 15 is used to describe the Figure 13 A schematic diagram of another example of driving some light sources based on final light source setting values ​​and obtaining final calibration data in the method;

[0024] Figure 16 is used to describe the Figure 13 A schematic diagram of an example of determining a final light source setting value in a method;

[0025] Figure 17 is a diagram showing a method for performing a multi-processor circuit according to an example embodiment. Figure 13 A flowchart of another example of determining a final light source setting value in a method;

[0026] Figure 18 and Figure 19 is a method for describing the Figure 13 A schematic diagram of another example of determining a final light source setting value in the method;

[0027] Figure 20 is a flowchart illustrating a method of setting a light source in a display panel for optical fingerprint recognition according to an example embodiment;

[0028] Figure 21 is used to describe the Figure 20 A schematic diagram of an example of determining a final light source setting value in a method;

[0029] Figure 22 is a flowchart illustrating a method of performing optical fingerprint recognition according to an example embodiment;

[0030] Figure 23 is a diagram showing a method for performing a multi-processor circuit according to an example embodiment. Figure 22 A flowchart of an example of a method for identifying a fingerprint;

[0031] Figure 24 and Figure 25 is a flowchart illustrating a method of performing optical fingerprint recognition according to an example embodiment;

[0032] Figure 26 is a schematic diagram illustrating an example process of a method for performing optical fingerprint recognition according to an example embodiment; and

[0033] Figure 27 is a block diagram illustrating an electronic device according to an example embodiment. DETAILED DESCRIPTION

[0034] Various example embodiments will be described more fully with reference to the accompanying drawings, in which embodiments are shown. However, embodiments consistent with the present disclosure may be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. Throughout this application, like reference numerals represent like elements.

[0035] In a method of setting a light source in a display panel for optical fingerprint recognition and a method of performing optical fingerprint recognition according to an example embodiment, the light source setting value can be changed so that the power used to drive light sources of different colors within the fingerprint recognition window is different and / or the power used to drive light sources at different positions within the fingerprint recognition window is different, thereby minimizing the contrast of the interference signal included in the initial calibration data and / or optimizing the amplitude of the interference signal included in the initial calibration data. The final calibration data can then be obtained based on the changed light source setting value. Therefore, even if changes occur due to the external temperature of the display panel and the pressure applied to the display panel, the final calibration data can be used to perform robust fingerprint image recovery and support efficient optical fingerprint recognition.

[0036] Figure 1 is a flowchart illustrating a method of setting a light source in a display panel for optical fingerprint recognition according to example embodiments.

[0037] refer to Figure 1 The method of setting a light source in a display panel for optical fingerprint recognition according to an exemplary embodiment is performed by an electronic device including a display panel and a fingerprint recognition sensor. The display panel includes a plurality of light sources, and the fingerprint recognition sensor performs optical fingerprint recognition using light provided from the plurality of light sources. Figures 2 to 4 To describe the detailed configuration of the electronic device.

[0038] In a method for setting a light source in a display panel for optical fingerprint recognition according to an example embodiment, some of the multiple light sources included in the display panel are driven based on an initial light source setting value (step S100). The driven light source is a light source arranged to correspond to a fingerprint recognition window that is a partial area of ​​the display panel. For example, the initial light source setting value may be the same value for all driven light sources. In other words, all driven light sources may emit light based on the initial light source setting value to have the same grayscale value. In some example embodiments, the initial light source setting value may be the same for a portion of the driven light sources.

[0039] While driving the light source based on the initial light source setting value, initial calibration data is obtained based on the reflected light received through the fingerprint recognition window (step S200). The initial calibration data can be obtained from the fingerprint recognition sensor. For example, all the driven light sources can be turned on substantially simultaneously or concurrently based on the initial light source setting value. The light generated by the driven light source can be reflected by the object on the fingerprint recognition window, and the reflected light of the object can be provided to the fingerprint recognition sensor, so that the fingerprint recognition sensor can obtain initial calibration data based on the reflected light of the object. In some example embodiments, the object can be a specific object for obtaining calibration data, rather than the user's finger. In some example embodiments, a portion of the driven light sources can be turned on substantially simultaneously or concurrently based on the initial light source setting value.

[0040] In order to minimize the contrast of the interference signal included in the initial calibration data, a final light source setting value is determined so that the power used to drive the light sources of different colors in the driven light sources is different (step S300). The contrast of the interference signal can be minimized by the final light source setting value. For example, the final light source setting value can be different for the light sources of different colors in the driven light sources. In other words, the light sources of different colors can emit light with different grayscale values ​​based on the final light source setting value.

[0041] In some example embodiments, as will be referred to Figure 7A and Figure 7B As described, the initial calibration data may include a low-frequency component and a high-frequency component, and the interference signal may indicate the high-frequency component included in the initial calibration data.

[0042] return Figure 1 , some light sources may be driven based on the final light source setting value (step S400), and while the light sources are driven based on the final light source setting value, final calibration data may be obtained based on the reflected light received through the fingerprint recognition window (step S500). For example, all driven light sources may be turned on substantially simultaneously or concurrently based on the final light source setting value. As with step S200, reflected light of an object serving as a specific object for obtaining calibration data may be provided to the fingerprint recognition sensor. In some example embodiments, a portion of the driven light sources may be turned on substantially simultaneously or concurrently based on the final light source setting value.

[0043] Typically, a display panel has a complex internal structure that includes patterns of multi-layer wiring, electrodes, and the like. When a user's finger is placed on the fingerprint recognition window as an object and the light source in the fingerprint recognition window is illuminated, the reflected light received through the fingerprint recognition window includes information about the fingerprint present on the user's finger and information about the internal structure of the display panel. For example, the internal structure may be a bottom view of the display panel. Therefore, in order to obtain only the fingerprint information, only information about the internal structure of the display panel should be obtained first, which is an interference component, and compensation should be performed to remove the interference component from the image signal, which includes the interference component and the fingerprint information obtained from the user's finger. Such interference components may be referred to as calibration data. For example, compensation may be performed by removing the calibration data from the read data from the user's finger, or by determining compensation data from the user's finger that negates the calibration data when added to the read data from the user's finger.

[0044] In a method of setting a light source in a display panel according to an exemplary embodiment, initial calibration data can be obtained while the light source within the fingerprint recognition window emits light at the same grayscale, and the light source setting value can be changed so that the power used to drive the light sources of different colors within the fingerprint recognition window is different, thereby minimizing the contrast of the interference signal included in the initial calibration data. Final calibration data can then be obtained while the light sources of different colors within the fingerprint recognition window emit light with different grayscales. Therefore, even if changes occur due to the external temperature of the display device, pressure applied to the display panel, etc., the final calibration data can be used to perform robust fingerprint image recovery, and efficient optical fingerprint recognition can be supported.

[0045] Despite Figure 1 Step S300 shows that the final light source setting value is determined immediately or once, but example embodiments are not limited thereto, and the operation of determining the final light source setting value may be repeatedly performed until the contrast of the interference signal included in the initial calibration data is minimized, for example, until the final calibration data has an optimal value for fingerprint image restoration.

[0046] Figure 2 is a plan view of an electronic device according to example embodiments.

[0047] refer to Figure 2 , the electronic device 100 includes a display panel 110 to interact with the user. The display panel 110 outputs visual information to the user. Figure 2 Although not shown in the figure, the electronic device 100 may further include a touch sensor panel for sensing a user's touch input, and the user may input a signal to the electronic device 100 through the touch sensor panel.

[0048] The fingerprint recognition window FRW may be provided on the display panel 110. Figure 3 As described above, the fingerprint recognition sensor for fingerprint detection can be arranged to correspond spatially to the position of the fingerprint recognition window FRW. Figure 2 and subsequent drawings as a rectangle, but the shape and / or size of the fingerprint recognition window FRW may be changed according to example embodiments.

[0049] In some example embodiments, the electronic device 100 may be or may include any mobile system, such as a mobile phone, a smart phone, a tablet computer, a laptop computer, a personal digital assistant (PDA), a portable multimedia player (PMP), a digital camera, a portable game console, a music player, a video camera, a video player, a navigation device, a wearable device, an Internet of Things (IoT) device, an Internet of Everything (IoE) device, an e-book reader, a virtual reality (VR) device, an augmented reality (AR) device, a robotic device, etc.

[0050] The present disclosure can provide an interface for detecting fingerprints. For example, when a user touches or approaches the touch sensor panel or the display panel 110, the fingerprint detection function can be performed. According to the present disclosure, the interface for fingerprint detection and the fingerprint recognition sensor can share an area on the electronic device 100 with the touch sensor panel and the display panel 110, so the interface and the fingerprint recognition sensor may not require an additional area on the electronic device 100. Therefore, the size of the electronic device 100 can be reduced, or the spare area outside the display panel 110 that is otherwise used for the interface can be used for other purposes.

[0051] Figure 3 is along the Figure 2 1 is a cross-sectional view of an example of an electronic device taken along line AA′.

[0052] refer to Figure 3 , the fingerprint recognition window FRW may be provided on a partial area (or, portion) of the display panel 110. In some example embodiments, the FRW may be displayed on a partial area (or, portion) of the display panel 110 in the fingerprint recognition mode. The display panel 110 may include a plurality of light sources 112. For example, as will be referred to Figure 4 As described, the plurality of light sources 112 may be included in a plurality of pixels included in the display panel 110 .

[0053] Among the plurality of light sources 112, only some of the light sources 114a and 114b arranged to correspond to the fingerprint recognition window FRW may be driven substantially simultaneously in the fingerprint recognition mode. Figure 3 In FIG. 1 , the light sources 114a and 114b that are driven and emit light are shaded. Figure 1 As described above, the power (or power supply) for driving light sources of different colors can be set differently. Figure 3 In FIG. 1 , light sources 114 a and 114 b having different powers (eg, having different brightness or grayscale values) are indicated by different hatching. Figure 3 Light sources 114a and 114b are shown in an alternating pattern.

[0054] The fingerprint recognition sensor 130 may be arranged below the display panel 110 so that the fingerprint recognition sensor 130 may at least partially overlap with the fingerprint recognition window FRW in the vertical direction. In other words, the display panel 110 may include a first surface 110a on which an image is displayed and a second surface 110b opposite to the first surface, and the fingerprint recognition sensor 130 may be arranged below the second surface 110b of the display panel 110.

[0055] The fingerprint recognition sensor 130 may include a lens 132 and an image sensor 134. The lens 132 may be disposed below the display panel 110 (e.g., between the display panel 110 and the image sensor 134) and may focus reflected light received through the fingerprint recognition window FRW onto the image sensor 134. The image sensor 134 may be disposed below the lens 132 and may generate an image signal for an object on a partial area of ​​the FRW based on the reflected light focused by the lens 132. The fingerprint recognition sensor 130 may be implemented in the form of a compact camera module (CCM) including the lens 132 and the image sensor 134.

[0056] For example, Figure 3 As shown in , when a user places a finger 10 on the fingerprint recognition window FRW, light generated from the light sources 114a and 114b within the fingerprint recognition window FRW may be reflected by the fingerprint of the finger 10, and the reflected light of the fingerprint may be provided to the fingerprint recognition sensor 130. The fingerprint recognition sensor 130 may capture an image signal of the fingerprint or information associated with the shape of the fingerprint (e.g., a fingerprint image) based on the reflected light of the fingerprint received through the fingerprint recognition window FRW.

[0057] For another example, refer to Figure 6 As described, when the object 20 for obtaining calibration data is placed on the fingerprint recognition window FRW, light generated from the light sources 114a and 114b within the fingerprint recognition window FRW may be reflected by the object 20, and the reflected light of the object 20 may be provided to the fingerprint recognition sensor 130. The fingerprint recognition sensor 130 may capture an image signal of the calibration data (e.g., an image of the internal structure of the display panel 110) based on the reflected light of the object 20 received through the fingerprint recognition window FRW.

[0058] Despite Figure 3 Although not shown in the figure, the fingerprint recognition sensor 130 may further include a filter for adjusting the frequency characteristics and / or polarization characteristics of the reflected light to be provided to the image sensor 134.

[0059] Figure 4 is a diagram showing a method according to an example embodiment Figure 2 A block diagram of an example of an electronic device.

[0060] refer to Figure 4 , the electronic device 100 may include a display panel 110 and a fingerprint recognition sensor 130. The electronic device 100 may further include a display driver 120, a processor 140, and a memory 150.

[0061] The display panel 110 outputs visual information to a user. The display panel 110 may include a plurality of pixels arranged along rows and columns to display an image. Figure 4 One pixel PX is shown as an example. Each pixel can be configured to emit light of a specific color that forms an image. When multiple pixels emit light together, the display panel 110 can display a desired or intended image.

[0062] In some example embodiments, the display panel 110 may be an electroluminescent display panel. A light-emitting diode (LED) or an organic light-emitting diode (OLED) that generates light by the recombination of electrons and holes may be used to drive the electroluminescent display panel with a fast response speed and low power consumption. Compared to a liquid crystal display panel using a backlight unit, the pixels PX of the electroluminescent display panel can emit light by themselves, and can provide the reflected light received through the fingerprint recognition window FRW to the fingerprint recognition sensor 130 below the display panel 110 through the space (gap) between the pixels PX. Therefore, the light-emitting diode or organic light-emitting diode included in the pixel PX may correspond to the light source included in the display panel according to the example embodiment. However, the example embodiment is not limited thereto, and the display panel 110 may be any display panel having the following structure: the reflected light received through the fingerprint recognition window FRW can be provided to the fingerprint recognition sensor 130.

[0063] The display driver 120 may control the operation of the display panel 110 and may drive the display panel 110. For example, the display driver 120 may appropriately drive each pixel of the display panel 110 in response to a command of the processor 140 so that a desired or intended image is displayed on the display panel 110. For example, the display driver 120 may partially drive the display panel 110 so that the pixel corresponding to the fingerprint recognition window FRW emits light. Figure 4 Although not shown in the figure, the display driver 120 may include a data driver, a scan driver, a timing controller, a gamma circuit, etc.

[0064] The fingerprint recognition sensor 130 may be used to detect a fingerprint. The fingerprint recognition sensor 130 may generate / output an image signal associated with an object on the fingerprint recognition window FRW. For example, the fingerprint recognition sensor 130 may be operated to obtain an image signal associated with a fingerprint of a finger that is in contact with or close to the fingerprint recognition window FRW. Figure 3 As depicted, the fingerprint recognition sensor 130 may include a lens 132 and an image sensor 134 .

[0065] The fingerprint recognition sensor 130 may provide optical fingerprint recognition or optical-based fingerprint detection. For example, the image sensor 134 included in the fingerprint recognition sensor 130 may include a photodiode capable of generating current in response to light.

[0066] The processor 140 may control the overall operation of the electronic device 100. The processor 140 may process / execute various arithmetic / logical operations based on program codes to provide the functions of the electronic device 100.

[0067] The processor 140 can communicate with the display driver 120, the fingerprint sensor 130, and the memory 150. The processor 140 can control the operation of the display driver 120, the fingerprint sensor 130, and the memory 150. The processor 140 can process program code including commands, requests, responses, etc. associated with the operation of the display driver 120, the fingerprint sensor 130, and the memory 150. For example, the processor 140 can provide various information to the display driver 120 to display a desired or intended image on the display panel 110. For example, the processor 140 can control the timing / sequence of the operation of the display panel 110 and the fingerprint sensor 130 so that the fingerprint sensor 130 generates an image signal associated with the fingerprint and / or calibration data. For example, the processor 140 can generate and analyze image information associated with the fingerprint and / or calibration data based on the image signal output from the fingerprint sensor 130. For example, the processor 140 can store the associated data in the memory 150 or load the associated data from the memory 150.

[0068] In some example embodiments, the processor 140 may include one or more dedicated circuits (e.g., a field programmable gate array (FPGA), an application specific integrated circuit (ASIC), etc.) to perform various operations. For example, the processor 140 may include one or more processor cores capable of performing various operations. For example, the processor 140 may be implemented as a general-purpose processor, a dedicated processor, or an application processor.

[0069] The memory 150 may store data related to the operation of the electronic device 100. For example, the memory 150 may store the above-mentioned program code, and may store an initial light source setting value, initial calibration data, final light source setting value, final calibration data, etc. for performing the method of setting a light source in a display panel according to an example embodiment.

[0070] In some example embodiments, the memory 150 may include: at least one of various volatile memories, such as dynamic random access memory (DRAM), static random access memory (SRAM), etc.; and / or at least one of various non-volatile memories, such as flash memory, phase change random access memory (PRAM), resistive random access memory (RRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), nano floating gate memory (NFGM), polymer random access memory (PoRAM), etc.

[0071] In some example embodiments, the display driver 120, the fingerprint recognition sensor 130, the processor 140, and the memory 150 may be implemented using separate circuits / modules / chips. In other example embodiments, based on their functions, some of the display driver 120, the fingerprint recognition sensor 130, the processor 140, and the memory 150 may be combined into one circuit / module / chip, or may be separated into multiple circuits / modules / chips.

[0072] The electronic device 100 may perform a reference Figure 1 For example, the display panel 110 and the display driver 120 may execute the following operations under the control of the processor 140: Figure 1 In steps S100 and S400, the fingerprint recognition sensor 130 may perform under the control of the processor 140 Figure 1 and the processor 140 may execute steps S200 and S500. Figure 1 In addition, the electronic device 100 may execute the reference Figure 13 and Figure 20 The method of setting the light source described and / or will refer to Figure 22 A method of performing optical fingerprinting is described.

[0073] Figure 5A 、 Figure 5B 、 Figure 5C and Figure 5D is a schematic diagram for describing a method of providing a light source in a display panel for optical fingerprint recognition according to example embodiments.

[0074] Figure 5AAn image obtained based on reflected light from an object for obtaining calibration data without a fingerprint (eg, without a user's finger) is shown. Figure 5A The image may correspond to calibration data (eg, initial calibration data) obtained by the fingerprint recognition sensor and may include only information on the internal structure of the display panel.

[0075] Figure 5B An image obtained based on reflected light caused by a fingerprint is shown. Figure 5B The image may also be obtained by the fingerprint recognition sensor and may include both the information of the fingerprint and the information of the internal structure of the display panel.

[0076] Figure 5C and Figure 5D Shown based on Figure 5A and Figure 5B An example of a pure fingerprint image obtained by using an image of Figure 1 As described, a first image (eg, Figure 5A ), then a second image including both the fingerprint and interference components may be acquired (e.g., Figure 5B Then, a pure fingerprint image can be obtained by performing compensation to remove the interference component. For example, a pure fingerprint image can be obtained by performing a simple face subtraction to obtain the difference between the second image and the first image.

[0077] like Figure 5C As shown in , a pure fingerprint image with interference components completely removed can be obtained. Figure 5D As shown in , the residual component RES may remain or be retained without completely removing the interference component. For example, when the user's finger is placed on the fingerprint recognition window, the interference component may change according to the temperature of the display panel and / or the pressure applied to the display panel. Specifically, deformation (e.g., rotation, scaling, translation, etc.) may appear in the second image (i.e., Figure 5B ) and thus the residual component RES may appear because in the first image ( Figure 5A ) and the interference component in the second image ( Figure 5B ) there is a spatial mismatch between the interference components in .

[0078] In order to minimize this residual component RES, the power of the light source within the fingerprint recognition window can be adjusted to minimize the above reference Figure 1 The contrast of the interference signal included in the initial calibration data described above, or the power of the light source within the fingerprint recognition window can be adjusted to optimize the Figure 13 The amplitude of the interfering signal included in the described initial calibration data.

[0079] Figure 6 、 Figure 7A 、 Figure 7B and Figure 7C is a method for describing the Figure 1 Schematic diagram of an example of driving some light sources based on initial light source setting values ​​and an example of obtaining initial calibration data in a method.

[0080] refer to Figure 1 and Figure 6 , some light sources 114 a and 114 b set to correspond to the fingerprint recognition window FRW can be turned on basically at the same time based on the initial light source setting value ILSET, and initial calibration data ICDAT can be obtained based on light emitted from the some light sources 114 a and 114 b and reflected by the object 20.

[0081] As reference Figure 1 As described above, for all turned-on light sources 114a and 114b, the initial light source setting value ILSET may be the same value, and all turned-on light sources 114a and 114b may emit light to have the same grayscale value based on the initial light source setting value ILSET, so that all light sources 114a and 114b emitting light have the same grayscale value. Figure 6 According to an example embodiment, the initial light source setting value ILSET may be stored in Figure 4 and provided from memory 150 in the memory 150, or may be obtained from Figure 4 Provided in the processor 140 in.

[0082] The object 20 may be a specific object for obtaining calibration data, rather than the user's finger. For example, to facilitate acquisition of initial calibration data ICDAT associated with the internal structure of the display panel, the object 20 may be any object that is white, flat, and highly reflective without being curved. According to example embodiments, the initial calibration data ICDAT may be provided to and stored in the memory 150, or may be provided to the processor 140 for use in determining the final light source setting value.

[0083] Figure 7A The fingerprint recognition sensor 130 obtains Figure 6 The initial calibration data ICDAT corresponds to the image. Figure 7B Shown along Figure 7A The line BB' in the image shows a change in brightness. Figure 7B In the figure, the X axis represents the direction along Figure 7A The Y-axis represents the position of the line BB' in the image, and the Y-axis represents the brightness at the corresponding position.

[0084] like Figure 7A and Figure 7B As shown in , the initial calibration data ICDAT may include a low frequency component and a high frequency component. The low frequency component may be obtained by Figure 7A The high-frequency component can represent the local brightness variation (e.g., fluctuation), where the relatively bright center and relatively dark edges in the image represent the overall brightness variation. Figure 7A The center of the image alternately repeats bright and dark parts. The high-frequency component may be generated by the internal structure of the display panel 110 (for example, reflected light may or may not pass through the pattern). Since the high-frequency component has a frequency similar to the frequency of the fingerprint signal of the ridges and valleys of the fingerprint, it may be difficult to remove only the high-frequency component.

[0085] Figure 7C shows that when the initial calibration data ICDAT is used as is, Figure 5D The residual component RES in Figure 7C In the middle, the solid line represents Figure 7B The interference signal included in the initial calibration data ICDAT shown in FIG, and the dotted line represents the interference signal included in the image including both the fingerprint and the interference component. When the two interference signals do not match or are inconsistent in space, as shown in FIG. Figure 7C As shown by the double-headed arrows in , the difference between the two interfering signals may be relatively large, and as Figure 5D As shown in , the residual component RES may be Figure 7C The differences shown by the appear.

[0086] Figure 8 is a diagram showing a method for performing a multi-processor circuit according to an example embodiment. Figure 1 Flowchart of an example of determining final light source setting values ​​in a method.

[0087] refer to Figure 1 and Figure 8 When the final light source setting value is determined so that the power used to drive light sources of different colors is different (step S300), the brightness of a first light source among some of the light sources can be determined as a first value (step S310), and the brightness of a second light source among some of the light sources can be determined as a second value different from the first value (step S320). The first light source can have a first color, and the second light source can have a second color different from the first color.

[0088] For example, when the display panel includes red, green, and blue (RGB) light sources, the first color of the first light source may be blue, and the second color of the second light source may be green. However, example embodiments are not limited thereto, and any two of different colors among the plurality of light sources included in the display panel may be selected as the first color and the second color, respectively.

[0089] Figure 9 、 Figure 10A 、 Figure 10B and Figure 10C is used to describe the Figure 1 A schematic diagram of an example of driving some light sources based on the final light source setting value and obtaining the final calibration data in the method. Figure 6 Duplicate description.

[0090] refer to Figure 1 and Figure 9 , some light sources 114 a and 114 b set to correspond to the fingerprint recognition window FRW can be turned on basically at the same time based on the final light source setting value FLSET, and the final calibration data FCDAT can be obtained based on the light emitted from the some light sources 114 a and 114 b and reflected by the object 20.

[0091] As reference Figure 1 As described above, for light sources of different colors among some of the light sources 114a and 114b, the final light source setting value FLSET may be different values. The light sources 114a and 114b may emit light to have different brightness or grayscale values ​​for each color, so the light sources 114a and 114b emitting light with different brightness or grayscale values ​​may be different values. Figure 9 According to an example embodiment, the final light source setting value FLSET may be stored in Figure 4 and provided from memory 150 in the memory 150, or may be obtained from Figure 4 Provided in the processor 140 in.

[0092] Figure 10A The fingerprint recognition sensor 130 obtains Figure 9 The final calibration data FCDAT corresponds to the image. Figure 10B Shown along Figure 10A The line C-C' in the image shows a change in brightness. Figure 10B In the figure, the X axis represents the direction along Figure 10A The Y-axis represents the position of the line CC' in FIG, and the Y-axis represents the brightness at the corresponding position.

[0093] like Figure 10A and 10B As shown in , the final calibration data FCDAT may also include low-frequency components and high-frequency components. Figure 7A and Figure 7B The low frequency components included in the final calibration data FCDAT are similar to the low frequency components included in the initial calibration data ICDAT, and the high frequency components included in the final calibration data FCDAT are reduced compared to the high frequency components included in the initial calibration data ICDAT (for example, compared to the initial calibration data ICDAT).

[0094] Figure 10C It shows that the final calibration data FCDAT can be reduced or eliminated Figure 5D The residual component RES in Figure 10C In the middle, the solid line represents Figure 10B The interference signal included in the final calibration data FCDAT shown in , and the dotted line represents the interference signal included in the image including both fingerprint and interference components. Figure 7C In contrast, even if the two interference signals are not spatially matched or consistent, Figure 10C As shown by the double arrows in , the difference between the two interference signals can also be relatively small and more uniform overall. Therefore, the residual component RES can be efficiently removed from the fingerprint image when using the final calibration data FCDAT.

[0095] Figure 11 is a diagram illustrating determination according to an example embodiment Figure 1 Flowchart of another example of the final light source setting value in . Figure 8 Duplicate description.

[0096] refer to Figure 1 and Figure 11 , when determining the final light source setting value so that the power used to drive light sources of different colors is different (step S300), Figure 11 Steps S310 and S320 in Figure 8 Steps S310 and S320 in the embodiment are substantially the same. The brightness of a third light source among the turned-on light sources may be determined as a third value (step S330). The third value may be different from the first value and the second value. For example, the third light source may have a third color that is different from the first color and the second color.

[0097] For example, when the display panel includes red, green, and blue light sources, the first color of the first light source may be blue, the second color of the second light source may be green, and the third color of the third light source may be red. However, example embodiments are not limited thereto, and any three of the different colors among the plurality of light sources included in the display panel may be selected as the first color, the second color, and the third color, respectively.

[0098] Figure 12 Is used to describe Figure 1 A schematic diagram of another example of driving some light sources based on the final light source setting value and obtaining the final calibration data in the method of FIG. Figure 6 and Figure 9 Duplicate description.

[0099] refer to Figure 1 and Figure 12, some of the light sources 114a, 114b, and 114c set to correspond to the fingerprint recognition window FRW may be turned on substantially simultaneously based on the final light source setting value FLSET', and final calibration data FCDAT' may be obtained based on light emitted from the turned-on light sources 114a, 114b, and 114c and reflected by the object 20. The light sources 114a, 114b, and 114c having different colors and emitting light having different brightness or grayscale values ​​are Figure 12 Indicated by different shaded lines.

[0100] In some example embodiments, when the display panel includes red, green, and blue light sources, first, second, and third values ​​representing the brightness of the first, second, and third light sources may be obtained by Equation 1, respectively.

[0101] [Equation 1]

[0102] (α, β, γ) = argmin (α，β，γ) (cost fn (α*Blue+β*Green+γ*Red))

[0103] In Equation 1, α, β, and γ represent the first value, the second value, and the third value, respectively. fn represents a cost function, and argmin represents a function for obtaining indices α, β, and γ that minimize the cost function. For example, each of α, β, and γ may be a grayscale value of a grayscale range (e.g., 0 to 255 grayscale) in the grayscale range of the display panel. For example, the cost function may be a function representing the contrast of an interference signal included in the initial calibration data, and may be a standard deviation or difference from a low-pass filtered signal (e.g., a signal from which the interference signal has been removed).

[0104] The power of each of the R, G, and B channels may be set based on the α, β, and γ ratios calculated by Equation 1, and the set power may then be used to drive the light source in the fingerprint recognition window.

[0105] Although the exemplary embodiment has been described in which two or three different color light sources are set to have different grayscale values ​​for each color, the exemplary embodiment is not limited thereto and the exemplary embodiment may be employed or applied to an example in which at least two different color light sources of any color among a plurality of different colors included in the display panel are set to have different grayscale values ​​for each color. In addition, although the exemplary embodiment has been described in which all light sources in the fingerprint recognition window are set to have different grayscale values ​​for each color, the exemplary embodiment is not limited thereto and the exemplary embodiment may be employed or applied to an example in which only a portion of the light sources in the fingerprint recognition window are set to have different grayscale values ​​for each color.

[0106] Figure 13 is a flow chart showing a method of setting a light source in a display panel for optical fingerprint recognition according to an example embodiment. Figure 1 Duplicate description.

[0107] refer to Figure 13 In the method of providing a light source in a display panel for optical fingerprint recognition according to an example embodiment, Figure 13 Steps S100, S200, S400 and S500 in Figure 1 Steps S100, S200, S400 and S500 in the embodiment are substantially the same.

[0108] In order to optimize the amplitude of the interference signal included in the initial calibration data, a final light source setting value is determined so that the power used to drive the light sources at different positions in the driven light source is different (step S600). The amplitude of the interference signal included in the initial calibration data is optimized by the final light source setting value. For example, the final light source setting value can be different for the light sources at different positions in the driven light source. In other words, the light sources at different positions can emit light with different grayscale values ​​based on the final light source setting value.

[0109] In a method of setting a light source in a display panel according to an exemplary embodiment, initial calibration data can be obtained while emitting the light source within the fingerprint recognition window at the same grayscale, and the light source setting value can be changed so that the power used to drive the light source at different positions within the fingerprint recognition window is different, thereby optimizing the amplitude of the interference signal included in the initial calibration data. Thereafter, final calibration data can be obtained while emitting the light source at different positions within the fingerprint recognition window at different grayscales. Therefore, even if changes occur due to the temperature of the display panel, pressure applied to the display panel, etc., the final calibration data can be used to perform robust fingerprint image recovery, and efficient optical fingerprint recognition can be supported.

[0110] Figure 14 is a diagram showing a method for performing a multi-processor circuit according to an example embodiment. Figure 13 Flowchart of an example of determining final light source setting values ​​in a method.

[0111] refer to Figure 13 and Figure 14When the final light source setting value is determined so that the power used to drive the light sources at different positions is different (step S600), the brightness of a first light source among some of the light sources can be determined as a first value (step S610), and the brightness of a second light source among some of the light sources can be determined as a second value (step S620). The second value can be different from the first value. The first light source can be arranged in a first area among the partial areas, and the second light source can be arranged in a second area among the partial areas that is different from the first area.

[0112] Figure 15 is used to describe the Figure 13 A schematic diagram of an example of driving some light sources based on the final light source setting value and obtaining the final calibration data in the method. Figure 6 、 Figure 9 and Figure 12 Duplicate description.

[0113] refer to Figure 13 and Figure 15 , some light sources 114a and 114c arranged to correspond to the fingerprint recognition window FRW can be turned on basically at the same time based on the final light source setting value FLSET", and the final calibration data FCDAT" can be obtained based on the light emitted from the some light sources 114a and 114c and reflected by the object 20.

[0114] As reference Figure 13 As described above, for light sources at different positions among some of the light sources 114a and 114c, the final light source setting value FLSET" may be different values. The light sources 114a and 114c may emit light to have different brightness or grayscale values ​​for each position, so the light sources 114a and 114c emitting light with different brightness or grayscale values ​​are Figure 15 Indicated by different shaded lines.

[0115] Figure 16 is used to describe the Figure 13 Schematic diagram of an example of determining the final light source setting value using the method.

[0116] refer to Figure 14 and Figure 16 The first area R1 where the first light source is arranged may be the central portion of the fingerprint recognition window FRW, and the second area R2 where the second light source is arranged may be the edge portion (or peripheral portion) surrounding the central portion of the fingerprint recognition window FRW. For example, the first light source may be set to have a relatively low grayscale value or brightness (e.g., set to be relatively dark).

[0117] Figure 17 is a diagram showing a method for performing a multi-processor circuit according to an example embodiment. Figure 13A flowchart of another example of determining the final light source setting value in the method of Figure 14 Duplicate description.

[0118] refer to Figure 13 and Figure 17 , when determining the final light source setting value so that the power used to drive the light sources at different positions is different (step S600), Figure 17 Steps S610 and S620 in Figure 14 Steps S610 and S620 are substantially the same. The brightness of the third light source among the turned-on light sources may be determined as a third value (step S630). The third value may be different from the first value and the second value. For example, the third light source may be arranged in a third area that is different from the first area and the second area of ​​the partial area. The operation of obtaining the final calibration data by driving the first light source, the second light source, and the third light source may be similar to the reference light source. Figure 12 The described operation.

[0119] Figure 18 and Figure 19 is a method for describing the Figure 13 Schematic diagram of another example of determining the final light source setting value in the method.

[0120] refer to Figure 17 and Figure 18 , the first area R1' where the first light source is arranged may be the central part of the fingerprint identification window FRW, the second area R2' where the second light source is arranged may be the middle part surrounding the central part of the fingerprint identification window FRW, and the third area R3' where the third light source is arranged may be the edge part surrounding the middle part of the fingerprint identification window FRW.

[0121] Although example embodiments have been described in which the fingerprint recognition window is divided into two or three areas and the light source in the fingerprint recognition window is set to have a different grayscale value for each area, the example embodiments are not limited thereto, and the example embodiments may be adopted or applied to examples in which the fingerprint recognition window is divided into any number of different areas and the light source in the fingerprint recognition window is set to have a different grayscale value for each area. In addition, the example embodiments may be adopted or extended to examples in which all light sources in the fingerprint recognition window are set to have different grayscale values ​​for each position. In some example embodiments, all light sources in the fingerprint recognition window are set to have different grayscale values ​​based on position. In some other example embodiments, each individually turned-on light source may have a different grayscale value.

[0122] Figure 19FIG. 3 shows the brightness difference according to the position of the light source in the fingerprint recognition window FRW when all the light sources in the fingerprint recognition window are set to have different grayscale values ​​for each position. Figure 19 In the figure, the X' axis represents the direction along Figure 2 The line AA′ in FIG. 2 represents the position of the light source in the fingerprint recognition window FRW, and the Y′ axis represents the brightness or grayscale generated by the light source set at the corresponding position.

[0123] like Figure 19 As shown in , as the light source becomes closer to the center (or the center part), the brightness of the light source in the fingerprint recognition window can be determined to be lower. Figure 7A As shown in other figures, the interference signal may appear relatively large in the center part, the interference signal may appear relatively small in the edge part, and the fingerprint signal may also appear weak due to the vignetting of the lens. To improve this, the power used to drive the light source can be adjusted according to the position of each of the light sources, so that the center part is relatively dark and the edge part is relatively bright. For example, in some example embodiments, the light sources at each edge position may have the same grayscale value, the next light source adjacent to the edge position may have another grayscale value, and so on. In other example embodiments, each individual light source may have a different grayscale value for each position. In other example embodiments, each individual light source may have a different grayscale value based on the position. In other example embodiments, each individually turned on light source may have a different grayscale value. Therefore, the fingerprint signal in the edge part can be enhanced while reducing the amplitude of the interference signal in the center part.

[0124] Although an example embodiment has been described in which all light sources in the fingerprint recognition window are set to have different grayscale values ​​for each position, the example embodiment is not limited thereto, and the example embodiment may be adopted or applied to a case in which only a portion of the light sources in the fingerprint recognition window are set to have different grayscale values ​​for each position.

[0125] Figure 20 is a flow chart showing a method of setting a light source in a display panel for optical fingerprint recognition according to an example embodiment. Figure 1 and Figure 13 Duplicate description.

[0126] refer to Figure 20 , in a method of providing a light source in a display panel for optical fingerprint recognition according to an example embodiment, Figure 20 Steps S100, S200, S300, S400 and S500 in the Figure 1 Steps S100, S200, S300, S400 and S500 in the embodiment are substantially the same, and Figure 20Step S600 in Figure 13 According to example embodiments, the order of performing steps S300 and S600 may be changed, and steps S300 and S600 may be performed substantially simultaneously.

[0127] Figure 21 is used to describe the Figure 20 Schematic diagram of an example of determining the final light source setting value using the method.

[0128] Figure 21 FIG1 shows the brightness difference according to the position of the light source in the fingerprint recognition window FRW when all the light sources in the fingerprint recognition window are set to have different grayscale values ​​for each color and each position. Figures 1 to 12 As described, the brightness L1 of the first light source having the first color and the brightness L2 of the second light source having the second color may be set differently, and as described with reference to FIG. Figures 13 to 19 As described above, the brightness of the light source can be set differently for each position of the light source. For example, the green light source and the blue light source arranged in the center can be set to have grayscales of 230 and 216, respectively, and the green light source and the blue light source arranged in the edge can be set to have grayscales of 254 and 255, respectively. The brightness and hue of the light source at each position can be changed together.

[0129] Figure 22 is a flowchart illustrating a method of performing optical fingerprint recognition according to example embodiments.

[0130] refer to Figure 22 In the method of performing optical fingerprint recognition according to an example embodiment, light source setting values ​​and calibration data are obtained (step S1100). Figures 1 to 21 The method of setting a light source in a display panel of the described exemplary embodiment performs step S1100. For example, a final light source setting value may be determined so that the power used to drive light sources of different colors in the driven light sources within the fingerprint recognition window is different, so that the power used to drive light sources at different positions in the driven light sources is different, or so that the power used to drive light sources of different colors and the power used to drive light sources at different positions are different. For example, final calibration data may be obtained based on the final light source setting value, and the final light source setting value and the final calibration data may be stored as light source setting value and calibration data, respectively. For example, the light source setting value and the calibration data may be stored in Figure 4 In the memory 150.

[0131] Entering fingerprint recognition mode (step S1200). Entering fingerprint recognition mode can be based on a request. For example, the request can be associated with a signal or action that instructs the detection of a fingerprint.

[0132] For example, a request may occur when the electronic device 100 receives any input from the user, when a signal / command is generated in the electronic device 100 based on the received input, etc. For example, a request may occur when the user contacts or approaches any area on the touch sensor panel or display panel 110 with the object 10 (for example, the request may occur in response to the touch of the object 10). For example, a request may occur when the object 10 performs a specific action or gesture near the electronic device 100. For example, a request may occur when the electronic device 100 moves in a specific manner. As another example, an application running on the electronic device 100 may initiate a request. However, the example embodiments are not limited thereto, and the request may be changed or modified to identify guidance for fingerprint detection.

[0133] For example, the request may occur when the electronic device 100 is in an idle state or the display panel 110 is not driven. For example, the request may occur when the display panel 110 is in standby mode. Here, standby mode may refer to an operating mode in which the display panel 110 displays a reduced amount of information or a minimum amount of information (e.g., the current time, date, etc.), and may also be referred to as an "always-on display (AOD)" mode, an "active display mode," or the like. For example, the request may occur when the display panel 110 is in normal mode. Here, normal mode may refer to an operating mode in which the display panel 110 displays various information according to the user's intention.

[0134] A fingerprint recognition window is displayed on a partial area of ​​the display panel based on the light source setting value (step S1300), and the fingerprint is identified based on the reflected light of the fingerprint received through the fingerprint recognition window and the calibration data (step S1400). Once the fingerprint is identified, a fingerprint recognition mode can then exist. As described above, when the power for driving the light source is set to be different from each other according to color and / or position, the fingerprint can be identified based on the reflected light and the calibration data. Therefore, even if changes occur due to the temperature of the display panel, the pressure applied to the display panel, etc., robust fingerprint image recovery can be performed, and efficient optical fingerprint recognition can be supported.

[0135] In some example embodiments, a fingerprint recognition sensor based on a reference may be performed when manufacturing an electronic device including a display panel and a fingerprint recognition sensor. Figures 1 to 21The method for setting a light source in a display panel according to an example embodiment is described to obtain the operation of the final light source setting value and the final calibration data. For example, the method for setting a light source in a display panel according to an example embodiment can be performed once when manufacturing an electronic device, and the final light source setting value and the final calibration data can be obtained and stored in the electronic device. Thereafter, in step S1100, an operation of loading the final light source setting value and the final calibration data already stored in the memory 150 can be performed. The fingerprint recognition operations of steps S1200, S1300, and S1400 can be performed by loading the stored final light source setting value and the stored final calibration data.

[0136] In other example embodiments, since the characteristics of the light source are changed, degraded, or worsened by using the display panel, the reference-based display may be periodically performed. Figures 1 to 21 The method of setting a light source in a display panel according to an exemplary embodiment is described to obtain the final light source setting value and the final calibration data. For example, the calibration based on the reference time may be repeatedly performed as long as the usage time of the display panel exceeds the threshold reference time. Figures 1 to 21 The method of setting a light source in a display panel according to example embodiments is described to obtain operations of final light source setting values ​​and final calibration data.

[0137] Figure 23 is a diagram showing a method for performing a multi-processor circuit according to an example embodiment. Figure 22 Flowchart of an example of a method for identifying fingerprints.

[0138] refer to Figure 22 and Figure 23 When the fingerprint is identified based on the reflected light of the fingerprint received through the fingerprint identification window and the calibration data (step S1400), an image signal of the fingerprint can be obtained based on the reflected light (step S1410). For example, the image signal of the fingerprint can be obtained based on the reflected light reflected by the fingerprint and received through the fingerprint identification window. The final information of the fingerprint can be obtained by subtracting the calibration data from the image signal (step S1420). As shown in FIG. Figure 5C and Figure 5D As described, a first image (eg, Figure 5A ), then a second image including both the fingerprint and interference components may be acquired (e.g., Figure 5B The pure fingerprint image can then be obtained by performing compensation to remove the interference components.

[0139] Figure 24 and Figure 25 is a flowchart illustrating a method of performing optical fingerprint recognition according to an example embodiment. Figure 22 Duplicate description.

[0140] Reference Figure 24 , in a method of performing optical fingerprint recognition according to example embodiments, Figure 24 Steps S1100, S1200, S1300 and S1400 in the Figure 22 Steps S1100, S1200, S1300 and S1400 in FIG. 1 are substantially the same.

[0141] It may be determined whether the fingerprint identified in the fingerprint recognition mode (i.e., in step 1400) is the fingerprint of the authenticated user (step S1500). For example, a pre-stored fingerprint of the authenticated user may be compared with the fingerprint identified in the fingerprint recognition mode to determine whether the two fingerprints are substantially the same or identical.

[0142] When the fingerprint recognized in the fingerprint recognition mode is the fingerprint of the authenticated user (step S1500 : YES), it may be determined that the fingerprint recognition is successful (step S1510 ), and appropriate subsequent operations may be performed.

[0143] When the fingerprint identified in the fingerprint recognition mode is not the fingerprint of the authenticated user (step S1500: No), it can be determined that the fingerprint recognition has failed (step S1520) and the operation can be terminated. In some example embodiments, the fingerprint recognition operation can be repeated until the number of fingerprint recognition failures exceeds a threshold number.

[0144] Reference Figure 25 , in a method of performing optical fingerprint recognition according to example embodiments, Figure 25 Steps S1100, S1200, S1300 and S1400 in the Figure 22 Steps S1100, S1200, S1300 and S1400 in FIG. 1 are substantially the same.

[0145] In the fingerprint recognition mode, an image may be displayed on at least a portion of the remaining area of ​​the display panel excluding the partial area (step S1600). Step S1600 may be performed simultaneously with at least one of steps S1300 and S1400. In some example embodiments, the image may also be displayed on the partial area where the fingerprint recognition window is arranged.

[0146] Figure 26 is a schematic diagram illustrating an example process of a method for performing optical fingerprint recognition according to an example embodiment. Figure 24 The method is described as an example Figure 26 .

[0147] refer to Figure 26After obtaining the light source setting value and calibration data (step S1100), a request may be generated or may occur to enter the fingerprint recognition mode (step S1200). For example, the request may occur in response to the object 10 contacting or approaching any area on the display panel 110. For example, the request may occur when the display panel 110 is in standby mode (e.g., when the display panel 110 displays a reduced or minimized amount of information such as the current time).

[0148] For example, the user may not know the location where the fingerprint recognition sensor 130 is arranged. Therefore, in some example embodiments, the user may touch or approach an area other than the fingerprint recognition window FRW with the object 10. The electronic device 100 may determine that the touched area does not coincide with the fingerprint recognition window FRW and may display the reference image RI by partially driving the display panel 110 under the control of the display driver 120. The reference image RI may be displayed to inform the user of the location where the fingerprint recognition sensor 130 is arranged. The reference image RI may be displayed on some or all of the fingerprint recognition window FRW.

[0149] Thereafter, the user may touch or approach the fingerprint recognition window FRW in which the reference image RI is displayed with the object 10. The electronic device 100 may determine that the touch area coincides with the fingerprint recognition window FRW and may emit light by partially driving the display panel 110 under the control of the display driver 120 (step S1300). The electronic device 100 may generate an image signal associated with the object 10 on the fingerprint recognition window FRW based on the emitted light.

[0150] The electronic device 100 may recognize the fingerprint based on the reflected light of the fingerprint received through the fingerprint recognition window FRW and the calibration data (step S1400). The electronic device 100 may determine whether the fingerprint recognized in the fingerprint recognition mode is the fingerprint of the authenticated user (step S1500).

[0151] In some example embodiments, a reference image RI may be provided in association with a fingerprint detection function. For example, since the function of fingerprint detection is associated with issues of user authentication and security, the function of fingerprint detection may be processed with the highest priority. In some example embodiments, the electronic device 100 may appropriately drive the display panel 110 under the control of the display driver 120 so that an interface associated with the reference image RI (e.g., contact or approach of the object 10) is processed before an interface associated with the standby mode (e.g., time setting). In some cases, even if the reference image RI is displayed, the user may again contact or approach an area other than the fingerprint recognition window FRW. In this case, the electronic device 100 may display an error response to inform the user that the touch area is inconsistent with the fingerprint recognition window FRW.

[0152] Figure 27 is a block diagram illustrating an electronic device according to an example embodiment.

[0153] refer to Figure 27 , the electronic device 1000 may include a processor 1010, a memory device 1020, a fingerprint recognition sensor 1030, an input / output (I / O) device 1040, a power supply 1050, and a display device 1060. The electronic device 100 may also include a plurality of ports for communicating with a video card, a sound card, a memory card, a universal serial bus (USB) device, other electronic devices, and the like.

[0154] Processor 1010 controls the operation of electronic device 1000. Processor 1010 can execute an operating system and at least one application to provide an internet browser, games, or videos, etc. Memory device 1020 can store data used for operating electronic device 1000. I / O device 1040 can include input devices such as a keyboard, keypad, mouse, touchpad, touch screen, remote control, etc.; and output devices such as a printer, speakers, etc. Power supply 1050 can provide power for the operation of electronic device 1000.

[0155] The display device 1060 includes a display panel. Figure 27 The display panel, fingerprint recognition sensor 1030, processor 1010 and memory device 1020 may correspond to Figure 4 The display panel 110, the fingerprint recognition sensor 130, the processor 140 and the memory 150 in the embodiment can perform the method of setting the light source in the display panel according to the example embodiment and the method of performing optical fingerprint recognition according to the example embodiment.

[0156] The present invention can be applied to various electronic devices and systems that include a display panel and a fingerprint recognition sensor and perform optical fingerprint recognition. For example, the present invention can be applied to systems such as mobile phones, smart phones, tablet computers, laptop computers, personal digital assistants (PDAs), portable multimedia players (PMPs), digital cameras, portable game consoles, music players, video cameras, video players, navigation devices, wearable devices, Internet of Things (IoT) devices, Internet of Everything (IoE) devices, e-book readers, virtual reality (VR) devices, augmented reality (AR) devices, robotic devices, etc.

[0157] The foregoing is illustrative of example embodiments and should not be construed as limiting thereof. Although a few example embodiments have been described, those skilled in the art will readily appreciate that various modifications may be made to the example embodiments without materially departing from the novel teachings and advantages of the example embodiments. Therefore, all such modifications are intended to be included within the scope of the example embodiments as defined in the claims. Therefore, it should be understood that the foregoing is illustrative of various example embodiments and should not be construed as limiting the specific example embodiments disclosed, and that modifications of the disclosed example embodiments and other example embodiments are intended to be included within the scope of the appended claims.

Claims

1. A method for providing a light source in a display panel for optical fingerprint recognition, the method comprising: driving a portion of the plurality of light sources included in the display panel based on an initial light source setting value, the portion of the light sources being arranged to correspond to a fingerprint recognition window that is a partial area of ​​the display panel, wherein the driven portion of the light sources emits light to have the same grayscale value based on the initial light source setting value; while driving the portion of light sources based on the initial light source setting value, obtaining initial calibration data based on reflected light of an object received by a fingerprint recognition sensor through the fingerprint recognition window, wherein the object is a specific object for obtaining the initial calibration data, rather than a finger of a user; and Final light source setting values ​​are determined so that powers for driving light sources of different colors among the portion of light sources are different, the final light source setting values ​​being determined to minimize a contrast of an interference signal included in the initial calibration data.

2. The method according to claim 1, wherein: The initial calibration data includes a low frequency component and a high frequency component, and The interference signal corresponds to the high frequency component included in the initial calibration data.

3. The method according to claim 1, wherein: For all of the partial light sources, the initial light source setting value is the same value, and For light sources of different colors among the part of light sources, the final light source setting values ​​are different values.

4. The method of claim 1 , wherein determining the final light source setting value comprises: determining a brightness of a first light source among the portion of light sources as a first value, the first light source having a first color; as well as The brightness of a second light source among the part of the light sources is determined to be a second value different from the first value, the second light source having a second color different from the first color.

5. The method of claim 4, wherein determining the final light source setting value further comprises: The brightness of a third light source among the part of the light sources is determined to be a third value different from the first value and the second value, the third light source having a third color different from the first color and the second color.

6. The method according to claim 1, further comprising: The final light source setting value is determined so that powers for driving light sources at different positions among the portion of light sources are different, and the final light source setting value is determined to optimize the amplitude of the interference signal included in the initial calibration data.

7. The method according to claim 6, wherein determining the final light source setting value so that the power used to drive the light sources at different positions is different comprises: determining a brightness of a first light source among the partial light sources as a first value, the first light source being arranged in a first area of ​​the partial area; as well as The brightness of a second light source among the partial light sources is determined to be a second value different from the first value, the second light source being arranged in a second area of ​​the partial area different from the first area.

8. The method according to claim 7, wherein determining the final light source setting value so that the power used to drive the light sources at different positions is different further comprises: The brightness of a third light source among the partial light sources is determined to be a third value different from the first value and the second value, the third light source being arranged in a third area of ​​the partial area different from the first area and the second area.

9. The method according to claim 1, further comprising: driving the portion of light sources based on the final light source setting value; as well as While driving the portion of the light sources based on the final light source setting value, final calibration data is obtained based on the reflected light of the object received by the fingerprint recognition sensor through the fingerprint recognition window. 10 . The method according to claim 9 , wherein the part of the light sources are turned on simultaneously based on the initial light source setting value or the final light source setting value.

11. The method according to claim 1 , wherein: The display panel includes a first surface on which an image is displayed and a second surface opposite to the first surface, and The fingerprint recognition sensor is arranged below the second surface of the display panel.

12. The method according to claim 11, wherein the fingerprint recognition sensor comprises: a lens configured to collect reflected light of the object received through the fingerprint recognition window; as well as An image sensor is configured to generate an image signal corresponding to the object on the partial area based on the reflected light collected by the lens.

13. A method for providing a light source in a display panel for optical fingerprint recognition, the method comprising: driving a portion of the plurality of light sources included in the display panel based on an initial light source setting value, the portion of the light sources being arranged to correspond to a fingerprint recognition window that is a partial area of ​​the display panel, wherein the driven portion of the light sources emits light to have the same grayscale value based on the initial light source setting value; while driving the portion of light sources based on the initial light source setting value, obtaining initial calibration data based on reflected light of an object received by a fingerprint recognition sensor through the fingerprint recognition window, wherein the object is a specific object for obtaining the initial calibration data, rather than a finger of a user; and Final light source setting values ​​are determined such that powers for driving light sources at different positions among the portion of light sources are different, the final light source setting values ​​being determined to optimize the amplitude of the interference signal included in the initial calibration data. 14 . The method according to claim 13 , wherein the power for driving the light source is determined such that brightness of the partial light sources becomes lower as the light source becomes closer to a center of the partial area.

15. A method for performing optical fingerprint recognition, the method comprising: Get light source settings and calibration data; In the fingerprint recognition mode, displaying a fingerprint recognition window on a partial area of ​​the display panel based on the light source setting value; as well as In the fingerprint recognition mode, the fingerprint is recognized based on reflected light of the fingerprint received through the fingerprint recognition window and based on the calibration data, Wherein obtaining the light source setting value and the calibration data comprises: driving, based on an initial light source setting value, a portion of light sources arranged to correspond to the fingerprint recognition window among a plurality of light sources included in the display panel, wherein the driven portion of light sources emits light to have the same grayscale value based on the initial light source setting value; while driving the portion of light sources based on the initial light source setting value, obtaining initial calibration data based on reflected light of an object received by a fingerprint recognition sensor through the fingerprint recognition window, wherein the object is a specific object for obtaining the initial calibration data, rather than a finger of a user; determining final light source setting values ​​so that powers used to drive light sources of different colors among the portion of light sources are different and / or powers used to drive light sources at different positions among the portion of light sources are different, the final light source setting values ​​being determined to respectively minimize a contrast of an interference signal included in the initial calibration data and / or optimize an amplitude of the interference signal included in the initial calibration data; driving the portion of light sources based on the final light source setting value; while driving the portion of light sources based on the final light source setting value, obtaining final calibration data based on reflected light of the object received by the fingerprint recognition sensor through the fingerprint recognition window; and The final light source setting values ​​and the final calibration data are stored as the light source setting values ​​and the calibration data. 16 . The method according to claim 15 , wherein after the final light source setting value and the final calibration data are obtained and stored, a fingerprint recognition operation is performed by loading the stored final light source setting value and the stored final calibration data. 17 . The method according to claim 16 , wherein the final light source setting value and the final calibration data are obtained and stored when an electronic device including the display panel and the fingerprint recognition sensor is manufactured.

18. The method of claim 15, wherein identifying the fingerprint comprises: obtaining an image signal of the fingerprint based on the reflected light of the fingerprint received through the fingerprint recognition window; as well as The final information of the fingerprint is obtained by subtracting the calibration data from the image signal.

19. The method according to claim 15, further comprising: Determine whether the fingerprint recognized in the fingerprint recognition mode is the fingerprint of the authenticated user.

20. The method of claim 15, further comprising: In the fingerprint recognition mode, an image is displayed on at least a portion of a remaining area of ​​the display panel except the partial area.

Images