Display device

Abstract

Disclosed is a display device including a display unit displaying an image, a fingerprint sensing unit arranged at one side of the display unit and including a fingerprint sensing pixel for sensing a fingerprint, and a reading circuit receiving a fingerprint sensing signal from the fingerprint sensing pixel, wherein the reading circuit generates a normal fingerprint image and a dry fingerprint image corresponding to the fingerprint sensing signal during a fingerprint enrollment mode.

Description

Technical Field

[0001] This invention relates to a display device with fingerprint sensing function. Background Technology

[0002] Multimedia electronic devices such as televisions, mobile phones, tablet computers, computers, navigators, and game consoles are equipped with display devices for displaying images. In addition to common input methods such as buttons, keyboards, and mice, electronic devices can be equipped with display devices that provide users with easy, intuitive, and convenient input of information or commands.

[0003] Recently, there has been a proposal to use fingerprints, one type of biometric information, as a method of user authentication for online banking, shopping, security, and other purposes. Furthermore, the demand for display devices with fingerprint recognition capabilities is increasing. Summary of the Invention

[0004] The purpose of this invention is to provide a display device capable of sensing fingerprints.

[0005] Another object of the present invention is to provide a display device that can improve fingerprint authentication performance regardless of skin condition.

[0006] According to a feature of the present invention for achieving these objectives, a display device includes: a display unit for displaying an image; a fingerprint sensing unit disposed on one side of the display unit and including fingerprint sensing pixels for sensing fingerprints; and a reading circuit for receiving fingerprint sensing signals from the fingerprint sensing pixels. The reading circuit generates a normal fingerprint image and a dried fingerprint image corresponding to the fingerprint sensing signals during a fingerprint registration mode.

[0007] In an exemplary embodiment, the reading circuit can generate a dry fingerprint image corresponding to the fingerprint sensing signal, and store the dry fingerprint image when the matching score between the dry fingerprint image and the ordinary fingerprint image is higher than a benchmark score.

[0008] In an exemplary embodiment, the reading circuit may calculate a matching score representing the degree of matching between the dried fingerprint image and the ordinary fingerprint image.

[0009] In an exemplary embodiment, the reading circuit can store a fingerprint template including a normal fingerprint template and a dried fingerprint template, wherein the normal fingerprint template corresponds to the normal fingerprint image and the dried fingerprint template corresponds to the dried fingerprint image.

[0010] In an exemplary embodiment, the fingerprint template may include multiple ordinary fingerprint templates and multiple dried fingerprint templates.

[0011] In an exemplary embodiment, the reading circuit generates a fingerprint image corresponding to the fingerprint sensing signal during fingerprint authentication mode and compares the generated fingerprint image with the fingerprint template.

[0012] In an exemplary embodiment, the reading circuit may generate a dry fingerprint image corresponding to the fingerprint sensing signal during fingerprint authentication mode, convert the dry fingerprint image into a normal fingerprint image, and compare the normal fingerprint image with the fingerprint template.

[0013] In an exemplary embodiment, the reading circuit may further include a memory for storing the fingerprint template.

[0014] In an exemplary embodiment, the display unit includes a display area with arranged pixels and a non-display area adjacent to the display area, and the fingerprint sensing pixels of the fingerprint sensing unit can be arranged in the fingerprint sensing area corresponding to the display area.

[0015] In an exemplary embodiment, the fingerprint sensing pixel is connected to multiple fingerprint scanning lines and multiple fingerprint sensing lines respectively, and the fingerprint sensing unit may further include: a fingerprint scanning driving circuit that sequentially drives the multiple fingerprint scanning lines.

[0016] In an exemplary embodiment, the reading circuit can receive the fingerprint sensing signal from the plurality of fingerprint sensing lines.

[0017] According to another feature of the present invention, a control method for a display device may include a fingerprint registration mode and a fingerprint authentication mode. The fingerprint registration mode includes the following steps: receiving a first fingerprint sensing signal; generating a first ordinary fingerprint image corresponding to the first fingerprint sensing signal; generating a first dried fingerprint image corresponding to the first fingerprint sensing signal; and storing the first dried fingerprint image and the first ordinary fingerprint image.

[0018] In an exemplary embodiment, the step of storing the first dried fingerprint image and the first ordinary fingerprint image may further include the following step: storing the first dried fingerprint image and the first ordinary fingerprint image when they are identical.

[0019] In an exemplary embodiment, the step of storing the first dry fingerprint image and the first ordinary fingerprint image may further include the following step: storing the first dry fingerprint image and the first ordinary fingerprint image when the matching score of the first dry fingerprint image and the first ordinary fingerprint image is higher than a benchmark score.

[0020] In an exemplary embodiment, the following steps may also be included: storing a fingerprint template including a normal fingerprint template and a dried fingerprint template, wherein the normal fingerprint template corresponds to the first normal fingerprint image and the dried fingerprint template corresponds to the first dried fingerprint image.

[0021] In an exemplary embodiment, the fingerprint authentication mode may include the following steps: receiving a second fingerprint sensing signal; generating a fingerprint image corresponding to the second fingerprint sensing signal; comparing the fingerprint image with the fingerprint template; and determining that user authentication is successful when the fingerprint image and the fingerprint template are consistent.

[0022] In an exemplary embodiment, the control method of the display device may further include the following steps: comparing the fingerprint image with the ordinary fingerprint template within the fingerprint template; and comparing the fingerprint image with the dried fingerprint template within the fingerprint template when the fingerprint image and the ordinary fingerprint template are inconsistent.

[0023] In an exemplary embodiment, user authentication can be determined to be successful when the fingerprint image matches at least one of the ordinary fingerprint template and the dried fingerprint template.

[0024] In an exemplary embodiment, the step of generating a fingerprint image corresponding to the second fingerprint sensing signal may include the following steps: determining whether the fingerprint image is a dry fingerprint image; when the fingerprint image is determined to be a dry fingerprint image, converting the dry fingerprint image into a normal fingerprint image, wherein the step of comparing the fingerprint image and the fingerprint template includes the following steps: comparing the normal fingerprint image with the normal fingerprint template within the fingerprint template; and when the normal fingerprint image and the normal fingerprint template are inconsistent, comparing the normal fingerprint image with the dry fingerprint template within the fingerprint template.

[0025] In an exemplary embodiment, the step of generating a first dry fingerprint image corresponding to the first fingerprint sensing signal can be performed when the user selects automatic dry fingerprint registration.

[0026] This display device can sense fingerprints. In fingerprint registration mode, it can pre-register a standard fingerprint template based on the user's input fingerprint, and it can also pre-register a dried fingerprint template based on the user's input fingerprint. In fingerprint authentication mode, it can perform fingerprint authentication by determining whether the user's input fingerprint matches either the standard or dried fingerprint template. In particular, the display device provides convenience to the user by minimizing fingerprint authentication errors when the user's skin is dry. Attached Figure Description

[0027] Figure 1 This is a perspective view of a display device according to an embodiment of the present invention.

[0028] Figure 2a This is an exploded view of a display device according to an embodiment of the present invention.

[0029] Figure 2b This is a cross-sectional view of a display device according to an embodiment of the present invention.

[0030] Figure 2c This is a block diagram of a display device according to an embodiment of the present invention.

[0031] Figure 3a This is an exploded view of a display device according to an embodiment of the present invention.

[0032] Figure 3b This is a cross-sectional view of a display device according to an embodiment of the present invention.

[0033] Figure 3c This is a block diagram of a display device according to an embodiment of the present invention.

[0034] Figure 4 This is a plan view of a display unit according to an embodiment of the present invention.

[0035] Figure 5 This is a plan view of a touch sensing unit according to an embodiment of the present invention.

[0036] Figure 6 This is a plan view of a fingerprint sensing unit according to an embodiment of the present invention.

[0037] Figure 7 This diagram illustrates, exemplarily, the connection relationships between the fingerprint sensing pixels, the fingerprint scanning driving circuit, and the reading circuit.

[0038] Figure 8 This is a block diagram illustrating the configuration of a read circuit according to an exemplary embodiment of the present invention.

[0039] Figure 9 The diagram illustrates, for example, a standard fingerprint template and a dried fingerprint template.

[0040] Figure 10 This is a flowchart of the operation of the fingerprint registration mode of a display device according to an embodiment of the present invention.

[0041] Figure 11 This is a flowchart of a fingerprint authentication mode for a display device according to an embodiment of the present invention.

[0042] Figure 12 This is a flowchart of a fingerprint authentication mode for a display device according to an embodiment of the present invention.

[0043] Figure 13 This is a flowchart of a fingerprint authentication mode for a display device according to an embodiment of the present invention.

[0044] Figure 14 This is a flowchart of a fingerprint authentication mode for a display device according to an embodiment of the present invention.

[0045] Figure 15a and Figure 15b The user interface screen of the display device is shown in fingerprint registration mode.

[0046] [Explanation of Labels in the Attached Image]

[0047] DD: Display device; DP: Display panel

[0048] DM: Display module; FSM: Fingerprint sensor module

[0049] PDC: Panel driver circuit; TSC: Touch driver circuit

[0050] TSU: Touch Sensing Unit; ROC: Readout Circuit

[0051] FSP: Fingerprint sensor panel; P-FCB: Panel circuit board

[0052] F-FCB: Fingerprint circuit board; FSDC: Fingerprint scanning driver circuit.

[0053] SP: Fingerprint sensing pixel; FRP: Fingerprint recognition unit Detailed Implementation

[0054] In this specification, when it is mentioned that a certain component (or region, layer, part, etc.) is located "above", "connected" to, or "combined" with another component, it means that it can be directly arranged on / connected to / combined with another component, or that a third component can be arranged between them.

[0055] The same reference numerals refer to the same constituent elements. Furthermore, for the purpose of effective explanation of the technical content, the thickness, proportions, and dimensions of the constituent elements are exaggerated in the drawings. "And / or" includes all combinations of related constituent elements that can be defined.

[0056] The terms "first," "second," etc., can be used to describe multiple constituent elements, but the constituent elements should not be limited by the terms. The terms are used only to distinguish one constituent element from another. For example, without departing from the scope of the invention, a first constituent element can be named a second constituent element, and similarly, a second constituent element can be named a first constituent element. Singular expressions include plural expressions unless the context explicitly indicates a different meaning.

[0057] Furthermore, terms such as "below," "lower side," "above," and "upper side" are used to describe the relationships between the components shown in the accompanying drawings. These terms are relative concepts and are explained based on the directions indicated in the accompanying drawings.

[0058] Terms such as “including” or “having” should be understood as being intended to specify the presence of features, figures, steps, operations, constituent elements, components or combinations thereof described in the specification, rather than precluding the presence or possibility of one or more other features or figures, steps, operations, constituent elements, components or combinations thereof.

[0059] Unless otherwise defined, all terms (including technical and scientific terms) used in this specification shall have the same meaning as commonly understood by one of ordinary skill in the art to which this invention pertains. Furthermore, terms identical to those defined in commonly used dictionaries shall be interpreted as having the same meaning as in the context of the relevant art, and shall be interpreted as having the meaning expressly defined herein, unless interpreted as having an ideal or overly formal meaning.

[0060] Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings.

[0061] Figure 1 This is a perspective view of a display device according to an embodiment of the present invention.

[0062] Reference Figure 1 A portable terminal is shown as an example of a display device DD according to an embodiment of the present invention. Portable terminals may include tablet computers, smartphones, personal digital assistants (PDAs), portable multimedia players (PMPs), game consoles, watch-type electronic devices, etc. However, the present invention is not limited thereto.

[0063] This invention can be used not only in large electronic devices such as televisions or external advertising billboards, but also in small and medium-sized electronic devices such as personal computers, laptops, car navigation units, and cameras. These are merely examples; it is obvious that it can be used in other electronic devices without departing from the concept of this invention.

[0064] like Figure 1 As shown, the display surface of the image IM is parallel to the surface defined by the first direction DR1 and the second direction DR2. The display device DD includes multiple regions that can be distinguished on the display surface. The display surface includes: a display area DA, which displays the image IM; and a non-display area NDA, which is adjacent to the display area DA. The non-display area NDA can be referred to as a border area. As an example, the display area DA can be quadrilateral in shape. The non-display area NDA surrounds the display area DA. And, although not shown, as an example, the display device DD can include a partially curved shape. As a result, a region of the display area DA can have a curved shape.

[0065] The front (top or first side) and back (bottom or second side) of each component are defined based on the direction of the displayed image IM. However, the directions pointing from the first direction to the third direction DR1, DR2, and DR3 are relative concepts and can be converted to other directions. Hereinafter, the first direction to the third direction refers to the directions pointing from the first direction DR1 to the third direction DR3 respectively, referring to the same reference numerals.

[0066] According to an embodiment of the present invention, the display device DD can sense user input TC applied from the outside. User input TC includes various forms of external input such as touch, light, heat, or pressure from a part of the user's body. In this embodiment, although the user input is described assuming it is applied to the front of the user's hand, this is merely exemplary. As described above, user input TC can be provided in various forms, and the display device DD can also sense user input applied to the side or back of the display device DD depending on its structure, and is not limited to any particular embodiment.

[0067] Figure 2a This is an exploded view of a display device according to an embodiment of the present invention. Figure 2b This is a cross-sectional view of a display device according to an embodiment of the present invention. Figure 2a In this diagram, the components of the display device DD are simplified to illustrate the stacking relationship of its constituent elements.

[0068] like Figure 2a and Figure 2bAs shown, the display device DD includes a window component WM, a first bonding component OCA1, a display module DM, and a fingerprint sensing module FSM. The display module DM includes a display panel DP, a panel circuit board P-FCB, a panel driving circuit PDC, and a touch sensing circuit TSC.

[0069] Windows Mobile widgets provide Figure 1 The front of the display device DD is shown. The window component WM may include a glass substrate, a sapphire substrate, a plastic substrate, etc. Furthermore, the window component WM may include functional coatings such as an anti-fingerprint layer, an anti-reflective layer, and a hard coating. In the exemplary embodiment, although a window component WM with a flat shape within the non-display area NDA is shown, the shape of the window component WM can be deformed. The edges of the window component WM facing each other in the first direction DR1 may be curved.

[0070] The display panel (DP) is positioned on the back of the window widget (WM) to generate the image. Furthermore, the display panel (DP) can also sense user input (TC) (see reference). Figure 1 For example, through user touch and / or user pressure input. Although a display panel DP providing a flat display surface is shown as an example in this embodiment, the shape of the display panel DP can be deformed. The edges of the display panel DP facing each other in the first direction DR1 can be bent to provide a curved surface.

[0071] The display panel DP can include various display elements. For example, the display elements can be liquid crystal capacitors, organic light-emitting elements, inorganic light-emitting elements, quantum dot elements, electrophoretic elements, or electrowetting elements. The following description will focus on a case where the display elements according to one embodiment are multiple organic light-emitting diodes (OLEDs). That is, the display panel DP according to the present invention is a flexible display panel, such as an organic light-emitting display panel.

[0072] The display panel DP includes a touch sensing unit (TSU) and a display unit (DU). In another embodiment, the stacking order of the touch sensing unit (TSU) and the display unit (DU) can be changed.

[0073] A first adhesive component OCA1 is arranged between the window component WM and the display panel DP. The first adhesive component OCA1 may be an optically transparent adhesive component.

[0074] One end of the panel circuit board P-FCB is bonded to a pad disposed in a region of the display panel DP, thereby enabling electrical connection with the display panel DP. According to one embodiment, the panel driving circuit PDC and the touch sensing circuit TSC can be mounted on the panel circuit board P-FCB in a chip-on-film (COF) manner. Although not shown separately, multiple passive and active components can also be mounted on the panel circuit board P-FCB. The panel circuit board P-FCB can provide electrical signals to the display panel DP via signal lines. The panel circuit board P-FCB can be implemented as a flexible printed circuit. The other end of the panel circuit board P-FCB can be connected to the display device DD (on the display panel DP). Figure 1 Other components (shown in the figure) are electrically connected.

[0075] The fingerprint sensing module (FSM) is disposed on the back of the display panel (DP) and includes a second adhesive component (OCA2), an optical layer (OCL), a third adhesive component (OCA3), a fingerprint sensing panel (FSP), a fingerprint circuit substrate (F-FCB), and a reading circuit (ROC). While the fingerprint sensing module (FSM) is shown and described on the back of the display panel (DP) in an exemplary embodiment, the invention is not limited thereto. For example, the fingerprint sensing module (FSM) may be disposed on top of the display panel (DP).

[0076] The second bonding component OCA2 is disposed between the display panel DP and the optical layer OCL to bond the two together. The third bonding component OCA3 is disposed between the optical layer OCL and the fingerprint sensing panel FSP to bond the two together. The second bonding component OCA2 and the third bonding component OCA3 can be optically transparent bonding components.

[0077] The optical layer OCL may include the input TC (refer to) that is controlled by the user. Figure 1 The light reflected from the fingerprint passes through multiple translucent pinholes (PH).

[0078] Although Figure 2b The second adhesive component OCA2 and the optical layer OCL are shown and illustrated in the fingerprint sensing module FSM, but the invention is not limited thereto. In another embodiment, the second adhesive component OCA2 and the optical layer OCL may be included in the display module DM.

[0079] The fingerprint sensing panel (FSP) senses a user's fingerprint information by sensing the amount of light emitted from the display panel (DP), reflected by the user's input (TC) after passing through the window component (WM) and being emitted outward. The light reflected by the user's input (TC) can reach the fingerprint sensing panel (FSP) through the pinholes (PH) in the optical layer (OCL). In areas of the optical layer (OCL) where no pinholes (PH) are formed, an opaque material can be used to block light transmission. Furthermore, in an exemplary embodiment, the optical layer (OCL) can be implemented using a material with low reflectivity.

[0080] One end of the fingerprint circuit board F-FCB can be bonded to a pad disposed in a region of the fingerprint sensing panel FSP and electrically connected to the fingerprint sensing panel FSP. According to one embodiment, the readout circuit ROC can be mounted on the fingerprint circuit board F-FCB in a chip-on-film (COF) manner. Although not shown separately, multiple passive and active components can also be mounted on the fingerprint circuit board F-FCB. The fingerprint circuit board F-FCB can provide electrical signals to the fingerprint sensing panel FSP via signal lines and receive fingerprint sensing signals from the fingerprint sensing panel FSP. The fingerprint circuit board F-FCB can be implemented as a flexible printed circuit. The other end of the fingerprint circuit board F-FCB can be electrically connected to other components of the display device DD.

[0081] Although in the exemplary embodiment the panel circuit board P-FCB and the fingerprint circuit board F-FCB are arranged facing each other at one end of the display panel DP and the fingerprint sensing panel FSP, respectively, the present invention is not limited thereto. In another embodiment, the panel circuit board P-FCB and the fingerprint circuit board F-FCB may be arranged to be spaced apart from each other in the second direction DR2. That is, the panel circuit board P-FCB may be connected to one side of the display panel DP, and the fingerprint circuit board F-FCB may be connected to the other side of the fingerprint sensing panel FSP corresponding to the other side of the display panel DP.

[0082] Besides the display module (DM) and the fingerprint sensor module (FSM) Figure 2a The display device DD shown may also include various components for controlling the operation of the display module DM and the fingerprint sensing module FSM. The circuitry components of the display device DD will be referenced... Figure 2c Details will be discussed later.

[0083] Figure 2c yes Figure 1 Block diagram of the display device shown.

[0084] Reference Figure 2cThe display device DD may include a display module DM, a power supply module PM, a first electronic module EM1, a second electronic module EM2, and a fingerprint sensing module FSM. The display module DM, the power supply module PM, the first electronic module EM1, the second electronic module EM2, and the fingerprint sensing module FSM may be electrically connected to each other. Figure 2c The image exemplarily illustrates the display unit DU, panel driving circuit PDC, touch sensing unit TSU, and touch sensing circuit TSC among the components of the display module DM. Furthermore, Figure 2c The image exemplarily illustrates the fingerprint sensing panel FSP and the reading circuit ROC in the components of a fingerprint sensing module FSM.

[0085] The power supply module PM supplies the power required for the overall operation of the display device DD. The power supply module PM may include a common battery module.

[0086] The first electronic module EM1 and the second electronic module EM2 include various functional modules for enabling the display device DD to operate. The first electronic module EM1 can be directly mounted on a motherboard that is electrically connected to the display module DM, or mounted on a separate substrate and electrically connected to the motherboard via a connector (not shown).

[0087] The first electronic module EM1 may include a control module CM, a wireless communication module TM, an image input module IIM, a voice input module AIM, a memory MM, and an external interface IF. Some of these modules may be electrically connected to the motherboard via a flexible circuit board instead of being mounted on it.

[0088] The control module CM controls the overall operation of the display device DD. The control module CM can be a microprocessor. For example, the control module CM activates or deactivates the display module DM. The control module CM can control other modules such as the image input module IIM or the voice input module AIM based on touch signals received from the display module DM. The control module CM can perform user authentication (fingerprint authentication) based on fingerprint signals received from the fingerprint sensing module FSM.

[0089] The wireless communication module TM can transmit and receive wireless signals with other terminals using Bluetooth or Wi-Fi lines. The wireless communication module TM can also transmit and receive voice signals using standard communication lines. The wireless communication module TM includes a transmitting unit TM1 that modulates and transmits the signal to be transmitted, and a receiving unit TM2 that demodulates the received signal.

[0090] The Image Input Module (IIM) processes image signals and converts them into image data that can be displayed on the Display Module (DM). The Audio Input Module (AIM), in recording mode, voice recognition mode, etc., receives external audio signals through a microphone and converts them into electronic audio data.

[0091] The external interface (IF) serves as an interface for connecting to external chargers, wired / wireless data ports, card slots (e.g., memory cards, SIM / UIM cards), etc.

[0092] The second electronic module EM2 may include a sound output module AOM, a light-emitting module LM, a light-receiving module LRM, and a camera module CMM, etc. This configuration can be directly mounted to the motherboard, or mounted on a separate substrate and electrically connected to the display module DM or the first electronic module EM1 via a connector (not shown).

[0093] The audio output module AOM converts the audio data received from the wireless communication module TM or the audio data stored in the memory MM and outputs it to the outside.

[0094] The light-emitting module (LM) generates and outputs light. The LM can output infrared light. The LM may include LED elements. The light-receiving module (LRM) senses infrared light. The LRM is activated when it senses infrared light above a predetermined level. The LRM may include a CMOS sensor. After the light generated by the LM is output, it is reflected by an external object (e.g., a user's finger or face), and the reflected light can then enter the LRM. The camera module (CMM) captures an image of the external environment.

[0095] Figure 3a This is an exploded view of a display device according to an embodiment of the present invention. Figure 3b This is a cross-sectional view of a display device according to an embodiment of the present invention. Figure 3a and Figure 3b In the display device DD2, the same reference numerals are used to indicate the same... Figure 2a and Figure 2b The components of the display device DD shown are the same as those of the components shown, and repeated descriptions are omitted.

[0096] Reference Figure 3a and Figure 3b The display device DD2 includes a window component WM, a first bonding component OCA1, and a display module DM. The display module DM includes a display panel DP, a panel circuit board P-FCB, a panel driving circuit PDC, a touch sensing circuit TSC, and a readout circuit ROC.

[0097] Windows Mobile widgets provide Figure 1 The front of the display device DD is shown. A first adhesive component OCA1 is arranged between the window component WM and the display panel DP. The first adhesive component OCA1 may be an optically transparent adhesive component.

[0098] The display panel DP is positioned on the back of the window component WM to generate images. The display panel DP includes a touch sensing unit TSU, a display unit DU, an optical layer OCL, and a fingerprint sensing unit FSU.

[0099] The second bonding component OCA2 is disposed between the display unit DU and the optical layer OCL, thereby bonding the two together. The third bonding component OCA3 is disposed between the optical layer OCL and the fingerprint sensing unit FSU, thereby bonding the two together. The second bonding component OCA2 and the third bonding component OCA3 can be optically transparent bonding components, respectively.

[0100] In this embodiment, the window component WM is "plate" type, and the touch sensing unit TSU, display unit DU, optical layer OCL, and fingerprint sensing unit FSU are "layer" type. The "plate" type includes a base layer (e.g., synthetic resin film, composite material film, glass substrate, etc.) providing the base surface, but the "layer" type may omit the base layer. In other words, the constituent elements of the "layer" type are arranged on the base surface provided by other constituent elements. In one embodiment of the present invention, the window component WM may also be "layer" type.

[0101] Figure 3c This is a block diagram of a display device according to an embodiment of the present invention.

[0102] exist Figure 3c In the display device DD2 shown, the same reference numerals are used to denote the same as those in the accompanying drawings. Figure 2c The components of the display device DD shown are the same, and repeated descriptions are omitted.

[0103] Reference Figure 3c The display module DM includes a display unit DU, a panel driver circuit PDC, a touch sensing unit TSU, a touch sensing circuit TSC, a fingerprint sensing unit FSU, and a reading circuit ROC. The following details the specific operation of the components that make up the display module DM.

[0104] Figure 4 This is a plan view of a display unit according to an embodiment of the present invention. Figure 4 The signal circuit diagram is simplified. Furthermore, for ease of explanation, Figure 4 Some of the constituent elements are shown but omitted.

[0105] like Figure 4As shown, the display unit DU includes a display area DU-DA and a non-display area DU-NDA on a plane. In this embodiment, the non-display area DU-NDA can be defined along the edge of the display area DU-DA. The display area DU-DA and the non-display area DU-NDA of the display unit DU are respectively connected to... Figure 1 The display area DA and the non-display area NDA of the display device DD shown correspond to each other.

[0106] The display unit DU may include a scan drive circuit SDC, multiple signal lines (hereinafter referred to as signal lines) SGL, multiple signal pads (hereinafter referred to as signal pads) DU-PD, TS-PD, FS-PD, and multiple pixels (hereinafter referred to as pixels) PX. Pixels PX are arranged in the display area DU-DA. Each of the pixels PX includes an organic light-emitting diode and a pixel drive circuit connected thereto.

[0107] The scan drive circuit SDC generates multiple scan signals (hereinafter, scan signals) and outputs them sequentially to multiple scan lines (hereinafter referred to as scan lines) SL, which will be described later. The scan drive circuit SDC can also output other control signals to the drive circuit of pixel PX.

[0108] The scan drive circuit SDC may include multiple thin-film transistors formed using the same process as the drive circuit of the pixel PX (e.g., low-temperature polycrystalline silicon (LTPS) process or low-temperature polycrystalline oxide (LTPO) process).

[0109] The signal line SGL includes scan lines SL, data lines DL, power lines PL, and control signal lines CSL. Scan lines SL and DL are connected to their respective corresponding pixels PX. Power lines PL are connected to pixels PX. The control signal lines CSL provide control signals to the scan drive circuit SDC.

[0110] The signal line SGL overlaps with the display area DU-DA and the non-display area DU-NDA. The signal line SGL may include a pad portion and a line portion. The line portion overlaps with both the display area DU-DA and the non-display area DU-NDA. The pad portion is connected to the end of the line portion. The pad portion is disposed in the non-display area DU-NDA and overlaps with the corresponding signal pads DU-PD, TS-PD, and FS-PD. The area in the non-display area DU-NDA where the signal pads DU-PD, TS-PD, and FS-PD are disposed can be defined as the pad area NDA-PD.

[0111] In this embodiment, the signal line SGL may further include an auxiliary line SSL. The auxiliary line SSL is connected to the touch sensing unit TSU (see reference). Figure 3b The signal line is connected. In one embodiment of the invention, the auxiliary line SSL can be omitted.

[0112] Signal lines (SGLs) can include multiple sections arranged on different layers. Figure 4 The diagram exemplarily illustrates a data line DL comprising two parts, SDL1 and SDL2, and an auxiliary line SSL. The two parts, SDL1 and SDL2, can be connected via a contact hole CH. The auxiliary line SSL can be connected via the contact hole CH to the touch sensing unit TSU (described later). Figure 5 The signal lines and fingerprint sensing unit FSU (refer to) Figure 6 (Signal line connection).

[0113] Signal pads DU-PD, TS-PD, and FS-PD may include a first type of signal pad DU-PD connected to the data line DL, power line PL, and control signal line CSL; a second type of signal pad TS-PD connected to the auxiliary line SSL; and a third type of signal pad FS-PD. The first type of signal pad DU-PD, the second type of signal pad TS-PD, and the third type of signal pad FS-PD are arranged adjacent to each other in a pad region NDA-PD defined in a portion of the non-display area DU-NDA. The stacked structure or constituent materials of the signal pads DU-PD, TS-PD, and FS-PD may be formed using the same process without distinguishing them from each other.

[0114] Essentially, the line portion connected to pixel PX constitutes the majority of signal line SGL. The line portion is connected to the transistor (not shown) of pixel PX. The line portion can have a single-layer / multi-layer structure, and can be a single body or comprise two or more parts. The two or more parts are arranged on different layers and can be connected to each other through contact holes penetrating the insulating layer arranged between the two or more parts.

[0115] Figure 4 The panel circuit board P-FCB, which is electrically connected to the display unit DU, is also shown. The panel circuit board P-FCB can be a rigid circuit board or a flexible circuit board. The panel circuit board P-FCB can be directly bonded to the display unit DU or connected to the display unit DU through other circuit boards.

[0116] A panel driving circuit PDC for controlling the operation of a display unit DU can be disposed on the panel circuit board P-FCB. Furthermore, a touch sensing circuit TSC for controlling a touch sensing unit TSU can be disposed on the panel circuit board P-FCB. A reading circuit ROC for controlling a fingerprint sensing unit FSU can be disposed on the panel circuit board P-FCB. Each of the panel driving circuit PDC, touch sensing circuit TSC, and reading circuit ROC can be mounted on the panel circuit board P-FCB as an integrated chip. The panel circuit board P-FCB may include a circuit board pad PCB-P electrically connected to the display unit DU. Although not shown, the panel circuit board P-FCB also includes signal lines connecting the circuit board pad PCB-P to the panel driving circuit PDC, touch sensing circuit TSC, and / or reading circuit ROC.

[0117] Figure 5 This is a plan view of a touch sensing unit according to an embodiment of the present invention.

[0118] Reference Figure 5 The touch sensing unit (TSU) is arranged in the display unit (DU) (see reference). Figure 4 The touch sensing unit (TSU) can sense the user's input (TC). Figure 1 The touch sensing unit (TSU) acquires the position or intensity information of external touch input. The TSU may include a touch area (TA) and a surrounding touch area (TSA) on a plane. In this embodiment, the surrounding touch area (TSA) may be defined along the edge of the touch area (TA). The touch area (TA) and the surrounding touch area (TSA) of the touch sensing unit (TSU) are related to... Figure 1 The display area DA and the non-display area NDA of the display device DD shown correspond to each other.

[0119] The touch sensing unit (TSU) includes multiple first sensing electrodes (SE1), multiple second sensing electrodes (SE2), and multiple sensing lines (TL1, TL2, TL3).

[0120] The first sensing electrode SE1 and the second sensing electrode SE2 are arranged in the touch area TA. The touch sensing unit TSU can obtain information about the touch input by the change in capacitance between the first sensing electrode SE1 and the second sensing electrode SE2.

[0121] Each of the first sensing electrodes SE1 extends along a first direction DR1 and is arranged along a second direction DR2. The first sensing electrodes SE1 may include a plurality of first sensing patterns SP1 and a plurality of first auxiliary patterns CP1.

[0122] First sensing patterns SP1, constituting a first sensing electrode, are arranged spaced apart from each other along a first direction DR1. In this embodiment, for ease of explanation, the first sensing patterns SP1 are shown in a shaded manner. A first auxiliary pattern CP1 is arranged between the first sensing patterns SP1 to connect two adjacent first sensing patterns SP1.

[0123] Each of the second sensing electrodes SE2 extends along the second direction DR2 and is arranged along the first direction DR1. The second sensing electrode SE2 may include a plurality of second sensing patterns SP2 and a plurality of second auxiliary patterns CP2.

[0124] The second sensing patterns SP2, which constitute a second sensing electrode, are arranged spaced apart from each other along the second direction DR2. The second auxiliary pattern CP2 is arranged between the second sensing patterns SP2 to connect two adjacent second sensing patterns SP2.

[0125] Sensing lines TL1, TL2, and TL3 are arranged in the touch area TSA. Sensing lines TL1, TL2, and TL3 may include a first sensing line TL1, a second sensing line TL2, and a third sensing line TL3. The first sensing line TL1 is connected to a first sensing electrode SE1. The second sensing line TL2 is connected to one end of a second sensing electrode SE2. The third sensing line TL3 is connected to the other end of the second sensing electrode SE2. The other end of the second sensing electrode SE2 may be the portion opposite to one end of the second sensing electrode SE2. Accordingly, the sensitivity of the area can be uniformly maintained for the second sensing electrode SE2, which has a relatively longer length than the first sensing electrode SE1. In another embodiment, one of the second sensing line TL2 and the third sensing line TL3 may be omitted. The first sensing line TL1, the second sensing line TL2, and the third sensing line TL3 can be connected to the touch area via a contact hole CH. Figure 4 A portion of the auxiliary line SSL connection is shown. The first sensing line TL1 and the second sensing line TL2 are electrically connected to the second type signal pad TS-PD via the auxiliary line SSL.

[0126] Figure 6 This is a plan view of a fingerprint sensing unit according to an embodiment of the present invention.

[0127] Reference Figure 6 The fingerprint sensing unit (TSU) can sense the user's input (TC) (see reference). Figure 1 The fingerprint sensing unit (FSU) acquires user fingerprint information by reflecting the reflected light. The FSU includes a fingerprint sensing area (FSA) and a surrounding area (FSSA) on a plane. In this embodiment, the surrounding area (FSSA) can be defined along the edge of the fingerprint sensing area (FSA). The fingerprint sensing area (FSA) and the surrounding area (FSSA) of the fingerprint sensing unit (FSU) are... Figure 1The display area DA and the non-display area NDA of the display device DD shown correspond to each other. Therefore, Figure 1 The display area DA of the display device DD shown is... Figure 4 The display area DU-DA of the display unit DU shown is shown. Figure 5 The touch area TA of the touch sensing unit TSU and the fingerprint sensing area FSA of the fingerprint sensing unit FSU correspond to each other. Similarly, Figure 1 The non-display area NDA of the display device DD shown is... Figure 4 The non-display area DU-NDA of the display unit DU shown is... Figure 5 The touch sensing area TSA of the touch sensing unit TSU and the surrounding area FSSA of the fingerprint sensing unit FUS correspond to each other. However, the present invention is not limited thereto. For example, the fingerprint sensing area FSA of the fingerprint sensing unit FSU can be... Figure 1 This corresponds to a portion of the display area DA of the display device DD shown. That is, the fingerprint sensing area FSA of the fingerprint sensing unit FSU can have an area smaller than the display area DA of the display device DD.

[0128] The fingerprint sensing unit (FSU) may include a fingerprint scanning drive circuit (FSDC), multiple fingerprint signal lines (F-SGL), and multiple fingerprint sensing pixels (SP). The fingerprint sensing pixels (SP) are arranged in the fingerprint sensing area (FSA).

[0129] The fingerprint scanning driver circuit FSDC generates multiple fingerprint scanning signals and outputs them sequentially to the multiple fingerprint scanning lines FSL (described later). The fingerprint scanning driver circuit FSDC can also output other control signals to the fingerprint sensing pixel SP.

[0130] In an exemplary embodiment, the fingerprint sensing unit FSU may include only a fingerprint scanning drive circuit FSDC disposed on one side of the fingerprint sensing area FSA. However, in another embodiment, the fingerprint sensing unit FSU may include at least two fingerprint scanning drive circuits. The two fingerprint scanning drive circuits may be arranged facing each other with the fingerprint sensing area FSA disposed in between them, and multiple fingerprint scanning lines FSL may be connected to both fingerprint scanning drive circuits.

[0131] The fingerprint signal line F-SGL includes the fingerprint scanning line FSL, the fingerprint sensing line FDL, the control signal line FCL, and the fingerprint power line PLL. The fingerprint scanning line FSL is connected to the corresponding fingerprint sensing pixel SP, and the fingerprint sensing line FDL is connected to the corresponding fingerprint sensing pixel SP. Figure 6In this circuit, the fingerprint power line PLL is a single line, but the fingerprint sensing pixels SP can be connected to two or more power lines. The control signal line FCL provides control signals to the fingerprint scanning driver circuit FSDC.

[0132] The fingerprint signal line F-SGL overlaps with the fingerprint sensing area FSA and the surrounding area FSSA. The fingerprint signal line F-SGL can be connected to the contact hole CH. Figure 4 The auxiliary line SSL is shown as part of the connection. The fingerprint signal line F-SGL can be electrically connected to the third-type signal pad FS-PD via the auxiliary line SSL.

[0133] In an exemplary embodiment, the fingerprint scanning driving circuit FSDC can be formed on the same substrate as multiple fingerprint sensing pixels SP, but the present invention is not limited thereto. For example, the fingerprint scanning driving circuit FSDC can be implemented as a separate integrated circuit chip and electrically connected to at least one side of the fingerprint sensing unit FSU. Furthermore, in another embodiment, the fingerprint scanning driving circuit FSDC can be configured inside the readout circuit ROC and provide fingerprint scanning signals to multiple fingerprint scanning lines FSL through connection wiring.

[0134] Figure 7 This diagram illustrates, exemplarily, the connection relationships between the fingerprint sensing pixels, the fingerprint scanning driving circuit, and the reading circuit.

[0135] Reference Figure 7 Each of the fingerprint sensing pixels SP is connected to the corresponding fingerprint sensing line in the multiple fingerprint sensing lines FDL1-FDLm, and is also connected to the corresponding fingerprint scanning line in the multiple fingerprint scanning lines FSL1-FSLn.

[0136] The fingerprint scanning driver circuit FSDC can output fingerprint scanning signals FS1-FSLn to multiple fingerprint scanning lines FSL1-FSLn in response to the fingerprint sensing control signal FSC. The fingerprint sensing control signal FSC can be provided from the read circuit ROC.

[0137] The readout circuit ROC provides the fingerprint sensing control signal FSC to the fingerprint scanning driver circuit FSDC. In addition to providing the fingerprint sensing control signal FSC, the readout circuit ROC can also provide other signals required for the operation of the fingerprint scanning driver circuit FSDC. Furthermore, the readout circuit ROC can receive fingerprint sensing signals RX1-RXm from multiple fingerprint sensing lines FDL1-FDLm.

[0138] When the fingerprint sensing unit (FSU) senses a user's fingerprint, the fingerprint of a user with normal skin is easy to identify because the feature points are clear. Conversely, the fingerprint of a user with dry skin is difficult to identify because the feature points are not clear.

[0139] For example, a user can register their fingerprint in normal skin condition on the display device DD (see fingerprint registration mode). Figure 1 Users may input fingerprints with dry skin in fingerprint authentication mode. In this case, because the feature points of dry skin are different from those of normal skin, user authentication (fingerprint authentication) may fail. Furthermore, in low-temperature environments, the feature points of the user's fingerprint may not be accurately transmitted to the fingerprint sensing panel (FSP).

[0140] Figure 8 This is a block diagram illustrating the configuration of a read circuit ROC according to an exemplary embodiment of the present invention.

[0141] like Figure 8 As shown, the read circuit ROC includes a fingerprint recognition unit FRP and a memory MEM.

[0142] The fingerprint recognition unit (FRP) receives fingerprint sensing signals RX1-RXm and outputs a normal fingerprint image NF and a dried fingerprint image DF. The FRP can generate a normal fingerprint image NF and a dried fingerprint image DF corresponding to the fingerprint sensing signals RX1-RXm according to a fingerprint recognition algorithm.

[0143] The memory MEM can store the fingerprint recognition algorithm executed by the fingerprint recognition unit FRP. The fingerprint recognition algorithm can be software learned through artificial intelligence programs or deep learning.

[0144] The fingerprint recognition unit (FRP) can operate in fingerprint registration mode and fingerprint authentication mode. During fingerprint registration mode, the FRP generates a normal fingerprint image NF and a dried fingerprint image DF corresponding to the fingerprint sensing signals RX1-RXm. First, the FRP generates the normal fingerprint image NF corresponding to the fingerprint sensing signals RX1-RXm and stores it in the memory MEM. The FRP then generates the dried fingerprint image DF based on the generated normal fingerprint image NF. The FRP compares the normal fingerprint image NF and the dried fingerprint image DF stored in the memory MEM, and outputs the dried fingerprint image DF when the matching score between the normal fingerprint image NF and the dried fingerprint image DF is higher than a benchmark score. Finally, the FRP stores the dried fingerprint image DF in the memory MEM.

[0145] The fingerprint recognition unit (FRP) can store a regular fingerprint template corresponding to a regular fingerprint image (NF) and a dried fingerprint template corresponding to a dried fingerprint image (DF) in the memory (MEM). The regular fingerprint template includes attribute information of the feature points included in the regular fingerprint image (NF), and the dried fingerprint template can include attribute information of the feature points included in the dried fingerprint image (DF). The attribute information of the feature points can include the position of the feature points, the angle of the feature points, the reliability of the feature points, the curvature around the feature points, and the thickness of the fingerprint lines around the feature points, etc.

[0146] The ordinary fingerprint image (NF) and the dried fingerprint image (DF) output from the fingerprint recognition unit (FRP) can be provided to... Figure 2c The control module CM shown is or Figure 3c The control module CM is shown.

[0147] During fingerprint authentication mode, the fingerprint recognition unit (FRP) generates a fingerprint image corresponding to the fingerprint sensing signals RX1-RXm. The FRP can perform user authentication (fingerprint authentication) by comparing the fingerprint image generated from the fingerprint sensing signals RX1-RXm with a regular fingerprint template and a dried fingerprint template stored in the memory MEM.

[0148] In another embodiment, during fingerprint authentication mode, the fingerprint recognition unit (FRP) outputs the fingerprint image corresponding to the fingerprint sensing signals RX1-RXm as either a normal fingerprint image (NF) or a dried fingerprint image (DF). For example, if the fingerprint image corresponding to the fingerprint sensing signals RX1-RXm sufficiently includes feature points, the fingerprint image corresponding to the fingerprint sensing signals RX1-RXm can be output as the normal fingerprint image (NF). The fingerprint recognition unit (FRP) compares the normal fingerprint image (NF) with the normal fingerprint template and the dried fingerprint template stored in the memory MEM, and performs user authentication (fingerprint authentication) based on the comparison result.

[0149] Furthermore, when the fingerprint image corresponding to the fingerprint sensing signals RX1-RXm does not sufficiently include feature points, the fingerprint image corresponding to the fingerprint sensing signals RX1-RXm can become a dry fingerprint image DF. The fingerprint recognition unit FRP can convert the dry fingerprint image DF into a normal fingerprint image NF, compare the converted normal fingerprint image NF with the normal fingerprint template and the dry fingerprint template stored in the memory MEM, and perform user authentication (fingerprint authentication) based on the comparison result.

[0150] In another embodiment, the fingerprint recognition unit FRP outputs the fingerprint image corresponding to the fingerprint sensing signals RX1-RXm as a normal fingerprint image NF during the fingerprint authentication mode. Figure 2c The control module CM shown is or Figure 3cThe control module CM shown can perform user authentication (fingerprint authentication) using the ordinary fingerprint image NF received from the fingerprint recognition unit FRP.

[0151] Figure 9 The diagram illustrates, for example, a standard fingerprint template and a dried fingerprint template.

[0152] Reference Figure 8 and Figure 9 During fingerprint registration mode, the fingerprint recognition unit (FRP) generates a standard fingerprint image (NF) corresponding to the fingerprint sensing signals RX1-RXm, and stores the standard fingerprint template corresponding to the standard fingerprint image (NF) in the memory (MEM). For example, in the display device (DD) (reference...) Figure 1 When configured to receive six fingerprints from a user, the fingerprint recognition unit (FRP) sequentially receives six fingerprint sensing signals RX1-RXm and generates six ordinary fingerprint images NF corresponding to each of the six input fingerprint sensing signals RX1-RXm. The FRP can sequentially store the six ordinary fingerprint templates NT1-NT6 corresponding to the six ordinary fingerprint images NF into the memory MEM. Furthermore, the FRP can sequentially store four dried fingerprint templates DT1-DT4 corresponding to four of the six ordinary fingerprint images NF into the memory MEM. As a result, the fingerprint template FT can include six ordinary fingerprint templates NT1-NT6 and four dried fingerprint templates DT1-DT4.

[0153] The number of ordinary fingerprint templates NT1 to NT6 and the number of dried fingerprint templates DT1 to DT4 stored in the memory MEM can be varied in various ways. For example, the number of ordinary fingerprint templates and the number of dried fingerprint templates stored in the memory MEM can be the same.

[0154] Furthermore, in the exemplary embodiment, ordinary fingerprint templates NT1 to NT6 and dried fingerprint templates DT1 to DT4 are stored in the memory MEM within the read circuit ROC. In one embodiment, the fingerprint recognition unit FRP can... Figure 2c or Figure 3c The control module CM shown provides standard fingerprint templates NT1-NT6 and dried fingerprint templates DT1-DT4. The control module CM can store the standard fingerprint templates NT1-NT6 and the dried fingerprint templates DT1-DT4 into... Figure 2c or Figure 3c The memory MM shown is shown.

[0155] Figure 10 This is a flowchart illustrating the operation of a fingerprint registration mode on a display device according to an embodiment of the present invention. For ease of explanation, it is shown below. Figure 8The present invention will be described in the case where the reading circuit ROC performs the fingerprint registration mode operation of the display device, but the invention is not limited thereto. The fingerprint registration mode of the display device can be... Figure 2c or Figure 3c The control module CM shown is executed.

[0156] Reference Figure 10 The fingerprint recognition unit FRP can be obtained from Figure 7 The fingerprint sensing pixel SP of the fingerprint sensing unit FSU shown receives fingerprint sensing signals RX1-RXm (step S100).

[0157] The fingerprint recognition unit (FRP) generates a normal fingerprint image (NF) corresponding to the fingerprint sensing signals RX1-RXm (step S110).

[0158] The fingerprint recognition unit FRP generates a dried fingerprint image DF corresponding to the fingerprint sensing signals RX1-RXm (S120). In one embodiment, the fingerprint recognition unit FRP can generate a dried fingerprint image based on a normal fingerprint image NF. The dried fingerprint image generated from the fingerprint recognition unit FRP is a virtual fingerprint image generated based on the fingerprint sensing signals RX1-RXm, predicting the fingerprint image that might be input when the user's skin is dry.

[0159] The fingerprint recognition unit (FRP) determines whether the generated dry fingerprint image meets the fingerprint registration conditions (step S130). For example, if the matching score between the generated dry fingerprint image and the ordinary fingerprint image (NF) is higher than the benchmark score, the fingerprint recognition unit (FRP) can output the generated dry fingerprint image as the dry fingerprint image (DF). The matching score can be a score representing the degree of matching (or consistency) between the generated dry fingerprint image and the ordinary fingerprint image (NF).

[0160] If the generated dry fingerprint image meets the fingerprint registration conditions, i.e., when the matching score is higher than the benchmark score, the fingerprint recognition unit FRP outputs a normal fingerprint image NF and a dry fingerprint image DF (step S140). The normal fingerprint image NF and the dry fingerprint image DF can be provided to... Figure 2c or Figure 3c The control module CM is shown.

[0161] If the generated dry fingerprint image does not meet the fingerprint registration conditions, that is, when the matching score is below the benchmark score, the fingerprint recognition unit FRP repeats the operation of generating a new dry fingerprint image based on the fingerprint sensing signals RX1-RXm (step S120).

[0162] Although not shown in the figure, the fingerprint recognition unit (FRP) may not generate a dry fingerprint image (DF) when the number of times the generated dry fingerprint image fails to meet the fingerprint registration conditions is k (k is a positive integer). As previously stated... Figure 9 The text explains that when the fingerprint recognition unit FRP generates four dry fingerprint templates DT1 to DT4, which correspond to four of the six ordinary fingerprint images NF respectively, the fingerprint recognition unit FRP may not generate a dry fingerprint image DF corresponding to the currently received fingerprint sensing signals RX1-RXm.

[0163] Next, the fingerprint recognition unit FRP stores (registers) the ordinary fingerprint template corresponding to the ordinary fingerprint image NF and the dried fingerprint template corresponding to the dried fingerprint image DF in the memory MEM (step S150). The fingerprint recognition unit FRP can then... Figure 2c or Figure 3c The control module CM shown provides both standard fingerprint templates and dried fingerprint templates.

[0164] Figure 11 This is a flowchart of a fingerprint authentication mode for a display device according to an embodiment of the present invention. For ease of explanation, it is shown below. Figure 8 The present invention will be described in the case where the reading circuit ROC performs the operation of the fingerprint authentication mode of the display device, but the invention is not limited thereto. The fingerprint authentication mode of the display device can be... Figure 2c or Figure 3c The control module CM shown is executed.

[0165] Reference Figure 11 The fingerprint recognition unit FRP can be obtained from Figure 7 The fingerprint sensing pixel SP of the fingerprint sensing unit FSU shown receives fingerprint sensing signals RX1-RXm (step S200).

[0166] The fingerprint recognition unit (FRP) generates fingerprint images corresponding to the fingerprint sensing signals RX1-RXm (step S210).

[0167] The fingerprint recognition unit FRP outputs the generated fingerprint image as a fingerprint image (step S220). As an example, the fingerprint recognition unit FRP can output the fingerprint image as a normal fingerprint image NF.

[0168] The fingerprint recognition unit (FRP) determines whether the fingerprint image matches the fingerprint template (FT) stored in the memory (MEM) (step S230). The fingerprint template (FT) stored in the memory (MEM) may include... Figure 9 The images show the standard fingerprint templates NT1 to NT6 and the dried fingerprint templates DT1 to DT4.

[0169] If the fingerprint image matches the fingerprint template FT stored in the memory MEM, the fingerprint recognition unit FRP can determine that user authentication (fingerprint authentication) is successful (step S240). For example, if the fingerprint image matches one of the ordinary fingerprint templates NT1 to NT6 and the dried fingerprint templates DT1 to DT4 in the fingerprint template FT, the fingerprint recognition unit FRP can determine that user authentication (fingerprint authentication) is successful. That is, when there is a template among the ordinary fingerprint templates NT1 to NT6 and the dried fingerprint templates DT1 to DT4 that has a matching score of more than a benchmark score with the fingerprint image, the fingerprint recognition unit FRP can determine that user authentication (fingerprint authentication) is successful.

[0170] If the fingerprint image does not match the fingerprint template FT stored in the memory MEM, the fingerprint recognition unit FRP can determine that user authentication (fingerprint authentication) has failed (step S250). For example, if the fingerprint image does not match any of the ordinary fingerprint templates NT1 to NT6 and the dried fingerprint templates DT1 to DT4 in the fingerprint template FT, the fingerprint recognition unit FRP can determine that user authentication (fingerprint authentication) has failed. That is, if there is no template among the ordinary fingerprint templates NT1 to NT6 and the dried fingerprint templates DT1 to DT4 that has a matching score of more than a benchmark score with the fingerprint image, the fingerprint recognition unit FRP can determine that user authentication (fingerprint authentication) has failed.

[0171] Figure 12 This is a flowchart of a fingerprint authentication mode for a display device according to an embodiment of the present invention. For ease of explanation, it is shown below. Figure 8 The example shown illustrates the operation of the fingerprint authentication mode of the display device using the reading circuit ROC, but the invention is not limited thereto. The fingerprint authentication mode of the display device can be... Figure 2c or Figure 3c The control module CM shown is executed.

[0172] Reference Figure 12 The fingerprint recognition unit is made of FRP. Figure 7 The fingerprint sensing pixel SP of the fingerprint sensing unit FSU shown receives fingerprint sensing signals RX1-RXm (step S300).

[0173] The fingerprint recognition unit (FRP) generates fingerprint images corresponding to the fingerprint sensing signals RX1-RXm (step S310).

[0174] The fingerprint recognition unit FRP outputs the generated fingerprint image as a fingerprint image (step S320). As an example, the fingerprint recognition unit FRP can output the fingerprint image as a normal fingerprint image NF.

[0175] The fingerprint recognition unit FRP determines whether the fingerprint image matches one of the ordinary fingerprint templates NT1 to NT6 stored in the fingerprint template FT in the memory MEM (step S330).

[0176] If the fingerprint image matches one of the ordinary fingerprint templates NT1 to NT6 stored in the fingerprint template FT in the memory MEM, the fingerprint recognition unit FRP can determine that user authentication (fingerprint authentication) is successful (step S350). For example, if there is a template among the ordinary fingerprint templates NT1 to NT6 in the fingerprint template FT that has a matching score of above the benchmark score with the fingerprint image, the fingerprint recognition unit FRP can determine that user authentication (fingerprint authentication) is successful.

[0177] If the fingerprint image does not match any of the ordinary fingerprint templates NT1 to NT6 stored in the memory MEM, the fingerprint recognition unit FRP determines whether the fingerprint image matches any of the dried fingerprint templates DT1 to DT4 stored in the fingerprint template FT in the memory MEM (step S340).

[0178] If the fingerprint image matches one of the dried fingerprint templates DT1 to DT4 stored in the fingerprint template FT in the memory MEM, the fingerprint recognition unit FRP can determine that user authentication (fingerprint authentication) is successful (step S350). For example, if there is a template among the dried fingerprint templates DT1 to DT4 in the fingerprint template FT that has a matching score of more than a benchmark score with the fingerprint image, the fingerprint recognition unit FRP can determine that user authentication (fingerprint authentication) is successful.

[0179] If the fingerprint image does not match any of the dried fingerprint templates DT1 to DT4 stored in the memory MEM, the fingerprint recognition unit FRP can determine that the user authentication (fingerprint authentication) has failed (step S360).

[0180] Figure 13 This is a flowchart of a fingerprint authentication mode for a display device according to an embodiment of the present invention. For ease of explanation, it is shown below. Figure 8 The present invention will be described in the case where the reading circuit ROC performs the operation of the fingerprint authentication mode of the display device, but the invention is not limited thereto. The fingerprint authentication mode of the display device can be... Figure 2c or Figure 3c The control module CM shown is executed.

[0181] Reference Figure 13 The fingerprint recognition unit is made of FRP. Figure 7 The fingerprint sensing pixel SP of the fingerprint sensing unit FSU shown receives fingerprint sensing signals RX1-RXm (step S400).

[0182] The fingerprint recognition unit (FRP) generates fingerprint images corresponding to the fingerprint sensing signals RX1-RXm (step S410).

[0183] The fingerprint recognition unit (FRP) determines whether the generated fingerprint image is a dry fingerprint image (step S420). For example, if the generated fingerprint image does not sufficiently include feature point information, the fingerprint recognition unit (FRP) can determine that the generated fingerprint image is a dry fingerprint image.

[0184] If the generated fingerprint image is determined to be a dry fingerprint image, the fingerprint recognition unit (FRP) converts the generated fingerprint image into a normal fingerprint image (step S430). The operation of converting the generated fingerprint image into a normal fingerprint image (NF) can be performed by a fingerprint recognition algorithm stored in the memory (MEM).

[0185] The fingerprint recognition unit (FRP) outputs the converted ordinary fingerprint image as an ordinary fingerprint image (NF) (step S440).

[0186] If in step S420 it is determined that the generated fingerprint image is not a dry fingerprint image, then the fingerprint recognition unit FRP can output the generated fingerprint image as a normal fingerprint image NF.

[0187] The fingerprint recognition unit (FRP) determines whether the ordinary fingerprint image (NF) matches one of the fingerprint templates (FT) stored in the memory (MEM) (step S450).

[0188] If the ordinary fingerprint image NF matches one of the fingerprint templates FT stored in the memory MEM, the fingerprint recognition unit FRP can determine that user authentication (fingerprint authentication) is successful (step S460). For example, if there is a template in the fingerprint template FT that has a matching score higher than the benchmark score of the ordinary fingerprint image NF, the fingerprint recognition unit FRP can determine that user authentication (fingerprint authentication) is successful.

[0189] If the fingerprint image does not match any of the fingerprint templates FT stored in the memory MEM, the fingerprint recognition unit FRP can determine that the user authentication (fingerprint authentication) has failed (step S470).

[0190] Even when a user enters their fingerprint for authentication while their skin is dry, the fingerprint recognition unit (FRP) performing this fingerprint authentication mode can minimize fingerprint authentication errors.

[0191] In one embodiment, the fingerprint recognition unit FRP can determine in step S450 whether any one of the ordinary fingerprint templates NT1 to NT6 in the fingerprint template FT stored in the memory MEM is consistent with the ordinary fingerprint image NF.

[0192] Figure 14This is a flowchart of a fingerprint authentication mode for a display device according to an embodiment of the present invention. For ease of explanation, it is shown below. Figure 8 The present invention will be described in the case where the reading circuit ROC performs the operation of the fingerprint authentication mode of the display device, but the invention is not limited thereto. The fingerprint authentication mode of the display device can be... Figure 2c or Figure 3c The control module CM shown is executed.

[0193] Reference Figure 14 The fingerprint recognition unit is made of FRP. Figure 7 The fingerprint sensing pixel SP of the fingerprint sensing unit FSU shown receives fingerprint sensing signals RX1-RXm (step S500).

[0194] The fingerprint recognition unit (FRP) generates fingerprint images corresponding to the fingerprint sensing signals RX1-RXm (step S510).

[0195] The fingerprint recognition unit (FRP) determines whether the generated fingerprint image is a dry fingerprint image (step S520). For example, if the generated fingerprint image does not sufficiently include feature point information, the fingerprint recognition unit (FRP) can determine that the generated fingerprint image is a dry fingerprint image.

[0196] If the generated fingerprint image is determined to be a dry fingerprint image, the fingerprint recognition unit FRP converts the generated fingerprint image into a normal fingerprint image (step S530). The operation of converting the generated fingerprint image into a normal fingerprint image NF can be performed by a fingerprint recognition algorithm stored in the memory MEM.

[0197] The fingerprint recognition unit (FRP) outputs the converted ordinary fingerprint image as an ordinary fingerprint image (NF) (step S540).

[0198] If in step S520 it is determined that the generated fingerprint image is not a dry fingerprint image, the fingerprint recognition unit FRP can output the generated fingerprint image as a normal fingerprint image NF.

[0199] The fingerprint recognition unit FRP determines whether the ordinary fingerprint image NF matches one of the ordinary fingerprint templates NT1 to NT6 stored in the fingerprint template internal memory MEM (step S550).

[0200] If the ordinary fingerprint image NF matches one of the ordinary fingerprint templates NT1 to NT6 stored in the fingerprint template FT in the memory MEM, the fingerprint recognition unit FRP can determine that user authentication (fingerprint authentication) is successful (step S570). For example, if there is a template among the ordinary fingerprint templates NT1 to NT6 in the fingerprint template FT that has a matching score higher than the benchmark score of the ordinary fingerprint image NF, the fingerprint recognition unit FRP can determine that user authentication (fingerprint authentication) is successful.

[0201] If the fingerprint image does not match any of the ordinary fingerprint templates NT1 to NT6 stored in the memory MEM, the fingerprint recognition unit FRP can determine whether the ordinary fingerprint image NF matches one of the dried fingerprint templates DT1 to DT4 stored in the fingerprint template FT in the memory MEM (step S560).

[0202] If the ordinary fingerprint image NF matches one of the dried fingerprint templates DT1 to DT4 stored in the fingerprint template FT in the memory MEM, the fingerprint recognition unit FRP can determine that user authentication (fingerprint authentication) is successful (step S570). For example, if there is a template among the dried fingerprint templates DT1 to DT4 in the fingerprint template FT that has a matching score higher than the benchmark score of the fingerprint image NF, the fingerprint recognition unit FRP can determine that user authentication (fingerprint authentication) is successful.

[0203] If, in step S560, the ordinary fingerprint image NF is inconsistent with any one of the dried fingerprint templates DT1 to DT4 stored in the fingerprint template FT in the memory MEM, then the fingerprint recognition unit FRP can determine that the user authentication (fingerprint authentication) has failed (step S580).

[0204] Even when a user enters their fingerprint for authentication while their skin is dry, the fingerprint recognition unit (FRP) performing this fingerprint authentication mode can minimize fingerprint authentication errors.

[0205] Figure 15a and Figure 15b An example is shown of the user interface screen displayed on the display device DD in fingerprint registration mode.

[0206] Reference Figure 15a In fingerprint registration mode, the user can register their fingerprint by selecting the first setting SET1 displayed on the display device DD. Furthermore, the user can register detailed biometric settings by selecting the second setting SET2 displayed on the display device DD. If the user selects (touches) the second setting SET2, it will be displayed on the display device DD. Figure 15b The screen shown.

[0207] Reference Figure 15b Users can select automatic registration of dried fingerprints by touching the third setting SET3 displayed on the display device DD. If the user touches the third setting SET3 and selects the automatic registration of dried fingerprints as "On", then the following steps can be performed. Figure 10 The fingerprint registration mode shown.

[0208] As in Figure 10As explained, during fingerprint registration mode, the fingerprint recognition unit (FRP) can register not only ordinary fingerprint templates corresponding to the fingerprint entered by the user, but also automatically register dried fingerprint templates.

[0209] The display device DD, which registers both a regular fingerprint template and a dried fingerprint template, can minimize fingerprint authentication errors when the user's skin is dry by determining whether the fingerprint entered by the user matches the regular fingerprint template or the dried fingerprint template in fingerprint authentication mode.

[0210] While the foregoing description has been based on embodiments, those skilled in the art will understand that various modifications and alterations can be made to the invention without departing from the spirit and scope of the invention as set forth in the claims. Furthermore, the embodiments disclosed herein are not intended to limit the technical concept of the invention, and all technical concepts falling within the scope of the claims and their equivalents should be interpreted as being included within the scope of the invention.

Claims

1. A display device, comprising: Display unit, displays images; A fingerprint sensing unit is disposed on one side of the display unit and includes fingerprint sensing pixels for sensing fingerprints; as well as The reading circuit receives the fingerprint sensing signal from the fingerprint sensing pixel. The reading circuit generates a normal fingerprint image and a dried fingerprint image corresponding to the fingerprint sensing signal during the fingerprint registration mode. The reading circuit generates the dry fingerprint image corresponding to the fingerprint sensing signal. When the matching score between the dry fingerprint image and the ordinary fingerprint image is higher than the benchmark score, it stores a fingerprint template including an ordinary fingerprint template and a dry fingerprint template. The ordinary fingerprint template corresponds to the ordinary fingerprint image, and the dry fingerprint template corresponds to the dry fingerprint image.

2. The display device as claimed in claim 1, wherein, The reading circuit calculates a matching score, which represents the degree of matching between the dried fingerprint image and the ordinary fingerprint image.

3. The display device as claimed in claim 1, wherein, The fingerprint templates include multiple ordinary fingerprint templates and multiple dried fingerprint templates.

4. The display device as claimed in claim 1, wherein, The reading circuit generates a fingerprint image corresponding to the fingerprint sensing signal during fingerprint authentication mode, and compares the generated fingerprint image with the fingerprint template.

5. The display device as claimed in claim 1, wherein, The reading circuit generates a dry fingerprint image corresponding to the fingerprint sensing signal during the fingerprint authentication mode, converts the dry fingerprint image into a normal fingerprint image, and compares the normal fingerprint image with the fingerprint template.

6. The display device as claimed in claim 1, wherein, The display unit includes a display area with arranged pixels and a non-display area adjacent to the display area. The fingerprint sensing pixels of the fingerprint sensing unit are arranged in the fingerprint sensing area corresponding to the display area.

7. The display device as claimed in claim 1, wherein, The fingerprint sensing pixels are connected to multiple fingerprint scanning lines and multiple fingerprint sensing lines, respectively. The fingerprint sensing unit further includes: The fingerprint scanning driving circuit sequentially drives the multiple fingerprint scanning lines.

8. The display device as claimed in claim 7, wherein, The reading circuit receives the fingerprint sensing signal from the multiple fingerprint sensing lines.

Images