Display device and fingerprint detection method

Abstract

The present disclosure relates to a display device and a fingerprint detection method. The display device includes a display panel including a pinhole optical system and an optical sensor overlapping the pinhole optical system. The fingerprint detection method of detecting a fingerprint of a user using the display device includes obtaining fingerprint sensing data by sensing a fingerprint of a user using the display device, detecting misalignment information indicating a degree of misalignment between the pinhole optical system and the optical sensor, generating calibration data using at least one piece of reference data corresponding to at least one reference folding angle according to the detected misalignment information, generating fingerprint data by correcting the fingerprint sensing data using the calibration data, and detecting a fingerprint of the user according to the fingerprint data.

Description

[0001] Cross-references to related applications

[0002] This application claims priority to Korean Patent Application No. 10-2020-0104207, filed on August 19, 2020, with the Korean Intellectual Property Office, the entire disclosure of which is incorporated herein by reference. Technical Field

[0003] This invention relates to a display device and a fingerprint detection method using the display device. Background Technology

[0004] Biometric authentication methods using a user's fingerprint can be used in display devices such as smartphones or tablet PCs. To implement biometric authentication, a fingerprint sensor can be embedded in the display device. Summary of the Invention

[0005] Embodiments of the present invention provide a display device including a pinhole optical system and an optical sensor, and a fingerprint detection method using the display device.

[0006] According to an embodiment of the present invention, a fingerprint detection method includes: obtaining fingerprint sensing data by sensing a user's fingerprint using a display device, the display device including: a display panel including a pinhole optical system and an optical sensor overlapping the pinhole optical system; detecting misalignment information indicating the degree of misalignment between the pinhole optical system and the optical sensor; generating calibration data based on the detected misalignment information using at least one reference data corresponding to at least one reference folding angle; generating fingerprint data by correcting the fingerprint sensing data using the calibration data; and detecting the user's fingerprint based on the fingerprint data.

[0007] In an embodiment, detecting the misalignment information includes: using the fingerprint sensing data to detect the position information of a plurality of pinholes included in the pinhole optical system; and detecting the difference in the amount of movement between the pinhole optical system and the optical sensor by comparing the position information of the pinholes with the at least one reference data.

[0008] In one embodiment, generating the calibration data includes: comparing the location information of the pinhole with multiple reference data, selecting two reference data with high similarity from the multiple reference data; and generating the calibration data by interpolating the two reference data.

[0009] In an embodiment, interpolating the two reference data includes: setting an offset value for each of the two reference data by comparing the location information of the pinhole with the extracted location information of the pinhole extracted from the two reference data; assigning a weight to each of the two reference data according to the offset value used for each of the two reference data; and summing the weighted two reference data.

[0010] In an embodiment, the offset value for each of the two reference data is a correction value set to match the position of the pinhole in each of the two reference data with the position of the detected pinhole.

[0011] In one embodiment, generating the calibration data includes: setting an offset value for the single reference data by comparing the location information of the pinhole with the extracted location information of the pinhole extracted from a single reference data; and correcting the single reference data according to the offset value to generate the calibration data.

[0012] In an embodiment, the offset value is a correction value set to match the position of the pinhole in the single reference data with the position of the detected pinhole.

[0013] In one embodiment, detecting the misalignment information includes detecting the folding angle of the display device.

[0014] In one embodiment, detecting the folding angle of the display device includes detecting the folding angle using a sensing signal output from a touch sensor.

[0015] In one embodiment, generating the calibration data includes selecting a reference data as the calibration data corresponding to the detected folding angle.

[0016] In one embodiment, generating the calibration data includes: selecting two reference data points corresponding to two reference folding angles similar to the detected folding angle; and generating the calibration data by interpolating the two reference data points.

[0017] In one embodiment, generating the calibration data includes: extracting an offset value corresponding to the detected folding angle; and generating the calibration data by correcting the at least one reference data based on the offset value.

[0018] In one embodiment, generating the calibration data includes: interpolating two offset values ​​for two reference folding angles similar to the detected folding angle; and generating the calibration data by correcting the at least one reference data according to the interpolated two offset values.

[0019] According to an embodiment of the present invention, a display device includes: a display panel including a pinhole optical system; an optical sensor overlapping the pinhole optical system; a memory storing at least one reference data corresponding to at least one reference folding angle; and a sensor controller that detects misalignment information indicating the degree of misalignment between the pinhole optical system and the optical sensor, and corrects fingerprint sensing data based on the detected misalignment information and the at least one reference data.

[0020] In one embodiment, the sensor controller includes: a fingerprint sensing data generator that generates the fingerprint sensing data using an electrical signal from the optical sensor; a motion detector that detects the misalignment information; a calculator that generates calibration data corresponding to the detected misalignment information; and an image processor that corrects the fingerprint sensing data using the calibration data.

[0021] In one embodiment, the calculator selects at least one reference data stored in the memory that corresponds to the detected misalignment information, and uses the selected at least one reference data to generate the calibration data.

[0022] In one embodiment, the calculator generates the calibration data by correcting at least one reference data stored in the memory based on an offset value corresponding to the detected misalignment information.

[0023] In one embodiment, the display panel includes a flexible folding region and a first flat region and a second flat region disposed on opposite sides of the folding region.

[0024] In one embodiment, the display device further includes a touch sensor, comprising at least one touch electrode disposed in the first flat area and at least one touch electrode disposed in the second flat area.

[0025] In one embodiment, the display device further includes a folding angle detector for detecting a folding angle from the output signal of the touch sensor. The sensor controller corrects the fingerprint sensing data based on the detected folding angle.

[0026] According to embodiments of the present invention, a display device and a fingerprint detection method using the display device improve the signal-to-noise ratio (SNR) and enable high-precision fingerprint detection even when the alignment between the pinhole optical system and the optical sensor is misaligned due to, for example, folding or bending, in a display device that detects fingerprints using a pinhole optical system embedded in the display panel. Therefore, the fingerprint authentication performance of the display device can be improved. Attached Figure Description

[0027] The above and other features of the invention will become more apparent from the embodiments described in detail with reference to the accompanying drawings, in which:

[0028] Figure 1 This is a plan view illustrating a display device according to an embodiment of the present invention;

[0029] Figure 2 It is along Figure 1 A cross-sectional view taken from line I-I';

[0030] Figure 3 It is shown Figure 1 and Figure 2 An enlarged cross-sectional view of the fingerprint sensing area of ​​the display device shown;

[0031] Figure 4 This is a perspective view schematically illustrating a display device according to an embodiment of the present invention;

[0032] Figure 5 This is a block diagram illustrating a display device according to an embodiment of the present invention;

[0033] Figure 6 This is a block diagram illustrating a fingerprint detection and authentication method according to an embodiment of the present invention;

[0034] Figures 7A to 11B A method for correcting fingerprint sensing data according to an embodiment of the present invention is shown;

[0035] Figures 12A to 12D The diagram illustrates the misalignment that occurs between the pinhole optical system and the optical sensor due to the foldable display device, and the pinhole position deviation in the fingerprint sensing data and calibration data based on the misalignment.

[0036] Figures 13A to 17B The process of processing fingerprint sensing data obtained by the optical sensor under conditions of misalignment between the pinhole optical system and the optical sensor is shown, along with the image profile based on this process.

[0037] Figure 18A and Figure 18B This is a block diagram illustrating a sensor controller according to an embodiment of the present invention;

[0038] Figure 19 This is a block diagram illustrating a fingerprint detection and authentication method according to an embodiment of the present invention;

[0039] Figures 20A to 20D A method for generating benchmark data according to an embodiment of the present invention is shown;

[0040] Figure 21A and Figure 21BA method for selecting reference data according to an embodiment of the present invention is shown;

[0041] Figure 22 A method for generating calibration data according to an embodiment of the present invention is shown;

[0042] Figure 23 A method for generating calibration data according to an embodiment of the present invention is shown;

[0043] Figure 24 The effects of an embodiment based on multiple reference data using multiple folding angles are shown;

[0044] Figure 25 The effect of an embodiment based on a single reference data point using a single folding angle is shown;

[0045] Figure 26 This is a block diagram illustrating a fingerprint detection and authentication method according to an embodiment of the present invention;

[0046] Figure 27 This is a plan view illustrating a touch sensor according to an embodiment of the present invention;

[0047] Figure 28A and Figure 28B This is a schematic illustration of the effects of folding. Figure 27 A cross-sectional view of the capacitance change between touch electrodes caused by the touch sensor in the display device;

[0048] Figure 29 A method for selecting calibration data according to an embodiment of the present invention is shown; and

[0049] Figure 30 A method for setting offset values ​​for calibration data according to an embodiment of the present invention is shown. Detailed Implementation

[0050] In the following description, embodiments of the invention will be described more fully with reference to the accompanying drawings. Throughout the drawings, the same reference numerals may refer to the same elements.

[0051] It should be understood that the terms “first,” “second,” “third,” etc., are used herein to distinguish one element from another, and the elements are not limited by these terms. Therefore, a “first” element in one embodiment may be described as a “second” element in another embodiment. Unless the context clearly indicates otherwise, singular terms may include plural forms.

[0052] It should be understood that, unless the context clearly indicates otherwise, the description of features or aspects within each embodiment should generally be considered applicable to other similar features or aspects in other embodiments.

[0053] When a value is described as being approximately the same as or approximately equal to another value, it will be understood that the values ​​are equal to each other within measurement error, or, if measurably unequal, are sufficiently close in value to be functionally equal, as will be understood by one of ordinary skill in the art. It will also be understood that when two components or directions are described as extending substantially parallel or perpendicular to each other, the two components or directions extend precisely parallel or perpendicular to each other, or, as will be understood by one of ordinary skill in the art, extend approximately parallel or perpendicular to each other (e.g., within measurement error). Other uses of the terms “substantially” and “approximately” should be interpreted in a similar manner.

[0054] Figure 1 This is a plan view illustrating a display device DD according to an embodiment of the present invention. Figure 2 It is along Figure 1 A cross-sectional view taken by line I-I'. For example, Figure 1 and Figure 2 The structure of the display device DD is schematically shown with an emphasis on the panel unit PNL.

[0055] Reference Figure 1 and Figure 2 The display device DD includes a display panel DP and a window WD for protecting the display panel DP. The display panel DP includes pixels PX (also called "display pixels") provided in the display area DA to display images.

[0056] Furthermore, the display device DD may include at least one type of sensor to provide various functions. For example, the display device DD may include: a touch sensor TS, including touch electrodes TSE provided in the touch sensing area TSA; and an optical sensor PHS, including sensor pixels SPXL provided in the fingerprint sensing area FSA.

[0057] In embodiments, the touch sensing area TSA and the fingerprint sensing area FSA may overlap with the display area DA. For example, the entire area of ​​the display area DA may be set as the touch sensing area TSA, and a partial area of ​​the display area DA may be set as the fingerprint sensing area FSA. However, the invention is not limited thereto. For example, according to embodiments of the invention, the positions and / or sizes of the touch sensing area TSA and the fingerprint sensing area FSA may be varied.

[0058] Furthermore, the display device DD may also include a cover panel CPN provided on the rear surface of the display panel DP. The cover panel CPN can improve the strength of the device. In an embodiment, an optical sensor PHS may be provided on the rear surface of the display panel DP, configured to surround the cover panel CPN. For example, the cover panel CPN may include an opening corresponding to the fingerprint sensing area FSA, and the optical sensor PHS may be disposed in the opening. In this case, the thickness of the display device DD can be reduced, and the flexibility of the display device DD can be ensured. However, the invention is not limited thereto. For example, in an embodiment, at least a portion of the optical sensor PHS may be disposed in the opening of the cover panel CPN, or the optical sensor PHS may be arranged not to be disposed in the opening.

[0059] The display device DD can have various shapes. For example, the display device DD can have a rectangular shape, in which the length in the first direction DR1 (hereinafter also referred to as the "X-axis direction") is greater than the length in the second direction DR2 (hereinafter also referred to as the "Y-axis direction"). Furthermore, the display device DD can have various shapes. For example, the display device DD can have various shapes, such as a closed polygon including straight sides, a circle or ellipse including curved sides, a semicircle or semi-ellipse including both straight and curved sides, etc. Moreover, the display device DD can have angled corners or curved surfaces.

[0060] The display device DD may be flexible throughout or at least in a portion of its area. In an embodiment, at least one area of ​​the display device DD may be configured as a deformable area (e.g., a foldable area). The display device DD may, for example, fold or roll up in the deformable area. For instance, the display device DD may be a foldable display device.

[0061] The display panel DP can have a shape that matches the shape of the display device DD. For example, the display panel DP can have a rectangular shape or various other shapes.

[0062] The display panel (DP) can display any visual information, including, for example, text, video, photographs, 2D or 3D images, on its front side. In this invention, the type and / or structure of the display panel (DP) are not specifically limited.

[0063] In this embodiment, the display panel DP can be a light-emitting display panel that includes light-emitting elements. For example, the display panel DP can be a light-emitting display panel that uses organic light-emitting diodes or ultra-small inorganic light-emitting diodes as the light source for each pixel, wherein the ultra-small inorganic light-emitting diodes can be at the nanometer to micrometer scale. Furthermore, the display panel DP can be made from other types of display panels.

[0064] The display panel DP and the display device DD including the display panel DP may include a display area DA in which an image is displayed and a non-display area NDA disposed around the display area DA. For example, the non-display area NDA may surround the display area DA.

[0065] Pixels PX can be provided in the display area DA. Lines, pads, and / or at least one driving circuit (e.g., at least one of a gate driver and a data driver) for driving the pixels PX in the display area DA can be provided in the non-display area NDA.

[0066] The display panel DP may include a substrate SUB and a display pixel layer DPL provided on the substrate SUB. Furthermore, the display panel DP may also include a pinhole layer PHL. For example, the display panel DP may include a pinhole layer PHL disposed between the substrate SUB and the display pixel layer DPL. However, the location of the pinhole layer PHL is not limited to this and can be varied according to embodiments of the invention. For example, in embodiments, the pinhole layer PHL may be provided inside the display pixel layer DPL (e.g., a circuit element layer and / or a light-emitting element layer), or it may be provided within the display pixel layer DPL. In embodiments, the pinhole layer PHL may be disposed below the substrate SUB.

[0067] The substrate SUB can be made of various materials, such as glass or polymeric organic materials. In an embodiment, when the display device DD is a foldable display device, the substrate SUB can be formed of an insulating substrate made of a polymeric organic material. Insulating substrates comprising polymeric organic materials can include at least one of, for example, polystyrene, polyvinyl alcohol, polymethyl methacrylate, polyethersulfone, polyacrylate, polyetherimide, polyethylene naphthalate, polyethylene terephthalate, polyphenylene sulfide, polyarylate, polyimide, polycarbonate, cellulose triacetate, and cellulose acetate propionate. However, the material of the substrate SUB is not limited to these. For example, in an embodiment, the substrate SUB can be made of glass fiber reinforced plastic (FRP).

[0068] The pinhole layer PHL may include multiple pinhole apertures (PIHs) provided in the fingerprint sensing area (FSA), and a light-blocking member (LBM) surrounding the pinhole PIHs. The light-blocking member LBM may be made of a material capable of blocking light, including, for example, conventional black matrix materials or metals, and the constituent material of the light-blocking member LBM is not specifically limited. The pinhole PIHs may be openings formed in the light-blocking member LBM at a predetermined distance and / or size, at least within the fingerprint sensing area (FSA). Therefore, only a portion of the light incident on the pinhole layer PHL that passes through the pinhole PIHs can be incident on the optical sensor PHS.

[0069] A pinhole layer (PHL) can form a pinhole optical system for sensing fingerprints. For example, the pinhole layer (PHL) can be combined with an optical sensor (PHS) to form a fingerprint sensor (FPS). In embodiments, the fingerprint sensor (FPS) may also include an infrared (IR) filter.

[0070] The display pixel layer (DPL) may include pixels (PX) for displaying images and various circuit elements and / or lines connected to the pixels (PX). In an embodiment, each pixel (PX) may include at least one light-emitting element and pixel circuitry for driving the light-emitting element. In this case, the display pixel layer (DPL) may include: a circuit element layer (also referred to as a “backplane”) including the pixel circuitry of each pixel (PX) and lines connected to the pixel circuitry; and a light-emitting element layer overlapping the circuit element layer.

[0071] A touch sensor TS can be provided on one surface of the display panel DP. For example, the touch sensor TS can be provided on the display panel DP in a third direction DR3 (hereinafter also referred to as the "Z-axis direction") (e.g., in the height direction). However, the position of the touch sensor TS is not limited to this and can be changed according to embodiments of the invention. For example, in an embodiment, the touch sensor TS can be disposed below the display panel DP, or it can be disposed on both sides of the display panel DP. In an embodiment, the touch sensor TS can be provided inside the display panel DP.

[0072] In one embodiment, the touch sensor TS can be provided integrally with the display panel DP. For example, the touch sensor TS can be formed directly on the display pixel layer DPL (or a thin film encapsulation layer covering the display pixel layer DPL) of the display panel DP. In another embodiment, the touch sensor TS can be manufactured separately from the display panel DP and then attached to the display panel DP by, for example, an adhesive member.

[0073] In an embodiment, the touch sensor TS can be a capacitive touch sensor. For example, the touch sensor TS can be a self-capacitance type or a mutual-capacitance type touch sensor, which includes a plurality of touch electrodes TSE dispersed in the touch sensing area TSA. However, the type and structure of the touch sensor TS are not limited thereto, and can be varied differently according to embodiments of the present invention.

[0074] A window WD can be provided on the front surface of the display panel (DP) to protect the DP. For example, a window WD can be provided on the DP and the touch sensor (TS) on a third-party DR3.

[0075] Window WD can mitigate external impacts, thereby preventing damage or malfunction of the display panel (DP) and / or touch sensor (TS). External impact can refer to a force capable of causing defects in the display panel (DP) and / or touch sensor (TS). Such force can include, for example, pressure or stress applied to the display panel (DP) from an external source.

[0076] In an embodiment, when the display device DD is a deformable display device such as a foldable display device, the window WD can be flexible over the entire area or at least a portion thereof. For this purpose, the window WD can be formed of a flexible insulating material.

[0077] The cover panel CPN and the optical sensor PHS are provided on the rear surface of the display panel DP and can be coupled to the display panel DP via the adhesive member ADH. For example, the cover panel CPN and the optical sensor PHS can be disposed on a third-party DR3 below the display panel DP.

[0078] The cover panel CPN may include a buffer layer that mitigates external impacts and comprises a material capable of elastic deformation. For example, the cover panel CPN may include a single or multiple buffer layers, comprising at least one and combinations thereof, such as thermoplastic elastomers, polystyrene, polyolefins, polyurethane thermoplastic elastomers, polyamides, synthetic rubbers, polydimethylsiloxane, polybutadiene, polyisobutylene, poly(styrene-butadiene-styrene), polyurethane, polychloroprene, polyethylene, and silicone. Furthermore, the cover panel CPN can be formed from various elastic materials. Additionally, the cover panel CPN may include, for example, a high-strength plate (e.g., a metal plate), graphite plate, copper plate, and / or heat sink for stably supporting the display panel DP on its rear surface. That is, the cover panel CPN can be referenced when at least one of the above configurations is included.

[0079] The optical sensor PHS may include a plurality of sensor pixels SPXL dispersed in the fingerprint sensing area FSA. In an embodiment, the optical sensor PHS may use light generated from the display panel DP to sense the user's fingerprint. For example, the optical sensor PHS may sense reflected light emitted from at least some pixels PX disposed in the fingerprint sensing area FSA and reflected from the user's finger (e.g., the fingerprint area) to sense the user's fingerprint.

[0080] Figure 3 It is shown Figure 1 and Figure 2 The image shows an enlarged cross-sectional view of the fingerprint sensing area FSA of the display device DD. For example, Figure 3 The diagram schematically illustrates a cross-section of a region where the fingerprint sensing area FSA and the user's finger come into contact with the fingerprint sensing area FSA.

[0081] Reference Figures 1 to 3 The display pixel layer (DPL) may include a circuit element layer (BPL) and a light-emitting element layer (LDL) sequentially disposed on the substrate (SUB) and the pinhole layer (PHL). Furthermore, the display pixel layer (DPL) may also include a protective layer (PTL) disposed on the light-emitting element layer (LDL).

[0082] The circuit element layer (BPL) may include at least one conductive layer. For example, the BPL may include multiple circuit elements for constituting pixel circuitry of a pixel PX, as well as lines for supplying various powers and signals to drive the pixel PX. In this case, the BPL may include multiple conductive layers for constituting various circuit elements, such as transistors, capacitors, and lines connecting the transistors and capacitors. Furthermore, the BPL may include at least one insulating layer provided between the multiple conductive layers.

[0083] The light-emitting element layer (LDL) can be disposed on one surface of the circuit element layer (BPL). The LDL may include multiple light-emitting elements (LDs) connected to the circuit element layer (BPL) via, for example, contact holes. In embodiments, each light-emitting element (LD) may be composed of an organic light-emitting diode (OLED), or may be composed of an ultra-small inorganic light-emitting diode such as a micron-sized OLED, a nano-sized OLED, or a quantum dot OLED.

[0084] Each pixel PX may include circuit elements disposed in the circuit element layer BPL and at least one light-emitting element LD disposed in the light-emitting element layer LDL. In an embodiment, each pixel PX may include a single light-emitting element, or may include multiple light-emitting elements connected in series, in parallel, or in a series-parallel connection. In this case, at least one light-emitting element LD may be formed and / or provided in each pixel region PXA.

[0085] The protective layer PTL can be disposed on the light-emitting element layer LDL and can cover the display area DA. The protective layer PTL may include sealing components, such as a thin-film encapsulation (TFE) layer or encapsulation substrate. In addition, the protective layer PTL may also include a protective film.

[0086] The optical sensor PHS can overlap with the display panel DP to be positioned at least within the fingerprint sensing area FSA. The optical sensor PHS may include sensor pixels SPXL dispersed at a predetermined resolution and / or spacing.

[0087] The sensor pixels SPXL can have an appropriate number, size, and arrangement to generate a recognizable fingerprint image through electrical signals output from the sensor pixels SPXL. For example, the gaps between the sensor pixels SPXL can be densely arranged such that reflected light from a target object (e.g., a finger) can be incident on at least two adjacent sensor pixels SPXL.

[0088] The sensor pixel SPXL can output an electrical signal, such as a voltage signal, based on the amount of light received. Reflected light from a user's finger (e.g., the fingerprint area), passing through the pinhole layer PHL, and incident on the sensor pixel SPXL can have optical properties (e.g., frequency, wavelength, intensity, etc.) corresponding to the valleys and ridges of the fingerprint formed on the user's finger. Therefore, the sensor pixel SPXL can output a sensing signal with electrical properties based on the optical properties of the reflected light.

[0089] The width (or diameter) of the pinhole PIH can be set to approximately 10 times or more the wavelength of the reflected light, for example, approximately 4 μm or approximately 5 μm or more, to prevent light diffraction. Furthermore, the width of the pinhole PIH can be set to a size sufficient to prevent image blurring and sufficient to more clearly sense the shape of the fingerprint. For example, the width of the pinhole PIH can be set to approximately 15 μm or less. However, the width of the pinhole PIH is not limited to this and can be varied depending on the wavelength band of the reflected light and / or the thickness of each layer of the module.

[0090] Only the reflected light passing through the pinhole PIH can reach the sensor pixel SPXL of the optical sensor PHS. Because the pinhole PIH has a very narrow width, the phase of the light reflected from the fingerprint and the phase of the image focused on the optical sensor PHS can have a difference of 180 degrees.

[0091] The sensing signal output from the sensor pixel SPXL can be controlled by the sensor controller PSC (also known as a "fingerprint detector" or "sensor controller circuit") (see [link]). Figure 5 This data is converted into fingerprint data. Fingerprint data can be an image corresponding to a user's fingerprint pattern, such as a fingerprint image. Once fingerprint data is obtained, the user's fingerprint can be detected. That is, fingerprint data can be used to detect a user's fingerprint. For example, the detected user's fingerprint can be used for fingerprint recognition and authentication.

[0092] Figure 4 This is a perspective view schematically showing a display device DD according to an embodiment of the present invention.

[0093] Reference Figures 1 to 4At least one area of ​​the display device DD may be flexible, and the display device DD may be folded in the flexible area. In embodiments, the term "fold" may refer to a shape that is not fixed but can be deformed from an initial shape into another shape. For example, in describing embodiments of the invention, the term "fold" may refer to a state of folding, bending, or curling along one or more specific lines (i.e., fold lines).

[0094] For example, a display device DD may include a flexible folding region FDA (also known as a “curved region”) and a flat region FLA that is continuous and flat on at least one side of the folding region FDA. The folding region FDA can be folded due to its flexibility. Therefore, the folding region FDA may also be referred to as a foldable region. The flat region FLA may or may not be flexible.

[0095] The flat area FLA may include a first flat area FLA1 and a second flat area FLA2 spaced apart from each other, with a folded area FDA located between the first flat area FLA1 and the second flat area FLA2. The first flat area FLA1 may be provided in at least a portion of the display area DA and / or the non-display area NDA. The folded area FDA may be continuously disposed between the first flat area FLA1 and the second flat area FLA2. The folded area FDA may be integrally formed with the first flat area FLA1 and / or the second flat area FLA2, but is not limited thereto.

[0096] One surface of the first flat region FLA1 and one surface of the second flat region FLA2 may be provided in a folded state, configured to be substantially parallel to each other and facing each other. However, the invention is not limited thereto. For example, in embodiments of the invention, the display device DD may be folded or bent such that the one surface of the first flat region FLA1 and the one surface of the second flat region FLA2 form a predetermined angle (e.g., an acute angle, a right angle, or an obtuse angle), with the folded region FDA located between the first flat region FLA1 and the second flat region FLA2.

[0097] In an embodiment, a folding region FDA may be provided within a display region DA. For example, a display device DD may include a folding region FDA disposed within the display region DA, and may be folded within the folding region FDA via inward folding or outward folding. Inward folding may refer to a folding scheme in which the display region DA folds inward and is not visible to the user when the display device DD is folded, and outward folding may refer to a folding scheme in which the display region DA folds outward and is visible to the user when the display device DD is folded.

[0098] Furthermore, the folding area FDA can be defined as a specific area of ​​the display area DA, or it can be formed to vary throughout the entire display area DA without being limited to a specific area. Additionally, the display device DD can include multiple folding areas FDA disposed within a specific area, or it can be formed to fold freely over most of the area including the display area DA.

[0099] Figure 5 This is a block diagram illustrating a display device DD according to an embodiment of the present invention.

[0100] Reference Figures 1 to 5 The display device DD may include a panel unit PNL and a driving circuit unit DRV. The panel unit PNL includes a display panel DP, a touch sensor TS, and an optical sensor PHS. The driving circuit unit DRV includes a touch controller TSC, a display driver DPD, a display controller DPC, a sensor driver PSD, a sensor controller PSC, and a memory MR. The display panel DP, touch sensor TS, and optical sensor PHS can be connected to the display driver DPD, touch controller TSC, and sensor driver PSD, respectively. Furthermore, the display driver DPD and sensor driver PSD can be connected to the display controller DPC and sensor controller PSC, respectively.

[0101] The display driver (DPD) may include a gate driver and a data driver, which supply signals to pixels (PX) included in the display panel (DP). The display controller (DPC) can control the image display operation of the display panel (DP) by supplying drive signals to the display driver (DPD). For example, the gate driver can generate a gate signal based on a gate drive signal supplied from the display controller (DPC) and can output the gate signal to the gate line connected to the pixel (PX). The data driver can generate a grayscale voltage corresponding to the image data provided by the display controller (DPC) based on a data drive signal supplied from the display controller (DPC). The data driver can output the grayscale voltage, as a data voltage, to the data line connected to the pixel (PX).

[0102] The display controller (DPC) can generate drive signals using various control signals (including image signals and data enable signals) supplied from an external image source. For example, the DPC can receive image signals and control signals from an external image source. Control signals may include a vertical synchronization signal as a signal distinguishing frame intervals, a horizontal synchronization signal as a line-distinguishing signal within a frame, a data enable signal that is high only during the period of output data, and a clock signal. Furthermore, drive signals may include gate drive signals and data drive signals for driving the gate driver and data driver, respectively.

[0103] The touch controller (TSC) can generate drive signals that are output to the touch sensor (TS) and can receive sensing signals from the touch sensor (TS). Furthermore, the touch controller (TSC) can use the drive signals and sensing signals to determine whether a touch input has been generated and / or the location of a detected touch input.

[0104] The sensor driver PSD may include a scan driver and a readout driver, wherein the scan driver applies a scan signal to a sensor pixel SPXL included in an optical sensor PHS, and the readout driver receives a sensing signal output from the sensor pixel SPXL.

[0105] A sensor controller (PSC) may include a processor that controls the operation of a sensor driver (PSD), generates fingerprint data (e.g., a fingerprint image) based on electrical signals supplied from the PSD, and determines whether the fingerprint belongs to a registered user based on the generated fingerprint data. For example, the PSC may perform fingerprint authentication by sensing a user's fingerprint using an optical sensor (PHS) and comparing the resulting fingerprint sensing data (e.g., a raw fingerprint image) with stored registered fingerprint data (e.g., a registered fingerprint image). For example, the PSC may allow a display device (DD) (or a system including the display device DD) to perform or prevent a specific function based on the result of the fingerprint comparison operation.

[0106] Furthermore, when performing a fingerprint sensing operation, the sensor controller (PSC) can output a control signal to the display controller (DPC), enabling the display panel (DP) to provide illumination for detecting the user's fingerprint pattern. For example, the sensor controller (PSC) controls the display controller (DPC) to cause the pixel (PX) corresponding to the area where the user's finger may be located (e.g., the fingerprint sensing area (FSA)) to emit light.

[0107] In this embodiment, when the optical sensor PHS is activated for fingerprint sensing, the pixel PX, which serves as the light source for sensing the fingerprint, can emit light with high brightness (e.g., brightness corresponding to a white grayscale level). Therefore, fingerprint sensing contrast can be improved.

[0108] Fingerprint sensing data obtained by the optical sensor PHS may include noise due to image interference caused by the internal structure of the display panel DP (e.g., the location of the pinhole camera PIH). The sensor controller PSC can correct the obtained fingerprint image using pre-stored calibration data (hereinafter referred to as "reference data"). The reference data may be image data used to remove noise, such as that caused by image interference, and may be stored in memory MR.

[0109] That is, when fingerprint sensing data is obtained, the sensor controller PSC may correct the obtained fingerprint sensing data by using reference data stored in the memory MR. However, when the position between the pinhole optical system (e.g., pinhole PIH) and the optical sensor PHS in the display device DD changes due to, for example, folding, it may be difficult to remove noise from the obtained fingerprint image by using the calibration data stored in the memory MR. Therefore, the accuracy of fingerprint detection may be reduced.

[0110] The sensor controller PSC according to an embodiment of the present invention may comprise: a movement amount detector MDT (see Figure 18A and Figure 18B ), configured to detect misalignment information indicating a degree of misalignment between the pinhole optical system (e.g., pinhole PIH) and the optical sensor PHS (e.g., a difference in movement amounts between the pinhole optical system and the optical sensor PHS); and a calculator OP (see Figure 18A and 18B ), configured to generate new calibration data corresponding to the detected information. As a result, according to an embodiment of the present invention, noise can be removed from the obtained fingerprint image.

[0111] Figure 6 is a block diagram illustrating a fingerprint detection and authentication method according to an embodiment of the present invention. Hereinafter, the fingerprint detection and authentication method according to an embodiment of the present invention will be described sequentially with reference to Figures 1 to 6 The fingerprint detection and authentication method according to an embodiment of the present invention will be sequentially described below.

[0112] <ST110 and ST120: Fingerprint Event Occurrence Operation and Pixel Light Emitting Operation>

[0113] First, when a fingerprint event requesting fingerprint authentication occurs, pixels PX located in the fingerprint sensing area FSA and / or a peripheral area of the fingerprint sensing area FSA emit light to sense a fingerprint. In an embodiment, predetermined pixels PX corresponding to the fingerprint sensing area FSA may be used as a light source for sensing a fingerprint. In an embodiment, when the touch controller TSC senses the position of a touch input when a user's finger touches or approaches, at least some of the pixels PX corresponding to the position where the touch input occurs may also be used as the light source for sensing the fingerprint.

[0114] <ST130: Fingerprint Sensing Operation>

[0115] Next, the optical sensor PHS is used to sense the reflected light that is reflected from the user's fingerprint and passes through the pinhole PIH. As a result, the user's fingerprint can be sensed. Thus, fingerprint sensing data (also referred to as "raw fingerprint data" or "raw fingerprint image") can be obtained. The fingerprint sensing data is generated by collecting electrical signals generated according to an amount of light received by each of the sensor pixels SPXL.

[0116] <ST140: Fingerprint Sensing Data Calibration Operation>

[0117] Next, noise included in the fingerprint sensing data can be removed by using calibration data (also referred to as "reference image data") stored in the memory MR. Accordingly, the user's fingerprint can be detected.

[0118] <ST150: Fingerprint Authentication Operation>

[0119] Next, fingerprint authentication can be performed by comparing the detected user's fingerprint with the registered user's fingerprint. For example, when the detected user's fingerprint and the registered user's fingerprint are determined to match, it can be determined that the fingerprint authentication succeeds, and the fingerprint authentication can be completed. When a similarity score representing the similarity between the detected user's fingerprint and the registered user's fingerprint exceeds a predetermined threshold, the detected user's fingerprint and the registered user's fingerprint can be determined to match.

[0120] Figures 7A to 11B illustrates a method of correcting fingerprint sensing data according to an embodiment of the present invention. For example, Figure 7A , Figure 8A , Figure 9A , Figure 10A and Figure 11A each illustrate an image related to fingerprint image correction, and Figure 7B , Figure 8B , Figure 9B , Figure 10B and Figure 11B illustrate image profiles obtained from each image along the line II-II' shown in Figure 7A , Figure 8A , Figure 9A , Figure 10A and Figure 11A or a line located at a position corresponding to the line II-II'. For example, Figure 7B , Figure 8B , Figure 9B , Figure 10B and Figure 11B respectively illustrate luminance (intensity or amplitude of light) at positions in the X-axis direction obtained from the images shown in Figure 7A , Figure 8A , Figure 9A , Figure 10A and Figure 11A . In the embodiment, the positions in the X-axis direction can be defined according to X coordinates, and the luminance at each position can be defined according to gray-scale voltage values.

[0121] in Figure 7B , Figure 8B , Figure 9B , Figure 10Band Figure 11B In the middle, it is shown that along Figure 7A , Figure 8A , Figure 9A , Figure 10A and Figure 11A The image outline is in the X-axis direction, but the reference axis can be changed. For example, the reference axis can be changed to the Y-axis.

[0122] Reference Figures 1 to 11B ,pass Figure 6 The ST130 fingerprint sensor can obtain fingerprints such as... Figure 7A The fingerprint sensing data shown is in the form of a fingerprint image, i.e., raw fingerprint data (also referred to as "raw fingerprint image"). In embodiments, the fingerprint sensing data may have the following characteristics: Figure 7B The image outline shown.

[0123] Each fingerprint image (or calibration image) and its corresponding image profile can vary depending on the location of the pinhole PIH. For example, the brightness of the fingerprint image (e.g., the amount of light received by the sensor pixel SPXL) at the location corresponding to the center of each of the pinhole PIHs can have a maximum value, and the brightness of the fingerprint image can decrease towards the peripheral area. For example, the brightness of the fingerprint image at the center point between two adjacent pinhole PIHs can have a minimum value.

[0124] That is, the fingerprint sensing data obtained by the fingerprint sensing operation ST130 can include not only the optical characteristics caused by the valleys and ridges of the fingerprint, but also the optical characteristics based on the position of the pinhole PIH. Therefore, in order to extract the optical characteristics based on the user's fingerprint pattern, the light component based on the position of the pinhole PIH (e.g., noise) is removed.

[0125] Therefore, we can use, for example Figure 8A The calibration data shown is also referred to as a "calibration image". The calibration data can be obtained from the memory MR. For example, in the manufacturing process of the display device DD, a calibration map such as a reflector can be set on the fingerprint sensing area FSA, and reflected light incident on the sensor pixel SPXL can be sensed to obtain calibration data, and then the calibration data can be stored in the memory MR.

[0126] The calibration data stored in the memory MR can have light distribution characteristics based on the location of the pinhole PIH. For example, the calibration data can have characteristics such as... Figure 8B The image outline shown.

[0127] By using, for example Figure 8A The calibration data shown is from, for example Figure 7AThe fingerprint sensing data shown extracts optical characteristics based on the user's fingerprint pattern. For example, this can be achieved by determining the difference between the fingerprint sensing data and calibration data. Figure 9A The secondary fingerprint data shown is also referred to as the "second fingerprint image".

[0128] Next, as Figures 10A to 11B As shown, the final fingerprint data (also known as the "final fingerprint image") can be obtained through distortion correction. In an embodiment, as... Figure 10A and Figure 10B As shown, the distortion correction operation may include obtaining third fingerprint data (also referred to as the "third fingerprint image") by consistently correcting the brightness deviation based on location (e.g., consistently adjusting the signal intensity), and by... Figure 10A The third fingerprint data shown is rotated 180 degrees to obtain as follows Figure 11A The operation of the fourth fingerprint data (also known as the "fourth fingerprint image" or "final fingerprint data") shown is illustrated. For example, the third fingerprint data is rotated 180 degrees for each unit area centered on each pinhole PIH and then synthesized. Figure 10A The third fingerprint data shown can be used to obtain, for example... Figure 11A The fourth fingerprint data shown.

[0129] Figures 12A to 12D This illustrates the misalignment between the pinhole optical system and the optical sensor PHS caused by the folding of the display device DD, and the positional deviation of the pinhole PIH in fingerprint sensing data and calibration data based on said misalignment. For ease of description, in the following embodiments, it is assumed that the misalignment in the X-axis direction between the pinhole optical system and the optical sensor PHS of the display panel DP is determined based on whether the display device DD is folded and the degree of folding of the display device DD (e.g., the folding angle). Furthermore, in Figures 12A to 12D The diagram shows the X-axis, Y-axis, and Z-axis directions. The X-axis direction can correspond to the first direction DR1 mentioned above, the Y-axis direction can correspond to the second direction DR2 mentioned above, and the Z-axis direction can correspond to the third direction DR3 mentioned above.

[0130] Reference Figures 1 to 12D First, when the display device DD is like Figure 12AWhen the display device DD is folded, the optical sensor PHS can be positioned at an initial location within the reference lines RL1 and RL2 of the fingerprint sensing area FSA. In this case, the position of the pinhole PIH in the fingerprint sensing data obtained by the optical sensor PHS can substantially match the position of the pinhole PIH in the calibration data. For example, when the display device DD is folded and unfolded, calibration data can be obtained, and therefore can include pinhole PIH position information obtained based on the initial position of the optical sensor PHS.

[0131] When the display device DD is as follows Figures 12B to 12D When the display panel DP is folded as shown, its pinhole optical system and optical sensor PHS may misalign while the display panel DP is pushed at least along the X-axis. Therefore, the positions of the pinhole optical system and the optical sensor PHS may differ from their initial positions when calibration data is obtained. For example, to prevent damage to the display device DD due to folding, the optical sensor PHS can be attached to the rear surface of the display panel DP using an elastic adhesive member ADH. In this case, as the display device DD is folded, the adhesive member ADH is pushed, and a deviation in the amount of movement of the display panel DP and the optical sensor PHS may occur in the X-axis direction. For example, as the display panel DP is pushed, at least one area of ​​the optical sensor PHS may be positioned outside the reference lines RL1 and RL2 of the fingerprint sensing area FSA. Therefore, misalignment of the pinhole optical system and the optical sensor PHS of the display panel DP may occur, and this misalignment may occur with different widths depending on the folding angle of the display device DD. That is, depending on the folding angle of the display device DD, a sliding phenomenon of misalignment between the pinhole optical system and the optical sensor PHS may occur.

[0132] When a sliding phenomenon occurs, the position of the pinhole PIH in the fingerprint sensing data obtained by the optical sensor PHS when the display device DD is folded may differ from the position of the pinhole PIH in the calibration data stored based on the initial positions of the pinhole optical system and the optical sensor PHS when the display device DD is not folded. Specifically, as the degree of folding (or folding angle) increases, the amount of movement of the display panel DP increases, and therefore, the positional deviation between the pinhole optical system and the optical sensor PHS increases. Consequently, the positional deviation of the pinhole PIH in the fingerprint sensing data and the calibration data increases.

[0133] Figures 13A to 17B The process of processing fingerprint sensing data obtained by the optical sensor PHS under conditions of misalignment between the pinhole optical system and the optical sensor PHS, and the image profile based on this process, are illustrated. For example, Figure 13A , Figure 14A , Figure 15A , Figure 16A and Figure 17A Each image associated with the fingerprint sensing data is shown, and Figure 13B , Figure 14B , Figure 15B , Figure 16B and Figure 17B It shows along Figure 13A , Figure 14A , Figure 15A , Figure 16A and Figure 17A The line III-III' shown, or the line located at the position corresponding to line III-III', is the image contour obtained from each image. For example, Figure 13B , Figure 14B , Figure 15B , Figure 16B and Figure 17B They respectively show the results based on the data from... Figure 13A , Figure 14A , Figure 15A , Figure 16A and Figure 17A The image shown represents the brightness (intensity or amplitude of light) at a position along the X-axis.

[0134] and Figures 7A to 11B Compared to each image shown and the image contour corresponding to each image, in Figures 13A to 17B In each image shown and the corresponding image contour, the pinhole PIH position in the fingerprint sensing data sensed by the optical sensor PHS differs from the pinhole PIH position in the pre-stored calibration data, and therefore, it is difficult to effectively remove noise from the fingerprint sensing data using the calibration data.

[0135] For example, when the pinhole optical system and the optical sensor PHS are misaligned... Figure 6 The fingerprint sensing operation of ST130 obtains the following: Figure 13A The fingerprint sensing data shown may differ from... Figure 7A The fingerprint sensing data shown. Additionally, as... Figure 13A The calibration data shown is used for distortion correction of fingerprint sensing data (e.g., Figure 14A The calibration data shown may be related to Figure 8A The calibration data shown are essentially the same. In this case, it becomes difficult to effectively remove noise from the fingerprint sensing data, and therefore the signal-to-noise ratio (hereinafter referred to as "SNR") decreases, and thus the fingerprint detection and authentication performance of the display device DD is reduced.

[0136] Therefore, in the embodiments described later, the sensor controller PSC can detect misalignment information indicating the degree of misalignment between the pinhole optical system and the optical sensor PHS caused by the folding of the display device DD (e.g., the difference in the amount of movement between the pinhole optical system and the optical sensor PHS and / or the folding angle of the display device DD), and can generate new calibration data capable of effectively removing noise from the fingerprint sensing data. Furthermore, the memory MR can store reference data (also referred to as "reference calibration data") that can be referenced when the sensor controller PSC generates new calibration data.

[0137] That is, the embodiments described later, based on information about the misalignment between the pinhole optical system and the optical sensor PHS, can generate new calibration data using calibration data pre-stored in the memory MR, or can select at least one of a plurality of pre-stored calibration data as the calibration data to be used to correct the actual fingerprint sensing data. Therefore, in the embodiments described later, by naming the calibration data pre-stored in the memory MR as “reference data” and by naming the calibration data generated or selected based on the misalignment information of the pinhole optical system and the optical sensor PHS as “calibration data”, a distinction will be made between the pre-stored calibration data (e.g., reference data in the following embodiments) and the calibration data to be actually used to correct the fingerprint sensing data (e.g., calibration data in the following embodiments).

[0138] Figure 18A and Figure 18B This is a block diagram illustrating a sensor controller (PSC) according to an embodiment of the present invention. For example, Figure 18A and Figure 18B The configuration used to generate new calibration data is shown in the context of this example. Figure 5 An example of the configuration of the sensor controller PSC.

[0139] Reference Figures 1 to 18B The sensor controller PSC may include a fingerprint sensing data generator SDG (also known as "fingerprint sensing data generator circuit"), a motion detector MDT (also known as "motion detector circuit"), a calculator OP (also known as "calculator circuit"), and an image processor IMP (also known as "image processor circuit").

[0140] The fingerprint sensing data generator (SDG) can generate fingerprint sensing data using electrical signals input from the optical sensor (PHS). For example, the SDG can generate fingerprint sensing data by collecting output signals from the sensor pixel (SPXL).

[0141] A motion quantity detector (MDT) can detect misalignment information that indicates the degree of misalignment between the pinhole optical system and the optical sensor (PHS) of a display panel (DP). For example, an MDT can detect the difference in the amount of movement between the pinhole optical system and the optical sensor (PHS) caused by folding of the display device (DD).

[0142] In one embodiment, the Motion Quantity Detector (MDT) can detect the position information of the pinhole PIH from the fingerprint sensing data generated by the fingerprint sensing data generator (SDG), and can compare the detected position information with reference data stored in the memory (MR) to detect the difference in the amount of movement (e.g., sliding distance) between the pinhole optical system and the optical sensor (PHS). For this purpose, the Motion Quantity Detector (MDT) may include a Sliding Distance Detector (SDD).

[0143] In an embodiment, the movement amount detector (MDT) can extract the position information of the pinhole PIH by using the folding angle of the display device DD sensed by the touch sensor TS (or folding sensor), and can compare the extracted position information with reference data stored in the memory MR to detect the difference (or offset value) in the amount of movement between the pinhole optical system and the optical sensor PHS. For this purpose, the sensor controller (PSC) may include a folding angle detector (also referred to as a "folding angle detector circuit") that detects whether the display device DD is folded and / or the folding angle of the display device DD based on the sensing signal from the touch sensor TS (or folding sensor). In an embodiment, the folding angle detector (FAD) may be provided in the touch controller (TSC).

[0144] That is, the Motion Quantity Detector (MDT) can detect misalignment information indicating the degree of misalignment between the pinhole optics system and the optical sensor (PHS) through various configurations and / or methods. For this purpose, the MDT can include, for example... Figure 18B The sliding distance detector SDD and / or folding angle detector FAD are shown in the figure.

[0145] The calculator OP (also known as the "calibration data generator") can generate calibration data corresponding to the amount of movement of the optical sensor PHS detected by the motion quantity detector MDT. For example, the calculator OP can select any one of the reference data stored in the memory MR based on information about the misalignment between the pinhole optics system and the optical sensor PHS (e.g., sliding distance and / or folding angle, etc.), or select at least two reference data and interpolate at least two reference data to generate (or select) new calibration data that will be used for the correction of the fingerprint sensing image.

[0146] The image processor IMP can generate final fingerprint data by correcting fingerprint sensing data obtained from the optical sensor PHS using calibration data generated by the calculator OP. For example, the image processor IMP can generate final fingerprint data by subtracting the calibration data generated by the calculator OP from the fingerprint sensing data and correcting distortion of the subtracted image.

[0147] Figure 19 is a block diagram illustrating a fingerprint detection and authentication method according to an embodiment of the present invention. Compared with the embodiment of Figure 6 , the embodiment of Figure 19 may further include a movement amount detection operation ST132 and a calibration data generation operation ST134.

[0148] Hereinafter, the fingerprint detection and authentication method according to an embodiment of the present invention will be described sequentially with reference to Figures 1 to 19 . In the description of the embodiments of Figure 19 , further detailed descriptions of components and technical aspects previously described with reference to Figure 6 may be omitted.

[0149] <ST132: Movement Amount Detection Operation>

[0150] After the fingerprint sensing data is obtained through the fingerprint sensing operation ST130, misalignment information indicating the degree of misalignment between the pinhole optical system and the optical sensor PHS can be detected from the fingerprint sensing data. In an embodiment, position information of the pinhole PIH may be extracted from the fingerprint sensing data, and the position information is compared with reference data stored in the memory MR, thereby detecting a difference in movement amount between the pinhole optical system and the optical sensor PHS.

[0151] According to an embodiment, the movement amount detection operation ST132 may be performed by the movement amount detector MDT according to the embodiments of Figure 18A and Figure 18B . However, the present invention is not limited thereto.

[0152] According to an embodiment of the present invention, the movement amount detection operation ST132 may be omitted. In this case, after performing the fingerprint sensing operation ST130, the calibration data generation operation ST134 may be performed immediately.

[0153] <ST134: Calibration Data Generation Operation>

[0154] After obtaining the fingerprint sensing data and / or detecting the movement amount of the optical sensor PHS, calibration data corresponding to the position information of the pinhole PIH extracted from the fingerprint sensing data and / or the movement amount of the optical sensor PHS can be generated. According to an embodiment, the calibration data generation operation ST134 may be performed according to Figure 18A and Figure 18B The calculator OP is executed in the embodiment. However, the invention is not limited thereto.

[0155] Calibration data can be generated in various ways, and a detailed description of the relevant embodiments will be provided below.

[0156] After generating calibration data, fingerprint sensing data correction operation ST140 and fingerprint authentication operation ST150 using the calibration data can be executed sequentially.

[0157] Figures 20A to 20D A method for generating benchmark data according to an embodiment of the present invention is illustrated. For example, Figures 20A to 20D A method for generating reference data is shown, which can be stored during the manufacturing process of the display device DD. Figure 5 The MR memory can be used to generate (or select) calibration data by the sensor controller PSC.

[0158] Reference Figures 1 to 20D In the manufacturing steps of the display device DD (e.g., the factory calibration step), a calibration map can be set on the fingerprint sensing area FSA, and calibration data corresponding to multiple folding angles (also known as "reference folding angles") can be obtained using an optical sensor PHS. Furthermore, the calibration data obtained at each folding angle can be stored as reference data in the memory MR.

[0159] For example, such as Figures 20A to 20D As shown, when the display device DD is folded or bent at each of the angles of 0°, 60°, 120°, and 180°, calibration data can be obtained by sensing reflected light from the calibration map using an optical sensor PHS. The calibration data obtained by the optical sensor PHS at each folding angle can be stored in the memory MR as reference data for the corresponding folding angle (Cal_0°, Cal_60°, Cal_120°, and Cal_180°).

[0160] Figure 21A and Figure 21B A method for selecting reference data according to an embodiment of the present invention is illustrated. For example, Figure 21A and Figure 21B The options shown can be used by Figure 18A and Figure 18B An embodiment of a method for generating reference data for calibration data by a sensor controller (PSC) (e.g., calculator OP).

[0161] Reference Figures 1 to 21B ,like Figure 21AAs shown, the location information (e.g., X and Y coordinates) of the pinhole PIH can be extracted from the fingerprint sensing data obtained by the optical sensor PHS. For example, the location information of each pinhole PIH can be extracted from the image contour of the fingerprint sensing data, and the coordinate values ​​of the location information can be stored.

[0162] Next, as Figure 21B As shown, by comparing the pinhole PIH location information extracted from the fingerprint sensing data with reference data (e.g., coordinate data extracted from the reference data) stored in the memory MR for each fold angle, at least one reference data with high similarity can be selected. Here, high similarity means that the similarity of at least one reference data is above a certain predetermined value, such as 70%, 80%, 90%, or other suitable values.

[0163] When a reference data exists that matches the location information of the pinhole PIH extracted from the fingerprint sensing data, the reference data can be selected as the calibration data.

[0164] When no reference data matches the positional information of the pinhole PIH extracted from the fingerprint sensing data, two reference data sets with high similarity to the reference data can be selected, and new calibration data can be generated by interpolating the two reference data sets. For example, when there is a difference in the amount of movement in the X-axis direction between the pinhole optical system and the optical sensor PHS due to the folding of the display device DD (e.g., when the pinhole optical system moves in the X-axis direction and misaligns compared to the optical sensor PHS when the display panel DP is pushed out), two reference data sets with high similarity can be selected by comparing the X coordinates of the pinhole PIH extracted from the fingerprint sensing data and the X coordinates of the pinhole PIH extracted from the reference data.

[0165] Figure 22 A method for generating calibration data according to an embodiment of the present invention is illustrated. For example, Figure 22 It shows the result of Figure 18A and Figure 18B An embodiment of a method for generating calibration data by a sensor controller (PSC) (e.g., a calculator OP).

[0166] Reference Figures 1 to 22 This can be achieved by using, for example, referencing Figure 21A and Figure 21B The method disclosed in the embodiments uses two reference data points to generate calibration data. For example, for each of the two selected reference data points, the position of the pinhole PIH can be corrected by assigning an offset value to the two reference data points, so that the position of the pinhole PIH matches the position of the pinhole PIH in the fingerprint sensing data.

[0167] For example, when selecting reference data Cal_60° and Cal_120° for folding angles of 60° and 120°, and the positional deviation of the pinhole PIH in the X-axis direction between the reference data Cal_60° at a folding angle of 60° and the fingerprint sensing data is 10px (e.g., 10 pixels; the movement distance calculated based on the sensor pixel SPXL), the position of the pinhole PIH can be corrected by assigning an offset value of 10px in the X-axis direction to the reference data Cal_60° at a folding angle of 60°. Similarly, when the positional deviation of the pinhole PIH in the X-axis direction between the reference data Cal_120° at a folding angle of 120° and the fingerprint sensing data is -5px, the position of the pinhole PIH can be corrected by assigning an offset value of -5px in the X-axis direction to the reference data Cal_120° at a folding angle of 120°.

[0168] Next, weights can be assigned to the reference data Cal_60° and Cal_120° for folding angles of 60° and 120° respectively, and a weighted summation can be performed to generate calibration data. For example, when the offset values ​​for the reference data Cal_60° and Cal_120° for folding angles of 60° and 120° are 10px and -5px respectively, a weight of (15-10) / 15 (i.e., 1 / 3 of the weight) is assigned to the reference data Cal_60° for folding angle, and a weight of (15-5) / 15 (i.e., 2 / 3 of the weight) is assigned to the reference data Cal_120° for folding angle, and a weighted summation is performed to generate calibration data. The generated calibration data can be used to correct fingerprint sensing data (e.g., for noise removal).

[0169] Figure 23 A method for generating calibration data according to an embodiment of the present invention is illustrated. For example, Figure 23 It shows the result of Figure 18A and Figure 18B An embodiment of a method for generating calibration data by a sensor controller (PSC) (e.g., a calculator OP).

[0170] Reference Figures 1 to 23 Instead of generating multiple reference data points during the manufacturing process of the display device (DD), a single reference data point corresponding to a predetermined folding angle (also known as a "reference folding angle") (e.g., 0° or 90°) can be generated and stored in the memory (MR). Furthermore, calibration data can be generated using the reference data.

[0171] For example, reference data can be obtained at a predetermined folding angle, and the location information of the pinhole PIH in the reference data can be extracted.

[0172] Next, the pinhole PIH location information can be extracted from the fingerprint sensing data obtained for user fingerprint authentication, and the offset value (e.g., 15px) can be calculated based on the positional deviation of the pinhole PIH in the stored reference data and the fingerprint sensing data.

[0173] Next, calibration data can be generated by correcting the position of the pinhole PIH by applying the calculated offset value to the reference data, thus matching the position of the pinhole PIH in the reference data and the fingerprint sensing data. The generated calibration data can then be used to correct the fingerprint sensing data.

[0174] Figure 24 The effects of an embodiment based on multiple reference data using multiple folding angles are shown. For example, Figure 24 It shows that according to Figures 20A to 22 The embodiment generates the SNR of each folding angle in the display device DD for generating calibration data.

[0175] Reference Figure 24 High SNR can be ensured at folding angles (e.g., folding angles of 0°, 60°, 120°, and 180°) corresponding to reference data stored in memory MR. Furthermore, for other folding angles, a relatively high SNR at a certain level or higher can be ensured.

[0176] Figure 25 The effect of an embodiment based on a single reference data point using a single folding angle is shown. For example, Figure 25 It shows that according to Figure 23 The embodiment generates the SNR of each folding angle in the display device DD for generating calibration data.

[0177] Reference Figure 25 A high SNR can be ensured at a folding angle corresponding to the stored baseline data (e.g., a folding angle of 0°). Furthermore, for other folding angles, a relatively high SNR of a certain level or higher can be ensured.

[0178] Figure 26 This is a block diagram illustrating a fingerprint detection and authentication method according to an embodiment of the present invention. Figure 6 Compared to the previous embodiment, Figure 26 The embodiments may also include touch position detection operation ST112, folding angle detection operation ST114 and calibration data generation operation ST134.

[0179] In the following text, reference will be made to Figures 1 to 26 The fingerprint detection and authentication method according to embodiments of the present invention is described sequentially. For ease of explanation, previous references may be omitted. Figure 6 and Figure 19 Further detailed description of the components and technologies described.

[0180] <ST112: Touch position detection operation>

[0181] When a fingerprint event occurs, the touch position of a user's finger touching or approaching the display device DD can be detected for fingerprint authentication. For example, by using Figure 5 the touch sensor TS and the touch controller TSC, the touch coordinates of the position where the user's finger touches or approaches can be detected.

[0182] In an embodiment, in the touch position detection operation ST112, the touch position can be detected in the fingerprint sensing area FSA, and the user's fingerprint can be sensed by emitting light from at least some of the pixels PX disposed in the fingerprint sensing area FSA. In an embodiment, regardless of the detected touch position, the user's fingerprint can be sensed by emitting light from at least some of the pixels PX disposed in the fixed fingerprint sensing area FSA (ST120 and ST130).

[0183] In an embodiment, when the fingerprint sensing area FSA is set to be fixed, the touch position detection operation ST112 can be omitted.

[0184] <ST114: Folding angle detection operation>

[0185] When a fingerprint event occurs, the folding angle of the display device DD can be detected. In an embodiment, the folding angle of the display device DD can be detected by using Figure 5 the touch sensor TS. In an embodiment, the folding angle of the display device DD can be sensed by using a folding sensor separate from the touch sensor TS.

[0186] Detection of the folding angle may be performed by the touch controller TSC and / or the sensor controller PSC (for example, including a movement amount detector MDT having a folding angle detector FAD as described with reference to Figure 18B ). In this case, the touch controller TSC and / or the sensor controller PSC can detect the folding angle of the display device DD based on an electrical signal input from the touch sensor TS. To this end, the touch controller TSC and / or the sensor controller PSC may include a folding angle detector (e.g., Figure 18B FAD).

[0187] <ST134: Calibration data generation operation>

[0188] After detection of the folding angle, calibration data corresponding to the folding angle can be generated. According to an embodiment, the calibration data generation operation ST134 may be performed by the calculator OP according to the embodiment of Figure 18A and Figure 18B . However, the present invention is not limited thereto.

[0189] In an embodiment, information regarding the misalignment between the pinhole optical system and the optical sensor PHS at each folding angle of the reference memory MR (e.g., the difference in the amount of movement between the pinhole optical system and the optical sensor PHS) can be extracted or calculated, and the position of the pinhole PIH can be corrected (e.g., shifted) in the reference data stored in the memory MR based on the amount of movement of the optical sensor PHS, thereby generating new calibration data. To this end, during the manufacturing steps of the display device DD, the difference in the amount of movement between the pinhole optical system and the optical sensor PHS relative to at least one folding angle (also referred to as the "reference folding angle") and / or the offset value used to correct the calibration data can be stored in the memory MR. That is, during the manufacturing steps of the display device DD, the difference in the amount of movement between the pinhole optical system and the optical sensor PHS at each reference folding angle (e.g., the sliding distance of the display panel DP and / or the pinhole optical system) can be converted into data (or numbered) in the form of offset values ​​and stored in the memory MR.

[0190] When a fingerprint event occurs while using the display device DD, offset values ​​can be used to correct the reference data, thereby generating calibration data. For example, an offset value can be selected for any reference folding angle that is closest to (or matches) the folding angle sensed in the folding angle detection operation ST114, and the position of the pinhole PIH in the reference data can be corrected by applying the offset value, thus generating calibration data. Alternatively, a new offset value can be calculated by interpolating the offset values ​​of two reference folding angles similar to the folding angle sensed in the folding angle detection operation ST114, and the position of the pinhole PIH in the reference data can be corrected by applying the calculated offset value, thus generating calibration data. In this case, calibration data can be generated by assigning weights based on the deviation between the sensed folding angle and each selected reference folding angle.

[0191] Calibration data can be generated in various ways. For example, in one embodiment, calibration data can be generated by selecting one of a plurality of reference folding angles based on the folding angle and / or the range of said folding angles, or by interpolating two reference data.

[0192] After generating calibration data, fingerprint sensing data correction operation ST140 and fingerprint authentication operation ST150 using the calibration data can be executed sequentially.

[0193] Figure 27 This is a plan view illustrating a touch sensor TS according to an embodiment of the present invention. According to the embodiment, in... Figure 27In this paper, a mutual capacitance type touch sensor TS is described as an example. However, the invention is not limited thereto. For example, the touch sensor TS can be a touch sensor of various structures and / or types.

[0194] Reference Figures 1 to 27 The touch sensor TS may include touch electrodes TSE provided in the touch sensing area TSA. In an embodiment, the touch electrodes TSE may include a first touch electrode TSE1 and a second touch electrode TSE2 arranged in different directions.

[0195] First touch electrodes TSE1 may be arranged sequentially on a first direction DR1, and each of the first touch electrodes TSE1 may extend on a second direction DR2. Second touch electrodes TSE2 may be arranged sequentially on a second direction DR2, and each of the second touch electrodes TSE2 may extend on a first direction DR1.

[0196] When the touch sensor TS is a mutual capacitance type touch sensor, one of the first touch electrode TSE1 and the second touch electrode TSE2 can be a driving electrode, and the other of the first touch electrode TSE1 and the second touch electrode TSE2 can be a sensing electrode. For example, the first touch electrode TSE1 can be a driving electrode, and the second touch electrode TSE2 can be a sensing electrode.

[0197] In this embodiment, the touch electrodes TSE can also be used to calculate the folding angle of the display device DD. For example, when a fingerprint event occurs, at least some of the touch electrodes TSE can be used to sense the folding angle of the display device DD.

[0198] For example, when the touch sensor TS (and / or the display device DD including the touch sensor TS) includes a first flat region FLA1 and a second flat region FLA2 disposed on both sides of the folding region FDA, at least one touch electrode TSE disposed in the first flat region FLA1 can be used as a driving electrode for fold sensing, and at least one other touch electrode TSE disposed in the second flat region FLA2 can be used as a sensing electrode for fold sensing. Alternatively, at least one touch electrode TSE disposed in the first flat region FLA1 can be used as a sensing electrode for fold sensing, and at least one other touch electrode TSE disposed in the second flat region FLA2 can be used as a driving electrode for fold sensing.

[0199] For example, the folding angle of the display device DD can be sensed by using at least one first touch electrode TSE1-1 disposed in the first flat area FLA1 as a driving electrode and at least one first touch electrode TSE1-2 disposed in the second flat area FLA2 as a sensing electrode. In this case, the display device DD may also include a switching unit, which is used during the fingerprint detection period (or folding detection period) to connect the first touch electrode TSE1-1 of the first flat area FLA1 to the scan driver (or driving circuit) of the touch controller TSC and to connect the first touch electrode TSE1-2 of the second flat area FLA2 to the readout driver (or sensing circuit) of the touch controller TSC.

[0200] Figure 28A and Figure 28B This is a schematic illustration of the effects of folding. Figure 27 A cross-sectional view of the capacitance change between the touch electrodes TSE caused by the touch sensor TS of the display device DD.

[0201] Reference Figures 1 to 28B When the display device DD is as follows Figure 28A When the area is unfolded as shown, a first capacitance Cm1 may appear between the first touch electrode TSE1-1 in the first flat region FLA1 and the first touch electrode TSE1-2 in the second flat region FLA2.

[0202] When the display device DD is folded or bent, the distance between the first touch electrode TSE1-1 of the first flat region FLA1 and the first touch electrode TSE1-2 of the second flat region FLA2 changes, and therefore, the capacitance between the first touch electrode TSE1-1 of the first flat region FLA1 and the first touch electrode TSE1-2 of the second flat region FLA2 may change. For example, when the display device DD is folded or bent... Figure 28B When the ground is folded as shown, the distance between the first touch electrode TSE1-1 of the first flat region FLA1 and the first touch electrode TSE1-2 of the second flat region FLA2 decreases, and therefore, a second capacitance Cm2 greater than the first capacitance Cm1 may be generated between the first touch electrode TSE1-1 of the first flat region FLA1 and the first touch electrode TSE1-2 of the second flat region FLA2.

[0203] That is, the capacitance detected by the touch sensor TS can change according to the folding angle. Therefore, by sensing the capacitance, the folding angle of the display device DD can be detected. For example, the folding angle detector FAD can detect the folding angle of the display device DD by sensing the capacitance based on the electrical signal output from the touch sensor TS when detecting a fingerprint.

[0204] exist Figure 27 , Figure 28A and Figure 28B In one embodiment, a touch sensor TS is used to detect the folding angle of the display device DD. However, the invention is not limited thereto. For example, in one embodiment, a folding sensor separate from the touch sensor TS can be used, and the folding sensor can be used to detect the folding angle of the display device DD. In another embodiment, the folding sensor may include a first electrode disposed in a first flat region FLA1 and a second electrode disposed in a second flat region FLA2 and spaced apart from the first electrode, and may output an electrical signal corresponding to the mutual capacitance between the first electrode and the second electrode.

[0205] Figure 29 A method for selecting calibration data according to an embodiment of the present invention is illustrated. For example, Figure 29 This illustrates a method for selecting one of multiple reference data stored in memory MR as calibration data, or a method for... Figure 18A and Figure 18B An embodiment of a method for generating calibration data by a sensor controller (PSC) (e.g., a calculator OP).

[0206] Reference Figures 26 to 29 In the manufacturing process of the display device DD, reference data of multiple folding angles (e.g., reference folding angles) can be stored in the memory MR. Furthermore, at least one reference data can be selected based on the folding angle detected in the folding angle detection operation ST114, and calibration data can be generated using the selected reference data.

[0207] In this embodiment, reference data for any folding angle can be selected as calibration data based on the folding angle detected in the folding angle detection operation ST114. For example, a preset (e.g., based on the detected folding angle and / or the range of the folding angle) can be selected. Figure 29 The reference data (stored in the form of a lookup table as shown) is used as calibration data. Alternatively, reference data corresponding to the folding angle closest to the folding angle can be selected as calibration data. The selected calibration data can be used to correct the fingerprint sensing data.

[0208] In this embodiment, two reference data points for fold angles similar to the fold angle detected in the fold angle detection operation ST114 can be selected, and calibration data can be generated by interpolating the two selected reference data points. For example, calibration data can be generated by assigning weights based on the similarity to the detected fold angles and by summing the two reference data points. The generated calibration data can be used to correct fingerprint sensing data.

[0209] Figure 29The diagram shows calibration data for only some folding angle selections within a folding angle range. However, the invention is not limited to this. For example, calibration data can be selected for other folding angles in a similar manner, and the corresponding selection values ​​for the folding angle range and / or calibration data can be varied. Furthermore, for the folding angles corresponding to the boundaries of each folding angle range, predetermined standards can be prepared, and calibration data can be selected. For example, when a folding angle of 45° is detected, calibration data corresponding to a folding angle of 60° can be selected.

[0210] Figure 30 A method for setting offset values ​​for calibration data according to an embodiment of the present invention is shown. For example, Figure 30 The settings for use by are shown Figure 18A and Figure 18B An embodiment of a method for a sensor controller (PSC) (e.g., calculator OP) to generate offset values ​​for calibration data.

[0211] Reference Figures 26 to 30 Calibration data can be generated by correcting the reference data stored in memory MR by applying a predetermined offset value based on the folding angle detected in the folding angle detection operation ST114. For example, calibration data can be generated by pre-setting a value based on the detected folding angle and / or the range of the folding angle (e.g., as shown in the image). Figure 30 The offset values, stored in the form of a lookup table as shown, are used to correct (e.g., shift) the position of the pinhole PIH in the reference data to generate calibration data. Figure 30 The offset value used for the reference folding angle is shown, and the offset value can be changed differently.

[0212] Therefore, during the manufacturing process of the display device DD, the offset value of the reference data used to correct at least one folding angle (e.g., a reference folding angle) can be stored in the memory MR. That is, during the manufacturing stage of the display device DD, the difference in the amount of movement between the pinhole optical system and the optical sensor PHS at each reference folding angle (e.g., the sliding distance of the display panel DP and / or the pinhole optical system) can be converted into data in the form of an offset value and stored in the memory MR.

[0213] According to an embodiment, as the folding angle of the display device DD increases (as the folding degree increases), the amount of movement of the optical sensor PHS can increase. Therefore, as the folding angle of the display device DD increases, the offset value increases, thereby compensating for the misalignment caused by the difference in the amount of movement between the pinhole optical system and the optical sensor PHS.

[0214] In one embodiment, the offset value can be set to increase linearly with each folding angle. In another embodiment, the offset value can be set to increase non-linearly with each folding angle.

[0215] When a fingerprint event occurs while using the display device DD, offset values ​​can be used to correct the reference data, thereby generating calibration data. For example, an offset value for any reference folding angle closest to the folding angle sensed in the folding angle detection operation ST114 can be extracted from the memory MR, and the position of the pinhole PIH in the reference data can be corrected by applying the offset value. As a result, calibration data can be generated. Alternatively, a new offset value can be calculated by interpolating two offset values ​​for two reference folding angles similar to the folding angle sensed in the folding angle detection operation ST114, and the reference data can be corrected by applying the calculated offset value. As a result, calibration data can be generated. For example, calibration data can be generated by correcting the position of the pinhole PIH in the reference data based on the two interpolated offset values. The generated calibration data can be used to correct fingerprint sensing data.

[0216] According to the above embodiments, when detecting a user's fingerprint, misalignment information indicating the degree of misalignment between the pinhole optical system and the optical sensor PHS (e.g., the difference in the amount of movement between the pinhole optical system and the optical sensor PHS, the positional deviation or offset value of the pinhole PIH between the fingerprint sensing data and the reference data, and / or the folding angle of the display device DD) can be detected, and new calibration data can be generated from at least one reference data (e.g., at least one reference data corresponding to at least one reference folding angle) based on the detected information.

[0217] Therefore, noise included in fingerprint sensing data can be effectively removed. For example, in a display device DD that uses a pinhole optical system embedded in a display panel DP to detect fingerprints according to an embodiment of the present invention, noise can be effectively removed and the SNR can be improved even when the pinhole optical system and the optical sensor PHS are misaligned due to, for example, folding or bending. Therefore, the fingerprint authentication performance of the display device DD can be improved.

[0218] As is customary in the field of this invention, it is described in terms of functional blocks, units, and / or modules, and embodiments are illustrated in the accompanying drawings. Those skilled in the art will understand that these blocks, units, and / or modules are physically implemented by electronic (or optical) circuits that can be formed using semiconductor-based manufacturing techniques or other manufacturing techniques, such as logic circuits, discrete components, microprocessors, hardwired circuits, memory elements, wiring connections, etc. Where blocks, units, and / or modules are implemented by microprocessors or the like, they can be programmed using software (e.g., microcode) to perform the various functions discussed herein, and these blocks, units, and / or modules may optionally be driven by firmware and / or software. Alternatively, each block, unit, and / or module may be implemented by dedicated hardware, or as a combination of dedicated hardware performing some functions and processors performing other functions (e.g., one or more programmable microprocessors and associated circuitry).

[0219] Although the invention has been specifically shown and described with reference to embodiments thereof, those skilled in the art will understand that various changes in form and detail may be made therein without departing from the spirit and scope of the invention as defined by the claims.

Claims

1. A fingerprint detection method, wherein, The fingerprint detection method includes: Fingerprint sensing data is obtained by sensing a user's fingerprint using a display device, the display device comprising: a display panel including a pinhole optical system and an optical sensor overlapping the pinhole optical system; Misalignment information indicating the degree of misalignment between the pinhole optical system and the optical sensor; Based on the detected misalignment information, calibration data is generated using at least one reference data corresponding to the folding angle of at least one reference display device; Fingerprint data is generated by correcting the fingerprint sensing data using the calibration data; and The user's fingerprint is detected based on the fingerprint data. The misalignment information includes: The difference in the amount of movement between the pinhole optical system and the optical sensor The detection of the misalignment information includes: The fingerprint sensing data is used to detect the location information of multiple pinholes included in the pinhole optical system; and The difference in the amount of movement between the pinhole optical system and the optical sensor is detected by comparing the position information of the pinhole with the at least one reference data.

2. The fingerprint detection method according to claim 1, wherein, Generating the calibration data includes: By comparing the location information of the pinhole with multiple reference data, two reference data with high similarity are selected from the multiple reference data; and The calibration data is generated by interpolating the two reference data.

3. The fingerprint detection method according to claim 2, wherein, Interpolation of the two reference data includes: By comparing the location information of the pinhole with the extracted location information of the pinhole extracted from the two reference data, an offset value is set for each of the two reference data. A weight is assigned to each of the two reference data points based on the offset value used for each of the two reference data points; and The two weighted benchmark data are summed.

4. The fingerprint detection method according to claim 3, wherein, The offset value used for each of the two reference data is a correction value set to match the position of the pinhole in each of the two reference data with the position of the detected pinhole.

5. The fingerprint detection method according to claim 1, wherein, Generating the calibration data includes: By comparing the pinhole location information with the extracted pinhole location information extracted from a single reference data set, an offset value is set for the single reference data set; and The calibration data is generated by correcting the single reference data based on the offset value.

6. The fingerprint detection method according to claim 5, wherein, The offset value is a correction value set to match the position of the pinhole in the single reference data with the position of the detected pinhole.

7. The fingerprint detection method according to claim 1, wherein, The misalignment information also includes the folding angle of the display device. The at least one reference data point is selected from multiple reference data points corresponding to different folding angles of the reference display device. The detection of the misalignment information also includes detecting the folding angle of the display device.

8. The fingerprint detection method according to claim 7, wherein, Detecting the folding angle of the display device includes detecting the folding angle of the display device using a sensing signal output from a touch sensor.

9. The fingerprint detection method according to claim 7, wherein, Generating the calibration data includes selecting one reference data from the plurality of reference data as the calibration data corresponding to the detected folding angle of the display device.

10. The fingerprint detection method according to claim 7, wherein, Generating the calibration data includes: From the plurality of reference data, select two reference data points corresponding to two reference display device folding angles that are similar to the detected folding angle of the display device; and The calibration data is generated by interpolating the two reference data.

11. The fingerprint detection method according to claim 7, wherein, Generating the calibration data includes: Extract the offset value corresponding to the detected folding angle of the display device; and The calibration data is generated by correcting the at least one reference data based on the offset value.

12. The fingerprint detection method according to claim 7, wherein, Generating the calibration data includes: Interpolation of two offset values ​​for two reference display device folding angles similar to the detected folding angle of the display device; and The calibration data is generated by correcting the at least one reference data based on the two interpolated offset values.

13. The fingerprint detection method according to claim 7, wherein, The calibration data is generated using the reference data corresponding to the folding angle of the reference display device, selected from the plurality of reference data, which is closest to the folding angle of the display device.

14. A fingerprint detection method, wherein, The fingerprint detection method includes: Fingerprint sensing data is obtained by sensing a user's fingerprint using a display device, the display device comprising: a display panel including a pinhole optical system and an optical sensor overlapping the pinhole optical system; Misalignment information indicating the degree of misalignment between the pinhole optical system and the optical sensor; Based on the detected misalignment information, calibration data is generated using at least one reference data corresponding to the folding angle of at least one reference display device; Fingerprint data is generated by correcting the fingerprint sensing data using the calibration data; and The user's fingerprint is detected based on the fingerprint data. The misalignment information includes the folding angle of the display device. The at least one reference data point is selected from multiple reference data points corresponding to different folding angles of the reference display device. Detecting the misalignment information includes detecting the folding angle of the display device. The generation of the calibration data includes: From the plurality of reference data, select two reference data points corresponding to two reference display device folding angles that are similar to the detected folding angle of the display device; and The calibration data is generated by interpolating the two reference data.

15. The fingerprint detection method according to claim 14, wherein, Detecting the folding angle of the display device includes detecting the folding angle of the display device using a sensing signal output from a touch sensor.

16. A fingerprint detection method, wherein, The fingerprint detection method includes: Fingerprint sensing data is obtained by sensing a user's fingerprint using a display device, the display device comprising: a display panel including a pinhole optical system and an optical sensor overlapping the pinhole optical system; Misalignment information indicating the degree of misalignment between the pinhole optical system and the optical sensor; Based on the detected misalignment information, calibration data is generated using at least one reference data corresponding to the folding angle of at least one reference display device; Fingerprint data is generated by correcting the fingerprint sensing data using the calibration data; and The user's fingerprint is detected based on the fingerprint data. The misalignment information includes the folding angle of the display device. The at least one reference data point is selected from multiple reference data points corresponding to different folding angles of the reference display device. Detecting the misalignment information includes detecting the folding angle of the display device. The generation of the calibration data includes: Extract the offset value corresponding to the detected folding angle of the display device; and The calibration data is generated by correcting the at least one reference data based on the offset value.

17. The fingerprint detection method according to claim 16, wherein, Detecting the folding angle of the display device includes detecting the folding angle of the display device using a sensing signal output from a touch sensor.

18. A fingerprint detection method, wherein, The fingerprint detection method includes: Fingerprint sensing data is obtained by sensing a user's fingerprint using a display device, the display device comprising: a display panel including a pinhole optical system and an optical sensor overlapping the pinhole optical system; Misalignment information indicating the degree of misalignment between the pinhole optical system and the optical sensor; Based on the detected misalignment information, calibration data is generated using at least one reference data corresponding to the folding angle of at least one reference display device; Fingerprint data is generated by correcting the fingerprint sensing data using the calibration data; and The user's fingerprint is detected based on the fingerprint data. The misalignment information includes the folding angle of the display device. The at least one reference data point is selected from multiple reference data points corresponding to different folding angles of the reference display device. Detecting the misalignment information includes detecting the folding angle of the display device. The generation of the calibration data includes: Interpolation of two offset values ​​for two reference display device folding angles similar to the detected folding angle of the display device; and The calibration data is generated by correcting the at least one reference data based on the two interpolated offset values.

19. The fingerprint detection method according to claim 18, wherein, Detecting the folding angle of the display device includes detecting the folding angle of the display device using a sensing signal output from a touch sensor.

20. A display device, wherein, The display device includes: Display panel, including pinhole optical system; An optical sensor overlaps with the pinhole optical system; The memory stores at least one piece of reference data corresponding to the folding angle of at least one reference display device; and The sensor controller detects misalignment information indicating the degree of misalignment between the pinhole optical system and the optical sensor, and corrects the fingerprint sensing data based on the detected misalignment information and the at least one reference data. The misalignment information includes: The difference in the amount of movement between the pinhole optical system and the optical sensor The sensor controller includes: A fingerprint sensing data generator that generates the fingerprint sensing data using electrical signals from the optical sensor; A motion detector detects the misalignment information. A calculator that generates calibration data corresponding to the detected misalignment information; and An image processor uses the calibration data to correct the fingerprint sensing data.

21. The display device according to claim 20, wherein, The calculator selects at least one reference data stored in the memory that corresponds to the detected misalignment information, and uses the selected at least one reference data to generate the calibration data.

22. The display device according to claim 20, wherein, The calculator generates the calibration data by correcting at least one reference data stored in the memory based on an offset value corresponding to the detected misalignment information.

23. The display device according to claim 20, wherein, The movement detector includes a sliding distance detector, which detects differences in the movement; or The misalignment information also includes the folding angle of the display device, and the movement detector includes a sliding distance detector for detecting the difference in movement and a folding angle detector for detecting the folding angle of the display device.

24. The display device according to claim 20, wherein, The at least one reference data is selected from multiple reference data corresponding to different folding angles of the reference display device.

25. The display device according to claim 24, wherein, The misalignment information also includes the folding angle of the display device, and calibration data is generated using the reference data corresponding to the folding angle of the display device selected from the plurality of reference data that is closest to the folding angle of the display device.

26. The display device according to any one of claims 20 to 25, wherein, The display panel includes a flexible folding area and a first flat area and a second flat area disposed on opposite sides of the folding area.

27. The display device according to claim 20, wherein, The display panel includes a flexible folding area and a first flat area and a second flat area disposed on opposite sides of the folding area. The display device further includes: A touch sensor includes at least one touch electrode disposed in the first flat area and at least one touch electrode disposed in the second flat area.

28. The display device according to claim 27, wherein, The display device further includes a folding angle detector, which detects the folding angle of the display device from the output signal of the touch sensor.

Images