Electronic device for acquiring fingerprint information in fingerprint mode and method thereof

Abstract

Disclosed is an electronic device. The electronic device comprises a display, a fingerprint sensor, a memory for storing instructions, and at least one processor. The instructions, when executed individually or collectively by the at least one processor, may cause the electronic device to: detect the occurrence of an event for authenticating a user by using a fingerprint of the user; on the basis of the detection, change a display driving mode from a first mode to a second mode in which a screen including an indicator in a specific area and for acquiring the fingerprint is displayed; when a touch input of the user for the indicator is received, acquire fingerprint information via the fingerprint sensor on the basis of light output from the specific area by the display in the second mode; authenticate the user on the basis of the fingerprint information; on the basis of the success of the authentication, change the display driving mode from the second mode to the first mode; and on the basis of the failure of the authentication, output the light from the specific area in the second mode without changing the display driving mode by maintaining the display driving mode in the second mode while the screen for acquiring the fingerprint is displayed.

Description

Electronic device for obtaining fingerprint information in fingerprint mode and method thereof

[0001] The present disclosure relates to an electronic device for acquiring fingerprint information in a fingerprint mode and a method for acquiring fingerprint information thereof.

[0002] Electronic devices can obtain fingerprints from a user's finger touching the display and perform various functions using the fingerprints.

[0003] For example, electronic devices can use fingerprints to perform various functions, such as screen lock / unlock, logging in to applications, making payments, etc.

[0004] An electronic device according to one embodiment may include a display, a fingerprint sensor positioned below a specific area of ​​the display for acquiring a fingerprint, a memory for storing instructions, and at least one processor. The instructions, when individually or collectively executed by the at least one processor, cause the electronic device to detect the occurrence of an event for authenticating a user using the user's fingerprint. The instructions, when individually or collectively executed by the at least one processor, cause the electronic device to change, based on the detection, a display driving mode from a first mode to a second mode that includes an indicator in the specific area and displays a screen for acquiring the fingerprint. The instructions, when individually or collectively executed by the at least one processor, cause the electronic device to acquire fingerprint information through the fingerprint sensor based on light output from the specific area by the display in the second mode when a user's touch input to the indicator is received. The instructions, when individually or collectively executed by the at least one processor, cause the electronic device to authenticate the user based on the fingerprint information. The instructions, when individually or collectively executed by the at least one processor, cause the electronic device to change the display driving mode from the second mode to the first mode based on the success of the authentication.The instructions, when individually or collectively executed by the at least one processor, cause the electronic device to maintain the display driving mode in the second mode while displaying the screen for acquiring the fingerprint based on the authentication failure, so that the display outputs light in the specific area in the second mode without changing the display driving mode. The display is driven based on a first duty ratio for one frame in the first mode, and is driven based on a second duty ratio different from the first duty ratio for one frame in the second mode.

[0005] According to one embodiment, a method for obtaining fingerprint information of an electronic device including a display and a fingerprint sensor disposed below a specific area of ​​the display includes: detecting the occurrence of an event for authenticating a user using a fingerprint of the user; changing, based on the detection, a display driving mode from a first mode to a second mode including an indicator in the specific area and displaying a screen for obtaining the fingerprint; obtaining fingerprint information through the fingerprint sensor based on light output from the specific area by the display in the second mode when a touch input of the user for the indicator is received; authenticating the user based on the fingerprint information; changing, based on whether the authentication is successful, the display driving mode from the second mode to the first mode; and based on whether the authentication is unsuccessful, maintaining the display driving mode in the second mode while displaying the screen for obtaining the fingerprint so that the display outputs light from the specific area in the second mode without changing the display driving mode. The display is driven based on a first duty ratio for one frame in the first mode, and is driven based on a second duty ratio different from the first duty ratio for one frame in the second mode.

[0006] FIG. 1 is a block diagram of an exemplary electronic device capable of performing the operations described within the present disclosure.

[0007] Figure 2 illustrates an example of a display according to one embodiment.

[0008] FIG. 3 is a drawing for explaining a fingerprint recognition area according to one embodiment.

[0009] FIGS. 4, 5, and 6 are drawings for explaining operations of an electronic device according to one embodiment.

[0010] FIG. 7, FIG. 8a, FIG. 8b, and FIG. 9 are drawings illustrating an example of an electronic device performing a login in an application according to one embodiment.

[0011] FIG. 10 is a drawing for explaining a duty ratio corresponding to a mode of an electronic device according to one embodiment.

[0012] FIG. 11 is a block diagram of an exemplary electronic device capable of performing the operations described within the present disclosure.

[0013] Hereinafter, the present disclosure will be described in detail with reference to the attached drawings.

[0014] The terms used in the embodiments of this disclosure have been selected from widely used, current terms, taking into account the functions of this disclosure. However, these terms may vary depending on the intentions of those skilled in the art, precedents, the emergence of new technologies, etc. Furthermore, in certain cases, terms may be arbitrarily selected by the applicant, and in such cases, their meanings will be described in detail in the description of the relevant disclosure. Therefore, the terms used in this disclosure should not be defined simply as names of terms, but rather based on the meanings of the terms and the overall content of this disclosure.

[0015] In this specification, expressions such as “has,” “can have,” “includes,” or “may include” indicate the presence of a feature (e.g., a number, function, operation, or component such as a part), and do not exclude the presence of additional features.

[0016] The expression "at least one of A and / or B" should be understood to mean either "A" or "B" or "A and B".

[0017] As used herein, the expressions “first,” “second,” “first,” or “second,” etc., may describe various components, regardless of order and / or importance, and are only used to distinguish one component from another, but do not limit the components.

[0018] When it is said that a component (e.g., a first component) is “(operatively or communicatively) coupled with / to” or “connected to” another component (e.g., a second component), it should be understood that the component may be directly coupled to the other component, or may be connected through another component (e.g., a third component).

[0019] Singular expressions include plural expressions unless the context clearly dictates otherwise. In this application, terms such as "comprise" or "consist of" are intended to indicate the presence of a feature, number, step, operation, component, part, or combination thereof described in the specification, but should be understood not to preclude the presence or addition of one or more other features, numbers, steps, operations, components, parts, or combinations thereof.

[0020] In the present disclosure, a "module" or "part" performs at least one function or operation and may be implemented as hardware or software, or as a combination of hardware and software. Furthermore, multiple "modules" or multiple "parts" may be integrated into at least one module and implemented as at least one processor (not shown), excluding any "modules" or "parts" that need to be implemented as specific hardware.

[0021] In this specification, the term user may refer to a person using an electronic device or a device using an electronic device (e.g., an artificial intelligence electronic device).

[0022] Hereinafter, embodiments of the present disclosure will be described in more detail with reference to the attached drawings.

[0023] FIG. 1 is a block diagram of an exemplary electronic device capable of performing the operations described within the present disclosure.

[0024] Referring to FIG. 1, the electronic device (100) may be one of various forms of electronic devices, such as a notebook (180), smartphones (181) having various form factors (e.g., a bar-type smartphone (181-1), a foldable-type smartphone (181-2), or a sliderable (or rollable) type smartphone (181-3)), a tablet (182), a wearable device (e.g., glasses, a ring, etc.), a cellular phone (not shown), and other similar computing devices (not shown). The components, their relationships, and their functions illustrated in FIG. 1 are merely exemplary and do not limit the implementations described or claimed in the present disclosure. The electronic device (100) may be referred to as a mobile device, a user device, a multi-function device, a portable device, or a server.

[0025] The electronic device (100) may include components including at least one processor (110) (hereinafter, referred to as processor (110)), at least one memory (120) (hereinafter, referred to as memory (120)), at least one display (130) (hereinafter, referred to as display (130)), at least one image sensor (140) (hereinafter, referred to as image sensor (140)), at least one communication circuit (150) (hereinafter, referred to as communication circuit (150)), and / or at least one sensor (160) (hereinafter, referred to as sensor (160)). The above components are merely exemplary. For example, the electronic device (100) may include other components (e.g., power management integrated circuitry (PMIC), audio processing circuitry, an antenna, a rechargeable battery, or an input / output interface). For example, some components may be omitted from the electronic device (100). For example, some components may be integrated into one component.

[0026] The processor (110) may be implemented as one or more IC (integrated circuit (or circuitry)) chips and may perform various data processing. The processor (110) may include at least one electrical circuit and may individually or collectively perform distributed processing of instructions (or programs, data, etc.) stored in the memory (120). The processor (110) may include a processor assembly including one or more processing circuits. The processor (110) may include any processing circuit operative to control the performance and operations of one or more components (e.g., the memory (120), the display (130), the image sensor (140), the communication circuit (150), and / or the sensor (160)) of the electronic device (100). For example, the processor (110) (e.g., an application processor (AP)) may be implemented as a system on chip (SoC) (e.g., a single chip or a chipset). For example, the processor (110) may be implemented with multiple cores (or at least one core circuit), multiple chips, or multiple chipsets. For example, the processor (110) may include one or more processing circuits. For example, the processor (110) may include one or more processing circuits configured to individually and / or collectively perform various functions of the present disclosure. As a non-limiting example, at least a portion of the processor (110) may be included in a first chip of the electronic device (100), and at least another portion of the processor (110) may be included in a second chip of the electronic device (100) that is different from the first chip of the electronic device (100).

[0027] For example, the processor (110) may include a central processing unit (CPU) (111), a graphics processing unit (GPU) (112), a neural processing unit (NPU) (113), an image signal processor (ISP) (114), a display controller (115), a memory controller (116), a storage controller (117), a communication processor (CP) (118), and / or a sensor interface (119). These components of the processor (110) are merely exemplary. For example, the processor (110) may further include other components. For example, some components of the processor (110) may be omitted from the processor (110). For example, some components of the processor (110) may be included as separate components of the electronic device (100) outside the processor (110). For example, some components of the processor (110) (e.g., memory controller (116)) may be included within other components (e.g., at least a portion of memory (120), an interface (e.g., available for connection to at least one component of the electronic device (100)), a display (130) and / or an image sensor (140)).

[0028] The processor (110) may cause other components of the electronic device (100) to perform various operations by individually or collectively executing instructions stored in the memory (120). The CPU (111) (or central processing circuit) may be configured to control components of the processor (110) based on the execution of instructions stored in the memory (120) (e.g., volatile memory (121) and / or non-volatile memory (122)). The GPU (112) (or graphics processing circuit) may be configured to execute parallel operations (e.g., rendering). The NPU (113) (or neural processing circuit, or artificial intelligence (AI) chip) may be configured to execute operations for an artificial intelligence model (e.g., convolution computation). The ISP (114) (or image signal processing circuit) may be configured to process a raw image acquired through the image sensor (140) into a format suitable for a component within the electronic device (100) or a component of the processor (110). The display controller (115) (or display control circuit, or DPU (display processing unit)) may be configured to process an image acquired from the CPU (111), the GPU (112), the ISP (114), or the memory (120) (e.g., the volatile memory (121)) into a format suitable for the display (130). The memory controller (116) (or memory control circuit) may be configured to control reading data from the volatile memory (121) and writing data to the volatile memory (121). The storage controller (117) (or storage control circuit) may be configured to control reading data from the nonvolatile memory (122) and writing data to the nonvolatile memory (122).The CP (118) (communication processing circuit) may be configured to process data acquired from a component of the processor (110) into a format suitable for transmission to another electronic device via the communication circuit (150), or to process data acquired from another electronic device via the communication circuit (150) into a format suitable for processing by the component of the processor (110). For example, the communication circuit (150) may include one or more communication circuits. The sensor interface (119) (or sensing data processing circuit, sensor hub) may be configured to process data about the state of the electronic device (100) and / or the state of the surroundings of the electronic device (100), acquired via the sensor (160), into a format suitable for the component of the processor (110).

[0029] The memory (120) may include one or more storage media (or one or more storage devices). For example, the memory (120) may include a memory assembly including one or more storage media. For example, the one or more storage media may include permanent memory (e.g., non-volatile memory (122)) such as a hard drive, flash memory, read-only memory (ROM), semi-permanent memory (e.g., volatile memory (121)) such as random access memory (RAM), any other suitable type of storage (or storage assembly), or any combination thereof. The memory (120) may include cache memory, which is one or more different types of memory used to temporarily store data for a function or feature of the electronic device (100). As a non-limiting example, the cache memory may be included within the processor (110). The memory (120) may be fixedly embedded within the electronic device (100) or incorporated into one or more suitable types of components (e.g., a subscriber identity module (SIM) card and / or a secure digital (SD) card) that may be repeatedly inserted into and removed from the electronic device (100).

[0030] For example, the memory (120) may store one or more software applications, such as an operating system (or system) software application, a firmware software application, a driver software application, a plug-in (e.g., add-in, add-on, and / or applet) software application, and / or any other suitable software applications. For example, the one or more software applications may include instructions executable by the processor (110). For example, the memory (120) may store instructions callable by an application programming interface (API). For example, the memory (120) may store instructions within a library.

[0031] The display (130) is controlled by the processor (310) and can output visual information to the user. The visual information may include visual objects displayed on the screen of the display (130). For example, the visual objects may include indicators, images, icons, UI elements, menu items, etc. For example, the display (130) may be implemented as a flat panel display (FPD), a curved display, a flexible display capable of folding or / and rolling, etc.

[0032] According to one example, the display (130) may be implemented as a display including a self-luminous element. For example, the display (130) may be implemented as a display of various forms, such as an OLED (Organic Light Emitting Diodes) display, an LED (Light Emitting Diodes), a micro LED, a Mini LED, etc.

[0033] The display (130) may include a touch circuit (131) configured to detect a touch. The touch circuit (131) may acquire a user input for the display (130). For example, the touch circuit (131) may detect an input (e.g., a touch input or a hovering input) on a specific location of the display (130) by measuring a change in a signal (e.g., a voltage, a light amount, a resistance, or a charge amount) for the specific location of the display (130), and may provide information about the detected input to the processor (110). The processor (110) may use the touch circuit (131) to identify information about a touch input for the display (130) and the end of the touch input. The end of the touch input may include the user removing his / her hand that touched the display (130).

[0034] The communication circuit (150) may include hardware components for supporting transmission and / or reception of electrical signals between the electronic device (1000) and an external electronic device (e.g., a server device, another electronic device, etc.). For example, the communication circuit (150) may include at least one of a modem, an antenna, and an optical / electronic (O / E) converter. The communication circuit (150) may support transmission and / or reception of electrical signals based on various types of protocols, such as Ethernet, a local area network (LAN), a wide area network (WAN), wireless fidelity (WiFi), Bluetooth, Bluetooth low energy (BLE), ZigBee, long term evolution (LTE), 5G NR (new radio), and / or 6G.

[0035] The sensor (160) can generate electrical information that can be processed by the processor (110) and / or the memory (120) from non-electronic information related to the electronic device (100). The information can be referred to as sensor data. For example, the sensor (160) can detect the operating state of the electronic device (100) or the external environmental state and generate electrical information corresponding to the detected state. For example, the sensor (160) can include an inertial measurement unit (IMU) sensor, a global positioning system (GPS) sensor, a temperature sensor, an illuminance sensor, and / or a time-of-flight (ToF) sensor.

[0036] The sensor (160) may include a fingerprint sensor (161). The fingerprint sensor (161) may acquire fingerprint information under the control of the processor (110) and provide the acquired fingerprint information to the processor (110).

[0037] The fingerprint sensor (161) may be positioned below the display area of ​​the display (130). For example, the fingerprint sensor (161) may be positioned below a specific area (hereinafter referred to as a fingerprint recognition area) among the display areas of the display (130). The display area may include a screen on which visual information is displayed. For example, the fingerprint sensor (161) may be positioned on the backplane of the display panel of the display (130).

[0038] The fingerprint sensor (161) may be an optical type fingerprint sensor. The fingerprint sensor (161) may be configured to obtain a fingerprint image using an optical method. The fingerprint sensor (161) may detect a user's fingerprint using light output (or emitted) from the display (130). For example, light output from pixels corresponding to a fingerprint recognition area may be reflected by a finger touching the fingerprint recognition area. The fingerprint sensor (161) may obtain fingerprint information by sensing light reflected by the ridges and valleys between the ridges of the fingerprint of the finger through an image sensor. The fingerprint information may include a fingerprint image. For example, the image sensor may be implemented with a photoelectric conversion element (e.g., a photodiode, a phototransistor, a photogate, etc.), a CIS (CMOS Image Sensor), or a CCD (Charge Coupled Device).

[0039] The sensor (160) may include a pressure sensor (162). The pressure sensor (162) may detect pressure on the display (130) under the control of the processor (110) and provide information on the detected pressure to the processor (110). The pressure sensor (162) may be disposed below the display area of ​​the display (130). For example, the fingerprint sensor (161) may be disposed on the back plane of the display panel of the display (130).

[0040] FIG. 2 illustrates an example of a display (130) according to one embodiment.

[0041] Referring to FIG. 2, the display (130) may include a display having a fixed shape, and / or a deformable display, such as a foldable display or a rollable (or slidable) display. The components, their relationships, and their functions illustrated in FIG. 2 are exemplary only and do not limit the implementations described or claimed in this document.

[0042] The display (130) may include components such as a display panel (210), a display driver integrated circuitry (DDI) (or display driver circuitry (220)), and / or a touch circuitry (131). The above components are merely exemplary. For example, the display (130) may include other components (e.g., a digitizer and / or circuitry for controlling a sensor (160). For example, some components may be omitted from the display (130).

[0043] The display panel (210) may include a plurality of pixels and a plurality of thin film transistors (TFTs) that control the plurality of pixels. For example, the plurality of TFTs may include p-channel metal-oxide semiconductor (PMOS) transistors and / or n-channel metal-oxide semiconductor (NMOS) transistors. Each of the plurality of pixels may include a set of sub-pixels (e.g., a sub-pixel for providing red light, a sub-pixel for providing blue light, a sub-pixel for providing green light, and / or a sub-pixel for providing white light). For example, the plurality of pixels in the display panel (210) may be driven based on a voltage (or current) provided to the TFTs through (or from) the display driving circuit (220).

[0044] The display driving circuit (220) can provide visual information through the display panel (210) based on image data received from the processor (110) and / or commands for controlling the operation of sub-components of the display driving circuit (220). The display driving circuit (220) can include sub-components such as an interface controller (221) (e.g., including an interface control circuit), a timing controller (222) (e.g., including a timing control circuit), a command controller (223) (e.g., including a command control circuit), a graphics random access memory (GRAM) controller (224) (e.g., including a GRAM control circuit), a GRAM (225), a source driver (266), a gate driver (227), a first gamma voltage generation circuit (228), and / or a second gamma voltage generation circuit (229). The above sub-components are exemplary. For example, the display driving circuit (220) may further include other sub-components, such as a self-drawing engine (or any suitable circuit for self-drawing). For example, some sub-components, such as a GRAM controller (224) and a GRAM (225), may be omitted from the display driving circuit (220). For example, some sub-components, such as a source driver (226), a gate driver (227), may be arranged as separate components from the display driving circuit (220).

[0045] The interface controller (221) may provide image data acquired from the processor (110) (e.g., the display controller (115)) to the GRAM (225) and provide commands acquired from the processor (110) to the command controller (223). For example, the interface controller (221) may be used for one or more interfaces (e.g., a mobile industry processor interface (MIPI), a mobile display digital interface (MDDI), a serial peripheral interface (SPI), an inter-integrated circuit (I2C), and / or a compact display port (CDP)). In one embodiment, the image data may be stored in the GRAM (225). In one embodiment, storing the image data in the GRAM (225) may be bypassed. When storing the image data is bypassed, the image data may be provided to an image processing circuit (not shown) or a source driver (226) in the display driving circuit (220) through the interface controller (221).

[0046] The timing controller (222) can provide a synchronization signal (or timing signal) to the GRAM controller (224), the source driver (226), and / or the gate driver (227). In one embodiment, the synchronization signal is generated by the timing controller (222), and the synchronization signal generated by the timing controller (222) can be provided from the timing controller (222) to the GRAM controller (224), the source driver (226), the gate driver (227), and / or the touch circuit (131). In one embodiment, the synchronization signal can be generated by a synchronization signal generation circuit located outside the display driver circuit (220), and provided from the synchronization signal generation circuit to the timing controller (222). The synchronization signal provided from the synchronization signal generation circuit can be provided from the timing controller (222) to the GRAM controller (224), the source driver (226), and / or the gate driver (227). For example, the synchronization signal may include a display synchronization signal (e.g., a display vertical synchronization signal and a display horizontal synchronization signal). For example, the display vertical synchronization signal and the display horizontal synchronization signal may be used for reference timing for switching the source driver (226) and the gate driver (227), respectively. For example, the synchronization signal may include a touch synchronization signal (e.g., a touch vertical synchronization signal and a touch horizontal synchronization signal). For example, the touch vertical synchronization signal and the touch horizontal synchronization signal may each be provided to the touch circuit (131). As a non-limiting example, the frequency of the display synchronization signal may be different from the frequency of the touch synchronization signal. The command controller (223) may provide the command to the GRAM controller (224) and / or the timing controller (222).

[0047] The GRAM controller (224) can scan the image data recorded in the GRAM (225) based on the synchronization signal obtained from the timing controller (222) and the command obtained from the command controller (223), thereby providing the image data to the source driver (226). In one embodiment, the image data can be processed based on the command provided to the image processing circuit from the command controller (223) through an image processing circuit (not shown) located between the GRAM (225) and the source driver (226) before being provided to the source driver (226).

[0048] The source driver (226) can provide color through the set of sub-pixels based on the display vertical synchronization signal and the image data. For example, the source driver (226) can provide a data voltage corresponding to the input image data to a plurality of pixels.

[0049] According to an example, the source driver (226) can generate a data voltage (e.g., an analog data voltage) corresponding to image data using a gamma voltage. For example, the first gamma voltage generation circuit (228) can generate a gamma voltage under the control of the timing controller (222) and provide the gamma voltage to the source driver (226). The source driver (226) can generate a data voltage corresponding to a gray level value of a pixel using the gamma voltage under the control of the timing controller (222). The gamma voltage can be set based on the gamma value. Even for the same gray level, the size of the data voltage generated by the source driver (226) can vary depending on the gamma value.

[0050] The second gamma voltage generation circuit (229) can generate a gamma voltage under the control of the timing controller (222) and provide the gamma voltage to the source driver (226). The gamma voltage can be set based on a gamma value. For example, the gamma voltage generated by the second gamma voltage generation circuit (229) can be used to change (or adjust) the brightness of light (or flash light) output from the fingerprint recognition area of ​​the display (130) to a brightness (e.g., 650 nit) for acquiring a fingerprint. For example, the source driver (226) can generate a data voltage using the gamma voltage under the control of the timing controller (222) so that the brightness of light output from pixels corresponding to the fingerprint recognition area becomes a brightness for acquiring a fingerprint, and apply the generated data voltage to the pixels corresponding to the fingerprint recognition area.

[0051] The gate driver (227) can turn on or turn off the set of sub-pixels based on the display horizontal synchronization signal and the emission signal. For example, the timing controller (222) can set a duty ratio for a plurality of pixels and provide an emission signal having the set duty ratio to the gate driver (227). The gate driver (227) can turn on or turn off each of the plurality of pixels (e.g., the set of sub-pixels) based on the display horizontal synchronization signal and the emission signal. The duty ratio may include an on duty ratio. The on duty ratio is a ratio of a period in which the emission signal is on in a period corresponding to one frame. A set of sub-pixels may be turned on in a period in which the emission signal is on, and a set of sub-pixels may be turned off in a period in which the emission signal is off. As the ratio of the period in which the emission signal is on increases, the brightness of the pixel may increase. In the present disclosure, brightness may be replaced with an expression such as luminance, for example. The timing controller (222) can set a duty ratio based on the brightness of the image displayed on the display (130) using image data. In some embodiments, the duty ratio may include an off-duty ratio. The off-duty ratio is the ratio of the period in which the light-emitting signal is turned off in a period corresponding to one frame. The greater the ratio of the period in which the light-emitting signal is turned off, the more the brightness of the pixel may decrease.

[0052] The touch circuit (131) may include a touch sensor controller (231) and a touch sensor (232). The touch sensor controller (231) may control the touch sensor (232) based on the touch synchronization signal (e.g., the touch vertical synchronization signal and / or the touch horizontal synchronization signal) to obtain information about an input on the display panel (210) (e.g., a touch input or a hovering input on the display panel (210). The touch sensor controller (231) may provide the information obtained based on the touch synchronization signal to the processor (110) or the display driving circuit (220). The touch sensor (232) may be disposed in relation to the display panel (210). For example, the touch sensor (232) may be disposed within the display panel (210) or on the display panel (210).

[0053] The pressure sensor (162) can obtain information about input on the display panel (210). For example, the pressure sensor (162) can detect a change in electrostatic capacity according to a force applied to the display (130), convert the detected change into an electrical signal, and provide the signal to the processor (110). The processor (110) can obtain information about the touch position of the display (130), the magnitude of the pressure, etc. based on the received signal. For example, the pressure sensor (162) can be placed within the display panel (210). However, the present disclosure is not limited thereto, and the electronic device (100) can also detect pressure using various methods such as the piezoelectric effect, resistance change, etc.

[0054] FIG. 3 is a drawing for explaining a fingerprint recognition area according to one embodiment.

[0055] Referring to FIG. 3, a fingerprint recognition area (320) may be formed in at least a portion of a display (310). For example, the fingerprint recognition area (320) may be positioned a certain distance above the center of the bottom of the screen of the display (310). The display (310) may include the display (130) of FIGS. 1 and 2. A fingerprint sensor (161) may be formed below the fingerprint recognition area (320). A user may easily touch the fingerprint recognition area (320) using a finger (e.g., a thumb) while holding the electronic device (100). In response to detecting a touch input to the fingerprint recognition area (320), the electronic device (100) outputs light from the fingerprint recognition area (320) by the display (310) and obtains fingerprint information through the fingerprint sensor (161) using the light output from the fingerprint recognition area (320). In FIG. 3, the fingerprint recognition area (320) is illustrated as being circular, but the present disclosure is not limited thereto. For example, the fingerprint recognition area (320) may have various shapes, such as a square or an oval.

[0056] For example, the display driving mode of the display (310) may include a first mode and a second mode. The first mode may be replaced with an expression such as a normal mode. The second mode may be replaced with an expression such as a fingerprint mode, a fingerprint sensing mode, an optical fingerprint mode, etc.

[0057] For example, the display (310) may be driven based on a first duty ratio for one frame in a first mode. The display (310) may be driven based on a second duty ratio different from the first duty ratio for one frame in a second mode. The ratio of the on-periods of the plurality of pixels of the display (310) corresponding to the second duty ratio may be greater than the ratio of the on-periods of the plurality of pixels of the display (310) corresponding to the first duty ratio.

[0058] For example, the display (310) may have brightness controlled by region in the second mode. For example, the display (310) may individually (or independently) control the brightness of the fingerprint recognition region (320) and the brightness of the remaining region (330) under the control of the processor (110). The individual control of the brightness of the fingerprint recognition region (320) and the brightness of the remaining region (330) may be referred to as a local HBM (High Brightness Mode).

[0059] In one example, the display (310) can drive a plurality of pixels of the display (310) using a gamma voltage generated by the first gamma voltage generation circuit (228) in the first mode or the second mode. In the second mode, the display (310) can drive the fingerprint recognition area (320) and the remaining area excluding the fingerprint recognition area (320) using different gamma voltages based on whether a touch input is received for the fingerprint recognition area (320). For example, for the remaining area, the display (310) can drive the remaining area using the gamma voltage generated by the first gamma voltage generation circuit (228) as before the touch input is received. In the case of the fingerprint recognition area (320), the display (310) can drive the fingerprint recognition area (320) using the gamma voltage generated by the second gamma voltage generation circuit (229) so that the brightness of the light output from the fingerprint recognition area (320) becomes the brightness for acquiring a fingerprint. In the second mode, when the touch input to the fingerprint recognition area (320) ends or a designated (or preset) time elapses while the touch input is maintained, the display (310) can drive the fingerprint recognition area (320) using the gamma voltage generated by the first gamma voltage generation circuit (228) so as to lower the brightness of the light output from the fingerprint recognition area (320) back to the original brightness.

[0060] According to one example, the display (310) may control the brightness of the fingerprint recognition area (320) using an alpha mask image under the control of the processor (110). For example, when the display driving mode is changed from the first mode to the second mode, the display (310) may increase the brightness of the image displayed in the entire area of ​​the display (310) using the gamma voltage generated by the first gamma voltage generation circuit (228). In addition, when a touch input is received for the fingerprint recognition area (320) in the second mode, the display (310) may overlay the alpha mask image on the image displayed in the remaining area except for the fingerprint recognition area (320), thereby lowering the brightness of the remaining area. For example, overlaying the alpha mask image may include adjusting the brightness of the remaining area by multiplying the pixel value of the alpha mask image by the pixel value of the image displayed in the remaining area. The pixel value of the pixel of the alpha mask image may be less than 1. Accordingly, the brightness of the remaining areas is lowered, while the fingerprint recognition area (320) can be driven at high brightness.

[0061] FIGS. 4, 5, and 6 are diagrams for explaining operations of an electronic device according to one embodiment. The processor (110) may perform at least one of the operations of FIGS. 4, 5, and 6. Instructions stored in the memory (120) of the electronic device (100), when individually or collectively executed by the processor (110) of the electronic device (100), may cause the electronic device (100) to perform the operations of FIGS. 4, 5, and 6.

[0062] In operation S410, the electronic device (100) may drive the display (130) based on the first mode. The electronic device (100) may drive a plurality of pixels of the display (130) based on a first duty ratio to display an image on the display (130). The first duty ratio may include a first on-duty ratio of a light-emitting signal for driving the plurality of pixels. For example, the first on-duty ratio may be set based on the brightness of the image displayed on the display (130).

[0063] In operation S420, the electronic device (100) can detect the occurrence of an event for authenticating a user using the user's fingerprint.

[0064] An event for authenticating a user may be expressed as, for example, an event for fingerprint recognition. In one example, an event for authenticating a user using the user's fingerprint may include an event in which a fingerprint is requested for user authentication. For example, the processor (110) may identify that an event for authenticating a user has occurred when a fingerprint is requested for registration on the electronic device (100), a fingerprint is requested for signing up for a fingerprint registration service within an application, a fingerprint is requested for executing a specific function (e.g., login, payment, remittance, etc.) within an application, a fingerprint is requested for unlocking the electronic device (100), or a fingerprint is requested for unlocking the electronic device (100).

[0065] In operation S420-Y, S430, when the occurrence of an event for authenticating a user is detected, the electronic device (100) can change the display driving mode from the first mode to the second mode.

[0066] According to an example, when an event for authenticating a user is detected while the brightness of the display (130) is low, the electronic device (100) can change the display driving mode from the first mode to the second mode.

[0067] For example, the low brightness of the display (130) may include that the brightness of the image displayed on the display (130) is low. If the brightness of the image displayed on the display (130) is low, the on-duty ratio for driving a plurality of pixels of the display (130) may be low. Therefore, even if the gamma voltage is increased by setting the gamma value for the fingerprint recognition area (320) and the data voltage for the pixels corresponding to the fingerprint recognition area (320) is generated using the high gamma voltage, the brightness of the pixels corresponding to the fingerprint recognition area (320) may not increase to the brightness required to acquire a fingerprint. Accordingly, the electronic device (100) may change the on-duty ratio based on the detection of an event for authenticating a user in a state where the brightness of the display (130) is low. For example, the low brightness may include a brightness of 100 nit or less. For example, the electronic device (100) can drive a plurality of pixels of the display (130) based on a first duty ratio in a first mode. The electronic device (100) can change the display driving mode from the first mode to a second mode and drive a plurality of pixels of the display (130) based on the second duty ratio to display an image on the display (130). The second duty ratio can include a second on-duty ratio of a light-emitting signal for driving the plurality of pixels. For example, a ratio of an on-period of the light-emitting signal corresponding to the second on-duty ratio in the second mode can be greater than a ratio of an on-period of the light-emitting signal corresponding to the first on-duty ratio in the first mode. Alternatively, a ratio of an off-period of the light-emitting signal corresponding to the second on-duty ratio in the second mode can be less than a ratio of an off-period of the light-emitting signal corresponding to the first on-duty ratio in the first mode. For example, the second duty ratio may be a duty ratio set so that pixels corresponding to the fingerprint recognition area (320) can implement the brightness required for fingerprint acquisition through setting a gamma value for the fingerprint recognition area (320).

[0068] According to an example, when the display driving mode is changed from the first mode to the second mode, the electronic device (100) may change the duty ratio from the first duty ratio to the second duty ratio. In some embodiments, when the electronic device (100) changes the duty ratio from the first duty ratio to the second duty ratio, the electronic device (100) may change the duty ratio in steps. For example, the electronic device (100) may sequentially change the duty ratio from the first duty ratio to at least one duty ratio between the first duty ratio and the second duty ratio, thereby changing the duty ratio from the first duty ratio to the second duty ratio. For example, the at least one duty ratio may be determined based on a difference between the first duty ratio and the second duty ratio. For example, the greater the difference between the first duty ratio and the second duty ratio, the greater the number of the at least one duty ratio.

[0069] In operation S440, the electronic device (100) may include an indicator in the fingerprint recognition area (320) in the second mode and display a screen for acquiring a fingerprint. The indicator may guide the user to the location of an area where a fingerprint can be input (e.g., the fingerprint recognition area (320)) on the display (130). For example, the indicator may include an image representing the shape of a fingerprint.

[0070] In operations S450-Y and S460, when a user's touch input to the fingerprint recognition area (320) is received, the electronic device (100) can change the brightness of light output from the fingerprint recognition area (320) to brightness for fingerprint recognition.

[0071] For example, in order to more accurately detect a fingerprint using an optical fingerprint sensor (161), sufficient light is required. Therefore, if the brightness of the display (130) is low, it is necessary to increase the brightness of the pixels corresponding to the fingerprint recognition area (320) so that the fingerprint recognition area (320) shines brighter. The electronic device (100) can increase the brightness of light output from the fingerprint recognition area (320) based on a touch input to the fingerprint recognition area (320) while the on-duty ratio is adjusted to the second on-duty ratio.

[0072] According to one example, the electronic device (100) can identify pixels corresponding to the fingerprint recognition area (320) among the plurality of pixels of the display (130). For example, the pixels corresponding to the fingerprint recognition area (320) may include pixels whose brightness is adjusted for fingerprint recognition. The pixels corresponding to the fingerprint recognition area (320) may include pixels constituting the fingerprint recognition area (320) among the plurality of pixels of the display (130). The electronic device (100) can identify pixels corresponding to the fingerprint recognition area (320) among the plurality of pixels of the display (130) based on the position and size of the fingerprint recognition area (320). For example, if the fingerprint recognition area (320) is a rectangle, the position of the fingerprint recognition area (320) may include x,y coordinate values ​​of pixels corresponding to the vertices of the rectangle, and the size of the fingerprint recognition area (320) may include width and height. If the fingerprint recognition area (320) is circular, the position of the fingerprint recognition area (320) may include the x,y coordinate values ​​of the pixel corresponding to the center of the circle, and the size of the fingerprint recognition area (320) may include the radius.

[0073] According to one example, the electronic device (100) may change the brightness of light output from the fingerprint recognition area (320) to a brightness for acquiring a fingerprint based on a second gamma value that is different from the first gamma value for the remaining areas of the display (130) excluding the fingerprint recognition area (320). For example, the electronic device (100) may adjust the data voltage so that the data voltage applied to the pixels corresponding to the fingerprint recognition area (320) increases, and apply the adjusted data voltage to the pixels, thereby increasing the brightness of the pixels corresponding to the fingerprint recognition area (320). For example, the electronic device (100) may adjust the data voltage using the gamma voltage generated by the second gamma voltage generation circuit (229) according to the gamma value. The gamma value may include a gamma value for making the brightness of light output from the pixels corresponding to the fingerprint recognition area (320) a specified brightness (e.g., 650 nit) (or a brightness higher than the specified brightness). The specified brightness may include the brightness (or minimum brightness) required for fingerprint acquisition. For example, the specified brightness may be set during the manufacturing stage of the electronic device (100).

[0074] According to one example, the electronic device (100) can control the brightness of the light output from the fingerprint recognition area (320) based on the size of the touch input to the fingerprint recognition area (320). The size of the touch input may include, for example, the size of the area touched by the finger on the display (310). For example, if the user's finger does not touch accurately on the fingerprint recognition area (320) (e.g., the finger touches only a part of the fingerprint recognition area (320), it is difficult to obtain accurate fingerprint information of the user. When the electronic device (100) receives the user's touch input to the fingerprint recognition area (320), the electronic device (100) can identify the size of the area touched by the finger in the fingerprint recognition area (320), and identify the ratio of the area touched by the finger to the fingerprint recognition area (320) based on the identified size and the size of the fingerprint recognition area (320). The electronic device (100) may change the brightness of the light output from the fingerprint recognition area (320) to a brightness for fingerprint acquisition based on the identification that the identified ratio is greater than or equal to a specified ratio. The electronic device (100) may display a notification (e.g., “Please place your finger exactly in the fingerprint recognition area”) on the display (310) to guide the user to change the touch position of the finger to the fingerprint recognition area (320) without adjusting the brightness of the light output from the fingerprint recognition area (320) based on the identification that the identified ratio is less than or equal to a specified ratio.

[0075] In operation S470, the electronic device (100) can obtain the user's fingerprint information through the fingerprint sensor (161) using light output from the fingerprint recognition area (320).

[0076] According to one example, the electronic device (100) can obtain fingerprint information including a fingerprint image through the fingerprint recognition area (320) based on a user's touch input to the fingerprint recognition area (320). The fingerprint sensor (161) can be placed below the fingerprint recognition area (320). The fingerprint sensor (161) can obtain the fingerprint image using an optical method.

[0077] In operation S480, the electronic device (100) can authenticate the user based on fingerprint information.

[0078] According to one example, the electronic device (100) may perform a preprocessing operation on a fingerprint image. For example, the preprocessing operation may include a direction component extraction operation, a binarization operation, a smoothing operation, and / or a thinning operation on the fingerprint image. The electronic device (100) may extract feature points (e.g., minutiae) from the preprocessed fingerprint image. For example, the feature points may include a core point, a delta point, an ending point, and / or a bifurcation point that constitute a ridge of the fingerprint.

[0079] According to one example, the electronic device (100) can perform user authentication by comparing a fingerprint image with registered fingerprint information. The memory (120) can store the registered fingerprint information. For example, the electronic device (100) can compare feature points of the fingerprint image with feature points of the registered fingerprint information. The electronic device (100) can calculate the degree of similarity (e.g., a similarity score) between the fingerprint image and the registered fingerprint information by comparing the feature points of the fingerprint image and the feature points of the registered fingerprint information. The electronic device (100) can identify that the user authentication is successful based on whether the similarity of the fingerprint image is greater than or equal to a specified similarity. Successful user authentication can be replaced with an expression such as, for example, "fingerprint recognition success." The electronic device (100) can identify that the user authentication is unsuccessful based on whether the similarity of the fingerprint image is less than a specified similarity. Failure of user authentication can be replaced with an expression such as, for example, "fingerprint recognition failure."

[0080] In operation S510-Y, S520, the electronic device (100) can change the display driving mode from the second mode to the first mode based on successful authentication.

[0081] According to an example, the electronic device (100) may change the display driving mode from the second mode to the first mode, and drive a plurality of pixels of the display (130) based on the first duty ratio in the first mode. For example, the electronic device (100) may change the duty ratio from the second duty ratio to the first duty ratio, and drive a plurality of pixels of the display (130) based on the first duty ratio to display an image on the display (130). The first duty ratio may be a corresponding duty ratio in the first mode before changing to the second mode according to the occurrence of an event for authenticating a user. The electronic device (100) may stop displaying an indicator for guiding fingerprint input based on whether authentication of the user is successful or whether the display driving mode is changed to the first mode. The indicator displayed in the fingerprint recognition area (320) on the screen may be removed.

[0082] According to one example, the electronic device (100) may execute a function corresponding to user authentication based on the identification that user authentication has been successful. For example, the electronic device (100) may proceed with signing up for a fingerprint registration service within an application using the acquired fingerprint information. For example, the electronic device (100) may execute a specific function (e.g., login, payment, remittance, etc.) within the application. For example, the electronic device (100) may register the acquired fingerprint information as fingerprint information for unlocking the electronic device (100). For example, the electronic device (100) may proceed with unlocking the electronic device (100) and display the home screen.

[0083] In operation S510-N, S530, the electronic device (100) may maintain the display driving mode in the second mode while displaying a screen for obtaining a fingerprint based on a failure in authentication for the user.

[0084] According to one example, the electronic device (100) may maintain the second mode based on the identification that authentication for the user has failed, maintain the duty ratio for driving a plurality of pixels of the display (130) at the second duty ratio, and drive the plurality of pixels based on the second duty ratio to display an image on the display (130).

[0085] As described above, when the brightness of the display (130) is low, the on-duty ratio of the second mode may be set differently from the on-duty ratio of the first mode. When the mode of the electronic device (100) changes from the first mode to the second mode upon activation of the second mode, or when the mode of the electronic device (100) changes from the second mode to the first mode upon deactivation of the second mode, the user may visually feel the screen flickering. In addition, if the mode is changed to the first mode even when the fingerprint recognition fails in the second mode, it may cause further inconvenience to the user. The electronic device (100) according to the present disclosure may maintain the second mode without changing to the first mode when the user authentication fails in the second mode, thereby maintaining the on-duty ratio in the second mode. According to the present disclosure, the number of times the screen flickers during the fingerprint recognition process can be minimized, thereby reducing inconvenience to the user.

[0086] In operations S540-Y and S550, when a user's touch input to the fingerprint recognition area (320) is received, the electronic device (100) can change the brightness of the light output from the fingerprint recognition area (320). When authentication fails, the electronic device (100) can cause the display (130) to output light from the fingerprint recognition area (320) in the second mode without changing the display driving mode. For example, the electronic device (100) can maintain the second mode, and when a user's touch input to the fingerprint recognition area (320) is received, the brightness of the light output from the fingerprint recognition area (320) can be changed to brightness for fingerprint acquisition. Since the description of operation S450 can be applied to operation S540, and the description of operation S460 can be applied to operation S550, repeated descriptions are omitted.

[0087] In operation S560, the electronic device (100) can obtain the user's fingerprint information through the fingerprint sensor (161) using light output from the fingerprint recognition area (320). Since the description of operation S470 can be applied to operation S560, a repeated description is omitted.

[0088] In operation S570, the electronic device (100) can authenticate the user based on fingerprint information. If the authentication of the user is successful, the electronic device (100) can change the display driving mode from the second mode to the first mode and drive a plurality of pixels of the display (130) based on the first duty ratio. If the authentication of the user fails, the electronic device (100) can maintain the second mode, maintain the duty ratio for driving the plurality of pixels of the display (130) at the second duty ratio, and drive the plurality of pixels based on the second duty ratio. Since the description of operation S480 can be applied to operation S570, a repeated description will be omitted.

[0089] FIG. 6 is a drawing for explaining an operation of controlling the brightness of a fingerprint recognition area of ​​an electronic device according to one embodiment.

[0090] In operations S610-Y and S630, the electronic device (100) may change the brightness of the fingerprint recognition area (320) to its original brightness based on the termination of the touch input to the fingerprint recognition area (320). For example, the electronic device (100) may lower the brightness of light output from the fingerprint recognition area (320) to its original brightness in response to the termination of the touch input to the fingerprint recognition area (320).

[0091] In operations S610-N, S620-Y, and S630, the electronic device (100) may change the brightness of the fingerprint recognition area (320) to its original brightness based on the elapsed time period during which the touch input to the fingerprint recognition area (320) is maintained. In one example, the electronic device (100) may lower the brightness of light output from the fingerprint recognition area (320) to its original brightness in response to the touch input to the fingerprint recognition area (320) being maintained for a specified time period without ending. For example, the specified time period may be 400 ms.

[0092] According to one example, the electronic device (100) may adjust the size of pixels corresponding to the fingerprint recognition area (320) to lower the brightness of the fingerprint recognition area (320) to the original brightness. For example, the electronic device (100) may set the size of the pixels corresponding to the fingerprint recognition area (320) to 0 when a touch input to the fingerprint recognition area (320) is terminated or a specified time elapses while the touch input to the fingerprint recognition area (320) is maintained. If the size of the pixels is adjusted to 0, pixels whose brightness is adjusted for fingerprint recognition may not be identified. Accordingly, the electronic device (100) may lower the brightness of the image displayed on the pixels corresponding to the fingerprint recognition area (320) to the original brightness by using a previous gamma value (e.g., a gamma value applied to the fingerprint recognition area (320) before changing the brightness of the fingerprint recognition area (320).

[0093] In the above example, the fingerprint mode is described as being deactivated based on successful user authentication, but the present disclosure is not limited thereto. The electronic device (100) may deactivate the fingerprint mode based on the completion of fingerprint registration during the process of registering the user's fingerprint. For example, the electronic device (100) may deactivate the fingerprint mode based on successful fingerprint acquisition during the process of registering the user's fingerprint, thereby changing the display driving mode from the fingerprint mode to the normal mode, and may maintain the display driving mode in the fingerprint mode based on a failure in fingerprint acquisition. In addition, the electronic device (100) may deactivate the fingerprint mode based on the reception of a user input for canceling authentication or fingerprint registration during the process of authenticating the user or registering a fingerprint, thereby changing the display driving mode from the fingerprint mode to the normal mode.

[0094] In the above-described example, when the occurrence of an event for authenticating a user is detected while the electronic device (100) is driving the display (130) based on the first duty ratio in the first mode, the display driving mode is changed from the first mode to the second mode, and the display (130) is driven based on the second duty ratio. However, the present disclosure is not limited thereto. For example, the electronic device (100) may drive a plurality of pixels of the display (130) based on the second duty ratio when the occurrence of an event for authenticating a user is detected while the display (130) is inactive. The inactive state of the display (130) may include a state in which the display (130) is not used to display visual information, a state in which a plurality of pixels of the display (130) are not driven, or a state in which the display (130) provides a black image. For example, the electronic device (100) may drive a plurality of pixels of the display (130) based on a second duty ratio in a second mode based on a user input of pressing a button of the electronic device (100) or a touch input to the display (130) detected while in a sleep mode to display a lock screen on the display (130). The electronic device (100) may obtain fingerprint information through the lock screen. In response to successful authentication of a user based on the fingerprint information, the electronic device (100) may drive a plurality of pixels of the display (130) based on a first duty ratio to display a screen corresponding to unlocking (e.g., a home screen) on the display (130). In response to a failure in authentication of a user based on the fingerprint information, the electronic device (100) may maintain the duty ratio at the second duty ratio and drive a plurality of pixels of the display (130) based on the second duty ratio to display a lock screen on the display (130).

[0095] FIG. 7, FIG. 8a, FIG. 8b, and FIG. 9 are drawings illustrating an example of an electronic device performing a login in an application according to one embodiment.

[0096] Hereinafter, the first mode is described as the normal mode, and the second mode is described as the fingerprint mode. Referring to FIG. 7, the electronic device (100) may drive a plurality of pixels of the display (310) using the on-duty ratio in the normal mode (e.g., the on-duty ratio in the normal mode) to display a login screen (710) of a banking application on the display (310). According to one example, the electronic device (100) may display the screen (710) at a low brightness. The login screen (710) may include a screen for selecting a means for logging in.

[0097] For example, a user may touch a menu item (711) to select a fingerprint as a means for logging in. Referring to (1) of FIG. 8A, the electronic device (100) may change the mode of the electronic device (100) from the normal mode to the fingerprint mode based on the detection of a touch input for the menu item (711). The electronic device (100) may adjust an on-duty ratio based on the activation of the fingerprint mode, and may drive a plurality of pixels of the display (310) using the adjusted on-duty ratio to display the screen (810). For example, the on-duty ratio of the fingerprint mode may be greater than the on-duty ratio of the normal mode. The screen (810) may include a screen for receiving a user's fingerprint. For example, the screen (810) may include a visual object (811) (e.g., an indicator) for guiding fingerprint input. The visual object (811) may be displayed on the fingerprint recognition area (320). Referring to (1) of FIG. 8A, the electronic device (100) may be in a standby state. In the present disclosure, the standby state may include a state in which a plurality of pixels of the display (310) are driven using an on-duty ratio of a fingerprint mode (e.g., the adjusted on-duty ratio).

[0098] Referring to (2) of FIG. 8A, the electronic device (100) can change the brightness of the fingerprint recognition area (320) to a brightness for fingerprint acquisition based on the detection of a touch input to the fingerprint recognition area (320), and can acquire fingerprint information using the fingerprint sensor (161). Referring to (2) of FIG. 8A, the electronic device (100) can be in a standby and light-emitting state. In the present disclosure, the standby and light-emitting state can include a state in which a plurality of pixels of the display (310) are driven using the on-duty ratio of the fingerprint mode, and the brightness of the fingerprint recognition area (320) is changed. For example, the brightness of the fingerprint recognition area (320) can be increased to a brightness for fingerprint acquisition.

[0099] The electronic device (100) can perform user authentication based on the acquired fingerprint information. Referring to (3) of FIG. 8A, the electronic device (100) can maintain the fingerprint mode based on the identification that the user authentication has failed based on the acquired fingerprint information, and can display the screen (810) by driving a plurality of pixels of the display (310) using the on-duty ratio of the fingerprint mode. For example, the screen (810) can include a visual object (811) displayed in the fingerprint recognition area (320). The electronic device (100) can lower the brightness of the fingerprint recognition area (320) to its original brightness. Referring to (3) of FIG. 8A, the electronic device (100) can be in a standby state.

[0100] Referring to (4) of FIG. 8A, the electronic device (100) can change the brightness of the fingerprint recognition area (320) to a brightness for fingerprint acquisition based on the detection of a touch input to the fingerprint recognition area (320) and can acquire fingerprint information using the fingerprint sensor (161). Referring to (4) of FIG. 8A, the electronic device (100) can be in a standby and light-emitting state.

[0101] The electronic device (100) can authenticate a user based on the acquired fingerprint information. Based on successful authentication of the user based on the acquired fingerprint information, the electronic device (100) can deactivate the fingerprint mode and change the mode of the electronic device (100) from the fingerprint mode to the normal mode. Referring to (5) of FIG. 8B, the electronic device (100) can be in a standby state for a specified period of time (e.g., a short period of time) before changing the mode of the electronic device (100) to the normal mode. In the standby state, the electronic device (100) can drive a plurality of pixels of the display (310) using the on-duty ratio of the fingerprint mode to display the screen (810). For example, the screen (810) may not include a visual object (811). Alternatively, the screen (810) may include a visual object (811) displayed in the fingerprint recognition area (320). The electronic device (100) can change the brightness of the fingerprint recognition area (320) to its original brightness. For example, the electronic device (100) can lower the brightness of the fingerprint recognition area (320) that was increased for fingerprint acquisition back to the original brightness.

[0102] Referring to FIG. 9, the electronic device (100) may display an account screen (910) of a logged-in user on the display (310) based on successful authentication of the user. For example, the electronic device (100) may adjust the on-duty ratio to the original on-duty ratio (e.g., the on-duty ratio of the normal mode) based on the change to the normal mode, and may drive a plurality of pixels of the display (310) using the on-duty ratio of the normal mode to display the account screen (910).

[0103] FIG. 10 is a drawing for explaining a duty ratio corresponding to a mode of an electronic device according to one embodiment.

[0104] Referring to FIG. 10, the electronic device (100) may change the duty cycle for driving a plurality of pixels based on whether the mode is changed from the normal mode to the fingerprint mode while displaying an image on the display (130) with low brightness in the normal mode. The turn-on period (e.g., t1) of the pixels corresponding to the duty cycle of the normal mode may be shorter than the turn-on period (e.g., t2) corresponding to the duty cycle of the fingerprint mode. According to an embodiment, the brightness of the display (130) in the fingerprint mode may be higher than the brightness of the display (130) in the normal mode or may be equal to the brightness of the display (130) in the normal mode. The electronic device (100) may adjust the brightness of the fingerprint recognition area based on the number of times fingerprint recognition has failed. The failure of fingerprint recognition may include a failure to acquire a fingerprint or a failure to authenticate a user using acquired fingerprint information. For example, the electronic device (100) may gradually increase the brightness of the fingerprint recognition area as the number of times fingerprint recognition has failed increases. For example, the electronic device (100) can gradually increase the brightness of the fingerprint recognition area by adjusting the duty ratio of the pixels or adjusting the voltage applied to the pixels.

[0105] According to the present disclosure, if authentication based on a user's fingerprint information fails in fingerprint mode or if fingerprint information acquisition fails, fingerprint mode can be maintained. Accordingly, the number of times the screen flickers can be minimized, thereby reducing user inconvenience.

[0106] FIG. 11 is a block diagram of an exemplary electronic device capable of performing the operations described within the present disclosure.

[0107] Referring to FIG. 11, the electronic device (100) may include a display (1110), a fingerprint sensor (1120), a memory (1130), and at least one processor (1140). The display (1110) may perform the same function as the display (130) of FIG. 1, the fingerprint sensor (1120) may perform the same function as the fingerprint sensor (161) of FIG. 1, the memory (1130) may perform the same function as the memory (120) of FIG. 1, and at least one processor (1140) may perform the same function as the processor (110) of FIG. 1. Therefore, in describing FIG. 11, overlapping content described with FIG. 1 is omitted for the sake of brevity.

[0108] For example, when the processor (1140) detects the occurrence of an event for authenticating a user using the user's fingerprint, the processor (1140) may change the display driving mode from the first mode to the second mode. The processor (1140) may drive a plurality of pixels of the display (1110) based on the second duty ratio in the second mode, and display a screen for acquiring a fingerprint, including an indicator in a fingerprint recognition area, on the display (1110). For example, in response to detecting the occurrence of an event while driving a plurality of pixels of the display (1110) based on the first duty ratio in the first mode, the processor (1140) may change the duty ratio to the second duty ratio and drive the plurality of pixels of the display (1110) based on the second duty ratio. For example, the processor (1140) may drive a plurality of pixels of the display (1110) based on the second duty ratio, based on detecting the occurrence of an event while the display (1110) is in an inactive state.

[0109] According to one example, when a touch input is received for a fingerprint recognition area in the second mode, the processor (1140) may acquire fingerprint information through the fingerprint sensor (1120) using light output from the fingerprint recognition area by the display (1110), and authenticate the user based on the acquired fingerprint information. Based on successful authentication of the user, the processor (1140) may change the display driving mode from the second mode to the first mode, and change the duty ratio to the first duty ratio to drive a plurality of pixels of the display (1110) based on the first duty ratio. Based on failed authentication of the user, the processor (1140) may maintain the display driving mode as the second mode and drive a plurality of pixels of the display (1110) based on the second duty ratio.

[0110] According to one example, the processor (1140) may acquire fingerprint information using the fingerprint sensor (1120) based on a touch input received on a fingerprint recognition area in a second mode for registering a user's fingerprint. Based on successful fingerprint acquisition, the processor (1140) may change the display driving mode from the second mode to the first mode and change the duty ratio to the first duty ratio to drive a plurality of pixels of the display (1110) based on the first duty ratio. Based on a failure in fingerprint acquisition, the processor (1140) may maintain the display driving mode as the second mode and drive a plurality of pixels of the display (1110) based on the second duty ratio.

[0111] Since the description related to the operations of the processor (1140) has already been described in the description of the previous drawings, a repeated description is omitted.

[0112] As described above, an electronic device (100) according to one embodiment may include a display (130 of FIG. 1, 1110 of FIG. 11), a fingerprint sensor (161 of FIG. 1, 1120 of FIG. 11), a memory (120 of FIG. 1, 1130 of FIG. 11), and a processor (110 of FIG. 1, 1140 of FIG. 11).

[0113] The instructions stored in the memory, when individually or collectively executed by at least one processor, cause the electronic device to detect the occurrence of an event for authenticating a user using a fingerprint of the user, and based on the detection, change the display driving mode from a first mode to a second mode that includes an indicator in the specific area and displays a screen for acquiring the fingerprint, and when a touch input of the user for the indicator is received, acquire fingerprint information through the fingerprint sensor based on light output by the display in the specific area in the second mode, authenticate the user based on the fingerprint information, and based on whether the authentication is successful, change the display driving mode from the second mode to the first mode, and based on whether the authentication is unsuccessful, maintain the display driving mode in the second mode while displaying the screen for acquiring the fingerprint, so that the display outputs light in the specific area in the second mode without changing the display driving mode. The display may be driven based on a first duty ratio for one frame in the first mode, and may be driven based on a second duty ratio different from the first duty ratio for one frame in the second mode.

[0114] For example, the display may include a plurality of pixels. A ratio of on periods of the plurality of pixels corresponding to the second duty ratio may be greater than a ratio of on periods of the plurality of pixels corresponding to the first duty ratio.

[0115] For example, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to change the display driving mode from the first mode to the second mode based on the detection that the brightness of the display is in a low brightness state.

[0116] For example, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to change the brightness of light output from the specific region to a brightness for acquiring the fingerprint when the user's touch input to the indicator is received in the second mode. The brightness of light output from the specific region may be maintained at the changed brightness for a specified period of time while the user's touch input to the indicator is maintained.

[0117] For example, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to, when a user's touch input for the specific area is received in the second mode, change the brightness of light output from the specific area to a brightness for acquiring the fingerprint based on a second gamma value that is different from the first gamma value for the remaining areas.

[0118] For example, the fingerprint sensor may be configured to acquire a fingerprint image using an optical method. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to acquire fingerprint information including the fingerprint image through the fingerprint sensor when a user's touch input to the indicator is received in the second mode.

[0119] For example, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to, when a touch input of the user for the specific area is received in the maintained second mode after the authentication fails, obtain fingerprint information through the fingerprint sensor based on light output from the specific area by the display, re-authenticate the user based on the fingerprint information, and change the display driving mode from the second mode to the first mode based on the re-authentication being successful.

[0120] As described above, a method for obtaining fingerprint information of an electronic device including a display and a fingerprint sensor disposed below a specific area of ​​the display for obtaining a fingerprint according to one embodiment may include an operation of detecting the occurrence of an event for authenticating a user using a fingerprint of the user, an operation of changing a display driving mode from a first mode to a second mode that includes an indicator in the specific area and displays a screen for obtaining the fingerprint based on the detection, an operation of obtaining fingerprint information through the fingerprint sensor based on light output by the display in the specific area in the second mode when a touch input of the user for the indicator is received, an operation of authenticating the user based on the fingerprint information, an operation of changing the display driving mode from the second mode to the first mode based on whether the authentication is successful, and an operation of maintaining the display driving mode in the second mode while displaying the screen for obtaining the fingerprint based on whether the authentication is unsuccessful, so that the display outputs light in the specific area in the second mode without changing the display driving mode. The display may be driven based on a first duty ratio for one frame in the first mode, and may be driven based on a second duty ratio different from the first duty ratio for one frame in the second mode.

[0121] For example, the display may include a plurality of pixels. A ratio of on periods of the plurality of pixels corresponding to the second duty ratio may be greater than a ratio of on periods of the plurality of pixels corresponding to the first duty ratio.

[0122] For example, the operation of changing to the second mode may include an operation of changing the display driving mode from the first mode to the second mode based on the detection in a state where the brightness of the display is low.

[0123] For example, a fingerprint information acquisition method according to one embodiment may further include an operation of changing the brightness of light output from the specific region to a brightness for acquiring the fingerprint when the user's touch input to the indicator is received in the second mode. The brightness of light output from the specific region may be maintained at the changed brightness for a specified period of time while the user's touch input to the indicator is maintained.

[0124] For example, the changing operation may include an operation of changing the brightness of light output from the specific area to a brightness for acquiring the fingerprint based on a second gamma value that is different from the first gamma value for the remaining areas when the user's touch input for the specific area is received in the second mode.

[0125] For example, the fingerprint sensor may be configured to acquire a fingerprint image using an optical method. The operation of acquiring the fingerprint information may include an operation of acquiring the fingerprint information including the fingerprint image through the fingerprint sensor when a user's touch input to the indicator is received in the second mode.

[0126] For example, a fingerprint information acquisition method according to one embodiment may further include an operation of acquiring fingerprint information through the fingerprint sensor based on light output from the specific area by the display when a touch input of the user for the specific area is received in the maintained second mode after the authentication fails, an operation of re-authenticating the user based on the fingerprint information, and an operation of changing the display driving mode from the second mode to the first mode based on the re-authentication being successful.

[0127] Meanwhile, the various embodiments described above may be implemented in a computer-readable recording medium or similar device using software, hardware, or a combination thereof. In some cases, the embodiments described herein may be implemented by the processor itself. In a software implementation, embodiments, such as the procedures and functions described herein, may be implemented as separate software modules. Each of the software modules may perform one or more functions and operations described herein.

[0128] Meanwhile, computer instructions for performing processing operations of an electronic device according to various embodiments of the present disclosure described above may be stored in a non-transitory computer-readable medium. When the computer instructions stored in such a non-transitory computer-readable medium are executed by a processor of a specific device, the computer instructions cause the specific device to perform processing operations in the electronic device according to various embodiments described above.

[0129] A non-transitory computer-readable medium refers to a medium that permanently stores data and can be read by a device, rather than a medium that stores data for a short period of time, such as a register, cache, or memory. Specific examples of non-transitory computer-readable media include CDs, DVDs, hard disks, Blu-ray discs, USBs, memory cards, and ROMs.

[0130] Although the preferred embodiments of the present disclosure have been illustrated and described above, the present disclosure is not limited to the specific embodiments described above, and various modifications may be made by a person having ordinary skill in the art to which the present disclosure pertains without departing from the gist of the present disclosure as claimed in the claims, and such modifications should not be understood individually from the technical idea or prospect of the present disclosure.

Claims

1. In an electronic device (100), display (130); A fingerprint sensor (161) positioned below a specific area of ​​the display for acquiring a fingerprint; Memory (120) for storing instructions; and comprising at least one processor (110), The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: Detecting the occurrence of an event to authenticate the user using the user's fingerprint, Based on the above detection, the display driving mode is changed from the first mode to the second mode, which includes an indicator in the specific area and displays a screen for acquiring the fingerprint, When the user's touch input for the indicator is received, fingerprint information is acquired through the fingerprint sensor based on the light output from the specific area by the display in the second mode, Authenticate the user based on the fingerprint information, Based on the success of the above authentication, the display driving mode is changed from the second mode to the first mode, Based on the failure of the above authentication, the display driving mode is maintained in the second mode while displaying the screen for acquiring the fingerprint, so that the display outputs light in the specific area in the second mode without changing the display driving mode, An electronic device wherein the display is driven based on a first duty ratio for one frame in the first mode, and is driven based on a second duty ratio different from the first duty ratio for one frame in the second mode.

2. In paragraph 1, The above display includes a plurality of pixels, An electronic device, wherein the ratio of the on periods of the plurality of pixels corresponding to the second duty ratio is greater than the ratio of the on periods of the plurality of pixels corresponding to the first duty ratio.

3. In paragraph 1 or 2, The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: An electronic device that changes the display driving mode from the first mode to the second mode based on the detection when the brightness of the display is low.

4. In paragraph 1, The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: When the user's touch input for the indicator is received in the second mode, the brightness of the light output from the specific area is changed to a brightness for acquiring the fingerprint, An electronic device in which the brightness of light output from the specific area is maintained at the changed brightness for a specified period of time while the user's touch input to the indicator is maintained.

5. In paragraph 4, The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: An electronic device that, when a user's touch input for the specific area is received in the second mode, changes the brightness of light output from the specific area to a brightness for acquiring the fingerprint based on a second gamma value that is different from the first gamma value for the remaining areas.

6. In paragraph 5, The above fingerprint sensor is configured to acquire a fingerprint image using an optical method, The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: An electronic device that, when a user's touch input to the indicator is received in the second mode, acquires the fingerprint information including the fingerprint image through the fingerprint sensor.

7. In any one of paragraphs 1 to 6, The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: When the user's touch input for the specific area is received in the maintained second mode after the above authentication fails, fingerprint information is acquired through the fingerprint sensor based on the light output from the specific area by the display, Re-authenticate the user based on the fingerprint information, An electronic device that changes the display driving mode from the second mode to the first mode based on the success of the re-authentication.

8. A method for obtaining fingerprint information of an electronic device including a display and a fingerprint sensor positioned below a specific area of ​​the display for obtaining a fingerprint, An operation (S420) for detecting the occurrence of an event for authenticating a user using the user's fingerprint; Based on the above detection, an operation (S430) of changing the display driving mode from a first mode to a second mode that includes an indicator in the specific area and displays a screen for acquiring the fingerprint; When the user's touch input for the indicator is received, an operation (S470) of obtaining fingerprint information through the fingerprint sensor based on light output from the specific area by the display in the second mode; An operation for authenticating the user based on the fingerprint information (S480); Based on the success of the above authentication, an operation (S520) of changing the display driving mode from the second mode to the first mode; and An operation (S530) is included to maintain the display driving mode in the second mode while displaying the screen for acquiring the fingerprint based on the failure of the authentication, so that the display outputs light in the specific area in the second mode without changing the display driving mode. A fingerprint information acquisition method, wherein the display is driven based on a first duty ratio for one frame in the first mode, and is driven based on a second duty ratio different from the first duty ratio for one frame in the second mode.

9. In paragraph 8, The above display includes a plurality of pixels, A fingerprint information acquisition method, wherein the ratio of the on-periods of the plurality of pixels corresponding to the second duty ratio is greater than the ratio of the on-periods of the plurality of pixels corresponding to the first duty ratio.

10. In paragraph 8 or 9, The action of changing to the above second mode is: A fingerprint information acquisition method including an operation of changing the display driving mode from the first mode to the second mode based on the detection in a state where the brightness of the display is low.

11. In paragraph 8, In the second mode, when the user's touch input for the indicator is received, the method further includes changing the brightness of the light output from the specific area to a brightness for obtaining the fingerprint. A method for obtaining fingerprint information, wherein the brightness of light output from the specific area is maintained at the changed brightness for a specified period of time while the user's touch input to the indicator is maintained.

12. In paragraph 11, The above changing action is, A fingerprint information acquisition method, comprising an operation of changing the brightness of light output from the specific area to a brightness for acquiring the fingerprint based on a second gamma value different from the first gamma value for the remaining areas when a user's touch input for the specific area is received in the second mode.

13. In paragraph 12, The above fingerprint sensor is configured to acquire a fingerprint image using an optical method, The operation of obtaining the above fingerprint information is: A fingerprint information acquisition method, comprising an operation of acquiring the fingerprint information including the fingerprint image through the fingerprint sensor when the user's touch input to the indicator is received in the second mode.

14. In any one of paragraphs 8 to 13, An operation of obtaining fingerprint information through the fingerprint sensor based on light output from the specific area by the display when the user's touch input for the specific area is received in the maintained second mode after the authentication fails; An operation of re-authenticating the user based on the fingerprint information; and A fingerprint information acquisition method further comprising an operation of changing the display driving mode from the second mode to the first mode based on the success of the re-authentication.

Images