Method for controlling fingerprint sensor, and electronic device supporting same

Abstract

The electronic device detects the occurrence of an event for sensing a fingerprint of a user, obtains, on the basis of detecting the occurrence of the event for sensing the fingerprint of the user, a first image by using a fingerprint sensor before a display emits light with a predetermined intensity for sensing the fingerprint, analyzes a pattern corresponding to flicker noise in the first image, adjusts, on the basis of the analysis, an exposure time of the fingerprint sensor for sensing the light with the predetermined intensity emitted by the display and reflected by the fingerprint of the user, and obtains, on the basis of the adjusted exposure time, a second image by using the finger sensor sensing the light with the predetermined intensity emitted by the display and reflected by the fingerprint of the user.

Description

Method for controlling a fingerprint sensor and an electronic device supporting the same

[0001] The present disclosure relates to a method for controlling a fingerprint sensor and an electronic device supporting the same.

[0002] Various biometric authentication technologies can be applied to electronic devices. A commonly used biometric authentication technology may be fingerprint authentication. For example, an electronic device including a display (e.g., a touchscreen) capable of detecting touch by a finger or other object can acquire a fingerprint (e.g., a fingerprint image, fingerprint information) using a fingerprint sensor positioned at a location corresponding to at least a portion of the display.

[0003] An electronic device may cause a display to emit light having an intensity higher than a specified or predetermined intensity when acquiring a fingerprint image using a fingerprint sensor, in order to acquire a fingerprint image having a quality higher than a specified or predetermined quality. For example, the electronic device may control a fingerprint sensor so that the fingerprint sensor acquires a fingerprint image while pixels of the display corresponding to the location (or area) of the fingerprint sensor emit light having an intensity higher than the specified or predetermined intensity.

[0004] A fingerprint sensor may include a fingerprint sensor using a rolling shutter method that acquires an image (e.g., a fingerprint image) by sequentially acquiring (e.g., capturing) light and performing readout on a row-by-row basis of pixels of the fingerprint sensor, and a fingerprint sensor using a global shutter method that acquires an image by having pixels of the fingerprint sensor simultaneously acquire and read out light. A fingerprint sensor using a global shutter method can acquire a fingerprint image with higher performance than a fingerprint sensor using a rolling shutter method, but may have a complex circuit configuration, so the size of the fingerprint sensor may be large and a lot of resources may be consumed during operation.

[0005] The above information may be provided as background art to aid in understanding the present disclosure. No claim or determination is made as to whether any of the above is applicable as prior art related to the present disclosure.

[0006] The quality of an image (e.g., the quality of a fingerprint image) acquired by a fingerprint sensor (e.g., a fingerprint sensor using a rolling shutter method) may be affected not only by the intensity of the light emitted by the display, but also by the periodicity with which the display emits light. For example, a display may display a screen by periodically turning on and off (e.g., activating and deactivating) depending on the refresh rate of the display. In some embodiments, the periodicity with which the display is turned on and then turned off (e.g., activated and then deactivated) may be referred to as a display turning on / off period or an on / off period. If at least some of the rows of pixels of a fingerprint sensor operating using a rolling shutter method acquire light emitted from the display for different periods of time (e.g., the periods during which the pixels of the fingerprint sensor are exposed to light), a pattern due to flicker noise may appear in the image acquired using the fingerprint sensor.

[0007] In order to minimize the flicker noise, the electronic device may set the ratio of the amount of time that the display is off within a cycle (which may be referred to as the off ratio (OR)) to the amount of time corresponding to the cycle (e.g., the time during one cycle that the display is on / off) for the cycle in which the display is turned on / off to a specified or predetermined ratio or less. However, in this case, it may be difficult for the light sensor to accurately measure the illuminance of the electronic device because external light is detected during the time that the display is off. Accordingly, it is necessary to minimize the flicker noise occurring in the fingerprint image (or prevent the flicker noise from occurring) while ensuring that the OR is about 10% or more. Accordingly, the electronic device may minimize the flicker noise by transmitting information about the on / off cycle of the display to the fingerprint sensor via electrical wiring for each cycle in which the display is turned on / off, thereby ensuring that the OR is about 10% or more. However, these can cause problems for electronic devices, requiring separate circuits or circuit blocks.

[0008] The electronic device can minimize the flicker noise by controlling the fingerprint sensor so that each pixel of the fingerprint sensor detects light for an exposure time (e.g., the time each pixel of the fingerprint sensor is exposed to light) obtained by multiple (or "multiplying") the cycle of turning the display on and off, thereby making the OR greater than or equal to about 10% without separate circuit components.

[0009] The actual on / off cycle of the display can be set using a clock generated by an oscillator of the electronic device (e.g., by multiplying the clock generated by the oscillator by an integer). The clock generated by the oscillator can change depending on the external environment of the electronic device (e.g., the temperature of the electronic device, the brightness around the electronic device, the brightness of the display of the electronic device). In addition, the clock generated by the oscillator can vary depending on the oscillator mounted on the electronic device. For example, there can be a deviation between oscillators manufactured by the same process, and the clock predicted to be generated by an oscillator mounted on the electronic device and the clock actually generated by the oscillator can differ. If the time for which each row of pixels of a fingerprint sensor (e.g., a fingerprint sensor using a rolling shutter method) is exposed to light is set or selected to be an integer multiple of the cycle of turning the display on / off, and then the clock generated by the oscillator is changed, the time for which each row of pixels of the fingerprint sensor is exposed to light may not be an integer multiple of the cycle of actually turning the display on / off. In this case, a pattern due to flicker noise may appear in an image acquired using the fingerprint sensor. In the examples described above, the flicker noise is generated by changing the clock generated by the oscillator, but this is not limited thereto. For example, the flicker noise may be generated by changing the clock of the fingerprint sensor for acquiring light from the fingerprint sensor (e.g., a clock that counts the exposure time).

[0010] One embodiment of the present disclosure relates to a method for controlling a fingerprint sensor and an electronic device supporting the same, wherein the fingerprint sensor can adjust an exposure time (e.g., a time for each row of pixels of the fingerprint sensor to acquire light) based on an image acquired using the fingerprint sensor, and the fingerprint sensor can acquire light during the adjusted exposure time.

[0011] The technical problems to be achieved by the present disclosure are not limited to the technical problems mentioned above, and other technical problems not mentioned can be clearly understood by a person having ordinary skill in the technical field related to this document from the description below.

[0012] An electronic device according to one embodiment may include a display, a fingerprint sensor disposed under the display and configured to acquire an image by sensing light, at least one processor including a processing circuit, and a memory storing instructions. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to detect the occurrence of an event for sensing a fingerprint of a user. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to acquire a first image using the fingerprint sensor before the display emits light at a predetermined intensity for sensing a fingerprint, based on the detection of the occurrence of the event for sensing the fingerprint of the user. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to analyze at least one pattern corresponding to flicker noise within the first image. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to adjust at least one exposure time of the fingerprint sensor for sensing light emitted by the display at the predetermined intensity and reflected by the fingerprint of the user based on the analysis. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to acquire a second image using the fingerprint sensor by sensing light emitted by the display at the predetermined intensity and reflected by the fingerprint of the user based on the adjusted at least one exposure time.

[0013] In one embodiment, a method of controlling a fingerprint sensor in an electronic device may include detecting an occurrence of an event for sensing a fingerprint of a user. The method may include acquiring a first image using the fingerprint sensor before the display emits light at a predetermined intensity for sensing the fingerprint, based on the detection of the occurrence of the event for sensing the fingerprint of the user. The method may include analyzing at least one pattern corresponding to flicker noise within the first image. The method may include adjusting at least one exposure time of the fingerprint sensor for sensing light emitted by the display at the predetermined intensity and reflected by the fingerprint of the user, based on the analysis. The method may include acquiring a second image using the fingerprint sensor by sensing light emitted by the display at the predetermined intensity and reflected by the fingerprint of the user, based on the adjusted at least one exposure time.

[0014] In one embodiment, a non-transitory computer-readable storage medium having computer-executable instructions recorded thereon may cause an electronic device to detect an occurrence of an event for sensing a fingerprint of a user. The computer-executable instructions, when executed by the at least one processor, may cause the electronic device to, based on detecting the occurrence of the event for sensing the fingerprint of the user, acquire a first image using the fingerprint sensor before the display emits light at a predetermined intensity for sensing the fingerprint. The computer-executable instructions, when executed by the at least one processor, may cause the electronic device to, in response to detecting the occurrence of the event for sensing the fingerprint of the user, acquire a first image using the fingerprint sensor before the display emits light at a predetermined intensity for sensing the fingerprint. The computer-executable instructions, when executed by at least one processor, may cause the electronic device to adjust, based on the analysis, at least one exposure time of the fingerprint sensor for sensing light emitted by the display at the predetermined intensity and reflected by the fingerprint of the user. The computer-executable instructions, when executed by the at least one processor, may cause the electronic device to acquire a second image using the fingerprint sensor by sensing light emitted by the display at the predetermined intensity and reflected by the fingerprint of the user, based on the adjusted at least one exposure time.

[0015] In connection with the description of the drawings, the same or similar reference numerals may be used for the same or similar components.

[0016] FIG. 1 is a block diagram of an electronic device within a network environment, according to one embodiment.

[0017] FIG. 2 is a block diagram of an electronic device according to one embodiment.

[0018] FIG. 3 is a drawing for explaining components included in a fingerprint sensor according to one embodiment.

[0019] FIG. 4 is a diagram for explaining the operation of a fingerprint sensor according to one embodiment.

[0020] FIG. 5 is a drawing for explaining the arrangement of a fingerprint sensor within an electronic device according to one embodiment.

[0021] FIG. 6 is a drawing for explaining a method of controlling a fingerprint sensor in a comparative example according to one embodiment.

[0022] FIG. 7 is a flowchart illustrating a method for controlling a fingerprint sensor according to one embodiment.

[0023] FIG. 8 is a diagram illustrating a method for detecting an event for sensing a user's fingerprint according to one embodiment.

[0024] FIG. 9 is a drawing for explaining a pattern represented by flicker noise in a first image according to one embodiment.

[0025] FIG. 10 is a flowchart illustrating a method for adjusting exposure time according to one embodiment.

[0026] FIG. 11A is a diagram illustrating a method for adjusting exposure time according to one embodiment.

[0027] FIG. 11b is a drawing for explaining a method of adjusting exposure time according to one embodiment.

[0028] FIG. 12 is a diagram for explaining a method of controlling a fingerprint sensor according to one embodiment.

[0029] FIG. 13 is a flowchart illustrating a method for controlling a fingerprint sensor according to one embodiment.

[0030] FIG. 14 is a flowchart illustrating a method for controlling a fingerprint sensor according to one embodiment.

[0031] FIG. 15 is a diagram for explaining a method of controlling a fingerprint sensor according to one embodiment.

[0032] FIG. 16 is a flowchart illustrating a method for controlling a fingerprint sensor according to one embodiment.

[0033] FIG. 17 is a diagram for explaining a method of controlling a fingerprint sensor according to one embodiment.

[0034] FIG. 18 is a flowchart illustrating a method for controlling a fingerprint sensor according to one embodiment.

[0035] FIG. 19 is a diagram for explaining images including a pattern represented by flicker noise according to one embodiment.

[0036] FIG. 20 is a flowchart illustrating a method for controlling a fingerprint sensor according to one embodiment.

[0037] FIG. 21 is a diagram illustrating a method for controlling a fingerprint sensor according to one embodiment.

[0038] FIG. 22 is a drawing for explaining a method of controlling a fingerprint sensor according to one embodiment.

[0039] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings so that those skilled in the art can easily implement the present disclosure. However, the present disclosure may be implemented in various different forms and is not limited to the embodiments described herein. In connection with the description of the drawings, the same or similar reference numerals may be used for identical or similar components. Furthermore, in the drawings and related descriptions, descriptions of well-known functions and configurations may be omitted for clarity and conciseness.

[0040] FIG. 1 is a block diagram of an electronic device (101) within a network environment (100), according to one embodiment.

[0041] Referring to FIG. 1, in a network environment (100), an electronic device (101) may communicate with an electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with at least one of an electronic device (104) or a server (108) via a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display module (160), an audio module (170), a sensor module (176), an interface (177), a connection terminal (178), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197). In some embodiments, the electronic device (101) may omit at least one of these components (e.g., the connection terminal (178)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor module (176), the camera module (180), or the antenna module (197)) may be integrated into one component (e.g., the display module (160)).

[0042] The processor (120) may, for example, execute software (e.g., a program (140)) to control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) and perform various data processing or calculations. According to one embodiment, as at least a part of the data processing or calculations, the processor (120) may store commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the commands or data stored in the volatile memory (132), and store result data in a non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or a secondary processor (123) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor)) that can operate independently or together therewith. For example, if the electronic device (101) includes a main processor (121) and a secondary processor (123), the secondary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a specified function. The secondary processor (123) may be implemented separately from the main processor (121) or as a part thereof.

[0043] The auxiliary processor (123) may control at least a portion of functions or states associated with at least one component (e.g., a display module (160), a sensor module (176), or a communication module (190)) of the electronic device (101), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or can be performed through a separate server (e.g., server (108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.

[0044] The memory (130) can store various data used by at least one component (e.g., processor (120) or sensor module (176)) of the electronic device (101). The data can include, for example, software (e.g., program (140)) and input data or output data for commands related thereto. The memory (130) can include volatile memory (132) or non-volatile memory (134).

[0045] The program (140) may be stored as software in the memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

[0046] The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0047] The audio output module (155) can output audio signals to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. In one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.

[0048] The display module (160) can visually provide information to an external party (e.g., a user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. In one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.

[0049] The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150), output sound through the sound output module (155), or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (101).

[0050] The sensor module (176) can detect the operating status (e.g., power or temperature) of the electronic device (101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0051] The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) with an external electronic device (e.g., the electronic device (102)). In one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0052] The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0053] A haptic module (179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. In one embodiment, the haptic module (179) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

[0054] The camera module (180) can capture still images and videos. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0055] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented, for example, as at least a part of a power management integrated circuit (PMIC).

[0056] A battery (189) may power at least one component of the electronic device (101). In one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0057] The communication module (190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may operate independently from the processor (120) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module, or a power line communication module). Among these communication modules, the corresponding communication module can communicate with an external electronic device (104) via a first network (198) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules can be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can verify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) by using subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196).

[0058] The wireless communication module (192) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (192) can support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), an external electronic device (e.g., the electronic device (104)), or a network system (e.g., the second network (199)). According to one embodiment, the wireless communication module (192) can support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC realization.

[0059] The antenna module (197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna module (197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). In one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), may be selected from the plurality of antennas by, for example, the communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device through the selected at least one antenna. In some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (197).

[0060] According to various embodiments, the antenna module (197) may form a mmWave antenna module. According to one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high frequency band.

[0061] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).

[0062] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199). Each of the external electronic devices (102 or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices (102, 104, or 108). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (101) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server utilizing machine learning and / or a neural network. According to one embodiment, the external electronic device (104) or the server (108) may be included in the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0063] FIG. 2 is a block diagram of an electronic device (201) according to one embodiment.

[0064] Referring to FIG. 2, in one embodiment, the electronic device (201) may be the electronic device (101) of FIG. 1.

[0065] In one embodiment, the electronic device (201) may include a display (210), a fingerprint sensor (220), memory (230), and / or a processor (240).

[0066] In one embodiment, the display (210) may be included in the display module (160) of FIG. 1.

[0067] In one embodiment, the display (210) may include a display panel, a display driver integrated circuit (DDI) (also referred to as a “display driver”) for controlling the display panel, and a touch circuit. However, the present invention is not limited thereto, and the DDI and / or the touch circuit may be included in the electronic device (201) independently of the display (210).

[0068] In one embodiment, the display (210) (e.g., the display panel and the DDI) may include a display that operates based on a clock generated by an oscillator of the electronic device (201). For example, the display (210) may include a display that performs a refresh operation (e.g., an operation in which the display turns on and off periodically) based on a period obtained by integer multiples (also referred to as “multiplying”) of the period of the clock generated by the oscillator, such as an active matrix organic light emitting diode (AMOLED) display.

[0069] In one embodiment, the DDI may store, in memory (230), at least a portion of image data received from a main processor (e.g., the main processor (121) of FIG. 1) (e.g., an application processor) or an auxiliary processor (e.g., the auxiliary processor (123) of FIG. 1) (e.g., a graphics processing unit) that operates independently of the functions of the main processor. The DDI may display at least a portion of the image data through a display panel.

[0070] In one embodiment, the touch circuit may include a touch sensor and a touch sensor IC for controlling the touch sensor. The touch sensor IC may control the touch sensor to detect a touch input or a hovering input at a specific location on the display. For example, the touch sensor IC may detect a touch input or a hovering input by measuring a change in a signal (e.g., voltage, light intensity, resistance, or charge) at a specific location on the display. The touch sensor IC may provide information (e.g., location, area, pressure, or time) regarding the detected touch input or hovering input to the processor (240).

[0071] In one embodiment, the display (210) may display various information. For example, the display (210) may display an image related to a fingerprint (e.g., a fingerprint image indicating a location where a user's fingerprint can be input) (hereinafter, also referred to as a "fingerprint icon") at a location on the display (210) corresponding to a location where a fingerprint sensor (220) is positioned. For example, the display (210) may display information to guide the user in fingerprint registration while an operation for fingerprint registration is being performed. However, the information displayed by the display (210) is not limited to the examples described above.

[0072] In one embodiment, the display (210) may emit light configured to acquire fingerprint information. For example, during fingerprint authentication or fingerprint registration, among all pixels of the display (210), pixels arranged (or positioned) at a position (or area) corresponding to the position (or area) of the fingerprint sensor (220) within the display (210) may emit light having an intensity higher than a specified or predetermined intensity (e.g., light emitted at a predetermined intensity for sensing a user's fingerprint).

[0073] In one embodiment, a fingerprint sensor (220) (which may also be referred to as a “fingerprint recognition sensor”) may obtain information for obtaining an image (e.g., a fingerprint image) based on a touch input to the display (210).

[0074] In one embodiment, the fingerprint sensor (220) may acquire a user's fingerprint image using an optical method based on the difference in light reflected by ridges and valleys included in the fingerprint. However, the method by which the fingerprint sensor (220) acquires the fingerprint image is not limited to the examples described above.

[0075] In one embodiment, the fingerprint sensor (220) may acquire (e.g., generate) an image by acquiring light (e.g., light emitted from the display (210) and / or external light). Hereinafter, the fingerprint sensor (220) and examples of the operation of the fingerprint sensor (220) will be described in more detail with reference to FIGS. 3 and 4 .

[0076] FIG. 3 is a drawing for explaining the components included in a fingerprint sensor (220) according to one embodiment.

[0077] FIG. 4 is a drawing for explaining the operation of a fingerprint sensor (220) according to one embodiment.

[0078] Referring to FIGS. 3 and 4, in one embodiment, the fingerprint sensor (220) may include a complementary metal oxide semiconductor (CMOS)-based image sensor. However, the present invention is not limited thereto, and the fingerprint sensor (220) may include a charge-coupled device (CCD)-based image sensor.

[0079] In one embodiment, the fingerprint sensor (220) may include a light sensing area (310) (which may also be referred to as a “light response area” or a “light detection area”), an analog to digital converter (ADC) (320), and a controller (330) (which may also be referred to as a “control circuit”).

[0080] In one embodiment, the light sensing region (310) may include a plurality of pixels (e.g., a pixel array). The plurality of pixels included in the light sensing region (310) may each include photodiodes configured to perform an operation (also referred to as a “scan”) of converting acquired light into an electrical signal (e.g., a charge) through a photoelectric conversion operation. The light sensing region (310) may include a circuit (e.g., transistors) that can convert the electrical signal converted by the photodiodes into an analog signal (e.g., an electrical analog signal). In one embodiment, the light sensing region (310) may include an active area.

[0081] In one embodiment, the ADC (320) may convert the analog signal received from the light sensing region (310) into a digital signal (e.g., an electrical digital signal). The ADC (320) may provide (e.g., transmit) the digital signal to the controller (330).

[0082] In one embodiment, the digital signal output from the ADC (320) may include values ​​obtained from pixels of the fingerprint sensor (220) (e.g., values ​​obtained by the pixels of the fingerprint sensor (220) at their respective locations). Hereinafter, the digital signal output from the ADC (320) may be referred to as “pixel values ​​of the fingerprint sensor (220)” or “pixel values ​​of the pixels of the fingerprint sensor (220).”

[0083] In one embodiment, the controller (330) can control the light sensing region (310) (and ADC (320)).

[0084] In one embodiment, the controller (330) may store the digital signal received from the ADC (320) in the memory (230) (e.g., the memory included in the fingerprint sensor (220)). The controller (330) may transmit the digital signal to the processor (240).

[0085] In one embodiment, the controller (330) may be implemented as an application specific IC (ASIC) or a system on chip (SoC).

[0086] In one embodiment, the fingerprint sensor (220) may acquire pixel values ​​of the fingerprint sensor (220) using a rolling shutter method. For example, the fingerprint sensor (220) using the rolling shutter method may sequentially acquire pixel values ​​for each row of pixels included in the fingerprint sensor (220). Hereinafter, with reference to FIG. 4, an example of an operation of the fingerprint sensor (220) using the rolling shutter method to acquire pixel values ​​will be described.

[0087] In one embodiment, in FIG. 4, the X-axis may represent time (t) and the Y-axis may represent a row of pixels of the fingerprint sensor (220).

[0088] In one embodiment, in FIG. 4, reference numerals 410-1, 410-2, 410-3, and 410-n (where n represents the total number of rows of pixels included in the light sensing region (310)) may each represent operations in which each of the rows of pixels included in the light sensing region (310) converts light into an electrical signal. For example, reference numeral 410-1 may indicate an operation in which a first row of pixels (hereinafter, referred to as a “first row”) arranged first among the pixels included in the light sensing region (310) (e.g., at the top of the light sensing region (310)) converts light into an electrical signal, reference numeral 410-2 may indicate an operation in which a second row of pixels (e.g., a row immediately following the first row) (hereinafter, referred to as a “second row”) arranged second among the pixels included in the light sensing region (310) converts light into an electrical signal, and reference numeral 410-n may indicate an operation in which a row of pixels (hereinafter, referred to as an “nth row”) arranged last among the pixels included in the light sensing region (310) (e.g., at the bottom of the light sensing region (310)) converts light into an electrical signal.

[0089] In one embodiment, each of the pixels included in the light sensing region (310) converts the acquired light into an electrical signal when acquiring light, so the operation of each of the pixels included in the light sensing region (310) converting the light into an electrical signal may be referred to as the operation of each of the pixels included in the light sensing region (310) acquiring light.

[0090] In one embodiment, in a fingerprint sensor (220) (e.g., a fingerprint sensor using a rolling shutter method), each row of pixels in a light sensing area (310) can acquire light for the same amount of time. For example, as illustrated in FIG. 4, in a fingerprint sensor (220) using a rolling shutter method, each row of pixels in a light sensing area (310) can be exposed to light for the same amount of time (m1). Pixels included in the same row can acquire light simultaneously (e.g., for the same amount of time and the same amount of time). The time (e.g., m1) for each row of pixels in a light sensing area (310) to acquire light can be referred to as an “exposure time.”

[0091] In one embodiment, the fingerprint sensor (220) (e.g., a fingerprint sensor using a rolling shutter method) can sequentially perform a read out operation for each row of pixels in the light sensing area (310) (e.g., row by row for each row of pixels in the light sensing area (310). For example, the fingerprint sensor (220) can perform a first read out operation for a first row of pixels in the light sensing area (310) for a time (m2) based on light acquired during an exposure time (m1) in the first row of the pixels in the light sensing area (310). After performing the first read out operation for the first row for a time (m2), the fingerprint sensor (220) can sequentially perform a second read out operation for the second row of pixels in the light sensing area (310) for a time (m2) based on light acquired during an exposure time (m1) in the second row of the pixels in the light sensing area (310).

[0092] In one embodiment, the read-out operation for each row of pixels in the light sensing region (310) may include converting an electrical signal (e.g., an electrical signal output by each row of pixels in the light sensing region (310) by acquiring light) from each row of pixels in the light sensing region (310) into an analog signal, converting the analog signal into a digital signal, and storing the digital signal in a memory (e.g., a memory within the fingerprint sensor (220). The read-out operation may further include deleting pixel values ​​stored in the memory after the digital signal stored in the memory is transmitted to the processor (240). For example, a first read-out operation for a first row of the light sensing region (310) may include an operation of converting an electrical signal output by the first row of the light sensing region (310) by acquiring light into an analog signal, an operation of converting the analog signal into a digital signal, an operation of storing the digital signal in a memory of the fingerprint sensor (220), an operation of transmitting the digital signal to a processor (240), and an operation of deleting the digital signal stored in the memory of the fingerprint sensor (220).

[0093] In one embodiment, the time for performing a read-out operation (hereinafter, referred to as “read-out time” or “transfer time”) for each row of pixels in the light sensing region (310) may be substantially the same. For example, as illustrated in FIG. 4, the read-out time of the first row of pixels in the light sensing region (310) and the read-out time of the second row of pixels in the light sensing region (310) may both be time (m2). In one embodiment, the read-out operations for the rows of pixels in the light sensing region (310) may be performed continuously (e.g., without interruption). For example, immediately after the read-out operation for the first row of pixels in the light sensing region (310) is performed, the read-out operation for the second row of pixels in the light sensing region (310) may be performed.

[0094] In one embodiment, in rows of pixels in the light sensing region (310), the difference between when a row begins to acquire light and when the row immediately following it begins to acquire light may be the same. For example, as illustrated in FIG. 4, the difference between when a first row begins to acquire light and when a second row begins to acquire light, and the difference between when the second row begins to acquire light and when a third row begins to acquire light, may both be time (m3).

[0095] In one embodiment, in rows of pixels in the light sensing area (310), the time difference between when a row begins to acquire light and when the row immediately following it begins to acquire light may be equal to the readout time of the row. For example, as illustrated in FIG. 4, the time (m3) between when a first row begins to acquire light and when a second row begins to acquire light may be equal to the readout time (m2) of the first row.

[0096] In one embodiment, the fingerprint sensor (220) may be positioned under the display (210) (or within the display (210)). Hereinafter, with reference to FIG. 5, an example of the positioning of the fingerprint sensor (220) within the electronic device (201) will be described.

[0097] FIG. 5 is a drawing for explaining the arrangement of a fingerprint sensor (220) in an electronic device (201) according to one embodiment.

[0098] Referring to FIG. 5, in one embodiment, as shown in FIG. 5, the fingerprint sensor (220) may be positioned under the display (210) (e.g., the display panel (211)). However, the present invention is not limited thereto, and the fingerprint sensor (220) may also be positioned within the display (210).

[0099] In one embodiment, light emitted from the display panel (211) may be reflected (e.g., reflected by a user's fingerprint) and then received by a lens (222) through an opening (521). The fingerprint sensor (220) may obtain the light that is incident on the fingerprint sensor (220) after being received by the lens (222).

[0100] In one embodiment, in FIG. 5, the area (A) within the display panel (211) may represent an area of ​​pixels that are arranged at a position (or area) corresponding to the position (or area) of the fingerprint sensor (220) within the display panel (211), among all pixels of the display panel (211), when authenticating a fingerprint or registering a fingerprint, and that emit light with an intensity greater than a specified or predetermined intensity.

[0101] In one embodiment, the lens support (223) in FIG. 5 can support the lens (222).

[0102] In one embodiment, the fingerprint sensor (220) may be connected to a connector (512) that is electrically connected to a printed circuit board (513) via wiring (511).

[0103] In one embodiment, the memory (230) may be included in the memory (130) of FIG. 1.

[0104] In one embodiment, the memory (230) may store information for controlling the fingerprint sensor (220). Examples of information that the memory (230) stores for controlling the fingerprint sensor (220) will be described in more detail below.

[0105] In one embodiment, the processor (240) may be included in the processor (120) of FIG. 1.

[0106] In one embodiment, the processor (240) may control the overall operation of controlling the fingerprint sensor (220). In one embodiment, the processor (240) may include one or more processors for controlling the fingerprint sensor (220). For example, the processor (240) may correspond to multiple processors that collectively perform multiple operations by dividing them among the processors. Examples of operations by which the processor (240) controls the fingerprint sensor (220) will be described in detail below.

[0107] Although the electronic device (201) in FIG. 2 is illustrated as including a display (210), a fingerprint sensor (220), a memory (230), and a processor (240), the present invention is not limited thereto. For example, the electronic device (201) may further include at least one component (e.g., an inertial sensor configured to acquire movement of the electronic device (201), a temperature sensor configured to acquire temperature of the electronic device (201)) illustrated in FIG. 1.

[0108] FIG. 6 is a drawing for explaining a method of controlling a fingerprint sensor in a comparative example according to one embodiment.

[0109] Referring to FIG. 6, in one embodiment, the quality of an image (e.g., the quality of a fingerprint image acquired through the fingerprint sensor) obtained through a fingerprint sensor (e.g., a fingerprint sensor using a rolling shutter method) may be affected not only by the intensity of light emitted by the display, but also by the period at which the display emits light. For example, as illustrated by reference numeral 601 of FIG. 6, the display may be turned on / off periodically (e.g., turned on and off every period (a1)) based on a refresh rate of the display. If at least two rows of pixels of the fingerprint sensor perform read-out operations by acquiring light emitted from the display for different exposure times using the rolling shutter method, flicker noise may occur in the image acquired using the fingerprint sensor (220). Reference numeral 601 may represent an example where the initial on / off cycle of the display is approximately 4.16 ms (e.g., if the display has a refresh rate of 240 Hz) and the exposure time (ET) is approximately 16.64 ms, which is the integer "4" multiplied by the initial on / off cycle of the display.

[0110] In one embodiment, in a comparative example, the electronic device (201) can minimize flicker noise occurring in an image acquired using the fingerprint sensor by controlling the fingerprint sensor so that each pixel of the fingerprint sensor acquires light during an exposure time (ET) obtained by multiplying an integer number of a cycle in which the display is turned on / off (e.g., time (a1)). For example, in reference numeral 602 of FIG. 6, the X-axis may represent time and the Y-axis may represent the intensity of light (e.g., the intensity of light acquired by the fingerprint sensor). In reference numeral 602 of FIG. 6, a line (621) may represent, for example, the intensity of the light measured by acquiring the light emitted from the display over time. In reference numeral 602 of FIG. 6, arrows (611, 612, 613) may represent exposure times (e.g., the exposure time (ET) of reference numeral 601) during which three rows of the fingerprint sensor acquire light, respectively. As illustrated in reference numeral 602 of FIG. 6, when the exposure time is an integer multiple of the cycle of turning the display on / off (e.g., time (a1)), the number of time intervals during which the display is off in the exposure times indicated by the arrows (611, 612, 613) during which the three rows acquire light may be the same or exactly four. Accordingly, when the fingerprint sensor is controlled so that each pixel of the fingerprint sensor acquires light during the exposure time obtained by integer multiples of the cycle of turning the display on / off (e.g., time (a1)), flicker noise occurring in an image acquired using the fingerprint sensor can be minimized.

[0111] In one embodiment, the cycle at which the display actually turns on / off can be set using a clock generated by an oscillator of the electronic device (e.g., by multiplying the cycle of the clock generated by the oscillator by an integer). The clock generated by the oscillator (e.g., the cycle of the clock) can change depending on the external environment of the electronic device (e.g., the temperature of the electronic device, the brightness around the electronic device, the brightness of the display screen of the electronic device). For example, comparing the graphs of reference numerals 601 and 603 of FIG. 6, as the clock generated by the oscillator changes, the cycle at which the display actually turns on / off (e.g., the cycle at which the display actually turns on / off) can change from time (a1) to time (a2) that is shorter than time (a1). However, the present invention is not limited thereto, and as the clock generated by the oscillator changes, the cycle at which the display actually turns on / off can change from time (a1) to time that is longer than time (a1). Reference numeral 603 may indicate that the actual on / off cycle of the display is approximately 3.952 ms (if the display has a refresh rate of approximately 253 Hz), while the exposure time (ET) is approximately 16.64 ms, which is the integer "4" multiplied by the initial on / off cycle of the display (approximately 4.16 ms).

[0112] In one embodiment, in the comparative example, if the time for which each pixel of the fingerprint sensor is exposed to light is set or selected to be an integer multiple of the cycle for which the display is turned on / off and then the clock generated by the oscillator (e.g., the cycle of the clock) is changed, the time for which each pixel of the fingerprint sensor is exposed to light (e.g., the exposure time (ET) of reference numerals 601 and 603) may not be an integer multiple of the cycle for which the display is actually turned on / off (e.g., the time (a2)). For example, in reference numeral 604 of FIG. 6, the X-axis may represent time and the Y-axis may represent the intensity of light. In reference numeral 604 of FIG. 6, line (641) may represent, for example, the intensity of the light measured by obtaining the light emitted from the display over time. In reference numeral 604 of FIG. 6, arrows (614, 615, 616) may represent exposure times (e.g., exposure time ET of reference numeral 601) during which three rows of the fingerprint sensor acquire light, respectively. As illustrated in reference numeral 604 of FIG. 6, if the time during which each pixel of the fingerprint sensor is exposed to light (e.g., exposure times ET of reference numerals 601 and 603) is not an integer multiple of the actual on / off cycle of the display (e.g., time a2), the number of time intervals during which the display is off at the exposure times indicated by the arrows (614, 616) during which two rows acquire light may be four, whereas the number of time intervals during which the display is off at the exposure time (615) during which the remaining rows acquire light may be five. In such cases, patterns due to flicker noise may appear in the images acquired using the fingerprint sensor.

[0113] Referring to FIGS. 7 to 22 below, operations for minimizing flicker noise occurring in an image acquired through a fingerprint sensor even when a clock generated by an oscillator of an electronic device (201) is changed will be described in detail.

[0114] FIG. 7 is a flowchart (700) for explaining a method of controlling a fingerprint sensor (220) according to one embodiment.

[0115] In the following examples, each operation may be performed sequentially, but this is not a limitation. For example, the order of each operation may be changed, and at least two operations may be performed in parallel.

[0116] According to one embodiment, operations 701 to 709 may be understood to be performed in a processor (e.g., processor (240) of FIG. 2) of an electronic device (e.g., electronic device (201) of FIG. 2).

[0117] Referring to FIG. 7, in operation 701, in one embodiment, the processor (240) may detect the occurrence of an event for sensing a user's fingerprint.

[0118] In one embodiment, the processor (240) may display an image related to a fingerprint (e.g., a fingerprint image for guiding a location or area where a user's fingerprint can be input) (hereinafter, also referred to as a "fingerprint icon") at a location (or area) of the display (210) corresponding to a location (or area) where a fingerprint sensor (220) is placed, using the display (210).

[0119] In one embodiment, the processor (240) may detect an event for sensing a user's fingerprint by acquiring a touch input for an area including the fingerprint icon within the display (210). For example, the processor (240) may detect an event generated by a user's touch for an area including the fingerprint icon within the display (210). Hereinafter, an example of an operation for detecting an event for sensing a user's fingerprint will be described in more detail with reference to FIG. 8.

[0120] FIG. 8 is a diagram illustrating a method for detecting an event for sensing a user's fingerprint according to one embodiment.

[0121] Referring to FIG. 8, in one embodiment, the processor (240) may display a lock screen using the display (210) while the electronic device (201) is in a locked state. For example, the processor (240) may display a lock screen (810) including a fingerprint icon (811), an object (812) indicating that the electronic device (201) is in a locked state, and time information (813) through the display (210) while the electronic device (201) is in a locked state.

[0122] In one embodiment, the processor (240) may acquire a touch input for an area (814) including a fingerprint icon (811) within the display (210). By acquiring the touch input, the processor (240) may detect an event for sensing a user's fingerprint. In one embodiment, the touch input may include an input in which a touch is maintained on the display (210).

[0123] In one embodiment, the area (814) including the fingerprint icon (811) may be an area set to perform at least a part of an operation for fingerprint authentication when a touch input is obtained for at least a part of the area (814).

[0124] In the examples described above, the operation of acquiring a touch input for an area (814) including a fingerprint icon (811) while the electronic device (201) is in a locked state has been described, but is not limited thereto. For example, the processor (240) may display a screen including a fingerprint icon using the display (210) while an application requiring fingerprint authentication for performing a function (e.g., a payment application, a banking application, or an application for which fingerprint authentication is set for execution by a user) is being executed. The processor (240) may acquire a touch input for an area including a fingerprint icon while the screen including the fingerprint icon is displayed using the display (210). By acquiring the touch input, the processor (240) may detect an event for sensing a user's fingerprint.

[0125] In operation 703, in one embodiment, the processor (240) may, in response to detecting the occurrence of an event for sensing a user's fingerprint, acquire a first image using the fingerprint sensor (220) before the display (210) emits light at a predetermined intensity for sensing the fingerprint.

[0126] In one embodiment, the processor (240) may provide a signal (hereinafter, referred to as a “first signal”) to the display (210) to cause the display (210) to emit light configured to obtain fingerprint information based on a touch input to the display (210) (e.g., based on detecting a touch event that occurs when a user touches an area including a fingerprint icon). For example, the processor (240) may transmit the first signal to a display driver integrated circuit (DDI) to cause the display (210) (e.g., the display panel (211)) to emit light configured to obtain fingerprint information (e.g., a fingerprint image) based on the touch input to the display (210).

[0127] In one embodiment, the light set to acquire fingerprint information may be light having a predetermined intensity for sensing a fingerprint. For example, the light having a predetermined intensity for sensing a fingerprint may include light that causes the display (210) to display a white image at the maximum brightness of the display (210). For example, the light having a predetermined intensity for sensing a fingerprint may include light having an intensity greater than that of light for displaying a fingerprint icon.

[0128] In one embodiment, the light set to obtain fingerprint information may be light having an intensity greater than a specified or predetermined intensity.

[0129] In one embodiment, light set to obtain fingerprint information may be emitted by pixels (hereinafter, referred to as “first pixels of the display (210)”) arranged in a position (or area) corresponding to the position (or area) of the fingerprint sensor (220) among all pixels of the display (210).

[0130] In one embodiment, the DDI may perform an operation to cause the display (210) (e.g., the display panel (211)) to emit light set to acquire fingerprint information based on receiving a first signal from the processor (240). For example, the DDI may perform an operation to acquire information about the positions of first pixels of the display (210) and / or the intensity of light set to acquire fingerprint information (e.g., a predetermined intensity for sensing a fingerprint) from a memory upon receiving the first signal. After performing the operation to acquire information about the positions of the first pixels of the display (210) and / or the intensity of light set to acquire fingerprint information from the memory, the DDI may control the display (210) (e.g., the display panel (211)) to cause the first pixels of the display (210) to emit light having a predetermined intensity for sensing a fingerprint.

[0131] In one embodiment, after the display (210) receives the first signal from the processor (240), it may take a certain amount of time for the display (210) to emit light configured to acquire fingerprint information. For example, the DDI, based on receiving the first signal, may acquire information from memory about the positions of the first pixels of the display (210) and / or the intensity of light configured to acquire fingerprint information, and control the display panel (211) to emit the light based on the acquired information. For example, the display panel (211) may emit light having an intensity greater than a designated or predetermined intensity at a point in time after operation 707 is performed.

[0132] In one embodiment, the processor (240) may provide a signal (hereinafter, referred to as a “second signal”) to the fingerprint sensor (220) to acquire a first image using the fingerprint sensor (220) based on a touch input to the display (210) (e.g., in response to detecting the occurrence of a touch event that occurs when a user touches an area containing a fingerprint icon).

[0133] In one embodiment, the first image may be acquired based on pixel values ​​of the fingerprint sensor (220) acquired from the fingerprint sensor (220) (e.g., generated by the fingerprint sensor (220)) before the display (210) receives the first signal from the processor (240) and then emits light configured to acquire fingerprint information.

[0134] In one embodiment, the first image may be an image used to adjust (or determine whether to adjust or maintain) the exposure time (e.g., time m1 in FIG. 4) for each row of pixels in the light sensing area (310) to acquire light.

[0135] In one embodiment, the first image may not be used for fingerprint authentication. For example, the first image may not be used for fingerprint information acquisition. Hereinafter, an image acquired using a fingerprint sensor (220), such as the first image, that is not used for fingerprint authentication (e.g., an image acquired using the fingerprint sensor (220) and for which feature extraction is not performed) may also be referred to as a "dummy image."

[0136] In one embodiment, the second signal may include a command to activate the fingerprint sensor (220), a command to cause the fingerprint sensor (220) to acquire pixel values ​​of the fingerprint sensor (220) (e.g., pixel values ​​of the fingerprint sensor (220) acquired to acquire a first image), a command to cause the fingerprint sensor (220) to acquire pixel values ​​of the fingerprint sensor (220) (e.g., pixel values ​​of the fingerprint sensor (220) acquired to acquire a second image to be described later) after (or while) the display (210) emits light configured to acquire fingerprint information, and / or an exposure time stored in the memory (230).

[0137] In one embodiment, a command to activate the fingerprint sensor (220) may be or include a command to switch the light sensing region (310), the ADC (320), and the controller (330) included in the fingerprint sensor (220) from an inactive state (e.g., a sleep state) to an active state (e.g., a wake up state), and to supply power to the light sensing region (310) and the ADC (320).

[0138] In one embodiment, the command causing the fingerprint sensor (220) to obtain pixel values ​​of the fingerprint sensor (220) may be or include a command causing the activated fingerprint sensor (220) to obtain pixel values ​​of the fingerprint sensor (220) using a rolling shutter method to obtain a first image.

[0139] In one embodiment, the command to cause the fingerprint sensor (220) to obtain pixel values ​​of the fingerprint sensor (220) after the display (210) has emitted light set to obtain fingerprint information (or while emitting the light) may be a command to cause the fingerprint sensor (220) to obtain pixel values ​​of the fingerprint sensor (220) for obtaining a second image (e.g., a fingerprint image for obtaining fingerprint information) to be described later with reference to operation 707 after a specified or predetermined time (which may also be referred to as a “delay time”) from the time the second signal is received.

[0140] In one embodiment, as described above, after the display (210) receives the first signal from the processor (240), a predetermined amount of time may be required before the display (210) emits the light set to acquire fingerprint information. The designated or predetermined time (e.g., delay time) may be a time set for the fingerprint sensor (220) to receive the second signal from the processor (240) to acquire pixel values ​​of the fingerprint sensor (220) after or while the display (210) emits the light set to acquire fingerprint information.

[0141] In one embodiment, the exposure time stored in the memory (230) may be an exposure time (e.g., an exposure time for each row of pixels in the light sensing area (310) to acquire light) (e.g., may be referred to as “ET0”) obtained by multiplying an integer number of the on / off cycle (e.g., may be referred to as “T0”) of the display (210) corresponding to the refresh rate of the display (210) set upon a touch input to the display (210) (e.g., set for the current display (210)).

[0142] In one embodiment, the on / off cycle (T0) of the display (210) corresponding to the refresh rate of the display (210) may be calculated based on the refresh rate of the display (210), or may be calculated based on the refresh rate of the display (210) and then stored in the memory (230). For example, when the refresh rate of the display (210) set at 240 Hz is applied when a touch input is made to the display (210) (e.g., when a touch input is made to the area (814) including the fingerprint icon), the on / off cycle (T0) of the display (210) may be calculated to be approximately 4.16 ms. In one embodiment, the on / off cycle (T0) of the display (210) may also be referred to as an “initial on / off cycle of the display (210)” or an “on / off cycle set as a default of the display (210).”

[0143] In one embodiment, the exposure time (ET0) may be obtained by multiplying the on / off cycle (T0) of the display (210) by a specified or predetermined integer (n). For example, if the refresh rate of the display (210) is 240 Hz, the on / off cycle (T0) of the display (210) may be approximately 4.16 ms. If the specified or predetermined integer (n) is 4, the exposure time (ET0) may be approximately 16.64 ms.

[0144] In one embodiment, the specified or predetermined integer (n) may be determined at a level at which the fingerprint sensor (220) is not saturated (e.g., so that pixel values ​​of the fingerprint sensor (220) do not exceed a threshold value) in consideration of the light amount of the display (210) and / or the sensitivity of the fingerprint sensor (220) in a process step of the electronic device (201) (e.g., a process of assembling the electronic device (201). In one embodiment, the specified or predetermined integer (n) and the exposure time (ET0) may be determined (e.g., calculated) in the process step of the electronic device (201) and then stored in the memory (230).

[0145] Hereinafter, the exposure time (ET0) obtained by multiplying the initial on / off cycle of the display (210) and the specified or predetermined integer (n) may also be referred to as “the initial exposure time of the fingerprint sensor (220)” or “the exposure time set as the default of the fingerprint sensor (220).”

[0146] In one embodiment, the processor (240) may acquire a first image using the fingerprint sensor (220) before the display (210) emits light set to acquire fingerprint information (e.g., light emitted at a predetermined intensity to sense a user's fingerprint). For example, the processor (240) may acquire the first image based on pixel values ​​sequentially acquired row by row for pixels included in the fingerprint sensor (220) before the display (210) emits light set to acquire fingerprint information.

[0147] In one embodiment, the fingerprint sensor (220) may be activated based on a second signal received from the processor (240) (e.g., a command to activate the fingerprint sensor (220). The activated fingerprint sensor (220) may acquire pixel values ​​of the fingerprint sensor (220) using a rolling shutter method based on an initial exposure time (ET0) of the fingerprint sensor (220). For example, after the fingerprint sensor (220) is activated, rows of pixels included in the fingerprint sensor (220) may start to sequentially acquire light at designated or predetermined time intervals (e.g., the time (m3) interval in FIG. 4), and each row of pixels included in the fingerprint sensor (220) may acquire light during the initial exposure time (ET0) of the fingerprint sensor (220). The fingerprint sensor (220) can obtain pixel values ​​of the fingerprint sensor (220) by sequentially performing a read-out operation on rows of pixels included in the fingerprint sensor (220) (e.g., sequentially for rows of pixels included in the fingerprint sensor (220) for the time (m2) of FIG. 4 for each row of pixels included in the fingerprint sensor (220). In one embodiment, the fingerprint sensor (220) (e.g., the controller (330)) can transmit the obtained pixel values ​​of the fingerprint sensor (220) to the processor (240).

[0148] In one embodiment, the processor (240) may obtain a first image based on pixel values ​​of the fingerprint sensor (220) received from the fingerprint sensor (220). For example, the processor (240) may generate a first image (e.g., a dummy image) having pixel values ​​corresponding to the pixel values ​​of the fingerprint sensor (220).

[0149] In one embodiment, the processor (240) may generate the first image such that the number of pixels of the fingerprint sensor (220) is equal to the number of pixels of the first image (the pixels of the first image are also referred to as “pixels”) and the pixel values ​​of the first image correspond to the pixel values ​​of the fingerprint sensor (220). For example, when the number of pixels of the fingerprint sensor (220) is 200*200 (e.g., when the light sensing area (310) includes 200 pixels horizontally and 200 pixels vertically), the processor (240) may generate one image having a pixel count of 200*200, in which pixel values ​​at positions of pixels of the fingerprint sensor (220) correspond to pixel values ​​at positions of pixels in the first image that correspond to the positions, respectively.

[0150] In one embodiment, the processor (240) may generate the first image such that the number of pixels of the fingerprint sensor (220) is different from the number of pixels of the first image and the pixel values ​​of the first image correspond to the pixel values ​​of the fingerprint sensor (220). For example, when the number of pixels of the fingerprint sensor (220) is 200*200, the processor (240) may generate the first image having the number of pixels of 100*100 by performing a binning operation (e.g., an operation of grouping every 2*2 pixels for the pixels of 200*200 into one pixel). In this case, pixel values ​​at the locations of pixels of the fingerprint sensor (220) (e.g., coordinates (1, 1), coordinates (1, 2), coordinates (2, 1), and coordinates (2, 2) in the light sensing area (310)) and pixel values ​​at the corresponding locations of pixels in the first image (e.g., coordinates (1, 1) in the first image) may correspond to each other.

[0151] In one embodiment, the examples described above illustrate, but are not limited to, that a first image having pixel values ​​corresponding to the pixel values ​​of the fingerprint sensor (220) is generated based on the pixel values ​​of the fingerprint sensor (220) received from the fingerprint sensor (220). In one embodiment, the processor (240) may set the pixel values ​​of the fingerprint sensor (220) received from the fingerprint sensor (220) as the first image. For example, the data of the first image may include the pixel values ​​of the fingerprint sensor (220) received from the fingerprint sensor (220).

[0152] In operation 705, in one embodiment, the processor (240) may analyze at least one pattern corresponding to flicker noise within the first image.

[0153] In one embodiment, flicker noise may occur when the exposure time for each row of pixels of the fingerprint sensor (220) to acquire light (e.g., the initial exposure time (ET0) of the fingerprint sensor (220)) does not match the time obtained by multiplying the actual on / off cycle of the display (210) by an integer multiple (n).

[0154] In one embodiment, when flicker noise occurs in a first image, the first image (e.g., a dummy image) may include a pattern (hereinafter referred to as a “pattern”) in which a first portion (e.g., a relatively bright band) and a second portion (e.g., a relatively dark band) that is darker than the first portion alternately and repeatedly appear. In embodiments, the first portion may be referred to as a “first component generated by the flicker noise,” and the second portion may be referred to as a “second component generated by the flicker noise.” Hereinafter, an example of a pattern represented by the flicker noise in the first image will be described in more detail with reference to FIG. 9.

[0155] FIG. 9 is a drawing for explaining a pattern represented by flicker noise in a first image according to one embodiment.

[0156] Referring to FIG. 9, in one embodiment, the +X axis may correspond to the row direction of pixels of the first image (e.g., the direction in which pixels arranged in the same row are arranged), and the -Y axis may correspond to the column direction of pixels of the first image (e.g., the direction in which pixels arranged in the same column are arranged).

[0157] In one embodiment, as illustrated at reference numeral 901, if no flicker noise occurs, the pattern may not appear within the first image (910).

[0158] In one embodiment, as illustrated in reference numeral 902, when flicker noise occurs within the first image (920), the first portion and the second portion may alternately and repeatedly appear in the column direction of the pixels of the first image (920), such as first portions (931, 932) and second portions (921, 922). For example, the first portion and the second portion may alternately and repeatedly appear in the column direction of the pixels of the first image (920) within the first image (920). Each of the first portion and the second portion may be a band that appears in the row direction of the pixels of the first image (920) within the first image (920).

[0159] In one embodiment, the interval at which the first portion or the second portion repeatedly appears within the first image (which may also be referred to as a “pattern interval”) may be the same. For example, as illustrated in reference numeral 902, the heights of each of the first portions (931, 932) may be the same as h2, and the heights of the second portions (921, 922) may be the same as h1. The interval between the first portions (931, 932) within the first image (920) (e.g., the difference between the position where the first portion (931) starts and the position where the first portion (932) starts in the column direction of the first image (920)) may be the height of the sum of h1 and h2. The distance between the second portions (921, 922) within the first image (920) (e.g., the difference between the position where the second portion (921) starts and the position where the second portion (922) starts in the column direction of the first image (920)) may also be the height of the sum of h1 and h2.

[0160] In one embodiment, depending on the difference (hereinafter referred to as “offset of on / off cycle”) between the initial on / off cycle (T0) of the display (210) and the actual on / off cycle (e.g., the cycle at which the display (210) actually turns on / off) (which may also be referred to as “TO”) of the display (210), the pattern interval at which the first portion or the second portion repeatedly appears within the first image may be different. For example, in reference numeral 903, when flicker noise occurs within the first image (930), the first portion and the second portion may alternately and repeatedly appear in the column direction of the pixels of the first image (920), such as the first portions (951, 952) and the second portions (941, 942) within the first image (930). The pattern interval (e.g., the height obtained by summing the heights (h3) and (h4)) at which the first portion or the second portion repeatedly appears within the first image (930) may be the same. However, as shown by a comparison of the first image (920) and the first image (930), if the offset of the on / off cycle that occurred when the first image (920) was acquired is different from the offset of the on / off cycle that occurred when the first image (930) was acquired, the pattern interval of the first image (920) may be the height obtained by summing the heights (h1) and (h2), and the pattern interval of the first image (930) may be the height obtained by summing the heights (h3) and (h4), which is different from the height obtained by summing the heights (h1) and (h2).

[0161] In operation 707, in one embodiment, the processor (240) may adjust at least one exposure time of the fingerprint sensor (220) for sensing light emitted by the display (210) at the predetermined intensity and reflected by the fingerprint of the user based on the analysis (e.g., analyzing at least one pattern corresponding to flicker noise within the first image of operation 705).

[0162] In one embodiment, the light emitted by the display (210) at the predetermined intensity and reflected by the user's fingerprint may include light emitted by the display (210) at the predetermined intensity and then reflected by a fingerprint touching the display (210) to sense the user's fingerprint.

[0163] In one embodiment, the processor (240) may adjust an exposure time (e.g., an initial exposure time (ET0) of the fingerprint sensor (220)) for each row of pixels of the fingerprint sensor (220) to acquire light based on a pattern (at least one pattern corresponding to the flicker noise) exhibited by the flicker noise in the first image. For example, the processor (240) may determine an adjusted exposure time (which may be referred to as an "adjusted exposure time (ET1) of the fingerprint sensor (220)") for each row of pixels of the fingerprint sensor (220) to acquire light based on at least one pattern corresponding to the flicker noise occurring in the first image. Hereinafter, examples of an operation of adjusting the exposure time of the fingerprint sensor (220) based on analyzing at least one pattern corresponding to the flicker noise in the first image will be described with reference to FIGS. 10, 11A, and 11B.

[0164] FIG. 10 is a flowchart (1000) for explaining a method of adjusting exposure time according to one embodiment.

[0165] FIG. 11A is a diagram illustrating a method for adjusting exposure time according to one embodiment.

[0166] FIG. 11b is a drawing for explaining a method of adjusting exposure time according to one embodiment.

[0167] In the following examples, each operation may be performed sequentially, but this is not a limitation. For example, the order of each operation may be changed, and at least two operations may be performed in parallel.

[0168] According to one embodiment, operations 1001 to 1007 may be understood to be performed in a processor (e.g., processor (240) of FIG. 2) of an electronic device (e.g., electronic device (201) of FIG. 2).

[0169] In one embodiment, operations 1001 through 1005 may be included in operation 705 of FIG. 7, and operation 1007 may be included in operation 707 of FIG. 7, but is not limited thereto. For example, operations 1001 and 1003 may be included in operation 705 of FIG. 7, and operations 1005 and 1007 may be included in operation 707 of FIG. 7.

[0170] Referring to FIGS. 10, 11A, and 11B, in operation 1001, in one embodiment, the processor (240) may obtain average pixel values ​​corresponding to each row of pixels of the first image. For example, the processor (240) may calculate, for each row of pixels of the first image, an average value of pixel values ​​of pixels included in the row (which may also be referred to as an “average pixel value of the row”).

[0171] In operation 1003, in one embodiment, the processor (240) can identify an interval (e.g., a pattern interval) at which the first portion or the second portion repeatedly appears within the first image based on average pixel values ​​corresponding to each row of pixels of the acquired first image. Hereinafter, examples of an operation of identifying an interval at which the first portion or the second portion repeatedly appears within the first image will be described with reference to FIGS. 11A and 11B .

[0172] In one embodiment, in FIG. 11A, the X-axis may represent rows in the order in which the rows are arranged in pixels of the first image (e.g., from the topmost to the bottommost row in the first image), and the Y-axis may represent the average pixel value.

[0173] In one embodiment, line (1110) of the graph of reference numeral 1101 of FIG. 11A may represent average pixel values ​​of rows of pixels of the first image, row by row, when no flicker noise occurs within the first image. As with line (1110) of reference numeral 1101, when no flicker noise occurs within the first image, the average pixel values ​​of rows of pixels of the first image (e.g., Y-axis values ​​of line (1110)) may be substantially the same.

[0174] In one embodiment, reference numeral 1102 of FIG. 11A may represent an example where the offset of the on / off cycle is about +5% (e.g., when the actual on / off cycle of the display (210) is about 95% of the initial on / off cycle (T0) of the display (210). In the graph of reference numeral 1102, a line (1120) may represent average pixel values ​​of rows of pixels of the first image according to rows of pixels of the first image (e.g., according to the order in which the rows are arranged in the pixels of the first image), when flicker noise occurs within the first image. In line (1120), reference numeral 1121 may represent a maximum value of the average pixel values ​​within the first image, and reference numeral 1122 may represent a minimum value of the average pixel values ​​within the first image. Rows in the first image where the average pixel values ​​are maximum (e.g., rows in the X-axis corresponding to the maximum value (1121) of the average pixel values) may be included in the first part (e.g., the first part of the pattern generated by the flicker noise), and rows in the first image where the average pixel values ​​are minimum (e.g., rows in the X-axis corresponding to the minimum value (1122) of the average pixel values) may be included in the second part (e.g., the second part of the pattern generated by the flicker noise).

[0175] In one embodiment, reference numeral 1103 of FIG. 11A may represent an example where the offset of the on / off cycle is about +2.5% (e.g., when the actual on / off cycle of the display (210) is about 97.5% of the initial on / off cycle (T0) of the display (210). In the graph of reference numeral 1103, line (1130) may represent the average pixel values ​​of rows of pixels of the first image according to rows of pixels of the first image when flicker noise occurs within the first image.

[0176] In one embodiment, reference numeral 1104 of FIG. 11A may represent an example where the offset of the on / off cycle is about -5% (e.g., where the actual on / off cycle of the display (210) is about 105% of the initial on / off cycle (T0) of the display (210). In the graph of reference numeral 1104, line (1140) may represent the average pixel values ​​of rows of pixels of the first image according to rows of pixels of the first image when flicker noise occurs within the first image.

[0177] In one embodiment, reference numeral 1105 of FIG. 11A may represent an example where the offset of the on / off cycle is about -2.5% (e.g., when the actual on / off cycle of the display (210) is about 102.5% of the initial on / off cycle (T0) of the display (210). In the graph of reference numeral 1105, line (1150) may represent the average pixel values ​​of rows of pixels of the first image according to rows of pixels of the first image when flicker noise occurs within the first image.

[0178] In one embodiment, the processor (240) may determine a pattern interval at which the first portion or the second portion repeatedly appears based on average pixel values ​​of rows of pixels of the first image. For example, the processor (240) may determine the number of rows of the first image corresponding to a pattern interval at which the first portion or the second portion repeatedly appears as the pattern interval at which the first portion or the second portion repeatedly appears.

[0179] In one embodiment, as described above, within the first image, the pattern interval at which the first portion repeatedly appears and the pattern interval at which the second portion repeatedly appears may be the same. In one embodiment, the pattern interval may be the same as the number of rows in a section in which the average pixel values ​​of rows of pixels of the first image are repeated within each of the lines of the graphs of FIG. 11A (e.g., line 1120, line 1130, line 1140, line 1150). For example, in reference numeral 1102, the pattern interval may be the same as the number of rows of section (c1) (or the number of rows of section (d1)) among the sections in which the average pixel values ​​of rows of pixels of the first image are repeated. Section (c1) may include rows from row (x1) at which the average pixel values ​​of rows of pixels of the first image begin to increase to the row immediately preceding row (x2) at which the average pixel values ​​begin to increase again. The section (d1) may include rows from the row (x3) where the average pixel values ​​of the rows of pixels of the first image begin to decrease to the row immediately before the row (x4) where the average pixel values ​​begin to decrease again. For example, the pattern interval at reference numeral 1103 may be equal to the number of rows in the section (c2) where the average pixel values ​​of the rows of pixels of the first image are repeated. For example, the pattern interval at reference numeral 1104 may be equal to the number of rows in the section (c3) where the average pixel values ​​of the rows of pixels of the first image are repeated. For example, the pattern interval at reference numeral 1105 may be equal to the number of rows in the section (c4) where the average pixel values ​​of the rows of pixels of the first image are repeated.

[0180] In one embodiment, the processor (240) can determine a pattern interval in which the first portion or the second portion repeatedly appears within the first image by determining the number of rows in a section in which the average pixel values ​​of rows of pixels of the first image are repeated according to the rows of pixels of the first image (e.g., according to the order in which the rows are arranged in the pixels of the first image).

[0181] In one embodiment, the first image may include a portion corresponding to a fingerprint (e.g., a portion indicated by touching a fingerprint to the display (210)) and a portion corresponding to a fingerprint icon image (e.g., a portion indicated by the fingerprint icon image) in addition to the pattern indicated by the flicker noise. The portion corresponding to the fingerprint and the portion corresponding to the fingerprint icon image included in the first image may not affect the deviation (e.g., standard deviation) of the average pixel values ​​corresponding to each row of pixels of the first image. For example, in FIG. 11B , the first image (1160) may include first portions (e.g., the first portion (1170)) and second portions (e.g., the second portion (1180)) indicated by the flicker noise, and a portion (1190) corresponding to the fingerprint icon image. When calculating the average pixel values ​​for each row of pixels of the first image, the pixel values ​​by the portion (1190) corresponding to the fingerprint icon image reflected in each row may be substantially the same as the average pixel values ​​by each row of pixels of the first image. Accordingly, when checking the interval at which the first portion or the second portion repeatedly appears in the first image, the influence by the portion corresponding to the fingerprint icon image may be ignored.

[0182] In one embodiment, in FIG. 11B, the processor (240) can use the operations described above to determine a pattern interval (e.g., a height obtained by adding up heights e1 and e2) at which the first portion (1170) or the second portion (1180) is repeated within the first image (1160).

[0183] In operation 1005, in one embodiment, the processor (240) may determine the number of rows of pixels of the fingerprint sensor (220) corresponding to the interval (e.g., pattern interval) obtained through operation 1003 (e.g., the number of rows of pixels of the first image corresponding to the pattern interval) (which may be referred to as “the number of rows of pixels of the fingerprint sensor (220) corresponding to the pattern interval”).

[0184] In one embodiment, the processor (240) may determine the number of rows of pixels of the first image corresponding to the pattern interval as the number of rows of pixels of the fingerprint sensor (220) corresponding to the pattern interval, if the number of pixels of the fingerprint sensor (220) is the same as the number of pixels of the first image and the first image is generated such that pixel values ​​of the first image correspond to pixel values ​​of the fingerprint sensor (220). For example, if the number of pixels of the fingerprint sensor (220) is the same as the number of pixels of the first image and the first image is generated such that pixel values ​​of the first image correspond to pixel values ​​of the fingerprint sensor (220), the number of rows of pixels of the first image corresponding to the pattern interval may be the same as the number of rows of pixels of the fingerprint sensor (220) corresponding to the pattern interval.

[0185] In one embodiment, the processor (240) may determine the number of pixels of the fingerprint sensor (220) corresponding to the pattern interval based on the number of rows of each of the sections in which the average pixel values ​​of the rows of pixels of the first image are repeated within the first image and the number of rows of the fingerprint sensor (220) used for grouping the pixel values ​​of the fingerprint sensor (220) in the binning operation when the first image is generated by performing a binning operation on the pixel values ​​of the fingerprint sensor (220). For example, if the processor (240) obtains a first image of 100*100 by performing a binning operation that groups pixels of a 200*200 fingerprint sensor (220) into one pixel every 2*2 pixels, the processor (240) may determine the number of rows of pixels of the fingerprint sensor (220) corresponding to the pattern interval as the value obtained by multiplying the number of rows of each section in which the average pixel values ​​of rows of pixels of the first image are repeated by 2 (e.g., 2 as the number of rows in pixels of 2*2).

[0186] In one embodiment, when the processor (240) sets the pixel values ​​of the fingerprint sensor (220) received from the fingerprint sensor (220) as the first image (e.g., when the pixel values ​​of the fingerprint sensor (220) themselves are included in the data of the first image), the processor (240) can check the number of rows of pixels of the first image corresponding to the pattern interval as the number of rows of pixels of the fingerprint sensor (220) corresponding to the pattern interval.

[0187] In operation 1007, in one embodiment, the processor (240) may adjust the exposure time of the fingerprint sensor (220) based on the number of pixels of the fingerprint sensor (220) corresponding to the pattern interval, the transfer time, and a designated integer (n).

[0188] In one embodiment, the transfer time (e.g., read-out time) may be the time (e.g., time (m2) in FIG. 4) over which a read-out operation is performed for each row of pixels in the light sensing area (310). A designated or predetermined integer (n) may be a value used to obtain (e.g., calculate) the initial exposure time (ET0) of the fingerprint sensor (220) from the initial on / off cycle (T0) of the display (210).

[0189] In one embodiment, the product of the number of pixels of the fingerprint sensor (220) corresponding to the pattern interval and the transmission time may be substantially equal to the actual on / off period (T0') of the display (210). The processor (240) may determine the product of the number of pixels of the fingerprint sensor (220) corresponding to the pattern interval and the transmission time as the adjusted on / off period of the display (210) (which may also be referred to as the "adjusted on / off period (T0'') of the display (210)") for determining the adjusted exposure time of the fingerprint sensor (220).

[0190] In one embodiment, the processor (240) may determine the adjusted exposure time (ET1) of the fingerprint sensor (220) as the product of the number of pixels of the fingerprint sensor (220) corresponding to the pattern interval, the transmission time, and a specified integer (n) (e.g., number of pixels of the fingerprint sensor (220) * transmission time * specified integer (n)). For example, the processor (240) may adjust the exposure time of the fingerprint sensor (220) from the initial exposure time (ET0) to the determined exposure time (ET1).

[0191] Referring to FIG. 7, at operation 709, in one embodiment, the processor (240) may acquire a second image (which may be referred to as a “second image”) using the fingerprint sensor (220) by sensing light emitted by the display (210) at the predetermined intensity and reflected by the user’s fingerprint based on at least one adjusted exposure time.

[0192] In one embodiment, the processor (240) can obtain a second image used to obtain fingerprint information by controlling the fingerprint sensor (220) such that each row of pixels of the fingerprint sensor (220) acquires light for the adjusted exposure time while the display (210) emits the light.

[0193] In one embodiment, the operation of the processor (240) controlling the fingerprint sensor (220) such that each of the rows of pixels of the fingerprint sensor (220) acquires light during the adjusted exposure time may include, but is not limited to, the operation of the processor (240) providing the adjusted exposure time (ET1) (e.g., the adjusted exposure time (ET1) of the fingerprint sensor (220) determined in operation 1007) to the fingerprint sensor (220) (e.g., the controller (330)), but is not limited thereto. For example, the fingerprint sensor (220) may receive a second signal from the processor (240) that does not include a command causing the fingerprint sensor (220) to acquire pixel values ​​of the fingerprint sensor (220) while or after the display (210) emits the light set to acquire fingerprint information, as described with reference to operation 703. In such a case, the processor (240) may provide the adjusted exposure time (ET1) to the fingerprint sensor (220) (e.g., When provided as a controller (330), a command can be transmitted to the fingerprint sensor (220) to acquire pixel values ​​of the fingerprint sensor (220) based on the adjusted exposure time (ET1) while the display (210) emits light set to acquire fingerprint information or after emitting the light.

[0194] In one embodiment, the processor (240) may compare the adjusted exposure time (ET1) and the initial exposure time (ET0) of the fingerprint sensor (220). If the difference between the adjusted exposure time (ET1) and the initial exposure time (ET0) is greater than or equal to a specified or predetermined time, the processor (240) may transmit the adjusted exposure time (ET1) to the fingerprint sensor (220). If the difference between the adjusted exposure time (ET1) and the initial exposure time (ET0) is less than or equal to a specified or predetermined time, the processor (240) may transmit the initial exposure time (ET0) to the fingerprint sensor (220), or may not transmit the adjusted exposure time (ET1) and the initial exposure time (ET0) to the fingerprint sensor (220).

[0195] In one embodiment, the display (210) (e.g., DDI) may control the display (210) (e.g., display panel (211)) to emit light (e.g., light emitted at a predetermined intensity for sensing a fingerprint) set to obtain fingerprint information based on the first signal received in operation 703.

[0196] In one embodiment, while or after the display (210) emits the light (e.g., light set to acquire fingerprint information), the fingerprint sensor (220) may perform an operation of acquiring pixel values ​​of the fingerprint sensor (220) based on a second signal (e.g., a command for the fingerprint sensor (220) to acquire pixel values ​​of the fingerprint sensor (220) while or after the display (210) emits the light set to acquire fingerprint information, as described with reference to operation 703), based on an adjusted exposure time (ET1) after a designated or predetermined time (e.g., a delay time) from the time of receiving the second signal from the processor (240). For example, the fingerprint sensor (220) can sequentially acquire pixel values ​​of the fingerprint sensor (220) row by row for the rows of pixels of the fingerprint sensor (220) by having each pixel of the fingerprint sensor (220) acquire light (e.g., light including light set to acquire fingerprint information and external light) during the adjusted exposure time (ET1).

[0197] In one embodiment, the fingerprint sensor (220) may transmit the acquired pixel values ​​of the fingerprint sensor (220) to the processor (240). The processor (240) may acquire (e.g., generate) a second image based on the pixel values ​​of the fingerprint sensor (220) received from the fingerprint sensor (220).

[0198] In one embodiment, the processor (240) may perform a preprocessing operation to obtain (e.g., extract) fingerprint information (e.g., fingerprint feature points) from the second image after obtaining the second image. For example, the processor (240) may perform an operation of removing noise other than the fingerprint (e.g., noise caused by an external light source, noise caused by foreign substances present in the fingerprint sensor (220), pattern noise caused by the structure of the display (210)) through a pre-learned and stored filter, an operation of re-shaping and re-sizing the second image by taking into account the shading effect of a lens (e.g., lens (222)), and / or an operation of sharpening the second image.

[0199] In one embodiment, the processor (240) may perform an operation to extract feature points for the preprocessed second image. For example, the processor (240) may perform an operation to extract a direction component, a binarization operation, a smoothing operation, a thinning operation, and / or an operation to extract feature points (e.g., minutiae) for the preprocessed second image. The feature points may include a core point, a delta point, an ending point, and / or a bifurcation point that constitute a ridge of a fingerprint.

[0200] In one embodiment, the processor (240) may perform an operation (which may also be referred to as a “matching operation”) to determine whether authentication of a user succeeds or fails by comparing fingerprint information of a second image (e.g., a second image from which an operation of extracting feature points has been performed) with registered fingerprint information. For example, the processor (240) may compare feature points extracted from the second image with feature points of the registered fingerprint information (e.g., feature points included in fingerprint information stored in the memory (230) for fingerprint authentication). The processor (240) may calculate a degree of similarity (e.g., a similarity score) between the second image and the feature points of the registered fingerprint information by comparing them. The processor (240) may determine that authentication of the user succeeds or fails when the degree of similarity is equal to or greater than a threshold similarity. The processor (240) may determine that authentication for the user has failed if the similarity level is less than the threshold similarity level.

[0201] In one embodiment, the processor (240) may control the display (210) to not perform an operation of emitting light (e.g., light having an intensity greater than or equal to a specified or predetermined intensity) set to acquire fingerprint information based on a release of a touch input to the display (210) (e.g., in response to a release of a touch input to an area including a fingerprint icon), or to stop the display (210) from emitting light having an intensity greater than or equal to the specified or predetermined intensity.

[0202] In one embodiment, the processor (240) may not store the adjusted exposure time (ET1) in the memory (230) after performing an operation for fingerprint authentication based on the adjusted exposure time (ET1). For example, the processor (240) may store the determined adjusted exposure time (ET1) in the memory (230) after the adjusted exposure time (ET1) is determined. The processor (240) may delete the adjusted exposure time (ET1) from the memory (230) after performing an operation for fingerprint authentication based on the adjusted exposure time (ET1). However, the present invention is not limited thereto. For example, the processor (240) may not delete the adjusted exposure time (ET1) stored in the memory (230) even after performing an operation for fingerprint authentication based on the adjusted exposure time (ET1).

[0203] FIG. 12 is a drawing for explaining a method of controlling a fingerprint sensor (220) according to one embodiment.

[0204] Referring to FIG. 12, in one embodiment, reference numeral 1201 in FIG. 12 may represent the operation of a display (210) (e.g., display panel (211)), reference numeral 1202 may represent the operation of a system (e.g., processor, DDI), and reference numeral 1203 may represent the operation of a fingerprint sensor (220). In one embodiment, arrows (1220) in FIG. 12 may represent time (e.g., the passage of time).

[0205] In one embodiment, at reference numeral 1211, the display (210) may display a fingerprint icon. As illustrated in reference numerals 1211, 1211-1, and 1221, the fingerprint icon may be continuously displayed until light configured to acquire fingerprint information is emitted. The intensity of light emitted from the display (210) to display the fingerprint icon may be less than the intensity of light configured to acquire fingerprint information.

[0206] In one embodiment, at reference numerals 1211 and 1212, the processor (240) may detect an event (e.g., a Touch event) for sensing a user's fingerprint based on a touch input by the user's finger (1231) to the display (210) while a fingerprint icon is displayed using the display (210).

[0207] In one embodiment, the processor (240) may provide a first signal to the DDI (reference numeral 1213) and a second signal to the fingerprint sensor (220) (reference numeral 1214) based on detecting the event.

[0208] In one embodiment, the fingerprint sensor (220) may be activated (reference numeral 1216) (“Sensor Enable”) based on receiving a second signal.

[0209] In one embodiment, at reference numeral 1217, the operation of the fingerprint sensor (220) acquiring the second image may be delayed for a specified or predetermined time (e.g., a delay time) from the time the fingerprint sensor (220) receives a command included in the second signal (e.g., a command to cause the fingerprint sensor (220) to acquire pixel values ​​of the fingerprint sensor (220) after the display (210) emits light set to acquire fingerprint information).

[0210] In one embodiment, at reference numeral 1218, the fingerprint sensor (220) may acquire a first image (dummy image) (Dummy Capture).

[0211] In one embodiment, at reference numeral 1219, the processor (240) may adjust at least one exposure time (ET) of the fingerprint sensor (220) based on analyzing at least one pattern corresponding to flicker noise within the first image. For example, the processor may adjust at least one exposure time (ET) of the fingerprint sensor (220) from an initial exposure time (ET0) to an exposure time (ET1) based on the pattern analysis.

[0212] In one embodiment, at reference numeral 1215, the DDI may control the display (210) to emit light configured to acquire fingerprint information based on receiving the first signal. For example, at reference numeral 1221, the display (210) may emit light configured to acquire fingerprint information (e.g., light with a predetermined intensity for sensing a fingerprint) under the control of the DDI. For example, the display (210) may emit light to display a white image at the maximum brightness of the display (210).

[0213] In one embodiment, at reference numeral 1223, the fingerprint sensor (220) can acquire a second image (Image Capture) after the display (210) emits light set to acquire fingerprint information (e.g., light at a predetermined intensity for sensing a fingerprint).

[0214] In one embodiment, at reference numeral 1224, the processor (240) may perform a preprocessing operation (IPP (image preprocessing)) to obtain (e.g., extract) fingerprint information (e.g., fingerprint feature points) from the second image after receiving the second image from the fingerprint sensor (220). At reference numeral 1225, the processor (240) may perform a matching operation (Match) to determine whether authentication for the user is successful or failed by comparing the fingerprint information extracted from the second image with registered fingerprint information.

[0215] In one embodiment, at reference numeral 1226, when a touch input by a user's finger (1231) to the display (210) is released, the display (210) may be turned off.

[0216] FIG. 13 is a flowchart (1300) for explaining a method of controlling a fingerprint sensor (220) according to one embodiment.

[0217] In the embodiments described below, each operation may be performed sequentially, but this is not a limitation. For example, the order of each operation may be changed, and at least two operations may be performed in parallel.

[0218] According to one embodiment, operations 1301 to 1311 may be understood to be performed in a processor (e.g., processor (240) of FIG. 2) of an electronic device (e.g., electronic device (201) of FIG. 2).

[0219] In one embodiment, although the examples described above have described determining an adjusted exposure time (ET1) based on a dummy image (e.g., a first image) and performing an operation for fingerprint authentication (e.g., a fingerprint authentication operation based on a second image) based on the adjusted exposure time (ET1), the present invention is not limited thereto. For example, the processor (240) may perform an operation for determining the adjusted exposure time (ET1) while performing a fingerprint authentication operation (or together with the fingerprint authentication operation). Hereinafter, an example of an operation for determining the adjusted exposure time (ET1) while performing a fingerprint authentication operation will be described with reference to FIG. 13.

[0220] Referring to FIG. 13, in operation 1301, the processor (240) can detect the occurrence of an event for sensing a user's fingerprint.

[0221] In one embodiment, the processor (240) may acquire a touch input to the display (210). In one embodiment, the processor (240) may detect the occurrence of an event for sensing a user's fingerprint based on acquiring a touch input to the display (210).

[0222] In one embodiment, the processor (240) may display a fingerprint icon at a location (or area) of the display (210) corresponding to a location (or area) where the fingerprint sensor (220) is positioned, using the display (210). The processor (240) may detect the occurrence of an event for sensing a user's fingerprint by acquiring (e.g., receiving) a touch input for an area within the display (210) that includes the fingerprint icon.

[0223] In operation 1303, in one embodiment, the processor (240) may, in response to detecting the occurrence of an event for sensing a user's fingerprint, acquire a first image using the fingerprint sensor (220).

[0224] In one embodiment, the processor (240) may provide a first signal to the display (210) to cause the display (210) to emit light set to obtain fingerprint information based on a touch input to the display (210), and may provide a third signal (which may be referred to as a “third signal”) to the fingerprint sensor (220) to obtain an image (which may be referred to as a “first fingerprint image”) to be used to obtain fingerprint information using the fingerprint sensor (220).

[0225] In one embodiment, an operation of providing a first signal to the display (210) to cause the display (210) to emit light (e.g., light emitted at a predetermined intensity for sensing a fingerprint) set to obtain fingerprint information based on a touch input to the display (210) has been described with reference to operation 703 of FIG. 7, and therefore, a redundant description thereof will be omitted.

[0226] In one embodiment, the third signal may include a command to activate the fingerprint sensor (220), a command to cause the fingerprint sensor (220) to acquire pixel values ​​of the fingerprint sensor (220) after (or while) the display (210) emits light configured to acquire fingerprint information, and / or an exposure time stored in the memory (230) (e.g., an initial exposure time (ET0) of the fingerprint sensor (220).

[0227] In one embodiment, the processor (240) may acquire a first fingerprint image through the fingerprint sensor (220) after (or while) the display (210) emits light set to acquire fingerprint information.

[0228] In one embodiment, the fingerprint sensor (220) may acquire pixel values ​​of the fingerprint sensor (220) after the display (210) emits light set to acquire fingerprint information based on a third signal received from the processor (240). For example, the fingerprint sensor (220) may acquire pixel values ​​of the fingerprint sensor (220) using a rolling shutter method after the display (210) emits light set to acquire fingerprint information based on a third signal received from the processor (240). The fingerprint sensor (220) may transmit the acquired pixel values ​​of the fingerprint sensor (220) to the processor (240).

[0229] In one embodiment, the processor (240) may obtain a first fingerprint image based on pixel values ​​of the fingerprint sensor (220) received from the fingerprint sensor (220).

[0230] In operation 1305, in one embodiment, the processor (240) may adjust the exposure time of the fingerprint sensor (220) based on the first fingerprint image.

[0231] In one embodiment, the processor (240) may analyze at least one pattern corresponding to flicker noise within the first fingerprint image. Based on the analysis, the processor (240) may adjust at least one exposure time of the fingerprint sensor (220) for sensing light emitted by the display (210) at the predetermined intensity and reflected by the user's fingerprint.

[0232] In one embodiment, the processor (240) may determine an adjusted on / off cycle (T0'') and / or an adjusted exposure time (ET1) of the display (210) based on the first fingerprint image.

[0233] In one embodiment, the operation of the processor (240) determining the adjusted on / off cycle (T0'') and the adjusted exposure time (ET1) of the display (210) based on the first fingerprint image is at least partially the same as or similar to the operation of determining the adjusted on / off cycle (T0'') and the adjusted exposure time (ET1) of the display (210) based on the first image (e.g., a dummy image) described through FIG. 10, and therefore, a redundant description thereof will be omitted.

[0234] In one embodiment, the processor (240) may transmit the adjusted exposure time (ET1) to the fingerprint sensor (220) based on the adjusted exposure time (ET1) being determined based on the first fingerprint image. For example, the processor (240) may compare the initial on / off cycle (T0) of the display (210) and the adjusted on / off cycle (T0'') of the display (210). The processor (240) may transmit the adjusted exposure time (ET1) to the fingerprint sensor (220) based on the initial on / off cycle (T0) of the display (210) and the adjusted on / off cycle (T0'') of the display (210) being not the same. For example, the processor (240) may compare the initial exposure time (ET0) of the fingerprint sensor (220) and the adjusted exposure time (ET1). The processor (240) may transmit the adjusted exposure time (ET1) to the fingerprint sensor (220) based on the fact that the initial exposure time (ET0) of the fingerprint sensor (220) and the adjusted exposure time (ET1) are not the same.

[0235] In one embodiment, when the initial on / off cycle (T0) of the display (210) and the adjusted on / off cycle (T0'') of the display (210) are the same, the initial exposure time (ET0) and the adjusted exposure time (ET1) of the fingerprint sensor (220) may also be the same. In this case, the processor (240) may not transmit the adjusted exposure time (ET1) that is the same as the initial exposure time (ET0) of the fingerprint sensor (220) to the fingerprint sensor (220), or may transmit information indicating that the initial exposure time (ET0) and the adjusted exposure time (ET1) of the fingerprint sensor (220) are the same (or the initial on / off cycle (T0) of the display (210) and the adjusted on / off cycle (T0'') of the display (210) are the same) to the fingerprint sensor (220).

[0236] In operation 1307, in one embodiment, the processor (240) may perform fingerprint authentication based on the first fingerprint image.

[0237] In one embodiment, the processor (240) may perform an operation for extracting feature points from the first fingerprint image on which the preprocessing operation has been performed after performing the aforementioned preprocessing operation on the first fingerprint image. The processor (240) may determine whether fingerprint authentication is successful or unsuccessful by comparing the first fingerprint image (e.g., the first fingerprint image on which the feature point extraction operation has been performed) with registered fingerprint information.

[0238] In one embodiment, at least a portion of operation 1305 and at least a portion of operation 1307 may be performed in parallel or concurrently.

[0239] In one embodiment, the processor (240) may perform an operation according to the success of the fingerprint authentication when the initial on / off cycle (T0) of the display (210) and the adjusted on / off cycle (T0'') of the display (210) are the same and the fingerprint authentication based on the first fingerprint image is successful, and may not perform operations 1309 and 1311 described below.

[0240] In operation 1309, in one embodiment, the processor (240) may acquire a second fingerprint image (e.g., a fingerprint image acquired subsequent to the first fingerprint image) using the fingerprint sensor (220) while the display (210) is emitting light configured to acquire fingerprint information.

[0241] In one embodiment, the fingerprint sensor (220) may receive an adjusted exposure time (ET1) from the processor (240). For example, the fingerprint sensor (220) may receive the adjusted exposure time (ET1) obtained based on the adjusted on / off cycle (T0'') of the display (210) from the processor (240) based on the initial on / off cycle (T0) of the display (210) and the adjusted on / off cycle (T0'') of the display (210) being not the same.

[0242] In one embodiment, the fingerprint sensor (220) may acquire pixel values ​​of the fingerprint sensor (220) using a rolling shutter method based on the adjusted exposure time (ET1) while the display (210) emits light set to acquire fingerprint information. The fingerprint sensor (220) may transmit the acquired pixel values ​​of the fingerprint sensor (220) to the processor (240).

[0243] In one embodiment, the processor (240) may obtain a second fingerprint image based on pixel values ​​of the fingerprint sensor (220) received from the fingerprint sensor (220).

[0244] In one embodiment, if the initial on / off cycle (T0) of the display (210) and the adjusted on / off cycle (T0'') of the display (210) are the same, but the fingerprint authentication fails in operation 1307, the processor (240) may acquire pixel values ​​of the fingerprint sensor (220) using a rolling shutter method based on the initial exposure time (ET0). The fingerprint sensor (220) may transmit the acquired pixel values ​​of the fingerprint sensor (220) to the processor (240). The processor (240) may acquire a second fingerprint image based on the pixel values ​​of the fingerprint sensor (220) received from the fingerprint sensor (220).

[0245] In operation 1309, in one embodiment, the processor (240) may perform fingerprint authentication based on the second fingerprint image.

[0246] The operation of performing fingerprint authentication based on the second fingerprint image of operation 1309 is at least partially identical or similar to the operation of performing fingerprint authentication based on the first fingerprint image of operation 1307, so a detailed description thereof will be omitted.

[0247] FIG. 14 is a flowchart (1400) for explaining a method of controlling a fingerprint sensor (220) according to one embodiment.

[0248] FIG. 15 is a drawing for explaining a method of controlling a fingerprint sensor (220) according to one embodiment.

[0249] In the embodiments described below, each operation may be performed sequentially, but this is not a limitation. For example, the order of each operation may be changed, and at least two operations may be performed in parallel.

[0250] According to one embodiment, operations 1401 to 1409 may be understood to be performed in a processor (e.g., processor (240) of FIG. 2) of an electronic device (e.g., electronic device (201) of FIG. 2).

[0251] In one embodiment, FIGS. 14 and 15 may be drawings for explaining an operation of determining an adjusted exposure time (ET1) while registering a fingerprint.

[0252] In operation 1401, in one embodiment, the processor (240) may detect the occurrence of an event for sensing a user's fingerprint.

[0253] In one embodiment, the processor (240) may acquire a touch input to the display (210). Based on acquiring the touch input to the display (210), the processor (240) may detect the occurrence of an event for sensing a user's fingerprint.

[0254] In one embodiment, in FIG. 15, the processor (240) may display a screen for fingerprint registration using the display (210). For example, the processor (240) may, based on an input for setting (e.g., registering) a fingerprint, display a screen (1510) including an image (1523) and information (1524) for guiding fingerprint registration, together with a fingerprint icon (1511) displayed at a location of the display (210) corresponding to a location where a fingerprint sensor (220) is placed, through the display (210).

[0255] In one embodiment, the processor (240) may acquire a touch input using a touch sensor when a user touches an area (1512) including a fingerprint icon (1511) for fingerprint input using a finger. When acquiring the touch input, the processor (240) may perform operations for fingerprint registration (e.g., operations 1403 to 1411).

[0256] In operation 1403, in one embodiment, the processor (240) may acquire a dummy image using the fingerprint sensor (220) based on detecting the occurrence of an event for sensing a user's fingerprint.

[0257] In one embodiment, the processor (240) may provide a first signal to the display (210) to cause the display (210) to emit light set to obtain fingerprint information based on a touch input to the display (210) (e.g., an event for sensing a user's fingerprint), and may provide a fourth signal (which may be referred to as a "fourth signal") to the fingerprint sensor (220) to obtain an image (which may be referred to as a "dummy image") through the fingerprint sensor (220).

[0258] In one embodiment, the operation of providing a first signal to the display (210) to cause the display (210) to emit light set to obtain fingerprint information based on a touch input to the display (210) has been described with reference to operation 703 of FIG. 7, so a redundant description will be omitted.

[0259] In one embodiment, the fourth signal may include a command to activate the fingerprint sensor (220), a command to cause the fingerprint sensor (220) to acquire pixel values ​​of the fingerprint sensor (220) after (or while) the display (210) emits light configured to acquire fingerprint information, and / or an exposure time stored in the memory (230) (e.g., an initial exposure time (ET0) of the fingerprint sensor (220).

[0260] In one embodiment, the processor (240) may acquire a dummy image using the fingerprint sensor (220) after (or while) the display (210) emits light set to acquire fingerprint information.

[0261] In one embodiment, the fingerprint sensor (220) may acquire pixel values ​​of the fingerprint sensor (220) after the display (210) emits light set to acquire fingerprint information based on the fourth signal received from the processor (240). For example, the fingerprint sensor (220) may acquire pixel values ​​of the fingerprint sensor (220) using a rolling shutter method after the display (210) emits light set to acquire fingerprint information based on the fourth signal received from the processor (240). The fingerprint sensor (220) may transmit the acquired pixel values ​​of the fingerprint sensor (220) to the processor (240).

[0262] In one embodiment, the processor (240) may obtain a dummy fingerprint image based on pixel values ​​of the fingerprint sensor (220) received from the fingerprint sensor (220).

[0263] In operation 1405, in one embodiment, the processor (240) may adjust the exposure time of the fingerprint sensor (220) based on the dummy image.

[0264] Since operation 1405 is at least partially identical or similar to operation 1305 of FIG. 13, any overlapping description will be omitted.

[0265] In operation 1407, in one embodiment, the processor (240) may use the fingerprint sensor (220) to acquire a fingerprint image (e.g., an image acquired subsequent to the dummy image and used to acquire fingerprint information) while the display (210) is emitting light configured to acquire fingerprint information.

[0266] Since operation 1407 is at least partially identical or similar to operation 1309 of FIG. 13, any overlapping description will be omitted.

[0267] In one embodiment, the processor (240) may acquire a plurality of second fingerprint images for fingerprint registration. For example, the processor (240) may acquire a plurality of fingerprint images, ranging from about 5 to about 15, for fingerprint registration, but is not limited thereto.

[0268] In operation 1409, in one embodiment, the processor (240) may perform fingerprint registration based on the fingerprint image. For example, the processor (240) may perform a preprocessing operation and / or an operation to extract feature points on the fingerprint image. The processor (240) may register the extracted feature points and / or the fingerprint image as the user's fingerprint information.

[0269] FIG. 16 is a flowchart (1600) for explaining a method of controlling a fingerprint sensor (220) according to one embodiment.

[0270] FIG. 17 is a drawing for explaining a method of controlling a fingerprint sensor (220) according to one embodiment.

[0271] In the embodiments described below, each operation may be performed sequentially, but this is not a limitation. For example, the order of each operation may be changed, and at least two operations may be performed in parallel.

[0272] According to one embodiment, operations 1601 to 1605 may be understood to be performed in a processor (e.g., processor (240) of FIG. 2) of an electronic device (e.g., electronic device (201) of FIG. 2).

[0273] In one embodiment, although the above-described examples describe an operation of determining an adjusted exposure time (ET1) based on acquiring a touch input to the display (210), the electronic device (201) may perform an operation of determining an adjusted exposure time (ET1) based on a specified or predetermined condition (e.g., a condition in which a specified or predetermined event occurs).

[0274] Referring to FIGS. 16 and 17, in operation 1601, in one embodiment, the processor (240) may display a fingerprint icon using the display (210).

[0275] In one embodiment, the processor (240) may display a fingerprint icon using the display (210) based on the display (210) of the electronic device (201) being turned on while the electronic device (201) is in a locked state.

[0276] In one embodiment, the processor (240) may display a fingerprint icon using the display (210) to perform a payment function while the payment application is running. For example, as illustrated in FIG. 17, the processor (240) may display a screen (1710) including a fingerprint icon (1711), information (1712) guiding a user to input a fingerprint for fingerprint authentication, and information (1713) guiding a user to place a finger on an area including the fingerprint icon (1711).

[0277] In operation 1603, in one embodiment, the processor (240) may obtain a dummy image based on a fingerprint icon being displayed using the display (210).

[0278] In one embodiment, the processor (240) may provide a fifth signal (which may be referred to as a “fifth signal”) to the fingerprint sensor (220) to obtain a dummy image based on the fingerprint icon being displayed using the display (210).

[0279] In one embodiment, the processor (240) may provide a fifth signal to the fingerprint sensor (220) based on a fingerprint icon being displayed using the display (210) for an area containing the icon, independent of a touch input to the fingerprint sensing area within the display (210) (e.g., before a touch input to the fingerprint sensing area within the display (210) is acquired).

[0280] In one embodiment, the fifth signal may include a command to activate the fingerprint sensor (220), a command to cause the fingerprint sensor (220) to acquire pixel values ​​of the fingerprint sensor (220) (e.g., pixel values ​​of the fingerprint sensor (220) acquired to acquire a dummy image), and / or a designated or predetermined exposure time.

[0281] In one embodiment, a command to activate the fingerprint sensor (220) may be or include a command to switch the light sensing region (310), the ADC (320), and the controller (330) included in the fingerprint sensor (220) from an inactive state (e.g., a sleep state) to an active state (e.g., a wake up state), and to supply power to the light sensing region (310) and the ADC (320).

[0282] In one embodiment, the command causing the fingerprint sensor (220) to obtain pixel values ​​of the fingerprint sensor (220) may be or include a command causing the activated fingerprint sensor (220) to obtain pixel values ​​of the fingerprint sensor (220) based on a rolling shutter method to obtain a dummy image.

[0283] In one embodiment, the specified or predetermined exposure time included in the fifth signal may be a time obtained by multiplying the initial exposure time (ET0) of the fingerprint sensor (220) by a predetermined integer (e.g., about 10). For example, when acquiring a dummy image while a fingerprint icon is displayed, it may be necessary to increase the exposure time for the fingerprint sensor (220) to acquire light so that the fingerprint sensor (220) can acquire a sufficient amount of light. Accordingly, the processor (240) may provide the fifth signal, which includes the exposure time calculated by multiplying the initial exposure time (ET0) of the fingerprint sensor (220) by a predetermined integer (e.g., about 10), to the fingerprint sensor (220). However, the present invention is not limited thereto. For example, the processor (240) may also provide the fifth signal, which includes the initial exposure time (ET0) of the fingerprint sensor (220), to the fingerprint sensor (220).

[0284] In one embodiment, the processor (240) may obtain a dummy image.

[0285] In one embodiment, the fingerprint sensor (220) may acquire pixel values ​​of the fingerprint sensor (220) using a rolling shutter method based on a fifth signal received from the processor (240). For example, the fingerprint sensor (220) may be activated based on the fifth signal. After being activated, the fingerprint sensor (220) may acquire pixel values ​​of the fingerprint sensor (220) using a rolling shutter method based on an exposure time calculated by multiplying an initial exposure time (ET0) of the fingerprint sensor (220) by a predetermined integer (e.g., about 10). The fingerprint sensor (220) may transmit the acquired pixel values ​​of the fingerprint sensor (220) to the processor (240).

[0286] In one embodiment, the processor (240) may generate a dummy image based on pixel values ​​obtained from the fingerprint sensor (220).

[0287] In operation 1605, in one embodiment, the processor (240) may adjust the exposure time of the fingerprint sensor (220) based on the dummy image. The operation of determining the adjusted exposure time (ET1) based on the dummy image in operation 1605 may be at least partially the same as or similar to the operation of determining the adjusted exposure time (ET1) through the operations of FIG. 10. For example, the processor (240) may obtain average pixel values ​​of rows of pixels of the dummy image. The processor (240) may determine, based on the average pixel values ​​of rows of pixels of the obtained dummy image, an interval (e.g., a pattern interval) at which the first portion or the second portion repeatedly appears within the dummy image. The processor (240) may determine the number of pixels of the fingerprint sensor (220) corresponding to the obtained interval (e.g., the pattern interval) (e.g., the number of rows of each section at which the average pixel values ​​of rows of pixels of the dummy image are repeated within the dummy image). The processor (240) can determine the adjusted exposure time (ET1) of the fingerprint sensor (220) based on the number of pixels of the fingerprint sensor (220) corresponding to the pattern interval, the transfer time, and a designated or predetermined integer (n).

[0288] FIG. 18 is a flowchart (1800) for explaining a method of controlling a fingerprint sensor (220) according to one embodiment.

[0289] In the embodiments described below, each operation may be performed sequentially, but this is not a limitation. For example, the order of each operation may be changed, and at least two operations may be performed in parallel.

[0290] According to one embodiment, operations 1801 to 1805 may be understood to be performed in a processor (e.g., processor (240) of FIG. 2) of an electronic device (e.g., electronic device (201) of FIG. 2).

[0291] In one embodiment, the operation of determining the adjusted exposure time (ET1) is illustrated in FIG. 16 based on the display of a fingerprint icon, but is not limited thereto. For example, the electronic device (201) may perform the operation of determining the adjusted exposure time (ET1) based on the pixel values ​​of the first pixels of the display (210).

[0292] Referring to FIG. 18, in operation 1801, in one embodiment, the processor (240) may determine whether to perform an operation of determining the adjusted exposure time (ET1) based on pixel values ​​of the first pixels of the display (210).

[0293] In one embodiment, as described above, the first pixels of the display (210) may include pixels set or selected, among all pixels of the display (210), to emit light having an intensity greater than a specified or predetermined intensity upon fingerprint authentication or fingerprint registration.

[0294] In one embodiment, the processor (240) may determine pixel values ​​of first pixels of the display (210) while a normal screen (e.g., a home screen) is displayed.

[0295] In one embodiment, the processor (240) may determine to perform the operation of determining the adjusted exposure time (ET1) based on whether the sum of the pixel values ​​of the first pixels of the display (210) is greater than or equal to a threshold value. The processor (240) may determine not to perform the operation of determining the adjusted exposure time (ET1) based on whether the sum of the pixel values ​​of the first pixels of the display (210) is less than the threshold value. In one embodiment, the sum of the pixel values ​​of the first pixels of the display (210) may correspond to the sum of all intensities of light emitted by the first pixels of the display (210).

[0296] In one embodiment, the processor (240) may determine to perform the operation of determining the adjusted exposure time (ET1) based on a ratio of a number of first pixels that are on to a total number of first pixels of the display (210) (which may be referred to as an “on pixel ratio”) being greater than or equal to a specified or predetermined ratio. The processor (240) may determine not to perform the operation of determining the adjusted exposure time (ET1) based on a ratio of a number of first pixels (e.g., among the first pixels) that are on to a total number of first pixels of the display (210) being less than or equal to the specified or predetermined ratio.

[0297] In operation 1803, in one embodiment, the processor (240) may acquire a dummy image based on which it determines to perform the operation of determining the adjusted exposure time (ET1).

[0298] In one embodiment, the processor (240) may provide a sixth signal (which may be referred to as a “sixth signal”) to the fingerprint sensor (220) to acquire a dummy image based on determining to perform the operation of determining the adjusted exposure time (ET1).

[0299] In one embodiment, the sixth signal may include a command to activate the fingerprint sensor (220), a command to cause the fingerprint sensor (220) to acquire pixel values ​​of the fingerprint sensor (220) (e.g., pixel values ​​of the fingerprint sensor (220) acquired to acquire a dummy image), and / or a designated or predetermined exposure time.

[0300] In one embodiment, a command to activate the fingerprint sensor (220) may be or include a command to switch the light sensing region (310), the ADC (320), and the controller (330) included in the fingerprint sensor (220) from an inactive state (e.g., a sleep state) to an active state (e.g., a wake up state), and to supply power to the light sensing region (310) and the ADC (320).

[0301] In one embodiment, the command causing the fingerprint sensor (220) to obtain pixel values ​​of the fingerprint sensor (220) may be or include a command causing the activated fingerprint sensor (220) to obtain pixel values ​​of the fingerprint sensor (220) based on a rolling shutter method to obtain a dummy image.

[0302] In one embodiment, the specified or predetermined exposure time included in the sixth signal may be a time obtained by multiplying the initial exposure time (ET0) of the fingerprint sensor (220) by a certain integer (e.g., about 10). For example, when acquiring a dummy image while a normal screen is displayed, it may be necessary to increase the exposure time for the fingerprint sensor (220) to acquire light so that the fingerprint sensor (220) can acquire a sufficient amount of light. Accordingly, the processor (240) may provide the sixth signal, which includes the exposure time calculated by multiplying the initial exposure time (ET0) of the fingerprint sensor (220) by a certain integer (e.g., about 10), to the fingerprint sensor (220). However, the present invention is not limited thereto. For example, the processor (240) may also provide the sixth signal, which includes the initial exposure time (ET0) of the fingerprint sensor (220), to the fingerprint sensor (220).

[0303] In one embodiment, the processor (240) may obtain a dummy image.

[0304] In one embodiment, the fingerprint sensor (220) may acquire pixel values ​​of the fingerprint sensor (220) using a rolling shutter method based on a sixth signal received from the processor (240). For example, the fingerprint sensor (220) may be activated based on the sixth signal. After being activated, the fingerprint sensor (220) may acquire pixel values ​​of the fingerprint sensor (220) using a rolling shutter method based on an exposure time calculated by multiplying an initial exposure time (ET0) of the fingerprint sensor (220) by a predetermined integer (e.g., about 10). The fingerprint sensor (220) may transmit the acquired pixel values ​​of the fingerprint sensor (220) to the processor (240).

[0305] In one embodiment, the processor (240) may generate a dummy image based on pixel values ​​obtained from the fingerprint sensor (220).

[0306] In operation 1805, in one embodiment, the processor (240) may adjust the exposure time of the fingerprint sensor (220) based on the dummy image.

[0307] The operation of adjusting the exposure time (ET1) based on the dummy image of operation 1805 may be at least partially identical or similar to the operation of adjusting the exposure time through the operations of FIG. 10. For example, the processor (240) may obtain average pixel values ​​of each row of pixels of the dummy image. The processor (240) may determine, based on the average pixel values ​​of each row of pixels of the obtained dummy image, an interval (e.g., a pattern interval) at which the first portion or the second portion repeatedly appears within the dummy image. The processor (240) may determine the number of pixels of the fingerprint sensor (220) corresponding to the obtained interval (e.g., a pattern interval) (e.g., the number of rows of each section in which the average pixel values ​​of the rows of pixels of the dummy image are repeated within the dummy image). The processor (240) can determine the adjusted exposure time (ET1) of the fingerprint sensor (220) based on the number of pixels of the fingerprint sensor (220) corresponding to the pattern interval, the transfer time, and a designated or predetermined integer (n).

[0308] In one embodiment, although FIG. 18 illustrates an operation of determining the adjusted exposure time (ET1) based on pixel values ​​of the first pixels of the display (210), the present invention is not limited thereto. For example, the processor (240) may perform operations (e.g., operations 1803 to 1805) including an operation of determining the adjusted exposure time (ET1) at set intervals (e.g., approximately every hour). For example, the processor (240) may measure the temperature of the electronic device (201). When the temperature of the electronic device (201) is equal to or greater than a first threshold temperature or equal to or less than a second threshold temperature (a second threshold temperature lower than the first threshold temperature), the processor (240) may perform operations (e.g., operations 1803 to 1807) including an operation of determining the adjusted exposure time (ET1) based on the amount of change in the temperature of the electronic device (201) being equal to or greater than a threshold amount of change.

[0309] FIG. 19 is a diagram for explaining images including a pattern represented by flicker noise according to one embodiment.

[0310] Referring to FIG. 19, in one embodiment, at reference numeral 1901, image 1 (1910) may be a first image (e.g., a dummy image) acquired through operation 703 of FIG. 7. As illustrated in reference numeral 1901, image 1 (1910) may include a pattern represented by a fingerprint (and a fingerprint icon) and may include first portions (1911-1, 1911-2) and second portions (1912-1, 1912-2) that alternately and repeatedly appear due to flicker noise.

[0311] In one embodiment, at reference numeral 1902, image 2 (1920) may be a first fingerprint image obtained through operation 1405 of FIG. 14. As illustrated in reference numeral 1902, image 2 (1920) may include a pattern represented by a fingerprint (and a fingerprint icon) and may include first portions (1921-1, 1921-2) and second portions (1922-1, 1922-2) that alternately and repeatedly appear by flicker noise.

[0312] In one embodiment, at reference numeral 1903, image 3 (1930) may be a dummy image obtained through operation 1605 of FIG. 16. As illustrated in reference numeral 1903, image 3 (1930) may include a pattern (1933) represented by a fingerprint icon, and may include first portions (1931-1, 1931-2) and second portions (1932-1, 1932-2) that alternately and repeatedly appear by flicker noise.

[0313] In one embodiment, at reference numeral 1904, image 4 (1940) may be a dummy image obtained through operation 1805 of FIG. 18. As illustrated in reference numeral 1904, image 4 (1924) may include first portions (1941-1, 1941-2) and second portions (1942-1, 1942-2) that alternately and repeatedly appear due to flicker noise.

[0314] FIG. 20 is a flowchart (2000) for explaining a method of controlling a fingerprint sensor (220) according to one embodiment.

[0315] In the embodiments described below, each operation may be performed sequentially, but this is not a limitation. For example, the order of each operation may be changed, and at least two operations may be performed in parallel.

[0316] According to one embodiment, operations 2003 to 2015 may be understood to be performed in a processor (e.g., processor (240) of FIG. 2) of an electronic device (201) (e.g., electronic device (201) of FIG. 2).

[0317] Referring to FIG. 20, in operation 2001, in one embodiment, the processor (240) may display a first screen using the display (210).

[0318] In one embodiment, the processor (240) may display a first screen using the display (210) based at least in part on receiving a fingerprint input request.

[0319] In one embodiment, the first screen may be a fingerprint input guide screen. For example, the first screen may be a screen (e.g., screen (810), screen (1510), screen (1710)) that includes a fingerprint icon (e.g., fingerprint icon (811), fingerprint icon (1511), fingerprint icon (1711)).

[0320] In one embodiment, a fingerprint input request may include an event (or input) that causes or allows a fingerprint input guide screen to be displayed. For example, a fingerprint input request may be an event indicating that the display (210) is switched from an off state to an on state, when a fingerprint input guide screen including a fingerprint icon is displayed using the display (210) in a locked state of the electronic device (201) as the display (210) is switched from an off state to an on state. For example, a fingerprint input request may be an event indicating that a payment function is executed, when a payment function is performed using a fingerprint while a payment application is running.

[0321] In operation 2003, in one embodiment, the processor (240) may acquire a first image using the fingerprint sensor (220) according to a first exposure time set for the fingerprint sensor (220) during at least a portion of the time that the first screen is displayed.

[0322] In one embodiment, the first exposure time may be an exposure time (e.g., initial exposure time (ET0)) obtained by multiplying the initial on / off cycle of the display (210) described above (which may also be referred to as a “default on / off cycle of the display (210)”) by a specified or predetermined integer (n).

[0323] In one embodiment, the processor (240) may acquire the aforementioned dummy image as the first image using the fingerprint sensor (220) according to the first exposure time, at least for a portion of the time that the first screen is displayed. Since an example of acquiring the first image using the fingerprint sensor (220) according to the first exposure time has been described above, a redundant description will be omitted.

[0324] In one embodiment, the first exposure time may be set based at least in part on the refresh rate information of the display (210). For example, the processor (240) may calculate the exposure time by multiplying an initial on / off cycle of the display (210) corresponding to the refresh rate of the display (210) (e.g., a currently set refresh rate for the display (210)) by a specified or predetermined integer. The processor (240) may set the calculated exposure time as the first exposure time.

[0325] In one embodiment, the processor (240) may detect external environmental information using another sensor configured to detect external environmental information for the electronic device (201). The processor (240) may perform an operation of acquiring the first image based at least in part on whether the external environmental information satisfies a specified or predetermined condition.

[0326] In one embodiment, the external environmental information of the electronic device (201) may include external environmental information that may change the actual refresh rate of the display (210). For example, the external environmental information may include the temperature of the electronic device (201), the brightness around the electronic device (201), and / or the brightness of the display (210) of the electronic device (201), which may change the clock generated by the oscillator.

[0327] In one embodiment, the sensor configured to detect external environmental information for the electronic device (201) may include a temperature sensor capable of detecting the temperature of the electronic device (201) (e.g., a fingerprint sensor (220) or a temperature sensor included in the system), a light sensor capable of detecting the brightness around the electronic device (201) and / or the brightness of the display (210). However, the sensor configured to detect external environmental information for the electronic device (201) is not limited to the examples described above.

[0328] In one embodiment, the processor (240) may perform an operation of acquiring a first image based on whether the external environmental information satisfies a specified condition.

[0329] In one embodiment, when the temperature of the electronic device (201) is less than about -5 degrees Celsius (e.g., when there is a temperature change of about 30 degrees Celsius from room temperature of 25 degrees Celsius) or greater than about 60 degrees Celsius (e.g., when there is a temperature change of about 35 degrees Celsius from room temperature of 25 degrees Celsius), the change in the refresh rate of the display (210) may be affected. In one embodiment, the processor (240) may obtain the temperature of the electronic device (201) using a temperature sensor. The processor (240) may determine that the external environment information does not satisfy a specified or predetermined condition when the temperature of the electronic device (201) is greater than or equal to about -5 degrees Celsius and less than or equal to about 60 degrees Celsius. The processor (240) may determine that the external environment information satisfies a specified or predetermined condition when the temperature of the electronic device (201) is less than about -5 degrees Celsius or greater than about 60 degrees Celsius. Although the above-described example illustrates that the first image is acquired based on the temperature of the electronic device (201) satisfying a specified or predetermined condition, the present invention is not limited thereto. For example, the processor (240) may determine that the specified or predetermined condition is not satisfied when the ambient brightness of the electronic device (201) and / or the brightness of the display (210) falls within a specified or predetermined range. The processor (240) may determine that the specified or predetermined condition is satisfied when the ambient brightness of the electronic device (201) and / or the brightness of the display (210) does not fall within the specified or predetermined range.

[0330] In one embodiment, the processor (240) may not perform the operation of acquiring the first image (and the operation of setting the second exposure time, which will be described later) based on the external environmental information satisfying a specified or predetermined condition.

[0331] In one embodiment, the processor (240) may display an indicator using the display (210) indicating that an operation to acquire a first image is to be performed, based at least in part on satisfaction of the specified or predetermined condition.

[0332] In one embodiment, the processor (240) may display a user interface (e.g., an icon) using the display (210) to receive user input for executing an operation to acquire a first image, based at least in part on the external environmental information satisfying the specified or predetermined condition.

[0333] In one embodiment, the processor (240) may monitor a user's finger contact with the display (210) while displaying the first screen. Based on the detection of the contact, the processor (240) may acquire a first image.

[0334] In operation 2005, in one embodiment, the processor (240) may set a second exposure time instead of the first exposure time for the fingerprint sensor (220), based at least in part on the first image.

[0335] In one embodiment, the second exposure time may be the adjusted exposure time (ET1) of the fingerprint sensor (220) described above.

[0336] In one embodiment, an example of adjusting the exposure time for the fingerprint sensor (220) from the first exposure time to the second exposure time based at least in part on the first image has been described above, so a redundant description will be omitted.

[0337] In one embodiment, the processor (240) may determine changed refresh rate information of the display (210) based on a first image (e.g., a dummy image). For example, the processor (240) may determine a changed refresh rate of the display (210) corresponding to the adjusted on / off cycle (T0'') of the display (210) described above. The processor (240) may determine a second exposure time based on the changed refresh rate of the display (210) (or the adjusted on / off cycle (T0'') of the display (210).

[0338] In operation 2007, in one embodiment, the processor (240) may detect a user's finger contact.

[0339] In one embodiment, the processor (240) may use the display (210) to detect a touch input using a user's finger on an area including a fingerprint icon (e.g., an area including a fingerprint icon (1511)) while a first screen including a fingerprint icon (e.g., a fingerprint input guide screen) is displayed.

[0340] In operation 2009, in one embodiment, the processor (240) may, in response to detecting a finger contact, display a second screen using the display (210).

[0341] In one embodiment, the processor (240) may, in response to detecting a finger contact (e.g., a touch input to an area including a fingerprint icon), cause the display (210) to emit light (e.g., light having an intensity greater than or equal to the specified or predetermined intensity) at a predetermined intensity for sensing a fingerprint. The processor (240) may, using the display (210), display a second screen represented by the light emitted at the predetermined intensity for sensing a fingerprint. For example, the processor (240) may control the display (210) to display a white image (e.g., a circular white image displayed at maximum brightness) as the second screen at the maximum brightness of the display (210).

[0342] In one embodiment, it may include a fingerprint sensing area substantially aligned with the fingerprint sensor (220).

[0343] In one embodiment, the processor (240) may perform an operation of displaying the second screen such that the brightness of the fingerprint sensing area is displayed brighter than a corresponding area of ​​the first screen.

[0344] In one embodiment, the processor (240) may display a first guide image and a second guide image, each having at least one different attribute (e.g., size, shape, and / or brightness) in the corresponding area of ​​the first screen (e.g., fingerprint input guide screen) and the fingerprint sensing area, using the display (210), respectively. For example, when the first guide image is displayed in the corresponding area of ​​the first screen, the processor (240) may control the display (210) so that, when the second screen is displayed, a second guide image having an attribute different from that of the first guide image is displayed in the fingerprint sensing area. By displaying the first guide image and the second guide image such that the attributes of the first guide image and the second guide image are different, the user may be able to recognize that the image acquired using the fingerprint sensor (220) when acquiring the first image is a dummy image and not an image used for authentication or registration.

[0345] In operation 2011, in one embodiment, the processor (240) may acquire a second image corresponding to a finger using the fingerprint sensor (220) according to a second exposure time, at least during a portion of the time that the second screen is displayed.

[0346] In operation 2013, in one embodiment, the processor (240) may obtain fingerprint information corresponding to the finger, based at least in part on the second image.

[0347] In operation 2015, in one embodiment, the processor (240) may perform fingerprint authentication or fingerprint registration for a user based on fingerprint information.

[0348] As for actions 2011, 2013, and 2015, they have been described through actions 709 of FIG. 7 and actions 1407 and 1409 of FIG. 14, so redundant descriptions will be omitted.

[0349] FIG. 21 is a drawing for explaining a method of controlling a fingerprint sensor (220) according to one embodiment.

[0350] Referring to FIG. 21, in one embodiment, the processor (240) may set a mode (referred to as “first mode” or “enhanced authentication mode”) in which the exposure time can be adaptively adjusted.

[0351] In one embodiment, the first mode may be a mode in which the exposure time of the fingerprint sensor (220) can be adjusted using an image (e.g., a dummy image) acquired through the fingerprint sensor (220) and fingerprint information can be acquired using the adjusted exposure time.

[0352] In one embodiment, the processor (240) may cause the electronic device (201) to operate in the first mode when the first mode is set, upon fingerprint authentication, upon fingerprint registration, or upon occurrence of a designated or predetermined event.

[0353] In one embodiment, when the first mode is set, the processor (240) may cause the electronic device (201) to operate in the first mode if external environmental information satisfies a specified or predetermined condition (e.g., when the temperature of the electronic device (201) is less than about -5 degrees or greater than about 60 degrees as a specified or predetermined temperature range). For example, when the first mode is set, the processor (240) may adjust the exposure time of the fingerprint sensor (220) from the first exposure time to the second exposure time, one time only, if the temperature of the electronic device (201) satisfies the specified or predetermined temperature range.

[0354] In one embodiment, the second mode (which may also be referred to as “normal mode”) may be a mode in which fingerprint information is acquired using the first exposure time without adjusting the exposure time of the fingerprint sensor (220) from the first exposure time to the second exposure time.

[0355] In one embodiment, the processor (240) may set the first mode using a settings menu. For example, reference numeral 2100 of FIG. 21 may indicate a screen including a settings menu. The screen (2100) may include text (2110) indicating detailed settings of biometric recognition, text (2121) and text (2122) indicating the type of authentication to be set, text (2130) guiding turning on (e.g., activation) or off (e.g., deactivation) the first mode, and an object (2131) (e.g., an icon) for turning on or off the first mode. The processor (240) may selectively turn on or off the first mode based on a user input to the object (2131).

[0356] In one embodiment, although not shown in FIG. 21, the screen (2100) may include a guide indicating that the electronic device (201) may operate in a first mode or a second mode depending on the temperature of the electronic device (201).

[0357] In Fig. 21, a method of setting the first mode through a setting menu is exemplified, but is not limited thereto. For example, the processor (240) may acquire the temperature of the electronic device (201) using a temperature sensor (e.g., a fingerprint sensor (220) or a temperature sensor included in the system). When the acquired temperature of the electronic device (201) falls within a designated or predetermined range, the processor (240) may display a menu (e.g., a window including text (2130) and an object (2131)) that can set the first mode (e.g., turn the first mode on or off) in a pop-up form using the display (210). The processor (240) may set the first mode (e.g., turn the first mode on or off) based on a user input (e.g., a user input for a menu displayed in a pop-up form).

[0358] FIG. 22 is a drawing for explaining a method of controlling a fingerprint sensor (220) according to one embodiment.

[0359] Referring to FIG. 22, in one embodiment, the processor (240) may display fingerprint icons having different properties in the first mode and the second mode through the display (210).

[0360] In one embodiment, at reference numeral 2201 of FIG. 22, the processor (240) may display a screen (2210) including a first fingerprint icon (2211) using the display (210) in a second mode (normal mode) (or when the temperature of the electronic device (201) in the first mode does not fall within a specified or predetermined temperature range).

[0361] In one embodiment, the processor (240) may display a screen (2220) including a second fingerprint icon (2222) having a higher brightness than the brightness of the first fingerprint icon (2211) using the display (210), together with information (2221) indicating that, after the first mode is set, when the temperature of the electronic device (201) falls within a designated or predetermined temperature range, the environment for performing fingerprint authentication is changed to an environment for acquiring fingerprint information through an operation in which the exposure time of the fingerprint sensor (220) is adaptively set. However, the present invention is not limited thereto. For example, the processor (240) may, after the first mode is set, display a screen (2230) including an area (2232) having a higher brightness than the brightness of an area including the first fingerprint icon (2211) together with information (2231) identical to the information (2221) when the temperature of the electronic device (201) falls within a designated or predetermined temperature range. In the above example, the brightness of the fingerprint icon (or the area including the fingerprint icon) is described as being changed, but the present invention is not limited thereto, and the size and shape of the fingerprint icon (or the area including the fingerprint icon) may also be changed.

[0362] In one embodiment, the processor (240) may acquire a first image (e.g., a dummy image) using the fingerprint sensor (220) when the temperature of the electronic device (201) falls within a designated or predetermined temperature range. The processor (240) may calculate an offset of an on / off cycle of the display (210) based on the first image. The processor (240) may store the temperature of the electronic device (201) and the calculated offset in correspondence with each other in the memory (230). After the temperature of the electronic device (201) and the offset corresponding to the temperature of the electronic device (201) are stored in the memory (230), the processor (240) may perform fingerprint authentication or fingerprint registration. The processor (240) may acquire the temperature of the electronic device (201) using a temperature sensor during fingerprint authentication or fingerprint registration. The processor (240) can obtain an offset corresponding to the temperature of the electronic device (201) obtained from the memory (230). The processor (240) can adjust the exposure time of the fingerprint sensor (220) based on the obtained offset.

[0363] An electronic device according to one embodiment may include a display, a fingerprint sensor disposed under the display and configured to acquire an image by sensing light, at least one processor including a processing circuit, and a memory (230) storing instructions. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to detect the occurrence of an event for sensing a fingerprint of a user. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to acquire a first image using the fingerprint sensor before the display emits light at a predetermined intensity for sensing a fingerprint, based on the detection of the occurrence of the event for sensing the fingerprint of the user. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to analyze at least one pattern corresponding to flicker noise within the first image. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to adjust at least one exposure time of the fingerprint sensor for sensing light emitted by the display at the predetermined intensity and reflected by the fingerprint of the user based on the analysis. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to acquire a second image using the fingerprint sensor by sensing the light emitted by the display at the predetermined intensity and reflected by the fingerprint of the user based on the adjusted at least one exposure time.

[0364] In one embodiment, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device, in response to detecting the occurrence of the event for sensing the fingerprint of the user, to provide a first signal to the display for causing the display to emit light at the predetermined intensity for sensing the fingerprint before the display emits light at the predetermined intensity for sensing the fingerprint, and to provide a second signal to the fingerprint sensor for acquiring the first image via the fingerprint sensor. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device, in response to detecting the occurrence of the event for sensing the fingerprint of the user, to acquire the first image based on a plurality of pixel values ​​sequentially acquired row by row for rows of pixels included in the fingerprint sensor before the display emits light at the predetermined intensity for sensing the fingerprint.

[0365] In one embodiment, the first signal may include a command to activate the fingerprint sensor, a command to cause the fingerprint sensor to acquire pixel values ​​corresponding to the first image, a command to cause the fingerprint sensor to acquire pixel values ​​corresponding to the second image after the display emits light at a predetermined intensity for sensing the fingerprint, and the at least one exposure time stored in the memory.

[0366] In one embodiment, the at least one pattern may include a plurality of first portions that alternately and repeatedly appear within the first image and a plurality of second portions that are darker than the plurality of first portions. The instructions may be operable, individually or collectively, to execute the instructions, when individually or collectively executed by the at least one processor, to cause the electronic device to obtain, for each of the rows of pixels of the first image, an average value of pixel values ​​of pixels included in a row, thereby obtaining average pixel values ​​corresponding to each of the rows of pixels of the first image. The one or more processors may cause the electronic device to determine an interval at which the plurality of first portions and the plurality of second portions appear within the first image. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to determine a number of rows of pixels of the fingerprint sensor (220) corresponding to the interval. The above instructions, when executed individually or collectively by the at least one processor, may cause the electronic device to adjust the at least one exposure time based on the determined number.

[0367] In one embodiment, the instructions, when individually or collectively executed by the at least one processor, may further cause the electronic device to detect the occurrence of the event for sensing the fingerprint of the user while displaying a screen for fingerprint registration through the display. The instructions, when individually or collectively executed by the at least one processor, may further cause the electronic device to, in response to detecting the occurrence of the event for sensing the fingerprint of the user, acquire a third image using the fingerprint sensor while the display emits light at the predetermined intensity for sensing the fingerprint. The instructions, when individually or collectively executed by the at least one processor, may further cause the electronic device to analyze at least one pattern corresponding to the flicker noise within the third image. The instructions, when individually or collectively executed by the at least one processor, may further cause the electronic device to adjust, based on the analysis, at least one exposure time of the fingerprint sensor for sensing light emitted by the display at the predetermined intensity and reflected by the fingerprint of the user. The instructions, when individually or collectively executed by the at least one processor, may further cause the electronic device to acquire one or more fingerprint images using the fingerprint sensor by sensing light emitted by the display at the predetermined intensity and reflected by the fingerprint of the user, based on the adjusted at least one exposure time.

[0368] In one embodiment, the instructions, when individually or collectively executed by the at least one processor, may further cause the electronic device to acquire a fourth image using the fingerprint sensor based on displaying a fingerprint icon through the display. The instructions, when individually or collectively executed by the at least one processor, may further cause the electronic device to analyze at least one pattern corresponding to the flicker noise within the fourth image. The instructions, when individually or collectively executed by the at least one processor, may further cause the electronic device to adjust, based on the analysis, the at least one exposure time of the fingerprint sensor for sensing light emitted by the display at the predetermined intensity and reflected by the fingerprint of the user.

[0369] In one embodiment, the instructions, when individually or collectively executed by the at least one processor, may further cause the electronic device to acquire a fifth image based on a ratio of pixels that are on among the first pixels of the display arranged in an area corresponding to a location of the fingerprint sensor being greater than or equal to a specified ratio. The instructions, when individually or collectively executed by the at least one processor, may further cause the electronic device to analyze at least one pattern corresponding to the flicker noise within the fifth image. The instructions, when individually or collectively executed by the at least one processor, may further cause the electronic device to adjust, based on the analysis, at least one exposure time of the fingerprint sensor for sensing light emitted by the display at the predetermined intensity and reflected by the fingerprint of the user.

[0370] In one embodiment, a method of controlling a fingerprint sensor in an electronic device may include detecting an occurrence of an event for sensing a fingerprint of a user. The method may include acquiring a first image using the fingerprint sensor before the display emits light at a predetermined intensity for sensing the fingerprint, based on the detection of the occurrence of the event for sensing the fingerprint of the user. The method may include analyzing at least one pattern corresponding to flicker noise within the first image. The method may include adjusting at least one exposure time of the fingerprint sensor for sensing light emitted by the display at the predetermined intensity and reflected by the fingerprint of the user, based on the analysis. The method may include acquiring a second image using the fingerprint sensor by sensing light emitted by the display at the predetermined intensity and reflected by the fingerprint of the user, based on the adjusted at least one exposure time.

[0371] In one embodiment, the operation of acquiring a first image using the fingerprint sensor may include, in response to detecting the occurrence of the event for sensing the fingerprint of the user, providing a first signal to the display for causing the display to emit light at the predetermined intensity for sensing the fingerprint before the display emits light at the predetermined intensity for sensing the fingerprint, and providing a second signal to the fingerprint sensor for acquiring the first image. The operation of acquiring the first image using the fingerprint sensor may include, in response to detecting the occurrence of the event for sensing the fingerprint of the user, before the display emits light at the predetermined intensity for sensing the fingerprint, acquiring the first image based on a plurality of pixel values ​​sequentially acquired row by row for rows of pixels included in the fingerprint sensor.

[0372] In one embodiment, the first signal may include a command to activate the fingerprint sensor, a command to cause the fingerprint sensor to acquire pixel values ​​corresponding to the first image, a command to cause the fingerprint sensor to acquire pixel values ​​corresponding to the second image after the display emits light at a predetermined intensity for sensing a fingerprint, and the at least one exposure time stored in a memory of the electronic device.

[0373] In one embodiment, the at least one pattern may include a plurality of first portions that alternately appear in the first image and a plurality of second portions that are darker than the plurality of first portions. The operation of analyzing the at least one pattern may include an operation of obtaining an average value of pixel values ​​of pixels included in each row of pixels of the first image, thereby obtaining average pixel values ​​corresponding to each of the rows of pixels of the first image. The operation of analyzing the at least one pattern may include an operation of determining an interval at which the plurality of first portions and the plurality of second portions appear in the first image. The operation of analyzing the at least one pattern may include an operation of determining a number of rows of pixels of the fingerprint sensor (220) corresponding to the interval. The operation of adjusting the at least one exposure time of the fingerprint sensor may include an operation of adjusting the at least one exposure time based on the determined number.

[0374] In one embodiment, the method may further include detecting an occurrence of the event for sensing the fingerprint of the user while displaying a screen for fingerprint registration through the display. The method may further include, in response to detecting the occurrence of the event for sensing the fingerprint of the user, acquiring a third image using the fingerprint sensor while the display emits light at a predetermined intensity for sensing the fingerprint. The method may further include analyzing at least one pattern corresponding to the flicker noise within the third image. The method may further include, based on the analysis, adjusting at least one exposure time of the fingerprint sensor for sensing light emitted by the display at the predetermined intensity and reflected by the fingerprint of the user. The method may further include acquiring one or more fingerprint images using the fingerprint sensor by sensing light emitted by the display at the predetermined intensity and reflected by the fingerprint of the user, based on the adjusted at least one exposure time.

[0375] In one embodiment, the method may further include an operation of acquiring a fourth image using the fingerprint sensor based on displaying a fingerprint icon through the display. The method may further include an operation of analyzing at least one pattern corresponding to the flicker noise within the fourth image. The method may further include an operation of adjusting at least one exposure time of the fingerprint sensor for sensing light emitted by the display at the predetermined intensity and reflected by the fingerprint of the user based on the analysis.

[0376] In one embodiment, an electronic device (201) may include a display (210), a fingerprint sensor (220) disposed below the display (210) and configured to acquire an image by sensing light, at least one processor (240) including a processing circuit, and a memory (230) storing instructions. The instructions, when individually or collectively executed by the at least one processor, may cause the one or more processors to cause the electronic device to display a first screen via the display. The instructions, when individually or collectively executed by the at least one processor, may cause the one or more processors to cause the electronic device to acquire a first image via the fingerprint sensor according to a first exposure time set for the fingerprint sensor during at least a portion of the first screen being displayed. The instructions, when individually or collectively executed by the at least one processor, may cause the one or more processors to cause the electronic device to set a second exposure time for the fingerprint sensor instead of the first exposure time based at least in part on the first image. The above instructions, when individually or collectively executed by the at least one processor, may cause the one or more processors to cause the electronic device to detect a user's finger contact. The above instructions, when individually or collectively executed by the at least one processor, may cause the one or more processors to cause the electronic device to display a second screen through the display in response to the detection of the finger contact.The instructions, when individually or collectively executed by the at least one processor, may cause the one or more processors to cause the electronic device to acquire a second image corresponding to the finger through the fingerprint sensor according to the second exposure time during at least a portion of the second screen being displayed. The instructions, when individually or collectively executed by the at least one processor, may cause the one or more processors to cause the electronic device to acquire fingerprint information corresponding to the finger based at least in part on the second image. The instructions, when individually or collectively executed by the at least one processor, may cause the one or more processors to cause the electronic device to perform fingerprint authentication or fingerprint registration for the user based at least in part on the fingerprint information.

[0377] In one embodiment, the first exposure time may be set based at least in part on refresh rate information of the display. The instructions, when individually or collectively executed by the at least one processor, may cause one or more processors to cause the electronic device to determine changed refresh rate information of the display (210) based on the first image. The instructions, when individually or collectively executed by the at least one processor, may cause one or more processors to cause the electronic device to determine the second exposure time based at least in part on the changed refresh rate information.

[0378] In one embodiment, the electronic device may further include another sensor configured to detect external environmental information about the electronic device. The instructions, when individually or collectively executed by the at least one processor, may cause one or more processors to cause the electronic device to detect the external environmental information using the other sensor. In one embodiment, the instructions, when individually or collectively executed by the at least one processor, may cause one or more processors to perform an operation of acquiring the first image based at least in part on whether the external environmental information satisfies a specified condition.

[0379] In one embodiment, the instructions, when individually or collectively executed by the at least one processor, cause the one or more processors to cause the electronic device to display, through the display, an indicator indicating that an operation of acquiring the first image is to be performed, based at least in part on the external environmental information satisfying the specified condition.

[0380] In one embodiment, the instructions, when individually or collectively executed by the at least one processor, cause the one or more processors to cause the electronic device to display, through the display, a user interface for receiving user input for executing an operation of acquiring the first image, based at least in part on the external environmental information satisfying the specified condition.

[0381] In one embodiment, the second screen may include a fingerprint sensing area substantially aligned with the fingerprint sensor (220). The instructions, when individually or collectively executed by the at least one processor, may cause the one or more processors to perform an operation to display the second screen such that the brightness of the fingerprint sensing area is displayed brighter than a corresponding area of ​​the first screen.

[0382] In one embodiment, the instructions, when executed individually or collectively by the at least one processor, cause the one or more processors to cause the electronic device to display a first guide image and a second guide image, each of which has at least one attribute different from the corresponding area and the fingerprint sensing area.

[0383] In one embodiment, the instructions, when individually or collectively executed by the at least one processor, cause the one or more processors to cause the electronic device to display the first screen through the display (210) at least in part based on receiving a fingerprint input request.

[0384] In one embodiment, the instructions, when individually or collectively executed by the at least one processor, may cause the one or more processors to monitor a user's finger contact with the display (210) while the electronic device displays the first screen. The instructions, when individually or collectively executed by the at least one processor, may cause the one or more processors to cause the electronic device to acquire the first image further based on the detection of the contact.

[0385] An electronic device according to an embodiment disclosed in this document may take various forms. The electronic device may include, for example, a portable communication device (e.g., a smartphone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a home appliance. The electronic device according to an embodiment of this document is not limited to the aforementioned devices.

[0386] It should be understood that the embodiments of this document and the terminology used herein are not intended to limit the technical features described in this document to specific embodiments, but include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

[0387] The term "module" used in one embodiment of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0388] An embodiment of the present document may be implemented as software (e.g., a program (140)) including one or more instructions stored in a storage medium (e.g., an internal memory (136) or an external memory (138)) readable by a machine (e.g., an electronic device (101)). For example, a processor (e.g., a processor (120)) of the machine (e.g., an electronic device (101)) may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, "non-transitory" simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.

[0389] According to one embodiment, the method according to one embodiment disclosed in the present document may be provided as a computer program product. The computer program product may be traded between sellers and buyers as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or may be provided through an application store (e.g., Play Store). TM ) or directly between two user devices (e.g., smart phones), online distribution (e.g., downloading or uploading). In the case of online distribution, at least a portion of the computer program product may be at least temporarily stored or temporarily created in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0390] According to one embodiment, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and placed in other components. According to one embodiment, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to one embodiment, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

Claims

1. In the electronic device (201), display (210); A fingerprint sensor (220) arranged under the display (210) and configured to acquire an image by sensing light; At least one processor (240) comprising a processing circuit; and Includes a memory (230) for storing commands, The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: Detect the occurrence of an event to sense the user's fingerprint, Based on detecting the occurrence of the event for sensing the fingerprint of the user, the display acquires a first image using the fingerprint sensor before emitting light with a predetermined intensity for sensing the fingerprint, Analyzing at least one pattern corresponding to flicker noise within the first image, Based on the above analysis, adjusting at least one exposure time of the fingerprint sensor for sensing light emitted by the display at the predetermined intensity and reflected by the fingerprint of the user, and An electronic device that causes the fingerprint sensor to acquire a second image by sensing the light emitted by the display at the predetermined intensity and reflected by the fingerprint of the user based on at least one of the adjusted exposure times.

2. In paragraph 1, The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: In response to detecting the occurrence of the event for sensing the fingerprint of the user, the display emits light at the predetermined intensity for sensing the fingerprint: Providing a first signal to the display to cause the display to emit light with the predetermined intensity for sensing the fingerprint, and providing a second signal to the fingerprint sensor to obtain the first image through the fingerprint sensor, and An electronic device that causes the first image to be acquired based on a plurality of pixel values ​​sequentially acquired row by row for rows of pixels included in the fingerprint sensor.

3. In paragraph 2, The first signal above is: A command to activate the above fingerprint sensor, A command causing the fingerprint sensor to obtain pixel values ​​corresponding to the first image; A command to cause the display to acquire pixel values ​​corresponding to the second image after emitting the light with a predetermined intensity for sensing the fingerprint, and An electronic device comprising at least one exposure time stored in said memory.

4. In any one of paragraphs 1 to 3, wherein said at least one pattern comprises a plurality of first portions that alternately and repeatedly appear within said first image and a plurality of second portions that are darker than said plurality of first portions, and The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: By obtaining the average value of the pixel values ​​of the pixels included in each row of the pixels of the first image, the average pixel values ​​corresponding to each row of the pixels of the first image are obtained, Check the intervals at which the plurality of first parts and the plurality of second parts appear within the first image, Determine the number of rows of pixels of the fingerprint sensor corresponding to the above interval, and An electronic device that causes at least one exposure time to be adjusted based on the determined number.

5. In any one of paragraphs 1 to 4, The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: Detecting the occurrence of the event for sensing the user's fingerprint while displaying a screen for fingerprint registration through the display; In response to detecting the occurrence of the event for sensing the fingerprint of the user, while the display emits light at the predetermined intensity for sensing the fingerprint, a third image is acquired using the fingerprint sensor, Analyzing at least one pattern corresponding to the flicker noise within the third image, Based on the above analysis, adjusting at least one exposure time of the fingerprint sensor for sensing light emitted by the display at the predetermined intensity and reflected by the fingerprint of the user, and An electronic device that causes the fingerprint sensor to acquire one or more fingerprint images by sensing light emitted by the display at the predetermined intensity and reflected by the fingerprint of the user based on at least one of the adjusted exposure times.

6. In any one of paragraphs 1 to 5, The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: Based on displaying a fingerprint icon through the above display, a fourth image is acquired using the fingerprint sensor, analyzing at least one pattern corresponding to the flicker noise within the fourth image, and An electronic device that causes the at least one exposure time of the fingerprint sensor to be adjusted based on the analysis to sense light emitted by the display at the predetermined intensity and reflected by the fingerprint of the user.

7. In any one of paragraphs 1 to 6, The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: Acquiring a fifth image based on the ratio of pixels in an on state among the first pixels of the display arranged in an area corresponding to the location of the fingerprint sensor being greater than or equal to a specified ratio, analyzing at least one pattern corresponding to the flicker noise within the fifth image, and An electronic device that causes the at least one exposure time of the fingerprint sensor to be adjusted based on the analysis to sense light emitted by the display at the predetermined intensity and reflected by the fingerprint of the user.

8. A method for controlling a fingerprint sensor (220) in an electronic device (201), An action to detect the occurrence of an event for sensing a user's fingerprint; An action of acquiring a first image using the fingerprint sensor before the display of the electronic device emits light with a predetermined intensity for sensing a fingerprint based on detecting the occurrence of the event for sensing the fingerprint of the user; An operation of analyzing at least one pattern corresponding to flicker noise within the first image; Based on the analysis, adjusting at least one exposure time of the fingerprint sensor for sensing light emitted by the display at the predetermined intensity and reflected by the fingerprint of the user; and A method comprising: acquiring a second image using the fingerprint sensor by sensing the light emitted by the display at the predetermined intensity and reflected by the fingerprint of the user based on at least one of the adjusted exposure times.

9. In paragraph 8, The operation of obtaining the first image using the above fingerprint sensor is as follows: In response to detecting the occurrence of the event for sensing the fingerprint of the user, the display emits light at a predetermined intensity for sensing the fingerprint: An operation of providing a first signal to the display to cause the display to emit light with the predetermined intensity for sensing the fingerprint, and providing a second signal to the fingerprint sensor to obtain the first image through the fingerprint sensor; and A method comprising an operation of acquiring the first image based on a plurality of pixel values ​​sequentially acquired row by row for rows of pixels included in the fingerprint sensor.

10. In paragraph 9, The above first signal is, A command to activate the above fingerprint sensor, A command causing the fingerprint sensor to obtain pixel values ​​corresponding to the first image; A command to cause the display to acquire pixel values ​​corresponding to the second image after emitting the light with a predetermined intensity for sensing a fingerprint, and A method comprising at least one exposure time stored in a memory of the electronic device.

11. In any one of paragraphs 8 to 10, wherein said at least one pattern comprises a plurality of first portions that alternately and repeatedly appear within said first image and a plurality of second portions that are darker than said plurality of first portions, The operation of analyzing at least one pattern above comprises: An operation of obtaining average pixel values ​​corresponding to each row of pixels of the first image by obtaining an average value of pixel values ​​of pixels included in each row of pixels of the first image; An operation of checking the interval at which the plurality of first parts and the plurality of second parts appear within the first image; and comprising an operation of determining the number of rows of pixels of the fingerprint sensor corresponding to the above interval, and The operation of adjusting at least one exposure time of the fingerprint sensor is: A method comprising an operation of adjusting at least one exposure time based on the determined number.

12. In any one of paragraphs 8 to 11, An action of detecting the occurrence of the event for sensing the fingerprint of the user while displaying a screen for fingerprint registration through the display; In response to detecting the occurrence of the event for sensing the fingerprint of the user, an action of acquiring a third image using the fingerprint sensor while the display emits light at a predetermined intensity for sensing the fingerprint; An operation of analyzing at least one pattern corresponding to the flicker noise within the third image; Based on the analysis, adjusting at least one exposure time of the fingerprint sensor for sensing light emitted by the display at the predetermined intensity and reflected by the fingerprint of the user; and A method further comprising the action of acquiring one or more fingerprint images using the fingerprint sensor by sensing light emitted by the display at the predetermined intensity and reflected by the fingerprint of the user based on at least one of the adjusted exposure times.

13. In any one of paragraphs 8 to 12, An operation of acquiring a fourth image using the fingerprint sensor based on displaying a fingerprint icon through the display; An operation of analyzing at least one pattern corresponding to the flicker noise within the fourth image; and A method further comprising, based on the analysis, adjusting at least one exposure time of the fingerprint sensor for sensing light emitted by the display at the predetermined intensity and reflected by the fingerprint of the user.

14. In any one of paragraphs 8 to 13, An operation of acquiring a fifth image based on a ratio of pixels in an on state among the first pixels of the display arranged in an area corresponding to the position of the fingerprint sensor being greater than or equal to a specified ratio; An operation of analyzing at least one pattern corresponding to the flicker noise within the fifth image; and A method further comprising, based on the analysis, adjusting at least one exposure time of the fingerprint sensor for sensing light emitted by the display at the predetermined intensity and reflected by the fingerprint of the user.

15. A non-transitory computer-readable storage medium having computer-executable instructions recorded thereon, wherein the computer-executable instructions, when executed by at least one processor, cause an electronic device to: Detect the occurrence of an event to sense the user's fingerprint, In response to detecting the occurrence of the event for sensing the fingerprint of the user, the display of the electronic device acquires a first image using the fingerprint sensor before emitting light with a predetermined intensity for sensing the fingerprint, Analyzing at least one pattern corresponding to flicker noise within the first image, Based on the above analysis, adjusting at least one exposure time of the fingerprint sensor for sensing light emitted by the display at the predetermined intensity and reflected by the fingerprint of the user, and A non-transitory computer-readable storage medium that causes the fingerprint sensor to acquire a second image by sensing the light emitted by the display at the predetermined intensity and reflected by the fingerprint of the user based on at least one of the adjusted exposure times.

Images