Electronic device comprising fingerprint sensor, and operation method thereof

Abstract

An electronic device according to various embodiments may comprise: a fingerprint sensor; one or more processors; and a memory for storing one or more instructions. The one or more instructions may be executed by the one or more processors to cause the electronic device to: allow the fingerprint sensor to output multiple fingerprint image frames on the basis of a first frame rate; and determine a second frame rate at which a size of an overlapping area determined on the basis of the fingerprint image frames output from the fingerprint sensor falls within a designated range, so as to change a frame rate of the fingerprint sensor to the second frame rate.

Description

Electronic device including a fingerprint sensor and method of operating the same

[0001] The present disclosure relates to an electronic device including a fingerprint sensor and a method of operating the same.

[0002] Electronic devices may include sensors for detecting information. Various sensors may be used to enable electronic devices to detect information. For example, an electronic device may include a fingerprint sensor for obtaining fingerprint information for user authentication. Various methods, such as optical, thermal, or capacitive, may be used to implement the fingerprint sensor. Among these, a capacitive fingerprint sensor can obtain information about the shape of a fingerprint (fingerprint pattern) by detecting changes in capacitance caused by the valley and ridge shapes of a fingerprint when the surface of a human finger contacts a conductive sensing pattern. An electronic device including a fingerprint sensor can perform a computational process to process the information obtained through the fingerprint sensor.

[0003] The above information may be provided as background art to aid in understanding the present disclosure. No claim or determination is made as to whether any of the above is applicable as prior art in connection with the present disclosure.

[0004] An electronic device according to one embodiment may include a fingerprint sensor, one or more processors, and a memory storing one or more instructions. The one or more instructions may be executed by the one or more processors to cause the electronic device to cause the fingerprint sensor to output a plurality of fingerprint image frames, wherein at least one of the plurality of fingerprint image frames is output based on a first frame rate. The one or more instructions may be executed by the one or more processors to cause the electronic device to determine a second frame rate such that a size of an overlapping area determined based on fingerprint image frames output from the fingerprint sensor is within a specified range. The one or more instructions may be executed by the one or more processors to cause the electronic device to change a frame rate at which the fingerprint sensor outputs fingerprint image frames to the second frame rate.

[0005] In one embodiment, a method of operating an electronic device including a fingerprint sensor may include an operation in which the fingerprint sensor outputs a plurality of fingerprint image frames, at least one of the plurality of fingerprint image frames being output based on a first frame rate. The method may further include an operation in which a second frame rate is determined such that a size of an overlapping area determined based on fingerprint image frames output from the fingerprint sensor becomes within a specified range. The method may further include an operation in which the fingerprint sensor changes a frame rate at which the fingerprint sensor outputs fingerprint image frames to the second frame rate.

[0006] In one embodiment, a computer-readable, non-transitory recording medium may record a computer program that causes an electronic device including a fingerprint sensor to perform the above-described method when executed. The computer program may cause the electronic device including the fingerprint sensor to perform an operation of outputting a plurality of fingerprint image frames, wherein at least one of the plurality of fingerprint image frames is output based on a first frame rate. The computer program may cause the electronic device including the fingerprint sensor to perform an operation of determining a second frame rate so that an overlapping area determined based on fingerprint image frames output from the fingerprint sensor becomes a designated range when executed. The computer program may cause the electronic device including the fingerprint sensor to perform an operation of changing a frame rate at which the fingerprint sensor outputs fingerprint image frames to the second frame rate when executed.

[0007] According to one embodiment, a fingerprint sensor may be configured to output a plurality of fingerprint image frames, at least one of the plurality of fingerprint image frames being output based on a first frame rate. The fingerprint sensor may be configured to determine a second frame rate such that a size of an overlapping area determined based on the fingerprint image frames output from the fingerprint sensor is within a specified range. The fingerprint sensor may be configured to change a frame rate at which the fingerprint image frames are output to the second frame rate.

[0008] In one embodiment, a method of operating a fingerprint sensor may include an operation in which the fingerprint sensor outputs a plurality of fingerprint image frames, at least one of the plurality of fingerprint image frames being output based on a first frame rate. The method of the fingerprint sensor may further include an operation in which a second frame rate is determined such that a size of an overlapping area determined based on fingerprint image frames output from the fingerprint sensor becomes within a specified range. The method of the fingerprint sensor may further include an operation in which the fingerprint sensor changes a frame rate at which the fingerprint sensor outputs fingerprint image frames to the second frame rate.

[0009] FIG. 1 is a block diagram of an electronic device within a network environment according to various embodiments.

[0010] FIG. 2 conceptually illustrates the configuration of an electronic device and the process of obtaining fingerprint information according to one embodiment.

[0011] FIG. 3 illustrates a method of inputting fingerprint information through a fingerprint sensor of an electronic device according to one embodiment.

[0012] FIG. 4 is a flowchart illustrating a process by which an electronic device obtains a fingerprint template through a fingerprint sensor according to one embodiment.

[0013] FIG. 5 illustrates the locations of feature points indicating movement of a fingerprint image between fingerprint image frames acquired by an electronic device according to one embodiment.

[0014] FIG. 6 illustrates an overlapping area formed between fingerprint image frames acquired by an electronic device according to an embodiment of the present invention, depending on the direction of movement of the fingerprint image.

[0015] FIG. 7 illustrates an example in which an electronic device according to one embodiment overlaps fingerprint images contained in fingerprint image frames moving in a single direction.

[0016] FIG. 8 illustrates an example of a time interval at which a fingerprint sensor of an electronic device samples a fingerprint image frame according to one embodiment.

[0017] FIG. 9 conceptually illustrates motion vectors for fingerprint image frames acquired by an electronic device according to one embodiment.

[0018] FIG. 10 illustrates an example of a movement trajectory corresponding to fingerprint image frames acquired by an electronic device according to one embodiment.

[0019] FIG. 11 is a flowchart illustrating a process for dynamically adjusting a sampling rate during a fingerprint scanning operation performed by an electronic device according to one embodiment.

[0020] FIG. 12 is a flowchart illustrating a process for obtaining a fingerprint template based on a frame rate determined at the time when an electronic device initiates a fingerprint scanning operation according to one embodiment.

[0021] FIG. 13 is a flowchart illustrating a process by which an electronic device according to one embodiment provides a guide to a user based on an acquired fingerprint image frame.

[0022] Hereinafter, embodiments of the present invention will be described in detail with reference to the attached drawings so that those skilled in the art can easily implement the present invention. However, the disclosed embodiments may be implemented in various different forms and are not limited to the embodiments described herein.

[0023] Electronic devices can register a user's fingerprint or obtain a fingerprint template to determine whether it matches a registered fingerprint by performing calculations on fingerprint information sampled through a fingerprint sensor. As the number of duplicate samples of the same area of ​​a user's fingerprint increases, the number of unnecessary calculations required to obtain a fingerprint template may increase.

[0024] An electronic device can acquire a fingerprint image frame by sampling a user's fingerprint through a fingerprint sensor. The acquired fingerprint image frame can be stored in the electronic device's memory. As the percentage of duplicate information contained in the acquired fingerprint image frames increases, the number of fingerprint image frames required to acquire a fingerprint template may increase. Since the storage capacity of the electronic device's memory is limited, it is necessary to reduce the number of fingerprint image frames that are unnecessarily acquired.

[0025] The technical problems to be achieved in this document are not limited to the technical problems mentioned above, and other technical problems not mentioned can be clearly understood by a person having ordinary skill in the technical field to which the present invention pertains from the description of this disclosure.

[0026] FIG. 1 is a block diagram of an electronic device (101) within a network environment (100) according to various embodiments. Referring to FIG. 1, in the network environment (100), the electronic device (101) may communicate with the electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with at least one of the electronic device (104) or the server (108) via a second network (199) (e.g., a long-range wireless communication network). In one embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display module (160), an audio module (170), a sensor module (176), an interface (177), a connection terminal (178), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197). In some embodiments, the electronic device (101) may omit at least one of these components (e.g., the connection terminal (178)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor module (176), the camera module (180), or the antenna module (197)) may be integrated into one component (e.g., the display module (160)).

[0027] The processor (120) may, for example, execute software (e.g., a program (140)) to control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) and perform various data processing or operations. According to one embodiment, as at least a part of the data processing or operations, the processor (120) may store commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the commands or data stored in the volatile memory (132), and store result data in a non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or an auxiliary processor (123) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together with the main processor (121). For example, when the electronic device (101) includes the main processor (121) and the auxiliary processor (123), the auxiliary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a given function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as a part thereof.

[0028] The auxiliary processor (123) may control at least a portion of functions or states associated with at least one component (e.g., a display module (160), a sensor module (176), or a communication module (190)) of the electronic device (101), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or can be performed through a separate server (e.g., server (108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.

[0029] The memory (130) can store various data used by at least one component (e.g., processor (120) or sensor module (176)) of the electronic device (101). The data can include, for example, software (e.g., program (140)) and input data or output data for commands related thereto. The memory (130) can include volatile memory (132) or non-volatile memory (134).

[0030] The program (140) may be stored as software in the memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

[0031] The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0032] The audio output module (155) can output audio signals to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. In one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.

[0033] The display module (160) can visually provide information to an external party (e.g., a user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.

[0034] The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150), output sound through the sound output module (155), or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (101).

[0035] The sensor module (176) can detect the operating status (e.g., power or temperature) of the electronic device (101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0036] The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) with an external electronic device (e.g., the electronic device (102)). In one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0037] The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0038] The haptic module (179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. According to one embodiment, the haptic module (179) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

[0039] The camera module (180) can capture still images and videos. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0040] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

[0041] A battery (189) may power at least one component of the electronic device (101). In one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0042] The communication module (190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may operate independently from the processor (120) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module, or a power line communication module). Among these communication modules, the corresponding communication module can communicate with an external electronic device (104) via a first network (198) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules can be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can verify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) by using subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196).

[0043] The wireless communication module (192) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (192) can support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), an external electronic device (e.g., the electronic device (104)), or a network system (e.g., the second network (199)). According to one embodiment, the wireless communication module (192) can support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC realization.

[0044] The antenna module (197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna module (197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). In one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), may be selected from the plurality of antennas, for example, by the communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device via the at least one selected antenna. In some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (197).

[0045] According to various embodiments, the antenna module (197) may form a mmWave antenna module. In one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high-frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high-frequency band.

[0046] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).

[0047] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199). Each of the external electronic devices (102 or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices (102, 104, or 108). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (101) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server utilizing machine learning and / or a neural network. According to one embodiment, the external electronic device (104) or the server (108) may be included in the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0048] FIG. 2 conceptually illustrates the configuration of an electronic device (101) and the process of obtaining fingerprint information according to one embodiment.

[0049] In one embodiment, the electronic device (101) may include a processor (120), a memory (130), and a fingerprint sensor (200). For example, the fingerprint sensor (200) may be further included in the sensor module (176) illustrated in FIG. 1. The fingerprint sensor (200) may include a microcontroller (MCU, microcontroller unit) (201). However, the present invention is not limited thereto. For example, the electronic device (101) may include a fingerprint sensor (200) that does not include a microcontroller (201). In the present disclosure, it may be understood that the operation of the fingerprint sensor (200) is controlled by at least one of the processor (120) or the microcontroller (201) executing instructions stored in the memory (130).

[0050] In one embodiment, the fingerprint sensor (200) may output a fingerprint image frame (211) that captures a fingerprint image when the user's (10) finger is in proximity to or in contact with the fingerprint recognition area where the fingerprint sensor (200) is placed. The fingerprint image frame (211) may refer to a unit of fingerprint data for areas that the fingerprint sensor can acquire through one unit of sampling operation. Since the area of ​​the fingerprint sensor (200) is limited, the electronic device (101) may acquire a plurality of fingerprint image frames (213) in order to acquire sufficient information about the fingerprint (11) of the user (10). For example, the electronic device (101) may cause the fingerprint sensor (200) to perform a sampling operation for capturing a fingerprint image frame multiple times while the user's (10) finger is sliding on the fingerprint recognition area or rubbed against the fingerprint recognition area. In the present disclosure, while outputting a plurality of fingerprint image frames (213), the number of fingerprint image frames output by the fingerprint sensor (200) per unit time may be referred to as a frame rate. The frame rate may be expressed, for example, in frames per second (fps). The fingerprint image frames output from the fingerprint sensor (200) may be stored in the memory (130).

[0051] In one embodiment, the electronic device (101) may obtain fingerprint information (215) for a fingerprint (11) by performing an operation on a plurality of fingerprint image frames (213). The fingerprint information (215) may include, for example, a fingerprint image obtained by connecting fingerprint images included in the plurality of fingerprint image frames (213). Alternatively, for example, the fingerprint information (215) may include information on a feature point obtained from the plurality of fingerprint image frames (213). A feature point may mean a point within an image that has a feature for comparing the image with another image.

[0052] In one embodiment, the electronic device (101) may obtain a fingerprint template (217) based on fingerprint information (215). In the present disclosure, the fingerprint template (217) may refer to a unit of fingerprint data used to perform an operation related to a fingerprint (11) of a user (10). For example, the fingerprint template (217) may be registered as information about the fingerprint (11) of the user (10) in the electronic device (101) (or an external electronic device (e.g., the electronic device (102, 104) of FIG. 1, the server (108)). For example, the fingerprint template (217) may refer to a unit of data to be compared in a fingerprint matching operation to determine whether it matches fingerprint information registered in the electronic device (101) (or an external electronic device (e.g., the electronic device (102, 104) of FIG. 1, the server (108)).

[0053] In one embodiment, the electronic device (101) may adjust a frame rate for the fingerprint sensor (200) to acquire or output the fingerprint image frame (211) to efficiently perform the operation of acquiring the fingerprint image frame (211). For example, the electronic device (101) may lower the frame rate when the user's (10) finger moves slowly while capturing the plurality of fingerprint image frames (213). For example, the electronic device (101) may increase the frame rate when the user's (10) finger moves quickly while capturing the plurality of fingerprint image frames (213).

[0054] FIG. 3 illustrates a method of inputting fingerprint information through a fingerprint sensor (200) of an electronic device (101) according to one embodiment.

[0055] In one embodiment, the electronic device (101) may acquire a plurality of fingerprint image frames (e.g., fingerprint image frames (213) of FIG. 2) by sampling a signal for acquiring a fingerprint image multiple times while the body of the user (10) (e.g., a part of the finger with a fingerprint) is in contact with or close to the fingerprint sensor (200) and sliding in one direction (311). However, the direction (311) in which the body of the user (10) slides is not limited thereto. For example, the electronic device may also acquire a plurality of fingerprint image frames while the body of the user (10) slides in the opposite direction to the direction (311) illustrated in FIG. 3.

[0056] In one embodiment, the electronic device (101) may acquire a plurality of fingerprint image frames (e.g., fingerprint image frames (213) of FIG. 2) by having the fingerprint sensor (200) sample a signal for acquiring a fingerprint image multiple times while the user's (10) body (e.g., a part of the finger with a fingerprint) rubs in various directions while in contact with or in proximity to the fingerprint sensor (200).

[0057] FIG. 4 is a flowchart (400) illustrating a process in which an electronic device (e.g., an electronic device (101) of FIGS. 1 to 3) according to one embodiment acquires a fingerprint template through a fingerprint sensor (e.g., a fingerprint sensor (200) of FIGS. 1 to 2).

[0058] In the following examples, the operations may be performed sequentially, but are not necessarily sequential. For example, the order of the operations may be changed, and at least two operations may be performed in parallel.

[0059] In operation 410, an electronic device according to an embodiment may control a fingerprint sensor to output a fingerprint image frame (e.g., fingerprint image frame (211) of FIG. 2). For example, if a fingerprint registration function is executed through an application running on the electronic device, the electronic device may initiate the process illustrated in the flowchart (400). For example, if an authentication function for authenticating whether a user is a registered user is executed, the electronic device may also initiate the process illustrated in the flowchart (400). If a frame rate for outputting a fingerprint image frame is not set, the electronic device may output a next fingerprint image frame after outputting a previous fingerprint image frame based on a sampling time interval corresponding to a frame rate according to a default setting. If a frame rate for outputting a fingerprint image frame is not set, the electronic device may control a sampling time interval at which the fingerprint sensor outputs a fingerprint image frame based on a sampling time interval corresponding to the set frame rate. The frame rate at which the fingerprint sensor outputs fingerprint image frames can be controlled by at least one of a processor (e.g., an application processor (AP)) or a microcontroller (e.g., an MCU (201) of FIG. 2) of the electronic device. The fingerprint image output in operation 410 can be stored in a memory (e.g., a memory (130) of FIGS. 1 and 2).

[0060] In operation 420, an electronic device according to an embodiment may determine whether a fingerprint template (e.g., fingerprint template (217) of FIG. 2) is complete based on the fingerprint image frame output in operation 410. For example, the electronic device may determine whether the fingerprint template is complete based on whether a sufficient amount of fingerprint information has been acquired from fingerprint images included in fingerprint image frames accumulated and stored in a memory. If the fingerprint template is determined to be complete, the electronic device may terminate a scanning operation for acquiring the fingerprint template and execute a function performed using the fingerprint template. For example, the electronic device may store the fingerprint template in a secure area of ​​the electronic device to register the fingerprint template. For example, the electronic device may determine whether the fingerprint template matches fingerprint information stored in the secure area of ​​the electronic device. For example, the electronic device may communicate with a server to determine whether the fingerprint template matches a fingerprint of a user registered in the server.

[0061] In operation 430, the electronic device according to one embodiment may determine whether the size of the overlapping area including the overlapping fingerprint image between the fingerprint image frames in operation 410 is within a specified range. For example, if the size of the overlapping area is greater than or equal to about 10% and less than or equal to about 20% of the size of the fingerprint image frame, the electronic device may determine that the size of the overlapping area is within the specified range. In one embodiment, if the size of the overlapping area is within the specified range, the electronic device may maintain the set frame rate. The electronic device may output the next fingerprint image frame in operation 410 based on the previously set frame rate.

[0062] In one embodiment, based on determining that the size of the overlapping area is outside the point range, the electronic device may perform operation 440. In operation 440, the electronic device according to one embodiment may change the frame rate so that the size of the overlapping area for the fingerprint image frame output in operation 410 falls within a specified range when outputting the next fingerprint image frame. For example, the electronic device may determine a movement (e.g., at least one of a speed or a direction) of the fingerprint image determined based on previously acquired fingerprint image frames. When capturing a fingerprint image frame after a specified sampling time interval according to the determined movement, the electronic device may determine the size of the overlapping area that overlaps with the previously acquired fingerprint image frames. The electronic device may determine a frame rate corresponding to a sampling time interval such that the size of the overlapping area becomes about 15% of the size of the fingerprint image frame. The electronic device may increase or decrease a previously set frame rate. The electronic device may capture the next fingerprint image frame in operation 410 based on the changed frame rate.

[0063] In one embodiment, the electronic device may omit performing operations 430 and 440 for a specified period of time from the time of initiating a fingerprint scan operation to obtain a fingerprint template. For example, the electronic device may maintain the frame rate while N fingerprint image frames are output, and adjust the frame rate based on operations 430 and 440 after the N fingerprint image frames are output.

[0064] In one embodiment, the electronic device may determine a frame rate corresponding to a sampling time interval until the next fingerprint image frame is to be output each time a fingerprint image frame is output, without determining whether to maintain the frame rate. For example, the operating method of the electronic device according to one embodiment may omit operation 430.

[0065] FIG. 5 illustrates the positions of feature points indicating movement of a fingerprint image between fingerprint image frames (e.g., fingerprint image frame (211) and fingerprint image frames (213) of FIG. 2) acquired by an electronic device (e.g., electronic device (101) of FIGS. 1 to 3) according to one embodiment.

[0066] In one embodiment, the electronic device may extract feature points from a fingerprint image. For example, the electronic device may extract feature points for valley regions and ridge regions detected within the fingerprint image. The valley region may refer to the region where the valley shape of the fingerprint is captured. The ridge region may refer to the region where the ridge shape of the fingerprint is captured.

[0067] Referring to FIG. 5, the electronic device can obtain the second fingerprint image frame (520) output after a sampling time interval corresponding to a set frame rate from the time point at which the first fingerprint image frame (510) is output. The electronic device can extract the first feature point (511) and the second feature point (512) from the first fingerprint image frame (510). The electronic device can extract the third feature point (521) and the fourth feature point (522) from the second fingerprint image frame (520). The third feature point (521) may correspond to the first feature point (511). The fourth feature point (522) may correspond to the second feature point (512).

[0068] In one embodiment, the electronic device may compare the position of the first feature point (511) within the first fingerprint image frame (510) with the position of the third feature point (521) within the second fingerprint image frame (520). The electronic device may determine the speed at which the fingerprint image within the fingerprint image frames (510, 520) moves based on the distance between the position of the first feature point (511) and the position of the third feature point (521) and the sampling time interval. In one embodiment, the electronic device may also determine the direction in which the fingerprint image moves based on the difference between the position of the first feature point (511) and the position of the third feature point (521). In one embodiment, the electronic device may further consider the position of the second feature point (512) within the first fingerprint image frame (510) and the position of the fourth feature point (522) within the second fingerprint image frame (520) to determine at least one of the speed or direction in which the fingerprint image moves.

[0069] However, the method for determining the movement of a fingerprint image based on the feature points illustrated in FIG. 5 is presented as an example of an implementation method related to an electronic device and its operating method according to one embodiment, and the method for determining the movement of a fingerprint image is not limited thereto.

[0070] FIG. 6 illustrates an overlapping area (633) formed according to the movement direction of a fingerprint image between fingerprint image frames (e.g., fingerprint image frames (213) of FIG. 2) acquired by an electronic device (e.g., electronic device (101) of FIGS. 1 to 3) according to one embodiment.

[0071] In one embodiment, the electronic device can obtain a first fingerprint image frame (610) output from a fingerprint sensor. The electronic device can obtain a second fingerprint image frame (620) after a sampling time interval corresponding to a set frame rate from the time at which the first fingerprint image frame (610) is output. The electronic device can determine a movement (631) of the fingerprint image between the first fingerprint image frame (610) and the second fingerprint image frame (620). The electronic device can determine an overlapping area (633) between the first fingerprint image frame (610) and the second fingerprint image frame (620) based on the movement (631) of the fingerprint image.

[0072] FIG. 6 illustrates an overlapping area (633) between two fingerprint image frames (610, 620), but is not limited thereto. For example, an electronic device according to an embodiment may determine an overlapping area, among areas to be captured in a fingerprint image frame to be acquired in the next sequence, that overlaps with areas captured in a plurality of previously acquired fingerprint image frames. The area to be captured in a fingerprint image frame to be acquired in the next sequence may be determined based on the movement of the fingerprint image determined from at least some of the previously acquired plurality of fingerprint image frames and the frame rate (or a sampling time interval corresponding to the frame rate) for capturing the next fingerprint image frame. For example, the electronic device may determine an overlapping area, among areas captured in an image frame acquired in the current step, that overlaps with areas captured in a plurality of previously acquired image frames.

[0073] FIG. 7 illustrates an example in which an electronic device (e.g., the electronic device (101) of FIGS. 1 to 3) according to one embodiment overlaps fingerprint images included in fingerprint image frames (710, 720, 730) moving in a single direction.

[0074] A fingerprint sensor of an electronic device according to one embodiment (e.g., a fingerprint sensor (200) of FIGS. 2 to 3) may sequentially output a first fingerprint image frame (710), a second fingerprint image frame (720), and a third fingerprint image frame (730). FIG. 7 illustrates an example in which an overlapping area between fingerprint images included in two fingerprint image frames is approximately 50% of the size of the fingerprint image frames.

[0075] Referring to FIG. 7, when the size of the overlapping area is about 50%, the first partial image (721) of the second fingerprint image frame (720) may overlap with the fingerprint image included in the first fingerprint image frame (710). The second partial image (722) of the second fingerprint image frame (720) may overlap with the fingerprint image included in the third fingerprint image frame (730). Therefore, all fingerprint images captured in the second fingerprint image frame (720) may overlap with the fingerprint images included in the first fingerprint image frame (710) or the third fingerprint image frame (730). In this case, the electronic device may have to perform an unnecessary amount of computational processing related to the overlapping area. In one embodiment, the electronic device may adjust the frame rate of the fingerprint sensor so that the size of the overlapping area falls within a specified range in order to reduce the amount of unnecessary computation and efficiently use the capacity of the memory that stores the fingerprint image frames.

[0076] FIG. 8 illustrates an example of a time interval at which a fingerprint sensor (e.g., a fingerprint sensor (200) of FIGS. 2 to 3) of an electronic device (e.g., an electronic device (101) of FIGS. 1 to 3) samples a fingerprint image frame according to one embodiment.

[0077] In one embodiment, an electronic device may initiate a fingerprint scan operation to obtain a fingerprint template. The electronic device may control a fingerprint sensor to output fingerprint image frames based on a fixed frame rate for a specified period (810) from a time point (800) initiating the fingerprint scan operation. For example, if a frame rate determined based on a previously performed fingerprint scan operation is stored, the fingerprint sensor may output fingerprint image frames for a first period (810) based on the stored frame rate. The first period (810) may be pre-specified, for example, as a time interval or a number of output frames.

[0078] In one embodiment, the electronic device can determine the size of the overlapping area based on previously acquired fingerprint image frames. During a second period (820) of acquiring image frames for acquiring a fingerprint image template after a specified first period (810) has elapsed, the electronic device can adjust the interval at which the fingerprint sensor outputs fingerprint image frames according to a frame rate determined based on the determined size of the overlapping area. If the fingerprint sensor is equipped with a microcontroller (e.g., MCU (201) of FIG. 2), the operations of determining the frame rate and adjusting the interval at which the fingerprint sensor outputs fingerprint image frames can be controlled by the microcontroller. Referring to FIG. 8, although fingerprint image frames are illustrated as being output at similar intervals during the second period (820), in one embodiment, the electronic device can dynamically adjust the interval at which the fingerprint image frames are output during the second period (820). For example, the electronic device may determine a frame rate for the fingerprint sensor each time it samples a signal from the fingerprint sensor to obtain an image fingerprint image frame, and determine when to perform a sampling operation to output the next fingerprint image frame based on the determined frame rate. For example, the electronic device may determine a frame rate for the fingerprint sensor at specified intervals, and determine when to perform a sampling operation to output the next fingerprint image frame based on the determined frame rate. For example, the electronic device may determine a frame rate for the fingerprint sensor each time it outputs a specified number of fingerprint image frames, and determine when to perform a sampling operation to output the next fingerprint image frame based on the determined frame rate. However, the above-described example describes an example of an implementation method for an electronic device to adjust a frame rate according to one embodiment, and is not limited thereto.

[0079] In one embodiment, if the fingerprint sensor does not include a microcontroller, the electronic device may have difficulty adjusting the frame rate while acquiring fingerprint image templates for constructing a fingerprint template. The electronic device may maintain the frame rate set in the first period (810) while acquiring fingerprint image templates for constructing a fingerprint template.

[0080] FIG. 9 conceptually illustrates motion vectors for fingerprint image frames acquired by an electronic device (e.g., the electronic device (101) of FIGS. 1 to 3) according to one embodiment.

[0081] In one embodiment, an electronic device may determine a frame rate of a fingerprint sensor (e.g., fingerprint sensor (200) of FIGS. 2 and 3) based on fingerprint image frames. The electronic device may extract a first feature point (911) from a first fingerprint image frame (910). The electronic device may extract a second feature point (921) from a second fingerprint image frame (920). The first fingerprint image frame (910) may be output in a previous order to the second fingerprint image frame (920).

[0082] In one embodiment, the electronic device may compare the position of the first feature point (911) with the position of the second feature point (921) within the fingerprint image frame (900). The electronic device may obtain a motion vector (930) indicating a distance and direction moved from the position of the first feature point (911) to the second feature point (921). In the present disclosure, the motion vector (930) may be referred to as indicating a movement with respect to the second fingerprint image frame (920). The motion vector (930) may include a first component (Vx) in a first direction (e.g., a horizontal direction) and a second component (Vy) in a second direction (e.g., a vertical direction). The electronic device may determine a frame rate for obtaining a next fingerprint image frame based on the motion vector (930). For example, at a stage where the t-th fingerprint image frame is output, the electronic device can calculate (or predict) Vx(t+1) and Vy(t+1) of the t+1-th fingerprint image frame based on n motion vectors Vx(tn, t-n+1, ​​... , t) and Vy(tn, t-n+1, ​​... , t) including the motion vector of the t-th fingerprint image frame.

[0083] For example, when the second fingerprint image frame is output, the electronic device can determine Vx(3) and Vy(3), which are components of the motion vector for the motion for the third fingerprint image frame, based on the following mathematical expression 1.

[0084]

[0085]

[0086] The above mathematical formula 1 is merely an example to aid understanding and is not limited thereto, and can be modified, applied, or expanded in various ways.

[0087] Here, wt1 may be a weight for the motion vector of the t-th fingerprint image frame, and wt2 may be a weight for the motion vector of the t-1th fingerprint image frame. wt1 may have a value greater than wt2. For example, wt1 may be 0.6, and wt2 may be 0.4.

[0088] In one embodiment, the number of motion vectors considered for determining the motion vector for the next fingerprint image frame may be configured differently depending on the implementation example. For example, when the t-th fingerprint image frame is output, the components Vx(t+1) and Vy(t+1) of the motion vector of the next fingerprint image frame, which is determined based on the motion vectors for the four fingerprint image frames, may be determined based on the following mathematical expression 2.

[0089]

[0090]

[0091] The above mathematical formula 2 is merely an example to aid understanding and is not limited thereto, and can be modified, applied, or expanded in various ways.

[0092] wt1 may be a weight for the motion vector of the t-th fingerprint image frame, wt2 may be a weight for the motion vector of the t-1th fingerprint image frame, wt3 may be a weight for the motion vector of the t-2th fingerprint image frame, and wt4 may be a weight for the motion vector of the t-3th fingerprint image frame. For example, wt1 may be 0.4, wt2 may be 0.3, wt3 may be 0.2, and wt4 may be 0.1.

[0093] In one embodiment, the electronic device may determine a motion vector for the next fingerprint image frame using a predictive model. For example, the electronic device may determine a motion vector for the next fingerprint image frame based on a predictive model that predicts movement based on a pattern in which a fingerprint image moves during a fingerprint scan operation. The predictive model may include, for example, a Kalman filter, which is a recursive filter that estimates a state based on the locations of feature points of previous fingerprint image frames. The type of the predictive model is not limited thereto. The predictive model may be mounted on the MCU (201) of the fingerprint sensor (200), but is not limited thereto.

[0094] In one embodiment, the electronic device can determine the size of the overlap region, which is the area in the fingerprint image frame where the fingerprint image before movement remains when the fingerprint image moves according to the determined motion vector. The electronic device can determine a frame rate that causes the size of the overlap region to become a specified value based on the size of the overlap region. The specified value can be understood to include a margin of error from the specified value. For example, when scanning a fingerprint moving in one direction (e.g., one direction (311) of FIG. 3), the electronic device can determine the frame rate based on the length of the fingerprint sensor (or fingerprint image frame) with respect to the direction of movement of the fingerprint. If the determined size of the overlap region is about 50%, the length of the fingerprint sensor (or fingerprint image frame) is about 1.6 mm, and the specified value is about 15%, the distance the fingerprint image has moved is about 0.8 mm (1.6 * 0.5), and the fingerprint image must move by about 1.36 mm (1.6 * 0.15) for the size of the overlap region to become the specified value. Therefore, in order for the size of the overlap region to become the specified value, the electronic device must capture (sample) the next fingerprint image frame after the fingerprint image has moved approximately 1.7 times further than the expected time at which the next fingerprint image frame is captured (sampled). Therefore, since the time interval until the time at which the next fingerprint image frame is captured (sampled) must be approximately 1.7 times, the electronic device can adjust the frame rate to approximately 58.8% (1 / 1.7) of the preset frame rate. For example, the electronic device can adjust the frame rate of the fingerprint sensor based on the distance that the feature points have moved between fingerprint image frames divided by the distance that the fingerprint images must move so that the size of the overlap region becomes the specified value.

[0095] In one embodiment, the electronic device may be implemented to adjust the frame rate based on the size of the overlapping area between the previously acquired fingerprint image frames without predicting the location of the next fingerprint image frame. For example, when the t-th fingerprint image frame is output, if the overlapping area between the t-th fingerprint image frame and the t-1-th fingerprint image frame is about 50%, the electronic device may adjust the frame rate to about 58.8% of the preset frame rate.

[0096] FIG. 10 illustrates an example of a movement trajectory corresponding to fingerprint image frames (e.g., fingerprint image frames (213) of FIG. 2) acquired by an electronic device (e.g., electronic device (101) of FIGS. 1 to 3) according to one embodiment.

[0097] In one embodiment, the electronic device can obtain fingerprint data (1020) for a wide area by removing and connecting overlapping areas of fingerprint images included in fingerprint image frames obtained from a fingerprint sensor (e.g., the fingerprint sensor (200) of FIGS. 2 to 3). As the user's fingerprint moves while capturing the fingerprint image frames, a fingerprint image can be obtained along a movement trajectory (1000) within the fingerprint. The electronic device can determine an overlapping area where a fingerprint image to be captured in a fingerprint image frame to be obtained in a next step overlaps with fingerprint data (1020) based on the movement trajectory (1000). The electronic device can determine a frame rate of the fingerprint sensor (e.g., the fingerprint sensor (200) of FIGS. 2 to 3) based on the determined overlapping area.

[0098] In one embodiment, the electronic device can determine (predict) an area (1010) of a fingerprint image to be captured in the next fingerprint image frame. The electronic device can determine the frame rate of the fingerprint sensor based on the degree to which fingerprint information to be included in the determined area (1010) overlaps with previously acquired fingerprint data (1020). For example, the electronic device can maintain the frame rate of the fingerprint sensor without changing it if about 90% or more of the fingerprint information to be included in the determined area (1010) overlaps with the previously acquired fingerprint data (1020). If the fingerprint data (1020) is acquired along the movement trajectory (1000) illustrated in FIG. 10, adjusting the frame rate so that the size of the overlapping area in the next fingerprint image frame becomes a specified value (e.g., about 15%) may excessively lower the frame rate, which may increase the time required to acquire a fingerprint template. The electronic device can maintain the frame rate without change according to the specified conditions so that the frame rate is not excessively low by adjusting the frame rate so that the size of the overlapping area of ​​the next fingerprint image frame becomes a specified value based on the movement trajectory (1000).

[0099] FIG. 11 is a flowchart (1100) illustrating a process for dynamically adjusting a sampling rate during a process in which an electronic device (e.g., the electronic device (101) of FIGS. 1 to 3) performs a fingerprint scan operation according to one embodiment.

[0100] In the following examples, the operations may be performed sequentially, but are not necessarily sequential. For example, the order of the operations may be changed, and at least two operations may be performed in parallel.

[0101] In operation 1110, the electronic device according to one embodiment may initiate a fingerprint scanning operation. For example, the electronic device may activate a fingerprint sensor (e.g., fingerprint sensor (200) of FIGS. 2 and 3) in response to a user input that causes the electronic device to execute a function for registering the user's fingerprint.

[0102] In operation 1120, the electronic device according to one embodiment may determine whether there is a frame rate stored in a memory (e.g., memory (130) of FIGS. 1 and 2) in relation to the operation of the fingerprint sensor. For example, the frame rate stored in the memory may include a frame rate determined based on a result of an operation of the electronic device acquiring a fingerprint template prior to operation 1110. If there is no frame rate stored in the memory, the electronic device may set a default setting frame rate stored as a default value as a frame rate for the operation of the fingerprint sensor in operation 1131. If there is a frame rate stored in the memory, the electronic device may set the frame rate stored in the memory as a frame rate for the operation of the fingerprint sensor in operation 1133. In one embodiment, the operation of setting a frame for the fingerprint sensor in operation 1131 or operation 1133 may be performed by a processor of the electronic device (e.g., processor (120) of FIG. 2).

[0103] In operation 1140, the electronic device according to one embodiment may sample a signal of a fingerprint sensor to be captured in a fingerprint image frame based on a frame rate set in operation 1131 or operation 1133 during a specified period. For example, the electronic device may capture N fingerprint image frames based on the frame rate set in operation 1140.

[0104] In operation 1150, an electronic device according to one embodiment may determine whether a fingerprint template is complete based on previously acquired fingerprint image frames. For example, the electronic device may combine fingerprint information contained in the fingerprint image frames to construct a fingerprint template. In one example, the electronic device may determine whether the fingerprint template is complete based on whether the amount of fingerprint information contained in the constructed fingerprint template is sufficient to register the fingerprint information or determine whether a fingerprint match has occurred.

[0105] If it is determined that the fingerprint template is not complete, in operation 1160, the electronic device according to one embodiment may determine a sampling rate for capturing the next fingerprint image frame. In operation 1160, the electronic device may determine a frame rate so that the size of the overlapping area for the next fingerprint image frame corresponds to a specified value. In one embodiment, operation 1160 may be performed by a processor included in the fingerprint sensor (e.g., the MCU (201) of FIG. 2) by an external processor while the fingerprint sensor performs an operation of scanning a fingerprint. In operation 1170, the electronic device according to one embodiment may perform a sampling operation of sampling a signal of the fingerprint sensor to capture the next fingerprint image frame based on the frame rate determined in operation 1160. The electronic device may perform operation 1150 of determining whether the fingerprint template is complete based on the fingerprint image frame acquired in operation 1170.

[0106] If it is determined in operation 1150 that the fingerprint template is complete, in operation 1180, the electronic device according to one embodiment may store the last determined frame rate in a memory (e.g., memory (130) of FIGS. 1 and 2). Based on the determination in operation 1150 that the fingerprint template is complete, the electronic device may execute a function of the electronic device associated with fingerprint information based on the fingerprint template.

[0107] FIG. 12 is a flowchart (1200) illustrating a process for obtaining a fingerprint template based on a frame rate determined at the time when an electronic device (e.g., the electronic device (101) of FIGS. 1 to 3) initiates a fingerprint scanning operation according to one embodiment.

[0108] In the following examples, the operations may be performed sequentially, but are not necessarily sequential. For example, the order of the operations may be changed, and at least two operations may be performed in parallel.

[0109] In operation 1210, the electronic device according to one embodiment may initiate a fingerprint scanning operation. For example, the electronic device may activate a fingerprint sensor (e.g., fingerprint sensor (200) of FIGS. 2 and 3) in response to a user input that causes the electronic device to execute a function for registering a user's fingerprint.

[0110] In operation 1220, the electronic device according to one embodiment may determine whether there is a frame rate stored in a memory (e.g., memory (130) of FIGS. 1 and 2) in relation to the operation of the fingerprint sensor. For example, the frame rate stored in the memory may include a frame rate determined based on a result of the electronic device performing an operation of acquiring a fingerprint template prior to operation 1210. If there is no frame rate stored in the memory, the electronic device may set a default setting frame rate stored as a default value as the frame rate for the operation of the fingerprint sensor in operation 1231. If there is a frame rate stored in the memory, the electronic device may set the frame rate stored in the memory as the frame rate for the operation of the fingerprint sensor in operation 1233. In one embodiment, the operation of setting a frame for the fingerprint sensor in operation 1231 or operation 1233 may be performed by a processor of the electronic device (e.g., processor (120) of FIG. 2).

[0111] In operation 1240, the electronic device according to one embodiment may perform a sampling operation to sample a signal of the fingerprint sensor to capture a fingerprint image frame based on a frame rate set by at least one of operation 1231 or operation 1233.

[0112] In operation 1250, an electronic device according to one embodiment may determine whether a fingerprint template is complete based on at least one previously acquired fingerprint image frame. For example, the electronic device may configure a fingerprint template by combining fingerprint information included in at least one fingerprint image frame. In one example, the electronic device may determine whether the fingerprint template is complete based on whether the amount of fingerprint information included in the configured fingerprint template is sufficient to register the fingerprint information or determine whether a fingerprint match has occurred. Based on determining that the fingerprint template is incomplete, the electronic device may perform operation 1240 to capture the next fingerprint image frame.

[0113] If it is determined that the fingerprint template is complete in operation 1250, a frame rate may be determined based on fingerprint image frames captured while acquiring the fingerprint template in operation 1280. For example, the electronic device may determine a frame rate such that an overlapping area between fingerprint image frames is within a specified range by adjusting a time interval for outputting the acquired fingerprint image frames. The electronic device may store the determined frame rate in a memory (e.g., memory (130) of FIGS. 1 and 2) so that it can be used in the next fingerprint scan operation. Based on the determination that the fingerprint template is complete in operation 1250, the electronic device may execute a function of the electronic device associated with fingerprint information based on the fingerprint template.

[0114] FIG. 13 is a flowchart (1300) illustrating a process in which an electronic device (e.g., the electronic device (101) of FIGS. 1 to 3) according to one embodiment provides a guide to a user according to an acquired fingerprint image frame.

[0115] In the following examples, the operations may be performed sequentially, but are not necessarily sequential. For example, the order of the operations may be changed, and at least two operations may be performed in parallel.

[0116] In operation 1310, an electronic device according to an embodiment may determine whether an area of ​​a fingerprint image to be captured in an image frame (e.g., area 1010 of FIG. 10) acquired by an operation of acquiring an image frame (e.g., operation 1170 of FIG. 11) or a next image frame is larger than or equal to a threshold value of overlapping area with previously acquired fingerprint data (e.g., fingerprint data (1020) of FIG. 10). For example, the electronic device may determine whether the overlapping area is greater than or equal to about 70%.

[0117] Based on the determination that the overlapping area is greater than or equal to a threshold, the electronic device according to one embodiment may perform a guide operation for fingerprint input in operation 1320. For example, the electronic device may perform an operation of displaying a user interface including information for moving the user's finger so that a fingerprint image is acquired in a direction in which fingerprint information is not acquired. For example, the user interface may include information for indicating a direction in which the finger is moved so that an area in which fingerprint information is not input is input. The electronic device may also perform the guide operation through another form of notification. For example, the electronic device may operate a vibration motor included in the electronic device or output a sound through a speaker based on the determination that the overlapping area is greater than or equal to a threshold. The electronic device may induce a wider coverage of the input fingerprint information through the guide for fingerprint input.

[0118] In one embodiment, the electronic device may repeatedly perform the operations depicted in the flowchart (1300) until the fingerprint template is completed.

[0119] An electronic device (e.g., an electronic device (101) of FIGS. 1 to 3) according to one embodiment may include a fingerprint sensor (e.g., a fingerprint sensor (200) of FIGS. 1 to 2), one or more processors (e.g., a processor (120) of FIGS. 1 to 2, an MCU (201) of FIG. 2), and a memory (e.g., a memory (130) of FIGS. 1 to 2) storing one or more commands. The one or more commands may be executed by the one or more processors (e.g., a processor (120) of FIGS. 1 to 2, an MCU (201) of FIG. 2) to cause the electronic device (e.g., an electronic device (101) of FIGS. 1 to 3) to cause the fingerprint sensor (e.g., a fingerprint sensor (200) of FIGS. 1 to 2) to output a plurality of fingerprint image frames, wherein at least one of the plurality of fingerprint image frames is output based on a first frame rate. The one or more commands may be executed by the one or more processors (e.g., the processor (120) of FIGS. 1 to 2, the MCU (201) of FIG. 2) to cause the electronic device (e.g., the electronic device (101) of FIGS. 1 to 3) to determine a second frame rate such that the size of an overlapping area determined based on fingerprint image frames output from the fingerprint sensor (e.g., the fingerprint sensor (200) of FIGS. 1 to 2) is within a specified range. The one or more commands may be executed by the one or more processors (e.g., the processor (120) of FIGS. 1 to 2, the MCU (201) of FIG. 2) to cause the electronic device (e.g., the electronic device (101) of FIGS. 1 to 3) to change a frame rate at which the fingerprint sensor (e.g., the fingerprint sensor (200) of FIGS. 1 to 2) outputs fingerprint image frames to the second frame rate.

[0120] In one embodiment, the one or more instructions may be executed by the one or more processors (e.g., the processor (120) of FIGS. 1 to 2, the MCU (201) of FIG. 2) to cause the electronic device (e.g., the electronic device (101) of FIGS. 1 to 3) to determine the second frame rate as a value smaller than the first frame rate when the size of the overlapping area exceeds a specified range, and to determine the second frame rate as a value larger than the first frame rate when the size of the overlapping area is less than the specified range.

[0121] In one embodiment, the one or more commands may be executed by the one or more processors (e.g., the processor (120) of FIGS. 1 to 2, the MCU (201) of FIG. 2) to cause the electronic device (e.g., the electronic device (101) of FIGS. 1 to 3) to determine whether a first fingerprint template is complete based on the plurality of fingerprint image frames. The one or more commands may be executed by the one or more processors (e.g., the processor (120) of FIGS. 1 to 2, the MCU (201) of FIG. 2) to cause the electronic device (e.g., the electronic device (101) of FIGS. 1 to 3) to determine whether fingerprint information stored in the memory (e.g., the memory (130) of FIGS. 1 to 2) matches the first fingerprint template, and to store the second frame rate in the memory (e.g., the memory (130) of FIGS. 1 to 2)) based on the determination that the first fingerprint template is complete. The one or more commands may be executed by the one or more processors (e.g., the processor (120) of FIGS. 1 to 2, the MCU (201) of FIG. 2) to control the fingerprint sensor (e.g., the fingerprint sensor (200) of FIGS. 1 to 2) to output a fingerprint image frame based on the second frame rate when the electronic device (e.g., the electronic device (101) of FIGS. 1 to 3) initiates a fingerprint detection operation to obtain a second fingerprint template after the first fingerprint template is completed.

[0122] In one embodiment, the one or more commands may be executed by the one or more processors (e.g., the processor (120) of FIGS. 1 to 2, the MCU (201) of FIG. 2) to cause the electronic device (e.g., the electronic device (101) of FIGS. 1 to 3) to determine a location of a next fingerprint image frame for the plurality of fingerprint image frames based on a trajectory of the plurality of fingerprint image frames. The one or more commands may be executed by the one or more processors (e.g., the processor (120) of FIGS. 1 to 2, the MCU (201) of FIG. 2) to cause the electronic device (e.g., the electronic device (101) of FIGS. 1 to 3) to maintain the first frame rate when an area in which the next fingerprint image frame overlaps at least one of the plurality of fingerprint image frames is greater than or equal to a threshold.

[0123] In one embodiment, the one or more commands may be executed by the one or more processors (e.g., the processor (120) of FIGS. 1 to 2, the MCU (201) of FIG. 2) to cause the electronic device (e.g., the electronic device (101) of FIGS. 1 to 3) to determine the second frame rate based on a motion vector representing a change in position of feature points of the plurality of fingerprint image frames.

[0124] In one embodiment, the plurality of fingerprint image frames may include a first fingerprint image frame and a second fingerprint image frame output before the first fingerprint image frame. The one or more commands may be executed by the one or more processors (e.g., the processor (120) of FIGS. 1 and 2, the MCU (201) of FIG. 2) to cause the electronic device (e.g., the electronic device (101) of FIGS. 1 and 3) to assign a first weight to a first motion vector for the first fingerprint image frame and a second weight to a second motion vector for the second fingerprint image frame to determine the second frame rate. The first weight may have a greater value than the second weight.

[0125] In one embodiment, the one or more commands may be executed by the one or more processors (e.g., the processor (120) of FIGS. 1 to 2, the MCU (201) of FIG. 2) to cause the electronic device (e.g., the electronic device (101) of FIGS. 1 to 3) to determine the overlapping area based on an algorithm that estimates a movement location of fingerprint data included within the plurality of fingerprint image frames.

[0126] In one embodiment, the one or more instructions may be executed by the one or more processors (e.g., the processor (120) of FIGS. 1 to 2, the MCU (201) of FIG. 2) to cause the electronic device (e.g., the electronic device (101) of FIGS. 1 to 3) to determine the second frame rate to be a value smaller than the first frame rate when the size of the overlapping area corresponding to the location estimated based on the algorithm exceeds a specified range.

[0127] In one embodiment, a method of operating an electronic device (e.g., the electronic device (101) of FIGS. 1 to 3) including a fingerprint sensor (e.g., the fingerprint sensor (200) of FIGS. 1 to 2) may include an operation in which the fingerprint sensor (e.g., the fingerprint sensor (200) of FIGS. 1 to 2) outputs a plurality of fingerprint image frames, wherein at least one of the plurality of fingerprint image frames is output based on a first frame rate. The method may further include an operation of determining a second frame rate such that a size of an overlapping area determined based on fingerprint image frames output from the fingerprint sensor (e.g., the fingerprint sensor (200) of FIGS. 1 to 2) becomes a specified range. The method may further include an operation of changing a frame rate at which the fingerprint sensor (e.g., the fingerprint sensor (200) of FIGS. 1 to 2) outputs fingerprint image frames to the second frame rate.

[0128] In one embodiment, the operation of determining the second frame rate may include an operation of determining the second frame rate to a value smaller than the first frame rate when the size of the overlapping area exceeds a specified range, and an operation of determining the second frame rate to a value larger than the first frame rate when the size of the overlapping area is less than the specified range.

[0129] In one embodiment, the method may further include an operation of determining whether a first fingerprint template is completed based on the plurality of fingerprint image frames. The method may further include an operation of determining whether fingerprint information stored in a memory (e.g., memory (130) of FIGS. 1 to 2) of the electronic device (e.g., electronic device (101) of FIGS. 1 to 3) matches the first fingerprint template based on determining that the first fingerprint template is completed, and storing the second frame rate in the memory (e.g., memory (130) of FIGS. 1 to 2). The method may further include an operation of controlling the fingerprint sensor (e.g., fingerprint sensor (200) of FIGS. 1 to 2) to output a fingerprint image frame based on the second frame rate when a fingerprint detection operation for obtaining a second fingerprint template is initiated after the first fingerprint template is completed.

[0130] In one embodiment, the operation of changing the frame rate may include an operation of determining a position of a next fingerprint image frame with respect to the plurality of fingerprint image frames based on a trajectory of the plurality of fingerprint image frames. The operation of changing the frame rate may include an operation of maintaining the first frame rate when an area in which the next fingerprint image frame overlaps with at least one of the plurality of fingerprint image frames is greater than or equal to a threshold.

[0131] In one embodiment, the operation of determining the second frame rate may include an operation of determining the second frame rate based on a motion vector representing a change in position of feature points of the plurality of fingerprint image frames.

[0132] In one embodiment, the plurality of fingerprint image frames may include a first fingerprint image frame and a second fingerprint image frame output before the first fingerprint image frame. The operation of determining the second frame rate may include an operation of determining the second frame rate by assigning a first weight to a first fingerprint motion vector for the first fingerprint image frame and assigning a second weight to a second fingerprint motion vector for the second fingerprint image frame. The first weight may have a greater value than the second weight.

[0133] In one embodiment, the operation of determining the second frame rate may include an operation of determining the overlapping area based on an algorithm that estimates a movement location of fingerprint data included within the plurality of fingerprint image frames.

[0134] In one embodiment, the operation of determining the second frame rate may include an operation of determining the second frame rate to a value smaller than the first frame rate when the size of the overlapping area corresponding to the location estimated based on the algorithm exceeds a specified range.

[0135] In one embodiment, a computer-readable, non-transitory recording medium may record a computer program that causes an electronic device (e.g., an electronic device (101) of FIGS. 1 to 3) including a fingerprint sensor (e.g., a fingerprint sensor (200) of FIGS. 1 to 2) to perform the method described above when executed. The computer program may cause an electronic device (e.g., an electronic device (101) of FIGS. 1 to 3) including a fingerprint sensor (e.g., a fingerprint sensor (200) of FIGS. 1 to 2) to perform an operation of outputting a plurality of fingerprint image frames, wherein at least one of the plurality of fingerprint image frames is output based on a first frame rate. The computer program may cause an electronic device (e.g., an electronic device (101) of FIGS. 1 to 3) including a fingerprint sensor (e.g., a fingerprint sensor (200) of FIGS. 1 to 2) to perform an operation of determining a second frame rate so that an overlapping area determined based on fingerprint image frames output from the fingerprint sensor (e.g., a fingerprint sensor (200) of FIGS. 1 to 2) becomes a designated range when the computer program is executed. The computer program may cause an electronic device (e.g., an electronic device (101) of FIGS. 1 to 3) including a fingerprint sensor (e.g., a fingerprint sensor (200) of FIGS. 1 to 2) to perform an operation of changing a frame rate at which the fingerprint sensor (e.g., a fingerprint sensor (200) of FIGS. 1 to 2) outputs fingerprint image frames to the second frame rate when the computer program is executed.

[0136] An electronic device and an operating method thereof according to various embodiments can reduce the amount of unnecessary computation that an electronic device must perform when performing an operation to obtain information about a user's fingerprint.

[0137] An electronic device and an operating method thereof according to various embodiments can increase the efficiency of the capacity of a memory used to obtain information about a user's fingerprint.

[0138] The effects that can be obtained from the present disclosure are not limited to the effects mentioned above, and other effects that are not mentioned can be clearly understood by a person having ordinary skill in the art to which the present disclosure belongs from the description below.

[0139] The methods according to the embodiments described in the claims or specification of the present disclosure may be implemented in the form of hardware, software, or a combination of hardware and software.

[0140] When implemented in software, a computer-readable storage medium storing one or more programs (software modules) may be provided. The one or more programs stored in the computer-readable storage medium are configured for execution by one or more processors within an electronic device. The one or more programs include instructions that cause the electronic device to execute methods according to embodiments described in the claims or specification of the present disclosure.

[0141] In the present disclosure, the functions or operations performed by the electronic device may be performed by one or more processors executing one or more instructions stored in a memory. The functions or operations of the electronic device mentioned in the present disclosure may be performed by one processor executing one or more instructions, or may be performed by a combination of multiple processors executing one or more instructions. The processor mentioned in the present disclosure is to be understood as including a circuit for performing operations or controlling other components of the electronic device. For example, the processor may include a central processing unit (CPU), a microprocessor unit (MPU), an application processor (AP), a communication processor (CP), a neural processing unit (NPU), a system on a chip (SoC), or an integrated circuit (IC) configured to execute one or more instructions.

[0142] In the present disclosure, a program (software module, software) may be stored in a non-volatile memory including a random access memory (RAM), a flash memory, a read only memory (ROM), an electrically erasable programmable read only memory (EEPROM), a magnetic disc storage device, a compact disc ROM (CD-ROM), digital versatile discs (DVDs) or other forms of optical storage devices, a magnetic cassette. Or, it may be stored in a memory formed by a combination of some or all of these. The memory may be formed by a single storage medium, or may be formed by a combination of a plurality of storage media. The one or more commands may be stored in a single storage medium, or may be distributed and stored in a plurality of storage media.

[0143] Additionally, the program may be stored on an attachable storage device that is accessible via a communication network such as the Internet, an intranet, a local area network (LAN), a wide LAN (WLAN), or a storage area network (SAN), or a combination thereof. Such a storage device may be connected to a device performing an embodiment of the present disclosure via an external port. Additionally, a separate storage device on the communication network may be connected to a device performing an embodiment of the present disclosure.

[0144] In the specific embodiments of the present disclosure described above, components included in the disclosure are expressed in the singular or plural form, depending on the specific embodiment presented. However, the singular or plural expressions are selected to suit the presented situation for convenience of explanation, and the present disclosure is not limited to singular or plural components. Components expressed in the plural form may be composed of singular elements, or components expressed in the singular form may be composed of plural elements.

[0145] Additionally, in the present disclosure, terms such as “part”, “module”, etc. may refer to a hardware component such as a processor or circuit, and / or a software component executed by a hardware component such as a processor.

[0146] A "component" or "module" may be implemented by a program stored in an addressable storage medium and executed by a processor. For example, a "component" or "module" may be implemented by components such as software components, object-oriented software components, class components, and task components, as well as processes, functions, attributes, procedures, subroutines, segments of program code, drivers, firmware, microcode, circuitry, data, databases, data structures, tables, arrays, and variables.

[0147] The specific implementations described in this disclosure are merely exemplary and do not limit the scope of the present disclosure in any way. For the sake of brevity, descriptions of conventional electronic components, control systems, software, and other functional aspects of the systems may be omitted.

[0148] Additionally, in the present disclosure, “comprising at least one of a, b, or c” may mean “comprising only a, including only b, including only c, or including a combination of two or more (including a and b, including b and c, including a and c, or including all of a, b, and c).

[0149] While the detailed description of this disclosure has described specific embodiments, it should be understood that various modifications are possible without departing from the scope of this disclosure. Therefore, the scope of this disclosure should not be limited to the described embodiments, but should be defined not only by the scope of the claims described below, but also by equivalents thereof.

[0150] Electronic devices according to the various embodiments disclosed in this document may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to the embodiments of this document are not limited to the aforementioned devices.

[0151] The various embodiments of this document and the terminology used therein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

[0152] The term "module" used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0153] Various embodiments of the present document may be implemented as software (e.g., a program (140)) including one or more instructions stored in a storage medium (e.g., an internal memory (136) or an external memory (138)) readable by a machine (e.g., an electronic device (101)). For example, a processor (e.g., a processor (120)) of the machine (e.g., an electronic device (101)) may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g. electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.

[0154] According to one embodiment, the method according to various embodiments disclosed in this document may be provided as a computer program product. The computer program product may be traded between sellers and buyers as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or may be provided through an application store (e.g., Play Store). TM ) or directly between two user devices (e.g., smart phones), online distribution (e.g., downloading or uploading). In the case of online distribution, at least a portion of the computer program product may be at least temporarily stored or temporarily created in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0155] According to various embodiments, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and arranged in other components. According to various embodiments, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to various embodiments, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

Claims

1. In electronic devices, Fingerprint sensor; one or more processors; and Contains a memory that stores one or more instructions, The one or more instructions are executed by the one or more processors so that the electronic device: The fingerprint sensor outputs a plurality of fingerprint image frames, wherein at least one of the plurality of fingerprint image frames is output based on a first frame rate, A second frame rate is determined so that the size of the overlapping area determined based on the fingerprint image frames output from the fingerprint sensor is within a specified range, An electronic device that causes the fingerprint sensor to change the frame rate at which the fingerprint image frame is output to the second frame rate.

2. In claim 1, The one or more instructions are executed by the one or more processors so that the electronic device: An electronic device that determines the second frame rate to be a value smaller than the first frame rate when the size of the overlapping area exceeds a specified range, and determines the second frame rate to be a value larger than the first frame rate when the size of the overlapping area is less than a specified range.

3. In claim 1, The one or more instructions are executed by the one or more processors so that the electronic device: Based on the plurality of fingerprint image frames, it is determined whether the first fingerprint template is completed, Based on the above first fingerprint template being deemed complete: Determine whether the fingerprint information stored in the above memory matches the first fingerprint template, The second frame rate is stored in the memory, An electronic device, which controls the fingerprint sensor to output a fingerprint image frame based on the second frame rate when a fingerprint detection operation for obtaining a second fingerprint template is initiated after the first fingerprint template is completed.

4. In claim 1, The one or more instructions are executed by the one or more processors so that the electronic device: Determine the location of the next fingerprint image frame for the plurality of fingerprint image frames based on the trajectories of the plurality of fingerprint image frames, An electronic device that maintains the first frame rate when the area in which the next fingerprint image frame overlaps with at least one of the plurality of fingerprint image frames is greater than or equal to a threshold.

5. In claim 1, The one or more instructions are executed by the one or more processors so that the electronic device: An electronic device that determines the second frame rate based on a motion vector representing a change in position of feature points of the plurality of fingerprint image frames.

6. In claim 1, The above plurality of fingerprint image frames include a first fingerprint image frame and a second fingerprint image frame output before the first fingerprint image frame, The one or more instructions are executed by the one or more processors to cause the electronic device to determine the second frame rate by assigning a first weight to a first motion vector for the first fingerprint image frame and assigning a second weight to a second motion vector for the second fingerprint image frame. An electronic device, wherein the first weight is a value greater than the second weight.

7. In claim 1, An electronic device, wherein said one or more commands are executed by said one or more processors to cause said electronic device to determine said overlapping area based on an algorithm that estimates a movement location of fingerprint data included within said plurality of fingerprint image frames.

8. In a method of operating an electronic device including a fingerprint sensor, An operation in which the fingerprint sensor outputs a plurality of fingerprint image frames, wherein at least one of the plurality of fingerprint image frames is output based on a first frame rate; An operation of determining a second frame rate so that the size of the overlapping area determined based on the fingerprint image frames output from the fingerprint sensor becomes within a specified range; and A method comprising an operation of changing a frame rate at which the fingerprint sensor outputs a fingerprint image frame to the second frame rate.

9. In claim 8, The operation for determining the second frame rate is: A method comprising: determining a second frame rate as a value smaller than the first frame rate when the size of the overlapping area exceeds a specified range; and determining the second frame rate as a value larger than the first frame rate when the size of the overlapping area is less than the specified range.

10. In claim 8, An operation of determining whether a first fingerprint template is completed based on the plurality of fingerprint image frames; Based on the above first fingerprint template being deemed complete: Determining whether the fingerprint information stored in the memory of the electronic device matches the first fingerprint template, An operation of storing the second frame rate in the memory; and A method further comprising: when a fingerprint detection operation for obtaining a second fingerprint template is initiated after the first fingerprint template is completed, the method further comprising an operation of controlling the fingerprint sensor to output a fingerprint image frame based on the second frame rate.

11. In claim 8, The action of changing the above frame rate is: An operation of determining a position of a next fingerprint image frame for the plurality of fingerprint image frames based on trajectories of the plurality of fingerprint image frames; and A method comprising: maintaining the first frame rate when an area in which the next fingerprint image frame overlaps with at least one of the plurality of fingerprint image frames is greater than or equal to a threshold.

12. In claim 8, A method wherein the operation of determining the second frame rate includes an operation of determining the second frame rate based on a motion vector representing a change in position of feature points of the plurality of fingerprint image frames.

13. In claim 8, The above plurality of fingerprint image frames include a first fingerprint image frame and a second fingerprint image frame output before the first fingerprint image frame, The operation of determining the second frame rate includes an operation of determining the second frame rate by assigning a first weight to a first fingerprint motion vector for the first fingerprint image frame and assigning a second weight to a second fingerprint motion vector for the second fingerprint image frame. A method wherein the first weight is a value greater than the second weight.

14. In claim 8, A method according to claim 1, wherein the operation of determining the second frame rate includes an operation of determining the overlapping area based on an algorithm for estimating a movement location of fingerprint data included within the plurality of fingerprint image frames.

15. In a non-transitory computer-readable storage medium, when an electronic device including a fingerprint sensor is executed: An operation in which the fingerprint sensor outputs a plurality of fingerprint image frames, wherein at least one of the plurality of fingerprint image frames is output based on a first frame rate; An operation of determining a second frame rate so that the overlapping area determined based on the fingerprint image frames output from the fingerprint sensor becomes a specified range; and A computer program recording a method including changing a frame rate at which the fingerprint sensor outputs a fingerprint image frame to the second frame rate.

Images