Electronic device comprising fingerprint sensor and operation method thereof

Abstract

An electronic device according to one disclosed embodiment may comprise: at least one processor; a fingerprint sensor; and a memory comprising a plurality of parameter sets (LUTs) and instructions used by the fingerprint sensor to acquire information about a fingerprint of a user. The electronic device may receive a first input related to a first fingerprint. The electronic device may acquire a first registered fingerprint image from a first input by operating the fingerprint sensor by using a first parameter set, which is set as a reference parameter set, from among the plurality of parameter sets. The electronic device may acquire, from the first registered fingerprint image, first fingerprint feature information about a feature of the first fingerprint and first fingerprint density information about a density of the first fingerprint. The electronic device may register the first fingerprint by storing the first fingerprint feature information and the first fingerprint density information. The electronic device may receive a second input related to a second fingerprint. The electronic device may acquire a first authentication fingerprint image from the second input by operating the fingerprint sensor by using the first parameter set, in a first scan mode determined on the basis of the first fingerprint density information from among a plurality of defined scan modes of the fingerprint sensor. The electronic device may acquire second fingerprint feature information about a feature of the second fingerprint from the first authentication fingerprint image. The electronic device may perform authentication on the second fingerprint by comparing the second fingerprint feature information with the first fingerprint feature information.

Description

Electronic device including fingerprint sensor and method of operating same

[0001] The present disclosure discloses an electronic device including a fingerprint sensor and a method of operating the electronic device including the fingerprint sensor.

[0002] With the advancement of digital technology, various types of electronic devices, such as mobile terminals, personal digital assistants (PDAs), electronic organizers, smartphones, tablet PCs (personal computers), and wearable devices, are widely used. Electronic devices can provide various functions. For example, electronic devices can run at least one application in the foreground and / or background to provide at least one function. Electronic devices can provide various functions using a designated operating system (e.g., the Android™ operating system). Electronic devices can provide various security-related functions through biometric authentication (e.g., fingerprint recognition, facial recognition).

[0003] The above information may be provided as background information to aid in understanding the present disclosure. No claim or determination is made as to whether any of the above is applicable as prior art in connection with the present disclosure.

[0004] An electronic device according to one embodiment of the present disclosure may include at least one processor including a processing circuit. The electronic device may include a fingerprint sensor that obtains information about a fingerprint of a user who has come into contact with the electronic device. The electronic device may include a memory including a plurality of parameter sets (LUTs) and instructions used by the fingerprint sensor to obtain information about the user's fingerprint. The electronic device may receive a first input regarding a first fingerprint. The electronic device may operate the fingerprint sensor using a first parameter set set as a reference parameter set among the plurality of parameter sets, thereby obtaining a first registered fingerprint image from the first input. The electronic device may obtain first fingerprint feature information regarding a feature of the first fingerprint and first fingerprint density information regarding a density of the first fingerprint from the first registered fingerprint image. The electronic device may register the first fingerprint by storing the first fingerprint feature information and the first fingerprint density information. The electronic device may receive a second input regarding a second fingerprint. The electronic device can obtain a first authentication fingerprint image from a second input by operating the fingerprint sensor using a first parameter set in a first scan mode determined based on first fingerprint density information among a plurality of defined scan modes of the fingerprint sensor. The electronic device can obtain second fingerprint feature information regarding features of a second fingerprint from the first authentication fingerprint image. The electronic device can perform authentication of the second fingerprint by comparing the second fingerprint feature information with the first fingerprint feature information.

[0005] According to one disclosed embodiment, a method of operating an electronic device may include receiving a first input regarding a first fingerprint. The method of operating the electronic device may include obtaining a first registered fingerprint image from the first input by operating a fingerprint sensor using a first parameter set set as a reference parameter set from among a plurality of parameter sets. The method of operating the electronic device may include obtaining first fingerprint feature information regarding a feature of the first fingerprint and first fingerprint density information regarding a density of the first fingerprint from the first registered fingerprint image. The method of operating the electronic device may include registering the first fingerprint by storing the first fingerprint feature information and the first fingerprint density information. The method of operating the electronic device may include receiving a second input regarding a second fingerprint. The method of operating the electronic device may include obtaining a first authentication fingerprint image from the second input by operating the fingerprint sensor using a first parameter set in a first scan mode determined based on the first fingerprint density information from among a plurality of defined scan modes of the fingerprint sensor. The method of operating an electronic device may include an operation of obtaining second fingerprint feature information regarding the features of a second fingerprint from a first authentication fingerprint image. The method of operating the electronic device may include an operation of performing authentication on the second fingerprint by comparing the second fingerprint feature information with the first fingerprint feature information.

[0006] According to one embodiment of the disclosure, a computer-readable, non-transitory recording medium having recorded thereon instructions for controlling an electronic device may include instructions for obtaining a first registered fingerprint image from a first input by operating a fingerprint sensor using a first parameter set set as a reference parameter set from among a plurality of parameter sets. The recording medium may include instructions for obtaining first fingerprint feature information regarding characteristics of a first fingerprint and first fingerprint density information regarding a density of the first fingerprint from the first registered fingerprint image. The recording medium may include instructions for registering a first fingerprint by storing the first fingerprint feature information and the first fingerprint density information. The recording medium may include instructions for obtaining a first authentication fingerprint image from a second input by operating the fingerprint sensor using the first parameter set in a first scan mode determined based on the first fingerprint density information from among a plurality of defined scan modes of the fingerprint sensor. The recording medium may include instructions for obtaining second fingerprint feature information regarding characteristics of a second fingerprint from the first authentication fingerprint image. The recording medium may include instructions for performing authentication for a second fingerprint by comparing second fingerprint characteristic information with first fingerprint characteristic information.

[0007] FIG. 1 is a block diagram of an electronic device within a network environment according to various embodiments.

[0008] FIG. 2 is a block diagram of an electronic device according to one embodiment.

[0009] FIG. 3A is a diagram illustrating a method for a fingerprint sensor of an electronic device to obtain a fingerprint image of a user, according to one embodiment.

[0010] FIG. 3B is a diagram illustrating a method for a fingerprint sensor of an electronic device to obtain a fingerprint image of a user, according to one embodiment.

[0011] FIG. 4 is a drawing for explaining a fingerprint sensor of an electronic device according to one embodiment.

[0012] FIG. 5 is a block diagram illustrating a fingerprint sensor of an electronic device according to one embodiment.

[0013] FIG. 6A is a drawing for explaining a state in which a first protective member is attached on a display of an electronic device according to one embodiment.

[0014] FIG. 6b is a drawing for explaining a state in which a second protective member is attached on a display of an electronic device according to one embodiment.

[0015] FIG. 6c is a drawing for explaining a state in which a third protective member is attached on a display of an electronic device according to one embodiment.

[0016] FIG. 7 is a diagram illustrating parameter sets used by a fingerprint sensor of an electronic device according to one embodiment.

[0017] FIG. 8 is a flowchart illustrating a method for determining a parameter set used by a fingerprint sensor of an electronic device, according to one embodiment.

[0018] FIG. 9 is a flowchart illustrating a method for an electronic device to register a fingerprint according to one embodiment.

[0019] FIG. 10 is a flowchart illustrating a method for an electronic device to obtain fingerprint density information according to one embodiment.

[0020] FIG. 11 is a diagram illustrating an operation of an electronic device setting an area corresponding to a fingerprint according to one embodiment.

[0021] FIG. 12 is a diagram illustrating an operation of an electronic device to obtain a unit frequency value per pixel of a fingerprint image according to one embodiment.

[0022] FIG. 13 is a diagram illustrating an image showing a fingerprint image acquired by an electronic device and a distribution of unit frequencies per pixel according to one embodiment.

[0023] FIG. 14 is a diagram showing the results of quantifying the unit wave number acquired by an electronic device according to one embodiment.

[0024] FIG. 15 is a drawing for explaining a scan mode of a fingerprint sensor of an electronic device according to one embodiment.

[0025] FIG. 16 is a flowchart illustrating a method for an electronic device to perform fingerprint authentication according to one embodiment.

[0026] FIG. 17 is a diagram illustrating an operation of an electronic device displaying a notification for setting a representative fingerprint according to one embodiment.

[0027] An electronic device can perform user authentication using a fingerprint sensor positioned at the bottom of a display (e.g., in the -z direction of FIG. 3A). The fingerprint sensor can acquire a fingerprint image corresponding to a user's finger touching the top of the display (e.g., in the +z direction of FIG. 3A). For example, a fingerprint sensor using ultrasonic waves can acquire a fingerprint image by transmitting an ultrasonic signal to a user's finger touching the display, receiving an ultrasonic echo signal reflected by the user's finger, and reconstructing the ultrasonic echo signal.

[0028] Electronic devices may have a protective member attached to them. For example, electronic devices may have a protective member formed of a PET film or a protective member formed of tempered glass attached to the top of the display to protect the display.

[0029] Electronic devices may have a change in the round-trip time of a fingerprint sensor signal due to the attachment of a protective member. For example, the first round-trip time, during which an ultrasonic signal is transmitted and an ultrasonic echo signal is received when a protective member is attached to the electronic device, may be longer than the second round-trip time, during which an ultrasonic signal is transmitted and an ultrasonic echo signal is received when a protective member is not attached to the electronic device.

[0030] Electronic devices may experience degradation in the quality of image signals acquired by fingerprint sensors due to changes in the round-trip time of the signal. For example, the delay time set for elements in the transducer array of the fingerprint sensor may be determined based on the round-trip time of the fingerprint sensor signal. Therefore, changes in the round-trip time of the fingerprint sensor signal may degrade the resolution of the image signal acquired by the fingerprint sensor.

[0031] An electronic device can store preset parameter sets according to the presence or absence of a protective member and the type of the protective member. The parameter sets can include values ​​of parameters set when the electronic device is manufactured. For example, the parameter sets can be stored as a look up table (LUT). For example, the parameter sets can include parameters for each of a first state in which a protective member is not attached to the electronic device, a second state in which a protective member having a first thickness (e.g., a thin thickness) is attached to the electronic device, a third state in which a protective member having a second thickness (e.g., a thick thickness) is attached to the electronic device, and a fourth state in which a protective member having a third thickness (e.g., a protective member made of a tempered glass material) is attached to the electronic device.

[0032] An electronic device can acquire a fingerprint image by operating a fingerprint sensor using a set of parameters. For example, the electronic device can transmit an ultrasonic signal, receive an ultrasonic echo signal, and acquire a fingerprint image by operating the fingerprint sensor based on parameters relating to the frequency of the ultrasonic signal, parameters relating to the round-trip time of the ultrasonic signal, and parameters relating to the delay time of each element of a transducer array.

[0033] A fingerprint sensor can acquire a fingerprint image using one of a plurality of scan modes. For example, the fingerprint sensor can acquire a fingerprint image using a first scan mode that analyzes an image for all areas corresponding to a fingerprint regardless of the density of the fingerprint pattern (e.g., line pairs per millimeter (LPMM)). For example, the fingerprint sensor can acquire a fingerprint image using a second scan mode that analyzes an image only for areas where the fingerprint pattern is not dense.

[0034] Each of the parameter sets may be matched with a scan mode. For example, a first parameter set related to a first state in which no protective member is attached to the electronic device may be matched with a first scan mode. For example, a second parameter set related to a second state in which a protective member having a first thickness (e.g., a thin thickness) is attached to the electronic device may be matched with a second scan mode. For example, a third parameter set related to a third state in which a protective member having a second thickness (e.g., a thick thickness) is attached to the electronic device may be matched with a second scan mode. For example, a fourth parameter set related to a fourth state in which a protective member having a third thickness (e.g., a protective member made of a tempered glass material) is attached to the electronic device may be matched with a first scan mode.

[0035] However, if an electronic device acquires a fingerprint image only using a scan mode that matches a parameter set, it may not sufficiently reflect the characteristics of the user's fingerprint (e.g., fingerprint density). For example, when acquiring a fingerprint image of a woman or a child with small fingers using a second parameter set or a third parameter set, the electronic device acquires the fingerprint image using the second scan mode. Since the second scan mode is a scan mode that analyzes images by optimizing for areas where the fingerprint pattern is not dense, the characteristics of the fingerprints of children with dense fingerprint patterns or women with small fingers may not be reflected, resulting in the fingerprint image not being properly acquired. On the other hand, if a fingerprint image of a user with a non-dense fingerprint pattern (e.g., an adult male with large fingers) is acquired in a first state without a protective member attached to the electronic device, the electronic device may acquire the fingerprint image using the first scan mode. Since the first scan mode analyzes the image regardless of the fingerprint image density, performance may deteriorate when analyzing a fingerprint image of a user with a non-dense fingerprint pattern (e.g., an adult male with large fingers) using the second scan mode.

[0036] The technical problems to be achieved in this document are not limited to the technical problems mentioned above, and other technical problems not mentioned will be clearly understood by a person having ordinary skill in the technical field to which the present disclosure pertains.

[0037] Hereinafter, embodiments are described in detail with reference to the attached drawings so that those skilled in the art can easily implement the present disclosure. However, the disclosed embodiments may be implemented in various different forms and are not limited to the embodiments described herein.

[0038] FIG. 1 is a block diagram of an electronic device (101) within a network environment (100) according to various embodiments. Referring to FIG. 1, in the network environment (100), the electronic device (101) may communicate with the electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with at least one of the electronic device (104) or the server (108) via a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display module (160), an audio module (170), a sensor module (176), an interface (177), a connection terminal (178), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197). In some embodiments, the electronic device (101) may omit at least one of these components (e.g., the connection terminal (178)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor module (176), the camera module (180), or the antenna module (197)) may be integrated into one component (e.g., the display module (160)).

[0039] The processor (120) may, for example, execute software (e.g., a program (140)) to control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) and perform various data processing or calculations. According to one embodiment, as at least a part of the data processing or calculations, the processor (120) may store commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the commands or data stored in the volatile memory (132), and store result data in a non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or a secondary processor (123) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together therewith. For example, if the electronic device (101) includes a main processor (121) and a secondary processor (123), the secondary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a specified function. The secondary processor (123) may be implemented separately from the main processor (121) or as a part thereof.

[0040] The auxiliary processor (123) may control at least a portion of functions or states associated with at least one component (e.g., a display module (160), a sensor module (176), or a communication module (190)) of the electronic device (101), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or can be performed through a separate server (e.g., server (108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.

[0041] The memory (130) can store various data used by at least one component (e.g., processor (120) or sensor module (176)) of the electronic device (101). The data can include, for example, software (e.g., program (140)) and input data or output data for commands related thereto. The memory (130) can include volatile memory (132) or non-volatile memory (134).

[0042] The program (140) may be stored as software in the memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

[0043] The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0044] The audio output module (155) can output audio signals to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. In one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.

[0045] The display module (160) can visually provide information to an external party (e.g., a user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. In one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.

[0046] The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150), output sound through the sound output module (155), or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (101).

[0047] The sensor module (176) can detect the operating status (e.g., power or temperature) of the electronic device (101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0048] The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) with an external electronic device (e.g., the electronic device (102)). In one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0049] The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0050] A haptic module (179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. In one embodiment, the haptic module (179) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

[0051] The camera module (180) can capture still images and videos. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0052] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented, for example, as at least a part of a power management integrated circuit (PMIC).

[0053] A battery (189) may power at least one component of the electronic device (101). In one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0054] The communication module (190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may operate independently from the processor (120) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module, or a power line communication module). Among these communication modules, the corresponding communication module can communicate with an external electronic device (104) via a first network (198) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules can be integrated into a single component (e.g., a single chip) or implemented as a plurality of separate components (e.g., multiple chips). The wireless communication module (192) can verify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) by using subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196).

[0055] The wireless communication module (192) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (192) can support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), an external electronic device (e.g., the electronic device (104)), or a network system (e.g., the second network (199)). According to one embodiment, the wireless communication module (192) can support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC realization.

[0056] The antenna module (197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna module (197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). In one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), may be selected from the plurality of antennas, for example, by the communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device via the selected at least one antenna. In some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (197).

[0057] According to various embodiments, the antenna module (197) may form a mmWave antenna module. According to one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high-frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high-frequency band.

[0058] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).

[0059] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199). Each of the external electronic devices (102 or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices (102, 104, or 108). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (101) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In one embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server using machine learning and / or a neural network. According to one embodiment, the external electronic device (104) or the server (108) may be included in the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0060] FIG. 2 is a block diagram of an electronic device according to one embodiment.

[0061] Referring to FIG. 2, an electronic device (200) according to one embodiment may include a processor (220), a memory (230), a display (260), and a fingerprint sensor (270). The electronic device (200), the processor (220), the memory (230), the display (260), and the fingerprint sensor (270) of FIG. 2 may correspond to the electronic device (101), the processor (120), the memory (130), the display module (160), and the sensor module (176) described above with reference to FIG. 1, respectively. The components of the electronic device (200) illustrated in FIG. 2 are for describing one embodiment, and the electronic device (200) may include more components than the components illustrated in FIG. 2, or may include other components that can replace at least some of the components. For example, the memory (230) is not limited to a storage medium included in the electronic device (200), and may include a cloud storage external to the electronic device (200).

[0062] According to one embodiment, the memory (230) may include a secure area in which information exchange is controlled. The secure area may be a separate area provided within the processor. The secure area may be a separate area provided outside the processor (e.g., an embedded secure element (eSE), a secure processor). For example, the secure area may be an ARM TM Trustzone developed by Saga TM) may apply. For example, the security zone may be implemented as a hypervisor.

[0063] In one embodiment, the memory (230) may store parameter sets that the fingerprint sensor (270) uses to acquire a user's fingerprint image. For example, the memory (230) may store the parameter sets in a look up table (LUT).

[0064] For example, the memory (230) may store parameter sets including parameters regarding the frequency of an ultrasonic signal generated from a fingerprint sensor. For example, the memory (230) may store parameter sets including parameters regarding the round trip time of an ultrasonic signal. For example, the memory (230) may store parameter sets including parameters regarding the delay time of each element of a transducer array.

[0065] For example, the memory (230) may store parameter sets including parameters relating to a first state in which no protective member is attached to the electronic device. For example, the memory (230) may store parameter sets including parameters relating to a second state in which a protective member having a first thickness (e.g., a thin thickness) is attached to the electronic device. For example, the memory (230) may store parameter sets including parameters relating to a third state in which a protective member having a second thickness (e.g., a thick thickness) is attached to the electronic device. For example, the memory (230) may store parameter sets including parameters relating to a fourth state in which a protective member having a third thickness (e.g., a protective member made of a tempered glass material) is attached to the electronic device.

[0066] According to one embodiment, the memory (230) may store data acquired by the fingerprint sensor. For example, the memory (230) may store a fingerprint image acquired by the fingerprint sensor. For example, the memory (230) may store fingerprint feature information acquired from the fingerprint image. For example, the memory (230) may store fingerprint density information acquired from the fingerprint image.

[0067] According to one embodiment, the memory (230) may store data obtained by the processor (220) performing a calculation (e.g., local wavenumber estimation (LWE)). For example, the memory (230) may store data obtained by the processor (220) performing a calculation on a fingerprint image obtained through a fingerprint sensor. For example, the memory (230) may store values ​​obtained by converting pixel values ​​of the fingerprint image into first frequency components by the processor (220). For example, the memory (230) may store values ​​of a second frequency component obtained by applying a plurality of wavenumber filters to the first frequency components by the processor (220). For example, the memory (230) may store local wavenumber values ​​per pixel obtained by converting the values ​​of the second frequency components into a spatial domain by the processor (220). For example, the memory (230) can store values ​​that quantify the local frequency values ​​per pixel calculated by the processor (220).

[0068] According to one embodiment, the processor (220) may be configured with one or more processors. For example, the processor (220) may include a main processor (e.g., an application processor (AP)) and a secondary processor (e.g., a neural processing unit (NPU), a graphics processing unit (GPU), a secure processor unit (SPU)). For example, the processor (220) may include a plurality of computational cores.

[0069] According to one embodiment, the processor (220) may be operatively connected to the memory (230). The processor (220) may execute instructions stored in the memory (230). The processor (220) may perform various data processing or calculations by executing the instructions. The processor (220) may control components included in the electronic device (200) by executing the instructions. For example, the processor (220) may control at least one of the memory (230), the display (260), and the fingerprint sensor (270). The processor (220) may perform calculations in accordance with the instructions so that the electronic device (200) may perform operations described below with reference to FIGS. 3A to 17, and may control components included in the electronic device (200).

[0070] In one embodiment, the display (260) may display a user interface (UI) used when acquiring a user's fingerprint. For example, the display (260) may display information regarding an area where the user's finger is to be positioned for fingerprint recognition. For example, the display (260) may display information regarding the results of fingerprint recognition by the electronic device (200). For example, the display (260) may display a notification and / or a user interface (UI) for setting a representative fingerprint.

[0071] According to one embodiment, the fingerprint sensor (270) can obtain information about a user's fingerprint. For example, the fingerprint sensor (270) can obtain information about a fingerprint from a user's finger in contact with the display (260). For example, the fingerprint sensor (270) can be located on the opposite side of the front surface of the display (260) on which information is displayed. That is, the fingerprint sensor (270) can be located on the back surface of the display (260) (e.g., the -z direction in FIG. 3A). The fingerprint sensor (270) can transmit an ultrasonic signal to the display (260) and receive an ultrasonic echo signal generated when the ultrasonic signal is reflected by the user's finger in contact with the display (260). The fingerprint sensor (270) can obtain information about a fingerprint using the ultrasonic echo signal. For example, the fingerprint sensor (270) can convert the ultrasonic echo signal into a pixel value.

[0072] According to one embodiment, the processor (220) can obtain a fingerprint image of the user by controlling the fingerprint sensor (270). For example, the processor (220) connected to the fingerprint sensor may be a secure area within the processor (220) (e.g., a virtualized processor implemented as a hypervisor).

[0073] For example, the processor (220) may control the fingerprint sensor (270) to generate an ultrasonic signal. For example, the processor (220) may control the fingerprint sensor (270) to receive an ultrasonic echo signal. For example, the processor (220) may control the fingerprint sensor (270) to beamform the ultrasonic echo signal.

[0074] For example, the processor (220) may obtain a fingerprint image using the ultrasonic echo signal received by the fingerprint sensor (270). For example, the processor (220) may generate a fingerprint image that reflects the ultrasonic echo signal received by the fingerprint sensor (270) as a pixel value. The fingerprint image may include an image including ridges and valleys of a fingerprint of a user's finger in contact with the display (260). The pixel value may include a value indicated by each of the pixels constituting the fingerprint image. For example, the pixel value may include a value indicating the brightness of each of the pixels of the image obtained by the fingerprint sensor.

[0075] According to one embodiment, the processor (220) may perform an operation on a fingerprint image acquired through a fingerprint sensor. For example, the processor (220) may perform an operation to convert pixel values ​​of the fingerprint image into first frequency components. For example, the processor (220) may perform an operation to obtain values ​​of a second frequency component by applying a plurality of frequency filters to the first frequency components. For example, the processor (220) may perform an operation to obtain local frequency values ​​per pixel by converting values ​​of the second frequency component into a spatial domain. For example, the processor (220) may perform an operation to quantify local frequency values ​​per pixel.

[0076] In one embodiment, the processor (220) may control the display (260) to display the fingerprint recognition results. For example, the processor (220) may control the display (260) to display a notification that the fingerprint recognition was not successful (or failed) (or a retry is required).

[0077] FIGS. 3A and 3B are diagrams illustrating a method for a fingerprint sensor of an electronic device to obtain a fingerprint image of a user, according to one embodiment.

[0078] Referring to FIGS. 3A and 3B , the electronic device (200) may receive an input regarding a fingerprint of a user (390). For example, the electronic device (200) may receive an input for registering a fingerprint of the user (390). For example, the electronic device (200) may receive an input for authenticating a fingerprint of the user (390).

[0079] According to one embodiment, the electronic device (200) can obtain a fingerprint image from a finger of a user (390). Referring to FIG. 3A, for example, the electronic device (200) can display a user interface (UI) that guides the user (390) to touch the first area (260a) with his / her finger. For example, the electronic device (200) can obtain a fingerprint image from the finger of the user (390) touching the first area (260a) of the display (260).

[0080] According to one embodiment, the electronic device (200) can acquire a fingerprint image using an ultrasonic fingerprint sensor (300). Referring to FIG. 3B, the ultrasonic fingerprint sensor (300) may be positioned on the back surface (e.g., in the -z direction) of the display (260), but this is exemplary and is not limited thereto. There is no limitation on the relative position between the display (260) and the ultrasonic fingerprint sensor (300). The ultrasonic fingerprint sensor (300) may be implemented with hardware different from the display (260) or may be implemented as a component of the display (260).

[0081] According to one embodiment, the ultrasonic fingerprint sensor (300) can transmit an ultrasonic signal and receive an ultrasonic echo signal reflected by a finger of a user (390). For example, the ultrasonic fingerprint sensor (300) can receive an ultrasonic echo signal reflected by a ridge (391) of a finger of a user (390) in contact with a display (260) and an ultrasonic echo signal reflected by a valley (392) of a finger of the user (390) (or, an air layer (393) existing between a surface of the display (260) and the valley (392) of the finger of the user).

[0082] Although FIGS. 3A and 3B illustrate an embodiment of obtaining a fingerprint image using an ultrasonic fingerprint sensor (300) for a user's (390) finger in contact with a display (260), the present invention is not limited thereto. For example, the present invention can also be applied analogously to a case where a fingerprint image is obtained for a user's (390) finger in contact with a button (e.g., a power button, a home button). In addition, the embodiments of the present disclosure can also be applied analogically to a case where a fingerprint image is obtained for a user's (390) finger in contact with a button (e.g., a power button, a home button).

[0083] FIG. 4 is a drawing illustrating a fingerprint sensor of an electronic device according to one embodiment. FIG. 4 illustrates one side of an ultrasonic fingerprint sensor (300) and a display (260).

[0084] Referring to FIG. 4, the ultrasonic fingerprint sensor (300) may include transducer elements (411, 412, 413, 414, 415, 416). The transducer elements (411, 412, 413, 414, 415, 416) may form a transducer array.

[0085] Each of the transducer elements (411, 412, 413, 414, 415, 416) illustrated in FIG. 4 may mean a single transducer element, or may mean a plurality of transducer elements forming a single row or column of a transducer array. In the present disclosure, each of the transducer elements (411, 412, 413, 414, 415, 416) illustrated in FIG. 4 is described on the premise that it is a single transducer element, but it may be analogically applied to a plurality of transducer elements forming a single row or column of a transducer array.

[0086] According to one embodiment, the ultrasonic fingerprint sensor (300) can transmit and receive ultrasonic signals to and from the display (260) using at least one transducer element (411, 412, 413, 414, 415, 416). For example, the ultrasonic fingerprint sensor (300) can transmit a first ultrasonic signal (421) through a first transducer element (411). For example, the ultrasonic fingerprint sensor (300) can transmit a second ultrasonic signal (422) through a second transducer element (412). For example, the ultrasonic fingerprint sensor (300) can transmit a third ultrasonic signal (423) through a third transducer element (413). For example, the ultrasonic fingerprint sensor (300) can transmit a fourth ultrasonic signal (424) through a fourth transducer element (414). For example, the ultrasonic fingerprint sensor (300) can transmit a fifth ultrasonic signal (425) through the fifth transducer element (415). For example, the ultrasonic fingerprint sensor (300) can transmit a sixth ultrasonic signal (426) through the sixth transducer element (416).

[0087] According to one embodiment, the ultrasonic fingerprint sensor (300) can receive ultrasonic echo signals (441, 442, 443). The ultrasonic echo signals (441, 442, 443) can be generated by ultrasonic signals (421, 422, 423, 424, 425, 426) being reflected by a user's finger (430) (e.g., a finger of the user (390)) in contact with the display (260). For example, the ultrasonic fingerprint sensor (300) can receive the ultrasonic echo signals (441, 442, 443) through at least one transducer element (412, 413, 414). For example, the second transducer element (412) can receive the first ultrasonic echo signal (441). For example, the third transducer element (413) can receive the second ultrasonic echo signal (442). For example, the fourth transducer element (414) can receive the third ultrasonic echo signal (443).

[0088] According to one embodiment, each of the transducer elements (411, 412, 413, 414, 415, 416) may be set to a delay compensation time. Each of the transducer elements (411, 412, 413, 414, 415, 416) may have a difference in the time at which the ultrasonic echo signal (441, 442, 443) arrives. Accordingly, the delay compensation time may be set so that the delay time corresponding to the position of each of the transducer elements (411, 412, 413, 414, 415, 416) is compensated for. The ultrasonic fingerprint sensor (300) can beamform ultrasonic echo signals (441, 442, 443) using delay compensation times set for each of the transducer elements (411, 412, 413, 414, 415, 416). The electronic device can obtain a fingerprint image using the beamformed ultrasonic echo signals.

[0089] FIG. 5 is a block diagram illustrating a fingerprint sensor of an electronic device according to one embodiment.

[0090] Referring to FIG. 5, the ultrasonic fingerprint sensor (300) may include, but is not limited to, a transducer array (510), a control circuit (520), a transmitting circuit (530), or a receiving circuit (540). For example, the ultrasonic fingerprint sensor (300) may not include a control circuit (520). In this case, the ultrasonic fingerprint sensor (300) may be controlled by a control signal of a processor (220) of an electronic device (e.g., the electronic device (200) of FIG. 2).

[0091] According to one embodiment, the control circuit (520) of the ultrasonic fingerprint sensor (300) may be operatively connected to the processor (220). For example, the control circuit (520) and the processor (220) may complementarily control the operation of the ultrasonic fingerprint sensor (300). For example, the control circuit (520) and the processor (220) may control the ultrasonic fingerprint sensor (300) to take charge of at least one operation of the ultrasonic fingerprint sensor (300).

[0092] According to one embodiment, the transducer array (510) may be an array of a plurality of transducer elements. For example, the transducer array (510) may be an array of a plurality of transducer elements arranged in N rows and M columns. For example, the transducer array (510) may include the transducer elements (411, 412, 413, 414, 415, 416) described above with reference to FIG. 4.

[0093] According to one embodiment, the transducer array (510) can generate ultrasonic waves by converting an electrical signal into an ultrasonic signal, and can receive an ultrasonic echo signal and convert it into an electrical signal. For example, the transducer array (510) can transmit an ultrasonic signal and receive an ultrasonic echo signal using transducer elements (e.g., 411, 412, 413, 414, 415, 416 of FIG. 4). For example, the transducer array (510) can separately include a transducer element that transmits an ultrasonic signal and a transducer element that receives an ultrasonic echo signal. There is no limitation on the arrangement and configuration of the transducer elements included in the transducer array (510). In the present disclosure, an embodiment is described in which transducer elements (e.g., 411, 412, 413, 414, 415, 416 of FIG. 4) can both transmit ultrasonic signals and receive ultrasonic echo signals, but is not limited thereto, and the same may be applied analogously to an embodiment in which a transducer element for transmitting ultrasonic signals and a transducer element for receiving ultrasonic echo signals are separated.

[0094] In one embodiment, the transmitter circuit (530) can provide an electrical signal to the transducer array (510) to cause the transducer array (510) to generate an ultrasonic signal. For example, the transmitter circuit (530) can apply an impulse signal, a square pulse signal, a tone burst signal, or a continuous wave signal to the transducer array (510).

[0095] In one embodiment, the transmitter circuit (530) may provide an electrical signal to at least one transducer element corresponding to each channel through a plurality of channels. For example, the transmitter circuit (530) may provide an electrical signal to a first transducer element (e.g., 411) included in the transducer array (510) through a first channel.

[0096] According to one embodiment, the receiving circuit (540) may perform signal processing on an electrical signal obtained from the transducer array (510). For example, the receiving circuit (540) may amplify, buffer, filter, sample, and / or quantize the electrical signal obtained from the transducer array (510).

[0097] According to one embodiment, the receiving circuit (540) can obtain an electrical signal from at least one transducer element corresponding to each channel through a plurality of channels. For example, the receiving circuit (540) can obtain an electrical signal from a first transducer element (e.g., 411) included in the transducer array (510) through a first channel.

[0098] According to one embodiment, an electronic device (e.g., the electronic device (200) of FIG. 2) can perform image processing on raw data converted by the receiving circuit (540). For example, the processor (220) and / or the control circuit (520) of the electronic device (e.g., the electronic device (200) of FIG. 2) can individually or collectively perform image processing. For example, the electronic device (e.g., the electronic device (200) of FIG. 2) can obtain a raw image by performing image processing on amplified, buffered, filtered, sampled, and / or quantized data. For example, the electronic device (e.g., the electronic device (200) of FIG. 2) can generate a raw image by applying an image reconstruction algorithm to the raw data. For example, the electronic device (e.g., the electronic device (200 of FIG. 2) can obtain a fingerprint image by performing image processing on the raw image. For example, an electronic device (e.g., the electronic device (200) of FIG. 2) can generate a fingerprint image by applying algorithms of filtering, scaling, compression, and / or averaging to a raw image.

[0099] According to one embodiment, an electronic device (e.g., the electronic device (200) of FIG. 2) can obtain fingerprint feature information from a fingerprint image. For example, the processor (220) and / or the control circuit (520) of the electronic device (e.g., the electronic device (200) of FIG. 2) can individually or collectively perform operations to obtain fingerprint feature information from the fingerprint image. For example, the electronic device (e.g., the electronic device (200) of FIG. 2) can remove noise from the fingerprint image and perform binarization and normalization. For example, the electronic device (e.g., the electronic device (200) of FIG. 2) can identify minutiae such as ridge endings, bifurcations, and smooth areas of the fingerprint. For example, the electronic device (e.g., the electronic device (200 of FIG. 2) can identify the directionality of the fingerprint by finding the core and delta, which are the center points of the fingerprint. For example, an electronic device (e.g., the electronic device (200) of FIG. 2) may store fingerprint feature information including identified feature points and / or the directionality of a fingerprint. For example, the electronic device (e.g., the electronic device (200) of FIG. 2) may store fingerprint feature information in a secure area.

[0100] In one embodiment, an electronic device (e.g., the electronic device (200) of FIG. 2) can obtain fingerprint density information from a fingerprint image. For example, a processor (220) and / or a control circuit (520) of the electronic device (e.g., the electronic device (200) of FIG. 2) can individually or collectively perform operations to obtain fingerprint density information from the fingerprint image. For example, the electronic device (e.g., the electronic device (200) of FIG. 2) can identify a first region corresponding to a fingerprint of the fingerprint image. For example, the electronic device (e.g., the electronic device (200) of FIG. 2) can convert first pixel values ​​of the first region (e.g., the first pixel values ​​(1210) of FIG. 12) into a first wave component in a spatial frequency domain (e.g., the first wave component (1220) of FIG. 12). For example, an electronic device (e.g., the electronic device (200) of FIG. 2) can obtain a plurality of second wave components by applying a plurality of wave filters (e.g., the plurality of wave filters (1230) of FIG. 12) having different center frequencies to a first wave component (e.g., the first wave component (1220) of FIG. 12). For example, the electronic device (e.g., the electronic device (200) of FIG. 2) can convert the plurality of second wave components into second pixel values ​​(e.g., the second pixel values ​​(1240) of FIG. 12) in a spatial domain. For example, the electronic device (e.g., the electronic device (200) of FIG. 2) can identify a local wave value per pixel from the second pixel values ​​(e.g., the second pixel values ​​(1240) of FIG. 12). For example, an electronic device (e.g., the electronic device (200) of FIG. 2) can quantify local wavenumber values ​​per pixel. For example, the electronic device (e.g., the electronic device (200) of FIG. 2) can obtain fingerprint density information including the quantified local wavenumber values ​​per pixel.For example, an electronic device (e.g., electronic device (200) of FIG. 2) can store fingerprint density information in a secure area.

[0101] FIG. 6A is a diagram for explaining a state in which a first protective member is attached on a display of an electronic device according to one embodiment, FIG. 6B is a diagram for explaining a state in which a second protective member is attached on a display of an electronic device according to one embodiment, and FIG. 6C is a diagram for explaining a state in which a third protective member is attached on a display of an electronic device according to one embodiment. FIGS. 6A to 6C are side views of an electronic device (200). The electronic device (200) of FIGS. 6A to 6C may have a fingerprint sensor (e.g., an ultrasonic fingerprint sensor (300) of FIG. 3B) disposed below (e.g., in the -z direction) a display (e.g., a display (260) of FIG. 2).

[0102] Referring to FIGS. 6A to 6C, the electronic device (200) may have a protective member (610, 620, 630) attached to the top (e.g., in the +z direction) of the display (260) to prevent the display (260) from being broken or damaged. For example, the electronic device (200) may have a protective member formed of a PET series film or a protective member formed of tempered glass and an adhesive layer attached to the display (260).

[0103] Referring to FIG. 6A, for example, the electronic device (200) may have a first protective member (610) having a first thickness (d1) attached to the display (260). Referring to FIG. 6B, for example, the electronic device (200) may have a second protective member (620) having a second thickness (d2) attached to the display (260). Referring to FIG. 6C, for example, the electronic device (200) may have a third protective member (630) having a third thickness (d3) attached to the display (260).

[0104] In one embodiment, the protective members (610, 620, 630) may have different thicknesses. For example, the second protective member (620) may be thicker than the first protective member (610). For example, the third protective member (630) may be thicker than the second protective member (620).

[0105] As the thickness of the protective members (610, 620, 630) increases, the round trip time of the ultrasonic signal generated from the ultrasonic fingerprint sensor may increase. Accordingly, the electronic device (200) may acquire a fingerprint image using a parameter set that takes into account the thickness of the protective members (610, 620, 630), as described below with reference to FIG. 7.

[0106] FIG. 7 is a diagram illustrating parameter sets used by a fingerprint sensor of an electronic device according to one embodiment. The parameter sets of FIG. 7 are a first state in which no protective member is attached on the display (e.g., the display (260) of FIG. 2) of the electronic device (e.g., the electronic device (200) of FIG. 2), a second state in which a first protective member (e.g., the first protective member (610) of FIG. 6a) is attached on the display (e.g., the display (260) of FIG. 2) of the electronic device (e.g., the electronic device (200) of FIG. 2), a third state in which a second protective member (e.g., the second protective member (620) of FIG. 6b) is attached on the display (e.g., the display (260) of FIG. 2) of the electronic device (e.g., the electronic device (200) of FIG. 2), and a third protective member (e.g., the third protective member (620) of FIG. 6c) is attached on the display (e.g., the display (260) of FIG. 2) of the electronic device (e.g., the electronic device (200) of FIG. 2). It may include parameter sets corresponding to each of the fourth states to which the absence (630) is attached.

[0107] According to one embodiment, the parameter sets of FIG. 7 may include parameters for obtaining the clearest fingerprint image through experiments for each of the first to fourth states of an electronic device (e.g., the electronic device (200) of FIG. 2). Each of the parameter sets may include a parameter relating to a frequency of an ultrasonic signal (e.g., frequency), a parameter relating to a round trip time of an ultrasonic signal (e.g., RGD), and a parameter relating to a delay time of each of the elements of a transducer array (e.g., PSF table).

[0108] According to one embodiment, parameter sets may be stored in a table format. For example, parameter sets may be stored as a look-up table (LUT). For example, parameter sets may be stored in an electronic device (e.g., the electronic device (200) of FIG. 2) when the electronic device is manufactured. For example, parameter sets may be stored in a secure area provided in the electronic device (e.g., the electronic device (200) of FIG. 2). The secure area may be a separate area provided within the processor. The secure area may be a separate area provided outside of the processor (e.g., an embedded secure element (eSE), a secure processor). For example, the secure area may be an ARM TM Trustzone developed by Saga TM ) may apply. For example, the security zone may be implemented as a hypervisor.

[0109] According to one embodiment, an electronic device (e.g., the electronic device (200) of FIG. 2) may operate an ultrasonic fingerprint sensor (300) using at least one parameter set from among the parameter sets of FIG. 7. For example, the electronic device (e.g., the electronic device (200) of FIG. 2) may obtain a fingerprint image by operating an ultrasonic fingerprint sensor (e.g., the ultrasonic fingerprint sensor (300) of FIG. 3b) using a frequency of A Hz, an RGD of A' value, and a PSF table of A" value included in a first parameter set. For example, the electronic device (e.g., the electronic device (200) of FIG. 2) may obtain a fingerprint image by operating an ultrasonic fingerprint sensor (e.g., the ultrasonic fingerprint sensor (300) of FIG. 3b) using a frequency of B Hz, an RGD of B' value, and a PSF table of B" value included in a second parameter set. For example, an electronic device (e.g., an electronic device (200) of FIG. 2) can obtain a fingerprint image by operating an ultrasonic fingerprint sensor (e.g., an ultrasonic fingerprint sensor (300) of FIG. 3b) using a frequency of C Hz, an RGD of C' value, and a PSF table of C" value included in a third parameter set. For example, an electronic device (e.g., an electronic device (200) of FIG. 2) can obtain a fingerprint image by operating an ultrasonic fingerprint sensor (e.g., an ultrasonic fingerprint sensor (300) of FIG. 3b) using a frequency of D Hz, an RGD of D' value, and a PSF table of D" value included in a fourth parameter set.

[0110] According to one embodiment, an electronic device (e.g., the electronic device (200) of FIG. 2) may acquire a fingerprint image using a parameter set set as a reference parameter set from among a plurality of parameter sets. For example, the electronic device (e.g., the electronic device (200) of FIG. 2) may set one parameter set from among the plurality of parameter sets as a reference parameter set. For example, the reference parameter set may be a parameter set that is preferentially used over other parameter sets to acquire a fingerprint image. For example, the reference parameter set may be set when the electronic device (e.g., the electronic device (200) of FIG. 2) is manufactured. For example, the reference parameter set may be set while the electronic device (e.g., the electronic device (200) of FIG. 2) acquires a fingerprint image.

[0111] According to one embodiment, an electronic device (e.g., the electronic device (200) of FIG. 2) can set a reference parameter set while acquiring a fingerprint image. For example, the electronic device (e.g., the electronic device (200) of FIG. 2) can acquire a first fingerprint image by operating an ultrasonic fingerprint sensor using a first parameter set set as a reference parameter set, and can acquire a second fingerprint image, a third fingerprint image, and a fourth fingerprint image using the second to fourth parameter sets, which are not set as the reference parameter sets, in a round robin manner. For example, the electronic device (e.g., the electronic device (200) of FIG. 2) can reset the reference parameter set based on a result of comparing the first fingerprint image with the second fingerprint image, the third fingerprint image, and the fourth fingerprint image. For example, the electronic device (e.g., the electronic device (200) of FIG. 2) can set the second parameter set as the reference parameter set based on a second fingerprint image acquired more clearly than the first fingerprint image.

[0112] According to one embodiment, an electronic device (e.g., the electronic device (200) of FIG. 2) may acquire a fingerprint image using one of a plurality of scan modes. For example, the electronic device (e.g., the electronic device (200) of FIG. 2) may acquire a fingerprint image using a first scan mode or a second scan mode. For example, the first scan mode may include a scan mode that analyzes an image for all areas corresponding to a fingerprint regardless of the density of the fingerprint pattern. For example, the second scan mode may include a scan mode that analyzes an image only for areas where the fingerprint pattern is not dense.

[0113] According to one embodiment, each of the parameter sets may be matched with one scan mode among a plurality of scan modes. For example, an electronic device (e.g., the electronic device (200) of FIG. 2) may acquire a fingerprint image based on a parameter set corresponding to a state of the electronic device (e.g., the electronic device (200) of FIG. 2) and a scan mode matched thereto. For example, the electronic device (e.g., the electronic device (200) of FIG. 2) may acquire a fingerprint image using a first parameter set corresponding to a first state and a first scan mode matched with the first parameter set. For example, the electronic device (e.g., the electronic device (200) of FIG. 2) may acquire a fingerprint image using a second parameter set corresponding to a second state and a second scan mode matched with the second parameter set. For example, the electronic device (e.g., the electronic device (200) of FIG. 2) may acquire a fingerprint image using a third parameter set corresponding to a third state and a second scan mode matched with the third parameter set. For example, an electronic device (e.g., electronic device (200) of FIG. 2) can acquire a fingerprint image in a first scan mode matched with a fourth parameter set using a fourth parameter set corresponding to a fourth state.

[0114] According to the disclosed embodiment, if an electronic device acquires a fingerprint image only using a scan mode matching a parameter set, it may not sufficiently reflect the characteristics of the user's fingerprint (e.g., fingerprint density). For example, when acquiring a fingerprint image of a woman or a child with small fingers using a second parameter set or a third parameter set, the electronic device (e.g., the electronic device (200) of FIG. 2) may acquire the fingerprint image using the second scan mode. Since the second scan mode is a scan mode that analyzes images only for areas where the fingerprint pattern is not dense, a fingerprint image reflecting the characteristics of the fingerprint of a child with a dense fingerprint pattern or a woman with small fingers may not be acquired. A fingerprint image that does not reflect the characteristics of the user's fingerprint may have a low resolution. Therefore, the electronic device (e.g., the electronic device (200) of FIG. 2) may have a high probability of fingerprint authentication failure.

[0115] FIG. 8 is a flowchart illustrating a method for determining a parameter set used by a fingerprint sensor of an electronic device, according to one embodiment.

[0116] The operation of the electronic device illustrated in FIG. 8 (e.g., the electronic device (200) of FIG. 2) may be performed by a processor (e.g., the processor (220) of FIG. 2) performing calculations or controlling components of the electronic device (e.g., the electronic device (200) of FIG. 2). In the following embodiments, the operations may be performed sequentially, but are not necessarily performed sequentially. For example, the order of the operations may be changed, and at least two operations may be performed in parallel.

[0117] In one embodiment, parameters of an electronic device may be defined experimentally during manufacturing. For example, parameters may be defined experimentally to correspond to the state of an electronic device (e.g., electronic device (200) of FIG. 2). The state of the electronic device (e.g., the electronic device (200) of FIG. 2) is a first state in which no protective member is attached to the electronic device (e.g., the electronic device (200) of FIG. 2), a second state in which a first protective member (e.g., the first thickness (d1) of FIG. 6A) having a first thickness (e.g., the first thickness (d1) of FIG. 6A) (e.g., the first protective member (610) of FIG. 6A)) is attached to the electronic device (e.g., the electronic device (200) of FIG. 2), a third state in which a second protective member (e.g., the second thickness (d2) of FIG. 6A) having a second thickness (e.g., the second thickness (d2) of FIG. 6A) (e.g., the second protective member (620) of FIG. 6B)) having a third thickness (e.g., the third thickness (d3) of FIG. 6A) (e.g., the third thickness (d3) of FIG. 6C)) is attached to the electronic device (e.g., the electronic device (200) of FIG. 2). It may include a fourth state in which a third protective member (630)) is attached.

[0118] Referring to operation 810, an electronic device (e.g., the electronic device (200) of FIG. 2) according to one embodiment may define a first parameter of a fingerprint sensor corresponding to states of the electronic device (e.g., the electronic device (200) of FIG. 2). For example, the first parameter may include a parameter relating to a frequency of an ultrasonic signal (e.g., frequency) and a parameter relating to a round trip time of the ultrasonic signal (e.g., RGD).

[0119] According to one embodiment, an electronic device (e.g., the electronic device (200) of FIG. 2) may define a first parameter corresponding to each of the states of the electronic device (e.g., the electronic device (200) of FIG. 2)). For example, the electronic device (e.g., the electronic device (200) of FIG. 2) may define the first parameter corresponding to each of the states of the electronic device (e.g., the electronic device (200) of FIG. 2) through an experiment during manufacturing. For example, the electronic device (e.g., the electronic device (200) of FIG. 2) may define the parameter when the intensity of the ultrasonic echo signal is the strongest as the first parameter. For example, the electronic device (e.g., the electronic device (200) of FIG. 2) may define the parameter when the signal to noise ratio (SNR) of the ultrasonic echo signal is the highest as the first parameter. For example, as described above with reference to FIG. 7, an electronic device (e.g., an electronic device (200) of FIG. 2) may be defined to have a frequency of A Hz, an RGD of A' value to correspond to a first state of the electronic device (e.g., an electronic device (200) of FIG. 2). For example, an electronic device (e.g., an electronic device (200) of FIG. 2) may be defined to have a frequency of B Hz, an RGD of B' value to correspond to a second state of the electronic device (e.g., an electronic device (200) of FIG. 2). For example, an electronic device (e.g., an electronic device (200) of FIG. 2) may be defined to have a frequency of C Hz, an RGD of C' value to correspond to a third state of the electronic device (e.g., an electronic device (200) of FIG. 2). For example, an electronic device (e.g., an electronic device (200) of FIG. 2) may be defined such that an RGD of a frequency of D Hz and a value of D' correspond to a fourth state of the electronic device (e.g., an electronic device (200) of FIG. 2).

[0120] Referring to operation 820, an electronic device (e.g., electronic device (200) of FIG. 2) according to one embodiment may define scan modes of a fingerprint sensor.

[0121] For example, an electronic device (e.g., the electronic device (200) of FIG. 2) may define the scan modes described above with reference to FIG. 7. For example, the electronic device (e.g., the electronic device (200) of FIG. 2) may define a first scan mode that analyzes images for all areas corresponding to a fingerprint regardless of the density of the fingerprint pattern. For example, the electronic device (e.g., the electronic device (200) of FIG. 2) may define a second scan mode that analyzes images only for areas where the fingerprint pattern is not dense.

[0122] For example, an electronic device (e.g., an electronic device (200) of FIG. 2) may define scan modes described below with reference to FIG. 15. For example, an electronic device (e.g., an electronic device (200) of FIG. 2) may define scan modes distinguished by the density of a fingerprint pattern. For example, the scan modes of an electronic device (e.g., an electronic device (200) of FIG. 2) may be determined by experiment. For example, the scan modes of an electronic device (e.g., an electronic device (200) of FIG. 2) may be determined so that fingerprint images acquired by a fingerprint sensor (e.g., an ultrasonic fingerprint sensor (300) of FIG. 3B) have the highest resolution. For example, the scan modes of an electronic device (e.g., the electronic device (200) of FIG. 2) may be determined so that a region of interest (e.g., a region corresponding to a target LPMM) of a fingerprint image acquired by a fingerprint sensor (e.g., an ultrasonic fingerprint sensor (300) of FIG. 3b) has the highest resolution.

[0123] For example, scan modes of an electronic device (e.g., electronic device (200) of FIG. 2) may be determined based on line pair millimeter (LPMM) values ​​of a fingerprint image.

[0124] Referring to operation 830, an electronic device (e.g., the electronic device (200) of FIG. 2) according to an embodiment can scan a fingerprint tool based on defined parameters and scan modes. For example, the fingerprint tool can include information of various spatial frequencies. For example, the electronic device (e.g., the electronic device (200) of FIG. 2) can scan a fingerprint tool that is in contact with the electronic device (e.g., the electronic device (200) of FIG. 2) by operating an ultrasonic fingerprint sensor (e.g., the ultrasonic fingerprint sensor (300) of FIG. 3B) with scan modes defined in operation 820 using the first parameters defined in operation 810. The ultrasonic fingerprint sensor (e.g., the ultrasonic fingerprint sensor (300) of FIG. 3B) can provide an ultrasonic signal to the fingerprint tool and receive an ultrasonic echo signal reflected from the fingerprint tool.

[0125] For example, an electronic device (e.g., the electronic device (200) of FIG. 2) can scan a fingerprint tool in contact with a display (e.g., the display (260) of FIG. 2) that does not have a protective member attached, using an RGD of a frequency of A Hz, A' value corresponding to a first state of the electronic device (e.g., the electronic device (200) of FIG. 2)). For example, an electronic device (e.g., the electronic device (200) of FIG. 2) can scan a fingerprint tool in contact with a display (e.g., the display (260) of FIG. 2) that has a first protective member (e.g., the first protective member (610) of FIG. 6A) attached, using an RGD of a frequency of B Hz, B' value corresponding to a second state of the electronic device (e.g., the electronic device (200) of FIG. 2)). For example, an electronic device (e.g., an electronic device (200) of FIG. 2) can scan a fingerprint tool in contact with a display (e.g., a display (260) of FIG. 2) to which a second protective member (e.g., a second protective member (620) of FIG. 6b) is attached using an RGD of a frequency of C Hz and a value of C' corresponding to a third state of the electronic device (e.g., an electronic device (200) of FIG. 2). For example, an electronic device (e.g., an electronic device (200) of FIG. 2) can scan a fingerprint tool in contact with a display (e.g., a display (260) of FIG. 2) to which a third protective member (e.g., a third protective member (630) of FIG. 6c) is attached using an RGD of a frequency of D Hz, a D' value corresponding to a fourth state of the electronic device (e.g., an electronic device (200) of FIG. 2).

[0126] For example, an electronic device (e.g., the electronic device (200) of FIG. 2) can scan a fingerprint tool by operating an ultrasonic fingerprint sensor (e.g., the ultrasonic fingerprint sensor (300) of FIG. 3b) in a plurality of scan modes. For example, an electronic device (e.g., the electronic device (200) of FIG. 2) can scan a fingerprint tool by operating an ultrasonic fingerprint sensor (e.g., the ultrasonic fingerprint sensor (300) of FIG. 3b) in a plurality of scan modes described above with reference to FIG. 7. For example, an electronic device (e.g., the electronic device (200) of FIG. 2) can scan a fingerprint tool by operating an ultrasonic fingerprint sensor (e.g., the ultrasonic fingerprint sensor (300) of FIG. 3b) in a plurality of scan modes described below with reference to FIG. 15.

[0127] According to one embodiment, an electronic device (e.g., the electronic device (200) of FIG. 2) can acquire fingerprint images using ultrasonic echo signals received by an ultrasonic fingerprint sensor (e.g., the ultrasonic fingerprint sensor (300) of FIG. 3b). For example, the electronic device (e.g., the electronic device (200) of FIG. 2) can acquire fingerprint images corresponding to each of the ultrasonic echo signals acquired based on each of the parameters defined in operation 810 and each of the combinations of scan modes defined in operation 820.

[0128] Referring to operation 840, an electronic device according to one embodiment (e.g., electronic device (200) of FIG. 2 ) may define second parameters of a fingerprint sensor based on fingerprint images acquired by scanning a fingerprint tool. For example, the second parameters may include parameters for delay times of each element of a transducer array (e.g., a PSF table).

[0129] For example, an electronic device (e.g., an electronic device (200) of FIG. 2) may define parameters as second parameters when the clearest fingerprint image is acquired through an experiment for each of the first to fourth states of the electronic device (e.g., an electronic device (200) of FIG. 2). For example, an electronic device in the first state (e.g., an electronic device (200) of FIG. 2) may define the A" value of the PSF table when the clearest fingerprint image is acquired among fingerprint images acquired by scanning a fingerprint tool using an RGD of a frequency of A Hz and an A' value as a second parameter.

[0130] For example, an electronic device in a second state (e.g., an electronic device (200) of FIG. 2) may define the B" value of the PSF table, which is the clearest fingerprint image among fingerprint images obtained by scanning a fingerprint tool using an RGD of a frequency of B Hz and a B' value, as a second parameter.

[0131] For example, an electronic device in a third state (e.g., an electronic device (200) of FIG. 2) may define the C" value of the PSF table as a second parameter when the clearest fingerprint image is acquired among fingerprint images acquired by scanning a fingerprint tool using an RGD of a frequency of C Hz and a C' value.

[0132] For example, an electronic device in the fourth state (e.g., an electronic device (200) of FIG. 2) may define the D" value of the PSF table as the second parameter when the clearest fingerprint image is acquired among fingerprint images acquired by scanning a fingerprint tool using an RGD of a frequency of D Hz and a D' value.

[0133] Referring to operation 850, an electronic device according to one embodiment (e.g., the electronic device (200) of FIG. 2) may store a parameter set including a first parameter and a second parameter. For example, a parameter set including a first parameter defined in operation 810 and a second parameter defined in operation 840 may be stored.

[0134] According to one embodiment, parameter sets may be stored in a table format. For example, parameter sets may be stored as a look-up table (LUT). For example, parameter sets may be stored in a secure area provided in an electronic device (e.g., electronic device (200) of FIG. 2). The secure area may be a separate area provided within a processor. The secure area may be a separate area provided outside of the processor (e.g., an embedded secure element (eSE), a secure processor). For example, the secure area may be an ARM TM Trustzone developed by Saga TM ) may apply. For example, the security zone may be implemented as a hypervisor.

[0135] For example, parameter sets may be stored in an electronic device (e.g., an electronic device (200) of FIG. 2) when the electronic device is manufactured. For example, an electronic device (e.g., an electronic device (200) of FIG. 2) may be pre-loaded with parameter sets when it is shipped from a factory.

[0136] FIG. 9 is a flowchart illustrating a method for registering a fingerprint by an electronic device according to one embodiment. The operations of the electronic device (e.g., the electronic device (200) of FIG. 2) illustrated in FIG. 9 may be performed by a processor (e.g., the processor (220) of FIG. 2) performing calculations or controlling components of the electronic device (e.g., the electronic device (200) of FIG. 2). In the following embodiments, the operations may be performed sequentially, but are not necessarily performed sequentially. For example, the order of the operations may be changed, and at least two operations may be performed in parallel.

[0137] Referring to operation 910, an electronic device (e.g., the electronic device (200) of FIG. 2) according to one embodiment may prepare to register a fingerprint. For example, the electronic device (e.g., the electronic device (200) of FIG. 2) may initialize an ultrasonic fingerprint sensor (e.g., the ultrasonic fingerprint sensor (300) of FIG. 3B). For example, the electronic device (e.g., the electronic device (200) of FIG. 2) may identify whether a foreign substance exists on a first area (e.g., the first area (260a) of FIG. 3A) of a display (e.g., the display (260) of FIG. 2) where an ultrasonic signal arrives from the ultrasonic fingerprint sensor (e.g., the ultrasonic fingerprint sensor (300) of FIG. 3B) for fingerprint recognition. For example, an electronic device (e.g., the electronic device (200) of FIG. 2) can identify whether a foreign substance exists on a first area (e.g., the first area (260a) of FIG. 3A) by acquiring a background ultrasound image of the first area (e.g., the first area (260a) of FIG. 3A) using an ultrasonic fingerprint sensor (e.g., the ultrasonic fingerprint sensor (300) of FIG. 3B). The background ultrasound image may include an ultrasound image acquired in a situation where a finger of a user (e.g., the user (390) of FIG. 3A) does not contact the first area (e.g., the first area (260a) of FIG. 3A). For example, an electronic device can identify whether a foreign substance is present on a first area (e.g., the first area (260a) of FIG. 3a) by transmitting an ultrasonic signal to a first area (e.g., the first area (260a) of FIG. 3a) where a finger of a user (e.g., the user (390) of FIG. 3a) is not in contact with the first area using an ultrasonic fingerprint sensor (e.g., the ultrasonic fingerprint sensor (300) of FIG. 3b) and identifying that an ultrasonic echo signal is received.

[0138] According to one embodiment, an electronic device (e.g., the electronic device (200) of FIG. 2) can determine a scan mode of an ultrasonic fingerprint sensor (e.g., the ultrasonic fingerprint sensor (300) of FIG. 3b). For example, the electronic device (e.g., the electronic device (200) of FIG. 2) can determine one scan mode from among a plurality of defined scan modes of the ultrasonic fingerprint sensor (e.g., the ultrasonic fingerprint sensor (300) of FIG. 3b). For example, the scan mode of the ultrasonic fingerprint sensor (e.g., the ultrasonic fingerprint sensor (300) of FIG. 3b) may include a first scan mode that analyzes an image for all areas corresponding to a fingerprint regardless of the density of the fingerprint pattern, as described above with reference to FIG. 7, and a second scan mode that analyzes an image only for areas where the fingerprint pattern is not dense. For example, the scan mode of the ultrasonic fingerprint sensor (e.g., the ultrasonic fingerprint sensor (300) of FIG. 3b) may include the scan modes described below with reference to FIG. 15.

[0139] Referring to operation 920, an electronic device (e.g., the electronic device (200) of FIG. 2) according to one embodiment may receive a first input regarding a first fingerprint. For example, the electronic device (e.g., the electronic device (200) of FIG. 2) may display a UI that guides a user (e.g., the user (390) of FIG. 3A) to make contact with a finger. For example, the electronic device (e.g., the electronic device (200) of FIG. 2) may display a UI in a first area (e.g., the first area (260a) of FIG. 3A) so that a user (e.g., the user (390) of FIG. 3A) may make contact with a finger in the first area (e.g., the first area (260a) of FIG. 3A). For example, an electronic device (e.g., an electronic device (200) of FIG. 2) may be configured to allow a finger of a user (e.g., a user (390) of FIG. 3A) to come into contact with a first area (e.g., a first area (260a) of FIG. 3A) of a display (e.g., a display (260) of FIG. 2). The finger may include a first fingerprint.

[0140] Referring to operation 930, an electronic device (e.g., the electronic device (200) of FIG. 2) according to one embodiment may transmit an ultrasonic signal and receive an ultrasonic echo signal. For example, the electronic device (e.g., the electronic device (200) of FIG. 2) may transmit the ultrasonic signal to a finger of a user (e.g., the user (390) of FIG. 3A) who touches a first area (e.g., the first area (260a) of FIG. 3A) of a display (e.g., the display (260) of FIG. 2)) using an ultrasonic fingerprint sensor (e.g., the ultrasonic fingerprint sensor (300) of FIG. 3B).

[0141] For example, an electronic device (e.g., the electronic device (200) of FIG. 2) can generate an ultrasonic signal by operating an ultrasonic fingerprint sensor (e.g., the ultrasonic fingerprint sensor (300) of FIG. 3B) using a set of reference parameters. For example, the set of reference parameters may be set when the electronic device (e.g., the electronic device (200) of FIG. 2) is manufactured. For example, the set of reference parameters may be set when the electronic device (e.g., the electronic device (200) of FIG. 2) acquires a fingerprint image.

[0142] For example, the electronic device (e.g., the electronic device (200) of FIG. 2) may generate an ultrasonic signal in a scan mode determined in operation 910. For example, the electronic device (e.g., the electronic device (200) of FIG. 2) may generate an ultrasonic signal in one of a first scan mode that analyzes an image for all areas corresponding to a fingerprint regardless of the density of the fingerprint pattern, and a second scan mode that analyzes an image only for areas where the fingerprint pattern is not dense, as described above with reference to FIG. 7. For example, the electronic device (e.g., the electronic device (200) of FIG. 2) may generate an ultrasonic signal in the determined scan mode by comparing the second density values ​​defining each of the plurality of scan modes with the first density value included in the first fingerprint density information (e.g., fingerprint density information of a registered fingerprint image stored in a memory). For example, the electronic device (e.g., the electronic device (200) of FIG. 2) may generate an ultrasonic signal in one of the scan modes determined from among the scan modes described below with reference to FIG. 15.

[0143] For example, an electronic device (e.g., an electronic device (200) of FIG. 2) can receive an ultrasonic echo signal reflected by a finger of a user (e.g., a user (390) of FIG. 3a) using an ultrasonic fingerprint sensor (e.g., an ultrasonic fingerprint sensor (300) of FIG. 3b).

[0144] For example, an electronic device (e.g., an electronic device (200) of FIG. 2) can receive an ultrasonic echo signal reflected by a ridge (391) of a finger of a user (e.g., a user (390) of FIG. 3A) in contact with a display (260) and an ultrasonic echo signal reflected by a valley (392) of a finger of the user (e.g., a user (390) of FIG. 3A) (or, an air layer (393) existing between the surface of the display (260) and the valley (392) of the user's finger) by using an ultrasonic fingerprint sensor (e.g., an ultrasonic fingerprint sensor (300) of FIG. 3B). Operation 930 may be analogized to the operations of the electronic device (e.g., an electronic device (200) of FIG. 2) and the ultrasonic fingerprint sensor (e.g., an ultrasonic fingerprint sensor (300) of FIG. 3B) described above with reference to FIGS. 3A and 3B. Overlapping contents are omitted.

[0145] Referring to operation 940, an electronic device according to one embodiment (e.g., the electronic device (200) of FIG. 2) can obtain a first registered fingerprint image based on an ultrasonic echo signal.

[0146] For example, an electronic device (e.g., the electronic device (200) of FIG. 2) can pre-process an ultrasonic echo signal. For example, the electronic device (e.g., the electronic device (200) of FIG. 2) can amplify, buffer, filter, sample, and / or quantize the ultrasonic echo signal. For example, the electronic device (e.g., the electronic device (200) of FIG. 2) can obtain raw data by beamforming an ultrasonic echo signal received by an ultrasonic fingerprint sensor (e.g., the ultrasonic fingerprint sensor (300) of FIG. 3B).

[0147] For example, an electronic device (e.g., the electronic device (200) of FIG. 2) can perform image processing on raw data. For example, the electronic device (e.g., the electronic device (200) of FIG. 2) can generate a raw image by applying an image reconstruction algorithm to the raw data.

[0148] For example, an electronic device (e.g., the electronic device (200) of FIG. 2) can perform image processing on a raw image. The electronic device (e.g., the electronic device (200) of FIG. 2) can generate an enrolled fingerprint image, which is a fingerprint image registered in the electronic device, by applying an algorithm of filtering, scaling, compression, and / or averaging to the raw image.

[0149] For example, an electronic device (e.g., the electronic device (200) of FIG. 2) can identify the quality of an enrolled fingerprint image. For example, the electronic device (e.g., the electronic device (200) of FIG. 2) can identify qualities such as brightness, contrast, and clarity of an enrolled fingerprint image. For example, the electronic device (e.g., the electronic device (200) of FIG. 2) can identify whether the quality of an enrolled fingerprint image satisfies a predetermined standard. For example, the electronic device (e.g., the electronic device (200) of FIG. 2) can identify that the predetermined standard is met by identifying that the brightness, contrast, and clarity of an enrolled fingerprint image fall within a predetermined range. For example, the electronic device (e.g., the electronic device (200 of FIG. 2) can remove an enrolled fingerprint image whose quality does not meet the predetermined standard and rescan the user's fingerprint.

[0150] According to one embodiment, an electronic device (e.g., the electronic device (200) of FIG. 2) can set a reference parameter set while acquiring a fingerprint image. For example, the electronic device (e.g., the electronic device (200) of FIG. 2) can acquire a first fingerprint image by operating an ultrasonic fingerprint sensor (e.g., the ultrasonic fingerprint sensor (300) of FIG. 3B) using a first parameter set set as a reference parameter set, and can acquire a second fingerprint image, a third fingerprint image, and a fourth fingerprint image using second to fourth parameter sets that are not set as reference parameter sets in a round robin manner. For example, the electronic device (e.g., the electronic device (200) of FIG. 2) can reset the reference parameter set based on a result of comparing the first fingerprint image with the second fingerprint image, the third fingerprint image, and the fourth fingerprint image. For example, an electronic device (e.g., electronic device (200) of FIG. 2) can set a second parameter set as a reference parameter set based on a second fingerprint image acquired more clearly than the first fingerprint image.

[0151] Referring to operation 950, an electronic device (e.g., the electronic device (200) of FIG. 2) according to one embodiment may obtain first fingerprint feature information and first fingerprint density information from a first registered fingerprint image. For example, the electronic device (e.g., the electronic device (200) of FIG. 2) may identify a first area corresponding to a fingerprint in the fingerprint image.

[0152] For example, an electronic device (e.g., the electronic device (200) of FIG. 2) can obtain first fingerprint feature information regarding the features of a first fingerprint from a first region of a first registered fingerprint image. For example, a processor (220) and / or a control circuit (520) of the electronic device (e.g., the electronic device (200) of FIG. 2) can individually or collectively perform operations to obtain the first fingerprint feature information from the first registered fingerprint image. For example, the electronic device (e.g., the electronic device (200) of FIG. 2) can remove noise from the first registered fingerprint image and perform binarization and normalization. For example, the electronic device (e.g., the electronic device (200) of FIG. 2) can identify minutiae, such as ridge endings, bifurcations, and minutiae areas, of the first fingerprint. For example, an electronic device (e.g., the electronic device (200) of FIG. 2) can identify the directionality of a fingerprint by finding the core and delta, which are the center points of the first fingerprint. For example, the electronic device (e.g., the electronic device (200) of FIG. 2) can generate first fingerprint feature information including information about the identified feature points and / or the directionality of the fingerprint.

[0153] For example, an electronic device (e.g., the electronic device (200) of FIG. 2) can obtain first fingerprint density information regarding the density per unit area of ​​a first fingerprint from a first region of a first registered fingerprint image. For example, the electronic device (e.g., the electronic device (200) of FIG. 2) can convert first pixel values ​​of the first region into first wavenumber elements in a wavenumber domain. For example, the electronic device (e.g., the electronic device (200) of FIG. 2) can obtain a plurality of second wavenumber elements by applying a plurality of wavenumber filters having different center frequencies to the first wavenumber elements. For example, the electronic device (e.g., the electronic device (200 of FIG. 2)) can convert the plurality of second wavenumber elements into second pixel values ​​in a spatial domain. For example, an electronic device (e.g., the electronic device (200) of FIG. 2) can identify a local wavenumber value per pixel from a second pixel value. For example, the electronic device (e.g., the electronic device (200) of FIG. 2) can quantify the local wavenumber value per pixel. For example, the electronic device (e.g., the electronic device (200) of FIG. 2) can obtain first fingerprint density information including the quantified local wavenumber value per pixel.

[0154] Referring to operation 960, an electronic device (e.g., the electronic device (200) of FIG. 2) according to an embodiment may register a first fingerprint by storing first fingerprint characteristic information and first fingerprint density information. For example, the electronic device (e.g., the electronic device (200) of FIG. 2) may store the first fingerprint characteristic information and the first fingerprint density information in a secure area provided in the electronic device (e.g., the electronic device (200) of FIG. 2). The secure area may be a separate area provided within the processor. The secure area may be a separate area provided in addition to the processor (e.g., an embedded secure element (eSE), a secure processor). For example, the secure area may be an ARM TM Trustzone developed by Saga TM ) may apply. For example, the security zone may be implemented as a hypervisor.

[0155] FIG. 10 is a flowchart illustrating a method for an electronic device to obtain fingerprint density information according to an embodiment. FIG. 11 is a diagram illustrating an operation for an electronic device to set an area corresponding to a fingerprint according to an embodiment. FIG. 11 is a diagram illustrating operations 1010 and 1020 of FIG. 10. FIG. 12 is a diagram illustrating an operation for an electronic device to obtain a unit frequency value per pixel of a fingerprint image according to an embodiment. FIG. 12 is a diagram illustrating operations 1030 to 1060 of FIG. 10. FIG. 13 is a diagram illustrating an image showing a distribution of a fingerprint image and a unit frequency per pixel obtained by an electronic device according to an embodiment. FIG. 13 is a diagram illustrating operation 1050 of FIG. 10. FIG. 14 is a diagram illustrating a result of quantifying a unit frequency obtained by an electronic device according to an embodiment. FIG. 14 is a diagram illustrating operation 1060 of FIG. 10.

[0156] The operation of the electronic device illustrated in FIG. 10 (e.g., the electronic device (200) of FIG. 2) may be performed by a processor (e.g., the processor (220) of FIG. 2) performing calculations or controlling components of the electronic device (e.g., the electronic device (200) of FIG. 2). In the following embodiments, the operations may be performed sequentially, but are not necessarily performed sequentially. For example, the order of the operations may be changed, and at least two operations may be performed in parallel.

[0157] Referring to operation 1010, an electronic device (e.g., the electronic device (200) of FIG. 2) according to one embodiment may acquire a first registered fingerprint image. For example, the electronic device (e.g., the electronic device (200) of FIG. 2) may acquire a first registered fingerprint image (1110) through operations 910 to 940 described above with reference to FIG. 9. For example, the first registered fingerprint image (1110) may include a fingerprint area (1110a) and a background (1110b).

[0158] For example, an electronic device (e.g., the electronic device (200) of FIG. 2) can obtain a first registered fingerprint image (1110) by operating an ultrasonic fingerprint sensor (e.g., the ultrasonic fingerprint sensor (300) of FIG. 3B) using a set of reference parameters. For example, the set of reference parameters may be set when the electronic device (e.g., the electronic device (200) of FIG. 2) is manufactured. For example, the set of reference parameters may be set when the electronic device (e.g., the electronic device (200) of FIG. 2) obtains a fingerprint image.

[0159] For example, the electronic device (e.g., the electronic device (200) of FIG. 2) can obtain a first registered fingerprint image (1110) by operating the ultrasonic fingerprint sensor (e.g., the ultrasonic fingerprint sensor (300) of FIG. 3b) in a scan mode determined in operation 1010. For example, the electronic device (e.g., the electronic device (200) of FIG. 2) can obtain a first registered fingerprint image (1110) by operating the ultrasonic fingerprint sensor (e.g., the ultrasonic fingerprint sensor (300) of FIG. 3b) in one scan mode among a first scan mode that analyzes an image for all areas corresponding to a fingerprint regardless of the density of the fingerprint pattern, and a second scan mode that analyzes an image only for areas where the fingerprint pattern is not dense, as described above with reference to FIG. 7.

[0160] For example, an electronic device (e.g., an electronic device (200) of FIG. 2) can obtain a first registered fingerprint image (1110) by operating an ultrasonic fingerprint sensor (e.g., an ultrasonic fingerprint sensor (300) of FIG. 3B) in a determined scan mode by comparing a first density value included in the first fingerprint density information with second density values ​​defining each of a plurality of scan modes. For example, an electronic device (e.g., an electronic device (200) of FIG. 2) can obtain a first registered fingerprint image (1110) by operating an ultrasonic fingerprint sensor (e.g., an ultrasonic fingerprint sensor (300) of FIG. 3B) in one scan mode determined from among the scan modes described below with reference to FIG. 15.

[0161] Referring to operation 1020, an electronic device (e.g., the electronic device (200) of FIG. 2) according to one embodiment may identify a first region of a first registered fingerprint image (1110). The first region may be a region corresponding to a fingerprint region (1110a). For example, the electronic device (e.g., the electronic device (200) of FIG. 2) may identify the fingerprint region (1110a) and the background (1110b) using an algorithm that identifies the outline of a fingerprint. The background (1110b) may be removed because it does not have a local wavenumber value and may distort the value when quantifying the local wavenumber value.

[0162] In one embodiment, an electronic device (e.g., an electronic device (200) of FIG. 2) can identify a fingerprint region (1120a) from which a scar (1120b) is excluded as a first region. For example, the electronic device (e.g., an electronic device (200) of FIG. 2) can identify a fingerprint region (1120a) from which a scar (1120b) and a background (1120c) are excluded from a fingerprint image (1120) by using an algorithm that excludes regions larger than a predetermined size and having pixel values ​​lower than a predetermined value.

[0163] In one embodiment, an electronic device (e.g., the electronic device (200) of FIG. 2) can identify a fingerprint region (1130a) including a scar (1120b) as a first region. For example, the electronic device (e.g., the electronic device (200) of FIG. 2) can identify a fingerprint region (1130a) and a background (1130b) from a fingerprint image (1130) using an algorithm that identifies the outermost region of a region where pixel values ​​exist.

[0164] Referring to operation 1030, an electronic device according to one embodiment (e.g., the electronic device (200) of FIG. 2) can convert first pixel values ​​(1210) of a first region of a spatial domain into a first frequency component (1220) of a spatial frequency domain.

[0165] Referring to FIG. 12, an electronic device (e.g., the electronic device (200) of FIG. 2) according to one embodiment can identify a pixel value (1210) of a first region in a spatial domain identified in operation 1020. The pixel value (1210) of the first region can include a pixel value of a first region (1120a, 1130a) of a first registered fingerprint image (1110) acquired in a steady state. For example, the electronic device (e.g., the electronic device (200) of FIG. 2) can identify the pixel value (1210) of the first region as in Mathematical Expression 1.

[0166]

[0167] Referring to FIG. 12, an electronic device (e.g., the electronic device (200) of FIG. 2) according to one embodiment can convert a first pixel value (1210) of a first region of a spatial domain into a first wave component (1220) of a spatial frequency domain. For example, the electronic device (e.g., the electronic device (200) of FIG. 2) can convert the first pixel values ​​(1210) of the first region into the first wave component (1220) by applying a fast Fourier transform (FFT). For example, the electronic device (e.g., the electronic device (200) of FIG. 2) can identify the first wave component (1220) as in Equation 2.

[0168]

[0169] Referring to operation 1040, an electronic device (e.g., the electronic device (200) of FIG. 2) according to one embodiment can obtain a plurality of second wavenumber components by applying a plurality of wavenumber filters (1230) having different center frequencies to a first wavenumber component (1220). For example, the electronic device (e.g., the electronic device (200) of FIG. 2) can obtain the second wavenumber components by applying filters such as Equation 3 to the first wavenumber component (1220).

[0170]

[0171] Referring to operation 1050, an electronic device (e.g., the electronic device (200) of FIG. 2) according to an embodiment can convert a plurality of second wavenumber components into second pixel values ​​(1240) in a spatial domain. For example, the electronic device (e.g., the electronic device (200) of FIG. 2) can convert the second wavenumber components into second pixel values ​​(1240) in a spatial domain by applying an inverse fast Fourier transform (iFFT). The second pixel values ​​(1240) can represent a local wavenumber value included in a pixel. For example, the electronic device (e.g., the electronic device (200) of FIG. 2) can identify the second pixel values ​​(1240) as in Equation 4.

[0172]

[0173] Referring to operation 1060, an electronic device (e.g., the electronic device (200) of FIG. 2) according to one embodiment may obtain first fingerprint density information based on second pixel values ​​(1240). For example, the electronic device (e.g., the electronic device (200) of FIG. 2) may obtain first fingerprint density information in which the second pixel values ​​(1240) include quantified values.

[0174] For example, an electronic device (e.g., the electronic device (200) of FIG. 2) can obtain first fingerprint density information including a third pixel value (1250) composed of the maximum argument by performing a maximum argument selection (choose argument max) as in Equation 5 for the second pixel values ​​(1240). The third pixel value (1250) can represent a main local frequency value of the pixel.

[0175]

[0176] Referring to FIG. 13, an electronic device (e.g., the electronic device (200) of FIG. 2) according to one embodiment can obtain a fingerprint density image (1320) including a third pixel value (1250) by performing operations 1020 to 1060 from a first registered fingerprint image (1310). The electronic device (e.g., the electronic device (200) of FIG. 2) can obtain first fingerprint density information including the fingerprint density image (1320).

[0177] Referring to FIG. 14, an electronic device according to one embodiment (e.g., the electronic device (200) of FIG. 2) can obtain first fingerprint density information (1410) including an average spatial frequency value (1411) and a standard deviation value (1412) for a first area (1120a, 1130a) of a first registered fingerprint image (1110) based on a third pixel value (1250).

[0178] Referring to FIG. 14, an electronic device according to one embodiment (e.g., the electronic device (200) of FIG. 2) can obtain first fingerprint density information (1420) including a distribution histogram for a first area (1120a, 1130a) of a first registered fingerprint image (1110) based on a third pixel value (1250).

[0179] Referring to FIG. 14, an electronic device according to one embodiment (e.g., the electronic device (200) of FIG. 2) may obtain first fingerprint density information (1430) including cutoff spatial frequency values ​​(1431, 1432, 1433) for a first area (1120a, 1130a) of a first registered fingerprint image (1110) based on a third pixel value (1250). The first fingerprint density information (1430) may include at least one of a 70% cutoff spatial frequency value (1431), an 80% cutoff spatial frequency value (1432), or a 90% cutoff spatial frequency value (1433).

[0180] According to one embodiment, an electronic device (e.g., the electronic device (200) of FIG. 2) may store the acquired first fingerprint density information. For example, the electronic device (e.g., the electronic device (200) of FIG. 2) may store the first fingerprint density information in a secure area. For example, the electronic device (e.g., the electronic device (200) of FIG. 2) may store the first fingerprint density information together with the first fingerprint feature information. Operation 960 described above with reference to FIG. 9 may be analogically applied. Duplicate content is omitted.

[0181] FIG. 15 is a diagram illustrating a scan mode of a fingerprint sensor of an electronic device according to one embodiment. FIG. 15 may include a scan mode related to the fingerprint density information described above with reference to FIGS. 10 to 14.

[0182] Referring to FIG. 15, an ultrasonic fingerprint sensor according to one embodiment (e.g., the ultrasonic fingerprint sensor (300) of FIG. 3B) may have multiple defined scan modes. For example, the multiple scan modes may be defined during the manufacturing of an electronic device (e.g., the electronic device (200) of FIG. 2).

[0183] In one embodiment, the plurality of scan modes may be determined based on a density value representing the density of lines per unit area. For example, each of the plurality of scan modes may be determined based on a local wavenumber value. For example, each of the plurality of scan modes may be determined based on a quantified local wavenumber value. For example, each of the plurality of scan modes may be determined based on line pair millimeter (LPMM) values.

[0184] In one embodiment, the plurality of scan modes may have a range of density values ​​determined. For example, the ranges of the scan modes may be determined experimentally. For example, the plurality of scan modes may be determined to acquire a high-resolution fingerprint image of an area including a corresponding range of density values. Each of the plurality of scan modes may have a range of LPMM (line pair millimeter) values ​​matched. For example, a first scan mode may be a scan mode that acquires a high-resolution fingerprint image of an area including a density value of 1.7 to 2.1 LPMM. For example, a second scan mode may be a scan mode that acquires a high-resolution fingerprint image of an area including a density value of 2.1 to 2.5 LPMM. For example, a third scan mode may be a scan mode that acquires a high-resolution fingerprint image of an area including a density value of 2.5 to 3.5 LPMM.

[0185] According to one embodiment, an electronic device (e.g., the electronic device (200) of FIG. 2) can determine one scan mode from among a plurality of scan modes. For example, the electronic device (e.g., the electronic device (200) of FIG. 2) can determine the scan mode based on fingerprint density information of a registered fingerprint. For example, the electronic device (e.g., the electronic device (200) of FIG. 2) can determine the scan mode by comparing a first density value of the registered fingerprint with second density values ​​defining each of the plurality of scan modes. For example, the electronic device (e.g., the electronic device (200 of FIG. 2)) can determine the scan mode by comparing a line pair millimeter (LPMM) value of the registered fingerprint with a range of each LPMM value of the plurality of scan modes. For example, an electronic device (e.g., an electronic device (200) of FIG. 2) can identify a range to which a first LPMM value of a registered fingerprint corresponds among a first range of 1.7 to 2.1 LPMM, a second range of 2.1 to 2.5 LPMM, and a third range of 2.5 to 3.5 LPMM. The electronic device (e.g., an electronic device (200) of FIG. 2) can determine a scan mode corresponding to the identified range among the first scan mode, the second scan mode, and the third scan mode. For example, the electronic device (e.g., an electronic device (200) of FIG. 2) can obtain a fingerprint image by operating an ultrasonic fingerprint sensor (e.g., an ultrasonic fingerprint sensor (300) of FIG. 3B) in the determined scan mode.

[0186] FIG. 16 is a flowchart illustrating a method for an electronic device to perform fingerprint authentication according to one embodiment. The operations of the electronic device (e.g., the electronic device (200) of FIG. 2) illustrated in FIG. 16 may be performed by a processor (e.g., the processor (220) of FIG. 2) performing calculations or controlling components of the electronic device (e.g., the electronic device (200) of FIG. 2). In the following embodiments, the operations may be performed sequentially, but are not necessarily performed sequentially. For example, the order of the operations may be changed, and at least two operations may be performed in parallel.

[0187] Referring to operation 1610, an electronic device (e.g., a processor (220) of FIG. 2) according to one embodiment may prepare for fingerprint authentication. For example, the electronic device (e.g., an electronic device (200) of FIG. 2) may initialize an ultrasonic fingerprint sensor (e.g., an ultrasonic fingerprint sensor (300) of FIG. 3B). For example, the electronic device (e.g., an electronic device (200) of FIG. 2) may identify whether a foreign substance exists on a first area (e.g., a first area (260a) of FIG. 3A) of a display (e.g., a display (260) of FIG. 2) where an ultrasonic signal arrives from the ultrasonic fingerprint sensor (e.g., an ultrasonic fingerprint sensor (300) of FIG. 3B) for fingerprint recognition. For example, an electronic device (e.g., the electronic device (200) of FIG. 2) can identify whether a foreign substance exists on a first area (e.g., the first area (260a) of FIG. 3A) by acquiring a background ultrasound image of the first area (e.g., the first area (260a) of FIG. 3A) using an ultrasonic fingerprint sensor (e.g., the ultrasonic fingerprint sensor (300) of FIG. 3B). The background ultrasound image may include an ultrasound image acquired in a situation where a finger of a user (e.g., the user (390) of FIG. 3A) does not contact the first area (e.g., the first area (260a) of FIG. 3A). For example, an electronic device can identify whether a foreign substance is present on a first area (e.g., the first area (260a) of FIG. 3a) by transmitting an ultrasonic signal to a first area (e.g., the first area (260a) of FIG. 3a) where a finger of a user (e.g., the user (390) of FIG. 3a) is not in contact with the first area using an ultrasonic fingerprint sensor (e.g., the ultrasonic fingerprint sensor (300) of FIG. 3b) and identifying that an ultrasonic echo signal is received.

[0188] According to one embodiment, an electronic device (e.g., the electronic device (200) of FIG. 2) can determine a scan mode of an ultrasonic fingerprint sensor. For example, the electronic device (e.g., the electronic device (200) of FIG. 2) can determine one scan mode from among a plurality of defined scan modes of an ultrasonic fingerprint sensor (e.g., the ultrasonic fingerprint sensor (300) of FIG. 3B). For example, the scan mode of the ultrasonic fingerprint sensor can include a first scan mode that analyzes an image for all areas corresponding to a fingerprint regardless of the density of the fingerprint pattern, as described above with reference to FIG. 7, and a second scan mode that analyzes an image only for areas where the fingerprint pattern is not dense.

[0189] According to one embodiment, an electronic device (e.g., the electronic device (200) of FIG. 2) may determine a scan mode based on the first fingerprint density information acquired in operation 1060 of FIG. 10. For example, the electronic device (e.g., the electronic device (200) of FIG. 2) may determine a scan mode based on a density value included in the first fingerprint density information among scan modes distinguished by the density of a fingerprint pattern. For example, the electronic device (e.g., the electronic device (200) of FIG. 2) may determine a scan mode by comparing the first density value included in the first fingerprint density information with second density values ​​defining each of a plurality of scan modes. The first density value may include a value in which a local frequency value is quantified. For example, the electronic device (e.g., the electronic device (200) of FIG. 2) may determine one scan mode among a plurality of scan modes distinguished based on line pair millimeter (LPMM) values. For example, an electronic device (e.g., the electronic device (200) of FIG. 2) may determine one scan mode corresponding to the LPMM value included in the first fingerprint density information among a plurality of scan modes. For example, the electronic device (e.g., the electronic device (200) of FIG. 2) may determine one scan mode among the scan modes described above with reference to FIG. 15.

[0190] Referring to operation 1620, an electronic device (e.g., processor (220) of FIG. 2) according to one embodiment may receive a second input regarding a second fingerprint. For example, the electronic device (e.g., electronic device (200) of FIG. 2) may display a UI that guides a user (e.g., user (390) of FIG. 3A) to make contact with a finger. For example, the electronic device (e.g., electronic device (200) of FIG. 2) may display a UI in a first area (e.g., first area (260a) of FIG. 3A) so that a user (e.g., user (390) of FIG. 3A) may make contact with a finger in the first area (e.g., first area (260a) of FIG. 3A). For example, an electronic device (e.g., an electronic device (200) of FIG. 2) may be configured to allow a finger of a user (e.g., a user (390) of FIG. 3A) to come into contact with a first area (e.g., a first area (260a) of FIG. 3A) of a display (e.g., a display (260) of FIG. 2). The finger may include a second fingerprint.

[0191] Referring to operation 1630, an electronic device (e.g., a processor (220) of FIG. 2) according to one embodiment may transmit an ultrasonic signal and receive an ultrasonic echo signal. For example, the electronic device (e.g., an electronic device (200) of FIG. 2) may transmit the ultrasonic signal to a finger of a user (e.g., a user (390) of FIG. 3a) touching a first area (e.g., a first area (260a) of FIG. 3a) of a display (e.g., a display (260) of FIG. 2)) using an ultrasonic fingerprint sensor (e.g., an ultrasonic fingerprint sensor (300) of FIG. 3b).

[0192] For example, an electronic device (e.g., the electronic device (200) of FIG. 2) can generate an ultrasonic signal by operating an ultrasonic fingerprint sensor (e.g., the ultrasonic fingerprint sensor (300) of FIG. 3B) using a set of reference parameters. For example, the set of reference parameters may be set when the electronic device (e.g., the electronic device (200) of FIG. 2) is manufactured. For example, the set of reference parameters may be set when the electronic device (e.g., the electronic device (200) of FIG. 2) acquires a fingerprint image. For example, the set of reference parameters may be set by the electronic device (e.g., the electronic device (200) of FIG. 2) through operation 940 described above with reference to FIG. 9.

[0193] For example, the electronic device (e.g., the electronic device (200) of FIG. 2) may generate an ultrasonic signal in a scan mode determined in operation 1610. For example, the electronic device (e.g., the electronic device (200) of FIG. 2) may generate an ultrasonic signal in one of a first scan mode that analyzes an image for all areas corresponding to a fingerprint regardless of the density of the fingerprint pattern, and a second scan mode that analyzes an image only for areas where the fingerprint pattern is not dense, as described above with reference to FIG. 7. For example, the electronic device (e.g., the electronic device (200) of FIG. 2) may generate an ultrasonic signal in the determined scan mode by comparing the second density values ​​defining each of the plurality of scan modes with the first density value included in the first fingerprint density information. For example, the electronic device (e.g., the electronic device (200) of FIG. 2) may generate an ultrasonic signal in one of the scan modes determined as described above with reference to FIG. 15.

[0194] For example, an electronic device (e.g., an electronic device (200) of FIG. 2) can receive an ultrasonic echo signal reflected by a finger of a user (e.g., a user (390) of FIG. 3A) using an ultrasonic fingerprint sensor (e.g., an ultrasonic fingerprint sensor (300) of FIG. 3B). For example, an electronic device (e.g., an electronic device (200) of FIG. 2) can receive an ultrasonic echo signal reflected by a ridge (391) of a finger of a user (e.g., a user (390) of FIG. 3A) in contact with a display (260) and an ultrasonic echo signal reflected by a valley (392) of a finger of a user (e.g., a user (390) of FIG. 3A) (or an air layer (393) existing between a surface of the display (260) and the valley (392) of the user's finger). Operation 1630 can be analogized to the operation of the electronic device (e.g., the electronic device (200) of FIG. 2) and the ultrasonic fingerprint sensor (e.g., the ultrasonic fingerprint sensor (300) of FIG. 3b) described above with reference to FIGS. 3a and 3b. Duplicate details are omitted.

[0195] Referring to operation 1640, an electronic device (e.g., processor (220) of FIG. 2) according to one embodiment may obtain a first authentication fingerprint image based on an ultrasonic echo signal.

[0196] For example, an electronic device (e.g., the electronic device (200) of FIG. 2) can pre-process an ultrasonic echo signal. For example, the electronic device (e.g., the electronic device (200) of FIG. 2) can amplify, buffer, filter, sample, and / or quantize the ultrasonic echo signal. For example, the electronic device (e.g., the electronic device (200) of FIG. 2) can obtain raw data by beamforming an ultrasonic echo signal received by an ultrasonic fingerprint sensor (e.g., the ultrasonic fingerprint sensor (300) of FIG. 3B).

[0197] For example, an electronic device (e.g., the electronic device (200) of FIG. 2) can perform image processing on raw data. For example, the electronic device (e.g., the electronic device (200) of FIG. 2) can generate a raw image by applying an image reconstruction algorithm to the raw data.

[0198] For example, an electronic device (e.g., the electronic device (200) of FIG. 2) can perform image processing on a raw image. The electronic device (e.g., the electronic device (200) of FIG. 2) can generate an authentication fingerprint image to be compared with a fingerprint image registered in the electronic device by applying an algorithm of filtering, scaling, compression, and / or averaging to the raw image.

[0199] For example, an electronic device (e.g., the electronic device (200) of FIG. 2) can identify the quality of an authentication fingerprint image. For example, the electronic device (e.g., the electronic device (200) of FIG. 2) can identify qualities such as brightness, contrast, and clarity of the authentication fingerprint image. For example, the electronic device (e.g., the electronic device (200) of FIG. 2) can identify whether the quality of the authentication fingerprint image satisfies a predetermined standard. For example, the electronic device (e.g., the electronic device (200) of FIG. 2) can identify that the predetermined standard is met by identifying that the brightness, contrast, and clarity of the authentication fingerprint image fall within a predetermined range. For example, the electronic device (e.g., the electronic device (200 of FIG. 2) can remove an authentication fingerprint image whose quality does not meet the predetermined standard and rescan the user's fingerprint.

[0200] Referring to operation 1650, an electronic device (e.g., processor (220) of FIG. 2) according to one embodiment may obtain second fingerprint feature information from a first authentication fingerprint image. For example, the electronic device (e.g., electronic device (200) of FIG. 2) may obtain second fingerprint feature information regarding features of a second fingerprint from a first area of ​​the first authentication fingerprint image.

[0201] For example, the processor (220) and / or the control circuit (520) of the electronic device (e.g., the electronic device (200) of FIG. 2) may individually or collectively perform operations to obtain second fingerprint feature information from the first authentication fingerprint image. For example, the electronic device (e.g., the electronic device (200) of FIG. 2) may remove noise from the first authentication fingerprint image and perform binarization and normalization. For example, the electronic device (e.g., the electronic device (200) of FIG. 2) may identify minutiae, such as ridge endings, bifurcations, and minutiae areas, of the second fingerprint. For example, the electronic device (e.g., the electronic device (200) of FIG. 2) may identify the directionality of the fingerprint by finding the core and delta, which are the center points of the second fingerprint. For example, an electronic device (e.g., electronic device (200) of FIG. 2) may generate second fingerprint feature information that includes information about the identified feature points and / or the directionality of the fingerprint.

[0202] Referring to operation 1660, an electronic device (e.g., the processor (220) of FIG. 2) according to one embodiment may perform authentication for a second fingerprint by comparing second fingerprint characteristic information with first fingerprint characteristic information. For example, the electronic device (e.g., the electronic device (200) of FIG. 2) may perform a comparison of the second fingerprint characteristic information acquired in operation 1650 with first fingerprint characteristic information stored in a secure area.

[0203] According to one embodiment, an electronic device (e.g., the electronic device (200) of FIG. 2) can identify the similarity between a first feature point included in the first fingerprint feature information and a second feature point included in the second fingerprint feature information. For example, the electronic device (e.g., the electronic device (200) of FIG. 2) can identify the similarity between a ridge ending, a bifurcation, and a patterned area of ​​the first fingerprint and a ridge ending, a bifurcation, and a patterned area of ​​the second fingerprint. For example, the electronic device (e.g., the electronic device (200) of FIG. 2) can authenticate a second fingerprint based on the similarity between the first feature point and the second feature point. For example, the electronic device (e.g., the electronic device (200) of FIG. 2) can authenticate a second fingerprint based on the Euclidean distance between the first feature point and the second feature point being less than a predetermined distance.

[0204] According to one embodiment, the electronic device can identify the similarity between the directionality of the first fingerprint included in the first fingerprint characteristic information and the directionality of the second fingerprint included in the second fingerprint characteristic information. For example, the electronic device (e.g., the electronic device (200) of FIG. 2) can identify the similarity between the directionality of the first fingerprint and the directionality of the second fingerprint based on identifying the core and delta of the first fingerprint and the core and delta of the second fingerprint. For example, the electronic device (e.g., the electronic device (200) of FIG. 2) can authenticate the second fingerprint based on the similarity between the directionality of the first fingerprint and the directionality of the second fingerprint.

[0205] In one embodiment, an electronic device (e.g., the electronic device (200) of FIG. 2) may display an authentication result of a second fingerprint. For example, the electronic device (e.g., the electronic device (200) of FIG. 2) may display a notification indicating that the second fingerprint has been authenticated based on identifying the second fingerprint as being similar to the first fingerprint. For example, the electronic device (e.g., the electronic device (200) of FIG. 2) may display a notification indicating that the second fingerprint has not been authenticated based on identifying the second fingerprint as not being similar to the first fingerprint.

[0206] FIG. 17 is a diagram illustrating an operation of an electronic device displaying a notification for setting a representative fingerprint, according to one embodiment. The electronic device (200) can register multiple fingerprints. For example, the electronic device (200) can register multiple fingerprints through the operations described above with reference to FIGS. 9 and 10 .

[0207] According to one embodiment, the electronic device (200) may obtain a first registered fingerprint image (1711). For example, in response to receiving a first input for the first fingerprint, the electronic device (200) may obtain a first registered fingerprint image (1711) from the first fingerprint. For example, the electronic device (200) may obtain the first registered fingerprint image (1711) through operations 930 and 940 described above with reference to FIG. 9.

[0208] According to one embodiment, the electronic device (200) can obtain a first fingerprint density image (1712) from a first registered fingerprint image (1711). For example, the electronic device (200) can obtain the first fingerprint density image (1712) through operations 1020 to 1060 described above with reference to FIG. 10.

[0209] According to one embodiment, the electronic device (200) can obtain first fingerprint characteristic information (1713) from the first registered fingerprint image (1711). For example, the electronic device (200) can obtain first fingerprint characteristic information (1713) through operation 950 described above with reference to FIG. 9.

[0210] According to one embodiment, the electronic device (200) can obtain first fingerprint density information (1714) from the first fingerprint density image (1712). For example, the electronic device can obtain the first fingerprint density information (1714) through operation 1060 described above with reference to FIG. 10. For example, the first fingerprint density information (1714) can include quantified local frequency values.

[0211] According to one embodiment, the electronic device (200) can register a first fingerprint by storing first fingerprint characteristic information (1713) and first fingerprint density information (1714). For example, the electronic device (200) can store the first fingerprint characteristic information (1713) and first fingerprint density information (1714) in a secure area of ​​the electronic device (200).

[0212] In one embodiment, the electronic device (200) may obtain a second registered fingerprint image (1721). For example, in response to receiving a second input for a second fingerprint, the electronic device (200) may obtain a second registered fingerprint image (1721) from the second fingerprint. For example, the electronic device (200) may obtain the second registered fingerprint image (1721) through operations 930 and 940 described above with reference to FIG. 9.

[0213] According to one embodiment, the electronic device (200) can obtain a second fingerprint density image (1722) from a second registered fingerprint image (1721). For example, the electronic device (200) can obtain the second fingerprint density image (1722) through operations 1020 to 1060 described above with reference to FIG. 10.

[0214] According to one embodiment, the electronic device (200) can obtain second fingerprint characteristic information (1723) from the second registered fingerprint image (1721). For example, the electronic device (200) can obtain second fingerprint characteristic information (1723) through operation 950 described above with reference to FIG. 9.

[0215] According to one embodiment, the electronic device (200) can obtain second fingerprint density information (1724) from the second fingerprint density image (1722). For example, the electronic device can obtain the second fingerprint density information (1724) through operation 1060 described above with reference to FIG. 10. For example, the second fingerprint density information (1724) can include quantified local frequency values.

[0216] According to one embodiment, the electronic device (200) can register a second fingerprint by storing second fingerprint characteristic information (1723) and second fingerprint density information (1724). For example, the electronic device (200) can store the second fingerprint characteristic information (1723) and second fingerprint density information (1724) in a secure area of ​​the electronic device (200).

[0217] In one embodiment, the first and second fingerprints may have different fingerprint densities. For example, the first fingerprint density information (1714) of the first fingerprint may be different from the second fingerprint density information (1724) of the second fingerprint. For example, the distribution of the first fingerprint registered in the electronic device (200) may be different from the distribution of the second fingerprint.

[0218] According to one embodiment, the electronic device (200) can set a representative fingerprint from among registered fingerprints. For example, the electronic device (200) can set a representative fingerprint in response to receiving a user input. For example, the electronic device (200) can display a UI (1790) for setting a representative fingerprint to the user.

[0219] In one embodiment, the electronic device (200) may suggest a fingerprint to be set as a representative fingerprint among multiple registered fingerprints. For example, the electronic device (200) may display a UI (1790) suggesting that the first fingerprint among the first and second fingerprints be set as the representative fingerprint.

[0220] According to one embodiment, the electronic device (200) may propose a fingerprint to be set as a representative fingerprint based on fingerprint density information of a plurality of registered fingerprints. For example, the electronic device (200) may propose a fingerprint to be set as a representative fingerprint based on a first density value identified from the first fingerprint density information (1714) and a second density value identified from the second fingerprint density information (1724). For example, the electronic device (200) may propose to set a first fingerprint as a representative fingerprint based on the fact that among the first density value, which is a quantified local frequency value, and the second density value, which is a quantified local frequency value, the first density value is lower than the second density value.

[0221] According to the disclosed embodiment, an electronic device can improve the performance of fingerprint recognition by determining a scan mode of an ultrasonic fingerprint sensor based on fingerprint density information acquired during fingerprint registration.

[0222] The effects that can be obtained from the present disclosure are not limited to the effects mentioned above, and other effects that are not mentioned can be clearly understood by a person having ordinary skill in the art to which the present disclosure belongs from the description below.

[0223] An electronic device (e.g., the electronic device (200) of FIG. 2) according to one embodiment of the disclosure may include at least one processor (e.g., the processor (220) of FIG. 2) including a processing circuit. The electronic device (e.g., the electronic device (200) of FIG. 2) may include a fingerprint sensor (e.g., the ultrasonic fingerprint sensor (300) of FIG. 3B) that obtains information about a fingerprint of a user (e.g., the user (390) of FIG. 3A) who has come into contact with the electronic device (e.g., the electronic device (200) of FIG. 2)). The electronic device (e.g., the electronic device (200) of FIG. 2) may include a memory (e.g., the memory (230) of FIG. 2) that includes a plurality of parameter sets (LUTs) and instructions used by the fingerprint sensor (e.g., the ultrasonic fingerprint sensor (300) of FIG. 3B) to obtain information about a fingerprint of a user (e.g., the electronic device (390) of FIG. 3A)). An electronic device (e.g., the electronic device (200) of FIG. 2) can receive a first input regarding a first fingerprint. The electronic device (e.g., the electronic device (200) of FIG. 2) can obtain a first registered fingerprint image from the first input by operating a fingerprint sensor (e.g., the ultrasonic fingerprint sensor (300) of FIG. 3B) using a first parameter set set as a reference parameter set among a plurality of parameter sets. The electronic device (e.g., the electronic device (200) of FIG. 2) can obtain first fingerprint feature information regarding the characteristics of the first fingerprint and first fingerprint density information regarding the density of the first fingerprint from the first registered fingerprint image. The electronic device (e.g., the electronic device (200) of FIG. 2) can register the first fingerprint by storing the first fingerprint feature information and the first fingerprint density information. The electronic device (e.g., the electronic device (200) of FIG. 2) can receive a second input regarding a second fingerprint.An electronic device (e.g., an electronic device (200) of FIG. 2) can obtain a first authentication fingerprint image from a second input by operating the fingerprint sensor using a first parameter set in a first scan mode determined based on first fingerprint density information among a plurality of defined scan modes of a fingerprint sensor (e.g., an ultrasonic fingerprint sensor (300) of FIG. 3b). The electronic device (e.g., an electronic device (200) of FIG. 2) can obtain second fingerprint feature information about features of a second fingerprint from the first authentication fingerprint image. The electronic device (e.g., an electronic device (200) of FIG. 2) can perform authentication on the second fingerprint by comparing the second fingerprint feature information with the first fingerprint feature information.

[0224] In one embodiment, an electronic device (e.g., the electronic device (200) of FIG. 2) can identify a first region corresponding to a first fingerprint from a first registered fingerprint image. The electronic device (e.g., the electronic device (200) of FIG. 2) can obtain first fingerprint density information regarding a local wavenumber value of the first region.

[0225] According to one embodiment, an electronic device (e.g., electronic device (200) of FIG. 2) can determine a first scan mode from among a plurality of defined scan modes based on first fingerprint density information regarding a local wavenumber value of a first area.

[0226] According to one embodiment, each of the plurality of defined scan modes may be defined based on a quantified local wavenumber value. An electronic device (e.g., the electronic device (200) of FIG. 2) may obtain first fingerprint density information including a quantified local wavenumber value of a first region. The electronic device (e.g., the electronic device (200) of FIG. 2) may determine a first scan mode among the plurality of scan modes based on a result of comparing the first density value, in which the local wavenumber value of the first region is quantified, to second density values ​​defining each of the plurality of scan modes. The electronic device may obtain a first authentication fingerprint image using the first scan mode.

[0227] According to one embodiment, an electronic device (e.g., the electronic device (200) of FIG. 2) can convert first pixel values ​​of a first area of ​​a first registered fingerprint image in a spatial domain (e.g., the first pixel value (1210) of FIG. 12) into a first wavenumber component (e.g., the first wavenumber component (1220) of FIG. 12) in a spatial frequency domain. The electronic device (e.g., the electronic device (200) of FIG. 2) can obtain a plurality of second wavenumber components by applying a plurality of wavenumber filters (e.g., a plurality of wavenumber filters (1230) of FIG. 12) to the first wavenumber component (e.g., the first wavenumber component (1220) of FIG. 12). An electronic device (e.g., the electronic device (200) of FIG. 2) can convert a plurality of second wave components in a spatial frequency domain into second pixel values ​​in a spatial domain (e.g., the second pixel values ​​(1240) of FIG. 12). The electronic device (e.g., the electronic device (200) of FIG. 2) can obtain first fingerprint density information about local wave values ​​in a first region based on the second pixel values ​​(e.g., the second pixel values ​​(1240) of FIG. 12).

[0228] According to one embodiment, an electronic device (e.g., the electronic device (200) of FIG. 2) may obtain a second authentication fingerprint image for a second fingerprint by operating a fingerprint sensor in a first scan mode using a second parameter set among a plurality of parameter sets while performing authentication for a second fingerprint using a first authentication fingerprint image. The electronic device (e.g., the electronic device (200) of FIG. 2) may set the second parameter set as a reference parameter set based on a result of comparing the second authentication fingerprint image with the first authentication fingerprint image.

[0229] According to one embodiment, an electronic device (e.g., electronic device (200) of FIG. 2) may obtain third fingerprint feature information about the features of a second fingerprint from the second authentication fingerprint image based on a result of comparing the second authentication fingerprint image with the first authentication fingerprint image. The electronic device (e.g., electronic device (200) of FIG. 2) may perform authentication of the second fingerprint by comparing the third fingerprint feature information with the first fingerprint feature information.

[0230] According to one embodiment, an electronic device (e.g., the electronic device (200) of FIG. 2) can set a representative fingerprint among a plurality of registered fingerprints based on quantified density values ​​of local wavenumber values ​​corresponding to each of the plurality of fingerprints registered in the electronic device (e.g., the electronic device (200) of FIG. 2).

[0231] According to one embodiment, a first fingerprint may be set as a representative fingerprint among multiple fingerprints registered in an electronic device (e.g., an electronic device (200) of FIG. 2). The electronic device (e.g., an electronic device (200) of FIG. 2) may set the second fingerprint as the representative fingerprint based on a result of comparing first fingerprint density information regarding the first fingerprint with second fingerprint density information regarding the second fingerprint.

[0232] According to one embodiment, an electronic device (e.g., electronic device (200) of FIG. 2) can obtain a third authentication fingerprint image from a second input by operating a fingerprint sensor using a set of reference parameters in a second scan mode determined from among a plurality of defined scan modes based on second fingerprint density information.

[0233] According to one disclosed embodiment, a method of operating an electronic device (e.g., the electronic device (200) of FIG. 2) may include an operation of receiving a first input relating to a first fingerprint. The method of operating the electronic device (e.g., the electronic device (200) of FIG. 2) may include an operation of operating a fingerprint sensor (e.g., the ultrasonic fingerprint sensor (300) of FIG. 3B) using a first parameter set set as a reference parameter set from among a plurality of parameter sets, thereby obtaining a first registered fingerprint image from the first input. The method of operating the electronic device (e.g., the electronic device (200) of FIG. 2) may include an operation of obtaining first fingerprint feature information relating to a feature of the first fingerprint and first fingerprint density information relating to a density of the first fingerprint from the first registered fingerprint image. The method of operating the electronic device (e.g., the electronic device (200) of FIG. 2) may include an operation of registering the first fingerprint by storing the first fingerprint feature information and the first fingerprint density information. A method of operating an electronic device (e.g., the electronic device (200) of FIG. 2) may include an operation of receiving a second input relating to a second fingerprint. The method of operating an electronic device (e.g., the electronic device (200) of FIG. 2) may include an operation of operating a fingerprint sensor (e.g., the ultrasonic fingerprint sensor (300) of FIG. 3B) using a first parameter set in a first scan mode determined based on first fingerprint density information among a plurality of defined scan modes of the fingerprint sensor, thereby obtaining a first authentication fingerprint image from the second input. The method of operating an electronic device (e.g., the electronic device (200) of FIG. 2) may include an operation of obtaining second fingerprint feature information relating to features of a second fingerprint from the first authentication fingerprint image.A method of operating an electronic device (e.g., electronic device (200) of FIG. 2) may include an operation of performing authentication for a second fingerprint by comparing second fingerprint characteristic information with first fingerprint characteristic information.

[0234] In one embodiment, the operation of obtaining the first fingerprint density information may include the operation of identifying a first region corresponding to the first fingerprint from the first registered fingerprint image. The operation of obtaining the first fingerprint density information may include the operation of obtaining first fingerprint density information regarding a local wavenumber value of the first region.

[0235] According to one embodiment, the operation of obtaining a first authentication fingerprint image may include the operation of determining a first scan mode from among a plurality of defined scan modes based on first fingerprint density information regarding a local frequency value of a first area.

[0236] According to one embodiment, each of the plurality of defined scan modes may be defined based on a quantified local wavenumber value. The operation of obtaining the first fingerprint density information may include the operation of obtaining the first fingerprint density information including a quantified local wavenumber value of the first region. The operation of obtaining the first authentication fingerprint image may include the operation of determining the first scan mode from among the plurality of scan modes based on a result of comparing the first density value, in which the local wavenumber value of the first region is quantified, to second density values ​​defining each of the plurality of scan modes.

[0237] According to one embodiment, the operation of obtaining the first fingerprint density information may include an operation of converting first pixel values ​​of a first area of ​​a first registered fingerprint image in a spatial domain (e.g., the first pixel values ​​(1210) of FIG. 12) into first wavenumber components in a spatial frequency domain (e.g., the first wavenumber components (1220) of FIG. 12). The operation of obtaining the first density information may include an operation of obtaining a plurality of second wavenumber components by applying a plurality of wavenumber filters (e.g., the plurality of wavenumber filters (1230) of FIG. 12) to the first wavenumber components (e.g., the first wavenumber components (1220) of FIG. 12). The operation of obtaining the first density information may include an operation of converting the plurality of second wavenumber components in the spatial frequency domain into second pixel values ​​in the spatial domain (e.g., the second pixel values ​​(1240) of FIG. 12). The operation of obtaining the first density information may include an operation of obtaining first fingerprint density information about local wavenumber values ​​of the first area based on second pixel values ​​(e.g., the second pixel values ​​(1240) of FIG. 12).

[0238] According to one embodiment, the operation of performing authentication for the second fingerprint may include an operation of obtaining a second authentication fingerprint image for the second fingerprint by operating a fingerprint sensor (e.g., an ultrasonic fingerprint sensor (300) of FIG. 3B) using a second parameter set from among a plurality of parameter sets in a first scan mode. The operation of performing authentication for the second fingerprint may include an operation of setting the second parameter set as a reference parameter set based on a result of comparing the second authentication fingerprint image with the first authentication fingerprint image.

[0239] In one embodiment, the operation of performing authentication for the second fingerprint may include an operation of obtaining third fingerprint characteristic information regarding characteristics of the second fingerprint from the second authentication fingerprint image based on a result of comparing the second authentication fingerprint image with the first authentication fingerprint image. The operation of performing authentication for the second fingerprint may include an operation of performing authentication for the second fingerprint by comparing the third fingerprint characteristic information with the first fingerprint characteristic information.

[0240] According to one embodiment, a method of operating an electronic device (e.g., an electronic device (200) of FIG. 2) may include an operation of setting a representative fingerprint among a plurality of registered fingerprints based on quantified density values ​​of local frequency values ​​corresponding to each of a plurality of fingerprints registered in the electronic device (e.g., an electronic device (200) of FIG. 2).

[0241] According to one embodiment, a first fingerprint may be set as a representative fingerprint among multiple fingerprints registered in an electronic device (e.g., the electronic device (200) of FIG. 2). The operation of setting the representative fingerprint may include an operation of setting the second fingerprint as the representative fingerprint based on a result of comparing first fingerprint density information regarding the first fingerprint with second fingerprint density information regarding the second fingerprint.

[0242] According to one embodiment of the present disclosure, a non-transitory computer-readable recording medium having recorded thereon instructions for controlling an electronic device (e.g., the electronic device (200) of FIG. 2) may include instructions for obtaining a first registered fingerprint image from a first input by operating a fingerprint sensor (e.g., the ultrasonic fingerprint sensor (300) of FIG. 3B) using a first parameter set set as a reference parameter set from among a plurality of parameter sets. The recording medium may include instructions for obtaining first fingerprint feature information regarding characteristics of a first fingerprint and first fingerprint density information regarding a density of the first fingerprint from the first registered fingerprint image. The recording medium may include instructions for registering a first fingerprint by storing the first fingerprint feature information and the first fingerprint density information. The recording medium may include instructions for obtaining a first authentication fingerprint image from a second input by operating a fingerprint sensor (e.g., an ultrasonic fingerprint sensor (300) of FIG. 3B) using a first parameter set in a first scan mode determined based on first fingerprint density information among a plurality of defined scan modes of the fingerprint sensor (e.g., an ultrasonic fingerprint sensor (300) of FIG. 3B). The recording medium may include instructions for obtaining second fingerprint feature information about features of a second fingerprint from the first authentication fingerprint image. The recording medium may include instructions for performing authentication on the second fingerprint by comparing the second fingerprint feature information with the first fingerprint feature information.

[0243] The methods according to the embodiments described in the claims or specification of the present disclosure may be implemented in the form of hardware, software, or a combination of hardware and software.

[0244] When implemented in software, a computer-readable storage medium storing one or more programs (software modules) may be provided. The one or more programs stored in the computer-readable storage medium are configured for execution by one or more processors within an electronic device. The one or more programs include instructions that cause the electronic device to execute methods according to embodiments described in the claims or specification of the present disclosure.

[0245] In the present disclosure, the functions or operations performed by the electronic device may be performed by one or more processors executing one or more instructions stored in a memory. The functions or operations of the electronic device mentioned in the present disclosure may be performed by one processor executing one or more instructions, or may be performed by a combination of multiple processors executing one or more instructions. The processor mentioned in the present disclosure may be understood to include circuitry for performing calculations or controlling other components of the electronic device. For example, the one or more processors may include a central processing unit (CPU), a microprocessor unit (MPU), an application processor (AP), a communication processor (CP), a neural processing unit (NPU), a system on a chip (SoC), or an integrated circuit (IC) configured to execute one or more instructions. The one or more processors may be configured to perform the operations of the electronic device described above.

[0246] In the present disclosure, a program (software module, software) may be stored in a non-volatile memory including a random access memory (RAM), a flash memory, a read only memory (ROM), an electrically erasable programmable read only memory (EEPROM), a magnetic disc storage device, a compact disc ROM (CD-ROM), digital versatile discs (DVDs) or other forms of optical storage devices, a magnetic cassette. Or, it may be stored in a memory formed by a combination of some or all of these. The memory may be formed by a single storage medium, or may be formed by a combination of a plurality of storage media. The one or more commands may be stored in a single storage medium, or may be distributed and stored in a plurality of storage media.

[0247] Additionally, the program may be stored on an attachable storage device that is accessible via a communication network such as the Internet, an intranet, a local area network (LAN), a wide LAN (WLAN), or a storage area network (SAN), or a combination thereof. Such a storage device may be connected to a device performing an embodiment of the present disclosure via an external port. Additionally, a separate storage device on the communication network may be connected to a device performing an embodiment of the present disclosure.

[0248] In the specific embodiments of the present disclosure described above, components included in the disclosure are expressed singularly or plurally, depending on the specific embodiment presented. However, the singular or plural expressions are selected to suit the presented situation for convenience of explanation, and the present disclosure is not limited to singular or plural components. Components expressed in plural may be composed of singular elements, or components expressed in singular may be composed of plural elements.

[0249] Additionally, in the present disclosure, terms such as “part”, “module”, etc. may refer to a hardware component such as a processor or circuit, and / or a software component executed by a hardware component such as a processor.

[0250] A "component" or "module" may be implemented by a program stored in an addressable storage medium and executed by a processor. For example, a "component" or "module" may be implemented by components such as software components, object-oriented software components, class components, and task components, as well as processes, functions, attributes, procedures, subroutines, segments of program code, drivers, firmware, microcode, circuitry, data, databases, data structures, tables, arrays, and variables.

[0251] The specific implementations described in this disclosure are merely exemplary and do not limit the scope of the present disclosure in any way. For the sake of brevity, descriptions of conventional electronic components, control systems, software, and other functional aspects of the systems may be omitted.

[0252] Additionally, in the present disclosure, “comprising at least one of a, b, or c” may mean “comprising only a, including only b, including only c, or including a combination of two or more (including a and b, including b and c, including a and c, or including all of a, b, and c).

[0253] While the detailed description of this disclosure has described specific embodiments, it should be understood that various modifications are possible without departing from the scope of this disclosure. Therefore, the scope of this disclosure should not be limited to the described embodiments, but should be defined not only by the scope of the claims described below, but also by equivalents thereof.

[0254] Electronic devices according to the various embodiments disclosed in this document may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to the embodiments of this document are not limited to the aforementioned devices.

[0255] The various embodiments of this document and the terminology used therein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

[0256] The term "module" used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0257] Various embodiments of the present document may be implemented as software (e.g., a program (140)) including one or more instructions stored in a storage medium (e.g., an internal memory (136) or an external memory (138)) readable by a machine (e.g., an electronic device (101)). For example, a processor (e.g., a processor (120)) of the machine (e.g., an electronic device (101)) may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.

[0258] According to one embodiment, the method according to various embodiments disclosed in this document may be provided as included in a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or may be distributed online (e.g., downloaded or uploaded) through an application store (e.g., Play Store™) or directly between two user devices (e.g., smart phones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily generated in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0259] According to various embodiments, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separately arranged in other components. According to various embodiments, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to various embodiments, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

Claims

In electronic devices, At least one processor comprising a processing circuit; A fingerprint sensor that obtains information about a user's fingerprint that has come into contact with the electronic device; A memory including a plurality of parameter sets and commands used by the fingerprint sensor to obtain information about the user's fingerprint; The above instructions are individually or collectively executed by the at least one processor, thereby causing the electronic device to: Receive a first input regarding a first fingerprint, By operating the fingerprint sensor using a first parameter set set as a reference parameter set among the plurality of parameter sets, a first registered fingerprint image is obtained from the first input, Obtain first fingerprint feature information about the features of the first fingerprint and first fingerprint density information about the density of the first fingerprint from the first registered fingerprint image, By storing the first fingerprint characteristic information and the first fingerprint density information, the first fingerprint is registered, Receive a second input regarding the second fingerprint, By operating the fingerprint sensor using the first parameter set in a first scan mode determined based on the first fingerprint density information among the plurality of defined scan modes of the fingerprint sensor, a first authentication fingerprint image is obtained from the second input, Obtain second fingerprint feature information about the features of the second fingerprint from the first authentication fingerprint image, By comparing the second fingerprint characteristic information with the first fingerprint characteristic information, authentication is performed for the second fingerprint. Electronic devices. In the first paragraph, The above instructions are individually or collectively executed by the at least one processor, thereby causing the electronic device to: Identifying a first area corresponding to the first fingerprint from the first registered fingerprint image, To obtain the first fingerprint density information regarding the local wave number value of the first region, Electronic devices. In the second paragraph, The above instructions are individually or collectively executed by the at least one processor, thereby causing the electronic device to: Based on the first fingerprint density information about the local wave number value of the first area, the first scan mode is determined from among the plurality of defined scan modes. Electronic devices. In the third paragraph, Each of the above defined scan modes is defined based on a quantified local wavenumber value, The above instructions are individually or collectively executed by the at least one processor, thereby causing the electronic device to: Obtaining the first fingerprint density information including the quantified value of the local wave number value of the first region, Based on the result of comparing the first density value, in which the local wavenumber value of the first region is quantified, to the second density values ​​defining each of the plurality of scan modes, a first scan mode is determined among the plurality of scan modes, To obtain the first authentication fingerprint image in the first scan mode, Electronic devices. In the second paragraph, The above instructions are individually or collectively executed by the at least one processor, thereby causing the electronic device to: Converting the first pixel values ​​of the first region of the first registered fingerprint image in the spatial domain into a first wave component in the spatial frequency domain, By applying a plurality of wave filters to the first wave component, a plurality of second wave components are obtained, Converting the plurality of second wave components in the spatial frequency domain into second pixel values ​​in the spatial domain, Based on the second pixel values, the first fingerprint density information regarding the local wavenumber values ​​of the first area is obtained. Electronic devices. In the first paragraph, The above instructions are individually or collectively executed by the at least one processor, thereby causing the electronic device to: While performing authentication for the second fingerprint using the first authentication fingerprint image, In the first scan mode, by operating the fingerprint sensor using a second parameter set among the plurality of parameter sets, a second authentication fingerprint image for the second fingerprint is obtained, Based on the result of comparing the second authentication fingerprint image with the first authentication fingerprint image, the second parameter set is set as the reference parameter set. Electronic devices. In the second paragraph, The above electronic device has multiple fingerprints registered, The above instructions are individually or collectively executed by the at least one processor, thereby causing the electronic device to: Based on the quantified density values ​​of the local wavenumber values ​​corresponding to each of the plurality of registered fingerprints, a representative fingerprint is set among the plurality of registered fingerprints. Electronic devices. In a method of operating an electronic device, An action of receiving a first input regarding a first fingerprint; An operation of obtaining a first registered fingerprint image from the first input by operating a fingerprint sensor using a first parameter set set as a reference parameter set among a plurality of parameter sets; An operation of obtaining first fingerprint feature information regarding the features of the first fingerprint and first fingerprint density information regarding the density of the first fingerprint from a first registered fingerprint image; An operation of registering the first fingerprint by storing the first fingerprint characteristic information and the first fingerprint density information; An action of receiving a second input regarding a second fingerprint; An operation of obtaining a first authentication fingerprint image from the second input by operating the fingerprint sensor using the first parameter set in a first scan mode determined based on the first fingerprint density information among a plurality of defined scan modes of the fingerprint sensor; An operation of obtaining second fingerprint feature information regarding the features of the second fingerprint from the first authentication fingerprint image; and An operation of performing authentication for the second fingerprint by comparing the second fingerprint characteristic information with the first fingerprint characteristic information, How it works. In paragraph 8, The operation of obtaining the above first fingerprint density information is: An operation of identifying a first area corresponding to the first fingerprint from the first registered fingerprint image; and comprising an operation of obtaining the first fingerprint density information regarding the local wave number value of the first region; How it works. In paragraph 9, The operation of obtaining the above first authentication fingerprint image is: An operation of determining the first scan mode among the plurality of defined scan modes based on the first fingerprint density information regarding the local wave number value of the first area, How it works. In Article 10, Each of the above defined scan modes is defined based on a quantified local wavenumber value, The operation of obtaining the above first fingerprint density information is: An operation of obtaining the first fingerprint density information including a quantified value of the local wave number value of the first region, The operation of obtaining the above first authentication fingerprint image is: An operation of determining a first scan mode among a plurality of scan modes based on a result of comparing a first density value whose local wavenumber value of the first region is quantified to second density values ​​defining each of the plurality of scan modes, How it works. In paragraph 9, The operation of obtaining the above first fingerprint density information is: An operation of converting first pixel values ​​of the first area of ​​the first registered fingerprint image in the spatial domain into a first wave component in the spatial frequency domain; An operation of obtaining a plurality of second wave components by applying a plurality of wave filters to the first wave component; An operation of converting the plurality of second wave components in the spatial frequency domain into second pixel values ​​in the spatial domain; and An operation of obtaining the first fingerprint density information regarding local wavenumber values ​​of the first area based on the second pixel values, How it works. In paragraph 8, The operation of performing authentication for the above second fingerprint is as follows: An operation of obtaining a second authentication fingerprint image for the second fingerprint by operating the fingerprint sensor using a second parameter set among the plurality of parameter sets in the first scan mode; and An operation of setting the second parameter set as the reference parameter set based on a result of comparing the second authentication fingerprint image with the first authentication fingerprint image, How it works. In paragraph 9, The above method of operation is, An operation of setting a representative fingerprint among the plurality of registered fingerprints based on quantified density values ​​of local frequency values ​​corresponding to each of the plurality of fingerprints registered in the electronic device, How it works. A computer-readable, non-transitory recording medium having recorded thereon a command for controlling an electronic device, A command to obtain a first registered fingerprint image from a first input by operating a fingerprint sensor using a first parameter set set as a reference parameter set among a plurality of parameter sets; A command for obtaining first fingerprint feature information about the features of a first fingerprint and first fingerprint density information about the density of the first fingerprint from a first registered fingerprint image; A command for registering the first fingerprint by storing the first fingerprint characteristic information and the first fingerprint density information; A command to obtain a first authentication fingerprint image from a second input by operating the fingerprint sensor using the first parameter set in a first scan mode determined based on the first fingerprint density information among a plurality of defined scan modes of the fingerprint sensor; A command for obtaining second fingerprint feature information about the features of a second fingerprint from the first authentication fingerprint image; and A command for performing authentication for the second fingerprint by comparing the second fingerprint characteristic information with the first fingerprint characteristic information, Recording medium.

Images