Electronic device comprising fingerprint sensor, operation method thereof, and recording medium

Abstract

This electronic device may be enabled to: acquire a first fingerprint image on the basis of a signal acquired via a fingerprint sensor; acquire, from the first fingerprint image, a first ridge image related to an area corresponding to a ridge of the fingerprint of a user and a first valley image related to an area corresponding to a valley of the fingerprint of the user; acquire second correction data on the basis of a second ridge image acquired by applying at least one of pixel values of the first ridge image and a second valley image acquired by applying at least one of pixel values of the first valley image; update first correction data with the second correction data; and remove noise from a signal acquired via the fingerprint sensor on the basis of the second correction data.

Description

Electronic device including a fingerprint sensor, method of operation thereof, and recording medium

[0001] The present disclosure relates to an electronic device including a fingerprint sensor, an operating method thereof, and a recording medium.

[0002] With the advancement of digital technology, various types of electronic devices, such as mobile terminals, personal digital assistants (PDAs), electronic organizers, smartphones, tablet PCs (personal computers), and wearable devices, are widely used. Electronic devices can provide various functions. For example, electronic devices can run at least one application in the foreground and / or background to provide at least one function. Electronic devices can provide various functions using a designated operating system (e.g., the Android™ operating system). Electronic devices can also provide various security-related functions through biometric authentication (e.g., fingerprint recognition, facial recognition).

[0003] The above information may be provided as background art to aid in understanding the present disclosure. No claim or determination is made as to whether any of the above is applicable as prior art in connection with the present disclosure.

[0004] According to one embodiment, an electronic device may include a display, a fingerprint sensor, a processor, and a memory. The fingerprint sensor may be generated by the display and may obtain a signal related to a user's fingerprint by receiving light reflected by a user's finger in contact with the display. The memory may store first calibration data used to calibrate a signal detected from the fingerprint sensor. The memory may store instructions. The instructions, when executed by the processor, may cause the electronic device to obtain a first fingerprint image based on a signal obtained through the fingerprint sensor. The instructions, when executed by the processor, may cause the electronic device to obtain a first ridge image related to an area corresponding to a ridge of the user's fingerprint and a first valley image related to an area corresponding to a valley of the user's fingerprint from the first fingerprint image. The instructions, when executed by the processor, may cause the electronic device to obtain second correction data based on a second ridge image obtained by applying at least one of the pixel values ​​of the first ridge image and a second ridge image obtained by applying at least one of the pixel values ​​of the first ridge image. The instructions, when executed by the processor, may cause the electronic device to update the first correction data with the second correction data. The instructions, when executed by the processor, may cause the electronic device to remove noise from a signal obtained through the fingerprint sensor based on the second correction data.

[0005] According to one embodiment, a computer-readable, non-transitory recording medium having recorded thereon instructions for controlling an electronic device including a display and a fingerprint sensor may include instructions for causing the electronic device to acquire a first fingerprint image based on a signal acquired through the fingerprint sensor. The recording medium may further include instructions for causing the electronic device to acquire, from the first fingerprint image, a first ridge image related to an area corresponding to a ridge of the user's fingerprint and a first valley image related to an area corresponding to a valley of the user's fingerprint. The recording medium may further include instructions for causing the electronic device to acquire second correction data based on a second ridge image obtained by applying at least one of the pixel values ​​of the first ridge image and a second valley image obtained by applying at least one of the pixel values ​​of the first valley image. The recording medium may further include instructions for causing the electronic device to update the first correction data with the second correction data. The recording medium may further include instructions for causing the electronic device to remove noise from a signal acquired through the fingerprint sensor based on the second correction data.

[0006] A method for operating an electronic device including a display and a fingerprint sensor may include an operation in which the electronic device acquires a first fingerprint image based on a signal acquired through the fingerprint sensor. The method may further include an operation in which the electronic device acquires, from the first fingerprint image, a first ridge image related to an area corresponding to a ridge of the user's fingerprint and a first valley image related to an area corresponding to a valley of the user's fingerprint. The method may further include an operation in which the electronic device acquires second correction data based on a second ridge image acquired by applying at least one of the pixel values ​​of the first ridge image and a second valley image acquired by applying at least one of the pixel values ​​of the first valley image. The method may further include an operation in which the electronic device updates the first correction data with the second correction data. The method may further include an operation in which the electronic device removes noise from a signal acquired through the fingerprint sensor based on the second correction data.

[0007] FIG. 1 is a block diagram of an electronic device within a network environment according to various embodiments.

[0008] FIG. 2 is a block diagram of an electronic device according to one embodiment.

[0009] FIG. 3 is a diagram illustrating a method for a fingerprint sensor of an electronic device according to one embodiment to obtain information about a user's fingerprint.

[0010] FIG. 4 is a flowchart illustrating a process by which an electronic device removes noise by updating correction data according to one embodiment.

[0011] FIG. 5 is a flowchart illustrating a process for an electronic device to acquire a bone image and a fusion image according to one embodiment.

[0012] FIG. 6 is a diagram illustrating a method for an electronic device according to one embodiment to acquire a bone image and a fusion image.

[0013] FIG. 7 is a flowchart illustrating a process by which an electronic device acquires correction data according to one embodiment.

[0014] FIG. 8 is a diagram illustrating a method for an electronic device according to one embodiment to obtain correction data.

[0015] FIG. 9 is a flowchart illustrating a process for updating correction data when a display module and / or a fingerprint sensor module is changed in an electronic device according to one embodiment.

[0016] FIG. 10 is a flowchart illustrating a process for updating correction data when a display module and / or a fingerprint sensor module is changed in an electronic device according to one embodiment.

[0017] FIG. 11 is a flowchart illustrating a process for updating correction data when a display module and / or a fingerprint sensor module is changed in an electronic device according to one embodiment.

[0018] A fingerprint recognition sensor can acquire an image of a user's fingerprint. The image acquired through the fingerprint recognition sensor may contain artifacts or noise caused by the display module.

[0019] An electronic device may perform image processing to obtain only an image of a user's fingerprint from an image acquired using a fingerprint recognition sensor. To obtain correction data used by the electronic device in the image processing, a correction tool may be used. The correction tool may include a reflective tool (e.g., white rubber), an absorbent tool (e.g., black rubber), and / or a pattern tool. For example, the electronic device may obtain images corresponding to each of the reflective tool, the absorbent tool, and / or the pattern tool through the fingerprint recognition sensor, and may obtain correction data from the images corresponding to each of the reflective tool, the absorbent tool, and / or the pattern tool. However, the electronic device has a problem in that it must re-acquire the correction data using the reflective tool, the absorbent tool, and / or the pattern tool if the display module and / or the fingerprint recognition sensor module are damaged or changed. In addition, since the reflective tool, the absorbent tool, and / or the pattern tool are generated with a standardized pattern, they do not reflect the characteristics of a person's fingerprint, which has a different pattern for each individual. Therefore, there is a problem that the electronic device is not optimized for recognizing the user's fingerprint because the correction data acquired by the electronic device using the reflective tool, the absorbent tool, and / or the pattern tool cannot reflect the characteristics of the user's fingerprint.

[0020] According to the disclosed embodiment, an electronic device can easily remove artifacts or noise caused by a display module from an image acquired through a fingerprint recognition module. Furthermore, according to the disclosed embodiment, the electronic device can quickly and accurately identify a user's fingerprint by performing fingerprint recognition customized for the user. Furthermore, according to the disclosed embodiment, there is an advantage in that no additional tools (e.g., a reflector tool, an absorber tool, and / or a pattern tool) are required to acquire correction data even when the display module and / or the fingerprint recognition module of the electronic device are changed due to repair and / or deterioration.

[0021] The technical problems to be achieved in this document are not limited to the technical problems mentioned above, and other technical problems not mentioned can be clearly understood by a person having ordinary skill in the technical field pertaining to the present disclosure from the description below.

[0022] FIG. 1 is a block diagram of an electronic device (101) within a network environment (100) according to various embodiments. Referring to FIG. 1, in the network environment (100), the electronic device (101) may communicate with the electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with at least one of the electronic device (104) or the server (108) via a second network (199) (e.g., a long-range wireless communication network). In one embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display module (160), an audio module (170), a sensor module (176), an interface (177), a connection terminal (178), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197). In some embodiments, the electronic device (101) may omit at least one of these components (e.g., the connection terminal (178)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor module (176), the camera module (180), or the antenna module (197)) may be integrated into one component (e.g., the display module (160)).

[0023] The processor (120) may, for example, execute software (e.g., a program (140)) to control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) and perform various data processing or calculations. According to one embodiment, as at least a part of the data processing or calculation, the processor (120) may store a command or data received from another component (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the command or data stored in the volatile memory (132), and store the resulting data in a non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or a secondary processor (123) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor)) that can operate independently or together therewith. For example, if the electronic device (101) includes a main processor (121) and a secondary processor (123), the secondary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a specified function. The secondary processor (123) may be implemented separately from the main processor (121) or as a part thereof.

[0024] The auxiliary processor (123) may control at least a portion of functions or states associated with at least one component (e.g., a display module (160), a sensor module (176), or a communication module (190)) of the electronic device (101), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or can be performed through a separate server (e.g., server (108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.

[0025] The memory (130) can store various data used by at least one component (e.g., processor (120) or sensor module (176)) of the electronic device (101). The data can include, for example, software (e.g., program (140)) and input data or output data for commands related thereto. The memory (130) can include volatile memory (132) or non-volatile memory (134).

[0026] The program (140) may be stored as software in the memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

[0027] The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0028] The audio output module (155) can output audio signals to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. In one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.

[0029] The display module (160) can visually provide information to an external party (e.g., a user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. In one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.

[0030] The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150), output sound through the sound output module (155), or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (101).

[0031] The sensor module (176) can detect the operating status (e.g., power or temperature) of the electronic device (101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0032] The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) with an external electronic device (e.g., the electronic device (102)). In one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0033] The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0034] The haptic module (179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. According to one embodiment, the haptic module (179) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

[0035] The camera module (180) can capture still images and videos. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0036] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

[0037] A battery (189) may power at least one component of the electronic device (101). In one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0038] The communication module (190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may operate independently from the processor (120) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module, or a power line communication module). Among these communication modules, the corresponding communication module can communicate with an external electronic device (104) via a first network (198) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules can be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can verify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) by using subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196).

[0039] The wireless communication module (192) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (192) can support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), an external electronic device (e.g., the electronic device (104)), or a network system (e.g., the second network (199)). According to one embodiment, the wireless communication module (192) can support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC realization.

[0040] The antenna module (197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna module (197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). In one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), may be selected from the plurality of antennas, for example, by the communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device via the at least one selected antenna. In some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (197).

[0041] According to various embodiments, the antenna module (197) may form a mmWave antenna module. In one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high-frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high-frequency band.

[0042] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).

[0043] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199). Each of the external electronic devices (102 or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices (102, 104, or 108). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (101) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In one embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server using machine learning and / or a neural network. According to one embodiment, the external electronic device (104) or the server (108) may be included in the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0044] FIG. 2 is a block diagram of an electronic device according to one embodiment.

[0045] Referring to FIG. 2, an electronic device (201) according to one embodiment may include a processor (220), a memory (230), a display (260), and a fingerprint sensor (270). The electronic device (201), the processor (220), the memory (230), the display (260), and the fingerprint sensor (270) of FIG. 2 may correspond to the electronic device (101), the processor (120), the memory (130), the display module (160), and the sensor module (176) described above with reference to FIG. 1, respectively. The components of the electronic device (201) illustrated in FIG. 2 are for describing one embodiment, and the electronic device (201) may include more components than the components illustrated in FIG. 2, or may include other components that can replace at least some of the components. For example, the memory (230) is not limited to a storage medium included in the electronic device (201), and may include a cloud storage external to the electronic device (201).

[0046] According to one embodiment, the memory (230) may include a secure area in which information exchange is controlled. The secure area may be a separate area provided within the processor. The secure area may be a separate area provided outside the processor (e.g., an embedded secure element (eSE), a secure processor). For example, the secure area may be an ARM TM Trustzone developed by Saga TM) may apply. For example, the security zone may be implemented as a hypervisor.

[0047] According to one embodiment, the memory (230) may store data obtained by the processor (220) performing a calculation. For example, the memory (230) may store correction data used to remove noise from a signal obtained by the fingerprint sensor (270). The memory (230) may store a bone pixel value and a ridge pixel value used to obtain the correction data. The bone pixel value may include a value of each pixel of a bone image obtained from a fingerprint image. The ridge pixel value may include a value of each pixel of a ridge image obtained from a fingerprint image.

[0048] According to one embodiment, the processor (220) may be configured with one or more processors. For example, the processor (220) may include a main processor (e.g., an application processor (AP)) and a secondary processor (e.g., a neural processing unit (NPU), a graphics processing unit (GPU), a secure processor unit (SPU)). For example, the processor (220) may include a plurality of computational cores.

[0049] According to one embodiment, the processor (220) may be operatively connected to the memory (230). The processor (220) may execute instructions stored in the memory (230). The processor (220) may perform various data processing or calculations by executing the instructions. The processor (220) may control components included in the electronic device (201) by executing the instructions. For example, the processor (220) may control at least one of the memory (230), the display (260), and the fingerprint sensor (270). The processor (220) may perform calculations according to the instructions so that the electronic device (201) may perform operations described below with reference to FIGS. 3 to 11, and may control components included in the electronic device (201).

[0050] According to one embodiment, the display (260) may display a user interface (UI) used when acquiring a user's fingerprint. For example, the display (260) may display information regarding an area where the user's finger is to be positioned for fingerprint recognition. For example, the display (260) may display information regarding the result of the electronic device (201) recognizing a fingerprint. For example, the display (260) may display a UI indicating that the display (260) and / or the fingerprint sensor (270) have been changed and / or that fingerprint verification is required. For example, the display (260) may display a user interface (UI) used when acquiring data through a calibration tool. For example, the display (260) may display information regarding the type of calibration tool to be used for calibration. For example, the display (260) may display information regarding an area where the calibration tool is to be positioned.

[0051] In one embodiment, the fingerprint sensor (270) can obtain information about a user's fingerprint. For example, the fingerprint sensor (270) can obtain information about a fingerprint from a user's finger in contact with the display (260). For example, the fingerprint sensor (270) can be located on the opposite side of the front surface of the display (260) on which information is displayed. That is, the fingerprint sensor (270) can be located on the back surface of the display (260). The fingerprint sensor (270) can receive light generated from the display (260) and reflected by a user's finger in contact with the front surface of the display (260). The fingerprint sensor (270) can obtain information about a fingerprint using the received light. For example, the fingerprint sensor (270) can obtain the received light as a pixel value. The fingerprint sensor (270) can generate a signal related to the received light.

[0052] According to one embodiment, the processor (220) can obtain a fingerprint image of a user by controlling a fingerprint sensor (270). For example, the processor (220) connected to the fingerprint sensor may be a secure area (e.g., a virtualized processor implemented as a hypervisor) within the processor (220). For example, the processor (220) may control the display (260) to emit light to obtain a fingerprint image. The processor (220) may control the fingerprint sensor (270) located on the back of the display (260) to receive light generated by the display (260) and reflected by a user's finger in contact with the display. The processor (220) may obtain a fingerprint image based on a signal related to the received light generated by the fingerprint sensor (270). For example, the processor (220) may generate a fingerprint image that reflects the light received by the fingerprint sensor (270) as pixel values. A fingerprint image may include an image including ridges and valleys of a fingerprint of a user's finger in contact with the display (260). A pixel value may include a value indicated by each pixel constituting the fingerprint image. For example, a pixel value may include a value indicating the brightness of each pixel of an image acquired by a fingerprint sensor. The fingerprint image may include artifacts generated when light reflected by the user's finger passes through the display (260). The artifacts may include noise, such as the outline of an internal structure of the display (270). Artifacts cause a problem in that they reduce accuracy when the electronic device (201) identifies the user's fingerprint using the fingerprint image. Therefore, the electronic device (201) may require correction data used in image processing to remove the artifacts. The correction data may be stored in a secure area of ​​the electronic device (201).The correction data may include any data specified by the manufacturer of the electronic device (201) when the electronic device (201) is manufactured. The electronic device (201) may obtain the correction data using a fingerprint image acquired for the user's finger. The correction data acquired by the electronic device (201) using a fingerprint image acquired based on the user's finger may reflect the characteristics of the user's fingerprint.

[0053] According to one embodiment, the processor (220) may obtain a first ridge image and a first valley image from a fingerprint image obtained through the fingerprint sensor (270). The ridge image may include an image related to an area corresponding to a ridge of the user's fingerprint. The valley image may include an image related to an area corresponding to a valley of the user's fingerprint. The processor (220) may obtain the first ridge image and the first valley image by extracting an area corresponding to a ridge of the fingerprint and an area corresponding to a valley from the first fingerprint image. For example, the processor (220) may generate a ridge mask and a ridge mask from the first fingerprint image, and may generate the first ridge image and the first valley image from the first fingerprint image using the generated ridge mask and ridge mask.

[0054] According to one embodiment, the processor (220) may obtain a second ridge image based on the first ridge image, and may obtain a second goal image based on the first goal image. For example, the processor (220) may obtain a second ridge image to which at least one of the pixel values ​​of the first ridge image is applied. For example, the processor (220) may obtain the second ridge image by applying the pixel value of a first pixel among the pixels constituting the first ridge image to a second pixel corresponding to the first pixel among the pixels constituting the second ridge image. For example, the processor (220) may obtain a second goal image to which at least one of the pixel values ​​of the first goal image is applied. For example, the processor (220) may obtain the second goal image by applying the pixel value of a first pixel among the pixels constituting the first goal image to a second pixel corresponding to the first pixel among the pixels constituting the second goal image.

[0055] According to one embodiment, the processor (220) may obtain correction data based on the second ridge image and the second goal image. For example, the processor (220) may identify pixels including pixel values ​​of the second ridge image and pixel values ​​of the second goal image by matching the second ridge image and the second goal image. The processor (220) may obtain correction data based on the identified pixels. For example, the processor (220) may generate correction data including pixel values ​​of pixels of the second ridge image and pixel values ​​of pixels of the second goal image corresponding to the identified pixels.

[0056] In one embodiment, the processor (220) can update the correction data. For example, the processor (220) can update the first correction data stored in the memory (230) with the second correction data acquired based on the second fusion image and the second bone image. For example, the electronic device can overwrite the first correction data with the second correction data. Alternatively, for example, the electronic device can update the first correction data by performing a moving average operation based on the second correction data.

[0057] According to one embodiment, the processor (220) may remove noise included in a fingerprint image based on the acquired correction data. For example, the processor (220) may remove artifacts from a fingerprint image acquired after acquiring the second correction data by using second correction data acquired based on the second ridge image and the second bone image. The artifacts may include noise generated by the outline of the internal structure of the display (270). For example, the processor (220) may remove noise from the fingerprint image by extracting pixels of the fingerprint image having pixel values ​​corresponding to pixel values ​​of the second correction data.

[0058] According to one embodiment, the processor (220) may perform fingerprint recognition based on the acquired correction data. For example, the processor (220) may perform fingerprint recognition by comparing pixel values ​​of pixels constituting a fingerprint image with pixel values ​​constituting correction data. For example, the processor (220) may perform fingerprint recognition by identifying whether the number of pixels whose pixel values ​​of the fingerprint image and the pixel values ​​constituting the correction data match satisfies a predetermined condition.

[0059] In one embodiment, the processor (220) may control the display (260) to display the fingerprint recognition result. For example, the processor (220) may control the display (260) to display a notification that the fingerprint recognition has failed.

[0060] FIG. 3 is a diagram illustrating a method for a fingerprint sensor of an electronic device to obtain information about a user's fingerprint according to one embodiment. Referring to FIG. 3, a display (360) of the electronic device may include an RGB (red, green, blue) panel, glass, a polarizing layer, and an optically clear adhesive (OCA) that adheres the glass and the polarizing layer. A fingerprint sensor (370) may include a lens (371) and a light receiving sensor (373). A user's finger (390) may include a fingerprint including a ridge (391) and a valley (392).

[0061] According to one embodiment, the display (360) can generate light based on a control signal of the processor. The display (360) can generate light in the front direction of the display (360) where the user's finger is in contact. The light generated from the panel of the display (360) can pass through the polarizing layer, OCA, and glass of the display (360) and reach the user's finger (390). The light reaching the user's finger (390) can be reflected by the user's finger (390) and transmitted to the fingerprint sensor (370) located on the back surface of the display (360). The light reflected by the user's finger (390) can pass through the glass, OCA, and polarizing layer of the display (360) and be focused by the lens (371) onto the light receiving sensor (373). The ridges (391) and valleys (392) of the user's finger (390) have different reflectivities. Among the light reaching the user's finger (390), most of the light reaching the valley (392) may be reflected. Among the light reaching the user's finger (390), some of the light reaching the ridge (391) may not be reflected but may be absorbed by the user's finger (390). As the user's finger (390) comes into closer contact with the display (360), the light reaching the valley (392) may be reflected better, and the light reaching the ridge (391) may be absorbed better by the ridge (391).

[0062] According to one embodiment, the fingerprint sensor (370) can obtain a fingerprint image based on the light received by the light receiving sensor (373). For example, the fingerprint sensor (370) can obtain the pixel value of each pixel constituting the light receiving sensor (373) based on the amount of light received. The fingerprint sensor (370) can generate a fingerprint image including the obtained pixel values. For example, among the pixels of the fingerprint image, pixels corresponding to the ridges (391) of the user's fingerprint can include low-value pixel values. Among the pixels of the fingerprint image, pixels corresponding to the valleys (392) of the user's fingerprint can include high-value pixel values. The fingerprint image can include artifacts, which are noise such as outlines of internal structures of the display (360) generated by passing through the glass, OCA, and polarizing layer of the display (360). The electronic device can perform image processing to remove artifacts from the fingerprint image. The electronic device can obtain and update correction data used in the image processing. The electronic device can perform fingerprint recognition on a fingerprint image from which artifacts have been removed based on the correction data.

[0063] FIG. 4 is a flowchart illustrating a process of removing noise by updating correction data by an electronic device according to one embodiment. The operation of the electronic device illustrated in FIG. 4 may be performed by a processor (e.g., processor (220) of FIG. 2 ) performing calculations or controlling components of the electronic device.

[0064] In the following examples, the operations may be performed sequentially, but are not necessarily sequential. For example, the order of the operations may be changed, and at least two operations may be performed in parallel.

[0065] According to one embodiment, in operation 410, the electronic device may acquire a first fingerprint image through a fingerprint sensor. For example, the electronic device may control the display and the fingerprint sensor by having a processor execute instructions stored in memory. For example, the electronic device may control the display to emit light. For example, the electronic device may control the fingerprint sensor to receive light generated by the display and reflected by a user's finger touching the display. For example, the electronic device may generate a fingerprint image by reflecting the light received by the fingerprint sensor as pixel values.

[0066] According to one embodiment, in operation 420, the electronic device may obtain a first ridge image and a first valley image. The electronic device may obtain the first ridge image and the first valley image using a valley mask and a valley mask. The valley mask may include mask data for identifying and extracting only an area corresponding to a valley of the user's fingerprint. The valley mask may include mask data for identifying and extracting only an area corresponding to a valley of the user's fingerprint.

[0067] In one embodiment, the electronic device can generate a bone mask and a ridge mask from a first fingerprint image. For example, the electronic device can convert the first fingerprint image into a binary image. For example, the electronic device can obtain the bone mask from the binary image. For example, the electronic device can obtain the ridge mask from the binary image by inverting the bone mask.

[0068] According to one embodiment, the electronic device can extract the first bone image and the first ridge image from the first fingerprint image using the bone mask and the ridge mask. For example, the electronic device can obtain the first bone image by identifying pixels corresponding to the bone mask among the pixels constituting the first fingerprint image. For example, the electronic device can obtain the first ridge image by identifying pixels corresponding to the ridge mask among the pixels constituting the first fingerprint image.

[0069] According to one embodiment, in operation 430, the electronic device may obtain a second ridge image and a second goal image. For example, the electronic device may update the second ridge image by applying a pixel value of the first ridge image to the second ridge image. Furthermore, the electronic device may update the second goal image by applying a pixel value of the first goal image to the second goal image. For example, the electronic device may generate the second ridge image by applying a pixel value of a first pixel constituting the first ridge image to a second pixel corresponding to the first pixel among pixels constituting the second ridge image. The electronic device may generate the second goal image by applying a pixel value of a first pixel constituting the first goal image to a second pixel corresponding to the first pixel among pixels constituting the second goal image. The electronic device may apply the pixel value of the first ridge image to the second ridge image and apply the pixel value of the first goal image to the second goal image by using a statistical calculation method, such as a moving average, to minimize the influence of outliers.

[0070] According to one embodiment, in operation 440, the electronic device may obtain second correction data. For example, the electronic device may match the second ridge image and the second goal image, and identify pixels from the matched images that include pixel values ​​of the second ridge image and pixel values ​​of the second goal image. The electronic device may obtain second correction data based on the identified pixels. For example, the electronic device may obtain second correction data to which pixel values ​​included in the identified pixels are applied.

[0071] According to one embodiment, the electronic device can obtain the second correction data when a predetermined condition is satisfied. For example, the electronic device can obtain the second correction data when the number of pixels of the matching image including the pixel values ​​of the second ridge image and the pixel values ​​of the second goal image is greater than or equal to a predetermined number. For example, the electronic device can obtain the second correction data when the ratio of the number of pixels of the matching image including the pixel values ​​of the second ridge image and the pixel values ​​of the second goal image is greater than or equal to a predetermined value.

[0072] In one embodiment, at operation 450, the electronic device may update the first correction data with the second correction data. For example, the electronic device may update the first correction data stored in the secure area with the second correction data obtained at operation 440. For example, the electronic device may overwrite the first correction data with the second correction data.

[0073] According to one embodiment, the electronic device may update the first correction data with the second correction data in response to a predetermined condition being satisfied. For example, each time the electronic device acquires a fingerprint image of the user, the electronic device may acquire the second correction data from the fingerprint image and update the first correction data. For example, the electronic device may update the first correction data with the second correction data in response to identifying that a false rejection rate (FRR) is greater than or equal to a predetermined percentage. For example, the electronic device may update the first correction data with the second correction data in response to identifying that the number of pixels containing the pixel values ​​of the second ridge image and the pixel values ​​of the second bone image is greater than or equal to a predetermined percentage of all pixels. For example, the electronic device may update the correction data at predetermined time intervals. That is, the electronic device may update the second correction data with the third correction data in response to a predetermined period of time elapsed after the first correction data is updated with the second correction data.

[0074] In one embodiment, at operation 460, the electronic device may remove noise based on the second correction data. For example, the electronic device may remove artifacts included in a fingerprint image acquired through a fingerprint sensor based on the second correction data. For example, the electronic device may remove noise from the fingerprint image by extracting pixels of the fingerprint image having pixel values ​​corresponding to the pixel values ​​of the second correction data.

[0075] According to the disclosed embodiment, an electronic device can obtain correction data used to remove noise. The electronic device can obtain correction data customized for the user. Using the correction data, the electronic device can identify the user's fingerprint more quickly and accurately.

[0076] FIG. 5 is a flowchart illustrating a process for an electronic device to acquire a bone image and a fusion image according to one embodiment, and FIG. 6 is a diagram for explaining a method for an electronic device to acquire a bone image and a fusion image according to one embodiment. FIG. 5 may be a process related to operations 410 and 420 of FIG. 4. The operations of the electronic device illustrated in FIG. 5 may be performed by a processor (e.g., processor (220) of FIG. 2) performing calculations or controlling components of the electronic device.

[0077] In the following examples, the operations may be performed sequentially, but are not necessarily sequential. For example, the order of the operations may be changed, and at least two operations may be performed in parallel.

[0078] According to one embodiment, in operation 510, the electronic device may acquire a first fingerprint image (610 of FIG. 6) via a fingerprint sensor. For example, the electronic device may acquire a fingerprint image of a user's finger in contact with the display by controlling the display and the fingerprint sensor. Operation 510 may be analogized to the operation of the electronic device described above with reference to operation 410, and any duplicate content will be omitted.

[0079] According to one embodiment, in operation 530, the electronic device may convert the first fingerprint image (610 of FIG. 6) into a binary image. For example, the electronic device may convert the first fingerprint image (610 of FIG. 6) into a binary image through a binarization conversion operation. For example, the electronic device may convert the first fingerprint image (610 of FIG. 6) into a binary image by performing an adaptive threshold-based binarization conversion operation. By performing the adaptive threshold-based binarization conversion operation, the electronic device may easily separate an area corresponding to a valley and an area corresponding to a ridge even when shade values ​​of a portion of the first fingerprint image (610 of FIG. 6) are different.

[0080] According to one embodiment, in operation 550, the electronic device may generate a goal mask (630 of FIG. 6) and a ridge mask (650 of FIG. 6). For example, the electronic device may obtain a goal mask (630 of FIG. 6) from a binary image, in which pixels including a pixel value of 1 represent an area corresponding to a goal, and pixels including a pixel value of 0 represent an area not a goal. For example, the electronic device may obtain a ridge mask (650 of FIG. 6) by performing an inversion operation on the goal mask (630 of FIG. 6). For example, the electronic device may obtain a ridge mask (650 of FIG. 6) from a binary image, in which pixels including a pixel value of 1 represent an area corresponding to a ridge, and pixels including a pixel value of 0 represent an area not a ridge.

[0081] According to one embodiment, the electronic device can perform image processing on the bone mask (630 of FIG. 6) and the ridge mask (650 of FIG. 6). For example, the electronic device can perform morphological transformation on the bone mask (630 of FIG. 6) and the ridge mask (650 of FIG. 6). Since the ridge mask (650 of FIG. 6) includes values ​​for an area where ridge is maximum and a boundary area between ridge and ridge, and the bone mask (630 of FIG. 6) includes values ​​for an area where ridge is maximum and a boundary area between ridge and ridge, the electronic device can reduce the areas of the ridge mask (630 of FIG. 6) and the bone mask (650 of FIG. 6) by performing the morphological transformation.

[0082] According to one embodiment, in operation 570, the electronic device may obtain a first bone image (670 of FIG. 6) and a first ridge image (690 of FIG. 6). For example, the electronic device may extract the first bone image (670 of FIG. 6) from the first fingerprint image (610 of FIG. 6) using the bone mask (630 of FIG. 6). For example, the electronic device may obtain the first bone image (670 of FIG. 6) by extracting pixel values ​​of an area corresponding to the bone mask (630 of FIG. 6) from the first fingerprint image (610 of FIG. 6). For example, the electronic device may generate the first bone image (670 of FIG. 6) by extracting pixels of the first fingerprint image (610 of FIG. 6) corresponding to pixels having a value of 1 among the pixels constituting the bone mask (630 of FIG. 6). For example, the electronic device can extract the first ridge image (690 in FIG. 6) from the first fingerprint image (610 in FIG. 6) using the ridge mask (650 in FIG. 6). For example, the electronic device can obtain the first ridge image (690 in FIG. 6) by extracting pixel values ​​of an area corresponding to the ridge mask (650 in FIG. 6) from the first fingerprint image (610 in FIG. 6). For example, the electronic device can generate the first ridge image (690 in FIG. 6) by extracting pixels of the first fingerprint image (610 in FIG. 6) corresponding to pixels having a value of 1 among the pixels constituting the ridge mask (650 in FIG. 6).

[0083] FIG. 7 is a flowchart illustrating a process for an electronic device to acquire correction data according to one embodiment. FIG. 7 may be a process related to operations 420 to 440 of FIG. 4. The operations of the electronic device illustrated in FIG. 7 may be performed by a processor (e.g., the processor (220) of FIG. 2) performing calculations or controlling components of the electronic device.

[0084] In the following examples, the operations may be performed sequentially, but are not necessarily sequential. For example, the order of the operations may be changed, and at least two operations may be performed in parallel.

[0085] According to one embodiment, in operation 710, the electronic device may obtain a first ridge image and a first bone image. For example, the electronic device may extract the first ridge image and the first bone image from the user's first fingerprint image obtained using a fingerprint sensor. Operation 710 may be analogized to the operation of the electronic device described above with reference to FIGS. 5 and 6, and redundant details are omitted.

[0086] According to one embodiment, in operation 730, the electronic device may apply the pixel values ​​of the first ridge image to the second ridge image and may apply the pixel values ​​of the first goal image to the second goal image. For example, the electronic device may update the second ridge image by applying the pixel values ​​of the first pixels of the first ridge image to the second ridge image stored in the secure area. For example, the electronic device may update the second ridge image and the second goal image by applying the pixel values ​​of the second pixels of the first goal image to the second goal image stored in the secure area.

[0087] According to one embodiment, the electronic device can apply the pixel value of the first pixel to the second ridge image in response to a predetermined condition being satisfied by comparing the pixel values ​​of each of the pixels of the first ridge image and the second ridge image. As the ridge portion of the user's fingerprint comes into contact with the display, light generated from the display is absorbed by the ridge, and the pixel value of the first ridge image becomes smaller. Accordingly, the electronic device can apply the pixel value of the first pixel to the second ridge image based on identifying that the pixel value of the first pixel of the first ridge image is smaller than the predetermined value. For example, the electronic device can apply the pixel value of the first pixel to the second ridge image when the pixel value of the first pixel of the first ridge image is smaller than the pixel value of the pixel corresponding to the first pixel among the pixels of the second ridge image.

[0088] According to one embodiment, the electronic device can apply the pixel value of the second pixel to the second goal image by comparing the pixel values ​​of each of the pixels of the first goal image and the second goal image and, in response to a predetermined condition being satisfied, can do so. As the valley portion of the user's fingerprint comes into close contact with the display, the light generated from the display is reflected more by the valley, and the pixel value of the first goal image increases. Accordingly, the electronic device can apply the pixel value of the second pixel to the second goal image based on identifying that the pixel value of the second pixel of the first goal image is greater than a predetermined value. For example, the electronic device can apply the pixel value of the second pixel to the second goal image when the pixel value of the second pixel of the first goal image is greater than the pixel value of the pixel corresponding to the second pixel among the pixels of the second goal image.

[0089] In one embodiment, the electronic device may apply the pixel values ​​of the first ridge image to the second ridge image and the pixel values ​​of the first goal image to the second goal image using a statistical calculation method so as to minimize the influence of outliers. For example, the electronic device may apply the pixel values ​​of the first pixels of the first ridge image to the second ridge image using a moving average calculation method. For example, the electronic device may apply the second pixel values ​​of the first goal image to the second goal image using a moving average calculation method.

[0090] In one embodiment, in operation 750, the electronic device may match the second ridge image and the second bone image. For example, since the second ridge image and the second bone image are images obtained from the first fingerprint image, the number of horizontal and vertical pixels may be the same (nxm). Accordingly, the electronic device may match the pixels of the second ridge image and the pixels of the second bone image one-to-one.

[0091] According to one embodiment, in operation 770, the electronic device may identify pixels that include pixel values ​​of the second ridge image and pixel values ​​of the second goal image. For example, the electronic device may identify pixels that include pixel values ​​from each of the matched second ridge image and the second goal image. For example, the electronic device may identify a third pixel whose pixel value has been updated among the pixels constituting the second ridge image, and may identify a fourth pixel whose pixel value has been updated among the pixels constituting the second goal image. For example, the electronic device may identify the third pixel from the pixels constituting the second ridge image, which is composed of nxm pixels, and may identify the fourth pixel from the pixels constituting the second goal image, which is composed of nxm pixels. The electronic device may identify the third pixel and the fourth pixel that have been matched among the matched pixels. The electronic device may identify the number of pixels to which the third pixel and the fourth pixel have been matched. The electronic device may identify a ratio of the number of pixels to which the third pixel and the fourth pixel have been matched to the number of matched pixels.

[0092] According to one embodiment, in operation 790, the electronic device may obtain second correction data based on the identified pixel. The electronic device may obtain second correction data to which the pixel value of the third pixel and the pixel value of the fourth pixel are applied. For example, the electronic device may obtain matching data including the pixel value of the third pixel and the pixel value of the fourth pixel as the second correction data.

[0093] According to one embodiment, the electronic device may acquire second correction data in response to a predetermined condition being satisfied. For example, the electronic device may acquire second correction data based on identifying that the number of matched third pixels and fourth pixels is greater than or equal to a predetermined number. For example, the electronic device may acquire second correction data based on identifying that the ratio of the number of matched pixels to the total number of matched pixels is greater than or equal to a predetermined value. The electronic device may update first correction data stored in a memory with the acquired second correction data.

[0094] FIG. 8 is a diagram illustrating a method for an electronic device to acquire correction data according to one embodiment. The operation of the electronic device described with reference to FIG. 8 may be performed by a processor (e.g., the processor (220) of FIG. 2) performing calculations or controlling components of the electronic device.

[0095] According to one embodiment, the electronic device can acquire multiple fingerprint images (811, 813, 815, 817, 819) from the user. In response to the user changing the direction of his / her finger, the electronic device can acquire fingerprint images (811, 813, 815, 817, 819) in various directions. The electronic device can acquire mask data (831, 833, 835, 837, 839) from the fingerprint images (811, 813, 815, 817, 819). The electronic device can obtain a ridge image (851, 853, 855, 857, 859) and a valley image (871, 873, 875, 877, 879) from a fingerprint image (811, 813, 815, 817, 819) using mask data (831, 833, 835, 837, 839). The electronic device can obtain a matching image (893, 895, 897, 899) from the ridge image (851, 853, 855, 857, 859) and a valley image (871, 873, 875, 877, 879).

[0096] According to one embodiment, an electronic device can obtain a first fingerprint image (811) of a user in contact with the display by controlling a display and a fingerprint sensor. The electronic device can perform preprocessing on the first fingerprint image (811). For example, the electronic device can set a region of interest (ROI) for the first fingerprint image (811) and perform cropping. For example, the electronic device can apply a filter (e.g., a Gaussian filter) to the first fingerprint image (811).

[0097] According to one embodiment, the electronic device can obtain first mask data (831) from the first fingerprint image (811). The first mask data (831) may include bone mask data and / or ridge mask data. For example, the electronic device can obtain the first mask data (831) by performing binarization transformation on the first fingerprint image (811). The electronic device can reduce the masking area by performing shape transformation on the first mask data (831).

[0098] According to one embodiment, the electronic device may obtain a first ridge image (851) and a first bone image (871) from a first fingerprint image (811) using the first mask data (831). For example, the electronic device may obtain the first ridge image (851) and the first bone image (871) by extracting pixel values ​​of an area corresponding to the first mask data (831) from the first fingerprint image (811). The electronic device may store the first ridge image (851) and the first bone image (871) in a memory. For example, the electronic device may store the first ridge image (851) and the first bone image (871) in a secure area.

[0099] According to one embodiment, the electronic device can obtain a second fingerprint image (813) of the user. The electronic device can obtain second mask data (833) from the second fingerprint image (813). The operation of the electronic device obtaining the second fingerprint image (813) and the second mask data (833) can be analogously applied to the operation of obtaining the first fingerprint image (811) and the first mask data (831). Duplicate details are omitted.

[0100] According to one embodiment, the electronic device can obtain the peak pixel values ​​and the valley pixel values ​​from the second fingerprint image (813) using the second mask data (833). For example, the electronic device can obtain the peak pixel values ​​and the valley pixel values ​​by extracting the pixel values ​​of the area corresponding to the first mask data (831) from the first fingerprint image (811).

[0101] According to one embodiment, the electronic device may apply the peak pixel values ​​and valley pixel values ​​obtained from the second fingerprint image (813) to the first peak image (851) and the first valley image (871), respectively. For example, the electronic device may apply the peak pixel values ​​obtained from the second fingerprint image (813) to the first peak image (851) in response to a predetermined condition being satisfied by comparing the peak pixel values ​​obtained from the second fingerprint image (813) with the pixel values ​​of pixels constituting the first peak image (851). The electronic device may obtain the second peak image (853) by applying the peak pixel values ​​obtained from the second fingerprint image (813) to the first peak image (851). For example, the electronic device can apply the bone pixel value obtained from the second fingerprint image (813) to the first bone image (871) in response to a predetermined condition being satisfied by comparing the bone pixel value obtained from the second fingerprint image (813) with the pixel values ​​of the pixels constituting the first bone image (871). The electronic device can obtain the second bone image (873) by applying the bone pixel value obtained from the second fingerprint image (813) to the first bone image (871). The electronic device can store the second ridge image (853) and the second bone image (873) in a memory. For example, the electronic device can update the first ridge image (851) and the first bone image (871) stored in the memory to the second ridge image (853) and the second bone image (873).

[0102] According to one embodiment, the electronic device can obtain a first matching image (893) based on the second ridge image (853) and the second valley image (873). The electronic device can obtain the first matching image (893) by matching the second ridge image (853) and the second valley image (873). Since the second ridge image (853) and the second valley image (873) are images obtained from the second fingerprint image (813), they can be matched 1:1. The electronic device can identify whether each of the pixels constituting the first matching image (893) includes a ridge pixel value and a valley pixel value. The electronic device can identify the ridge pixel value and the valley pixel value included in each of the pixels constituting the first matching image (893). The electronic device can store the first matching image (893) in a memory. For example, the electronic device can store the first matching image (893) in a secure area.

[0103] According to one embodiment, the electronic device can identify that the first matching image (893) satisfies a predetermined condition. For example, the electronic device can identify whether the number of pixels including high pixel values ​​and low pixel values ​​among the pixels constituting the first matching image (893) is greater than or equal to a predetermined number. The electronic device can identify whether the number of pixels including high pixel values ​​and low pixel values ​​among the pixels constituting the first matching image (893) is greater than or equal to a predetermined ratio relative to the number of pixels constituting the first matching image (893).

[0104] According to one embodiment, the electronic device may obtain correction data based on the first matching image (893) based on whether the first matching image (893) satisfies a predetermined condition. For example, the electronic device may obtain correction data including pixel values ​​of pixels constituting the first matching image (893). The electronic device may obtain correction data including only pixel values ​​of pixels including both peak pixel values ​​and valley pixel values ​​among the pixels constituting the first matching image (893).

[0105] According to one embodiment, the electronic device can obtain a third fingerprint image (815) of the user. The electronic device can obtain third mask data (835) from the third fingerprint image (815). The electronic device can obtain ridge pixel values ​​and valley pixel values ​​from the third fingerprint image (815) using the third mask data (835). The electronic device can obtain a third ridge image (855) and a third valley image (875) by applying the ridge pixel values ​​and valley pixel values ​​obtained from the third fingerprint image (815) to a second ridge image (853) and a second valley image (873), respectively. The electronic device can obtain a second matching image (895) based on the third ridge image (855) and the third valley image (875). The operation of the electronic device acquiring the third fingerprint image (815), the third mask data (835), the third ridge image (855), the third bone image (875), and the second matching image (895) can be analogously applied to the operation of acquiring the second fingerprint image (813), the second mask data (833), the second ridge image (853), the second bone image (873), and the first matching image (893). Duplicate content is omitted.

[0106] According to one embodiment, the electronic device may store the second matching image (895) in the memory. For example, the electronic device may update the first matching image (893) with the second matching image (895). The electronic device may identify that the second matching image (895) satisfies a predetermined condition. Based on that the second matching image (895) satisfies the predetermined condition, the electronic device may obtain correction data based on the second matching image (895). The operation of the electronic device identifying that the second matching image (895) satisfies the predetermined condition and the operation of the electronic device obtaining correction data based on the second matching image (895) may be analogously applied to the operation of the electronic device identifying that the first matching image (893) satisfies the predetermined condition and the operation of the electronic device obtaining correction data based on the first matching image (893). Overlapping content is omitted.

[0107] According to one embodiment, the electronic device can obtain a fourth fingerprint image (817) of the user. The electronic device can obtain fourth mask data (837) from the fourth fingerprint image (817). The electronic device can obtain ridge pixel values ​​and valley pixel values ​​from the fourth fingerprint image (817) using the fourth mask data (837). The electronic device can obtain a fourth ridge image (857) and a fourth valley image (877) by applying the ridge pixel values ​​and valley pixel values ​​obtained from the fourth fingerprint image (817) to a third ridge image (855) and a third valley image (875), respectively. The electronic device can obtain a third matching image (897) based on the fourth ridge image (857) and the fourth valley image (877). The operation of the electronic device acquiring the fourth fingerprint image (817), the fourth mask data (837), the fourth ridge image (857), the fourth bone image (877), and the third matching image (897) can be analogously applied to the operation of acquiring the second fingerprint image (813), the second mask data (833), the second ridge image (853), the second bone image (873), and the first matching image (893). Duplicate content is omitted.

[0108] According to one embodiment, the electronic device may store the third matching image (897) in the memory. For example, the electronic device may update the second matching image (895) with the third matching image (897). The electronic device may identify that the third matching image (897) satisfies a predetermined condition. Based on that the third matching image (897) satisfies the predetermined condition, the electronic device may obtain correction data based on the third matching image (897). The operation of the electronic device identifying that the third matching image (897) satisfies the predetermined condition and the operation of the electronic device obtaining correction data based on the third matching image (897) may be analogously applied to the operation of the electronic device identifying that the first matching image (893) satisfies the predetermined condition and the operation of the electronic device obtaining correction data based on the first matching image (893). Overlapping content is omitted.

[0109] According to one embodiment, the electronic device can obtain a fifth fingerprint image (819) of the user. The electronic device can obtain fifth mask data (839) from the fifth fingerprint image (819). The electronic device can obtain peak pixel values ​​and valley pixel values ​​from the fifth fingerprint image (819) using the fifth mask data (839). The electronic device can obtain the fifth peak image (859) and the fifth valley image (879) by applying the peak pixel values ​​and valley pixel values ​​obtained from the fifth fingerprint image (819) to a fourth peak image (857) and a fourth valley image (877), respectively. The electronic device can obtain a fourth matching image (899) based on the fifth peak image (859) and the fifth valley image (879). The operation of the electronic device acquiring the fifth fingerprint image (819), the fifth mask data (839), the fifth ridge image (859), the fifth bone image (879), and the fourth matching image (899) can be analogously applied to the operation of acquiring the second fingerprint image (813), the second mask data (833), the second ridge image (853), the second bone image (873), and the first matching image (893). Duplicate content is omitted. The electronic device can store the fourth matching image (899) in memory. For example, the electronic device can update the third matching image (897) with the fourth matching image (899).

[0110] According to one embodiment, the electronic device can identify that the fourth matching image (899) satisfies a predetermined condition. For example, the electronic device can identify whether the number of pixels including high pixel values ​​and low pixel values ​​among the pixels constituting the fourth matching image (899) is greater than or equal to a predetermined number. The electronic device can identify whether the number of pixels including high pixel values ​​and low pixel values ​​among the pixels constituting the fourth matching image (899) is greater than or equal to a predetermined ratio relative to the number of pixels constituting the fourth matching image (899).

[0111] According to one embodiment, the electronic device may obtain correction data based on the fourth matching image (899) based on whether the fourth matching image (899) satisfies a predetermined condition. For example, the electronic device may obtain correction data including pixel values ​​of pixels constituting the fourth matching image (899). The electronic device may obtain correction data including only pixel values ​​of pixels that include both peak pixel values ​​and valley pixel values ​​among the pixels constituting the fourth matching image (899).

[0112] FIG. 9 is a flowchart illustrating a process for updating correction data in an electronic device according to one embodiment when a display module and / or a fingerprint sensor module are changed. The operation of the electronic device illustrated in FIG. 9 may be performed by a processor (e.g., processor (220) of FIG. 2) performing calculations or controlling components of the electronic device.

[0113] In the following examples, the operations may be performed sequentially, but are not necessarily sequential. For example, the order of the operations may be changed, and at least two operations may be performed in parallel.

[0114] According to one embodiment, in operation 910, the electronic device may obtain and store correction data. For example, the electronic device may obtain the correction data by performing the operations of FIG. 4. The electronic device may store the obtained correction data in a memory (e.g., a secure area). Operation 910 may be analogized to the operations of the electronic device described above with reference to FIG. 4, and any redundant details will be omitted.

[0115] According to one embodiment, at operation 930, the electronic device may identify that the display module or the fingerprint sensor module has been changed. For example, the display module and / or the fingerprint sensor module of the electronic device may be repaired or replaced due to a failure or deterioration. For example, the electronic device may identify that the display module and / or the fingerprint sensor module has been changed by identifying a product identification symbol (e.g., a product serial number) of the display module and / or the fingerprint sensor module. For example, the electronic device may identify that the display module and / or the fingerprint sensor module has been changed by identifying that an electrical connection between the electronic device and the display module and / or the fingerprint sensor module has been disconnected and then reconnected.

[0116] According to one embodiment, in operation 950, the electronic device may perform fingerprint recognition based on stored calibration data. The electronic device may display a UI for obtaining a fingerprint image from the user based on identifying that the display module and / or the fingerprint sensor module has been changed. For example, the electronic device may display a UI indicating that the display module and / or the fingerprint sensor module has been changed and / or indicating that fingerprint verification is required. For example, the electronic device may display a UI (user interface) used when obtaining the user's fingerprint. For example, the electronic device may display information regarding an area where the user's finger is to be positioned for fingerprint recognition. For example, the electronic device may display information regarding the result of fingerprint recognition. After the display module and / or the fingerprint sensor module has been changed, the electronic device may obtain a fingerprint image from the user's finger in contact with the display. The electronic device may remove noise from the obtained fingerprint image based on calibration data stored in a memory (e.g., a secure area). The electronic device may perform fingerprint recognition using the noise-removed fingerprint image.

[0117] According to one embodiment, in operation 970, the electronic device can update stored correction data. For example, the electronic device can obtain and update the correction data by performing the operations of FIG. 4 based on the first fingerprint image obtained while performing fingerprint recognition in operation 950. The electronic device can update the correction data stored in a memory (e.g., a secure area) with the obtained correction data. For example, the electronic device can overwrite the correction data stored in the memory with the obtained correction data. For example, the electronic device can update the correction data stored in the memory by performing a moving average operation based on the obtained correction data. Operation 970 can be analogized to the operation of the electronic device described above with reference to operation 450 of FIG. 4, and overlapping details are omitted.

[0118] According to the disclosed embodiment, the electronic device can quickly and accurately identify a user's fingerprint by performing fingerprint recognition specific to the user, even when the display module and / or the fingerprint recognition module are changed.

[0119] FIG. 10 is a flowchart illustrating a process for updating correction data in an electronic device according to one embodiment when a display module and / or a fingerprint sensor module are changed. The operation of the electronic device illustrated in FIG. 10 may be performed by a processor (e.g., processor (220) of FIG. 2) performing calculations or controlling components of the electronic device.

[0120] In the following examples, the operations may be performed sequentially, but are not necessarily sequential. For example, the order of the operations may be changed, and at least two operations may be performed in parallel.

[0121] According to one embodiment, in operation 1010, the electronic device may identify that the display module and / or the fingerprint sensor module has been changed. For example, the display module and / or the fingerprint sensor module of the electronic device may be repaired or replaced due to a malfunction or deterioration. Operation 1010 may be analogized to the operation of the electronic device described above with reference to operation 930 of FIG. 9, and any overlapping details will be omitted.

[0122] According to one embodiment, in operation 1030, the electronic device may obtain first calibration data using a tool. For example, the electronic device may obtain the first calibration data using a calibration tool (e.g., an absorbent tool, a reflective tool, and / or a pattern tool). The electronic device may display a UI for obtaining a fingerprint image from the calibration tool based on identifying that the display module and / or the fingerprint sensor module has been changed. For example, the electronic device may display a UI notifying that the display module and / or the fingerprint sensor module has been changed and / or indicating that calibration is required. For example, the electronic device may display a UI (user interface) used when obtaining data through the calibration tool. For example, the electronic device may display information regarding an area where the calibration tool is to be positioned.

[0123] According to one embodiment, an electronic device can obtain a fingerprint image by having a fingerprint sensor receive light reflected by a calibration tool in contact with a display module. For example, the calibration tool can include at least one of an absorbent tool, a reflective tool, and a pattern tool. The absorbent tool can be used to simulate the ridges of a fingerprint. The absorbent tool can include black rubber. The electronic device can obtain a signal simulating the ridges of a fingerprint from the light reflected by the absorbent tool. The reflector tool can be used to simulate the valleys of a fingerprint. The reflector tool can include apricot-colored rubber. The electronic device can obtain a signal simulating the valleys of a fingerprint from the light reflected by the reflector tool. The pattern tool can be used to simulate both the ridges and valleys of a fingerprint. The pattern tool can include a pattern generated by alternating two or more colors. For example, the pattern tool may include a pattern created by alternating black and apricot-colored rubbers. The electronic device may obtain signals simulating the ridges and valleys of a fingerprint from the light reflected by the pattern tool. For example, the electronic device may obtain correction data from a fingerprint image obtained using the light reflected by the correction tool by performing the operations of FIG. 4.

[0124] According to one embodiment, the electronic device may store the acquired calibration data in memory (e.g., a secure area). For example, the electronic device may update the calibration data stored in the memory with the calibration data acquired using a calibration tool. Operation 1030 may be analogized to the operations of the electronic device described above with reference to FIGS. 4 to 9, and redundant details will be omitted.

[0125] According to one embodiment, in operation 1050, the electronic device may acquire a first fingerprint image. The electronic device may acquire the first fingerprint image of the user's finger in contact with the display after acquiring calibration data using a tool. Operation 1050 may be analogized to the operation of the electronic device described above with reference to operation 410, and any overlapping details will be omitted.

[0126] According to one embodiment, in operation 1070, the electronic device may obtain second correction data based on the first fingerprint image. The electronic device may obtain the correction data by performing the operations of FIG. 4 based on the first fingerprint image obtained in operation 1050. Operation 1070 may be analogously applied to the operations of the electronic device described above with reference to FIG. 4, and redundant details are omitted.

[0127] According to one embodiment, in operation 1090, the electronic device can update the first correction data with the second correction data. The electronic device can update the first correction data stored in the memory (e.g., the secure area) with the second correction data acquired in operation 1070. For example, the electronic device can overwrite the correction data stored in the memory with the acquired correction data. For example, the electronic device can update the correction data stored in the memory by performing a moving average operation based on the acquired correction data. Operation 1090 can be analogized to the operation of the electronic device described above with reference to operation 450 of FIG. 4, and overlapping content is omitted.

[0128] According to the disclosed embodiment, the electronic device can perform fingerprint recognition specific to the user by using the user's fingerprint to quickly and accurately identify the user's fingerprint even if the display module and / or the fingerprint recognition module has been changed and calibrated using a calibration tool.

[0129] FIG. 11 is a flowchart illustrating a process for updating correction data in an electronic device according to one embodiment when a display module and / or a fingerprint sensor module are changed. The operation of the electronic device illustrated in FIG. 11 may be performed by a processor (e.g., processor (220) of FIG. 2) performing calculations or controlling components of the electronic device.

[0130] In the following examples, the operations may be performed sequentially, but are not necessarily sequential. For example, the order of the operations may be changed, and at least two operations may be performed in parallel.

[0131] According to one embodiment, in operation 1110, the electronic device may acquire first calibration data as factory default data. For example, the electronic device may acquire the first calibration data by identifying factory default data stored in a memory as the first calibration data. The factory default data may be data pre-stored by the manufacturer of the electronic device when the electronic device is manufactured. For example, the factory default data may include calibration data acquired using a calibration tool when the electronic device is manufactured. For example, the factory default data may include data generated based on images captured by multiple electronic devices in a location free of external light. For example, the factory default data may include calibration data acquired without using a calibration tool. For example, the factory default data may include calibration data acquired by an electronic device positioned such that the front of the electronic device's display contacts a black floor surface in a location free of external light. For example, the factory default data may include data statistically calculated based on calibration data acquired from multiple electronic devices.

[0132] According to one embodiment, at operation 1130, the electronic device may identify that the display module and / or the fingerprint sensor module has been changed. For example, the display module and / or the fingerprint sensor module of the electronic device may be repaired or replaced due to a malfunction or deterioration. Operation 1130 may be analogized to the operation of the electronic device described above with reference to operation 930 of FIG. 9, and any overlapping details will be omitted.

[0133] According to one embodiment, in operation 1150, the electronic device may obtain first fingerprint data. For example, the electronic device may obtain the first fingerprint data after the display module and / or fingerprint sensor module have been changed. Operation 1150 may be analogized to the operation of the electronic device described above with reference to operation 410, and any duplicate content will be omitted.

[0134] According to one embodiment, in operation 1170, the electronic device may obtain second correction data based on the first fingerprint data. The electronic device may obtain the correction data by performing the operations of FIG. 4 based on the first fingerprint data obtained in operation 1150. Operation 1170 may be analogized to the operations of the electronic device described above with reference to FIG. 4, and any overlapping details will be omitted.

[0135] According to one embodiment, in operation 1190, the electronic device can update the first correction data with the second correction data. The electronic device can update the first correction data stored in the memory (e.g., the secure area) with the second correction data acquired in operation 1170. For example, the electronic device can overwrite the correction data stored in the memory with the acquired correction data. For example, the electronic device can update the correction data stored in the memory by performing a moving average operation based on the acquired correction data. Operation 1190 can be analogized to the operation of the electronic device described above with reference to operation 450 of FIG. 4, and overlapping content is omitted.

[0136] According to the disclosed embodiment, the electronic device can perform fingerprint recognition customized for the user by using the user's fingerprint to more quickly and accurately identify the user's fingerprint even when the correction data is initialized by changing the display module and / or the fingerprint recognition module.

[0137] According to one embodiment, an electronic device (e.g., 101, 201) may include a display (e.g., 160, 260, 360), a fingerprint sensor (e.g., 270, 370), a processor (e.g., 120, 220), and a memory (e.g., 130, 230). The fingerprint sensor (e.g., 270, 370) may obtain a signal regarding a user's fingerprint by receiving light generated by the display (e.g., 160, 260, 360) and reflected by a user's finger (e.g., 390) in contact with the display (e.g., 160, 260, 360). The memory (e.g., 130, 230) may store first correction data (e.g., calibration data) used to correct a signal detected from a fingerprint sensor (e.g., 270, 370). The memory (e.g., 130, 230) may store commands. The commands may be executed by a processor (e.g., 120, 220) to cause an electronic device (e.g., 101, 201) to obtain a first fingerprint image (e.g., 610, 811) based on a signal obtained through the fingerprint sensor (e.g., 270, 370). The instructions may be executed by the processor (e.g., 120, 220) to cause the electronic device (e.g., 101, 201) to obtain, from the first fingerprint image, a first ridge image (e.g., 690, 851) relating to an area corresponding to a ridge (e.g., ridge) of the user's fingerprint and a first valley image (e.g., 670, 871) relating to an area corresponding to a valley (e.g., valley) of the user's fingerprint.The instructions may be executed by the processor (e.g., 120, 220) to cause the electronic device (e.g., 101, 201) to obtain second correction data based on a second ridge image (e.g., 853) obtained by applying (e.g., applying) at least one of the pixel values ​​of the first ridge image (e.g., 690, 851) and a second goal image (e.g., 873) obtained by applying at least one of the pixel values ​​of the first goal image (e.g., 670, 871). The instructions may be executed by the processor (e.g., 120, 220) to cause the electronic device (e.g., 101, 201) to update (e.g., update) the first correction data with the second correction data. The instructions may be executed by the processor (e.g., 120, 220) to cause the electronic device (e.g., 101, 201) to remove noise from a signal acquired through the fingerprint sensor based on the second correction data.

[0138] According to one embodiment, the instructions may be executed by the processor (e.g., 120, 220) to cause the electronic device (e.g., 101, 201) to apply the pixel value of the first pixel to the second goal image based on identifying that the pixel value of the first pixel of the first goal image is less than a predetermined value. The instructions may be executed by the processor (e.g., 120, 220) to cause the electronic device (e.g., 101, 201) to apply the pixel value of the second pixel to the second goal image based on identifying that the pixel value of the second pixel of the first goal image is greater than a predetermined value. The instructions may be executed by the processor (e.g., 120, 220) to cause the electronic device (e.g., 101, 201) to obtain second correction data based on the pixel values ​​applied to the second goal image and the pixel values ​​applied to the second goal image.

[0139] According to one embodiment, the instructions may be executed by a processor (e.g., 120, 220) to cause an electronic device (e.g., 101, 201) to update pixel values ​​of the second ridge image and pixel values ​​of the second ridge image by applying pixel values ​​of the first pixel to the second ridge image and applying pixel values ​​of the second pixel to the second ridge image using a moving average calculation method.

[0140] According to one embodiment, the instructions may be executed by a processor (e.g., 120, 220) to cause an electronic device (e.g., 101, 201) to match a second fusion image and a second goal image.

[0141] According to one embodiment, the instructions may be executed by a processor (e.g., 120, 220) to cause the electronic device (e.g., 101, 201) to obtain second correction data based on identifying that a number of matches between a third pixel whose pixel value is updated among pixels constituting a second image by applying at least one of the pixel values ​​of the first goal image and a fourth pixel whose pixel value is updated among pixels constituting the second goal image by applying at least one of the pixel values ​​of the first goal image is greater than or equal to a predetermined number.

[0142] In one embodiment, the instructions may be executed by the processor (e.g., 120, 220) to cause the electronic device (e.g., 101, 201) to identify that at least one of the display or the fingerprint sensor has been changed. The instructions may be executed by the processor (e.g., 120, 220) to cause the electronic device (e.g., 101, 201) to remove noise from a signal acquired through the fingerprint sensor based on second correction data.

[0143] In one embodiment, the instructions may be executed by the processor (e.g., 120, 220) to cause the electronic device (e.g., 101, 201) to obtain a second fingerprint image of the user from a signal obtained via the fingerprint sensor based on identifying that at least one of the display or the fingerprint sensor has changed. The instructions may be executed by the processor (e.g., 120, 220) to cause the electronic device (e.g., 101, 201) to update second correction data with third correction data using the second fingerprint image.

[0144] According to one embodiment, the instructions may be executed by the processor (e.g., 120, 220) to cause the electronic device (e.g., 101, 201) to perform fingerprint recognition of the user based on the second correction data. The instructions may be executed by the processor (e.g., 120, 220) to cause the electronic device (e.g., 101, 201) to acquire a second fingerprint image of the user from a signal acquired through the fingerprint sensor based on determining that a false rejection rate (e.g., False Rejection Rate, FRR) identified by performing the fingerprint recognition is greater than or equal to a predetermined rate. The instructions may be executed by the processor (e.g., 120, 220) to cause the electronic device (e.g., 101, 201) to update the second correction data to third correction data using the second fingerprint image.

[0145] In one embodiment, the instructions may be executed by the processor (e.g., 120, 220) to cause the electronic device (e.g., 101, 201) to acquire a second fingerprint image of the user from a signal acquired through the fingerprint sensor based on identifying that a predetermined amount of time has elapsed since the first correction data was updated to the second correction data. The instructions may be executed by the processor (e.g., 120, 220) to cause the electronic device (e.g., 101, 201) to update the second correction data to third correction data using the second fingerprint image.

[0146] According to one embodiment, the first correction data stored in the memory may be correction data calculated based on correction data acquired by fingerprint sensors of a plurality of electronic devices.

[0147] According to one embodiment, a method of operating an electronic device (e.g., 101, 201) including a display (e.g., 160, 260, 360) and a fingerprint sensor (e.g., 270, 370) may include an operation in which the electronic device (e.g., 101, 201) acquires a first fingerprint image (e.g., 610, 811) based on a signal acquired through the fingerprint sensor (e.g., 270, 370). The method of operating the electronic device (e.g., 101, 201) may further include the electronic device (e.g., 101, 201) obtaining, from the first fingerprint image (e.g., 610, 811), a first ridge image (e.g., 690, 851) associated with an area corresponding to a ridge (e.g., 391) of the user's fingerprint and a first valley image (e.g., 670, 871) associated with an area corresponding to a valley (e.g., 392) of the user's fingerprint. The method of operating an electronic device (e.g., 101, 201) may further include an operation in which the electronic device (e.g., 101, 201) obtains second correction data based on a second ridge image (e.g., 853) obtained by applying (e.g., applying) at least one of pixel values ​​of a first ridge image (e.g., 690, 851) and a second goal image (e.g., 873) obtained by applying at least one of pixel values ​​of the first goal image (e.g., 670, 871). The method of operating an electronic device (e.g., 101, 201) may further include an operation in which the electronic device (e.g., 101, 201) updates (e.g., updates) the first correction data with second correction data. The method of operating the electronic device (e.g., 101, 201) may further include the electronic device (e.g., 101, 201) removing noise from a signal acquired through the fingerprint sensor based on second correction data.

[0148] According to one embodiment, a method of operating an electronic device (e.g., 101, 201) may further include an operation in which the electronic device (e.g., 101, 201) applies a pixel value of a first pixel of a first target image to a second target image based on identifying that a pixel value of a first pixel of a first target image is less than a predetermined value. A method of operating an electronic device (e.g., 101, 201) may further include an operation in which the electronic device (e.g., 101, 201) applies a pixel value of a second pixel of a first target image to a second target image based on identifying that a pixel value of a second pixel of a first target image is greater than a predetermined value. A method of operating an electronic device (e.g., 101, 201) may further include an operation in which the electronic device (e.g., 101, 201) obtains second correction data based on the pixel values ​​applied to the second target image and the pixel values ​​applied to the second target image.

[0149] According to one embodiment, a method of operating an electronic device (e.g., 101, 201) may further include an operation in which the electronic device (e.g., 101, 201) updates pixel values ​​of a second ridge image by applying a pixel value of a first pixel to a second ridge image using a moving average calculation method. A method of operating an electronic device (e.g., 101, 201) may further include an operation in which the electronic device (e.g., 101, 201) updates pixel values ​​of the second ridge image and pixel values ​​of the second ridge image by applying a pixel value of a second pixel to a second goal image using a moving average calculation method.

[0150] According to one embodiment, a method of operating an electronic device (e.g., 101, 201) may further include an operation of the electronic device (e.g., 101, 201) matching (e.g., matching) a second ridge image and a second goal image. A method of operating an electronic device (e.g., 101, 201) may further include an operation of acquiring second correction data based on an identification that a number of matches between a third pixel, whose pixel value is updated among pixels constituting the second ridge image by applying at least one of the pixel values ​​of the first ridge image, and a fourth pixel, whose pixel value is updated among pixels constituting the second goal image by applying at least one of the pixel values ​​of the first goal image, is greater than or equal to a predetermined number.

[0151] According to one embodiment, a method of operating an electronic device (e.g., 101, 201) may further include an operation of the electronic device (e.g., 101, 201) identifying that at least one of the display or the fingerprint sensor has been changed. A method of operating an electronic device (e.g., 101, 201) may further include an operation of the electronic device (e.g., 101, 201) removing noise from a signal acquired through the fingerprint sensor based on second correction data.

[0152] In one embodiment, a method of operating an electronic device (e.g., 101, 201) may further include an operation of obtaining a second fingerprint image of the user from a signal obtained via the fingerprint sensor based on the electronic device (e.g., 101, 201) identifying that at least one of the display or the fingerprint sensor has changed. The method of operating an electronic device (e.g., 101, 201) may further include an operation of the electronic device (e.g., 101, 201) updating second correction data to third correction data using the second fingerprint image.

[0153] According to one embodiment, a method of operating an electronic device (e.g., 101, 201) may further include an operation in which the electronic device (e.g., 101, 201) performs fingerprint recognition of the user based on second correction data. A method of operating an electronic device (e.g., 101, 201) may further include an operation in which the electronic device (e.g., 101, 201) acquires a second fingerprint image of the user from a signal acquired through a fingerprint sensor based on an identification that a false rejection rate (e.g., False Rejection Rate, FRR) identified by performing fingerprint recognition is greater than or equal to a predetermined rate. A method of operating an electronic device (e.g., 101, 201) may further include an operation in which the electronic device (e.g., 101, 201) updates second correction data to third correction data using the second fingerprint image.

[0154] In one embodiment, a method of operating an electronic device (e.g., 101, 201) may further include an operation of obtaining a second fingerprint image of the user from a signal obtained through a fingerprint sensor based on the electronic device (e.g., 101, 201) identifying that a predetermined amount of time has elapsed since the first correction data was updated to the second correction data. A method of operating an electronic device (e.g., 101, 201) may further include an operation of updating the second correction data to third correction data using the second fingerprint image.

[0155] According to one embodiment, the first correction data stored in the memory may be correction data calculated based on correction data acquired by fingerprint sensors of a plurality of electronic devices.

[0156] According to one embodiment, a non-transitory computer-readable recording medium having recorded thereon instructions for controlling an electronic device including a display and a fingerprint sensor may include instructions for causing the electronic device to obtain a first fingerprint image based on a signal obtained through the fingerprint sensor. The recording medium may further include instructions for causing the electronic device to obtain, from the first fingerprint image, a first ridge image related to an area corresponding to a ridge (e.g., a ridge) of the user's fingerprint and a first valley image related to an area corresponding to a valley (e.g., a valley) of the user's fingerprint. The recording medium may further include instructions for causing the electronic device to obtain second correction data based on a second ridge image obtained by applying (e.g., applying) at least one of pixel values ​​of the first ridge image and a second valley image obtained by applying at least one of pixel values ​​of the first valley image. The recording medium may further include instructions for causing the electronic device to update (e.g., update) the first correction data with second correction data. The recording medium may further include instructions for causing the electronic device to remove noise from a signal obtained through the fingerprint sensor based on the second correction data.

[0157] The methods according to the embodiments described in the claims or specification of the present disclosure may be implemented in the form of hardware, software, or a combination of hardware and software.

[0158] When implemented in software, a computer-readable storage medium storing one or more programs (software modules) may be provided. The one or more programs stored in the computer-readable storage medium are configured for execution by one or more processors within an electronic device. The one or more programs include instructions that cause the electronic device to execute methods according to embodiments described in the claims or specification of the present disclosure.

[0159] In the present disclosure, the functions or operations performed by the electronic device may be performed by one or more processors executing one or more instructions stored in a memory. The functions or operations of the electronic device mentioned in the present disclosure may be performed by one processor executing one or more instructions, or may be performed by a combination of multiple processors executing one or more instructions. The processor mentioned in the present disclosure may be understood to include circuitry for performing calculations or controlling other components of the electronic device. For example, the one or more processors may include a central processing unit (CPU), a microprocessor unit (MPU), an application processor (AP), a communication processor (CP), a neural processing unit (NPU), a system on a chip (SoC), or an integrated circuit (IC) configured to execute one or more instructions. The one or more processors may be configured to perform the operations of the electronic device described above.

[0160] In the present disclosure, a program (software module, software) may be stored in a non-volatile memory including a random access memory (RAM), a flash memory, a read only memory (ROM), an electrically erasable programmable read only memory (EEPROM), a magnetic disc storage device, a compact disc ROM (CD-ROM), digital versatile discs (DVDs) or other forms of optical storage devices, a magnetic cassette. Or, it may be stored in a memory formed by a combination of some or all of these. The memory may be formed by a single storage medium, or may be formed by a combination of a plurality of storage media. The one or more commands may be stored in a single storage medium, or may be distributed and stored in a plurality of storage media.

[0161] Additionally, the program may be stored on an attachable storage device that is accessible via a communication network such as the Internet, an intranet, a local area network (LAN), a wide LAN (WLAN), or a storage area network (SAN), or a combination thereof. Such a storage device may be connected to a device performing an embodiment of the present disclosure via an external port. Additionally, a separate storage device on the communication network may be connected to a device performing an embodiment of the present disclosure.

[0162] In the specific embodiments of the present disclosure described above, components included in the disclosure are expressed in the singular or plural form, depending on the specific embodiment presented. However, the singular or plural expressions are selected to suit the presented situation for convenience of explanation, and the present disclosure is not limited to singular or plural components. Components expressed in the plural form may be composed of singular elements, or components expressed in the singular form may be composed of plural elements.

[0163] Additionally, in the present disclosure, terms such as “part”, “module”, etc. may refer to a hardware component such as a processor or circuit, and / or a software component executed by a hardware component such as a processor.

[0164] A "component" or "module" may be implemented by a program stored in an addressable storage medium and executed by a processor. For example, a "component" or "module" may be implemented by components such as software components, object-oriented software components, class components, and task components, as well as processes, functions, attributes, procedures, subroutines, segments of program code, drivers, firmware, microcode, circuitry, data, databases, data structures, tables, arrays, and variables.

[0165] The specific implementations described in this disclosure are merely exemplary and do not limit the scope of the present disclosure in any way. For the sake of brevity, descriptions of conventional electronic components, control systems, software, and other functional aspects of the systems may be omitted.

[0166] Additionally, in the present disclosure, “comprising at least one of a, b, or c” may mean “comprising only a, including only b, including only c, or including a combination of two or more (including a and b, including b and c, including a and c, or including all of a, b, and c).

[0167] While the detailed description of this disclosure has described specific embodiments, it should be understood that various modifications are possible without departing from the scope of this disclosure. Therefore, the scope of this disclosure should not be limited to the described embodiments, but should be defined not only by the scope of the claims described below, but also by equivalents thereof.

[0168] Electronic devices according to the various embodiments disclosed in this document may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to the embodiments of this document are not limited to the aforementioned devices.

[0169] The various embodiments of this document and the terminology used therein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

[0170] The term "module" used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0171] Various embodiments of the present document may be implemented as software (e.g., a program (140)) including one or more instructions stored in a storage medium (e.g., an internal memory (136) or an external memory (138)) readable by a machine (e.g., an electronic device (101)). For example, a processor (e.g., a processor (120)) of the machine (e.g., an electronic device (101)) may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.

[0172] According to one embodiment, the method according to various embodiments disclosed in this document may be provided as included in a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or may be distributed online (e.g., downloaded or uploaded) through an application store (e.g., Play Store™) or directly between two user devices (e.g., smart phones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily generated in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0173] According to various embodiments, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separately arranged in other components. According to various embodiments, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to various embodiments, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

Claims

1. In electronic devices, display; A fingerprint sensor that obtains a signal regarding a user's fingerprint by receiving light generated by the display and reflected by a user's finger in contact with the display; processor; A memory including commands and first calibration data used to calibrate a signal detected from the fingerprint sensor is stored; The above instructions are executed by the processor, thereby causing the electronic device to: Based on the signal acquired through the fingerprint sensor, a first fingerprint image is acquired, From the first fingerprint image, a first ridge image related to an area corresponding to a ridge of the user's fingerprint and a first valley image related to an area corresponding to a valley of the user's fingerprint are obtained, A second correction data is obtained based on a second ridge image obtained by applying at least one of the pixel values ​​of the first ridge image and a second goal image obtained by applying at least one of the pixel values ​​of the first goal image, Update the above first correction data with the above second correction data, Based on the second correction data, noise is removed from the signal acquired through the fingerprint sensor. Electronic devices.

2. In paragraph 1, The above instructions are executed by the processor, thereby causing the electronic device to: Based on identifying that the pixel value of the first pixel of the first fusion image is less than a predetermined value, the pixel value of the first pixel is applied to the second fusion image, Based on identifying that the pixel value of the second pixel of the first goal image is greater than a predetermined value, the pixel value of the second pixel is applied to the second goal image, To obtain the second correction data based on the pixel value applied to the second fusion image and the pixel value applied to the second goal image. Electronic devices.

3. In paragraph 2, The above instructions are executed by the processor, thereby causing the electronic device to: By using a moving average calculation method, the pixel value of the first pixel is applied to the second ridge image, and the pixel value of the second pixel is applied to the second goal image, thereby updating the pixel value of the second ridge image and the pixel value of the second goal image. Electronic devices.

4. In paragraph 1, The above instructions are executed by the processor, thereby causing the electronic device to: Match the second fusion image and the second goal image, The second correction data is acquired based on identifying that the number of matching pixels among the pixels constituting the second goal image, the third pixel whose pixel value is updated by applying at least one of the pixel values ​​of the first goal image, and the fourth pixel whose pixel value is updated by applying at least one of the pixel values ​​of the first goal image, is greater than or equal to a predetermined number. Electronic devices.

5. In paragraph 1, The above instructions are executed by the processor, thereby causing the electronic device to: Identifying that at least one of the above display or the above fingerprint sensor has been changed, Based on the second correction data, noise is removed from the signal acquired through the fingerprint sensor. Electronic devices.

6. In paragraph 1, The above instructions are executed by the processor, thereby causing the electronic device to: Based on identifying that at least one of the display or the fingerprint sensor has been changed, a second fingerprint image of the user is acquired from a signal acquired through the fingerprint sensor, Using the second fingerprint image, the second correction data is updated to third correction data. Electronic devices.

7. In paragraph 1, The above instructions are executed by the processor, thereby causing the electronic device to: Based on the second correction data, fingerprint recognition of the user is performed, Based on the identification that the false rejection rate (FRR) identified by performing the fingerprint recognition is greater than a predetermined rate, the second fingerprint image of the user is acquired from the signal acquired through the fingerprint sensor, Using the second fingerprint image, the second correction data is updated to third correction data. Electronic devices.

8. In paragraph 1, The above instructions are executed by the processor, thereby causing the electronic device to: Based on identifying that a predetermined amount of time has elapsed since the first correction data has been updated to the second correction data, a second fingerprint image of the user is acquired from a signal acquired through the fingerprint sensor, Using the second fingerprint image, the second correction data is updated to third correction data. Electronic devices.

9. In paragraph 1, The first correction data stored in the above memory is, Correction data calculated based on correction data acquired by fingerprint sensors of multiple electronic devices, Electronic devices.

10. A computer-readable, non-transitory recording medium having recorded thereon a command for controlling an electronic device including a display and a fingerprint sensor that obtains a signal regarding a user's fingerprint by receiving light generated by the display and reflected by a user's finger in contact with the display, A command for obtaining a first fingerprint image based on a signal obtained through the fingerprint sensor; A command for obtaining, from the first fingerprint image, a first ridge image related to an area corresponding to a ridge of the user's fingerprint and a first valley image related to an area corresponding to a valley of the user's fingerprint; A command to obtain second correction data based on a second ridge image obtained by applying at least one of pixel values ​​of the first ridge image and a second goal image obtained by applying at least one of pixel values ​​of the first goal image; A command for updating the first correction data stored in the memory with the second correction data; and A command for removing noise from a signal acquired through the fingerprint sensor based on the second correction data, Recording medium.

11. A method for operating an electronic device including a display and a fingerprint sensor that obtains a signal regarding a user's fingerprint by receiving light generated by the display and reflected by a user's finger in contact with the display, An operation of acquiring a first fingerprint image based on a signal acquired through the fingerprint sensor; An operation of obtaining, from the first fingerprint image, a first ridge image related to an area corresponding to a ridge of the user's fingerprint and a first valley image related to an area corresponding to a valley of the user's fingerprint; An operation of obtaining second correction data based on a second ridge image obtained by applying at least one of the pixel values ​​of the first ridge image and a second goal image obtained by applying at least one of the pixel values ​​of the first goal image; An operation of updating the first correction data stored in the memory with the second correction data; and An operation of removing noise from a signal acquired through the fingerprint sensor based on the second correction data is included. method.

12. In paragraph 11, The operation of obtaining the above second correction data is as follows: An operation of applying the pixel value of the first pixel to the second fusion image based on identifying that the pixel value of the first pixel of the first fusion image is less than a predetermined value; An operation of applying the pixel value of the second pixel to the second goal image based on identifying that the pixel value of the second pixel of the first goal image is greater than a predetermined value; and An operation of obtaining the second correction data based on the pixel value applied to the second fusion image and the pixel value applied to the second goal image, method.

13. In paragraph 12, The operation of applying the pixel value of the first pixel to the second fusion image is: An operation of updating the pixel value of the second fusion image by applying the pixel value of the first pixel to the second fusion image using a moving average calculation method is included. The operation of applying the pixel value of the second pixel to the second goal image is An operation of updating the pixel values ​​of the second ridge image and the pixel values ​​of the second goal image by applying the pixel values ​​of the second pixel to the second goal image using a moving average calculation method, method.

14. In paragraph 11, The operation of obtaining the above second correction data is as follows: An operation of matching the second fusion image and the second goal image; and An operation of acquiring the second correction data based on identifying that the number of matching pixels among the pixels constituting the second goal image, the third pixel whose pixel value has been updated by applying at least one of the pixel values ​​of the first goal image, and the fourth pixel whose pixel value has been updated by applying at least one of the pixel values ​​of the first goal image, is greater than or equal to a predetermined number, method.

15. In paragraph 11, The above method, An action to identify that at least one of the display or the fingerprint sensor has been changed; and Further comprising an operation of removing noise from a signal acquired through the fingerprint sensor based on the second correction data. method.

Images