Electronic device, method, and storage medium for processing unintentional touch input

Abstract

Provided are an electronic device, a method, and a storage medium for processing an unintentional touch input. The electronic device comprises: a touch display; a fingerprint sensor; at least one processor including processing circuitry; and a memory storing instructions individually or collectively executed by the at least one processor. The instructions stored in the memory are configured to cause the electronic device to perform fingerprint authentication on the basis of a first touch input received in an area of the touch display corresponding to an area in which the fingerprint sensor is located. The instructions are configured to cause the electronic device to determine whether the first touch input is a valid touch input when the fingerprint authentication fails. The instructions are configured to cause the electronic device to increase the touch duration of the first touch input when the first touch input is determined as an invalid touch input.

Description

Electronic device, method, and storage medium for processing unintentional touch input

[0001] The embodiments of this document relate to electronic devices, methods, and storage media, for example, to electronic devices, methods, and storage media that process unintentional touch input and improve fingerprint recognition performance.

[0002] Fingerprint recognition is used for user authentication in electronic devices. Fingerprint recognition can be performed via an ultrasonic or optical fingerprint sensor located on the layer beneath the display. A fingerprint sensor located on the layer beneath the display cannot independently detect a user's touch. Therefore, a Finger on Display (FOD) area is set on the display, and touch information generated within the FOD area can be transmitted to the fingerprint sensor. When the fingerprint sensor is triggered by the touch information, the electronic device can perform a fingerprint authentication operation.

[0003] The information described above may be provided merely as related art to aid in understanding the present disclosure. None of the foregoing is to be claimed as prior art related to the present disclosure or to be used in determining prior art.

[0004] An electronic device according to various embodiments of the present document may include a touch display, a fingerprint sensor, at least one processor including a processing circuit, and a memory that stores instructions executed individually or collectively by said at least one processor. The instructions stored in said memory may be configured to cause the electronic device to perform fingerprint authentication based on a first touch input received in an area of ​​said touch display corresponding to an area where said fingerprint sensor is located. The instructions may be configured to cause the electronic device to determine whether said first touch input is a valid touch input when said fingerprint authentication fails. The instructions may be configured to cause the electronic device to increase the touch duration of said first touch input when it determines that said first touch input is an invalid touch input.

[0005] A method for handling unintentional touch input according to various embodiments of the present document may include an operation of performing fingerprint authentication based on a first touch input received in an area of ​​a touch display corresponding to an area where a fingerprint sensor is located. If the fingerprint authentication fails, the method may include an operation of determining whether the first touch input is a valid touch input. If the method determines that the first touch input is an invalid touch input, it may include an operation of increasing the touch duration of the first touch input.

[0006] A non-transient computer-readable storage medium having a program recorded thereon for processing an unintentional touch input according to various embodiments of the present document may include an operation of performing fingerprint authentication based on a first touch input received in an area of ​​a touch display corresponding to an area where a fingerprint sensor is located. If the fingerprint authentication fails, the storage medium may include an operation of determining whether the first touch input is a valid touch input. If the storage medium determines that the first touch input is an invalid touch input, it may include an operation of increasing the touch duration of the first touch input.

[0007] The above and other aspects, features, and advantages of specific embodiments of the present disclosure may become more apparent from the following detailed description, taken in conjunction with the accompanying drawings. In the drawings:

[0008] FIG. 1 is a block diagram of an electronic device in a network environment according to various embodiments.

[0009] FIG. 2 is a block diagram illustrating the configuration of an electronic device according to various embodiments.

[0010] FIG. 3 is a flowchart illustrating fingerprint authentication operations according to various embodiments.

[0011] Figure 4 is a diagram illustrating examples of fingerprint recognition failure of a fingerprint sensor and defects in the recognized fingerprint.

[0012] Figure 5 is a diagram illustrating an example of a fingerprint sensor matching failure.

[0013] Figure 6 is a diagram illustrating an example of the duration of a touch input due to an invalid touch input.

[0014] FIG. 7a is a drawing illustrating a touch area and a finger on display (FOD) area according to various embodiments.

[0015] FIGS. 7b and 7c are drawings illustrating touch maps on a display according to various embodiments.

[0016] FIG. 8 is a drawing illustrating a user interface (UI) that displays a touch intent confirmation guide according to various embodiments.

[0017] FIG. 9 is a flowchart illustrating a method for handling unintentional touch input according to various embodiments.

[0018] Hereinafter, embodiments of the present disclosure are described in detail with reference to the drawings so that those skilled in the art can easily implement them. However, the present disclosure may be embodied in various different forms and is not limited to the examples described herein. In relation to the description of the drawings, the same or similar reference numerals may be used for identical or similar components. Furthermore, in the drawings and related descriptions, descriptions of well-known functions and configurations may be omitted for clarity and brevity.

[0019] FIG. 1 is a block diagram of an electronic device (101) in a network environment (100) according to various embodiments. Referring to FIG. 1, in the network environment (100), the electronic device (101) may communicate with an electronic device (102) through a first network (198) (e.g., a short-range wireless communication network) or may communicate with at least one of an electronic device (104) or a server (108) through a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) through a server (108). According to one embodiment, the electronic device (101) may include a processor (120), memory (130), input module (150), sound output module (155), display module (160), audio module (170), sensor module (176), interface (177), connection terminal (178), haptic module (179), camera module (180), power management module (188), battery (189), communication module (190), subscriber identification module (196), or antenna module (197). In some embodiments, at least one of these components (e.g., connection terminal (178)) may be omitted from the electronic device (101), or one or more other components may be added. In some embodiments, some of these components (e.g., sensor module (176), camera module (180), or antenna module (197)) may be integrated into a single component (e.g., display module (160)).

[0020] The processor (120) can control at least one other component (e.g., hardware or software component) of the electronic device (101) connected to the processor (120) by executing software (e.g., program (140)), and can perform various data processing or operations. According to one embodiment, as at least part of the data processing or operations, the processor (120) can store commands or data received from other components (e.g., sensor module (176) or communication module (190)) in volatile memory (132), process the commands or data stored in volatile memory (132), and store the resulting data in non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., central processing unit or application processor) or an auxiliary processor (123) that can operate independently or together with it (e.g., graphics processing unit, neural processing unit (NPU), image signal processor, sensor hub processor, or communication processor). For example, if the electronic device (101) includes a main processor (121) and an auxiliary processor (123), the auxiliary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a designated function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as part thereof.

[0021] The auxiliary processor (123) may control at least some of the functions or states associated with at least one component of the electronic device (101) (e.g., display module (160), sensor module (176), or communication module (190)) on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. According to one embodiment, the auxiliary processor (123) (e.g., image signal processor or communication processor) may be implemented as part of another functionally related component (e.g., camera module (180) or communication module (190)). According to one embodiment, the auxiliary processor (123) (e.g., neural network processing unit) may include a hardware structure specialized for processing an artificial intelligence model. The artificial intelligence model may be generated through machine learning. Such learning may be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or through a separate server (e.g., server (108)). The learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the embodiments described above. The artificial intelligence model may include a plurality of artificial neural network layers.The artificial neural network may be a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the embodiments described above. In addition to the hardware structure, the artificial intelligence model may include a software structure, either additionally or substantially.

[0022] The memory (130) can store various data used by at least one component of the electronic device (101) (e.g., processor (120) or sensor module (176)). The data may include, for example, input data or output data for software (e.g., program (140)) and related commands. The memory (130) may include volatile memory (132) or non-volatile memory (134). The non-volatile memory (134) may include at least one internal memory (136) and an external memory (138).

[0023] The program (140) may be stored as software in memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

[0024] The input module (150) can receive commands or data to be used for a component of the electronic device (101) (e.g., processor (120)) from outside the electronic device (101) (e.g., user). The input module (150) may include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0025] The sound output module (155) can output a sound signal to the outside of the electronic device (101). The sound output module (155) may include, for example, a speaker or a receiver. The speaker may be used for general purposes, such as multimedia playback or recording playback. The receiver may be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from the speaker or as part thereof.

[0026] The display module (160) can visually provide information to an external (e.g., user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling said device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of the force generated by said touch.

[0027] The audio module (170) can convert sound into an electrical signal or, conversely, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150) or output sound through the sound output module (155) or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphones) connected directly or wirelessly to the electronic device (101).

[0028] The sensor module (176) can detect the operating state of the electronic device (101) (e.g., power or temperature) or the external environmental state (e.g., user state) and generate an electrical signal or data value corresponding to the detected state. According to one embodiment, the sensor module (176) may include, for example, a gesture sensor, a gyroscope sensor, a barometric pressure sensor, a magnetic sensor, an accelerometer sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biosensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0029] The interface (177) may support one or more specified protocols that can be used for the electronic device (101) to be connected directly or wirelessly to an external electronic device (e.g., electronic device (102)). According to one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0030] The connection terminal (178) may include a connector through which the electronic device (101) can be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0031] The haptic module (179) can convert an electrical signal into a mechanical stimulus (e.g., vibration or movement) or an electrical stimulus that the user can perceive through tactile or kinesthetic senses. According to one embodiment, the haptic module (179) may include, for example, a motor, a piezoelectric element, or an electric stimulation device.

[0032] The camera module (180) can capture still images and video. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0033] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented, for example, as at least part of a power management integrated circuit (PMIC).

[0034] The battery (189) can supply power to at least one component of the electronic device (101). According to one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0035] The communication module (190) can support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between an electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may include one or more communication processors that operate independently of the processor (120) (e.g., application processor) and support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., cellular communication module, short-range wireless communication module, or GNSS (global navigation satellite system) communication module) or a wired communication module (194) (e.g., LAN (local area network) communication module, or power line communication module). The corresponding communication module among these communication modules can communicate with an external electronic device (104) through a first network (198) (e.g., a short-range communication network such as Bluetooth, WiFi (wireless fidelity) direct, or IrDA (infrared data association)) or a second network (199) (e.g., a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules may be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can identify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) using subscriber information (e.g., International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module (196).

[0036] The wireless communication module (192) can support 5G networks and next-generation communication technologies following 4G networks, for example, new radio access technology. NR access technology can support high-speed transmission of high-capacity data (enhanced mobile broadband (eMBB)), minimization of terminal power and connection of multiple terminals (massive machine type communications (mMTC)), or high reliability and low latency (ultra-reliable and low-latency communications (URLLC)). The wireless communication module (192) can support a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate, for example. The wireless communication module (192) can support various technologies for securing performance in the high-frequency band, such as beamforming, massive MIMO (multiple-input and multiple-output), full-dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large-scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), external electronic device (e.g., electronic device (104)), or network system (e.g., second network (199)). According to one embodiment, the wireless communication module (192) can support a Peak data rate (e.g., 20 Gbps or more) for eMBB realization, loss coverage (e.g., 164 dB or less) for mMTC realization, or U-plane latency (e.g., downlink (DL) and uplink (UL) each 0.5 ms or less, or round trip 1 ms or less) for URLLC realization.

[0037] An antenna module (197) can transmit a signal or power to or from an external source (e.g., an external electronic device). According to one embodiment, the antenna module (197) may include an antenna comprising a radiator made of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). According to one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as a first network (198) or a second network (199), may be selected from the plurality of antennas, for example, by a communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device through the selected at least one antenna. According to some embodiments, in addition to the radiator, other components (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as part of the antenna module (197).

[0038] According to various embodiments, the antenna module (197) may form a mmWave antenna module. According to one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent to a first surface (e.g., bottom surface) of the printed circuit board and capable of supporting a specified high frequency band (e.g., mmWave band), and a plurality of antennas (e.g., array antennas) disposed on or adjacent to a second surface (e.g., top surface or side surface) of the printed circuit board and capable of transmitting or receiving a signal of the specified high frequency band.

[0039] At least some of the above components can be connected to each other via a communication method between peripheral devices (e.g., bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)) and exchange signals (e.g., commands or data) with each other.

[0040] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) through a server (108) connected to a second network (199). Each of the external electronic devices (102, or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations performed on the electronic device (101) may be performed on one or more of the external electronic devices (102, 104, or 108). For example, if the electronic device (101) needs to perform a function or service automatically or in response to a request from a user or another device, the electronic device (101) may request one or more external electronic devices to perform at least part of the function or service instead of performing the function or service itself or additionally. One or more external electronic devices that receive the above request may execute at least part of the requested function or service, or additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may provide the result as is or additionally processed as at least part of the response to the request. For this purpose, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used. The electronic device (101) may provide ultra-low latency services using, for example, distributed computing or mobile edge computing. In one embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server using machine learning and / or neural networks. According to one embodiment, the external electronic device (104) or the server (108) may be included within a second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0041] The electronic devices according to the various examples disclosed in this document may be of various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or consumer electronics. The electronic devices according to the embodiments of this document are not limited to the devices described above.

[0042] FIG. 2 is a block diagram illustrating the configuration of an electronic device according to various embodiments.

[0043] Referring to FIG. 2, the electronic device (200) may include a touch display (210), a fingerprint sensor (220), a memory (230), and a processor (240).

[0044] For example, a touch display (210) (e.g., the display module (160) of FIG. 1) can display content and receive touch input. As an example, a finger on display (FOD) area may be set in the touch display (210) in an area where a fingerprint sensor (220) (e.g., the sensor module (176) of FIG. 1) is located. The touch display (210) may display a user interface (UI) that displays the FOD area. As an example, if the number of invalid touch inputs exceeds a preset value, the touch display (210) may display a touch intent confirmation guide in an area to confirm the touch intent.

[0045] For example, the fingerprint sensor (220) may be located on a lower layer corresponding to a region of the layer of the touch display (210). When a touch input is received on the FOD region, the fingerprint sensor (220) may acquire an image containing fingerprint information. As an example, the fingerprint sensor (220) may include an optical sensor or an ultrasonic sensor.

[0046] For example, memory (230) (e.g., memory (130) of FIG. 1) can store data, algorithms, programs, instructions, etc. that perform the functions of an electronic device (200). Instructions, etc. stored in memory (220) can be loaded into a processor (240) and executed by the processor (240).

[0047] A processor (240) (e.g., processor (120) of FIG. 1) can control each component of the electronic device (200). The electronic device (200) may include one or more processors (240). For example, the processor (240) may correspond to a plurality of processors that collectively perform a plurality of functions by dividing them among the processors.

[0048] The processor (240) may include various processing circuits and / or multiple processors. For example, the term “processor” as used herein, including in the claims, may include various processing circuits including at least one processor. Here, one or more of the at least one processor may perform the various functions described in this document in a distributed manner, individually and / or collectively. When the terms “processor,” “at least one processor,” and “one or more processors” as used herein are described as performing numerous functions, these terms may encompass, by example and without limitation, situations where one processor performs some of the mentioned functions and other processor(s) perform others of the mentioned functions, and situations where a single processor can perform all the mentioned functions. Additionally, at least one processor may include a combination of processors performing various mentioned / disclosed functions, and may perform them, for example, in a distributed manner. At least one processor may execute program instructions to achieve or perform various functions.

[0049] For example, the processor (240) can perform fingerprint authentication based on a touch input received in an area of ​​the touch display (210) (e.g., an FOD area) corresponding to the area where the fingerprint sensor (220) is located. When a touch input is received in the FOD area, the processor (240) can activate the fingerprint sensor (220) to perform fingerprint authentication.

[0050] If fingerprint authentication fails, the processor (240) can determine whether the received touch input is a valid touch input. For example, the processor (240) can determine a weight based on the type of fingerprint authentication failure. The types of fingerprint authentication failure may include fingerprint recognition failure, defects in the recognized fingerprint, and / or failure to match the recognized fingerprint. The processor (240) can determine whether the received touch input is a valid touch input based on the number of fingerprint authentication failures, the determined weight, and / or the data of the touch input. As an example, the data of the touch input may include the number of touch areas, the location of the touch areas, and / or the size of the touch areas.

[0051] If the processor (240) determines that a touch input is an invalid touch input, the processor (240) may increase the touch duration of the touch input. For example, the touch duration may be the minimum time required to maintain a touch on the touch display (210) to perform fingerprint authentication or acquire a fingerprint image. For example, the processor (240) may increase the touch duration of the touch input to a maximum value based on an increase in the number of invalid touch inputs. For example, the default value of the touch duration may be set to 16ms. If three invalid touch inputs are received, the processor (240) may increase the touch duration to 64ms. If five invalid touch inputs are received, the processor (240) may increase the touch duration to 96ms. If 25 or more invalid touch inputs are received, the processor (240) may increase the touch duration to 256ms. The maximum value of the touch duration may be set to 256ms. The processor (240) can maintain the touch duration at 256ms even if there are more than 25 invalid touch inputs.

[0052] For example, if fingerprint authentication is successful, the processor (240) may reset the touch duration (e.g., set or change the touch duration to 16ms). As an example, if the touch duration exceeds a preset time (e.g., when the maximum touch duration is 256ms, the preset time is 176ms) and / or the number of invalid touch inputs exceeds a preset value (e.g., when the number corresponding to the maximum touch duration is 25, the preset value is 20), the processor (240) may display a touch intent confirmation guide on the touch display (210). As an example, the processor (240) may determine a touch area where one or more touch inputs have been received and display a touch intent confirmation guide in an area other than the determined touch area. For example, the processor (240) may disable the fingerprint sensor (220) or lock the fingerprint authentication process. The processor (240) can prevent unintentional touch input from being received on the touch intent verification guide by displaying the touch intent verification guide in an area other than the touch area. When a touch input is received on the touch intent verification guide, the processor (240) can perform fingerprint authentication. As an example, the processor (240) can activate a disabled fingerprint sensor (220) or unlock the fingerprint authentication process.

[0053] For example, if a touch input includes a continuous pattern and multiple touch inputs including a continuous pattern are received, the processor (240) may determine that the received touch input is an unintentional touch input. As an example, when a user moves with the electronic device (200) in their pocket, multiple touch inputs by the fabric may be received on the touch display (210). Images of multiple touch inputs acquired by the fingerprint sensor (220) may include a continuous pattern of the fabric. If multiple touch inputs including a continuous pattern are received, the processor (240) may determine that the touch input is an unintentional touch input. The processor (240) may perform an operation of setting the touch duration of the touch input to a maximum value and / or an operation of displaying a touch intent confirmation guide on the touch display.

[0054] Various embodiments of this document can improve fingerprint recognition performance by determining unintentional touch input and adjusting the touch duration.

[0055] FIG. 3 is a flowchart illustrating fingerprint authentication operation according to various embodiments, FIG. 4 is a diagram illustrating examples of fingerprint recognition failure of a fingerprint sensor and defects in the recognized fingerprint. FIG. 5 is a diagram illustrating examples of matching failure of a fingerprint sensor, and FIG. 6 is a diagram illustrating examples of the duration of a touch input due to an invalid touch input.

[0056] In the following embodiments, each operation may be performed sequentially, but is not necessarily performed sequentially. For example, the order of each operation may be changed, and at least two operations may be performed in parallel.

[0057] According to one embodiment, 310 to 380 can be understood as being performed in a processor (e.g., processor (240) of FIG. 2) of an electronic device (e.g., electronic device (200) of FIG. 2).

[0058] Referring to FIG. 3, the electronic device (200) can wait for the reception of a touch input (3100). When the touch display (210) is touched by a user, the electronic device (200) can receive the touch input (320). For example, an FOD area may be set on the touch display (210) in an area where a fingerprint sensor is located. When the touch input is received in the FOD area, the electronic device (200) can acquire a fingerprint image of the received touch input using the fingerprint sensor (220).

[0059] The electronic device (200) performs fingerprint authentication (330) and can determine whether the fingerprint authentication is successful (340). For example, the electronic device (200) can generate a fingerprint recognition result from a fingerprint image of an FOD regardless of the user's intention. The electronic device (200) can perform fingerprint authentication based on the similarity between the acquired fingerprint image and the stored fingerprint image. As an example, if the similarity between the acquired fingerprint image and the stored fingerprint image is greater than or equal to a preset value, the electronic device (200) can determine that the fingerprint information is matched. If the fingerprint information is matched, the fingerprint authentication may be successful. If the similarity between the acquired fingerprint image and the stored fingerprint image is less than a preset value, the electronic device (200) can determine that the fingerprint information is not matched. If the fingerprint information is not matched, the fingerprint authentication may be a failure. As an example, if the fingerprint image is not acquired normally or the acquired fingerprint image is defective, the electronic device (200) can terminate the fingerprint authentication without a fingerprint image matching operation. In this document, fingerprint authentication failure may include cases of fingerprint recognition failure, defects in the recognized fingerprint, and / or failure to match the recognized fingerprint.

[0060] If fingerprint authentication is successful (340-YES), the electronic device (200) may reset the touch duration (350). For example, if fingerprint authentication is successful, the electronic device (200) may change (or set) the currently set touch duration to a default value. As an example, if the fingerprint authentication termination state (e.g., unlock) occurs, the electronic device (200) may change (or set) the touch duration to a default value. If fingerprint authentication fails (340-NO), the electronic device (200) may obtain authentication failure information and / or touch input data (360). For example, the authentication failure information may include cases of fingerprint recognition failure, defects in the recognized fingerprint, and / or failure to match the recognized fingerprint. The touch input data may include the number of touch areas, the location of the touch areas, and / or the size of the touch areas.

[0061] The electronic device (200) can determine whether the received touch input is a valid touch input (370). For example, the electronic device (200) can obtain a weight corresponding to a specific type of authentication failure information. Referring to FIG. 4, a weight corresponding to a type of fingerprint recognition failure and a recognized fingerprint defect is shown (an example of bad quality). Referring to FIG. 5, a weight corresponding to a type of fingerprint sensor matching failure is shown (an example of no match). The electronic device (200) can determine whether the touch input is valid based on the following equation.

[0062] Decision value = (Number of authentication failures * 3 + Weight corresponding to the specific type of authentication failure information * 5 + (Number of touch areas * 0.5 + 0.8 (if the size of the touch area is greater than 1))) / 3 ---- (1)

[0063] If the judgment value is less than 1, the electronic device (200) may determine that the touch input is a valid touch input. If the judgment value is 1 or greater, the electronic device (200) may determine that the touch input is an invalid touch input. For example, the electronic device (200) may acquire a judgment value and determine whether the touch input is valid whenever fingerprint authentication of the touch input received in the FOD area fails.

[0064] If it is determined to be a valid touch input (370-YES), the electronic device (200) may wait for the reception of the next touch input (310). The electronic device (200) may maintain a set touch duration. If it is determined to be an invalid touch input (370-NO), the electronic device (200) may increase the touch duration (380). For example, the electronic device (200) may increase the touch duration according to the increase in the number of invalid touch inputs. Referring to FIG. 6, the touch duration corresponding to the number of invalid touches is illustrated. As an example, when the number of invalid touches is 0, the touch duration may be 16ms. The touch duration when the number of invalid touches is 0 may be the default touch duration. When the number of invalid touches is 3 or more, the touch duration may be increased (or set) to 64ms. If the number of invalid touches is 25 or more, the touch duration may be increased (or set) to 256ms. 256ms may be the maximum value of the touch duration. The electronic device (200) may wait for the reception of the next touch input after increasing the touch duration (310).

[0065] FIG. 7a is a drawing illustrating a touch area and a finger on display (FOD) area according to various embodiments, and FIG. 7b and FIG. 7c are drawings illustrating a touch map on a display according to various embodiments.

[0066] Referring to FIG. 7a, index information corresponding to an area (10) of a touch display (210) is illustrated. For example, the index information may include identification information assigned to each cell by dividing the area of ​​the display (210) into a plurality of cells. An FOD area (11) may be included in one area of ​​the touch display (210). As an example, the cells corresponding to indices 292-294, 305-307, and 331-333 may be the FOD area (11).

[0067] Referring to FIG. 7b, a first type of touch map is illustrated as an example. For example, the touch map may be a map containing information related to touch input. An electronic device (200) may receive touch input in a plurality of regions (21, 22, 23, 24) of a touch display (210). Among the plurality of regions (21, 22, 23, 24) where touch input is received, the second region (22) may include a part of the FOD region (11). Referring to FIG. 7c, a second type of touch map is illustrated as an example. An electronic device (200) may receive touch input in a single wide region (26) of a touch display (210). The single wide region (26) where touch input is received may include a part of the FOD region (11).

[0068] For example, the electronic device (200) can generate touch information based on a touch map. The electronic device (200) can determine whether the FOD area (11) has been touched based on the generated touch information. If it is determined that the FOD area (11) has been touched, the fingerprint sensor (220) is triggered, and the electronic device (200) can perform fingerprint authentication. The electronic device (200) can determine the number of touch areas, the location of the touch areas, and / or the size of the touch areas based on the generated touch information. The determined number of touch areas, the location of the touch areas, and / or the size of the touch areas (e.g., touch input data) can be used to determine the validity of the touch input.

[0069] FIG. 8 is a drawing illustrating a user interface (UI) that displays a touch intent confirmation guide according to various embodiments.

[0070] As an example, the electronic device (200) may include a biometric authentication function. If a series of fingerprint authentication failures occur, the biometric authentication function may be locked. The electronic device (200) may display a touch intent confirmation guide (31) to prevent the biometric authentication function from being locked. Generally, the electronic device (200) may perform fingerprint authentication at all times on the lock screen (30), but when the touch intent confirmation guide (31) is displayed, fingerprint authentication may not be performed even if a touch input is received (or the fingerprint sensor (220) detects the touch input) in the FOD area (11). When a touch input is received on the touch intent confirmation guide (31), the electronic device (200) may perform fingerprint authentication.

[0071] For example, the electronic device (200) can identify a touch area based on generated touch information. The electronic device (200) can prevent the reception of unintentional touch inputs on the touch intent confirmation guide (31) by displaying the touch intent confirmation guide (31) on an area other than the identified touch area. If the touch duration exceeds a preset time or the number of invalid touch inputs exceeds a preset value, the electronic device (200) can display the touch intent confirmation guide (31) on the touch display (210). For example, the preset time and the number of invalid touch inputs can be set considering the locking of the biometric authentication function. As an example, if the touch duration exceeds 250ms, the biometric authentication function can be set to be locked. The electronic device (200) can display the touch intent confirmation guide (31) before the touch duration is set to 250ms (e.g., 125ms). For example, if the number of invalid touch inputs exceeds 30, the biometric authentication function may be set to be locked. The electronic device (200) may display a touch intent confirmation guide (31) before the number of invalid touch inputs reaches 30 (e.g., 15). When a touch input is received on the touch intent confirmation guide (31), the electronic device (200) may perform fingerprint authentication.

[0072] For example, if a touch input includes a continuous pattern and multiple touch inputs including a continuous pattern are received, the electronic device (200) may determine the received touch input as an unintentional touch input. As an example, when a user moves with the electronic device (200) in a pocket, multiple touch inputs by the fabric may be received on the touch display (210). Images of the multiple acquired touch inputs may include a continuous pattern of the fabric. If multiple touch inputs including a continuous pattern are received, the electronic device (200) may determine the touch input as an unintentional touch input. As an example, the electronic device (200) may set the weight of the authentication failure information to a relatively high value. As an example, the electronic device (200) may set the duration of the touch input to a maximum value. As an example, the electronic device (200) may display a touch intent verification guide (31) and perform fingerprint authentication when a touch input is received on the touch intent verification guide (31). For example, the electronic device (200) includes a temperature sensor and / or a humidity sensor, and can determine whether there is an unintentional touch input by using the temperature and / or humidity information together. Cases where multiple touch inputs containing a continuous pattern are received are included in the types of authentication failure information along with the temperature and / or humidity information, and a weight corresponding to the types of authentication failure information can be set.

[0073] FIG. 9 is a flowchart illustrating a method for handling unintentional touch input according to various embodiments.

[0074] In the following embodiments, each operation may be performed sequentially, but is not necessarily performed sequentially. For example, the order of each operation may be changed, and at least two operations may be performed in parallel.

[0075] According to one embodiment, 910 to 930 can be understood as being performed in a processor (e.g., processor (240) of FIG. 2) of an electronic device (e.g., electronic device (200) of FIG. 2).

[0076] For example, the electronic device (200) can perform fingerprint authentication based on a first touch input received in an area of ​​the touch display (210) corresponding to the area where the fingerprint sensor (220) is located (910). If fingerprint authentication fails, the electronic device (200) can determine whether the first touch input is a valid touch input (920). The electronic device (200) can determine a weight based on the type of fingerprint authentication failure. For example, the types of fingerprint authentication failure may include fingerprint recognition failure, defects in the recognized fingerprint, touch areas exceeding a preset number, touch areas exceeding a preset size, and / or failure to match the recognized fingerprint. The electronic device (200) can determine whether the first touch input is a valid touch input based on the number of fingerprint authentication failures, the weight, the number of touch areas where the first touch input was received, and / or the size of the touch area.

[0077] For example, if the electronic device (200) determines that the first touch input is an invalid touch input, it may increase the touch duration of the first touch input (930). The electronic device (200) may increase the touch duration of the first touch input based on an increase in the number of invalid touch inputs. As an example, if the touch duration exceeds a preset time or the number of invalid touch inputs exceeds a preset value, the electronic device (200) may display a touch intent confirmation guide on the touch display (210). The electronic device (200) may identify the touch area where the first touch input was received and display the touch intent confirmation guide on an area other than the identified touch area. When a second touch input is received on the touch intent confirmation guide, the electronic device (200) may perform fingerprint authentication. If fingerprint authentication is successful, the electronic device (200) may reset the touch duration.

[0078] As an example, an electronic device may include at least one processor comprising a touch display, a fingerprint sensor, and a processing circuit, and a memory that stores instructions executed individually or collectively by said at least one processor. The instructions stored in said memory may be configured to cause the electronic device to perform fingerprint authentication based on a first touch input received in an area of ​​said touch display corresponding to an area where said fingerprint sensor is located. The instructions may be configured to cause the electronic device to determine whether the first touch input is a valid touch input when said fingerprint authentication fails. The instructions may be configured to cause the electronic device to increase the touch duration of the first touch input when it determines that the first touch input is an invalid touch input.

[0079] As an example, the command may be configured to cause the electronic device to acquire data of the first touch input. The command may be configured to cause the electronic device to determine a weight based on the type of failure of the fingerprint authentication. The command may be configured to cause the electronic device to determine whether the first touch input is a valid touch input based on at least one of the number of failures of the fingerprint authentication, the weight, and the data of the first touch input.

[0080] As an example, the types of failure of the fingerprint authentication may include at least one of fingerprint recognition failure, defect in the recognized fingerprint, and failure to match the recognized fingerprint. The data of the first touch input may include at least one of the number of touch areas, the location of the touch areas, and the size of the touch areas.

[0081] As an example, the above command may be configured to cause the electronic device to increase the touch duration of the first touch input based on an increase in the number of invalid touch inputs.

[0082] As an example, the above command may be configured to cause the electronic device to reset the touch duration when the fingerprint authentication is successful.

[0083] As an example, the above command may be configured to cause the electronic device to display a touch intent confirmation guide on the touch display when the touch duration exceeds a preset time or the number of invalid touch inputs exceeds a preset value.

[0084] As an example, the above command may be configured to cause the electronic device to identify the touch area where the first touch input is received and to display the touch intent confirmation guide in an area other than the identified touch area.

[0085] As an example, the above command may be configured to cause the electronic device to perform fingerprint authentication when a second touch input is received on the touch intent confirmation guide.

[0086] As an example, the above command may be configured to cause the electronic device to determine the first touch input as an unintentional touch input when the first touch input includes a continuous pattern and the first touch input including the continuous pattern is received multiple times.

[0087] As an example, the above command may be configured to cause the electronic device to perform at least one of the following actions when the first touch input including the continuous pattern is determined to be the unintentional touch input: setting the touch duration of the first touch input to a maximum value and displaying a touch intention confirmation guide on the touch display.

[0088] As an example, a method for handling unintentional touch input may include an operation of performing fingerprint authentication based on a first touch input received in an area of ​​a touch display corresponding to an area where a fingerprint sensor is located. If the fingerprint authentication fails, the method may include an operation of determining whether the first touch input is a valid touch input. If the method determines that the first touch input is an invalid touch input, it may include an operation of increasing the touch duration of the first touch input.

[0089] As an example, the above method may further include an operation of acquiring data of the first touch input. The above method may further include an operation of determining a weight based on the type of failure of the fingerprint authentication. The operation of determining whether the first touch input is a valid touch input may determine whether the first touch input is a valid touch input based on at least one of the number of failures of the fingerprint authentication, the weight, and the data of the first touch input.

[0090] As an example, the types of failure of the fingerprint authentication may include at least one of fingerprint recognition failure, defect in the recognized fingerprint, and failure to match the recognized fingerprint. The data of the first touch input includes at least one of the number of touch areas, the location of the touch areas, and the size of the touch areas.

[0091] As an example, the operation of increasing the touch duration of the first touch input may increase the touch duration of the first touch input based on an increase in the number of invalid touch inputs.

[0092] As an example, the above method may further include an operation to reset the touch duration when the fingerprint authentication is successful.

[0093] As an example, the above method may further include an operation of displaying a touch intent confirmation guide on the touch display when the touch duration exceeds a preset time or the number of invalid touch inputs exceeds a preset value.

[0094] As an example, the operation of displaying a touch intent confirmation guide on the touch display may identify a touch area where the first touch input is received and display the touch intent confirmation guide in an area other than the identified touch area.

[0095] As an example, the above method may further include an operation to perform fingerprint authentication when a second touch input is received on the touch intent confirmation guide.

[0096] As an example, the above method may further include an operation of determining the first touch input as an unintentional touch input when the first touch input includes a continuous pattern and the first touch input including the continuous pattern is received multiple times.

[0097] As an example, a non-transient computer-readable storage medium having a program recorded thereon for processing unintentional touch input may include an operation of performing fingerprint authentication based on a first touch input received in an area of ​​a touch display corresponding to an area where a fingerprint sensor is located. The storage medium may include an operation of determining whether the first touch input is a valid touch input when the fingerprint authentication fails. If the storage medium determines that the first touch input is an invalid touch input, it may include an operation of increasing the touch duration of the first touch input.

[0098] The various embodiments of this document and the terms used therein are not intended to limit the technical features described in this document to specific embodiments, and should be understood to include various modifications, equivalents, or substitutions of said embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of said items unless the relevant context clearly indicates otherwise. In this document, each of phrases such as "A or B," "at least one of A and B," "at least one of A or B," "A, B or C," "at least one of A, B and C," and "at least one of A, B, or C" may include any one of the items listed together in the corresponding phrase, or all possible combinations thereof. Terms such as “first,” “second,” or “first” or “second” may be used simply to distinguish a component from another component and do not limit the components in any other aspect (e.g., importance or order). Where any (e.g., first) component is referred to as “coupled” or “connected” to another (e.g., second) component, with or without the terms “functionally” or “communicationally,” it means that said component may be connected to said other component directly (e.g., wired), wirelessly, or through a third component.

[0099] The term “module” as used in the various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit, for example. A module may be a component formed integrally, or a minimum unit of said component or a part thereof that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0100] Various embodiments of the present document may be implemented as software (e.g., program (140)) comprising one or more instructions stored in a storage medium (e.g., internal memory (136) or external memory (138)) readable by a machine (e.g., electronic device (101)). For example, a processor (e.g., processor (120)) of the machine (e.g., electronic device (101)) may call at least one of the one or more instructions stored in the storage medium and execute it. This enables the machine to be operated to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code that can be executed by an interpreter. The storage medium readable by the machine may be provided in the form of a non-transitory storage medium. Here, 'non-temporary' simply means that the storage medium is a tangible device and does not contain a signal (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently and cases where it is stored temporarily.

[0101] According to one embodiment, the method according to the various embodiments disclosed herein may be provided by being included in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or an application store (e.g., Play Store). TM It can be distributed online (e.g., downloaded or uploaded) through ) or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily created on a device-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

[0102] According to various embodiments, each component (e.g., module or program) of the components described above may include a singular or multiple entities, and some of the multiple entities may be separated and placed in other components. According to various embodiments, one or more of the components or operations among the aforementioned components may be omitted, or one or more other components or operations may be added. Generally or additionally, multiple components (e.g., module or program) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each of the multiple components in the same or similar manner as those performed by the corresponding component among the multiple components prior to integration. According to various embodiments, operations performed by the module, program, or other components may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

[0103] The effects of this document are not limited to those mentioned above, and other unmentioned effects will be clearly understood by a person skilled in the art from the description above. Although this disclosure has been described and explained with reference to various embodiments, the various embodiments may be for illustrative purposes only and not for limitation. A person skilled in the art will better understand that various changes in form and detail may be made without departing from the substantial spirit and full scope of the disclosure, including the appended claims and equivalents. Furthermore, any of the embodiments described herein may be used in conjunction with other embodiments described herein.

Claims

1. In an electronic device, Touch display; fingerprint sensor; At least one processor including a processing circuit; and The above-mentioned memory for storing instructions executed individually or collectively by at least one processor; The instruction stored in the above memory causes the electronic device: Fingerprint authentication is performed based on a first touch input received in an area of ​​the touch display corresponding to the area where the fingerprint sensor is located, and If the above fingerprint authentication fails, it is determined whether the above first touch input is a valid touch input, and An electronic device configured to increase the touch duration of the first touch input when it is determined that the first touch input is an invalid touch input.

2. In Paragraph 1, The instruction stored in the above memory causes the electronic device: Acquire the data of the first touch input above, A weight is determined based on the type of failure of the above fingerprint authentication, and An electronic device configured to determine whether the first touch input is a valid touch input based on at least one of the number of failures of the fingerprint authentication, the weight, and the data of the first touch input.

3. In Paragraph 2, The types of failure in the above fingerprint authentication are, It includes at least one of fingerprint recognition failure, defect in the recognized fingerprint, and failure to match the recognized fingerprint, and The data of the first touch input above is, An electronic device comprising at least one of the number of touch areas, the location of the touch areas, and the size of the touch areas.

4. In Paragraph 1, The instruction stored in the above memory causes the electronic device: An electronic device configured to increase the touch duration of the first touch input based on an increase in the number of invalid touch inputs.

5. In Paragraph 1, The instruction stored in the above memory causes the electronic device: An electronic device configured to reset the touch duration when the fingerprint authentication is successful.

6. In Paragraph 1, The instruction stored in the above memory causes the electronic device: An electronic device configured to display a touch intent confirmation guide on the touch display when the above touch duration exceeds a preset time or the above number of invalid touch inputs exceeds a preset value.

7. In Paragraph 6, The instruction stored in the above memory causes the electronic device: An electronic device configured to identify a touch area where the first touch input is received and to display the touch intent confirmation guide in an area other than the identified touch area.

8. In Paragraph 6, The instruction stored in the above memory causes the electronic device: An electronic device configured to perform fingerprint authentication when a second touch input is received on the above touch intent confirmation guide.

9. In Paragraph 1, The instruction stored in the above memory causes the electronic device: An electronic device configured to determine the first touch input as an unintentional touch input when the first touch input includes a continuous pattern and the first touch input including the continuous pattern is received multiple times.

10. In Paragraph 9, The instruction stored in the above memory causes the electronic device: An electronic device configured to perform at least one operation, such as setting the touch duration of the first touch input to a maximum value and displaying a touch intention confirmation guide on the touch display, when the first touch input including the above continuous pattern is determined to be the above unintentional touch input.

11. In a method for handling unintentional touch input, An operation to perform fingerprint authentication based on a first touch input received in an area of ​​a touch display corresponding to an area where a fingerprint sensor is located; If the above fingerprint authentication fails, an operation to determine whether the above first touch input is a valid touch input; A method comprising: an action of increasing the touch duration of the first touch input when it is determined that the first touch input is an invalid touch input.

12. In Paragraph 11, An operation to acquire data of the first touch input; and Further including an operation to determine a weight based on the type of failure of the above fingerprint authentication, The operation of determining whether the above-mentioned first touch input is a valid touch input is, A method for determining whether the first touch input is a valid touch input based on at least one of the number of failures of the fingerprint authentication, the weight, and the data of the first touch input.

13. In Paragraph 12, The types of failure in the above fingerprint authentication are, It includes at least one of fingerprint recognition failure, defect in the recognized fingerprint, and failure to match the recognized fingerprint, and The data of the first touch input above is, A method comprising at least one of the number of touch areas, the location of the touch areas, and the size of the touch areas.

14. In Paragraph 11, The operation of increasing the touch duration of the first touch input above is, A method for increasing the touch duration of the first touch input based on an increase in the number of invalid touch inputs.

15. In a non-transient computer-readable storage medium on which a program for performing a method of processing unintentional touch input is recorded, An operation to perform fingerprint authentication based on a first touch input received in an area of ​​a touch display corresponding to an area where a fingerprint sensor is located; If the above fingerprint authentication fails, an operation to determine whether the above first touch input is a valid touch input; A non-transient computer-readable storage medium having a program recorded thereon that performs a method including: increasing the touch duration of the first touch input when it is determined that the first touch input is an invalid touch input.

Images