Palm print image processing method and electronic device supporting same

Abstract

An electronic device, according to various embodiments, comprises: a camera module; at least one processor; and a memory, wherein the memory may store instructions that, when executed by the at least one processor, instruct the electronic device to: acquire at least three feature coordinates from a palm image obtained via the camera module; identify a rotation angle of a palm on the basis of the at least three feature coordinates; and adjust a palm print recognition region on the basis of the rotation angle of the palm.

Description

Long-form image processing method and electronic device supporting the same

[0001] Various embodiments disclosed in this document relate to a method for processing long images and an electronic device supporting the same.

[0002] Electronic devices store a variety of personal information. This personal information must be protected from unauthorized access. One way to protect personal information is through user authentication. This authentication can be accomplished through user biometrics. Biometrics is a technology that extracts a person's biological information to identify or authenticate them. Due to the nature of biometrics, they are difficult to falsify, alter, or duplicate. Therefore, with the recent expansion of Internet of Things-based services such as fintech, healthcare, and location-based services, biometrics is emerging as a secure technology.

[0003] The aforementioned biometric authentication may include palm print recognition, which extracts biometric information from a palm print (e.g., the creases and wrinkles on the palm) and authenticates the user. This type of palm print recognition can provide a certain level of security by extracting biometric information from a wider area than a finger.

[0004] However, since fingerprints are formed in an area wider than a finger, it is difficult to select a fingerprint recognition area, and it takes a relatively long time to extract fingerprints.

[0005] Accordingly, at least one example among various embodiments is to provide a method for processing long-form images for increasing long-form recognition speed and improving long-form recognition performance, and an electronic device supporting the same.

[0006] According to various embodiments, an electronic device includes a camera module, at least one processor, and a memory, wherein the memory can store instructions that, when executed by the at least one processor, cause the electronic device to obtain at least three feature coordinates from a palm image obtained through the camera module, identify a rotation angle with respect to the palm based on the at least three feature coordinates, and adjust a palm print recognition area based on the rotation angle with respect to the palm.

[0007] An operating method of an electronic device according to various embodiments may include an operation of obtaining at least three feature coordinates from a palm image obtained through a camera module, an operation of identifying a rotation angle for the palm based on the at least three feature coordinates, and an operation of adjusting a palm print recognition area based on the rotation angle for the palm.

[0008] A computer-readable recording medium according to various embodiments may store instructions for obtaining at least three feature coordinates from a palm image obtained through a camera module, identifying a rotation angle for the palm based on the at least three feature coordinates, and adjusting a palm print recognition area based on the rotation angle for the palm.

[0009] An electronic device according to various embodiments disclosed in this document can increase palm recognition speed and improve palm recognition performance by dynamically adjusting a palm recognition area according to a palm posture and extracting palm prints through the adjusted palm recognition area.

[0010] The effects that can be obtained from this document are not limited to those mentioned above.

[0011] FIG. 1 is a block diagram of an electronic device within a network environment according to various embodiments.

[0012] FIG. 2 is a drawing for explaining a long-term recognition function supported by an electronic device according to various embodiments.

[0013] FIG. 3 is a diagram for explaining an operation of extracting biometric information in an electronic device according to various embodiments.

[0014] FIG. 4 is a diagram for explaining an operation of extracting biometric information from a fingerprint recognition area in an electronic device according to various embodiments.

[0015] FIGS. 5A and 5B are diagrams for explaining an operation of setting a long-print recognition area in an electronic device according to various embodiments.

[0016] FIG. 6 is a diagram for explaining an operation of extracting feature coordinates from a palm image in an electronic device according to various embodiments.

[0017] Figure 7 is a drawing for explaining the long-hand recognition area according to the palm posture.

[0018] FIGS. 8 to 11 are drawings for explaining an operation of dynamically adjusting a long-print recognition area in an electronic device according to various embodiments.

[0019] FIG. 12 is a drawing for explaining an operation of identifying a palm posture in an electronic device according to various embodiments.

[0020] FIG. 13 is a diagram for explaining an operation of correcting the position of a long-print recognition area in an electronic device according to various embodiments.

[0021] FIG. 14 is a flowchart illustrating the operation of an electronic device according to various embodiments.

[0022] FIG. 15 is a flowchart illustrating a long-term recognition area adjustment operation of an electronic device according to various embodiments.

[0023] FIGS. 16a and 16b are diagrams for explaining the normalization operation of a long-form recognition area according to various embodiments.

[0024] Hereinafter, various embodiments of this document are described with reference to the attached drawings. However, it should be understood that the technology described in this document is not limited to specific embodiments, but rather encompasses various modifications, equivalents, and / or alternatives of the embodiments of this document. In connection with the description of the drawings, similar reference numerals may be used for similar components.

[0025]

[0026] FIG. 1 is a block diagram of an electronic device (101) within a network environment (100) according to various embodiments.

[0027] Referring to FIG. 1, in a network environment (100), an electronic device (101) may communicate with an electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with at least one of an electronic device (104) or a server (108) via a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display module (160), an audio module (170), a sensor module (176), an interface (177), a connection terminal (178), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197). In some embodiments, the electronic device (101) may omit at least one of these components (e.g., the connection terminal (178)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor module (176), the camera module (180), or the antenna module (197)) may be integrated into one component (e.g., the display module (160)).

[0028] The processor (120) may control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) by executing, for example, software (e.g., a program (140)), and may perform various data processing or calculations. According to one embodiment, as at least a part of the data processing or calculation, the processor (120) may store a command or data received from another component (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the command or data stored in the volatile memory (132), and store the resulting data in a non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or a secondary processor (123) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor)) that may operate independently or together therewith. For example, if the electronic device (101) includes a main processor (121) and a secondary processor (123), the secondary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a specified function. The secondary processor (123) may be implemented separately from the main processor (121) or as a part thereof.

[0029] The auxiliary processor (123) may control at least a part of functions or states associated with at least one component (e.g., a display module (160), a sensor module (176), or a communication module (190)) of the electronic device (101), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or can be performed through a separate server (e.g., server (108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.

[0030] The memory (130) can store various data used by at least one component (e.g., processor (120) or sensor module (176)) of the electronic device (101). The data can include, for example, software (e.g., program (140)) and input data or output data for commands related thereto. The memory (130) can include volatile memory (132) or non-volatile memory (134).

[0031] The program (140) may be stored as software in the memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

[0032] The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0033] The audio output module (155) can output audio signals to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. According to one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.

[0034] The display module (160) can visually provide information to an external party (e.g., a user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.

[0035] The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150), output sound through the sound output module (155), or an external electronic device (e.g., an electronic device (102), a speaker, or headphones) directly or wirelessly connected to the electronic device (101).

[0036] The sensor module (176) can detect the operating status (e.g., power or temperature) of the electronic device (101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0037] The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) with an external electronic device (e.g., the electronic device (102)). In one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0038] The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0039] A haptic module (179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. According to one embodiment, the haptic module (179) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

[0040] The camera module (180) can capture still images and videos. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0041] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

[0042] A battery (189) may power at least one component of the electronic device (101). In one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0043] The communication module (190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may operate independently from the processor (120) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module, or a power line communication module). Among these communication modules, the corresponding communication module can communicate with an external electronic device (104) via a first network (198) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules can be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can verify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) by using subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196).

[0044] The wireless communication module (192) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (192) can support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), an external electronic device (e.g., the electronic device (104)), or a network system (e.g., the second network (199)). According to one embodiment, the wireless communication module (192) may support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC realization.

[0045] The antenna module (197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). According to one embodiment, the antenna module (197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). According to one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), may be selected from the plurality of antennas, for example, by the communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device via the at least one selected antenna. According to some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (197).

[0046] According to various embodiments, the antenna module (197) may form a mmWave antenna module. According to one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high-frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high-frequency band.

[0047] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).

[0048] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199). Each of the external electronic devices (102 or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices (102, 104, or 108). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of or in addition to executing the function or service by itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (101) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server utilizing machine learning and / or a neural network. According to one embodiment, the external electronic device (104) or the server (108) may be included in the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0049] The electronic device (101) according to various embodiments disclosed in this document may be a device of various forms. The electronic device (101) may include, for example, a portable communication device (e.g., a smartphone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a home appliance device. The electronic device (101) according to the embodiments of this document is not limited to the aforementioned devices.

[0050] The various embodiments of this document and the terminology used therein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another component (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

[0051] The term "module" used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0052] Various embodiments of the present document may be implemented as software (e.g., a program (140)) including one or more commands stored in a storage medium (e.g., an internal memory (136) or an external memory (138)) readable by a machine (e.g., an electronic device (101)). For example, a processor (e.g., a processor (120)) of the machine (e.g., an electronic device (101)) may call at least one command among the one or more commands stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one command called. The one or more commands may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.

[0053] According to one embodiment, the method according to the various embodiments disclosed in the present document may be provided as included in a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read only memory (CD-ROM)), or may be distributed online (e.g., downloaded or uploaded) via an application store (e.g., Play Store™) or directly between two user devices (e.g., smart phones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily generated in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0054] According to various embodiments, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and placed in other components. According to various embodiments, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to various embodiments, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

[0055]

[0056] According to various embodiments, the electronic device (101) may support a palm print recognition function that extracts and authenticates a palm print (e.g., palm lines and fine wrinkles) as biometric information. This will be described in detail with reference to FIGS. 2 to 16b below. Furthermore, at least one of the various embodiments described with reference to FIGS. 2 to 16b below may be combined with other embodiments.

[0057]

[0058] FIG. 2 is a diagram for explaining a long-term recognition function supported by an electronic device (101) according to various embodiments. FIG. 3 is a diagram for explaining an operation of extracting biometric information in an electronic device (101) according to various embodiments.

[0059] Referring to FIG. 2, an electronic device (101) according to various embodiments can obtain an image including a part of a user's body (200). According to one embodiment, the electronic device (101) can obtain a palm image (300) by photographing the palm through a camera module (180), as illustrated in FIG. 3.

[0060] According to various embodiments, the electronic device (101) can extract biometric information of the user from an acquired image (e.g., palm image (300)). According to one embodiment, the biometric information may be a palm print (e.g., palm lines and wrinkles).

[0061] The palm image (300) may include a hand region consisting of a palm region (310) and a finger region (320), as illustrated in FIG. 3 . For example, the electronic device (101) may extract a palm print (311) included in the palm region (310) and / or a palm print (321) included in the finger region (320). However, this is merely an example, and various embodiments are not limited thereto. For example, various biometric information such as blood vessel patterns, fingerprints, or finger shapes may also be extracted.

[0062] According to various embodiments, the electronic device (101) may authenticate a user based on extracted biometric information (e.g., palm print (311) (e.g., palm print of palm area (310)) and / or palm print (321) (e.g., palm print of finger area (320)). According to one embodiment, the electronic device (101) may authenticate a user based on a comparison result between the extracted biometric information and a stored template. The stored template may include characteristic information about at least one of a palm print of a specified user, a blood vessel pattern of the user, or a fingerprint of the user. For example, the electronic device (101) may determine that authentication is successful if biometric information having a similarity higher than a reference value with respect to the stored template is extracted. Additionally, the electronic device (101) may determine that authentication is unsuccessful if biometric information having a similarity lower than the reference value with respect to the stored template is extracted. According to an embodiment, if the user is successfully authenticated, the electronic device (101) may also execute a designated function (e.g., unlocking a lock function).

[0063] As described above, the electronic device (101) according to various embodiments can provide a certain level of security by extracting biometric information (e.g., palm print (321), palm print (311)) from the palm area (310) as well as the finger area (320).

[0064] However, some of the biometric information included in the palm image (300) (e.g., biometric information formed in the center of the palm area (310)) may be suitable information for use in user authentication, while other parts (e.g., biometric information formed in the border of the palm area (310)) may be unsuitable for use in user authentication.

[0065] The fingerprints obtained as biometric information (e.g., fingerprint (321), fingerprint (311)) can be formed by the ridges, which are convex parts of the palm surface, and the valleys, which are concave parts.

[0066] For example, some of the biometric information included in the palm image (300) may be suitable for user authentication as it is a long print with clearly distinct ridges and valleys and a size and / or length above a certain level. However, some of the biometric information included in the palm image (300) may be unsuitable for user authentication as it is a long print with unclear ridges and valleys or a size and / or length below a certain level.

[0067] Therefore, when acquiring biometric information across the entire hand region, calculations are performed on unnecessary areas of the palm image (300) (e.g., areas where long prints unsuitable for user authentication are formed), which may increase the amount of calculation and consumption of resources.

[0068] In this regard, the electronic device (101) according to various embodiments may select a region in the palm image (300) where meaningful biometric information is predicted to be actually located as a palm print recognition region (e.g., a region of interest). Accordingly, the region from which biometric information is extracted is limited to the palm print recognition region, thereby reducing the amount of computation and resource consumption required for biometric information extraction. The operation of selecting the palm print recognition region will be described in detail with reference to the drawings below.

[0069]

[0070] FIG. 4 is a diagram for explaining an operation of extracting biometric information from a palm print recognition area in an electronic device (101) according to various embodiments. In addition, FIG. 5a and FIG. 5b are diagrams for explaining an operation of setting a palm print recognition area in an electronic device (101) according to various embodiments, FIG. 6 is a diagram for explaining an operation of extracting feature coordinates from a palm image (300) in an electronic device (101) according to various embodiments, and FIG. 7 is a diagram for explaining a palm print recognition area according to a palm posture.

[0071] Referring to FIG. 4, an electronic device (101) according to various embodiments may select a palm print recognition area (401) from a palm image (300), as shown in 410 of FIG. 4. The palm print recognition area (401) may be an area in the palm image (300) where meaningful biometric information is predicted to be actually located. According to one embodiment, the electronic device (101) may select an area in the palm image (300) where ridges and valleys are clearly distinguished and / or an area where a palm print having a size and / or length greater than a certain level is predicted to be located, as the palm print recognition area (401).

[0072] According to various embodiments, the electronic device (101) may extract biometric information (403) from the palm print recognition area (401), as shown in 420 of FIG. 4. According to one embodiment, the electronic device (101) may exclude an operation of extracting biometric information for the remaining areas of the palm image (300) except for the palm print recognition area (401). Accordingly, the electronic device (101) may reduce the amount of computation and consumption of resources by omitting computation for at least a portion of the palm image (300) that includes biometric information that is unsuitable for use in user authentication.

[0073] According to various embodiments, in selecting a palm recognition area (401), the electronic device (101) may obtain at least two feature coordinates from a palm image (300) and use them to select the palm recognition area (401). The at least two feature coordinates that may be used to select the palm recognition area (401) may be included in a boundary line (505, 509) formed by the palm area (310) and the finger area (320).

[0074] According to an embodiment, as illustrated in 500 of FIG. 5A, a first feature coordinate (511) included in a first boundary line (505) (e.g., the center of the first boundary line (505)) formed by a middle finger region (503) and a palm region (501) and a second feature coordinate (513) included in a second boundary line (509) (e.g., the center of the second boundary line (509)) formed by a ring finger region (507) and a palm region (501) may be used to select a palm print recognition region (401).

[0075] For example, as illustrated in 520 of FIG. 5A, the electronic device (101) may use a point (527) included in a perpendicular bisector (525) based on the center (523) of a line segment (521) whose endpoints are the first feature coordinate (511) and the second feature coordinate (513), as the center of the palm print recognition area (401). For example, the electronic device (101) may define a point (527) corresponding to 1.5 times the length of the line segment (521) from the center (523) of the line segment (521) as the center of the palm print recognition area (401), and may select a palm print recognition area (401) in the shape of a square that is parallel to the line segment (521) and has one side whose length is twice the length of the line segment (521).

[0076] However, this is merely an example, and various embodiments are not limited thereto. For example, the center of the long-print recognition area (401) may be located at a position twice the length of the line segment (521). Additionally, a square area with one side length 1.5 times the length of the line segment (521) may be selected as the long-print recognition area (401).

[0077] As described above, at least two feature coordinates that can be used to select the palm recognition area (401) may be included in the boundary line (505, 509) formed by the palm area (310) and the finger area (320).

[0078] In this regard, the electronic device (101) according to various embodiments can extract at least two feature coordinates (e.g., first feature coordinates (511) and second feature coordinates (513)) centered on an extraction area including between fingers (e.g., a first extraction area (541) including between an index finger (502) and a middle finger (503) and a second extraction area (543) including between a middle finger (503) and a ring finger (507)), as illustrated in FIG. 5B.

[0079] However, the aforementioned extraction areas (e.g., the first extraction area (541) and the second extraction area (543)) are areas having a certain level of width and height, and operations are performed on unnecessary areas in addition to at least two feature coordinates, which may increase the amount of operations and consume a lot of resources.

[0080] In this regard, the electronic device (101) according to various embodiments can reduce the amount of computation and resource consumption required for feature coordinate extraction by using a feature coordinate detector configured to extract only at least two feature coordinates from a palm image (300).

[0081] According to various embodiments, as illustrated in FIG. 6, the feature coordinate detector (620) may be a lightweight network designed based on depthwise separable convolution. However, this is merely exemplary, and various embodiments are not limited thereto. For example, the feature coordinate detector (620) may be designed using various known methods other than depthwise separable convolution.

[0082] According to one embodiment, the feature coordinate detector (620) may be formed by a combination of a depthwise convolution (621) and a pointwise convolution (625).

[0083] For example, depth-wise convolution (621) can generate one feature map (623) by performing an operation with one filter on the input image (610). For example, if the number of input channels is M, M feature maps can be generated. For example, point-wise convolution (625) can adjust the number of channels for feature maps (623) generated by depth-wise convolution (621).

[0084] According to one embodiment, the feature coordinate detector (620) accurately extracts (630) at least two feature coordinates that can be used to select a palm print recognition area (401) from a palm image (610) by applying a point-wise convolution (625) after a depth-wise convolution (621), thereby reducing the amount of computation and resource consumption required for feature coordinate extraction.

[0085] Additionally or alternatively, according to various embodiments, if the electronic device (101) fails to extract biometric information from the palm print recognition area (401), it may select another palm print recognition area. According to one embodiment, the electronic device (101) may expand the palm print recognition area (401) in a certain direction and / or size based on the pre-selected palm print recognition area (401). Furthermore, according to various embodiments, if the extraction of biometric information from the pre-selected palm print recognition area (401) fails, biometric information may be acquired throughout the palm image (300) or through another palm image.

[0086] As described above, the electronic device (101) according to various embodiments can increase the fingerprint recognition speed and improve fingerprint recognition performance by extracting biometric information from the fingerprint recognition area (401).

[0087] In this regard, the electronic device (101) according to various embodiments can select a palm recognition area (401) from a reference posture. The reference posture may include a state in which the palm surface is parallel to the camera module (180).

[0088] However, depending on the distance and angle between the camera module (180) and the palm surface when taking a palm image (300), the palm posture in the palm image (300) may be rotated by a certain rotation angle from the reference posture, and it is difficult to select a palm recognition area (401) from such a rotated palm posture (e.g., a posture different from the reference posture).

[0089] In addition, as illustrated in 700 of FIG. 7, when the palm print recognition area (401) is selected in a reference posture, the biometric information formed in the palm print recognition area (401) may be suitable information for use in user authentication. However, as illustrated in 710 of FIG. 7, even if the palm print recognition area (401) is selected in a state other than the reference posture, the biometric information formed in at least a portion (711) of the palm print recognition area (401) may be unsuitable for use in user authentication. In other words, the palm print recognition area (401) may be distorted due to rotation of the palm, resulting in the extraction of biometric information that is unsuitable for use in user authentication.

[0090] In this regard, the electronic device (101) according to various embodiments can dynamically adjust the palm recognition area (401) based on the posture of the palm. For example, dynamically adjusting the palm recognition area (401) may include varying at least one of the size, direction, or shape of the palm recognition area (401). Dynamically adjusting the palm recognition area (401) will be described in detail with reference to the drawings below.

[0091]

[0092] FIGS. 8 to 11 are drawings for explaining an operation of dynamically adjusting a long-term recognition area (401) in an electronic device (101) according to various embodiments.

[0093] Referring to FIGS. 8 to 11, an electronic device (101) according to various embodiments can dynamically adjust a palm recognition area (401) based on the posture of the palm.

[0094] The palm posture may include a first posture and a second posture. According to one embodiment, the first posture may be a posture rotated in a first direction (e.g., clockwise) around a first axis (e.g., y-axis) that follows the long axis of the palm, as illustrated in FIG. 8. The long axis may follow the direction of the fingers. For example, the first axis may be the middle finger. Additionally, the second posture may be a posture rotated in a second direction (e.g., counterclockwise) opposite to the first direction around the first axis, as illustrated in FIG. 9.

[0095] Additionally or alternatively, the palm posture may include a third posture and a fourth posture. In one embodiment, the third posture may be a posture rotated in a third direction (e.g., clockwise) around a second axis (e.g., the x-axis) along the short axis of the palm that is perpendicular to the long axis, as illustrated in FIG. 10. Furthermore, the fourth posture may be a posture rotated in a fourth direction (e.g., counterclockwise) opposite to the third direction around the second axis, as illustrated in FIG. 11.

[0096] According to various embodiments, when recognizing a palm in a first posture and a second posture through analysis of a palm image (300), the electronic device (101) can adjust a third axis (e.g., width or horizontal axis) of a palm recognition area (401) corresponding to the long axis of the palm.

[0097] For example, as illustrated in FIG. 8, when the electronic device (101) recognizes a palm in a first posture, it can fix one end of the palm recognition area (401) with respect to the third axis and reduce the other end (801). As another example, as illustrated in FIG. 9, when the electronic device (101) recognizes a palm in a second posture, it can fix the other end of the palm recognition area (401) with respect to the third axis and reduce the other end (901).

[0098] According to various embodiments, when recognizing the palm in the third and fourth postures through analysis of the palm image, the electronic device (101) can adjust the fourth axis (e.g., height or vertical axis) of the long-hand recognition area (401) corresponding to the short-hand of the palm.

[0099] For example, as illustrated in FIG. 10, when the electronic device (101) recognizes a palm in a third posture, it can fix one end of the palm recognition area (401) with respect to the fourth axis and reduce the other end (1001). As another example, as illustrated in FIG. 11, when the electronic device (101) recognizes a palm in a fourth posture, it can fix the other end of the palm recognition area (101) with respect to the fourth axis and reduce the other end (1101).

[0100] As described above, the electronic device (101) according to various embodiments can dynamically adjust the palm recognition area (401) based on the palm posture. In this regard, the electronic device (101) according to various embodiments can determine whether the palm in the palm image (300) is in a specified posture. The specified posture may be a posture of the palm rotated to a level where meaningful biometric information can be extracted (e.g., a rotation angle of less than 15°).

[0101] According to one embodiment, the electronic device (101) may perform an operation to acquire a new palm image if the specified palm posture cannot be identified. For example, if the palm recognition area (401) is distorted to a level where meaningful biometric information cannot be extracted due to palm rotation, the electronic device (101) may provide guide information to induce the specified palm posture.

[0102] According to one embodiment, the electronic device (101) can dynamically adjust the palm recognition area (401) only when a specified palm posture is identified. In this regard, the electronic device (101) according to various embodiments can acquire at least three feature coordinates from the palm image (300) when identifying the specified palm posture. Identifying the palm posture will be described in detail with reference to the drawings below.

[0103]

[0104] FIG. 12 is a diagram for explaining an operation of identifying a palm posture in an electronic device (101) according to various embodiments. In addition, FIG. 13 is a diagram for explaining an operation of correcting the position of a palm recognition area (401) in an electronic device (101) according to various embodiments.

[0105] Referring to FIG. 12, an electronic device (101) according to various embodiments may identify a posture of a palm based on at least three feature coordinates obtained from a palm image (300). According to one embodiment, as illustrated in 1200 of FIG. 12, the at least three feature coordinates may include at least two feature coordinates (e.g., first feature coordinates (511) and second feature coordinates (513)) that may be used to select a palm recognition area (401) and a third feature coordinate (1201) that is a center coordinate of a palm area (320).

[0106] For example, as illustrated in 1210 of FIG. 12, the electronic device (101) can determine whether the palm is in a specified posture based on the length (l1) of a first line segment (1211) having the first feature coordinate (511) and the third feature coordinate (1201) as endpoints, the length (l2) of a second line segment (1212) having the second feature coordinate (513) and the third feature coordinate (1201) as endpoints, and the first angle (θ1) formed by the first line segment (1211) and the second line segment.

[0107] For example, the electronic device (101) may compare the length (l1) of the first line segment (1211), the length (l2) of the second line segment (1212), and the first angle (θ1) with the first threshold length, the second threshold length, and the first threshold angle, respectively. In addition, the electronic device (101) may determine that the palm is in a specified posture if at least some of the comparison results satisfy a specified condition. However, this is merely an example, and various embodiments are not limited thereto. For example, the electronic device (101) may also store the posture of the palm corresponding to the length (l1) of the first line segment (1211), the length (l2) of the second line segment (1212), and the first angle (θ1) in the form of a table. In this case, the electronic device (101) can identify the posture of the palm corresponding to the length (l1) of the first line segment (1211), the length (l2) of the second line segment (1212), and the first angle (θ1). In addition, in identifying the posture of the palm, the second angle (θ2) formed by the first line segment (1211) and the third line segment (1213) and the third angle (θ3) formed by the second line segment (1212) and the third line segment (1213) may be additionally considered.

[0108] As described above, the electronic device (101) according to various embodiments can dynamically adjust the palm recognition area (401) only when a palm in a specified posture is identified in the palm area.

[0109] Additionally or optionally, the electronic device (101) according to various embodiments may determine a correction value for the palm recognition area (401) based on the degree of rotation of the palm when correcting the palm recognition area (401).

[0110] For example, if the palm is rotated by a first rotation angle with respect to the first axis, the electronic device (101) can reduce the third axis (e.g., width or horizontal axis) of the palm print recognition area (401) by a first length. Additionally, if the palm is rotated by a second rotation angle greater than the first rotation angle with respect to the first axis, the electronic device (101) can reduce the third axis of the palm print recognition area (401) by a second length longer than the first length.

[0111] For example, if the palm is rotated by a first rotation angle about the second axis, the electronic device (101) can reduce the fourth axis (e.g., height or vertical axis) of the palm print recognition area (401) by a first length. Additionally, if the palm is rotated by a second rotation angle greater than the first rotation angle about the second axis, the electronic device (101) can reduce the fourth axis of the palm print recognition area (401) by a second length longer than the first length.

[0112] An electronic device (101) according to various embodiments may obtain at least three feature coordinates from a palm image (300) when determining a correction value for a palm print recognition area (401). For example, the at least three feature coordinates used to determine a correction value for a palm print recognition area (401) may include the first feature coordinate (511), the second feature coordinate (513), and the third feature coordinate (1201) described above.

[0113] According to one embodiment, the electronic device (101) may determine a correction value for the long-print recognition area (401) based on a ratio (α) of the length (l3) of a third line segment having the first feature coordinate (511) and the second feature coordinate (513) as endpoints to the length (l4) of a fourth line segment (1214) having the midpoint (P) of the third line segment (1213) and the third feature coordinate (1201) as endpoints, as illustrated in 1200 of FIG. 12.

[0114] For example, when the palm assumes a reference posture, the ratio (α) of the length (l3) of the third line segment (1213) to the length (l4) of the fourth line segment (1214) may be greater than or equal to the first threshold value (x) and less than the second threshold value (y) (x<α <y). 이와 관련하여, 제3 선분(1213)의 길이(l3) 대 제4 선분(1214)의 길이(l4) 비율(α)이 제1 임계값(x) 이상이며 제2 임계값(y) 미만에 해당되면, 전자 장치(101)는 제3 축 방향으로 L 길이를 갖고 제4 축 방향으로 L 길이를 가지는 정사각 형태의 장문 인식 영역(401)을 선정할 수 있다.

[0115] For example, when the palm is rotated at a certain rotation angle (e.g., 15° or more) with respect to the first axis, the ratio (α) of the length (l3) of the third line segment (1213) to the length (l4) of the fourth line segment (1214) may exceed the second threshold value (y). For example, as the rotation angle of the palm with respect to the first axis increases, the ratio (α) of the length (l3) of the third line segment (1213) to the length (l4) of the fourth line segment (1214) may also increase. In this regard, when the ratio (α) of the length (l3) of the third line segment (1213) to the length (l4) of the fourth line segment (1214) exceeds the second threshold value (y), the electronic device (101) may select a palm print recognition area (401) having a length in the third axis direction that is inversely proportional to the ratio (α). For example, the electronic device (101) can adjust the long-print recognition area (401) into a rectangular shape having a length L*(1 / α) in the third axis direction and a length L in the fourth axis direction.

[0116] For example, when the palm is rotated at a certain rotation angle (e.g., 15° or more) with respect to the second axis, the ratio (α) of the length (l3) of the third line segment (1213) to the length (l4) of the fourth line segment (1214) may be less than the first threshold value (x). For example, as the rotation angle of the palm with respect to the second axis increases, the ratio (α) of the length (l3) of the third line segment (1213) to the length (l4) of the fourth line segment (1214) may decrease. In this regard, when the ratio (α) of the length (l3) of the third line segment (1213) to the length (l4) of the fourth line segment (1214) is less than the first threshold value (x), the electronic device (101) may select a palm print recognition area (401) having a length in the fourth axis direction that is proportional to the ratio (α). For example, the electronic device (101) can adjust the long-print recognition area (401) into a rectangular shape having a length L in the third axis direction and a length L*(α) in the fourth axis direction.

[0117] Additionally or optionally, the electronic device (101) according to various embodiments may perform a normalization operation on the adjusted fingerprint recognition area (401). For example, the electronic device (101) may perform horizontal distortion correction and / or vertical distortion correction on the fingerprint recognition area (401). Such normalization operation may facilitate the extraction of biometric information from the fingerprint recognition area (401).

[0118] Additionally or alternatively, the electronic device (101) according to various embodiments may also correct the position of the adjusted palm print recognition area (401) as part of the normalization process. According to one embodiment, the distortion of the palm print recognition area (401) may also be proportional to the degree of rotation of the palm. In this regard, the electronic device (101) according to various embodiments may identify a palm that is rotated beyond a certain degree, as illustrated in 1300 of FIG. 13. In this case, the electronic device (101) may move the center of the adjusted palm print recognition area (401) to the center (1201) of the palm surface, as illustrated in 1310 of FIG. 13.

[0119] According to various embodiments, the processor (120) may include a secure zone (e.g., a trust zone) and a non-secure zone. For example, the secure zone and the non-secure zone within the processor (120) may be physically or logically separated from each other. Depending on the embodiment, at least some of the above-described embodiments may be executed through the secure zone of the processor (120). For example, the above-described embodiments may be executed through the secure zone or the general zone of the processor (120), or some of the above-described embodiments may be executed through the general zone and other parts may be executed through the secure zone.

[0120]

[0121] An electronic device (101) according to various embodiments includes a camera module (180), at least one processor (120), and a memory (130), and the memory (130) can store instructions that, when executed by the at least one processor (120), cause the electronic device (101) to obtain at least three feature coordinates (511, 513, 1201) from a palm image (300) obtained through the camera module (180), identify a rotation angle for the palm based on the at least three feature coordinates (511, 513, 1201), and adjust a palm print recognition area (401) based on the rotation angle for the palm.

[0122] According to various embodiments, the processor (120) (e.g., processing circuit) may be implemented as one or more IC (integrated circuit (or circuitry)) chips and may perform various data processes. The processor (120) may include at least one electrical circuit and may individually or collectively perform distributed processing of instructions (or programs, data) stored in the memory (123). The processor (120) may include a processor assembly including one or more processing circuits. The processor (120) may include any processing circuit operative to control the performance and operations of one or more components of the electronic device (101) (e.g., memory (130), display (160), sensor module (176) (e.g., sensor), camera module (180) (e.g., image sensor), and / or communication module (190) (e.g., communication circuit)). For example, the processor (120) (e.g., an application processor (AP)) may be implemented as a system on chip (SoC) (e.g., a single chip or chipset). For example, the processor (120) may be implemented as multiple cores (or at least one core circuit), multiple chips, or multiple chipsets. For example, the processor (120) may include one or more processing circuits. For example, the processor (120) may include one or more processing circuits configured to individually and / or collectively perform various functions of the present disclosure. As a non-limiting example, at least a portion of the processor (120) may be included in a first chip of the electronic device (101), and at least another portion of the processor (120) may be included in a second chip of the electronic device (101) that is different from the first chip of the electronic device (101).

[0123] According to various embodiments, the rotation angle for the palm may include at least one of a first rotation angle rotated in a first direction or a second direction about a first axis along the long axis of the palm and a second rotation angle rotated in a third direction or a fourth direction about a second axis along the short axis of the palm.

[0124] According to various embodiments, the instructions may cause the electronic device (101) to have a horizontal length of the fingerprint recognition area (401) as a first length when the first rotation angle is within a specified first range.

[0125] According to various embodiments, the instructions may cause the electronic device (101) to adjust (801, 901) the horizontal length of the long-print recognition area (401) to have a second length shorter than the first length when the first rotation angle is outside the specified first range.

[0126] According to various embodiments, the second length may be inversely proportional to the first rotation angle.

[0127] According to various embodiments, the instructions may cause the electronic device (101) to adjust the vertical length of the fingerprint recognition area (401) to have a third length when the second rotation angle is within a specified second range.

[0128] According to various embodiments, the instructions may cause the electronic device (101) to adjust (1001, 1101) the vertical length of the long-term recognition area (401) to have a fourth length that is shorter than the third length when the second rotation angle is outside the specified second range.

[0129] According to various embodiments, the fourth length may be inversely proportional to the second rotation angle.

[0130] According to various embodiments, the instructions may cause the electronic device (101) to adjust (520) the vertical length and horizontal length of the fingerprint recognition area (401) to be equal to each other when the first rotation angle is within a specified first range and the second rotation angle is within a specified second range.

[0131] According to various embodiments, the at least three feature coordinates (511, 513, 1201) may include a first feature coordinate (511) included in a first boundary line (505) formed by a middle finger area (503) and a palm area (501), a second feature coordinate (513) included in a second boundary line (509) formed by a ring finger area (507) and a palm area (501), and a third feature coordinate (1201) which is a center coordinate of the palm area (501).

[0132] According to various embodiments, the instructions may cause the electronic device (101) to position the center coordinates of the long-print recognition area (401) on a perpendicular bisector (525) of a line segment (521) having the first feature coordinate (511) and the second feature coordinate (513) as endpoints.

[0133] According to various embodiments, the instructions may cause the electronic device (101) to move the center coordinate of the fingerprint recognition area (401) to the third feature coordinate (1201) when the center coordinate of the fingerprint recognition area (401) is outside a certain range based on the third feature coordinate (1201).

[0134] According to various embodiments, the instructions may enable the electronic device (101) to obtain biometric information from the length-adjusted fingerprint recognition area (401, 801, 901, 1101, 1201).

[0135]

[0136] Figure 14 is a flowchart illustrating the operation of an electronic device (101) according to various embodiments. While the operations in the following embodiments may be performed sequentially, they are not necessarily performed sequentially. For example, the order of the operations may be changed, and at least two operations may be performed in parallel. Furthermore, at least one of the following operations may be omitted depending on the embodiment.

[0137] Referring to FIG. 14, an electronic device (101) (e.g., processor (120)) according to various embodiments may obtain a palm image (300) in operation 1410. According to one embodiment, the electronic device (101) may obtain a palm image (300) through a camera module (180).

[0138] According to various embodiments, the electronic device (101) (e.g., the processor (120)) may obtain at least three feature coordinates from the palm image (300) in operation 1420. According to one embodiment, the at least three feature coordinates may include at least two feature coordinates (e.g., the first feature coordinate (511) and the second feature coordinate (513)) that can be used to select the palm recognition area (401) described above with reference to FIG. 12, and a third feature coordinate (1201) that is the center coordinate of the palm area (320). However, this is merely an example, and various embodiments are not limited thereto. For example, other feature coordinates may be obtained from the palm image (300) in addition to the feature coordinates described above.

[0139] According to various embodiments, the electronic device (101) (e.g., the processor (120)) may, at operation 1430, identify a rotation angle for the palm based on at least three feature coordinates. According to one embodiment, the electronic device (101) may determine whether a palm in a specified posture is identified in the palm image (300) based on at least three feature coordinates, as described above with reference to FIG. 12.

[0140] According to various embodiments, the electronic device (101) (e.g., processor (120)) may adjust the palm recognition area (401) based on the rotation angle of the palm at operation 1440.

[0141] According to one embodiment, the electronic device (101) may select a palm recognition area (401) based on a first feature coordinate (511) included in a first boundary line (505) (e.g., the center of the first boundary line (505)) formed by a middle finger area (503) and a palm area (501), as described above with reference to FIG. 5A, and a second feature coordinate (513) included in a second boundary line (509) (e.g., the center of the second boundary line (509)) formed by a ring finger area (507) and a palm area (501).

[0142] Additionally, the electronic device (101) can adjust the palm recognition area (401) based on the rotation angle of the palm. According to one embodiment, the electronic device (101) can dynamically adjust the palm recognition area (401) based on the posture of the palm, as described above with reference to FIGS. 8 to 11.

[0143]

[0144] FIG. 15 is a flowchart illustrating an operation for adjusting a fingerprint recognition area of ​​an electronic device (101) according to various embodiments. In addition, FIGS. 16a and 16b may be one of various embodiments for operation 1440 for explaining a normalization operation for a fingerprint recognition area (401) according to various embodiments. In addition, each operation in the following embodiments may be performed sequentially, but is not necessarily performed sequentially, and at least one operation may be omitted depending on the embodiment.

[0145] Referring to FIG. 15, an electronic device (101) (e.g., a processor (120)) according to various embodiments may adjust one of the width and height of a palm print recognition area (401) based on a rotation angle relative to a first axis in operation 1510. The first axis may follow the long axis of the palm. The first axis may be the middle finger. According to one embodiment, the electronic device (100) may adjust the width of the palm print recognition area (401) in proportion to the rotation angle, as described above with reference to FIGS. 8 and 9.

[0146] According to various embodiments, the electronic device (101) (e.g., the processor (120)) may adjust the other of the width and height of the palm print recognition area (401) based on a rotation angle relative to a second axis in operation 1520. The second axis may follow the short axis of the palm, which is perpendicular to the long axis of the palm. According to one embodiment, the electronic device (100) may adjust the height of the palm print recognition area (401) in proportion to the rotation angle, as described above with reference to FIGS. 10 and 11 .

[0147] According to various embodiments, the electronic device (101) (e.g., the processor (120)) may perform a normalization operation on the palm print recognition area (401) in operation 1530. For example, the normalization operation may include an operation of correcting the palm print recognition area (401) adjusted through operations 1510 and 1520 into a specified shape. For example, the electronic device (101) may correct the palm print recognition area (401) in a rectangular shape adjusted through operations 1510 and 1520 into a square shape.

[0148] For example, as illustrated in 1610 of FIG. 16A, a palm print recognition area (1600) obtained from palm images of the first and second postures may have a rectangular shape in which the height (2X) is greater than the width (X). In this regard, the electronic device (101) may be corrected to a square shape palm print recognition area (1602) in which the width (X) and the height (X) are equal, as illustrated in 1620 of FIG. 16A.

[0149] For example, as illustrated in 1630 of FIG. 16b, the palm recognition area (1604) obtained from the palm images of the third and fourth postures may have a rectangular shape with a width (2X) greater than a height (X). In this regard, the electronic device (101) may correct the palm recognition area (1606) to a square shape with the width (X) and height (X) being equal, as illustrated in 1640 of FIG. 16b.

[0150]

[0151] The above-described normalization operation is merely exemplary, and various embodiments are not limited thereto. For example, the normalization operation can be performed in various known ways, and the electronic device (101) can facilitate the extraction of biometric information from the normalized fingerprint recognition area.

[0152] According to one embodiment, the electronic device (101) may correct at least one of color, contrast, or brightness for the long-form recognition area (401) as part of the normalization process. In this regard, the electronic device (101) may perform the normalization process using various machine learning techniques.

[0153] Additionally or optionally, the electronic device (101) may change the location of the palm recognition area (401) as part of the normalization process. In one embodiment, the electronic device (101) may move the center of the palm recognition area (401) to the center of the palm surface (1201), as described above with reference to FIG. 13 .

[0154]

[0155] An operating method of an electronic device (101) according to various embodiments may include an operation of obtaining at least three feature coordinates (511, 513, 1201) from a palm image (300) obtained through a camera module (180), an operation of identifying a rotation angle for the palm based on the at least three feature coordinates (511, 513, 1201), and an operation of adjusting a palm print recognition area (401) based on the rotation angle for the palm.

[0156] According to various embodiments, the rotation angle for the palm may include at least one of a first rotation angle rotated in a first direction or a second direction about a first axis along the major axis of the palm and a second rotation angle rotated in a third direction or a fourth direction about a second axis along the minor axis of the palm.

[0157] According to various embodiments, the operating method of the electronic device (101) may include an operation of adjusting the horizontal length of the long-print recognition area (401) to have a first length when the first rotation angle is included in a specified first range.

[0158] According to various embodiments, the operating method of the electronic device (101) may include an operation of adjusting (801, 901) the horizontal length of the long-print recognition area (401) to have a second length shorter than the first length when the first rotation angle is outside the specified first range.

[0159] According to various embodiments, the second length may be inversely proportional to the first rotation angle.

[0160] According to various embodiments, the operating method of the electronic device (101) may include an operation of adjusting the vertical length of the long-print recognition area (401) to have a third length when the second rotation angle is included in a specified second range.

[0161] According to various embodiments, the operating method of the electronic device (101) may include an operation of adjusting (1001, 1101) the vertical length of the long-term recognition area (401) to have a fourth length shorter than the third length when the second rotation angle is outside the specified second range.

[0162] According to various embodiments, the fourth length may be inversely proportional to the second rotation angle.

[0163] According to various embodiments, the operating method of the electronic device (101) may include an operation of adjusting (520) the vertical length and horizontal length of the long-print recognition area (401) to be equal to each other when the first rotation angle is included in a specified first range and the second rotation angle is included in a specified second range.

[0164] According to various embodiments, the at least three feature coordinates (511, 513, 1201) may include a first feature coordinate (511) included in a first boundary line (505) formed by a middle finger area (503) and a palm area (501), a second feature coordinate (513) included in a second boundary line (509) formed by a ring finger area (507) and a palm area (501), and a third feature coordinate (1201) which is a center coordinate of the palm area (501).

[0165] According to various embodiments, the operating method of the electronic device (101) may include an operation of positioning the center coordinate of the long-print recognition area (401) on a perpendicular bisector (525) of a line segment (521) having the first feature coordinate (511) and the second feature coordinate (513) as endpoints.

[0166] According to various embodiments, the operating method of the electronic device (101) may include an operation of moving the center coordinate of the palm recognition area (401) to the third feature coordinate (1201) when the center coordinate of the palm recognition area (401) is outside a certain range based on the third feature coordinate (1201).

[0167] According to various embodiments, the method of operating the electronic device (101) may include an operation of acquiring biometric information from the long-length recognition area (401, 801, 901, 1101, 1201) whose length is adjusted.

[0168] A computer-readable recording medium according to various embodiments may store instructions for obtaining at least three feature coordinates (511, 513, 1201) from a palm image (300) obtained through a camera module (180), identifying a rotation angle for the palm based on the at least three feature coordinates (511, 513, 1201), and adjusting a palm print recognition area (401) based on the rotation angle for the palm.

Claims

1. In an electronic device (101), Camera module (180); at least one processor (120); and Contains memory (130), The above memory (130), when executed by the at least one processor (120), causes the electronic device (101) to: At least three feature coordinates (511, 513, 1201) are acquired from the palm image (300) acquired through the above camera module (180), Identifying the rotation angle for the palm based on at least three feature coordinates (511, 513, 1201) above, An electronic device storing instructions for adjusting a palm recognition area (401) based on a rotation angle of the palm.

2. In paragraph 1, The rotation angle for the above palm is, An electronic device comprising at least one of a first rotation angle rotated in a first direction or a second direction with respect to a first axis along the major axis of the palm, and a second rotation angle rotated in a third direction or a fourth direction with respect to a second axis along the minor axis of the palm.

3. In paragraph 2, The above instructions cause the electronic device (101) to: If the first rotation angle is included in the specified first range, the horizontal length of the long-form recognition area (401) is adjusted to the first length, An electronic device that adjusts (801, 901) the horizontal length of the long-form recognition area (401) to a second length shorter than the first length when the first rotation angle is out of the first specified range.

4. In paragraph 3, An electronic device wherein the second length is adjusted inversely proportional to the first rotation angle.

5. In paragraph 2, The above instructions cause the electronic device (101) to: If the second rotation angle is included in the specified second range, the vertical length of the long-form recognition area (401) is adjusted to a third length, An electronic device that adjusts (1001, 1101) the vertical length of the long-form recognition area (401) to a fourth length shorter than the third length when the second rotation angle is out of the second range specified above.

6. In paragraph 5, An electronic device wherein the fourth length is adjusted inversely proportional to the second rotation angle.

7. In paragraph 2, The above instructions cause the electronic device (101) to: An electronic device that adjusts (520) the vertical length and horizontal length of the long-print recognition area (401) to be the same length when the first rotation angle is included in a specified first range and the second rotation angle is included in a specified second range.

8. In at least one of paragraphs 1 to 7, At least three feature coordinates (511, 513, 1201) above, An electronic device including a first feature coordinate (511) included in a first boundary line (505) formed by a middle finger area (503) and a palm area (501), a second feature coordinate (513) included in a second boundary line (509) formed by a ring finger area (507) and a palm area (501), and a third feature coordinate (1201) which is a center coordinate of the palm area (501).

9. In paragraph 8, The above instructions cause the electronic device (101) to: An electronic device that positions the center coordinate of the long-print recognition area (401) on a perpendicular bisector line (525) of a line segment (521) having the first feature coordinate (511) and the second feature coordinate (513) as endpoints.

10. In paragraph 9, The above instructions cause the electronic device (101) to: An electronic device that moves the center coordinate of the long-print recognition area (401) to the third feature coordinate (1201) when the center coordinate of the long-print recognition area (401) is out of a certain range from the third feature coordinate (1201).

11. In any of paragraphs 1, 4, 6 or 8, The above instructions cause the electronic device (101) to: An electronic device for acquiring biometric information based on the above-mentioned adjusted fingerprint recognition area (401, 801, 901, 1101, 1201).

12. In the operating method of an electronic device (101), An operation of acquiring at least three feature coordinates (511, 513, 1201) from a palm image (300) acquired through a camera module (180); An operation of identifying a rotation angle for a palm based on at least three feature coordinates (511, 513, 1201); and A method including an action of adjusting a palm recognition area (401) based on a rotation angle of the palm.

13. In paragraph 12, At least three feature coordinates (511, 513, 1201) above, A method including a first feature coordinate (511) included in a first boundary line (505) formed by a middle finger area (503) and a palm area (501), a second feature coordinate (513) included in a second boundary line (509) formed by a ring finger area (507) and a palm area (501), and a third feature coordinate (1201) which is a center coordinate of the palm area (501).

14. In paragraph 12, The rotation angle for the above palm is, At least one of a first rotation angle rotated in a first direction or a second direction with respect to a first axis along the long axis of the palm, and a second rotation angle rotated in a third direction or a fourth direction with respect to a second axis along the short axis of the palm, When the first rotation angle is included in the specified first range, an operation of adjusting the horizontal length of the long-form recognition area (401) to have the first length; and, A method including an operation of adjusting (801, 901) the horizontal length of the long-form recognition area (401) to have a second length shorter than the first length when the first rotation angle is out of the first specified range.

15. In paragraph 12, The rotation angle for the above palm is, At least one of a first rotation angle rotated in a first direction or a second direction with respect to a first axis along the long axis of the palm, and a second rotation angle rotated in a third direction or a fourth direction with respect to a second axis along the short axis of the palm, If the second rotation angle is included in the specified second range, an operation of adjusting the vertical length of the long-form recognition area (401) to have a third length; and A method including an operation of adjusting (1001, 1101) the vertical length of the long-form recognition area (401) to have a fourth length shorter than the third length when the second rotation angle is out of the second specified range.

Images