Acquisition method for biological data

Abstract

According to the present invention, an acquisition method for biological data involves acquiring first information obtained by capturing an image of a biological site on a person to be authenticated and performing first abnormality detection processing, performing second abnormality detection processing on the basis of second information that has been generated using the first information, performing third abnormality detection processing on the basis of third information that has been generated using the second information, generating a notification that indicates that an abnormality was detected and outputting the notification at the point in time at which an abnormality is detected, and when an abnormality is not detected, using the third information to generate biological data for the person to be authenticated that is to be used for biological authentication and outputting the biological data.

Description

Method for acquiring biological data 【0001】 The present disclosure relates to a method for acquiring biological data. 【0002】 Patent Document 1 discloses a method for performing fingerprint recognition. This method includes steps of capturing one or more high-resolution images representing a plurality of fingers of a target by a mobile device having a camera, a storage medium, instructions stored in the storage medium, and a processor for executing the instructions, wherein the processor, according to a segmentation algorithm, identifies respective fingertip segments for each finger among the plurality of fingers from the one or more high-resolution images, extracts distinguishable features for each finger from the respective fingertip segments, generates a biometric identifier including the extracted distinguishable features and stores it in a memory, and determines the viability of whether they represent a living target based on the features or characteristics of the generated biometric identifier. 【0003】 Japanese Patent Application Laid-Open No. 2020-074174 【0004】 In view of the above-described conventional circumstances, the present disclosure is devised, and an object thereof is to provide a method for acquiring biological data that more efficiently performs generation of biological data used for biometric authentication and detection of abnormalities in the biological data. 【0005】This disclosure provides a method for acquiring biometric data performed by at least one processor, comprising: acquiring first information in which a biological part of a person to be authenticated is imaged; executing a first anomaly detection process based on the first information; executing a second anomaly detection process different from the first anomaly detection process based on second information generated using the first information; executing a third anomaly detection process different from the first and second anomaly detection processes based on third information generated using the second information; generating and outputting a notification that an anomaly has been detected when an anomaly is detected in any of the first, second, or third anomaly detection processes; and, if no anomaly is detected in any of the first, second, or third anomaly detection processes, generating and outputting biometric data of the person to be authenticated used for biometric authentication using the third information. 【0006】 According to this disclosure, the generation of biometric data used for biometric authentication and the detection of anomalies in biometric data can be performed more efficiently. 【0007】 Block diagram showing a biological data acquisition device according to Embodiment 1; flowchart showing an example of the operation procedure of the biological data acquisition device; figures showing the first and second examples of anomaly detection; figure showing the third example of anomaly detection; block diagram showing an example of the internal configuration of a biological data acquisition system according to Embodiment 2. 【0008】 (Background to this Disclosure) Conventionally, when acquiring biometric data from biological parts used in biometric authentication (e.g., fingerprints, veins, or palm prints), there has been a demand for technology to detect the falsification or forgery (i.e., impersonation) of fingerprints using, for example, printed materials, images displayed on a screen, or silicon on which fingerprints have been formed. In particular, biometric authentication that acquires biometric data in a non-contact state on a predetermined surface (e.g., a glass surface or a sensor) has problems compared to biometric authentication that acquires biometric data while in contact with the predetermined surface, such as the ease with which unsuitable biometric data can be acquired or the ease with which biological parts can be falsified or forged (i.e., impersonated) due to the greater freedom in how the biological part is held. 【0009】Patent Document 1 identifies the fingertip segments of each finger from a high-resolution image, extracts identifiable features from each fingertip segment for each finger, and determines the viability of whether they represent living subjects based on the features or characteristics of a biometric identifier that includes the extracted identifiable features. 【0010】 However, in Patent Document 1, the survival determination is performed after the extraction of fingertip segments and biometric identifiers. Therefore, in biometric data registration or authentication using biometric data, there was a possibility that the notification of the survival determination result to the biometric data registration or authentication system, or to the user being authenticated, would be delayed, resulting in a decrease in throughput. 【0011】 The following describes in detail each embodiment that specifically discloses the configuration and operation of the method for acquiring biological data relating to this disclosure, with reference to the drawings as appropriate. However, unnecessarily detailed explanations may be omitted. For example, detailed explanations of already well-known matters or redundant explanations of substantially identical configurations may be omitted. This is to avoid the following explanation becoming unnecessarily verbose and to facilitate understanding by those skilled in the art. The attached drawings and the following explanation are provided to enable those skilled in the art to fully understand this disclosure and are not intended to limit the subject matter described in the claims. 【0012】 In this disclosure, the term "biometric data" refers to data that includes the characteristics of a biological part used for biometric authentication, and includes, for example, image data of a biological part, data of one or more feature points indicating individuality in a biological part, or data of feature quantities indicating individuality obtained from a biological part. In this disclosure, the term "feature" refers to an element used to identify a fingerprint in the authentication process of biometric authentication, and includes, for example, a feature pattern or shape of a biological part, a feature quantity of a biological part, or a feature point of a biological part. 【0013】Furthermore, the term "abnormal" in this disclosure refers to a state in which the condition of a biological part as depicted in an image used to generate biometric data is unsuitable for biometric authentication, for example, due to the falsification or forgery of a biological part, or the presentation of an incorrect biological part. 【0014】 (Embodiment 1) The biological data acquisition device P1 according to Embodiment 1 will be described with reference to Figure 1. Figure 1 is a block diagram showing the biological data acquisition device P1 according to Embodiment 1. Note that the biological data acquisition device P1 shown in Figure 1 is just one example and is not limited thereto. 【0015】 The biometric data acquisition device P1 performs multiple anomaly detection processes during the process of acquiring (generating) biometric data (i.e., fingerprint images or feature quantities indicating the individuality of fingerprints) used for biometric authentication. The biometric data acquisition device P1 includes a communication unit 10, a processor 11, a memory 12, and a camera 13. 【0016】 Note that the biometric data acquisition device P1 shown in Figure 1 is just one example and is not limited thereto. For example, the biometric data acquisition device P1 may not include a camera 13. In such a case, the biometric data acquisition device P1 acquires captured images of the fingers from an external device that is connected to it via a communication unit 10. 【0017】 The communication unit 10 is connected wirelessly to any external device or server to perform data transmission and reception. Wireless communication here refers to, for example, short-range wireless communication such as Bluetooth® or NFC®, or communication via a wireless Local Area Network (LAN) such as Wi-Fi®. 【0018】 The communication unit 10 outputs various data acquired from an external device or external server to the processor 11. The communication unit 10 also transmits various data acquired from the processor 11 to the external device or external server. 【0019】The processor 11 is configured using, for example, a Central Processing Unit (hereinafter referred to as "CPU"), a Field Programmable Gate Array (hereinafter referred to as "FPGA"), or a Graphics Processing Unit (hereinafter referred to as "GPU"), and works in cooperation with the memory 12 to perform various processes and controls. Specifically, the processor 11 refers to the programs and data held in the memory 12 and executes those programs to realize functions such as acquiring biological data and detecting abnormalities in biological data. 【0020】 The anomaly detection unit 111 performs analysis processing using the captured image of the fingers and the intermediate data acquired (generated) before the fingerprint image is generated. The anomaly detection unit 111 detects anomalies from the fingerprints captured in the fingerprint image or the intermediate data. If the anomaly detection unit 111 determines that an anomaly has been detected from the fingerprints captured in the fingerprint image or the intermediate data, it outputs a notification indicating that an anomaly has been detected. 【0021】 Memory 12 includes, for example, Random Access Memory (hereinafter referred to as "RAM"), which serves as work memory used when executing each process of the processor 11, and Read Only Memory (hereinafter referred to as "ROM"), which stores programs and data that define the operation of the processor 11. Data or information generated or acquired by the processor 11 is temporarily stored in RAM. Programs that define the operation of the processor 11 are written in ROM. 【0022】 Camera 13 includes a lens (not shown) and an image sensor (not shown). The lens (not shown) forms an image of incident light onto the image sensor (not shown). The image sensor (not shown) is a so-called image sensor, and is, for example, a solid-state image sensor such as a Charge-Coupled Device (CCD) or a Complementary Metal-Oxide Semiconductor (CMOS). Camera 13 converts the optical image formed on the image sensor by the lens (not shown) into an electrical signal and outputs it to the processor 11. 【0023】Next, we will explain examples of procedures for acquiring biological data and detecting abnormalities, referring to Figures 2 to 4. Figure 2 is a flowchart showing an example of the operation procedure for the biological data acquisition device P1. Figure 3 shows examples of the first and second abnormality detection procedures. Figure 4 shows an example of the third abnormality detection procedure. 【0024】 The processor 11 acquires the captured images of the fingers (hereinafter referred to as "finger images") captured by the camera 13 (St11). The finger images IMG11, IMG12, IMG13, and IMG14 (see Figure 3) here are captured images of at least one of the four fingers from the index finger to the little finger. 【0025】 The anomaly detection unit 111 performs image analysis on the entire acquired finger images IMG11 to IMG14 and executes the first anomaly detection process (St12). The anomaly detection unit 111 may also execute the first anomaly detection process after noise processing (for example, processing to remove background other than the fingers) or grayscale processing has been performed on the finger images IMG11 to IMG14 acquired by the processor 11. 【0026】 The first abnormality detection process, as described here, is a process that detects abnormalities in the fingers based on the state of the fingers shown in the finger images IMG11 to IMG14, and performs, for example, left / right determination, front / back determination, or forgery (counterfeiting) determination. Left / right determination detects whether the fingers shown in the finger images IMG11 to IMG14 are from the right hand or the left hand, and determines whether the detected hand is the hand to be authenticated. Front / back determination determines whether the fingers shown in the finger images IMG11 to IMG14 are fingerprints (i.e., the palm side and front side). Forgery (counterfeiting) determination determines whether the fingers shown in the finger images IMG11 to IMG14 are forged or counterfeited fingers, for example, made of silicone, rubber, images (screen or photograph), or models. 【0027】The anomaly detection unit 111 determines in the first anomaly detection process whether or not an anomaly has been detected from the finger images IMG11 to IMG14 (St13). Here, finger image IMG11 shown in Figure 3 is an image of the hand to be authenticated, in which the four fingers necessary for left / right determination are captured and there are no anomalies. Finger image IMG12 is an image in which fingerprints are not captured. Finger image IMG13 is an image captured by the camera 13 from a photograph of another person's fingers. Finger image IMG14 is an image captured by the camera 13 from an image of another person's fingers captured on the screen of, for example, a smartphone. 【0028】 For example, the anomaly detection unit 111 determines that an anomaly has been detected from the finger images IMG11 to IMG14 if it determines in the left / right determination that fingers of a hand different from the one being authenticated have been detected, if it determines in the front / back determination that the fingers shown in the finger images IMG11 to IMG14 are not fingerprints (i.e., palm side and front side), or if it determines in the forgery determination that the fingers shown in the finger images IMG11 to IMG14 are forged or spoofed fingers. The anomaly detection unit 111 may arbitrarily change the determination process executed in the first anomaly detection process based on the number of fingers shown in the finger images IMG11 to IMG14. For example, if there are one to three fingers shown in the finger images IMG11 to IMG14, the anomaly detection unit 111 may omit the left / right determination. The first anomaly detection method described above is merely an example and is not limited thereto; any publicly known technique may be used. 【0029】 If the anomaly detection unit 111 determines in the first anomaly detection process that an anomaly has been detected from the finger image (St13, YES), it generates a notification that an anomaly has been detected and outputs it to the processor 11 or to a monitor (not shown) provided by the biometric data acquisition device P1. 【0030】On the other hand, if the anomaly detection unit 111 determines in the first anomaly detection process that no anomalies are detected from the finger image (St13, NO), it requests the processor 11 to generate information of the fingertip detection result as intermediate data. The processor 11 performs fingertip detection to detect the areas in the finger image where the fingertips (fingerprints) of each finger are captured (hereinafter referred to as "detection areas") (St14). The information of the detection areas AR11, AR12, AR13, AR14 (see Figure 3) here refers to information such as the number, size, position (coordinates) of the detection areas, or the positional relationship of each detection area. 【0031】 The anomaly detection unit 111 analyzes the information of the fingerprint detection areas AR11 to AR14 of each finger obtained as a fingertip detection result and executes a second anomaly detection process (St15). 【0032】 The second anomaly detection process, as described here, is a process that detects anomalies in fingerprints (fingers) based on the analysis results of the fingerprints (fingers) captured in the detection areas AR11 to AR14, and performs, for example, a finger count determination, a type determination, or a coordinate determination. The finger count determination determines whether the number of fingers based on the number of detection areas AR11 to AR14 of the detected fingerprint is the number of fingers to be authenticated or the number of fingers required for authentication. The type determination determines whether the detected fingers are of a type to be authenticated. The coordinate determination determines whether the fingerprint is located in a position that is expected to exist (for example, an imaging position suitable for authentication) based on the coordinates of the detection areas AR11 to AR14. The anomaly detection unit 111 may arbitrarily change the determination process performed in the second anomaly detection process based on the number of fingers captured in the finger image. For example, if one to three fingers are detected, the anomaly detection unit 111 may omit the type determination. 【0033】 In the second abnormality detection process, the abnormality detection unit 111 determines whether or not an abnormality has been detected based on the information from detection areas AR11 to AR14 (St16). Here, detection area AR11 shown in Figure 3 is the area where the little finger of the right hand was detected. Detection area AR12 is the area where the ring finger of the right hand was detected. Detection area AR13 is the area where the middle finger of the right hand was detected. Detection area AR14 is the area where the index finger of the right hand was detected. 【0034】For example, the anomaly detection unit 111 determines that an anomaly has been detected in the finger image if, in the finger count determination, it determines that the number of fingers detected is not the number of fingers to be authenticated or the number of fingers required for authentication; in the type determination, it determines that the fingers shown in the finger image are not fingerprints (i.e., palmar or frontal); or in the forgery (counterfeiting) determination, it determines that the fingers shown in the finger image are forged or counterfeit. The anomaly detection unit 111 may arbitrarily change the determination process executed in the first anomaly detection process based on the number of fingers shown in the finger image. For example, if there are one to three fingers shown in the finger image, the anomaly detection unit 111 may omit the left / right determination. The method of the second anomaly detection process described above is just an example and is not limited thereto; any known technology may be used. 【0035】 In the second abnormality detection process, if the abnormality detection unit 111 determines that an abnormality has been detected in the detection areas AR11 to AR14 (St16, YES), it generates a notification that an abnormality has been detected and outputs it to the processor 11 or to a monitor (not shown) provided by the biological data acquisition device P1. 【0036】 On the other hand, if the anomaly detection unit 111 determines in the second anomaly detection process that no anomalies are detected in the detection regions AR11 to AR14 (St16, NO), it requests the processor 11 to generate fingertip images IMG21, IMG22, and IMG23 (see Figure 4) as intermediate data. The processor 11 generates fingertip images IMG21 to IMG23 for each finger, by extracting the fingertips (fingerprints) of each finger detected from the hand image (St17). 【0037】 The anomaly detection unit 111 performs image analysis on the fingertip images IMG21 to IMG23 of each finger and executes a third anomaly detection process (St18). Here, the fingertip image IMG21 shown in Figure 4 is an image of a fingertip on which silicone molded with another person's fingerprint has been placed. The fingertip image IMG22 is an image of a fingertip whose fingerprint has been altered by surgery or the like. The fingertip image IMG23 is an image of a fingertip whose fingerprint has been altered by tape or the like. 【0038】The third anomaly detection process, as referred to here, is a process that detects abnormalities in fingerprints (fingers) based on fingertip images IMG21 to IMG23, and for example, performs fingerprint forgery (counterfeiting) detection. Fingerprint forgery (counterfeiting) detection determines whether there is silicone with printed fingerprints, fingerprint concealment, or fingerprint transplantation (alteration) through surgery in the fingertip (fingerprint) area. 【0039】 In the third abnormality detection process, the abnormality detection unit 111 determines whether or not an abnormality has been detected based on the fingertip images IMG21 to IMG23 (St19). 【0040】 For example, in the fingerprint forgery (counterfeiting) determination, if the anomaly detection unit 111 determines that the fingertip (fingerprint) captured in the fingertip image is a forged or counterfeit fingertip (fingerprint), it determines that an anomaly has been detected from the fingertip images IMG21 to IMG23. Note that the third anomaly detection processing method described above is just an example and is not limited thereto; any publicly known technique may be used. 【0041】 If the anomaly detection unit 111 determines in the third anomaly detection process that an anomaly has been detected from the fingertip images IMG21 to IMG23 (St19, YES), it generates a notification that an anomaly has been detected and outputs it to the processor 11 or to a monitor (not shown) provided by the biometric data acquisition device P1. 【0042】 On the other hand, if the anomaly detection unit 111 determines in the third anomaly detection process that no anomalies are detected from the fingertip images IMG21 to IMG23 (St19, NO), it requests the processor 11 to generate biometric data. The processor 11 generates fingerprint images for each finger, or extracts feature quantities from the fingerprint images to acquire biometric data. The processor 11 registers the acquired fingerprint images or feature quantities for each finger, or performs fingerprint authentication using the acquired fingerprint images or feature quantities for each finger (St20). Note that the processing in step St20 is not mandatory and may be omitted. 【0043】As described above, the biological data acquisition device P1 according to Embodiment 1 executes different abnormality detection processes on various types of information (for example, raw data or a finger image on which noise processing has been performed) acquired in the process until biological data is obtained, and intermediate data (for example, information on a detection region or a fingertip image, etc.) generated or acquired in the process until biological data is generated from the finger image, thereby realizing various abnormality detections for determining whether the data is suitable for biological data and the acquisition of biological data used for biometric authentication. As a result, the biological data acquisition device P1 can execute the abnormality detection process in multiple stages. When an abnormality is detected in each abnormality detection process, it can output a notification indicating that an abnormality has been detected before the biological data is generated, that is, this finger image is not suitable for the acquisition of biological data. Therefore, the biological data acquisition device P1 can suppress a decrease in throughput in the acquisition of biological data and make the abnormality detection process more efficient. 【0044】 In the present disclosure, the above-described intermediate data is an example and may not be limited thereto. The intermediate data may further include an image obtained by converting a finger image (color image) as raw data captured by the camera 13 into grayscale (black and white image), or an image obtained by removing noise such as a background from the finger image. In such a case, the biological data acquisition device P1 may execute an abnormality detection process that can be executed using these intermediate data, which is the same as or different from the first abnormality detection process. 【0045】Furthermore, the biometric data acquisition device P1 can improve the efficiency of each anomaly detection process by sequentially executing first to third anomaly detection processes corresponding to each image data (finger image or intermediate data), and can also improve anomaly detection accuracy by using data suitable for each anomaly detection process. Specifically, the image analysis processing performed on each image data becomes more sophisticated in the order of finger image, then fingertip image (intermediate data). Therefore, the biometric data acquisition device P1 can perform a wider variety of anomaly detections on non-contact acquired finger images while suppressing a decrease in throughput performance by executing different first to third anomaly detection processes using each image data in accordance with the image analysis results obtainable through the image analysis processing performed on each image data. 【0046】 For example, in the first anomaly detection process, left / right determination is not performed by individually analyzing each detection region AR11 to AR14 or each fingertip image IMG21 to IMG23 to determine whether the fingers in each detection region or each fingertip image belong to the right or left hand. Instead, the finger images IMG11 to IMG14 are analyzed, and the determination is made based on the positional relationship of the four fingers from the index finger to the little finger. This allows the biometric data acquisition device P1 to more effectively reduce the processing time or processing load required for left / right determination and improve the accuracy of determining whether the captured fingers belong to the right or left hand. 【0047】 Similarly, for example, in the first anomaly detection process, the front / back determination is not performed by individually analyzing each detection region AR11 to AR14 or each fingertip image IMG21 to IMG23 to determine whether a fingertip (fingerprint) or a nail is captured in each detection region or each fingertip image, but rather by analyzing the entire hand image. This allows the biometric data acquisition device P1 to improve the accuracy of determining whether the captured hand is the right or left hand. 【0048】Similarly, for example, in the first abnormality detection process, the forgery (counterfeiting) determination is made not by analyzing only the fingertips shown in each detection area AR11 to AR14 or each fingertip image IMG21 to IMG23, but by analyzing the entire fingertip image. As a result, the biological data acquisition device P1 can improve the determination accuracy as to whether the finger shown in the finger image is a forged (counterfeited) finger (for example, a finger model formed of a photograph, an image displayed on a screen, silicon, or rubber instead of a living body part as the subject). 【0049】 Therefore, for the quantity determination, type determination, or coordinate determination in the second abnormality detection process, rather than using the image analysis results of the finger images IMG11 to IMG14, using the position information of the detection areas AR11 to AR14 with respect to the finger images IMG11 to IMG14, or the positional relationship of the detection areas AR11 to AR14, etc., as the image analysis results of the detection areas AR11 to AR14 can improve the abnormality detection accuracy. In addition, the biological data acquisition device P1 can more efficiently reduce the number of abnormality detection processes executed using the fingertip images by executing the second abnormality detection process using the detection areas AR11 to AR14 without using the fingertip images IMG21 to IMG23, and can improve the throughput of more advanced image analysis processes using the fingertip images. 【0050】 Also, for example, in the image analysis process using the fingertip images IMG21 to IMG23, generally, the number of pixels to be analyzed is smaller than that of the finger images IMG11 to IMG14. Therefore, when it is desired to execute a more advanced image analysis process for abnormality detection, a more advanced image analysis process can be realized without increasing the time required for the image analysis process by using the fingertip images IMG21 to IMG23 rather than using the finger images IMG11 to IMG14. 【0051】 Therefore, in the third abnormality detection process, the biological data acquisition device P1 can suppress a decrease in throughput by concentrating on, for example, advanced image processing for detecting the presence or absence of advanced forgery (counterfeiting) such as forgery (counterfeiting) of the fingerprint of the fingertip. 【0052】(Embodiment 2) The biometric data acquisition device P1 according to Embodiment 1 described above is an example in which imaging of the user's fingers and anomaly detection using the captured finger images are performed. The biometric data acquisition system 100 according to Embodiment 2 described below will describe an example in which imaging of the user's fingers and anomaly detection using the captured finger images are performed by different devices. 【0053】 In the description of the biological data acquisition system 100 shown in Figure 5, the same reference numerals are used to indicate the same configuration and functions as the biological data acquisition device P1 shown in Figure 1, thus omitting further explanation. 【0054】 Referring to Figure 5, the biological data acquisition system 100 according to Embodiment 2 will be described. Figure 5 is a block diagram showing an example of the internal configuration of the biological data acquisition system 100 according to Embodiment 2. 【0055】 The biological data acquisition system 100 includes a biological data acquisition device P1A and a processing device P2. The overall configuration of the biological data acquisition system 100 shown in Figure 5 is an example and is not limited thereto. For example, the processing device P2 may be connected to multiple biological data acquisition devices P1A in a communication-enabled manner. 【0056】 The biometric data acquisition device P1A captures images of the user's fingers and transmits the captured finger images to the processing device P2. The biometric data acquisition device P1A includes a communication unit 10A, a processor 11A, a memory 12, and a camera 13. 【0057】 The communication unit 10A is connected to the processing unit P2 via wireless or wired communication and performs data transmission and reception. The communication unit 10A transmits the hand image captured by the camera 13 to the processing unit P2. 【0058】 The processor 11A is configured using, for example, a CPU, FPGA, or GPU, and works in cooperation with the memory 12 to perform various processes and controls. Specifically, the processor 11A refers to the programs and data held in the memory 12 and executes the programs to transmit the hand images output from the camera 13 to the processing unit P2. 【0059】The processing unit P2 is connected to the biological data acquisition device P1A in a manner that enables data communication. The processing unit P2 can be implemented as, for example, a PC, a notebook PC, a tablet terminal, an on-premise server, or a cloud server. The processing unit P2 includes a communication unit 20, a processor 21, and a memory 22. 【0060】 The communication unit 20 is wirelessly connected to the biometric data acquisition device P1A and performs data transmission and reception. The communication unit 20 acquires the finger image transmitted from the biometric data acquisition device P1A and outputs it to the processor 21. The communication unit 20 also transmits a notification to the biometric data acquisition device P1A that an abnormality has been detected, which is output from the processor 21 (anomaly detection unit 211). 【0061】 The processor 21 is configured using, for example, a CPU, FPGA, or GPU, and works in cooperation with the memory 22 to perform various processes and controls. Specifically, the processor 21 refers to the programs and data held in the memory 22 and executes those programs to realize functions such as abnormal detection of biological data. The processor 21 can realize the same functions (processing) as the processor 11 in the operation procedure shown in Figure 2. 【0062】 The anomaly detection unit 211 can perform the same functions (processing) as the anomaly detection unit 111 shown in Embodiment 1. The anomaly detection unit 211 performs analysis processing using the captured image of the fingers and the intermediate data acquired (generated) before the fingerprint image is generated. The anomaly detection unit 211 detects anomalies from the fingerprints captured in the fingerprint image or the intermediate data. If the anomaly detection unit 211 determines that an anomaly has been detected from the fingerprints captured in the fingerprint image or the intermediate data, it outputs a notification indicating that an anomaly has been detected. 【0063】 Memory 22 includes, for example, RAM as work memory used when executing each process of the processor 21, and ROM which stores programs and data that define the operation of the processor 21. Data or information generated or acquired by the processor 21 is temporarily stored in RAM. Programs that define the operation of the processor 21 are written in ROM. 【0064】 (Note) The following technologies are disclosed based on the descriptions of each embodiment above. 【0065】(Technology 1) A method for acquiring biometric data performed by at least one processor 11, 21, comprising: acquiring first information (finger images IMG11 to IMG14) in which a biological part (fingertip) of the authenticated person (user) is imaged; executing a first anomaly detection process based on the first information (finger images IMG11 to IMG14); executing a second anomaly detection process different from the first anomaly detection process based on second information (information of detection regions AR11 to AR14) generated using the first information (finger images IMG11 to IMG14); and executing a third anomaly detection process different from the first anomaly detection process and the second anomaly detection process based on third information (fingertip images IMG21 to IMG23) generated using the second information (information of detection regions AR11 to AR14). A method for acquiring biometric data, comprising: generating and outputting a notification indicating that an anomaly has been detected when an anomaly is detected in any of the first anomaly detection process, the second anomaly detection process, or the third anomaly detection process; and, if no anomaly is detected in any of the first anomaly detection process, the second anomaly detection process, or the third anomaly detection process, generating and outputting biometric data of the person to be authenticated (for example, a fingerprint image or fingerprint feature quantities) used for biometric authentication using the third information (finger tip images IMG21 to IMG23). As a result, processors 11 and 21 can perform different anomaly detection processes on various types of information acquired during the process of obtaining biometric data (for example, finger images (raw data or data after noise processing) and intermediate data generated or acquired during the process of generating biometric data from finger images (for example, information on the detection area or fingertip images, etc.)), thereby enabling various anomaly detections to determine whether the data is suitable for biometric data and the acquisition of biometric data. As a result, processors 11 and 21 can perform anomaly detection processes in multiple stages, and if an anomaly is detected in each anomaly detection process, they can output a notification indicating that an anomaly was detected before the biometric data was generated, that is, that the finger images used to acquire biometric data are not suitable for acquiring biometric data. This suppresses a decrease in throughput during biometric data acquisition and makes the anomaly detection process more efficient. 【0066】(Technology 2) The method for acquiring biometric data as described in (Technology 1), wherein the first information is finger images IMG11 to IMG14 in which the fingers of the person to be authenticated are captured. This enables processors 11 and 21 to perform a first anomaly detection process using finger images IMG11 to IMG14, which are acquired first in the process of obtaining biometric data, and to acquire information on detection regions AR11 to AR14 in which the fingertips are detected from the finger images IMG11 to IMG14. The acquisition of information on detection regions AR11 to AR14 is performed based on the result of the first anomaly detection process, and is not performed if an anomaly is detected in the first anomaly detection process. Therefore, processors 11 and 21 can suppress a decrease in throughput in the acquisition of biometric data and determine whether the finger images used for acquiring biometric data are suitable for biometric data. 【0067】 (Technology 3) The method for acquiring biometric data as described in (Technology 1) or (Technology 2), wherein the second information is the detection result of the fingertip of the person to be authenticated, detected from the finger images IMG11 to IMG14 (i.e., information of the detection region AR11 to AR14). This enables the processors 11 and 21 to perform a second anomaly detection process using the information of the detection region AR11 to AR14 acquired in the process of obtaining biometric data, and to acquire fingertip images IMG21 to IMG23 using the information of the detection region AR11 to AR14. The acquisition of fingertip images IMG21 to IMG23 is performed based on the result of the second anomaly detection process, and is not performed if an anomaly is detected in the second anomaly detection process. Therefore, the processors 11 and 21 can suppress the decrease in throughput in acquiring biometric data and determine whether the finger images used to acquire biometric data are suitable for biometric data. 【0068】(Technical 4) The method for acquiring biological data according to any one of (Technical 1) to (Technical 3), wherein the third information is fingertip images IMG21 to IMG23 generated based on the fingertip detection result. As a result, processors 11 and 21 can perform a third anomaly detection process using the fingertip images IMG21 to IMG23 acquired in the process of obtaining biological data, and acquire biological data (fingerprint image or fingerprint feature quantity) using the fingertip images IMG21 to IMG23. Note that the acquisition of biological data is performed based on the result of the third anomaly detection process, and is not performed if an anomaly is detected in the third anomaly detection process.Therefore, processors 11 and 21 can suppress the decrease in throughput in the acquisition of biological data and determine whether the finger image used for acquiring biological data is an image suitable for biological data. 【0069】 (Technical 5) The first anomaly detection process includes a process for detecting whether the biological part is on the palm side (front / back determination), as described in (Technical 1), for acquiring biological data. This allows processors 11 and 21 to determine whether the acquired finger images IMG11 to IMG14 are images of a biological part (fingerprint) used for biometric authentication. In other words, processors 11 and 21 can perform a front / back determination of the fingers (palm or back of hand) as a process for detecting one of the anomalies that can occur in a non-contact state, that is, when there is a high degree of freedom in the orientation of the biological part. 【0070】 (Technical 6) The first anomaly detection process includes a process for detecting whether the biological part is the right hand or the left hand (left / right determination), as described in (Technical 1). This allows the processors 11 and 21 to determine whether the acquired finger images IMG11 to IMG14 are images of a biological part (fingerprint) used for biometric authentication. In other words, the processors 11 and 21 can perform left / right determination of the fingers as a process for detecting one of the anomalies that can occur in a non-contact state, that is, when there is a high degree of freedom in the orientation of the biological part. 【0071】(Technical 7) The first anomaly detection process includes a process for detecting whether the biological part is a living organism (fake / counterfeit determination), as described in (Technical 1), for acquiring biological data. This allows processors 11 and 21 to determine whether the acquired finger images IMG11 to IMG14 are images of a biological part (fingerprint) used for biometric authentication. In other words, processors 11 and 21 can perform a finger fake / counterfeit determination as a process for detecting one of the anomalies that becomes easier to perform by imaging the biological part in a non-contact state. 【0072】 (Technical 8) The method for acquiring biometric data as described in (Technical 1), wherein the second anomaly detection process includes a process for detecting the number or type of the biological parts (number determination or type determination). This allows the processors 11 and 21 to determine whether the acquired finger images IMG11 to IMG14 are images of biological parts (fingerprints) used for biometric authentication. In other words, the processors 11 and 21 can perform a finger count determination as a process for detecting one of the anomalies that are likely to occur in a non-contact state, that is, when the degree of freedom of the posture of the biological parts is high. 【0073】 (Technical 9) The method for acquiring biometric data as described in (Technical 1), wherein the second anomaly detection process includes a process for detecting the position of each biological part (coordinate determination). This allows the processors 11 and 21 to determine whether the acquired finger images IMG11 to IMG14 are images of biological parts (fingerprints) used for biometric authentication. In other words, the processors 11 and 21 can perform a finger coordinate determination as a process for detecting one of the anomalies that are likely to occur in a non-contact state, that is, when the degree of freedom of the posture of the biological part is high. 【0074】(Technical 10) The method for acquiring biometric data as described in (Technical 1), wherein the third anomaly detection process includes a detection process for whether or not there is falsification or forgery of the biological part (fingerprint falsification (forgery) determination). This allows the processors 11 and 21 to determine whether or not the acquired finger images IMG11 to IMG14 are images of a biological part (fingerprint) used for biometric authentication. In other words, the processors 11 and 21 can perform fingerprint falsification (forgery) determination as a process for detecting one of the anomalies that becomes easier to perform by imaging the biological part in a non-contact state. 【0075】 Although various embodiments have been described above with reference to the attached drawings, this disclosure is not limited to such examples. It will be clear to those skilled in the art that various modifications, alterations, substitutions, additions, deletions, and equivalents can be conceived within the scope of the claims, and these will also be understood to fall within the technical scope of this disclosure. Furthermore, the components of the various embodiments described above can be combined arbitrarily without departing from the spirit of the invention. 【0076】 This application is based on a Japanese patent application (JP 2024-214585) filed on December 9, 2024, the contents of which are incorporated by reference within this application. 【0077】 This disclosure is useful as a presentation of a method for acquiring biometric data that more efficiently performs the generation of biometric data used for biometric authentication and the detection of anomalies in biometric data. 【0078】 10, 10A, 20 Communication unit 11, 11A, 21 Processor 12, 22 Memory 13 Camera 100 Biological data acquisition system 111, 211 Anomaly detection unit AR11, AR12, AR13, AR14 Detection area IMG11, IMG12, IMG13, IMG14 Finger image IMG21, IMG22, IMG23 Fingertip image P1, P1A Biological data acquisition device P2 Processing unit

Claims

1. A method for acquiring biometric data performed by at least one processor, comprising: acquiring first information of which a biological part of a person to be authenticated is imaged; executing a first anomaly detection process based on the first information; executing a second anomaly detection process different from the first anomaly detection process based on second information generated using the first information; executing a third anomaly detection process different from the first and second anomaly detection processes based on third information generated using the second information; generating and outputting a notification that an anomaly has been detected when an anomaly is detected in any of the first, second, and third anomaly detection processes; and, if no anomaly is detected in any of the first, second, and third anomaly detection processes, generating and outputting biometric data of the person to be authenticated used for biometric authentication using the third information.

2. The method for acquiring biometric data according to claim 1, wherein the first information is a finger image obtained by capturing the fingers of the person to be authenticated.

3. The method for acquiring biometric data according to claim 2, wherein the second information is the detection result of detecting the fingertip of the person to be authenticated from the hand image.

4. The method for acquiring biological data according to claim 3, wherein the third piece of information is a fingertip image generated based on the fingertip detection result.

5. The method for acquiring biological data according to claim 1, wherein the first anomaly detection process includes a process for detecting whether or not the biological part is on the palm side.

6. The method for acquiring biological data according to claim 1, wherein the first anomaly detection process includes a process for detecting whether the biological part is the right hand or the left hand.

7. The method for acquiring biological data according to claim 1, wherein the first anomaly detection process includes a process for detecting whether the biological part is a living organism.

8. The method for acquiring biological data according to claim 1, wherein the second anomaly detection process includes a process for detecting the number or type of biological parts.

9. The method for acquiring biological data according to claim 1, wherein the second anomaly detection process includes a process for detecting the location of each biological part.

10. The method for acquiring biological data according to claim 1, wherein the third abnormality detection process includes a process for detecting whether or not the biological part is disguised or forged.

Images