Information processing device, information processing method, and computer program

Abstract

An information processing device 1 comprising: an acquisition unit 11 that performs an acquisition operation to acquire a surface image including a fingerprint of a subject; a first estimation unit 12 that performs a first estimation operation to estimate, from the acquired surface image, a pattern that the fingerprint has; and an estimation control unit 13 that controls the acquisition unit 11 and the first estimation unit 12 so as to repeat the acquisition operation and the first estimation operation until a prescribed number of surface images that have been estimated by the first estimation unit 12 to have a first pattern are acquired.

Description

Information processing device, information processing method, and recording medium

[0001] The present disclosure relates to the technical fields of an information processing device, an information processing method, and a recording medium.

[0002] Patent Document 1 describes an authentication device that includes a feature extraction unit that extracts feature information from biometric information of a person to be matched acquired by a biometric information sensor; a feature information storage unit that stores feature information of the biometric information of one or more users and multiple non-users; a first matching score calculation unit that compares the matcher feature information of the biometric information of the person to be matched extracted by the feature extraction unit with matched person feature information of the biometric information of a person to be matched who is one of the users stored in the feature information storage unit and with non-user feature information of the biometric information of the multiple non-users to calculate a first matching score; a matching score correction unit that corrects the first matching score with the matched person feature information based on the first matching scores with the multiple non-user feature information; and an authentication unit that authenticates the person to be matched as the person to be matched if the corrected first matching score is equal to or greater than a predetermined discrimination threshold. Patent Literature 2 (PTL 2) describes a technique for capturing high-resolution images representing multiple fingers of a target using a mobile device, identifying respective fingertip segments for each finger among the multiple fingers from the high-resolution images according to a segmentation algorithm, extracting identifiable features from each fingertip segment for each finger, generating a biometric identifier including the extracted identifiable features, and storing the generated biometric identifier in a memory. Patent Literature 3 (PTL 3) describes a technique for capturing biometric features of a user using a mobile device such as a smartphone and generating an identifier characterizing the user's biometric features. The biometric identifier is generated using captured images of the user's multiple fingers for the purpose of authenticating / identifying the user according to the captured biometrics and determining the user's existence. Patent Literature 3 also describes additional techniques for preventing false authentication due to spoofing. Patent Literature 3 describes a technique for preventing spoofing that may include capturing one or more images of a user's fingers and analyzing the captured images for signs of existence.

[0003] International Publication No. 2019 / 207649 Japanese Patent Application Laid-Open No. 2020-074174 Japanese Patent Application Laid-Open No. 2020-501264

[0004] An object of this disclosure is to provide an information processing device, an information processing method, and a recording medium that aim to improve upon the techniques described in prior art documents.

[0005] One aspect of an information processing device includes an acquisition means that performs an acquisition operation to acquire a surface image including a fingerprint of a subject, a first estimation means that performs a first estimation operation to estimate a pattern possessed by the fingerprint from the acquired surface image, and an estimation control means that controls the acquisition means and the first estimation means to repeat the acquisition operation and the first estimation operation until a predetermined number of surface images that are estimated by the first estimation means to have the first pattern are acquired.

[0006] One aspect of the information processing method includes performing an acquisition operation to acquire a surface image including a fingerprint of a subject, performing a first estimation operation to estimate a pattern possessed by the fingerprint from the acquired surface image, and controlling the acquisition operation and the first estimation operation to be repeated until a predetermined number of surface images estimated to have a first pattern by the first estimation operation are acquired.

[0007] One aspect of the recording medium has recorded thereon a computer program for causing a computer to execute an information processing method that controls a computer to perform an acquisition operation to acquire a surface image including a fingerprint of a subject, perform a first estimation operation to estimate a pattern possessed by the fingerprint from the acquired surface image, and repeat the acquisition operation and the first estimation operation until a predetermined number of surface images estimated to have a first pattern by the first estimation operation are acquired.

[0008] FIG. 1 is a block diagram showing the configuration of an information processing device in a first embodiment. FIG. 2 is a block diagram showing the configuration of an information processing device in a second embodiment. FIG. 3 is a flowchart showing the flow of information processing operations performed by the information processing device in the second embodiment. FIG. 4 is a block diagram showing the configuration of an information processing device in a third embodiment. FIG. 5 is a flowchart showing the flow of information processing operations performed by the information processing device in the third embodiment. FIG. 6 is a diagram showing an example of a display screen by the information processing device in the third embodiment. FIG. 7 is a block diagram showing the configuration of an information processing device in a fourth embodiment. FIG. 8 is a flowchart showing the flow of information processing operations performed by the information processing device in the fourth embodiment. FIG. 9 is a flowchart showing the flow of information processing operations performed by the information processing device in the fourth embodiment. FIG. 10 is a block diagram showing the configuration of an information processing device in a fifth embodiment. FIG. 11 is a diagram showing an example of a display screen by the information processing device in the fifth embodiment. FIG. 12 is a block diagram showing the configuration of an information processing device in a sixth embodiment. FIG. 13 is a flowchart showing the flow of information processing operations performed by the information processing device in the sixth embodiment. FIG. 14 is a diagram showing an example of a display screen by the information processing device in the sixth embodiment.

[0009] Hereinafter, embodiments of an information processing device, an information processing method, and a recording medium will be described with reference to the drawings. [1: First Embodiment]

[0010] A first embodiment of an information processing device, an information processing method, and a recording medium will be described below. Hereinafter, the first embodiment of the information processing device, the information processing method, and the recording medium will be described using an information processing device 1 to which the first embodiment of the information processing device, the information processing method, and the recording medium is applied. [1-1: Configuration of Information Processing Device 1]

[0011] The configuration of an information processing device 1 in the first embodiment will be described with reference to Fig. 1. Fig. 1 is a block diagram showing the configuration of the information processing device 1 in the first embodiment.

[0012] As shown in FIG. 1, the information processing device 1 includes an acquisition unit 11, a first estimation unit 12, and an estimation control unit 13. The acquisition unit 11 performs an acquisition operation to acquire a surface image including a fingerprint of a subject. The first estimation unit 12 performs a first estimation operation to estimate a pattern of the fingerprint from the acquired surface image. The estimation control unit 13 controls the acquisition unit 11 and the first estimation unit 12 to repeat the acquisition operation and the first estimation operation until a predetermined number of surface images estimated by the first estimation unit 12 to have the first pattern are acquired. [1-2: Technical Effects of the Information Processing Device 1]

[0013] The information processing device 1 in the first embodiment repeats the acquisition operation and the first estimation operation until a predetermined number of surface images estimated to have the first pattern are acquired, thereby enabling accurate estimation of the pattern of a fingerprint. [2: Second Embodiment]

[0014] A second embodiment of an information processing device, an information processing method, and a recording medium will be described below. Hereinafter, the second embodiment of the information processing device, the information processing method, and the recording medium will be described using an information processing device 2 to which the second embodiment of the information processing device, the information processing method, and the recording medium is applied. [2-1: Configuration of Information Processing Device 2]

[0015] The configuration of the information processing device 2 in the second embodiment will be described with reference to Fig. 2. Fig. 2 is a block diagram showing the configuration of the information processing device 2 in the second embodiment.

[0016] 2 , the information processing device 2 includes a calculation device 21 and a storage device 22. The information processing device 2 may further include a communication device 23, an input device 24, and an output device 25. However, the information processing device 2 does not necessarily include at least one of the communication device 23, the input device 24, and the output device 25. The calculation device 21, the storage device 22, the communication device 23, the input device 24, and the output device 25 may be connected via a data bus 26.

[0017] The arithmetic device 21 includes, for example, at least one of a central processing unit (CPU), a graphics processing unit (GPU), and a field programmable gate array (FPGA). The arithmetic device 21 reads a computer program. For example, the arithmetic device 21 may read a computer program stored in the storage device 22. For example, the arithmetic device 21 may read a computer program stored in a computer-readable, non-transitory storage medium using a storage medium reading device (e.g., an input device 24, described later) not shown in the drawings that is included in the information processing device 2. The arithmetic device 21 may acquire (i.e., download or read) the computer program from a device (not shown) located outside the information processing device 2 via the communication device 23 (or another communication device). The arithmetic device 21 executes the read computer program. As a result, logical functional blocks for executing the operations to be performed by the information processing device 2 are realized within the arithmetic device 21. In other words, the arithmetic device 21 can function as a controller for realizing logical functional blocks for executing the operations (in other words, processing) to be performed by the information processing device 2.

[0018] FIG. 2 shows an example of logical functional blocks implemented within the computing device 21 to perform information processing operations. As shown in FIG. 2 , the computing device 21 implements an acquisition unit 211, which is a specific example of an "acquisition means" described in the appendix below; a first estimation unit 212, which is a specific example of a "first estimation means" described in the appendix below; an estimation control unit 213, which is a specific example of an "estimation control means" described in the appendix below; and a second estimation unit 214, which is a specific example of a "second estimation means" described in the appendix below. However, the computing device 21 does not necessarily have to include the second estimation unit 214. The operations of the acquisition unit 211, the first estimation unit 212, the estimation control unit 213, and the second estimation unit 214 will be described later with reference to FIG. 3 .

[0019] In this specification, "acquisition" may refer to active acquisition, in which a device retrieves data stored in another device, storage medium, etc., based on user input or program instructions. Active acquisition may refer, for example, to receiving data by making a request or inquiry to another device, or to accessing and reading another device, storage medium, etc. In addition, in this specification, "acquisition" may refer to passive acquisition, in which a device inputs data output from another device based on user input or program instructions. Passive acquisition may refer, for example, to receiving data that is distributed (or transmitted, push notification, etc.), or to selecting and acquiring data from received data or information. In addition, in this specification, "acquisition" may refer to editing data (converting it to text, rearranging data, extracting some data, changing the file format, etc.) to generate new data and acquiring the new data.

[0020] The storage device 22 can store desired data. For example, the storage device 22 may temporarily store a computer program executed by the arithmetic device 21. The storage device 22 may temporarily store data that the arithmetic device 21 temporarily uses when the arithmetic device 21 is executing a computer program. The storage device 22 may store data that the information processing device 2 stores long-term. The storage device 22 may include at least one of a RAM (Random Access Memory), a ROM (Read Only Memory), a hard disk device, a magneto-optical disk device, an SSD (Solid State Drive), and a disk array device. In other words, the storage device 22 may include a non-temporary recording medium.

[0021] The communication device 23 is capable of communicating with devices external to the information processing device 2 via a communication network (not shown). The communication device 23 may be a communication interface based on standards such as Ethernet (registered trademark), Wi-Fi (registered trademark), Bluetooth (registered trademark), or USB (Universal Serial Bus).

[0022] The input device 24 is a device that accepts information input to the information processing device 2 from outside the information processing device 2. For example, the input device 24 may include an operation device (for example, at least one of a keyboard, a mouse trackball, a touch panel, a pointing device such as a pen tablet, a button, etc.) that can be operated by an operator of the information processing device 2. For example, the input device 24 may include a reading device that can read information recorded as data on a recording medium that can be externally attached to the information processing device 2.

[0023] The output device 25 is a device that outputs information to the outside of the information processing device 2. For example, the output device 25 may output information as an image. That is, the output device 25 may include a display device (a so-called display) capable of displaying an image showing the information to be output. Examples of display devices include a liquid crystal display and an OLED (organic light-emitting diode) display. For example, the output device 25 may output information as sound. That is, the output device 25 may include an audio device (a so-called speaker) capable of outputting sound. For example, the output device 25 may output information on paper. That is, the output device 25 may include a printing device (a so-called printer) capable of printing desired information on paper. Furthermore, the input device 24 and the output device 25 may be integrally formed as a touch panel.

[0024] The hardware configuration shown in FIG. 2 is an example, and devices other than those shown in FIG. 2 may be added, or some devices may not be provided. Also, some devices may be replaced with other devices having similar functions. Also, some functions of the second embodiment may be provided by other devices via a network. The functions of the second embodiment may be distributed and realized among multiple devices. In this way, the hardware configuration shown in FIG. 2 can be modified as appropriate. [2-2: Fingerprint Pattern]

[0025] Fingerprints of each finger of a human, including a newborn baby, can be classified into five types of fingerprint patterns, for example, Whorl (W), Double Loop (D), Left Loop (L), Right Loop (R), and Arch (A). A fingerprint pattern may represent the overall pattern of a fingerprint. Note that a fingerprint pattern may also be referred to as a fingerprint print.

[0026] A whorl pattern (W) is a fingerprint pattern with deltas on either side of a circular or spiral ridge. A circular pattern without flow exists in the center of the pattern, with deltas on both sides of the center. Depending on the fingerprint acquisition conditions, only one delta may be present. A delta may also be called a delta. A separated pattern (D) is a fingerprint pattern with deltas on either side of a double hoof-shaped ridge. A circular pattern with flow, resembling a Tomoe, exists in the center of the pattern, with deltas on both sides of the center. Depending on the fingerprint acquisition conditions, only one delta may be present. A left loop-shaped pattern (L) is a fingerprint pattern with a loop-shaped line and a delta on the right side of the flow. A pattern that flows from the left side toward the center of the pattern exists, with a delta on the right side of the flow. Depending on the fingerprint acquisition conditions, no delta may be present. In this embodiment, the same names are used for patterns on both right and left hands. A right loop-shaped fingerprint (R) is a fingerprint pattern that includes a loop-shaped line and has a delta on the left side of the flow direction. There is a pattern that flows from the right side toward the center of the pattern, and a delta on the left side of the flow direction. Note that there may be cases where a delta does not exist depending on the fingerprint acquisition conditions. In this embodiment, the same name is used for patterns on both right and left hands. An arch-shaped fingerprint (A) is a fingerprint pattern formed with an arch-shaped gland. A delta pattern may appear in the center of the pattern, but in many cases the pattern does not have a delta.

[0027] Alternatively, the first estimation unit 212 may determine which of six types of fingerprint patterns each of the multiple fingerprint images has, consisting of the above five types of fingerprint patterns plus an unknown fingerprint pattern (UK). If the pattern of a fingerprint image cannot be determined to be any of the above five types of fingerprint patterns, the first estimation unit 212 may determine that the pattern of the fingerprint image is "UK." Note that the above five types of fingerprint patterns are merely examples, and other classifications may be adopted. For example, fingerprints may be classified into eight types of fingerprint patterns: P Arch (Plain Arch: PA), T Arch (Tented Arch: TA), U Loop (Ulnar Loop: UL), R Loop (Radial Loop: RL), D Loop (Double Loop: DL), P Whorl (Plain Whorl: PW), C Whorl (Central Pocket Loop Whorl: CW), and A Whorl (Accidental Whorl: AW). [2-3: Information Processing Operation Performed by Information Processing Device 2]

[0028] With reference to FIG. 3, the flow of information processing operations performed by the information processing device 2 in the second embodiment will be described. FIG. 3 is a flowchart showing the flow of information processing operations performed by the information processing device 2 in the second embodiment. When a predetermined number of surface images estimated to have a first pattern are acquired, the information processing device 2 in the second embodiment may estimate that the first pattern is a pattern possessed by the subject's fingerprint. In the second embodiment, the predetermined number may be four. That is, in the second embodiment, when four surface images estimated to have the same fingerprint pattern are acquired, the same fingerprint pattern may be estimated to be a pattern possessed by the fingerprint. Note that the predetermined number of acquired surface images may be any plural number. The larger the predetermined number is set, the higher the accuracy of estimating the pattern possessed by the fingerprint.

[0029] As shown in Figure 3, at the start of the information processing operation, n is set to 0. n is a variable that counts the acquired surface images.

[0030] The acquisition unit 211 performs an acquisition operation to acquire a surface image including the subject's fingerprint (step S20). The acquisition operation may be an operation to acquire a surface image capturing the fingerprint of a specific finger of the subject. The subject may be a newborn. In this embodiment, a newborn may refer to a very premature baby within a few hours of birth. For example, in this embodiment, a newborn may refer to a baby within half a day of birth. In this embodiment, a newborn may particularly refer to a baby in the period up to when a situation requiring identification of the child occurs. A situation requiring identification of the child may be, for example, a situation in which the child moves from the place of birth (e.g., a hospital) to another place (e.g., home). The subject may be a newborn up to four weeks old, an infant, a toddler, or an adult.

[0031] A fingerprint image collected from the surface of a finger can be used as stable biometric information that can be obtained from a newborn. Stable biometric information may refer to biometric information that changes little with growth and can be used to identify an individual. The pitch of a newborn's fingerprint is much finer than that of an adult. Therefore, the acquisition unit 211 may acquire a high-resolution fingerprint image.

[0032] The first estimation unit 212 performs a first estimation operation to estimate a fingerprint pattern from the acquired surface image (step S21). The first estimation operation may be an operation to estimate which of a plurality of predetermined patterns the fingerprint pattern has from the acquired surface image. For example, the plurality of predetermined patterns may be five fingerprint patterns, namely, "W", "D", "L", "R", and "A". In this case, the first estimation operation may be an operation to estimate which of the fingerprint patterns "W", "D", "L", "R", and "A" the fingerprint pattern included in the surface image has.

[0033] The first estimation unit 212 may use an algorithm to estimate which of the five (or six, or any) types of fingerprint patterns each fingerprint pattern corresponds to. The first estimation unit 212 may use a determination model constructed by machine learning (e.g., a determination model using a neural network) to determine which of the five (or six, or any) types of fingerprint patterns each fingerprint pattern corresponds to. The first estimation unit 212 may use a determination model constructed by deep learning, which is an example of machine learning, to determine which of the five (or six, or any) types of fingerprint patterns each fingerprint pattern corresponds to.

[0034] The estimation control unit 213 determines whether n is less than 4, which is a predetermined number (step S22). If n is less than 4 (step S22: Yes), the estimation control unit 213 adds 1 to n (step S23). The estimation control unit 213 determines whether n is 4, which is a predetermined number (step S24). If n is less than 4 (step S24: No), the process returns to step S20. The estimation control unit 213 controls the operations from step S20 to step S24 to be repeated a predetermined number of times until n becomes a predetermined number from 0.

[0035] If n is the predetermined number of 4 (step S24: Yes), the estimation control unit 213 determines the number of acquired surface images of the first pattern (steps S25 to S27). In the second embodiment, the first pattern may be the fingerprint pattern with the largest number of surface images estimated to have the same fingerprint pattern. For example, assume that the number of acquired surface images is 4, the number of surface images estimated to be fingerprint pattern W is 1, the number of surface images estimated to be fingerprint pattern D is 1, the number of surface images estimated to be fingerprint pattern L is 1, and the number of surface images estimated to be fingerprint pattern R is 1. In this case, the number of acquired surface images of the first pattern is 0, and the estimation control unit 213 determines No in steps S25, S26, and S27 and proceeds to step S28. The estimation control unit 213 assigns 4 to Dn (step S28) and returns to step S20. Dn may be a variable indicating the number of surface images to be acquired. That is, if the number of acquired surface images of the same fingerprint pattern is zero, four surface images may be acquired again to estimate the pattern.

[0036] After the determination in step S24 becomes Yes, the determination in step S22 becomes No. Therefore, after steps S20, S21, and S22, the process proceeds to step S29. The estimation control unit 213 subtracts 1 from Dn (step S29) and determines whether Dn is 0 (step S30). The estimation control unit 213 repeats the operations of steps S20, S21, S22, S29, and S30 until Dn becomes 0.

[0037] After step S28, four new surface images are acquired, so eight surface images are acquired in the second step S25. For example, assume that the number of surface images in which the pattern is estimated to be fingerprint pattern W is three, the number of surface images in which the pattern is estimated to be fingerprint pattern D is two, the number of surface images in which the pattern is estimated to be fingerprint pattern L is two, and the number of surface images in which the pattern is estimated to be fingerprint pattern R is one. In this case, since the first pattern is fingerprint pattern W, the number of acquired surface images of the first pattern is three. The estimation control unit 213 determines No in step S25 and Yes in step S26, and proceeds to step S32. The estimation control unit 213 assigns 1 to Dn (step S32) and returns to step S20. The estimation control unit 213 performs the operations of steps S20, S21, S22, S29, and S30 once, and then proceeds to step S25.

[0038] When step S32 is performed after step S28, one new surface image is acquired, so nine surface images are acquired in the third step S25. For example, assume that the number of surface images in which the pattern is estimated to be fingerprint pattern W is four, the number of surface images in which the pattern is estimated to be fingerprint pattern D is two, the number of surface images in which the pattern is estimated to be fingerprint pattern L is two, and the number of surface images in which the pattern is estimated to be fingerprint pattern R is one. In this case, since the first pattern is fingerprint pattern W, the number of acquired surface images of the first pattern is four. The estimation control unit 213 determines Yes in step S25 and proceeds to step S33. That is, the information processing device 2 acquires surface images of the subject's finger and repeats the process of estimating the fingerprint pattern of the fingerprint from the acquired surface images until the number of surface images estimated to be the first pattern among the estimated fingerprint patterns reaches a predetermined number.

[0039] When the second estimation unit 214 acquires a predetermined number of surface images estimated by the first estimation unit 212 to have the first pattern, the second estimation unit 214 performs a second estimation operation to estimate that the first pattern is a pattern that the subject's fingerprint has (step S33). In the second embodiment, the second estimation unit 214 estimates that the first first pattern that reaches the predetermined number is the pattern that the subject's fingerprint has.

[0040] If the determinations made in steps S25 to S27 show that the number of acquired surface images of the first pattern is 2 (step S25: No, step S26: No, and step S27: Yes), the process proceeds to step S31, where the estimation control unit 213 assigns 2 to Dn (step S31), and the process returns to step S20. In this case, too, the estimation control unit 213 repeats the operations of steps S20, S21, S22, S29, and S30 until Dn becomes 0.

[0041] That is, the estimation control unit 213 controls the acquisition unit 211 and the first estimation unit 212 to repeat the acquisition operation (step S20) and the first estimation operation (step S21) until a predetermined number of surface images estimated by the first estimation unit 212 to have the first pattern are acquired.

[0042] The above-mentioned five types of fingerprint patterns are merely an example. Fingerprints may be classified into more than five types, for example, 20 or more types of fingerprint patterns. Alternatively, fingerprints may be classified into three types of fingerprint patterns, for example, a first fingerprint pattern that does not include a delta, a second fingerprint pattern that includes one delta, and a third fingerprint pattern that includes two deltas. Alternatively, fingerprints may be classified into two types of fingerprint patterns, for example, a delta-free fingerprint pattern that does not include a delta, and a delta-containing fingerprint pattern that includes a delta. Reducing the number of classifications can reduce errors in pattern estimation.

[0043] For example, the user may specify the number of fingerprint categories according to the requirements for using information about newborns. In this case, the first estimation unit 212 may estimate which fingerprint pattern belongs to which of the fingerprint patterns in the number of categories specified by the user.

[0044] The "acquisition means" described in the appendix below may be an imaging unit (or imaging means). That is, the information processing device 2 may be an image capturing device, which alternately repeats a first process of capturing a surface image including a fingerprint of a subject and a second process of estimating a pattern of the fingerprint from the captured surface image, and terminates the repetition when a predetermined number of surface images estimated to include the first pattern among the estimated patterns have been captured. In this case, the image capturing device as an information processing device may include a plurality of imaging units (or imaging means) as "acquisition means". Each of the acquisition means may capture a surface image of a different finger. The surface image may be a fingerprint image. This allows for faster processing when capturing multiple surface images of multiple fingers. [2-4: Modification]

[0045] As a modified example of this embodiment, even if the acquisition number condition is satisfied, the estimation control unit 213 may repeat the process until the difference in the number of acquisitions between the fingerprint pattern with the highest acquisition number and the fingerprint pattern with the second highest acquisition number reaches a predetermined number, and determine the first pattern. In this case, if the difference in the number of acquisitions between the fingerprint pattern with the highest acquisition number and the fingerprint pattern with the second highest acquisition number is large and significant, the fingerprint pattern with the highest acquisition number can be considered to be the fingerprint pattern of the subject, and highly accurate estimation can be performed. [2-5: Technical Effects of the Information Processing Device 2]

[0046] Since the body surface of a newborn baby shortly after birth is often covered with sebum, amniotic fluid, etc., it is often difficult to accurately estimate the pattern of the newborn baby's fingerprints. In particular, it is often difficult to accurately estimate the pattern of the newborn baby's fingerprints when the baby is born in a situation where postpartum care is likely to be inadequate and medical facilities are inadequate. Alternatively, it is often difficult to accurately estimate the pattern of the newborn baby's fingerprints when the sebum, amniotic fluid, and other deposits are not removed (removed) out of consideration for the newborn baby's health.

[0047] In contrast, the information processing device 2 in the second embodiment, when a predetermined number of surface images estimated to have the first pattern are acquired, performs a second estimation operation to estimate that the first pattern is a pattern that the subject's fingerprint has, thereby enabling highly accurate estimation. The predetermined number may be a number that can be determined to be a reliable estimate. Therefore, when a predetermined number of surface images estimated to have the first pattern are acquired, this means that a number of surface images that can be determined to be a reliable estimate have been acquired, and therefore the information processing device 2 can perform highly accurate estimation. [3: Third Embodiment]

[0048] A third embodiment of an information processing device, an information processing method, and a recording medium will be described below. Hereinafter, the third embodiment of the information processing device, the information processing method, and the recording medium will be described using an information processing device 3 to which the third embodiment of the information processing device, the information processing method, and the recording medium is applied. [3-1: Configuration of Information Processing Device 3]

[0049] The configuration of the information processing device 3 in the third embodiment will be described with reference to Fig. 4. Fig. 4 is a block diagram showing the configuration of the information processing device 3 in the third embodiment.

[0050] As shown in FIG. 4 , the information processing device 3 of the third embodiment includes a calculation device 21 and a storage device 22, similar to the information processing device 2 of the second embodiment. Furthermore, the information processing device 3 may include a communication device 23, an input device 24, and an output device 25, similar to the information processing device 2 of the second embodiment. However, the information processing device 3 does not necessarily include at least one of the communication device 23, the input device 24, and the output device 25. The information processing device 3 of the third embodiment differs from the information processing device 2 of the second embodiment in that the calculation device 21 further includes a display control unit 315. In the third embodiment, the output device 25 includes a display device (a so-called display) capable of displaying an image showing information to be output. The display control unit 315 causes the display device to display a display screen D including information related to the control operation of the estimation control unit 213. The control operation of the estimation control unit 213 is an operation of repeating the acquisition operation and the first estimation operation until a predetermined number of surface images estimated to have the first pattern are acquired. The information related to the control operation of the estimation control unit 213 includes information related to the number of surface images estimated to have the same pattern. The information processing device 3 may provide the administrator of the information processing device 3 with information on the control operation of the estimation control unit 213 as information notifying the progress of the information processing operation of the information processing device 3 .

[0051] Other features of the information processing device 3 may be the same as other features of the information processing device 2 in the second embodiment. Therefore, in the following, differences from the embodiments already described will be described in detail, and descriptions of other overlapping parts will be omitted as appropriate. [3-2: Information Processing Operation Performed by the Information Processing Device 3]

[0052] An information processing operation performed by the information processing device 3 in the third embodiment will be described with reference to Fig. 5 and Fig. 6. Fig. 5 is a flowchart showing the flow of the information processing operation performed by the information processing device 3 in the third embodiment. Fig. 6 is a diagram showing a display example of the display screen D.

[0053] As shown in Figure 5, the information processing device 3 in the third embodiment differs from the information processing device 2 in the second embodiment in that it performs a display update operation after step S23, step S28, step S31, step S32, step S33, and step S29.

[0054] FIG. 6A shows an example of the display screen D when the information processing operation shown in FIG. 5 starts. In the third embodiment, the predetermined number may be four, and the display control unit 315 may display the display screen D including four boxes as the predetermined number. The display control unit 315 may represent the number of acquired surface images as the number of check marks. In other words, the display control unit 315 may represent the number of surface images to be acquired as the number of boxes without check marks. In other words, the display control unit 315 may prompt the administrator of the information processing device 3 to collect a surface image including the subject's fingerprint by displaying the display screen D including boxes without check marks. The administrator of the information processing device 3 may be the person who collects a surface image including the subject's fingerprint and inputs it into the information processing device 3. In this case, the acquisition unit 211 acquires the input surface image.

[0055] By the operation of step S34 after the first acquisition operation, the display control unit 315 may update the display screen D illustrated in Fig. 6(a) to the display screen D illustrated in Fig. 6(b). By the operation of step S34 after the second acquisition operation, the display control unit 315 may update the display screen D illustrated in Fig. 6(b) to the display screen D illustrated in Fig. 6(c). By the operation of step S34 after the third acquisition operation, the display control unit 315 may update the display screen D illustrated in Fig. 6(c) to the display screen D illustrated in Fig. 6(d). By the operation of step S34 after the fourth acquisition operation, the display control unit 315 may update the display screen D illustrated in Fig. 6(d) to the display screen D illustrated in Fig. 6(e).

[0056] When acquisition of four surface images as the predetermined number has been completed (step S24: Yes), the display control unit 315 updates the display screen D according to the determination result of the number of first patterns acquired.

[0057] If the number of acquired surface images having the first pattern is less than two (step S25: No, step S26: No, step S27: No), the display control unit 315 may update the display screen D illustrated in FIG. 6( e) to the display screen D illustrated in FIG. 6( a) (step S35). That is, the display control unit 315 may display the display screen D including information for letting the administrator of the information processing device 3 understand that four surface images need to be acquired. In this case, in the subsequent step S39, the display control unit 315 may sequentially update the display screen D illustrated in FIG. 6( a) to the display screen D illustrated in FIG. 6( b), update the display screen D illustrated in FIG. 6( b) to the display screen D illustrated in FIG. 6( c), update the display screen D illustrated in FIG. 6( c) to the display screen D illustrated in FIG. 6( d), and update the display screen D illustrated in FIG. 6( d) to the display screen D illustrated in FIG. 6( e).

[0058] If the number of acquired surface images having the first pattern is two (step S25: No, step S26: No, step S27: Yes), the display control unit 315 may update the display screen D illustrated in FIG. 6( e) to the display screen D illustrated in FIG. 6( f) (step S36). The display control unit 315 may represent the number of valid surface images by shading a box. That is, the display control unit 315 may display the display screen D including information informing the administrator that two surface images of the first pattern have been acquired and two more surface images of the first pattern are required. In this case, in the subsequent step S39, the display control unit 315 may sequentially update the display screen D illustrated in FIG. 6( f) to the display screen D illustrated in FIG. 6( g), and then update the display screen D illustrated in FIG. 6( g) to the display screen D illustrated in FIG. 6( h).

[0059] If the number of acquired surface images having the first pattern is three (step S25: No, step S26: Yes), the display control unit 315 may update the display screen D illustrated in FIG. 6( e) to the display screen D illustrated in FIG. 6( i) (step S37). The display control unit 315 may display the display screen D including information informing the administrator that three surface images of the first pattern have been acquired and one more surface image of the first pattern is required. In this case, in the subsequent step S39, the display control unit 315 may update the display screen D illustrated in FIG. 6( i) to the display screen D illustrated in FIG. 6( j).

[0060] If the number of acquired first patterns is four (step S25: Yes), the display control unit 315 may update the display screen D illustrated in FIG. 6(e) to the display screen D illustrated in FIG. 6(k) (step S38). The display screen D may be a screen that notifies the administrator that four surface images of the first patterns have been acquired and that all the necessary surface images have been collected. [3-3: Technical Effects of the Information Processing Device 3]

[0061] The information processing device 3 in the third embodiment displays a display screen including information about the control operation on the display device, so that, for example, an administrator of the information processing device 3 can visually understand the status of information processing by the information processing device 3. Furthermore, the information about the control operation includes information about the number of surface images estimated to have the same pattern, so that the administrator of the information processing device 3 can know the progress of the information processing operation by the information processing device 3. [4: Fourth Embodiment]

[0062] A fourth embodiment of an information processing device, an information processing method, and a recording medium will be described below. Hereinafter, the fourth embodiment of the information processing device, the information processing method, and the recording medium will be described using an information processing device 4 to which the fourth embodiment of the information processing device, the information processing method, and the recording medium is applied. [4-1: Configuration of Information Processing Device 4]

[0063] The configuration of the information processing device 4 in the fourth embodiment will be described with reference to Fig. 7. Fig. 7 is a block diagram showing the configuration of the information processing device 4 in the fourth embodiment.

[0064] As shown in FIG. 7 , the information processing device 4 of the fourth embodiment includes a calculation device 21 and a storage device 22, similar to the information processing device 2 of the second embodiment and the information processing device 3 of the third embodiment. Furthermore, the information processing device 4 may include a communication device 23, an input device 24, and an output device 25, similar to the information processing device 2 of the second embodiment and the information processing device 3 of the third embodiment. However, the information processing device 4 does not necessarily include at least one of the communication device 23, the input device 24, and the output device 25. The information processing device 4 of the fourth embodiment differs from the information processing device 2 of the second embodiment and the information processing device 3 of the third embodiment in that the calculation device 21 further includes a registration control unit 416, the first estimation unit 212 includes a calculation unit 417, and the storage device 22 includes a pattern database DB. The pattern database DB may be a database that stores information indicating a pattern in a subject's fingerprint and finger information that associates a surface image of the pattern in the subject's fingerprint. However, the pattern database DB may be realized in a storage mechanism other than the storage device 22. For example, the information processing device 4 may be an edge server provided for each hospital. In this case, the pattern database DB may be realized in a storage device provided in the cloud server. In this case, multiple edge servers may control registration in the pattern database DB. Other features of the information processing device 3 may be the same as other features of the information processing device 2 in the second embodiment. Therefore, in the following, differences from the embodiments already described will be described in detail, and descriptions of other overlapping parts will be omitted as appropriate. [4-2: Information Processing Operation Performed by the Information Processing Device 4]

[0065] The information processing operation performed by the information processing device 4 in the fourth embodiment will be described with reference to Figures 8 and 9. Figures 8 and 9 are flowcharts showing the flow of the information processing operation performed by the information processing device 4 in the fourth embodiment.

[0066] 8, in the fourth embodiment, after the acquisition operation in step S20, the calculation unit 417 performs a calculation operation to calculate scores indicating the likelihood that the pattern in the surface image is each of multiple predetermined types of fingerprint patterns (step S40). In other words, the calculation unit 417 calculates the likelihood that the pattern in the surface image is at least one of the multiple predetermined types of fingerprint patterns.

[0067] As an example, the calculation unit 417 may calculate the possibility that the pattern in the surface image is each of multiple types of fingerprint patterns as a score within a range of 0 to 1. In this case, the calculation unit 417 may be considered to be calculating a score that indicates the possibility that the pattern in the surface image is a certain type of fingerprint pattern as a probability between 0% and 100%.

[0068] In the fourth embodiment, the first estimation unit 212 estimates which of a plurality of types of fingerprint patterns the pattern in the surface image corresponds to based on the score calculated by the calculation unit 417 (step S21). The first estimation unit 212 may estimate that the fingerprint pattern with the highest score is the most likely pattern in the surface image. Furthermore, the first estimation unit 212 may set the highest score as the score (S) of the corresponding surface image.

[0069] The calculation unit 417 determines whether the score (S) of the corresponding surface image exceeds a predetermined score threshold (step S41). If the score (S) of the corresponding surface image exceeds the predetermined score threshold, the first estimation unit 212 performs the operations of steps S22 to S24, S29, and S30 in the same manner as in the second embodiment. That is, in the fourth embodiment, if the score (S) of the surface image exceeds the score threshold, the first estimation unit 212 may select the acquired surface image as a target for subsequent processing.

[0070] The predetermined score threshold may be 0.51. In this case, the first estimation unit 212 may determine whether the score (S) of the corresponding surface image exceeds 0.51. If the score (S) of the surface image exceeds 0.51, the first estimation unit 212 may select the acquired surface image as the target for subsequent processing. In other words, if there is a 51% or higher probability that the pattern contained in the surface image is the most likely fingerprint pattern, the first estimation unit 212 may select the acquired surface image as the target for subsequent processing. If the predetermined score is set to 0.51, a surface image whose pattern has been accurately estimated can be selected as the target for subsequent processing.

[0071] If the score (S) of the corresponding surface image is less than 0.51, the process returns to step S20. In this case, the first estimation unit 212 may discard the acquired surface image.

[0072] As shown in Figure 9, the first estimation unit 212 calculates the number of surface images (IN) estimated to have a fingerprint pattern for each of multiple predetermined types of fingerprint patterns, and calculates the sum of the scores (SS) of the surface images estimated to have a fingerprint pattern (step S42).

[0073] The second estimation unit 214 determines the fingerprint pattern (P1) with the largest sum of scores (SS) of the surface images estimated to have the same fingerprint pattern (step S43). In the third embodiment, the fingerprint pattern (P1) with the largest sum of scores (SS) is also referred to as the first pattern.

[0074] The second estimation unit 214 determines whether the number of surface images (IN) corresponding to the first pattern is a predetermined number of 4 (step S25).

[0075] If the number of surface images (IN) corresponding to the first pattern is the predetermined number of 4 (step S25: Yes), the second estimation unit 214 estimates that the reliability of the first pattern is high (step S44). The second estimation unit 214 estimates that the first pattern is a pattern contained in the fingerprint of the subject (step S33).

[0076] The registration control unit 416 registers finger information in which information indicating the first pattern is associated with a predetermined number of surface images estimated to have the first pattern (step S45). The registration control unit 416 deletes surface images other than the predetermined number of surface images estimated to have the first pattern from among the multiple surface images acquired by the acquisition unit 211 until the first estimation unit 212 acquires the predetermined number of surface images estimated to have the first pattern. Deleting surface images may be an operation of deleting surface images temporarily stored in the storage device 22 from the storage device 22 and making them unavailable for subsequent processing. The registration control unit 416 may discard surface images not estimated to have the first pattern from among the surface images acquired by the acquisition unit 211 to eliminate fluctuations in the estimation value due to the storage of surface images showing different patterns and improve estimation accuracy. The registration control unit 416 may register only the predetermined number of surface images estimated to have the first pattern in association with information indicating the first pattern.

[0077] For example, if four is defined as the predetermined number, and three surface images are estimated to have the first pattern and one surface image is determined to have the second pattern, one more surface image is acquired. If this additionally acquired surface image is estimated to have the first pattern, the number of surface images having the first pattern will be four, and the number of surface images determined to have the second pattern will be one. In this case, since the number of surface images having the first pattern has reached four, the surface image having the second pattern is discarded as an unnecessary surface image, and the four surface images having the first pattern are registered.

[0078] For example, a predetermined number of surface images estimated to have the first pattern and registered by the registration control unit 416 in association with information indicating the first pattern may be used in the machine learning of the above-described determination model. That is, the surface images registered by the registration control unit 416 may be used as sample surface images of a newborn baby's finger having the first pattern. For example, suppose a surface image not having the first pattern (i.e., a surface image that does not resemble the first pattern, e.g., a surface image having the second pattern) is registered in association with information indicating the first pattern. Using a surface image that does not resemble the first pattern but is associated with information indicating the first pattern for machine learning may be detrimental to improving the accuracy of the determination of the determination model. In this embodiment, after the accuracy satisfies the condition for determining the pattern of the subject's fingerprint, surface images having a pattern different from the determined pattern are deleted from among the patterns acquired by the acquisition operation and the calculation operation, which can contribute to improving the accuracy of the estimation.

[0079] If the number of surface images (IN) corresponding to the first pattern is not 4 (step S25: No), the second estimation unit 214 determines whether the number of surface images (IN) corresponding to the first pattern is 3 (step S26).

[0080] If the number of surface images (IN) corresponding to the first pattern is the predetermined number of 3 (step S26: Yes), the second estimation unit 214 determines whether the difference between the sum of scores (SS1) corresponding to the first pattern and the sum of scores (SS2) corresponding to the pattern with the second highest sum of scores exceeds 1.75 (step S46).

[0081] If the difference exceeds 1.75 (step S46: Yes), the second estimation unit 214 estimates the reliability of the first pattern to be high (step S47). On the other hand, if the difference is 1.75 or less (step S46: No), the second estimation unit 214 estimates the reliability of the first pattern to be medium (step S48). That is, if the number (IN) of surface images corresponding to the pattern (first pattern) having the highest total score among the surface images estimated to have the same pattern is less than a predetermined number of 4, and the difference between the total score (SS1) corresponding to the pattern having the highest total score and the total score (SS2) corresponding to the pattern having the second highest total score is equal to or greater than a threshold, the second estimation unit 214 estimates the reliability of the pattern having the highest total score to be higher than when the difference is less than the threshold.

[0082] If the number of surface images (IN) corresponding to the first pattern is not 3 (step S26: No), the second estimation unit 214 determines whether the number of surface images (IN) corresponding to the first pattern is 2 or not (step S27).

[0083] If the number of surface images (IN) corresponding to the first pattern is the predetermined number of 2 (step S27: Yes), the second estimation unit 214 determines whether the difference between the sum of scores (SS1) corresponding to the first pattern and the sum of scores (SS2) corresponding to the pattern with the second highest sum of scores exceeds 1.0 (step S49).

[0084] If the difference exceeds 1.0 (step S49: Yes), the second estimation unit 214 estimates that the reliability of the first pattern is medium (step S50). On the other hand, if the difference is 1.0 or less (step S49: No), the second estimation unit 214 estimates that the reliability of the first pattern is low (step S51).

[0085] The estimation control unit 213 controls the calculation unit 417 to repeat the acquisition operation and the calculation operation until the likelihood satisfies a condition for determining the pattern of the subject's fingerprint. The condition for determining the pattern of the subject's fingerprint may include at least one of the following: the number of surface images of the first pattern reaches a predetermined number; and the difference in the total scores exceeds a threshold. For example, the estimation control unit 213 may perform the operation of step S33 after the operation of step S47. That is, a configuration may be adopted in which the pattern of the subject's fingerprint is determined even when the number of surface images of the first pattern does not reach a predetermined number. That is, the information processing device 4 may acquire a surface image of the subject's finger, calculate the likelihood that the fingerprint is at least one of multiple patterns from the captured surface image, and repeat the process of determining whether the likelihood satisfies the condition for determining the pattern while the condition is not satisfied.

[0086] In the future, the finger information registered in the pattern database DB may be integrated into a national information DB in which, for example, national identification information for all citizens managed by the government is registered. [4-3: Technical Effects of the Information Processing Device 4]

[0087] The information processing device 4 in the fourth embodiment estimates the reliability and estimates the pattern based on the reliability, so that the pattern can be estimated with higher accuracy. Furthermore, the information processing device 4 registers a surface image having the estimated pattern, so that the accuracy of the first estimation operation can be improved. [5: Fifth Embodiment]

[0088] A fifth embodiment of an information processing device, an information processing method, and a recording medium will be described below. Hereinafter, the fifth embodiment of the information processing device, the information processing method, and the recording medium will be described using an information processing device 5 to which the fifth embodiment of the information processing device, the information processing method, and the recording medium is applied. [5-1: Configuration of Information Processing Device 5]

[0089] The configuration of the information processing device 5 in the fifth embodiment will be described with reference to Fig. 10. Fig. 10 is a block diagram showing the configuration of the information processing device 5 in the fifth embodiment.

[0090] As shown in FIG. 10 , the information processing device 5 of the fifth embodiment includes a calculation device 21 and a storage device 22, similar to the information processing device 2 of the second embodiment to the information processing device 4 of the fourth embodiment. Furthermore, the information processing device 5 may include a communication device 23, an input device 24, and an output device 25, similar to the information processing device 2 of the second embodiment to the information processing device 4 of the fourth embodiment. However, the information processing device 5 does not necessarily include at least one of the communication device 23, the input device 24, and the output device 25. The information processing device 5 of the fifth embodiment differs from the information processing device 2 of the second embodiment and the information processing device 3 of the third embodiment in that the calculation device 21 further includes a registration control unit 416, the first estimation unit 212 includes a calculation unit 417, and the storage device 22 includes a pattern database DB. The information processing device 5 of the fifth embodiment also differs from the information processing device 2 of the second embodiment and the information processing device 4 of the fourth embodiment in that the calculation device 21 further includes a display control unit 315. That is, the information processing device 5 in the fifth embodiment can display the reliability of the estimated pattern on the display screen D. Other features of the information processing device 5 may be the same as at least one other feature of the information processing device 2 in the second embodiment to the information processing device 4 in the fourth embodiment. Therefore, in the following, differences from the already-described embodiments will be described in detail, and descriptions of other overlapping parts will be omitted as appropriate. [5-2: Information Processing Operation Performed by Information Processing Device 5]

[0091] The information processing operation performed by the information processing device 5 in the fifth embodiment will be described with reference to Fig. 11. Fig. 11 is a diagram showing a display example of the display screen D.

[0092] As shown in FIG. 11, the information processing device 5 in the fifth embodiment can both estimate the reliability and display the reliability.

[0093] As in the fourth embodiment, in the fifth embodiment, the calculation unit 417 calculates scores indicating the likelihood that the pattern in the surface image is one of a plurality of predetermined fingerprint patterns. The first estimation unit 212 estimates which of the plurality of fingerprint patterns the pattern in the surface image is, based on the calculated scores.

[0094] 9, the display control unit 315 may cause the display device to display a display screen D exemplified in Fig. 11(a). That is, the display control unit 315 may cause the left box to display a horizontal line pattern indicating high reliability.

[0095] 9 (Step S46: Yes), the display control unit 315 may cause the display device to display the display screen D illustrated in FIG. 11B. That is, the display control unit 315 may cause the display device to display a horizontal line pattern indicating high reliability in the left box. On the other hand, in step S48 (Step S46: No) shown in FIG. 9 , the display control unit 315 may cause the display device to display the display screen D illustrated in FIG. 11C. That is, the display control unit 315 may cause the display device to display a vertical line pattern indicating medium reliability in the left box. That is, the display control unit 315 causes the display device to display the display screen D such that the display mode of the display screen D when the difference between the sum of scores corresponding to the pattern with the largest sum of scores and the sum of scores corresponding to the pattern with the second largest sum of scores of the surface images estimated to have the same pattern is equal to or greater than a threshold value differs from the display mode of the display screen D when the difference is less than the threshold value.

[0096] 9 (step S49: Yes), the display control unit 315 may cause the display device to display a display screen D exemplified in FIG. 11(d). That is, the display control unit 315 may cause the display device to display a vertical line pattern indicating medium reliability in the box on the left. On the other hand, in step S51 (step S49: No) shown in FIG. 9, the display control unit 315 may cause the display device to display a display screen D exemplified in FIG. 11(e). That is, the display control unit 315 may display a display screen D in which all boxes are blank, indicating that a reliable surface image has not been acquired. [5-3: Technical Effects of Information Processing Device 5]

[0097] The information processing device 5 in the fifth embodiment can notify the administrator of the reliability of the estimated pattern. [6: Sixth Embodiment]

[0098] A sixth embodiment of an information processing device, an information processing method, and a recording medium will be described below. Hereinafter, the sixth embodiment of the information processing device, the information processing method, and the recording medium will be described using an information processing device 6 to which the sixth embodiment of the information processing device, the information processing method, and the recording medium is applied. [6-1: Configuration of Information Processing Device 6]

[0099] The configuration of the information processing device 6 in the sixth embodiment will be described with reference to Fig. 12. Fig. 12 is a block diagram showing the configuration of the information processing device 6 in the sixth embodiment.

[0100] As shown in FIG. 12 , the information processing device 6 of the sixth embodiment includes a calculation device 21 and a storage device 22, similar to the information processing device 2 of the second embodiment to the information processing device 5 of the fifth embodiment. Furthermore, the information processing device 6 may include a communication device 23, an input device 24, and an output device 25, similar to the information processing device 2 of the second embodiment to the information processing device 5 of the fifth embodiment. However, the information processing device 6 does not need to include at least one of the communication device 23, the input device 24, and the output device 25. The information processing device 6 of the sixth embodiment differs from the information processing device 2 of the second embodiment to the information processing device 5 of the fifth embodiment in that the calculation device 21 further includes a matching unit 618. Other features of the information processing device 6 may be the same as at least one other feature of the information processing device 2 of the second embodiment to the information processing device 5 of the fifth embodiment. Therefore, the following will describe in detail the differences from the already-described embodiments, and will omit appropriate descriptions of other overlapping features. [6-2: Information Processing Operation Performed by Information Processing Device 6]

[0101] The information processing operation performed by the information processing device 6 in the sixth embodiment will be described with reference to Fig. 13 and Fig. 14. Fig. 13(a) is a flowchart showing the flow of the pattern registration operation performed by the information processing device 6 in the sixth embodiment, and Fig. 13(b) is a flowchart showing the flow of the matching operation performed by the information processing device 6 in the sixth embodiment. Fig. 14 is a diagram showing a display example of the display screen D. [Registration Operation]

[0102] 13A, the second estimation unit 214 estimates a pattern of the fingerprint of a subject (step S100). The second estimation unit 214 may estimate the pattern of the fingerprint by performing the same operation as at least one of the information processing device 2 in the second embodiment to the information processing device 5 in the fifth embodiment. Information indicating the pattern estimation result by the second estimation unit 214 may be referred to as element information.

[0103] The second estimation unit 214 may estimate which of the above-mentioned five (or six, or any other) types of fingerprint patterns each of the four fingers of the first and second fingers of both hands has.

[0104] When the four fingers of a newborn baby are the targets of the second estimation operation, the second estimation unit 214 may estimate which of a plurality of types of fingerprint patterns each of the four fingerprints has (for example, the above-mentioned five types of whorl pattern (W), separated pattern (D), left loop pattern (L), right loop pattern (R), and arch pattern (A)).

[0105] The second estimation unit 214 determines whether all patterns of the fingerprint of the target of the second estimation operation have been estimated (step S101). If there is a target of the second estimation operation whose fingerprint pattern has not been estimated (step S101: No), the process returns to step S100.

[0106] FIG. 14 illustrates a display screen D during estimation of the fingerprint patterns of the first and second fingers of both hands. FIG. 14 shows that pattern estimation has been completed for the first finger of the right hand. FIG. 14 also shows that a high-reliability estimation has been made for the second finger of the right hand, but one more surface image of the first pattern is required. FIG. 14 also shows that a medium-reliability estimation has been made for the first finger of the left hand, and one more surface image of the first pattern is required. FIG. 14 also shows that a medium-reliability estimation has been made for the second finger of the left hand, and two more surface images of the first pattern are required. In other words, FIG. 14 illustrates a case where there is a target for the second estimation operation for which fingerprint pattern estimation has not been completed.

[0107] If all patterns of the fingerprint that is the target of the second estimation operation have been estimated (step S101: Yes), the registration control unit 416 generates registration pattern information that combines each of the patterns of each of the multiple fingers estimated by the second estimation unit 214 (step S102).

[0108] The registration control unit 416 registers the registered pattern information by associating each of the multiple fingers with the corresponding finger information (step S103). The registration control unit 416 may store the registered pattern information, which is a combination of the patterns of each of the multiple fingers estimated by the second estimating unit 214, in the pattern database DB in association with the finger information corresponding to each of the multiple fingers. The registered pattern information may be information indicating an arrangement of element information (hereinafter, may be referred to as "sequence data").

[0109] In the sixth embodiment, the registration control unit 416 may store, in the pattern database DB, registration pattern information that combines each of the element information corresponding to each of the multiple fingers obtained by the second estimating unit 214, in association with the finger information. The registration control unit 416 may store, in the pattern database DB, sequence data that combines each of the element information corresponding to each of four fingers, in association with the finger information. When the second estimating unit 214 determines the fingerprint patterns of each of the four fingers, the sequence data may be expressed, for example, as (left index finger-left thumb-right thumb-right index finger: whorl (W)-whorl (W)-whorl (W)-whorl (W)).

[0110] For example, the occurrence rate of fingerprint patterns for Japanese people is said to be 50%, which is the highest occurrence rate, for whorl (W) fingerprints. Therefore, if the fingerprint patterns of all four fingers are whorl (W) fingerprints (left index finger-left thumb-right thumb-right index finger: W-W-W-W), the occurrence rate of this sequence data is 6.25% (0.5 to the fourth power). Also, if the fingerprint patterns of all fingers on both the left and right (10 fingers) are whorl (W) fingerprints (W-W-W-W-W-W-W-W-W), the occurrence rate of this sequence data is 0.097% (0.5 to the tenth power), which is lower than the occurrence rate for four fingers.

[0111] When the registered pattern information is sequence data, the information processing device 6 can more accurately identify newborns. The information processing device 6 can accurately identify newborns even in cases where it is more difficult to obtain biometric information of a certain quality or higher, such as in the case of premature birth. For example, the information processing device 6 can accurately identify newborns even in cases where it is not possible to obtain a fingerprint image of a certain quality or higher, which is required for fingerprint authentication of adults.

[0112] The information processing device 6 may determine the number of fingers from which fingerprint images are acquired based on the accuracy required for the registered pattern information and the burden on the newborn. Since newborns often register the fingerprints of all of their fingers after they grow up, it is preferable to be able to acquire fingerprints of all of the fingers from newborns as well. Furthermore, by increasing the number of correctly estimated fingerprints (number of fingers) and making the combinations more complex, the accuracy of individual identification can be improved. However, increasing the number of fingers from which fingerprints are acquired imposes a heavy burden on the newborn.

[0113] For example, when the number of expected births is large, the information processing device 6 may determine to lower the accuracy required for the registered pattern information. In this case, for example, the information processing device 6 may determine to estimate fingerprint patterns of four fingers. Furthermore, when the number of expected births is small, the information processing device 6 may determine to increase the accuracy required for the registered pattern information. In this case, for example, the information processing device 6 may determine to acquire fingerprint images from ten fingers.

[0114] Furthermore, for example, if the predetermined plurality of types of fingerprint patterns are, for example, two types of fingerprint patterns with or without delta, the information processing device 6 may estimate the patterns of the fingerprints of ten fingers and generate registered pattern information. By increasing the number of fingers to be estimated, the information processing device 6 can ensure the likelihood of the subject even when the number of predetermined types is small, for example, two types. [Matching Operation]

[0115] The collation operation by the information processing device 6 may be performed before the timing when the newborn moves from a place other than the home, such as a hospital, to the home. Before the timing when the newborn moves may refer to the time of movement or before the movement. The information processing operation by the information processing device 6 may be performed before the newborn is discharged from the hospital, etc.

[0116] The information processing device 6 performs the matching operation shown in FIG. 13B after the registration control unit 416 performs the registration operation of the registered pattern information shown in FIG. 13A.

[0117] The second estimation unit 214 estimates the fingerprint pattern of the subject (step S200). The second estimation unit 214 determines whether all fingerprint patterns of the subjects of the second estimation operation have been estimated (step S201). If there is a subject of the second estimation operation whose fingerprint pattern has not been estimated (step S201: No), the process returns to step S200.

[0118] The collation unit 618 generates collation pattern information by combining the patterns of the fingerprints of each of the multiple fingers estimated by the second estimation unit 214 (step S202). Step S200 may be the same operation as step S100 described above, step S201 may be the same operation as step S101 described above, and step S202 may be the same operation as step S102 described above.

[0119] The matching unit 618 matches the matching pattern information with the registered pattern information (step S203). The matching pattern information may be information indicating an arrangement of element information (hereinafter, may be referred to as "sequence data"). The matching unit 618 may also match one sequence data with another. [6-3: Technical Effects of the Information Processing Device 6]

[0120] The information processing device 6 in the sixth embodiment uses information that combines the estimated patterns of each of the multiple fingers, and therefore can accurately identify an individual using biometric information even if the person to be identified is a newborn. [7: Supplementary Note]

[0121] The following supplementary notes are further disclosed with respect to the above-described embodiments. [Supplementary Note 1] An information processing device comprising: acquisition means for performing an acquisition operation to acquire a surface image including a fingerprint of a subject; first estimation means for performing a first estimation operation to estimate a pattern of the fingerprint from the acquired surface image; and estimation control means for controlling the acquisition means and the first estimation means to repeat the acquisition operation and the first estimation operation until a predetermined number of surface images estimated by the first estimation means to have the first pattern have been acquired. [Supplementary Note 2] The information processing device according to Supplementary Note 1, further comprising: second estimation means for performing a second estimation operation to estimate, when a predetermined number of surface images estimated to have the first pattern by the first estimation means have been acquired, that the first pattern is a pattern of the fingerprint of the subject. [Supplementary Note 3] The information processing device according to Supplementary Note 2, further comprising: registration control means for registering finger information that associates information indicating the first pattern with the predetermined number of surface images estimated to have the first pattern. [Supplementary Note 4] The information processing device according to Supplementary Note 3, wherein the registration control means deletes surface images other than the predetermined number of surface images estimated to have the first pattern from among the plurality of surface images acquired by the acquisition means until a predetermined number of the surface images estimated to have the first pattern by the first estimation means have been acquired. [Supplementary Note 5] The first estimation means calculates scores indicating the possibility that the pattern in the surface image is each of a plurality of predetermined types of patterns, and estimates which of the plurality of types of patterns the pattern in the surface image is based on the calculated scores, and the second estimation means, when the number of the surface images corresponding to the pattern with the largest total score among the surface images estimated to have the same pattern is less than the predetermined number and a difference between the total score corresponding to the pattern with the largest total score and the total score corresponding to the pattern with the second largest total score is equal to or greater than a threshold, estimates a reliability of the pattern with the largest total score to be higher than a case where the difference is less than the threshold.[Supplementary Note 6] The information processing device according to Supplementary Note 1, further comprising: display control means for causing a display device to display a display screen including information related to the control operation of the estimation control means. [Supplementary Note 7] The information processing device according to Supplementary Note 6, wherein the information includes information related to the number of the surface images estimated to have the same pattern. [Supplementary Note 8] The information processing device according to Supplementary Note 6, wherein the first estimation means calculates scores indicating the possibility that a pattern in the surface image is one of a plurality of predetermined types of patterns, and estimates which of the plurality of types of patterns the pattern in the surface image is based on the calculated scores, and the display control means causes the display device to display the display screen such that a display mode of the display screen when a difference between the sum of the scores corresponding to the pattern with the largest sum of the scores of the surface images estimated to have the same pattern and the sum of the scores corresponding to the pattern with the second largest sum of the scores is equal to or greater than a threshold value differs from a display mode of the display screen when the difference is less than the threshold value. [Supplementary Note 9] The information processing device according to Supplementary Note 2, wherein the second estimation means estimates each of the patterns possessed by a fingerprint of each of a plurality of fingers of the subject, and the registration control means registers registered pattern information combining each of the patterns possessed by each of the plurality of fingers estimated by the second estimation means, in association with each of the plurality of fingers and the corresponding finger information. [Supplementary Note 10] An information processing method, comprising: performing an acquisition operation to acquire a surface image including the subject's fingerprint; performing a first estimation operation to estimate a pattern possessed by the fingerprint from the acquired surface image; and controlling to repeat the acquisition operation and the first estimation operation until a predetermined number of surface images estimated by the first estimation operation to have a first pattern are acquired. [Supplementary Note 11] A recording medium having recorded thereon a computer program for causing a computer to execute an information processing method, the method comprising: performing an acquisition operation to acquire a surface image including a fingerprint of a subject; performing a first estimation operation to estimate a pattern of the fingerprint from the acquired surface image; and repeating the acquisition operation and the first estimation operation until a predetermined number of surface images estimated by the first estimation operation to have a first pattern are acquired.[Supplementary Note 12] The information processing device according to Supplementary Note 8, further comprising: a matching means for matching, after the registration control means has registered the registered pattern information, matching pattern information that combines each of the patterns possessed by the fingerprints of each of the plurality of fingers estimated by the second estimation means with the registered pattern information. [Supplementary Note 13] An information processing device comprising: an acquisition means for performing an acquisition operation to acquire a surface image including a fingerprint of a subject; a calculation means for performing a calculation operation to calculate a likelihood that a pattern possessed by the fingerprint from the acquired surface image is at least one pattern of a plurality of predetermined types of patterns; and an estimation control means for controlling the acquisition means and the calculation means to repeat the acquisition operation and the calculation operation until the likelihood satisfies a condition for determining the pattern possessed by the fingerprint of the subject. [Supplementary Note 14] An imaging device that alternately repeats a first process of capturing a surface image including a fingerprint of a subject and a second process of estimating a fingerprint pattern from the captured surface image, and terminates the repetition when a predetermined number of surface images estimated to include a first pattern among a plurality of estimated patterns have been captured. [Supplementary Note 15] An imaging device that captures a surface image of a subject's finger and repeats a process of estimating a fingerprint pattern from the captured surface image until a predetermined number of surface images estimated to be the first pattern among the estimated patterns have been captured. [Supplementary Note 16] An imaging device that captures a surface image of a subject's finger, calculates a likelihood that the fingerprint is at least one pattern among a plurality of patterns from the captured surface image, and repeats a process of determining whether the likelihood satisfies a condition for determining a fingerprint while the condition is not satisfied.

[0122] At least some of the components of each of the above-described embodiments can be appropriately combined with at least some of the other components of each of the above-described embodiments. Some of the components of each of the above-described embodiments may not be used.

[0123] This disclosure is not limited to the above-described embodiments. This disclosure may be modified as appropriate within the scope of the claims and the technical idea that can be read from the entire specification. Information processing devices, information processing methods, and recording media incorporating such modifications are also included in the technical idea of ​​this disclosure. Furthermore, to the extent permitted by law, all publications and papers described in this specification are incorporated herein by reference.

[0124] To the extent permitted by law, this application claims priority to Japanese Patent Application No. 2022-128256, filed August 10, 2022, the disclosure of which is incorporated herein in its entirety by reference.

[0125] 1, 2, 3, 4, 5, 6 Information processing device 11, 211 Acquisition unit 12, 212 First estimation unit 13, 213 Estimation control unit 214 Second estimation unit 315 Display control unit 416 Registration control unit 417 Calculation unit 618 Matching unit DB Pattern database D Display screen

Claims

1. An acquisition means for performing an acquisition operation to acquire a surface image including a fingerprint of a subject; a first estimation means for performing a first estimation operation of estimating a fingerprint pattern from the acquired surface image; an estimation control means for controlling the acquiring means and the first estimating means so as to repeat the acquiring operation and the first estimating operation until a predetermined number of the surface images estimated by the first estimating means to have a first pattern are acquired; An information processing device comprising:

2. a second estimation means for performing a second estimation operation for estimating, when a predetermined number of the surface images estimated by the first estimation means to have a first pattern are acquired, the first pattern being a pattern possessed by the fingerprint of the subject. The information processing apparatus according to claim 1 , further comprising:

3. a registration control means for registering finger information in which information indicating the first pattern is associated with the predetermined number of surface images estimated to have the first pattern; The information processing apparatus according to claim 2 , further comprising:

4. The registration control means deletes surface images other than the predetermined number of surface images estimated to have the first pattern from among the plurality of surface images acquired by the acquisition means until a predetermined number of the surface images estimated to have the first pattern by the first estimation means are acquired. The information processing device according to claim 3 .

5. the first estimation means calculates a score indicating a possibility that the pattern of the surface image is each of a plurality of predetermined types of patterns, and estimates which of the plurality of types of patterns the pattern of the surface image is based on the calculated score; When the number of the surface images corresponding to the pattern having the largest sum of the scores of the surface images estimated to have the same pattern is less than the predetermined number and a difference between the sum of the scores corresponding to the pattern having the largest sum of the scores and the sum of the scores corresponding to the pattern having the second largest sum of the scores is equal to or greater than a threshold, the second estimation means estimates a reliability of the pattern having the largest sum of the scores to be higher than a case where the difference is less than the threshold. The information processing device according to claim 2 .

6. a display control means for causing a display device to display a display screen including information regarding the control operation of the estimation control means; The information processing apparatus according to claim 1 , further comprising:

7. The information includes information regarding the number of the surface images that are estimated to have the same pattern. The information processing device according to claim 6.

8. the first estimation means calculates a score indicating a possibility that the pattern of the surface image is each of a plurality of predetermined types of patterns, and estimates which of the plurality of types of patterns the pattern of the surface image is based on the calculated score; The display control means causes the display device to display the display screen such that a display mode of the display screen when a difference between the sum of the scores corresponding to the pattern having the largest sum of the scores of each of the surface images estimated to have the same pattern and the sum of the scores corresponding to the pattern having the second largest sum of the scores is equal to or greater than the threshold value differs from a display mode of the display screen when the difference is less than the threshold value. The information processing device according to claim 6.

9. performing an acquisition operation to acquire a surface image including the subject's fingerprint; performing a first estimation operation of estimating a fingerprint pattern from the acquired surface image; and performing control such that the acquiring operation and the first estimating operation are repeated until a predetermined number of the surface images estimated to have a first pattern by the first estimating operation are acquired. A computer implemented information processing method.

10. On the computer, performing an acquisition operation to acquire a surface image including the subject's fingerprint; performing a first estimation operation of estimating a fingerprint pattern from the acquired surface image; and performing control such that the acquiring operation and the first estimating operation are repeated until a predetermined number of the surface images estimated to have a first pattern by the first estimating operation are acquired. A computer program for executing an information processing method.