Information processing device, information processing method, and recording medium

Abstract

This information processing device comprises: an authentication means that authenticates a subject by respectively using first bioinformation of a first modal acquired from the subject and second bioinformation of a second modal acquired from the subject; and an output means that outputs, on the basis of past authentication results, information prompting change of registered information for at least one of the first bioinformation and the second bioinformation.

Description

Information processing device, information processing method, and recording medium

[0001] The present disclosure relates to the technical fields of an information processing device, an information processing method, and a recording medium.

[0002] For example, a device has been proposed that determines whether or not image data for facial authentication needs to be replaced based on historical information of an authentication score that indicates the degree of match between a user's face included in registered image data for facial authentication and the user's face included in facial image data captured during facial authentication (see Patent Document 1). Another prior art document related to this disclosure is Patent Document 2.

[0003] JP 2022-032530 A JP 2021-189739 A

[0004] An object of this disclosure is to provide an information processing device, an information processing method, and a recording medium that aim to improve upon the techniques described in prior art documents.

[0005] One aspect of an information processing device includes an authentication means for authenticating a subject using first biometric information in a first modal acquired from the subject and second biometric information in a second modal acquired from the subject, and an output means for outputting information prompting a change of registration information for at least one of the first biometric information and the second biometric information based on past authentication results.

[0006] One aspect of the information processing method is to authenticate a target using first biometric information in a first modal acquired from the target and second biometric information in a second modal acquired from the target, and output information prompting the target to change registration information for at least one of the first biometric information and the second biometric information based on past authentication results.

[0007] One aspect of the recording medium has recorded thereon a computer program for causing a computer to execute an information processing method that authenticates a subject using first biometric information in a first modality acquired from the subject and second biometric information in a second modality acquired from the subject, and outputs information prompting a change of registration information for at least one of the first biometric information and the second biometric information based on past authentication results.

[0008] 1 is a block diagram showing an example of the configuration of an information processing device. FIG. 2 is a block diagram showing another example of the configuration of an information processing device. FIG. 3 is a block diagram showing the configuration of a multimodal authentication unit. FIG. 4 is a flowchart showing an example of the operation of an information processing device. FIG. 5 is a block diagram showing another example of the configuration of an information processing device. FIG. 6 is a flowchart showing another example of the operation of an information processing device. FIG. 7 is a block diagram showing another example of the configuration of an information processing device. FIG. 8 is a block diagram showing the configuration of an acquisition condition determination unit.

[0009] An information processing device, an information processing method, and a recording medium according to an embodiment will be described.

[0010] First Embodiment A first embodiment of an information processing device, an information processing method, and a recording medium will be described with reference to Fig. 1. In the following, the first embodiment of the information processing device, the information processing method, and the recording medium will be described using an information processing device 1.

[0011] 1, the information processing device 1 includes an authentication unit 11 and an output unit 12. The authentication unit 11 authenticates the target using first biometric information in a first modal acquired from the target and second biometric information in a second modal acquired from the target. In other words, the authentication unit 11 performs multimodal biometric authentication. The result of the authentication of the target by the authentication unit 11 is stored in a memory or the like (not shown).

[0012] The output unit 12 outputs information prompting a change of the registration information for at least one of the first biometric information and the second biometric information based on past authentication results (i.e., authentication results of authentication performed on the subject prior to the current authentication by the authentication unit 11).

[0013] It can be said that the information processing device 1 performs an information processing method in which the target is authenticated using first biometric information in a first modal acquired from the target and second biometric information in a second modal acquired from the target, and information prompting a change of registration information for at least one of the first biometric information and the second biometric information is output based on past authentication results.

[0014] The information processing device 1 may be realized by a computer reading a computer program recorded on a recording medium. In this case, it can be said that the recording medium records a computer program for causing a computer to execute an information processing method for authenticating a target using first biometric information in a first modality acquired from the target and second biometric information in a second modality acquired from the target, and outputting information prompting the user to change registered information for at least one of the first biometric information and the second biometric information based on past authentication results.

[0015] (Technical Effect) In biometric authentication, which is authentication using biometric information, authentication accuracy may decrease due to at least one of aging, the image quality of the registered image, and the matching conditions. To address this issue, for example, a technology has been proposed that prompts users to change their registered information based on the authentication results of a single biometric authentication method (i.e., single-modal biometric authentication). However, because this technology is based only on the authentication results of a single biometric authentication method, there is a possibility that users will be prompted to change their registered information based on incorrect authentication results.

[0016] The authentication unit 11 of the information processing device 1 performs multimodal biometric authentication. Therefore, the possibility that the authentication unit 11 will mistakenly authenticate a non-registered person as a registered person is lower than in single-modal biometric authentication. Therefore, in the information processing device 1, the possibility that a user will be prompted to change the registered information based on the result of an erroneous authentication is lower than in single-modal biometric authentication. If the registered information is changed in accordance with the information urging the user to change the registered information output by the output unit 12 of the information processing device 1, a decrease in authentication accuracy can be suppressed. As a result, the information processing device 1 can maintain high authentication accuracy.

[0017] Second Embodiment A second embodiment of an information processing device, an information processing method, and a recording medium will be described with reference to Fig. 2 to Fig. 4. In the following, the second embodiment of the information processing device, the information processing method, and the recording medium will be described using an information processing device 2.

[0018] 2 , the information processing device 2 includes a calculation device 21, a storage device 22, a communication device 23, and an image acquisition unit 26. The information processing device 2 may include an input device 24 and an output device 25. The information processing device 2 does not necessarily include at least one of the input device 24 and the output device 25. In the information processing device 2, the calculation device 21, the storage device 22, the communication device 23, the input device 24, the output device 25, and the image acquisition unit 26 may be connected via a data bus 27.

[0019] The arithmetic device 21 may include, for example, at least one of a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), an FPGA (Field Programmable Gate Array), a TPU (Tensor Processing Unit), and a quantum processor.

[0020] The storage device 22 may include, for example, at least one of a RAM (Random Access Memory), a ROM (Read Only Memory), a hard disk device, a magneto-optical disk device, an SSD (Solid State Drive), and an optical disk array. In other words, the storage device 22 may include a non-transitory recording medium. The storage device 22 is capable of storing desired data. For example, the storage device 22 may temporarily store a computer program executed by the arithmetic device 21. The storage device 22 may temporarily store data that is temporarily used by the arithmetic device 21 when the arithmetic device 21 is executing a computer program.

[0021] The communication device 23 may be capable of communicating with devices external to the information processing device 2. The communication device 23 may perform wired communication or wireless communication. Wired communication is not limited to communication via a network, but also includes communication via a cable such as a USB (Universal Serial Bus) cable. Wireless communication is not limited to communication via a network, but also includes short-range wireless communication such as Bluetooth (registered trademark).

[0022] The input device 24 is a device capable of accepting information input to the information processing device 2 from outside. The input device 24 may include an operation device (e.g., a keyboard, a mouse, a touch panel, etc.) that can be operated by an operator of the information processing device 2. The input device 24 may include a recording medium reading device that can read information recorded on a recording medium that is detachable from the information processing device 2, such as a USB memory. Note that when information is input to the information processing device 2 via the communication device 23 (in other words, when the information processing device 2 obtains information via the communication device 23), the communication device 23 may function as an input device.

[0023] The output device 25 is a device capable of outputting information to the outside of the information processing device 2. The output device 25 may output visual information such as text or images, auditory information such as sound, or tactile information such as vibration, as the information. The output device 25 may include, for example, at least one of a display, a speaker, a printer, and a vibration motor. The output device 25 may be capable of outputting information to a recording medium detachable from the information processing device 2, such as a USB memory. Note that when the information processing device 2 outputs information via the communication device 23, the communication device 23 may function as the output device.

[0024] The image acquisition unit 26 has one or more cameras. The cameras are arranged in positions where they can capture an image of the subject of multimodal biometric authentication. The image acquisition unit 26 acquires a facial image generated by the camera capturing an image of the subject's face. The image acquisition unit 26 acquires an eye image generated by the camera capturing an image of the subject's eyes. The image acquisition unit 26 may acquire a right-eye image including the subject's right eye and a left-eye image including the subject's left eye. The image acquisition unit 26 may also have a visible light camera for capturing an image of the subject's face and a near-infrared camera for capturing an image of the subject's eyes (particularly, the irises).

[0025] The arithmetic device 21 may have the multimodal authentication unit 211, the re-registration determination unit 212, and the re-registration unit 213 as logically realized functional blocks or as physically realized processing circuits. At least one of the multimodal authentication unit 211, the re-registration determination unit 212, and the re-registration unit 213 may be realized in a format in which a logical functional block and a physical processing circuit (i.e., hardware) are mixed. When at least a portion of the multimodal authentication unit 211, the re-registration determination unit 212, and the re-registration unit 213 are functional blocks, at least a portion of the multimodal authentication unit 211, the re-registration determination unit 212, and the re-registration unit 213 may be realized by the arithmetic device 21 executing a predetermined computer program.

[0026] The arithmetic device 21 may acquire (in other words, read) the predetermined computer program from the storage device 22. The arithmetic device 21 may read the predetermined computer program stored in a computer-readable, non-transitory recording medium using a recording medium reading device (not shown) included in the information processing device 2. The arithmetic device 21 may acquire (in other words, download or read) the predetermined computer program from a device (not shown) external to the information processing device 2 via the communication device 23. Note that the recording medium for recording the predetermined computer program executed by the arithmetic device 21 may be at least one of an optical disk, a magnetic medium, a magneto-optical disk, a semiconductor memory, and any other medium capable of storing a program.

[0027] 3, the multimodal authentication unit 211 includes a face authentication unit 2111, an iris authentication unit 2112, and an integrated authentication unit 2113. That is, the multimodal authentication unit 211 performs face authentication as a first modal and iris authentication as a second modal.

[0028] The face authentication unit 2111 performs face authentication using the face image of the subject acquired by the image acquisition unit 26. The face authentication unit 2111 extracts face-related features from the face image. The face authentication unit 2111 calculates a face matching score by matching the extracted features with face-related features registered in the enrollment data 221. Note that various existing aspects can be applied to face authentication, and detailed description thereof will be omitted.

[0029] The iris authentication unit 2112 performs iris authentication using the eye image of the subject acquired by the image acquisition unit 26. The iris authentication unit 2112 extracts iris-related features from the eye image. The iris authentication unit 2112 calculates an iris matching score by matching the extracted features with iris-related features registered in the enrollment data 221. In this case, the iris authentication unit 2112 may calculate a right iris matching score related to the iris of the right eye and a left iris matching score related to the iris of the left eye. Note that various existing aspects can be applied to iris authentication, and therefore detailed explanations thereof will be omitted.

[0030] The integrated authentication unit 2113 calculates an integrated score based on the face matching score calculated by the face authentication unit 2111 and the iris matching score (specifically, at least one of the right iris matching score and the left iris matching score) calculated by the iris authentication unit 2112. For example, the integrated authentication unit 2113 may calculate the average value of the face matching score and the iris matching score as the integrated score. The integrated authentication unit 2113 may calculate the integrated score using a learning model that outputs an integrated score when the face matching score and the iris matching score are input.

[0031] The multimodal authentication unit 211 determines that authentication is successful when the combined score is equal to or greater than the threshold. On the other hand, the multimodal authentication unit 211 determines that authentication is unsuccessful when the combined score is less than the threshold. The multimodal authentication unit 211 may control the output device 25 so that the authentication result (specifically, either authentication success or authentication failure) is presented to the subject.

[0032] If it is determined that the authentication is successful, the multimodal authentication unit 211 associates the matching ID (i.e., information equivalent to identification information indicating the person specified by authentication) with the current authentication result (i.e., the face matching score, iris authentication score, and integrated score), and registers them in the matching history data 222. The multimodal authentication unit 211 associates the matching ID with the current authentication result, and outputs them to the re-registration determination unit 212.

[0033] Based on the matching ID output from the multimodal authentication unit 211, the re-registration determination unit 212 acquires past matching results (i.e., face matching score, iris matching score, and integrated score) associated with the matching ID from the matching history data 222. The re-registration determination unit 212 compares the current matching result with the past matching results. For example, the re-registration determination unit 212 determines whether one of the face matching score, right iris matching score, and left iris matching score is lower than the remaining matching score of the face matching score, right iris matching score, and left iris matching score.

[0034] If it is determined that the one matching score is lower than the remaining matching scores, the re-registration determination unit 212 outputs re-registration information including information indicating a physical feature related to the one matching score (e.g., face, one of the right iris and the left iris) and information indicating that re-registration is necessary to the re-registration unit 213. If it is determined that the one matching score is not lower than the remaining matching scores, the re-registration determination unit 212 does not need to perform further processing.

[0035] When determining whether the one matching score is lower than the remaining matching scores, the re-registration determination unit 212 may determine whether the quality of the image (i.e., the face image and the eye image) used for the current authentication satisfies a predetermined quality. The image quality may include at least one of the degree of blur, the degree of shake, contrast, brightness, and resolution.

[0036] The re-registration unit 213 controls the output device 25 so that information prompting the subject to re-registration is presented to the subject based on the re-registration information output from the re-registration determination unit 212. If the subject agrees to re-registration (for example, if the subject indicates his / her intention to agree to re-registration via the input device 24), the re-registration unit 213 re-registers, in the enrollment data, the feature amount corresponding to the physical feature related to the one matching score included in the re-registration information. Note that re-registration is a concept that includes both replacing a feature amount already registered in the enrollment data 221 and adding a feature amount to the enrollment data 221.

[0037] The re-registration unit 213 may extract features to be re-registered in the enrollment data 221 based on the image (i.e., at least one of a face image and an eye image) used in the current authentication by the multimodal authentication unit 211. Alternatively, if the subject agrees to re-registration, the image acquisition unit 26 may acquire a new image of the subject (i.e., at least one of a face image and an eye image). The re-registration unit 213 may extract features to be re-registered in the enrollment data 221 based on the new image.

[0038] The operation of the information processing device 2 will be further described with reference to the flowchart of Fig. 4. In Fig. 4, the face authentication unit 2111 of the multimodal authentication unit 211 calculates a face matching score (step S101). In parallel with or before or after the processing of step S101, the iris authentication unit 2112 of the multimodal authentication unit 211 calculates an iris matching score (step S102). Thereafter, the integrated authentication unit 2113 of the multimodal authentication unit 211 calculates an integrated score based on the face matching score and the iris matching score (step S103).

[0039] The multimodal authentication unit 211 determines whether the combined score is equal to or greater than a threshold (step S104). If it is determined in the process of step S104 that the combined score is less than the threshold (step S104: No), the operation shown in Fig. 4 is terminated. If it is determined in the process of step S104 that the combined score is equal to or greater than the threshold (step S104: Yes), the multimodal authentication unit 211 associates the matching ID (i.e., information corresponding to identification information indicating the person identified by authentication) with the current authentication result (i.e., face matching score, iris authentication score, and combined score), and registers them in the matching history data 222 (step S105).

[0040] The re-registration determination unit 212 determines whether one of the face matching score, right iris matching score, and left iris matching score is lower than the remaining matching score of the face matching score, right iris matching score, and left iris matching score (step S106). If it is determined in the processing of step S106 that the one matching score is not lower than the remaining matching score (step S106: No), the operation shown in FIG. 4 is terminated.

[0041] If it is determined in the process of step S106 that the one matching score is lower than the remaining matching scores (step S106: Yes), the re-registration unit 213 controls the output device 25 so that information prompting the subject to re-register (for example, a prompting screen prompting re-registration) is presented to the subject (step S107). The re-registration unit 213 determines whether the subject has agreed to re-registration (step S108). If it is determined in the process of step S108 that the subject does not agree to re-registration (step S108: No), the operation shown in FIG. 4 is terminated.

[0042] If it is determined in the process of step S108 that the subject has agreed to re-registration (step S108: Yes), the re-registration unit 213 acquires an image for extracting features to be re-registered (step S109). The re-registration unit 213 extracts features based on the image acquired in the process of step S109 and re-registers the extracted features in the enrollment data 221 (step S110). Note that the image acquired in the process of step S109 may be the image used in the current authentication by the multimodal authentication unit 211, or may be an image newly acquired by the image acquisition unit 26.

[0043] (Technical effect) According to the information processing device 2, the feature quantities related to the physical features corresponding to the deteriorated matching scores among the multiple matching scores are re-registered in the registration data 221, so that high authentication accuracy can be maintained.

[0044] (Modification) In the second embodiment described above, the enrollment data 221 and the matching history data 222 are stored in the storage device 22 of the information processing device 2. At least one of the enrollment data 221 and the matching history data 222 may be stored in a device (e.g., a cloud server) different from the information processing device 2.

[0045] The re-registration determination unit 212 may determine whether re-registration is necessary using the current authentication result and multiple past authentication results. In this case, the re-registration determination unit 212 may determine that re-registration is necessary if the matching score (e.g., at least one of the face matching score, right iris matching score, and left iris matching score) of a certain session has been lower than the matching score of the immediately previous session for multiple consecutive sessions (in other words, if a downward trend in the matching score is observed). Alternatively, the re-registration determination unit 212 may determine that re-registration is necessary if, in the most recent predetermined number of matching history sessions, the rate at which the matching score is lower than the average of the previous matching scores exceeds a predetermined rate. Alternatively, the re-registration determination unit 212 may determine that re-registration of the face image used in face authentication (i.e., the face image that failed authentication) is necessary if the face matching score is below the face matching threshold (i.e., face authentication has failed) and the iris matching score is above the iris matching threshold (i.e., iris authentication has succeeded). Alternatively, conversely, if the iris matching score is below the iris matching threshold (i.e., authentication fails in iris authentication) and the face matching score exceeds the face matching threshold (i.e., authentication is successful in face authentication), the re-registration determination unit 212 may determine that re-registration of the iris image used in iris authentication (i.e., the iris image that failed authentication) is necessary.

[0046] The time-series change trend of each matching score (e.g., face matching score, right iris matching score, and left iris matching score) for each of multiple authentication IDs may be registered in the matching history data 222. For example, when the time-series change trend of one of the face matching score, right iris matching score, and left iris matching score shows a downward trend regardless of the authentication ID, the re-registration determination unit 212 may issue an alert indicating that there is a problem with the camera of the image acquisition unit 26, or information urging maintenance of the device.

[0047] In the second embodiment described above, multimodal biometric authentication including face authentication and iris authentication is performed. However, the multimodal authentication unit 211 may perform retina authentication, eye vein authentication, ear authentication, fingerprint authentication, and speaker authentication instead of or in addition to face authentication and iris authentication.

[0048] Third Embodiment A third embodiment of an information processing device, an information processing method, and a recording medium will be described with reference to Figures 5 and 6. Below, the third embodiment of an information processing device, an information processing method, and a recording medium will be described using an information processing device 3. Note that, with regard to the third embodiment, descriptions that overlap with the description of the second embodiment will be omitted as appropriate.

[0049] 5 , the information processing device 3 includes a calculation device 21, a storage device 22, a communication device 23, an input device 24, an output device 25, and an image acquisition unit 26. The calculation device 21 may include a multimodal authentication unit 211, a re-registration determination unit 212, and a spoofing determination unit 214 as logically realized functional blocks or as physically realized processing circuits. At least one of the multimodal authentication unit 211, the re-registration determination unit 212, and the spoofing determination unit 214 may be realized in a form that combines logical functional blocks and physical processing circuits (i.e., hardware). When at least some of the multimodal authentication unit 211, the re-registration determination unit 212, and the spoofing determination unit 214 are functional blocks, at least some of the multimodal authentication unit 211, the re-registration determination unit 212, and the spoofing determination unit 214 may be realized by the calculation device 21 executing a predetermined computer program.

[0050] The information processing device 3 will be further described with reference to the flowchart of Fig. 6. In the process of step S106 of Fig. 6, if it is determined that one of the face matching score, right iris matching score, and left iris matching score is lower than the remaining face matching score, right iris matching score, and left iris matching score (step S106: Yes), the re-registration determination unit 212 determines the quality of the image associated with the one matching score among the images used in the current authentication by the multimodal authentication unit 211 (step S201). Note that the image quality may include at least one of the degree of blur, degree of shake, contrast, brightness, and resolution.

[0051] The re-registration determination unit 212 determines whether the image quality satisfies a predetermined quality (step S202). If it is determined in step S202 that the image quality does not satisfy the predetermined quality (step S202: No), the operation shown in FIG. 6 is terminated. If it is determined in step S202 that the image quality satisfies the predetermined quality (step S202: Yes), the spoofing determination unit 214 performs spoofing determination on the image whose quality was determined in step S201 (step S203). That is, the spoofing determination unit 214 determines whether a person included in the image is impersonating a registrant. The spoofing determination unit 214 may perform spoofing determination on both the face image and the iris image, or may perform spoofing determination on only one of the face image and the iris image. The spoofing determination unit 214 may perform spoofing determination on the iris matching score if the iris matching score exceeds the iris matching threshold and the face matching score is below the face matching threshold by a predetermined range or more. Alternatively, conversely, when the face matching score exceeds the face matching threshold and the iris matching score is lower than the iris matching threshold by a predetermined range or more, the spoofing determination unit 214 may perform spoofing determination. Note that various existing aspects can be applied to spoofing determination, and therefore detailed description thereof will be omitted.

[0052] The spoofing determination unit 214 determines whether or not there is spoofing based on the result of the spoofing determination in the processing of step S203 (step S204). If it is determined that there is spoofing in the processing of step S204 (step S204: No), the operation shown in FIG. 6 is terminated. If it is determined that there is no spoofing in the processing of step S204 (step S204: Yes), the feature extracted from the image (e.g., a facial image) whose quality was determined in the processing of step S201 is re-registered in the enrollment data 221 (step S110). Note that the feature re-registered in the enrollment data 221 may be the feature extracted by the multimodal authentication unit 211 in the current authentication. The feature re-registered in the enrollment data 221 may be extracted, for example, by the re-registration determination unit 212. Note that if the iris matching score exceeds the iris matching threshold and the face matching score is below the face matching threshold by a predetermined range (i.e., if the difference between the face matching score and the face matching threshold is within a predetermined range), the spoofing determination unit 214 does not need to perform spoofing determination. In this case, the feature amount related to the face image used for face authentication by the multimodal authentication unit 211 may be re-registered in the enrollment data 221.

[0053] (Technical Effect) The information processing device 3 differs from the information processing device 2 in the second embodiment described above in that it does not have the re-registration unit 213. As a result, the information processing device 3 does not present information prompting the subject to re-registration. As a result, the information processing device 3 can shorten the processing time required for re-registration compared to the information processing device 2 in the second embodiment described above. According to the information processing device 3, similar to the information processing device 2 in the second embodiment described above, feature amounts related to physical features corresponding to deteriorated matching scores among multiple matching scores are re-registered in the enrollment data 221, so that high authentication accuracy can be maintained.

[0054] <Fourth embodiment> A fourth embodiment of an information processing device, an information processing method, and a recording medium will be described with reference to Figures 7 and 8. Below, the fourth embodiment of an information processing device, an information processing method, and a recording medium will be described using an information processing device 4. Note that, with regard to the fourth embodiment, descriptions that overlap with the description of the second embodiment will be omitted as appropriate.

[0055] 7, the information processing device 4 includes a calculation device 21, a storage device 22, a communication device 23, an input device 24, an output device 25, and an image acquisition unit 26. The calculation device 21 may include a multimodal authentication unit 211, a re-registration determination unit 212, a re-registration unit 213, and an acquisition condition determination unit 215 as logically realized functional blocks or as physically realized processing circuits. Note that at least one of the multimodal authentication unit 211, the re-registration determination unit 212, the re-registration unit 213, and the acquisition condition determination unit 215 may be realized in a format in which a logical functional block and a physical processing circuit (i.e., hardware) are mixed. If at least a portion of the multimodal authentication unit 211, the re-registration determination unit 212, the re-registration unit 213, and the acquisition condition determination unit 215 are functional blocks, at least a portion of the multimodal authentication unit 211, the re-registration determination unit 212, the re-registration unit 213, and the acquisition condition determination unit 215 may be realized by the calculation device 21 executing a predetermined computer program.

[0056] 8 , the acquisition condition determination unit 215 has an environmental condition detection unit 2151, an attachment condition detection unit 2152, a photographing subject condition detection unit 2153, and a condition difference determination unit 2154. The acquisition condition determination unit 215 determines, for at least a part of an image acquired by the image acquisition unit 26, the acquisition conditions under which the image was acquired. In the information processing device 4, the image acquired by the image acquisition unit 26 is input to the multimodal authentication unit 211 and also to the acquisition condition determination unit 215. In the information processing device 4, authentication of the subject by the multimodal authentication unit 211 and determination of the acquisition conditions by the acquisition condition determination unit 215 are performed in parallel.

[0057] Specifically, the environmental condition detection unit 2151 detects environmental conditions such as time, brightness, and weather. The environmental condition detection unit 2151 may detect time-related conditions based on, for example, a timestamp attached to an image. The environmental condition detection unit 2151 may detect brightness-related conditions based on, for example, an average brightness value of the image. The environmental condition detection unit 2151 may detect weather-related conditions by, for example, acquiring weather information from a device different from the information processing device 4.

[0058] The accessory condition detection unit 2152 detects conditions related to the accessories of the subject included in the image. Examples of accessories include glasses, a mask, and goggles. The accessory condition detection unit 2152 may detect the accessory conditions by detecting the accessory using existing technology. If no accessory is detected, the accessory condition detection unit 2152 may output a condition indicating that no accessory is present as the accessory condition.

[0059] The photographing subject condition detection unit 2153 detects conditions related to the subject included in the image. Examples of the conditions related to the subject include physique (for example, roundness of the face), whether or not makeup is worn, and posture (for example, at least one of the face direction and the gaze direction). The photographing subject condition detection unit 2153 may detect the conditions related to the subject by detecting the physique and the like of the subject using existing technology.

[0060] Here, the feature amounts registered in the registration data 221 are associated with the acquisition conditions under which the image from which the feature amounts were extracted was acquired. Information indicating the acquisition conditions associated with the registered feature amounts is referred to as registration condition information. If authentication by the multimodal authentication unit 211 is successful (i.e., if the subject included in the image input to the acquisition condition determination unit 215 is identified), the condition difference determination unit 2154 determines a difference between the acquisition conditions of the currently input image (i.e., the conditions detected by each of the environmental condition detection unit 2151, the attachment detection unit 2152, and the photographing subject condition detection unit 2153) and the registration condition information associated with the authentication ID of the subject included in the image input to the acquisition condition determination unit 215.

[0061] If the acquisition conditions of the currently input image and the acquisition conditions indicated by the registered condition information do not differ by a predetermined amount or more, the condition difference determination unit 2154 outputs acquisition condition determination information indicating that the acquisition conditions are registered to the re-registration determination unit 212. If the acquisition conditions of the currently input image and the acquisition conditions indicated by the registered condition information differ by a predetermined amount or more, the condition difference determination unit 2154 outputs acquisition condition determination information indicating that the acquisition conditions are unregistered to the re-registration determination unit 212.

[0062] When the acquisition condition determination unit 215 outputs acquisition condition determination information indicating that the acquisition condition is not yet registered, the re-registration determination unit 212 may output information indicating that additional registration is required to the re-registration unit 213 as information indicating that re-registration is required. When the acquisition condition determination unit 215 outputs acquisition condition determination information indicating that the acquisition condition is already registered, the re-registration determination unit 212 acquires, based on the matching ID output from the multimodal authentication unit 211, past matching results (i.e., face matching score, iris matching score, and integrated score) associated with the matching ID from the matching history data 222. The re-registration determination unit 212 compares the current matching result with the past matching results. For example, the re-registration determination unit 212 determines whether one of the face matching score, right iris matching score, and left iris matching score is lower than the remaining matching score of the face matching score, right iris matching score, and left iris matching score.

[0063] If it is determined that the one matching score is lower than the remaining matching scores, the re-registration determination unit 212 outputs re-registration information to the re-registration unit 213, the re-registration information including information indicating a physical feature related to the one matching score (e.g., one of the face, right iris, and left iris) and information indicating that replacement is required as information indicating that re-registration is required. Here, the feature amounts registered in the enrollment data 221 may be registered for multiple acquisition conditions. In other words, the enrollment data 221 may register multiple feature amounts corresponding to multiple acquisition conditions for a certain authentication ID. The re-registration determination unit 212 may output the re-registration information including information indicating that replacement is required to the re-registration unit 213 so that the number of feature amounts for each of the multiple acquisition conditions (i.e., the amount of registered information) is maintained.

[0064] (Technical Effect) According to the information processing device 4, when a plurality of feature amounts corresponding to a plurality of acquisition conditions are registered for a certain authentication ID, it is possible to appropriately determine whether or not re-registration (i.e., additional registration or replacement) is necessary. According to the information processing device 4, similar to the information processing device 2 in the second embodiment described above, it is possible to maintain a high level of authentication accuracy.

[0065] <Supplementary Notes> The following supplementary notes are further disclosed regarding the above-described embodiment.

[0066] (Supplementary Note 1) An information processing device comprising: an authentication means for authenticating a target using first biometric information in a first modal acquired from the target and second biometric information in a second modal acquired from the target; and an output means for outputting information prompting a change of registration information for at least one of the first biometric information and the second biometric information based on past authentication results.

[0067] (Supplementary Note 2) The information processing device according to Supplementary Note 1, further comprising: a change unit that changes the registration information based on at least one of the first biometric information and the second biometric information that have successfully authenticated the target.

[0068] (Supplementary Note 3) The information processing device described in Supplementary Note 1 or 2, wherein the past authentication results include a first authentication score related to authentication using the first biometric information and a second authentication score related to authentication using the second biometric information, and the output means outputs information prompting a change to the registered information for the first biometric information when a downward trend is observed in the first authentication score, and outputs information prompting a change to the registered information for the second biometric information when a downward trend is observed in the second authentication score.

[0069] (Supplementary Note 4) An information processing device according to any one of Supplementary Notes 1 to 3, further comprising an acquisition means for acquiring conditions related to authentication, wherein the conditions acquired by the acquisition means are associated with an authentication result, and wherein the output means outputs information prompting a change of registration information for at least one of the first biometric information and the second biometric information when the conditions acquired by the acquisition means at the time of this authentication differ by a predetermined amount or more from the conditions associated with the past authentication result.

[0070] (Supplementary Note 5) The information processing device according to Supplementary Note 4, wherein the authentication conditions include at least one of an environmental condition related to a lighting environment, an attachment condition related to an attachment of the subject, and an appearance condition related to an appearance of the subject.

[0071] (Supplementary Note 6) The information processing device according to any one of Supplementary Notes 1 to 5, wherein the output means outputs information urging device maintenance when a declining trend in authentication scores is observed for a predetermined number of targets or more in the past authentication results.

[0072] (Supplementary Note 7) The information processing device according to any one of Supplementary Notes 1 to 6, wherein the registration information is registered for each of a plurality of conditions related to authentication, and when the registration information is changed, the registration information is changed so that the amount of registration information for each of the plurality of conditions is maintained.

[0073] (Supplementary Note 8) The information processing device described in any one of Supplementary Notes 1 to 7, further comprising a change means for re-registering, as a registered image of a target identified in authentication using the second biometric information, a registered image for the first biometric information that failed to be authenticated using the first biometric information, when authentication using the first biometric information fails and authentication using the second biometric information is successful.

[0074] (Supplementary Note 9) The information processing device described in Supplementary Note 8, wherein the change means registers an image for authentication using the first biometric information used in the authentication using the first biometric information when the matching score for authentication using the second biometric information exceeds a first threshold and the matching score for authentication using the first biometric information falls below a second threshold within a predetermined range.

[0075] (Supplementary Note 10) The information processing device according to Supplementary Note 8 or 9, further comprising a determination means for determining impersonation when a matching score related to authentication using the second biometric information exceeds a first threshold and a matching score related to authentication using the first biometric information falls below a second threshold by a predetermined range or more.

[0076] (Supplementary Note 11) The information processing device according to Supplementary Note 10, wherein the change unit registers an image used in authentication using the first biometric information when the determination unit determines that the authentication is not an impersonation.

[0077] (Supplementary Note 12) An information processing method comprising: authenticating a target using first biometric information in a first modal acquired from the target; and second biometric information in a second modal acquired from the target; and outputting information prompting a change of registration information for at least one of the first biometric information and the second biometric information based on past authentication results.

[0078] (Supplementary Note 13) A recording medium having recorded thereon a computer program for causing a computer to execute an information processing method, the method comprising: authenticating a target using first biometric information in a first modal acquired from the target and second biometric information in a second modal acquired from the target; and outputting information prompting a change of registration information for at least one of the first biometric information and the second biometric information based on past authentication results.

[0079] This disclosure is not limited to the above-described embodiments, but may be modified as appropriate within the scope of the claims and the gist or idea of ​​the invention as can be read from the entire specification, and information processing devices, information processing methods, and recording media that involve such modifications are also included in the technical scope of this disclosure.

[0080] 1, 2, 3, 4 Information processing device 11 Authentication unit 12 Output unit 21 Arithmetic unit 211 Multimodal authentication unit 212 Re-registration determination unit 213 Re-registration unit 214 Spoofing determination unit 215 Acquisition condition determination unit

Claims

1. an authentication means for authenticating a target using first biometric information in a first modal acquired from the target and second biometric information in a second modal acquired from the target; an output means for outputting information prompting a user to change registration information for at least one of the first biometric information and the second biometric information based on a past authentication result; An information processing device comprising:

2. a change unit that changes the registration information based on at least one of the first biometric information and the second biometric information that have been successfully authenticated; The information processing device according to claim 1 .

3. the past authentication result includes a first authentication score related to authentication using the first biometric information and a second authentication score related to authentication using the second biometric information; The output means outputs information prompting a change of registered information about the first biometric information when a downward trend is observed in the first authentication score, and outputs information prompting a change of registered information about the second biometric information when a downward trend is observed in the second authentication score. The information processing device according to claim 1 .

4. Equipped with an acquisition means for acquiring conditions related to certification, The condition acquired by the acquisition means is associated with an authentication result; When the condition acquired by the acquisition means at the time of the current authentication differs from the condition associated with the past authentication result by a predetermined amount or more, the output means outputs information prompting the user to change the registered information for at least one of the first biometric information and the second biometric information. The information processing device according to claim 1 .

5. The output means outputs information urging device maintenance when a declining trend in authentication scores is observed for a predetermined number of subjects or more in the past authentication results. The information processing device according to claim 1 .

6. the registration information is registered for each of a plurality of conditions related to authentication, When the registration information is changed, the registration information is changed so that the amount of registration information for each of the plurality of conditions is maintained. The information processing device according to claim 1 .

7. and a change unit that, when authentication using the first biometric information fails and authentication using the second biometric information is successful, re-registers a registered image of the first biometric information that failed to be authenticated using the first biometric information as a registered image of a target identified in authentication using the second biometric information. The information processing device according to claim 1 .

8. The change means registers an image for authentication using the first biometric information that was used in the authentication using the first biometric information when the matching score for authentication using the second biometric information exceeds a first threshold and the matching score for authentication using the first biometric information falls below a second threshold within a predetermined range. The information processing device according to claim 7 .

9. authenticating the target using first biometric information in a first modal acquired from the target and second biometric information in a second modal acquired from the target; outputting information prompting a user to change registration information for at least one of the first biometric information and the second biometric information based on a past authentication result; Information processing methods.

10. On the computer, authenticating the target using first biometric information in a first modal acquired from the target and second biometric information in a second modal acquired from the target; outputting information prompting a user to change registration information for at least one of the first biometric information and the second biometric information based on a past authentication result; A recording medium on which a computer program for executing an information processing method is recorded.