Information processing device, information processing system, information processing method, and recording medium

Abstract

This information processing device comprises: an acquisition means for acquiring a plurality of collation scores that are calculated in biometric authentication performed by using biometric information of a subject, and that respectively correspond to a plurality of parts of the subject; and a presentation means for presenting the plurality of collation scores when a first collation score and a second collation score included in the plurality of collation scores are separated from each other.

Description

Information processing device, information processing system, information processing method, and recording medium

[0001] The present disclosure relates to the technical fields of an information processing device, an information processing system, an information processing method, and a recording medium.

[0002] One such device proposed is one that divides a facial image into three parts, top, middle, and bottom, performs authentication for each part, and determines that facial authentication is successful if authentication is successful for all parts (see Patent Document 1).

[0003] Japanese Patent Application Laid-Open No. 2019-168929

[0004] An object of this disclosure is to provide an information processing device, an information processing system, an information processing method, and a recording medium that aim to improve the technology related to the above-mentioned prior art documents.

[0005] One aspect of the information processing device includes an acquisition means for acquiring a plurality of matching scores corresponding to a plurality of body parts of a subject, the matching scores being calculated in biometric authentication performed using the subject's biometric information, and a presentation means for presenting the plurality of matching scores when a first matching score and a second matching score included in the plurality of matching scores diverge.

[0006] One aspect of the information processing system includes a first acquisition means for acquiring biometric information of a subject, an authentication means for performing biometric authentication of the subject using the biometric information, a second acquisition means for acquiring a plurality of matching scores calculated in the biometric authentication, each corresponding to a plurality of body parts of the subject, and a presentation means for presenting the plurality of matching scores when a first matching score and a second matching score included in the plurality of matching scores diverge.

[0007] One aspect of the information processing method obtains multiple matching scores corresponding to multiple body parts of a subject, calculated in biometric authentication performed using the subject's biometric information, and presents the multiple matching scores if a first matching score and a second matching score included in the multiple matching scores diverge.

[0008] Another aspect of the information processing method involves acquiring biometric information of a subject, performing biometric authentication of the subject using the biometric information, obtaining multiple matching scores calculated in the biometric authentication and corresponding to multiple body parts of the subject, and presenting the multiple matching scores if a first matching score and a second matching score included in the multiple matching scores diverge.

[0009] One aspect of the recording medium has a computer program recorded on it for causing a computer to execute an information processing method that obtains multiple matching scores corresponding to multiple body parts of a subject, calculated in biometric authentication performed using the subject's biometric information, and presents the multiple matching scores when a first matching score and a second matching score included in the multiple matching scores diverge.

[0010] FIG. 1 is a block diagram showing a configuration of an example of an information processing device according to an embodiment. FIG. 2 is a flowchart showing an example of an operation of the information processing device according to an embodiment. FIG. 3 is a block diagram showing a configuration of an example of an information processing system according to an embodiment. FIG. 4 is a diagram showing an example of a displayed image. FIG. 5 is a diagram showing another example of a displayed image. FIG. 6 is a block diagram showing a configuration of another example of an information processing device according to an embodiment. FIG. 7 is a diagram showing an example of a gate. FIG. 8 is a flowchart showing another example of an operation of the information processing device according to an embodiment.

[0011] First Embodiment A first embodiment of an information processing device, an information processing system, an information processing method, and a recording medium will be described with reference to Fig. 1 and Fig. 2. Hereinafter, the first embodiment of an information processing device, an information processing system, an information processing method, and a recording medium will be described using an information processing device 10.

[0012] 1, an information processing device 10 includes an acquisition unit 11 and a presentation unit 12. The acquisition unit 11 acquires a plurality of matching scores corresponding to a plurality of body parts of a subject, respectively, calculated in biometric authentication performed using biometric information of the subject.

[0013] The "subject" is a subject of biometric authentication. Therefore, the "subject" may also be referred to as a person to be authenticated. The matching score may mean a value indicating the degree of match between the biometric information of the subject and pre-registered biometric information. The matching score may also mean a value indicating the degree of match between a feature extracted from the biometric information of the subject and a feature registered in advance. The matching score may be expressed as a value within a range from 0.0 to 1.0, for example.

[0014] Biometric information is information relating to the physical characteristics of a subject. Examples of biometric information include at least one of a facial image including the subject's face, an iris image including the subject's iris, a fingerprint pattern of the subject, a palm print pattern of the subject, audio information including the subject's voice, and sound information including the subject's otoacoustic emissions. Examples of biometric authentication include at least one of face authentication, iris authentication, fingerprint authentication, palm print authentication, voice print authentication, and ear acoustic authentication.

[0015] The "plurality of matching scores corresponding to a plurality of body parts of the subject" may be a plurality of matching scores corresponding to a plurality of different authentication methods, or may be a plurality of matching scores for the same authentication method. The plurality of matching scores may include, for example, a matching score related to face authentication and a matching score related to iris authentication. The plurality of matching scores may include, for example, a matching score related to iris authentication of the left eye and a matching score related to iris authentication of the right eye.

[0016] The matching score may be calculated by the information processing device 10, or may be calculated by a device different from the information processing device 10. In other words, the information processing device 10 may have an authentication function for biometric authentication, or may not have an authentication function. If the information processing device 10 does not have an authentication function, the information processing device 10 may constitute a part of an authentication system that performs biometric authentication of a target. The information processing device 10 may not constitute a part of the authentication system. If the information processing device 10 constitutes a part of an authentication system, the authentication system may be referred to as an information processing system because the authentication system includes the information processing device 10.

[0017] The presentation unit 12 presents the multiple matching scores when there is a discrepancy between the first matching score and the second matching score included in the multiple matching scores acquired by the acquisition unit 11. The multiple matching scores may be presented as visual information or auditory information. The presentation unit 12 is not limited to presenting numerical values ​​indicating the matching scores, and may present, for example, at least one of characters, symbols, figures, colors, and sounds according to the matching scores.

[0018] Here, in biometric authentication, if the matching score is equal to or greater than a predetermined threshold, it is determined that the subject (i.e., the person to be authenticated) is a person who has been registered in advance (i.e., a registrant). For example, in the case of multimodal biometric authentication in which multiple modals are used in combination, a matching score is calculated for each modal. In multimodal biometric authentication, if all of the multiple matching scores are equal to or greater than a predetermined threshold, it may be determined that the subject is a registrant.

[0019] When the target is a registered user, it is expected that all of the multiple matching scores will be equal to or greater than a predetermined threshold. In other words, it is expected that the multiple matching scores will be close to each other. However, due to at least one of disturbance and spoofing, a situation may arise in which one matching score is equal to or greater than the predetermined threshold, while another matching score is less than the predetermined threshold. In other words, one matching score may diverge from the other matching scores.

[0020] "Disturbance" may refer to an external factor that causes a decrease in the matching score. Disturbances may include, for example, factors related to light and factors related to the positional relationship between the object and the camera. Examples of factors related to light include illuminance, contrast, and backlighting. Examples of factors related to the positional relationship between the object and the camera include the shooting angle and obstructions. "Impersonation" may refer to one person pretending to be another person. Note that when one person pretends to be another person (i.e., when performing impersonation), it is difficult to impersonate all multiple biometric elements at the same time. For this reason, one matching score may diverge from other matching scores.

[0021] For example, in multimodal biometric authentication of face recognition and iris recognition, the following situation may occur: For example, a situation may occur in which the matching score related to face recognition is equal to or greater than a predetermined threshold, but the matching score related to iris recognition is less than the predetermined threshold. For example, a situation may occur in which the matching score related to face recognition and the matching score related to iris recognition of the right eye are equal to or greater than a predetermined threshold, but the matching score related to iris recognition of the left eye is less than the predetermined threshold.

[0022] "When the first matching score and the second matching score deviate" may include when the situation deviates from what is originally expected. As described above, in multimodal biometric authentication, when the subject is a registered person, all of the multiple matching scores are expected to be equal to or greater than a predetermined threshold. When the subject is not a registered person, all of the multiple matching scores are expected to be less than the predetermined threshold. Therefore, a situation in which the first matching score among the multiple matching scores is equal to or greater than a predetermined threshold and the second matching score among the multiple matching scores is less than the predetermined threshold can be said to be a situation that deviates from what is originally expected.

[0023] The phrase "the first matching score and the second matching score are different" may include a case where the difference between the first matching score and the second matching score is equal to or greater than a predetermined value. The predetermined value may be a predetermined fixed value or a variable value depending on some parameter. The predetermined value may be set according to the specifications of an engine related to multimodal biometric authentication (e.g., an authentication system, a computer program for biometric authentication). For example, the predetermined value may be set based on the distribution of multiple matching scores calculated for registered subjects in an undisturbed environment. The predetermined value may vary depending on the number of times each subject has been authenticated in the past. For example, if the number of times a subject has been authenticated is relatively small, the predetermined value may be relatively small. Security guards often do not remember the faces of subjects who have been authenticated relatively infrequently. For such subjects, it is preferable for security guards to confirm their identity even if the difference between the first matching score and the second matching score is relatively small. For example, if the number of times a subject has been authenticated is relatively large, the predetermined value may be relatively large. The faces of subjects who have been authenticated relatively frequently are often widely known to security guards. For such a target, it is preferable that the security guard only checks if the difference between the first matching score and the second matching score is relatively large. In other words, for such a target, it is preferable that the security guard does not stop the target if the difference between the first matching score and the second matching score is relatively small. Note that the predetermined value may vary depending on the security guard in charge, as well as the number of times each target has been authenticated in the past. For example, the predetermined value may be smaller the less familiar the target is with the security guard in charge.

[0024] The operation of the information processing device 10 will be further described with reference to the flowchart of Fig. 2. In Fig. 2, the acquisition unit 11 of the information processing device 10 may acquire a plurality of matching scores corresponding to a plurality of body parts of a target (step S101). The presentation unit 12 of the information processing device 10 may determine whether a first matching score and a second matching score included in the plurality of matching scores are different from each other (step S102).

[0025] If it is determined in the process of step S102 that the first matching score and the second matching score are different from each other (step S102: Yes), the presenting unit 12 may present a plurality of matching scores (step S103).If it is determined in the process of step S102 that the first matching score and the second matching score are not different from each other (step S102: No), the operation shown in FIG. 2 is terminated.

[0026] In this way, the information processing device 10 obtains multiple matching scores corresponding to multiple body parts of the subject, calculated in biometric authentication performed using the subject's biometric information, and performs an information processing method in which the multiple matching scores are presented if the first matching score and the second matching score included in the multiple matching scores diverge.

[0027] The information processing device 10 described above may be realized by a computer reading a computer program recorded on a recording medium. In this case, the recording medium may have recorded thereon a computer program for causing the computer to execute an information processing method for obtaining multiple matching scores corresponding to multiple body parts of a subject, the multiple matching scores being calculated in biometric authentication performed using the subject's biometric information, and presenting the multiple matching scores when a first matching score and a second matching score included in the multiple matching scores diverge.

[0028] (Technical Effect) Multimodal biometric authentication is useful for improving security. However, it is extremely difficult to achieve 100% authentication accuracy. For example, in important facilities, based on the assumption that biometric authentication devices may make false recognitions, entry control is often performed by people (e.g., security guards) in addition to identity verification using authentication devices. Examples of important facilities include at least one of government buildings, foreign embassies, defense-related facilities, and nuclear power plants.

[0029] The information processing device 10 is equipped with the presentation unit 12, and thus can cooperate with security guards. The presentation unit 12 presents the multiple matching scores when a first matching score and a second matching score included in the multiple matching scores diverge. For example, the presentation unit 12 may present the multiple matching scores to a security guard at a critical facility when the first matching score and the second matching score diverge. On the other hand, the presentation unit 12 does not need to present the multiple matching scores to the security guard when the first matching score and the second matching score do not diverge.

[0030] In this way, if multiple matching scores are presented only when the first matching score and the second matching score are different, it is expected that the presentation of multiple matching scores will function as a warning to the security guard. As a result, the security guard's attention can be directed to the target. For example, if the target is a person who has repeatedly entered an important facility, the security guard may allow the target to enter even if the first matching score and the second matching score are different. This is because the difference between the first matching score and the second matching score may be caused by an external disturbance. For example, if the target is a person the security guard has never seen before and the first matching score and the second matching score are different, the security guard may stop the target. This is because the target may be attempting to impersonate someone else.

[0031] A relatively high predetermined threshold value provides improved security compared to a relatively low predetermined threshold value. If the range of possible match scores is from 0.0 to 1.0, the relatively high value may be, for example, 0.6, and the relatively low value may be, for example, 0.4.

[0032] For example, when entry control is performed solely by an authentication device related to biometric authentication, the predetermined threshold is often set to a relatively low value to reduce the possibility that entry of a registered person will be denied. In other words, when entry control is performed solely by an authentication device, the predetermined threshold may be set to a low value to prioritize the convenience of the registered person.

[0033] In contrast, when the information processing device 10 and a security guard collaborate to manage entry, the predetermined threshold may be set to a relatively high value. As a result, the false acceptance rate (FAR) is reduced, improving security. If the target is determined to be not a registered user through biometric authentication, the target can be subject to identity verification by a security guard. In other words, because the information processing device 10 and a security guard collaborate to manage entry, if the target is a registered user, even if the target's entry is denied through biometric authentication, the target is permitted entry through identity verification by the security guard.

[0034] In this case, for example, while a strict setting may be made for biometric authentication such that "if all of the multiple matching scores are equal to or greater than the first threshold value of 0.6, the subject is considered to be a registered person," an additional rule may be set such that "if one of the first matching score and the second matching score is equal to or greater than the first threshold value of 0.6, and the other of the first matching score and the second matching score is less than the first threshold value but equal to or greater than the second threshold value of 0.4, the subject is allowed to pass after warning the security guard (i.e., after presenting the multiple matching scores)."

[0035] In this way, the information processing device 10 can cooperate with, for example, security guards at important facilities. Therefore, the information processing device 10 can detect suspicious individuals in cooperation with, for example, security guards.

[0036] Second Embodiment A second embodiment relating to an information processing device, an information processing system, an information processing method, and a recording medium will be described with reference to Figures 3 and 4. Hereinafter, the second embodiment relating to an information processing device, an information processing system, an information processing method, and a recording medium will be described using an information processing system 1 including an information processing device 20. Note that, with regard to the second embodiment, descriptions that overlap with the description of the first embodiment will be omitted as appropriate.

[0037] The information processing system 1 is a system that performs multimodal biometric authentication that combines face authentication and iris authentication as biometric authentication. The information processing system 1 is a system that manages entrance to important facilities in cooperation with security guards. In FIG. 3 , the information processing system 1 includes an information processing device 20 and an authentication device 30. Security guards may use the information processing device 20. The information processing device 20 and the authentication device 30 are configured to be able to communicate with each other. Note that the information processing device 20 and the authentication device 30 may communicate with each other wirelessly or via wired communication.

[0038] The information processing device 20 includes a calculation device 21 , a storage device 22 , a communication device 23 , an input device 24 and an output device 25 .

[0039] The arithmetic device 21 may include, for example, at least one of a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), an FPGA (Field Programmable Gate Array), a TPU (Tensor Processing Unit), and a quantum processor.

[0040] The storage device 22 may include, for example, at least one of a RAM (Random Access Memory), a ROM (Read Only Memory), a hard disk device, a magneto-optical disk device, an SSD (Solid State Drive), and an optical disk array. In other words, the storage device 22 may include a non-transitory recording medium. The storage device 22 is capable of storing desired data. For example, the storage device 22 may temporarily store a computer program executed by the arithmetic device 21. The storage device 22 may temporarily store data that is temporarily used by the arithmetic device 21 when the arithmetic device 21 is executing a computer program.

[0041] The communication device 23 may be capable of communicating with a device (for example, the authentication device 30) external to the information processing device 20. The communication device 23 may perform wired communication or wireless communication.

[0042] The input device 24 is a device capable of accepting information input to the information processing device 20 from outside. The input device 24 may include an operation device (e.g., a keyboard, a mouse, a touch panel, etc.) that can be operated by a user (e.g., a security guard) of the information processing device 20. The input device 24 may include a recording medium reading device that can read information recorded on a recording medium that is detachable from the information processing device 20, such as a USB (Universal Serial Bus) memory. Note that when information is input to the information processing device 20 via the communication device 23 (in other words, when the information processing device 20 acquires information via the communication device 23), the communication device 23 may function as an input device.

[0043] The output device 25 is a device capable of outputting information to the outside of the information processing device 20. The output device 25 may output visual information such as text or images, auditory information such as sound, or tactile information such as vibration, as the information. The output device 25 may include, for example, at least one of a display, a speaker, a printer, and a vibration motor. The output device 25 may be capable of outputting information to a recording medium detachable from the information processing device 20, such as a USB memory. Note that when the information processing device 20 outputs information via the communication device 23, the communication device 23 may function as the output device.

[0044] In this embodiment, the output device 25 has a head-mounted display (HMD) 251 and earphones 252. The arithmetic unit 21, the storage device 22, the communication device 23, and the input device 24 may be housed in a housing of the head-mounted display 251 serving as the output device 25. In other words, the information processing device 20 may constitute at least a part of the head-mounted display 251.

[0045] The head-mounted display 251 may be an immersive head-mounted display or a see-through head-mounted display. The see-through head-mounted display may be a video see-through head-mounted display or an optical see-through head-mounted display (e.g., smart glasses). The head-mounted display 251 may be referred to as a display device.

[0046] The arithmetic device 21 may have the acquisition unit 211 and the presentation unit 212 as logically realized functional blocks or as physically realized processing circuits. At least one of the acquisition unit 211 and the presentation unit 212 may be realized in a form in which a logical functional block and a physical processing circuit (i.e., hardware) are mixed. When at least one of the acquisition unit 211 and the presentation unit 212 is a functional block, at least one of the acquisition unit 211 and the presentation unit 212 may be realized by the arithmetic device 21 executing a predetermined computer program.

[0047] The arithmetic device 21 may acquire (in other words, read) the predetermined computer program from the storage device 22. The arithmetic device 21 may read the predetermined computer program stored in a computer-readable, non-transitory recording medium using a recording medium reading device (not shown) included in the information processing device 20. The arithmetic device 21 may acquire (in other words, download or read) the predetermined computer program from a device (not shown) external to the information processing device 20 via the communication device 23. Note that the recording medium for recording the predetermined computer program executed by the arithmetic device 21 may be at least one of an optical disk, a magnetic medium, a magneto-optical disk, a semiconductor memory, and any other medium capable of storing a program.

[0048] The "acquisition unit 211" and the "presentation unit 212" are components corresponding to the "acquisition unit 11" and the "presentation unit 12" in the first embodiment, respectively.

[0049] The authentication device 30 includes an acquisition unit 31, an authentication unit 32, and cameras CAM1 and CAM2. Camera CAM1 is a camera capable of capturing light in the visible wavelength range (a so-called visible light camera). Camera CAM2 is a camera capable of capturing light in the near-infrared wavelength range (a so-called near-infrared camera). Camera CAM1 may be used to capture a facial image of a target (i.e., a person to be authenticated who is the subject of biometric authentication). Camera CAM2 may be used to capture an iris image of the target.

[0050] The acquisition unit 31 acquires an image output from camera CAM1 (a so-called visible light image) and an image output from camera CAM2 (a so-called near-infrared image). The acquisition unit 31 may acquire a face image including the face of the target output from camera CAM1 by having camera CAM1 capture an image of the target's face. The acquisition unit 31 may acquire an eye image including the eyes of the target output from camera CAM2 by having camera CAM2 capture an image of the target's eyes. Note that since the acquisition unit 31 acquires images, it may also be referred to as an image acquisition unit.

[0051] The authentication unit 32 performs multimodal biometric authentication of the target using the face image and eye image acquired by the acquisition unit 31. Here, the authentication unit 32 may calculate a face matching score by comparing the face image with a pre-registered face image. Alternatively, the authentication unit 32 may calculate a face matching score by comparing feature amounts extracted from the face image with pre-registered feature amounts. The authentication unit 32 may generate an iris image by extracting an area corresponding to the target's iris from the eye image. The authentication unit 32 may calculate a iris matching score by comparing the iris image with a pre-registered iris image. Alternatively, the authentication unit 32 may calculate a iris matching score by comparing feature amounts extracted from the iris image with pre-registered feature amounts.

[0052] The authentication unit 32 may generate an iris image of the left eye by extracting an area corresponding to the iris of the left eye of the subject from the eye image. The authentication unit 32 may generate an iris image of the right eye by extracting an area corresponding to the iris of the right eye of the subject from the eye image. The authentication unit 32 may calculate a matching score for the iris of the left eye by comparing the iris image of the left eye with a pre-registered iris image. Alternatively, the authentication unit 32 may calculate a matching score for the iris of the left eye by comparing a feature extracted from the iris image of the left eye with a pre-registered feature. The authentication unit 32 may calculate a matching score for the iris of the right eye by comparing the iris image of the right eye with a pre-registered iris image. Alternatively, the authentication unit 32 may calculate a matching score for the iris of the right eye by comparing a feature extracted from the iris image of the right eye with a pre-registered feature.

[0053] The authentication unit 32 may compare the matching score for the face with a predetermined threshold. The authentication unit 32 may compare the matching score for the iris with a predetermined threshold. The authentication unit 32 may compare the matching score for the iris of the left eye with a predetermined threshold. Similarly, the authentication unit 32 may compare the matching score for the iris of the right eye with a predetermined threshold. The authentication unit 32 may determine that the subject is a registrant when the matching score for the face is equal to or greater than the predetermined threshold and the matching score for the iris is equal to or greater than the predetermined threshold. The authentication unit 32 may determine that the subject is a registrant when the matching score for the face is equal to or greater than the predetermined threshold, the matching score for the iris of the left eye is equal to or greater than the predetermined threshold, and the matching score for the iris of the right eye is equal to or greater than the predetermined threshold.

[0054] The authentication device 30 may allow the target to pass if the matching score related to the face is equal to or greater than a predetermined threshold and the matching score related to the iris is equal to or greater than a predetermined threshold. Note that the authentication device 30 may allow the target to pass if the matching score related to the face is equal to or greater than a predetermined threshold, the matching score related to the iris of the left eye is equal to or greater than a predetermined threshold, and the matching score related to the iris of the right eye is equal to or greater than a predetermined threshold.

[0055] The authentication device 30 may not allow the target to pass if one of the face matching score and the iris matching score is equal to or greater than a predetermined threshold, and the other of the face matching score and the iris matching score is less than a predetermined threshold. The authentication device 30 may not allow the target to pass if both the face matching score and the iris matching score are less than a predetermined threshold. Note that the authentication device 30 may not allow the target to pass if one or two of the face matching score, the left eye iris matching score, and the right eye iris matching score are equal to or greater than a predetermined threshold, and one or two of the face matching score, the left eye iris matching score, and the right eye iris matching score are less than a predetermined threshold. The authentication device 30 may not allow the target to pass if all of the face matching score, the left eye iris matching score, and the right eye iris matching score are less than a predetermined threshold.

[0056] The authentication device 30 may transmit the matching score related to the face and the matching score related to the iris, or the matching score related to the face, the matching score related to the iris of the left eye, and the matching score related to the iris of the right eye to the information processing device 20.

[0057] The acquisition unit 211 of the information processing device 20 may acquire a matching score related to a face and a matching score related to an iris, or a matching score related to a face, a matching score related to the iris of the left eye, and a matching score related to the iris of the right eye, from the authentication device 30. In other words, the acquisition unit 211 may acquire a matching score related to a face and a matching score related to an iris, or a matching score related to a face, a matching score related to the iris of the left eye, and a matching score related to the iris of the right eye, as the multiple matching scores.

[0058] The presentation unit 212 of the information processing device 20 may present the multiple matching scores to the security guard when a first matching score and a second matching score included in the multiple matching scores diverge. For example, when the acquisition unit 211 acquires a matching score related to a face and a matching score related to an iris, one of the matching score related to the face and the matching score related to the iris corresponds to the first matching score, and the other of the matching score related to the face and the matching score related to the iris corresponds to the second matching score. For example, when the acquisition unit 211 acquires a matching score related to a face, a matching score related to the iris of the left eye, and a matching score related to the iris of the right eye, one of the matching score related to the face, the matching score related to the iris of the left eye, and the matching score related to the iris of the right eye corresponds to the first matching score, and the other of the matching score related to the face, the matching score related to the iris of the left eye, and the matching score related to the iris of the right eye corresponds to the second matching score.

[0059] For example, when the matching score for the face and the matching score for the iris are different from each other, the presenting unit 212 may control the output device 25 so that the image shown in Fig. 4 is displayed on the head-mounted display 251. In other words, the presenting unit 212 may present a plurality of matching scores to the security guard by displaying the image shown in Fig. 4 on the head-mounted display 251.

[0060] The image shown in Fig. 4 includes a target TP, an analog meter 2511 indicating the matching score for the target TP's face, and an analog meter 2512 indicating the matching score for the target TP's iris. In analog meter 2511, the index value of the needle indicates the matching score for the face. Similarly, in analog meter 2512, the index value of the needle indicates the matching score for the iris.

[0061] The matching score may be displayed by an image imitating an LED (Light Emitting Diode) array meter, instead of the analog meters 2511 and 2512, for example.

[0062] 4, analog meters 2511 and 2512 are placed near the target TP. Note that the analog meters 2511 and 2512 do not have to be placed near the target TP. In other words, the analog meters 2511 and 2512 may be displayed in any position.

[0063] 4, an image of the target TP viewed from the front is displayed. However, the head-mounted display 251 may display an image of the target TP as viewed from the perspective of a security guard (i.e., the person wearing the head-mounted display 251). If the head-mounted display 251 is an optical see-through type head-mounted display, only the analog meters 2511 and 2512 may be displayed on the head-mounted display 251.

[0064] (Technical Effect) According to the information processing system 1 of the second embodiment, it is possible to cooperate with, for example, security guards at important facilities. Therefore, according to the information processing system 1, it is possible to detect suspicious individuals in cooperation with, for example, security guards.

[0065] 4 is displayed on the head-mounted display 251, allowing the security guard to intuitively determine whether the matching score is good or bad. Also, as shown in FIG. 4, analog meters 2511 and 2512 are placed near the target TP, allowing the security guard to check the matching score while observing the target TP.

[0066] Third Embodiment A third embodiment relating to an information processing device, an information processing system, an information processing method, and a recording medium will be described with reference to Fig. 5 in addition to Fig. 3. Hereinafter, the third embodiment relating to an information processing device, an information processing system, an information processing method, and a recording medium will be described using an information processing system 1 including an information processing device 20. Note that, with regard to the third embodiment, descriptions that overlap with the descriptions of the first and second embodiments will be omitted as appropriate.

[0067] The authentication device 30 may transmit the matching score for the face and the matching score for the iris, or the matching score for the face, the matching score for the iris of the left eye, and the matching score for the iris of the right eye to the information processing device 20. The authentication device 30 may transmit information indicating whether the matching score for the face is equal to or greater than a predetermined threshold and information indicating whether the matching score for the iris is equal to or greater than a predetermined threshold to the information processing device 20. Alternatively, the authentication device 30 may transmit information indicating whether the matching score for the face is equal to or greater than a predetermined threshold, information indicating whether the matching score for the iris of the left eye is equal to or greater than a predetermined threshold, and information indicating whether the matching score for the iris of the right eye is equal to or greater than a predetermined threshold to the information processing device 20.

[0068] The acquisition unit 211 of the information processing device 20 may acquire a matching score related to a face and a matching score related to an iris, or a matching score related to a face, a matching score related to the iris of the left eye, and a matching score related to the iris of the right eye, from the authentication device 30. In other words, the acquisition unit 211 may acquire a matching score related to a face and a matching score related to an iris, or a matching score related to a face, a matching score related to the iris of the left eye, and a matching score related to the iris of the right eye, as the multiple matching scores.

[0069] For example, if there is a discrepancy between the matching score for the face and the matching score for the iris of the left eye or the right eye, the presenting unit 212 may control the output device 25 so that the image shown in Fig. 5 is displayed on the head-mounted display 251. In other words, the presenting unit 212 may present a plurality of matching scores to the security guard by displaying the image shown in Fig. 5 on the head-mounted display 251. Note that the image shown in Fig. 5 may be an image generated by superimposing frames 2513, 2514, and 2515 on an image of the target TP captured by the camera CAM1.

[0070] 5 includes a target TP, a frame 2513 relating to a matching score for the face of the target TP, a frame 2514 relating to a matching score for the iris of the left eye of the target TP, and a frame 2515 relating to a matching score for the iris of the right eye of the target TP. The display mode of the frame 2513 (e.g., at least one of the type, thickness, and color of the frame line, and at least one of the color and pattern of the area surrounded by the frame line) may change depending on the matching score for the face. The display mode of the frame 2514 may change depending on the matching score for the iris of the left eye. The display mode of the frame 2515 may change depending on the matching score for the iris of the right eye.

[0071] For example, the display mode of frame 2513 may include a display mode when the matching score for the face is equal to or greater than a predetermined threshold and a display mode when the matching score for the face is less than the predetermined threshold. Alternatively, the display mode of frame 2513 may include a display mode when the matching score for the face is in a first range (e.g., 0.0 to 0.4), a display mode when the matching score for the face is in a second range (e.g., 0.4 to 0.6) different from the first range, and a display mode when the matching score for the face is in a third range (e.g., 0.6 to 1.0) different from the first and second ranges.

[0072] For example, the display modes of frame 2514 may include a display mode when the matching score for the left eye iris is equal to or greater than a predetermined threshold, and a display mode when the matching score for the left eye iris is less than the predetermined threshold. Alternatively, the display modes of frame 2514 may include a display mode when the matching score for the left eye iris is in a first range (e.g., 0.0 to 0.4), a display mode when the matching score for the left eye iris is in a second range (e.g., 0.4 to 0.6) different from the first range, and a display mode when the matching score for the left eye iris is in a third range (e.g., 0.6 to 1.0) different from the first and second ranges.

[0073] For example, the display modes of frame 2515 may include a display mode when the matching score for the iris of the right eye is equal to or greater than a predetermined threshold, and a display mode when the matching score for the iris of the right eye is less than the predetermined threshold. Alternatively, the display modes of frame 2515 may include a display mode when the matching score for the iris of the right eye is in a first range (e.g., 0.0 to 0.4), a display mode when the matching score for the iris of the right eye is in a second range (e.g., 0.4 to 0.6) different from the first range, and a display mode when the matching score for the iris of the right eye is in a third range (e.g., 0.6 to 1.0) different from the first and second ranges.

[0074] In this way, the presentation unit 212 may present multiple matching scores to the security guard by changing the display mode of each of the multiple parts of the target TP (here, the face, left eye, and right eye) according to the corresponding matching score.

[0075] (Technical effect) According to the information processing system 1 of the third embodiment, an image such as that shown in FIG. 5 is displayed on the head-mounted display 251, allowing the security guard to intuitively judge whether the matching score is good or bad.

[0076] Fourth Embodiment A fourth embodiment relating to an information processing device, an information processing system, an information processing method, and a recording medium will be described with reference to Figures 3 and 5. Hereinafter, the fourth embodiment relating to an information processing device, an information processing system, an information processing method, and a recording medium will be described using an information processing system 1 including an information processing device 20. Note that, with regard to the fourth embodiment, descriptions that overlap with the descriptions of the first to third embodiments will be omitted as appropriate.

[0077] The acquisition unit 31 of the authentication device 30 may acquire multiple facial images of the target captured at different times from the camera CAM1. The acquisition unit 31 may acquire multiple eye images of the target captured at different times from the camera CAM2.

[0078] The authentication unit 32 performs multimodal biometric authentication of the target using the multiple face images and multiple eye images acquired by the acquisition unit 31. The authentication unit 32 may calculate multiple face-related matching scores based on the multiple face images. The authentication unit 32 may calculate multiple iris-related matching scores based on the multiple eye images. The authentication unit 32 may compare the largest matching score among the multiple face-related matching scores with a predetermined threshold. The authentication unit 32 may compare the largest matching score among the multiple iris-related matching scores with a predetermined threshold. The authentication unit 32 may determine that the target is a registered user when the largest face-related matching score is equal to or greater than the predetermined threshold and the largest iris-related matching score is equal to or greater than the predetermined threshold.

[0079] Alternatively, the authentication unit 32 may calculate multiple matching scores related to the face based on multiple face images. The authentication unit 32 may calculate multiple matching scores related to the left eye iris based on multiple eye images. The authentication unit 32 may calculate multiple matching scores related to the right eye iris based on multiple eye images. The authentication unit 32 may compare the largest matching score among the multiple matching scores related to the face with a predetermined threshold. The authentication unit 32 may compare the largest matching score among the multiple matching scores related to the left eye iris with a predetermined threshold. The authentication unit 32 may compare the largest matching score among the multiple matching scores related to the right eye iris with a predetermined threshold. The authentication unit 32 may determine that the target is a registered user when the largest matching score related to the face is equal to or greater than the predetermined threshold, the largest matching score related to the left eye iris is equal to or greater than the predetermined threshold, and the largest matching score related to the right eye iris is equal to or greater than the predetermined threshold.

[0080] The authentication device 30 may transmit the highest matching score related to the face and the highest matching score related to the iris, or the highest matching score related to the face, the highest matching score related to the left eye iris, and the highest matching score related to the right eye iris to the information processing device 20. Note that the authentication unit 32 may calculate the matching scores as at least a part of the authentication process related to biometric authentication. For example, the authentication unit 32 calculating the matching score related to the face multiple times based on multiple face images and calculating the matching score related to the iris multiple times based on multiple eye images can be said to be performing the authentication process multiple times by the authentication unit 32.

[0081] The acquisition unit 211 of the information processing device 20 may acquire from the authentication device 30 the maximum matching score related to the face and the maximum matching score related to the iris, or the maximum matching score related to the face, the maximum matching score related to the iris of the left eye, and the maximum matching score related to the iris of the right eye.

[0082] For example, if there is a discrepancy between the maximum matching score for the face and the maximum matching score for the iris of the left eye or the right eye, the presentation unit 212 may control the output device 25 so that the image shown in Figure 5 is displayed on the head-mounted display 251.

[0083] The display mode of frame 2513 may change depending on the maximum matching score for the face, the display mode of frame 2514 may change depending on the maximum matching score for the iris of the left eye, and the display mode of frame 2515 may change depending on the maximum matching score for the iris of the right eye.

[0084] (Technical effect) According to the information processing system 1 of the fourth embodiment, as in the third embodiment described above, an image such as that shown in FIG. 5 is displayed on the head-mounted display 251, allowing the security guard to intuitively judge whether the matching score is good or bad.

[0085] Fifth Embodiment A fifth embodiment relating to an information processing device, an information processing system, an information processing method, and a recording medium will be described with reference to Fig. 6 in addition to Fig. 3. Hereinafter, the fifth embodiment relating to an information processing device, an information processing system, an information processing method, and a recording medium will be described using an information processing system 1 including an information processing device 20. Note that, with regard to the fifth embodiment, descriptions that overlap with the descriptions of the first to fourth embodiments will be omitted as appropriate.

[0086] The acquisition unit 211 of the information processing device 20 may acquire an image (e.g., at least one of a face image and an iris image) used to calculate the matching score from the authentication device 30. For example, if there is a discrepancy between the matching score related to the face and the matching score related to the iris, the presentation unit 212 may determine the degree of disturbance using, for example, at least one of a face image and an eye image. The degree of disturbance may be in two stages (i.e., two stages: there is disturbance and there is no disturbance). The degree of disturbance may be in three or more stages. For example, the presentation unit 212 may determine the degree of disturbance based on at least one of the distribution and standard deviation of the luminance values ​​of the image. The disturbance may include at least one of illuminance, contrast, and backlight.

[0087] For example, if the matching score for the face and the matching score for the iris are different, the presentation unit 212 may control the output device 25 so that the image shown in FIG. 6 is displayed on the head-mounted display 251.

[0088] The image shown in FIG. 6 includes a target TP, analog meters 2511 and 2512, and disturbance information 2516 indicating the degree of disturbance. In other words, in this embodiment, the presentation unit 212 may present a plurality of matching scores and the degree of disturbance to the security guard by displaying the image shown in FIG. 6 on the head-mounted display 251. In FIG. 6, the disturbance information 2516 indicates that there is backlight as a disturbance. Note that, if there is no disturbance, the disturbance information 2516 does not need to be displayed. In other words, if there is a disturbance, the disturbance information 2516 is displayed, whereas if there is no disturbance, the disturbance information 2516 does not need to be displayed. As a result, the security guard can determine the degree of disturbance based on whether the disturbance information 2516 is displayed. Therefore, it can be said that the disturbance information 2516 indicates the degree of disturbance.

[0089] The presentation unit 212 may determine that a disturbance exists when the degree of the disturbance exceeds a predetermined threshold. Then, the presentation unit 212 may display information indicating that a disturbance exists (e.g., disturbance information 2516). The presentation unit 212 may determine that no disturbance exists when the degree of the disturbance is equal to or less than the predetermined threshold. The presentation unit 212 may display an analog meter indicating the degree of the disturbance regardless of whether or not a disturbance exists. In other words, the presentation unit 212 may directly display the degree of the disturbance.

[0090] (Technical Effect) In the information processing system 1 according to the fifth embodiment, in addition to the matching score, the degree of disturbance is also presented to the security guard. Therefore, with the information processing system 1 according to the fifth embodiment, the security guard can determine, for example, whether the deviation between the matching score related to the face and the matching score related to the iris is due to a disturbance, or whether the deviation between the matching score related to the face and the matching score related to the iris is due to impersonation.

[0091] Sixth Embodiment A sixth embodiment relating to an information processing device, an information processing system, an information processing method, and a recording medium will be described with reference to Fig. 3. Hereinafter, the sixth embodiment relating to an information processing device, an information processing system, an information processing method, and a recording medium will be described using an information processing system 1 including an information processing device 20. Note that, with regard to the sixth embodiment, descriptions that overlap with the descriptions of the first to fifth embodiments will be omitted as appropriate.

[0092] For example, when the matching score for the face and the matching score for the iris are different from each other, the presenting unit 212 may control the output device 25 so that sounds indicating each of the multiple matching scores are output from the earphones 252. The presenting unit 212 may control the output device 25 so that, in addition to the multiple matching scores, a sound indicating the degree of disturbance is output from the earphones 252. The presenting unit 212 may control the output device 25 so that, in addition to the sounds indicating each of the multiple matching scores, an image such as that shown in FIG. 4 is displayed on the head-mounted display 251. The output device 25 may have a speaker in addition to the earphones 252. For example, the presenting unit 212 may control the output device 25 so that sounds indicating each of the multiple matching scores and a sound indicating the degree of disturbance are output from the speaker. For example, the presenting unit 212 may control the output device 25 so that sounds indicating each of the multiple matching scores and a sound indicating the degree of disturbance are output from both the speaker and the earphones 252. For example, the presentation unit 212 may control the output device 25 so that sounds indicating each of the multiple matching scores are output from the speaker, and a sound indicating the degree of disturbance is output from the earphone 252 .

[0093] The sounds indicating the multiple matching scores may include, for example, a sound when the matching score for the face is equal to or greater than a predetermined threshold, a sound when the matching score for the face is less than a predetermined threshold, a sound when the matching score for the iris is equal to or greater than a predetermined threshold, and a sound when the matching score for the iris is less than a predetermined threshold.

[0094] The sound indicating the matching score may be one sound. For example, if the matching score for the face is equal to or greater than a predetermined threshold, the sound may be "do." If the matching score for the face is less than a predetermined threshold, the sound may be "re." If the matching score for the iris is equal to or greater than a predetermined threshold, the sound may be "mi." If the matching score for the iris is less than a predetermined threshold, the sound may be "fa." The sound indicating the degree of disturbance may be one sound. For example, if there is a disturbance, the sound may be "so." If there is no disturbance, the sound may be "la."

[0095] For example, if the matching score for the face is equal to or greater than a predetermined threshold, the matching score for the iris is less than a predetermined threshold, and there is no external disturbance, the presentation unit 212 may control the output device 25 so that the sound "Do-Fa-La" is output from the earphone 252.

[0096] (Technical Effects) In the information processing system 1 according to the sixth embodiment, multiple matching scores are presented to the security guard as auditory information. Therefore, the information processing system 1 allows the security guard to recognize the matching scores by ear while gazing at the target. As a result, the security guard can focus on observing the target, compared to when the matching scores are presented as visual information. Additionally, by outputting multiple sounds representing the multiple matching scores from the earphones 252, the multiple sounds representing the multiple matching scores can be prevented from being heard by the target (i.e., the person being authenticated, who is the subject of biometric authentication).

[0097] Seventh Embodiment A seventh embodiment relating to an information processing device, an information processing system, an information processing method, and a recording medium will be described with reference to Fig. 3. Hereinafter, the seventh embodiment relating to an information processing device, an information processing system, an information processing method, and a recording medium will be described using an information processing system 1 including an information processing device 20. Note that, with regard to the seventh embodiment, descriptions that overlap with the descriptions of the first to sixth embodiments will be omitted as appropriate.

[0098] For example, if the matching score for the face and the matching score for the iris are different, the presentation unit 212 may present the security guard with past matching scores (e.g., past matching scores for the face and past matching scores for the iris) in addition to the current matching scores (e.g., the current matching score for the face and the current matching score for the iris). Note that the past matching score may be the previous matching score for the target. Alternatively, the past matching score may be the average value of multiple past matching scores for the target (e.g., the matching scores for the past month).

[0099] Here, if one of the face matching score and the iris matching score is equal to or greater than a predetermined threshold, the authentication unit 32 of the authentication device 30 may identify a registrant corresponding to the target. The authentication device 30 may transmit information indicating the identified registrant to the information processing device 20. The acquisition unit 211 of the information processing device 20 may acquire a past matching score linked to the registrant based on the information indicating the identified registrant.

[0100] (Technical Effect) In the information processing system 1 according to the seventh embodiment, past matching scores are presented to the security guard in addition to the current matching score. For example, a matching score related to a face may be lowered due to makeup or hair. For example, a matching score related to an iris may be lowered due to the degree to which the eyes are open. If past matching scores are presented to the security guard in addition to the current matching score, the security guard can determine whether the target is a person who is likely to have a relatively low matching score. In other words, the information processing system 1 makes it easier for the security guard to infer whether the reason the target's matching score is relatively low is due to personality or an abnormality.

[0101] Eighth Embodiment An eighth embodiment relating to an information processing device, an information processing system, an information processing method, and a recording medium will be described with reference to Figures 7 to 9. Below, the eighth embodiment relating to an information processing device, an information processing system, an information processing method, and a recording medium will be described using an information processing device 20a. Note that, with regard to the eighth embodiment, descriptions that overlap with the descriptions of the first to seventh embodiments will be omitted as appropriate.

[0102] 7, the information processing device 20a includes a calculation device 21, a storage device 22, a communication device 23, an input device 24, and an output device 25. The calculation device 21 may include an acquisition unit 211, a presentation unit 212, an image acquisition unit 213, and an authentication unit 214 as logically realized functional blocks or as physically realized processing circuits. The "image acquisition unit 213" and the "authentication unit 214" are components corresponding to the "acquisition unit 31" and the "authentication unit 32" in the second embodiment described above, respectively.

[0103] At least one of the acquisition unit 211, the presentation unit 212, the image acquisition unit 213, and the authentication unit 214 may be realized in a format in which a logical function block and a physical processing circuit (i.e., hardware) are mixed. When at least one of the acquisition unit 211, the presentation unit 212, the image acquisition unit 213, and the authentication unit 214 is a function block, at least one of the acquisition unit 211, the presentation unit 212, the image acquisition unit 213, and the authentication unit 214 may be realized by the calculation device 21 executing a predetermined computer program.

[0104] The information processing device 20a may include cameras CAM3 and CAM4. Camera CAM3 is a camera capable of capturing light in the visible wavelength range (a so-called visible light camera). Camera CAM4 is a camera capable of capturing light in the near-infrared wavelength range (a so-called near-infrared camera). Camera CAM3 may be used to capture a facial image of a target (i.e., a person to be authenticated who is the subject of biometric authentication). Camera CAM4 may be used to capture an iris image of the target. Note that "camera CAM1" and "camera CAM4" are components corresponding to "camera CAM1" and "camera CAM2" in the second embodiment described above, respectively.

[0105] The image acquisition unit 213 acquires an image (a so-called visible light image) output from the camera CAM3 and an image (a so-called near-infrared image) output from the camera CAM4. The image acquisition unit 213 may acquire a face image including the face of the target output from the camera CAM3 by having the camera CAM3 capture an image of the face of the target. The image acquisition unit 213 may acquire an eye image including the eye of the target output from the camera CAM4 by having the camera CAM4 capture an image of the eye of the target.

[0106] The information processing device 20a may not include the cameras CAM3 and CAM4. In other words, the cameras CAM3 and CAM4 may be configured as devices separate from the information processing device 20a. In this case, the information processing device 20a and the cameras CAM3 and CAM4 may be referred to as an information processing system.

[0107] The authentication unit 214 performs multimodal biometric authentication of the target using the face image and eye image acquired by the image acquisition unit 213. That is, the authentication unit 214 performs multimodal biometric authentication that combines face authentication and iris authentication as biometric authentication.

[0108] The authentication unit 214 may compare the matching score for the face with a predetermined threshold. The authentication unit 214 may compare the matching score for the iris with a predetermined threshold. The authentication unit 214 may compare the matching score for the iris of the left eye with a predetermined threshold. Similarly, the authentication unit 214 may compare the matching score for the iris of the right eye with a predetermined threshold. The authentication unit 214 may determine that the subject is a registrant when the matching score for the face is equal to or greater than the predetermined threshold and the matching score for the iris is equal to or greater than the predetermined threshold. The authentication unit 214 may determine that the subject is a registrant when the matching score for the face is equal to or greater than the predetermined threshold, the matching score for the iris of the left eye is equal to or greater than the predetermined threshold, and the matching score for the iris of the right eye is equal to or greater than the predetermined threshold.

[0109] The information processing device 20a may allow the target to pass when the matching score related to the face is equal to or greater than a predetermined threshold and the matching score related to the iris is equal to or greater than a predetermined threshold. Note that the information processing device 20a may allow the target to pass when the matching score related to the face is equal to or greater than a predetermined threshold, the matching score related to the iris of the left eye is equal to or greater than a predetermined threshold, and the matching score related to the iris of the right eye is equal to or greater than a predetermined threshold.

[0110] The information processing device 20a may not allow the object to pass if one of the face matching score and the iris matching score is equal to or greater than a predetermined threshold, and the other of the face matching score and the iris matching score is less than a predetermined threshold. The information processing device 20a may not allow the object to pass if both the face matching score and the iris matching score are less than a predetermined threshold. Note that the information processing device 20a may not allow the object to pass if one or two of the face matching score, the left eye iris matching score, and the right eye iris matching score are equal to or greater than a predetermined threshold, and one or two of the face matching score, the left eye iris matching score, and the right eye iris matching score are less than a predetermined threshold. The information processing device 20a may not allow the object to pass if all of the face matching score, the left eye iris matching score, and the right eye iris matching score are less than a predetermined threshold.

[0111] The acquiring unit 211 may acquire a matching score related to a face and a matching score related to an iris, or a matching score related to a face, a matching score related to the iris of the left eye, and a matching score related to the iris of the right eye, from the authenticating unit 214. That is, the acquiring unit 211 may acquire a matching score related to a face and a matching score related to an iris, or a matching score related to a face, a matching score related to the iris of the left eye, and a matching score related to the iris of the right eye, as the multiple matching scores.

[0112] The presenting unit 212 may present the multiple matching scores to the security guard when the first matching score and the second matching score included in the multiple matching scores are different. Here, the output device 25 of the information processing device 20a has a display unit 253 having multiple lamps that respectively indicate the matching scores (see FIG. 8).

[0113] For example, if there is a discrepancy between the matching score for the face and the matching score for the iris, the presentation unit 212 may control the output device 25 so that the display unit 253 lights up multiple lamps corresponding to the matching score for the face and the matching score for the iris, respectively.

[0114] The lighting mode (e.g., lighting color, lighting cycle) of the lamp indicating the face matching score may change depending on the face matching score. For example, the lighting mode of the lamp indicating the face matching score may include a lighting mode when the face matching score is equal to or greater than a predetermined threshold, and a lighting mode when the face matching score is less than the predetermined threshold. The lighting mode of the lamp indicating the iris matching score may change depending on the iris matching score. For example, the lighting mode of the lamp indicating the iris matching score may include a lighting mode when the iris matching score is equal to or greater than a predetermined threshold, and a lighting mode when the iris matching score is less than the predetermined threshold.

[0115] Furthermore, the display unit 253 may include, for example, a lamp that is turned on when the matching score for the face is equal to or greater than a predetermined threshold, a lamp that is turned on when the matching score for the face is less than the predetermined threshold, a lamp that is turned on when the matching score for the iris is equal to or greater than a predetermined threshold, and a lamp that is turned on when the matching score for the iris is less than the predetermined threshold.

[0116] The display unit 253 may include a lamp that indicates the degree of disturbance. The lighting mode of the lamp that indicates the degree of disturbance may change depending on the degree of disturbance. For example, the lighting mode of the lamp that indicates the degree of disturbance may include a lighting mode when there is a disturbance and a lighting mode when there is no disturbance.

[0117] As shown in FIG. 8 , the display unit 253 may be placed near the gate through which the target TP is about to pass. In particular, the display unit 253 has a shroud 2531 that blocks the target TP's line of sight (see dotted arrow da1 in FIG. 8 ). Due to the presence of the shroud 2531, the target TP cannot see the display content of the display unit 253 (e.g., the lighting status of the lamps mentioned above). Meanwhile, the security guard GM can see the display content of the display unit 253 (see dotted arrow da2 indicating the line of sight of the security guard GM in FIG. 8 ). In other words, by having the shroud 2531 on the display unit 253, the information processing device 20a can present multiple matching scores (and even the degree of disturbance) only to the security guard GM. For convenience, cameras CAM3 and CAM4 are referred to as "CAM" in FIG. 8 .

[0118] The operation of the information processing device 20a will be further described with reference to the flowchart of Fig. 9. In Fig. 9, the image acquisition unit 213 of the information processing device 10 may acquire, as biometric information, an image (e.g., a face image) output from the camera CAM3 and an image (e.g., an eye image) output from the camera CAM4 (step S201). The authentication unit 214 of the information processing device 20a may calculate a plurality of matching scores corresponding to a plurality of parts of the target (e.g., the face, the left eye, and the right eye) respectively (step S202).

[0119] The acquisition unit 211 of the information processing device 20a may acquire a plurality of matching scores corresponding to the plurality of target body parts, respectively (step S203). The presentation unit 212 of the information processing device 20a may determine whether or not the first matching score and the second matching score included in the plurality of matching scores are different from each other (step S204).

[0120] If it is determined in the process of step S204 that the first matching score and the second matching score are different from each other (step S204: Yes), the presenting unit 212 may present the multiple matching scores to the security guard (step S205).If it is determined in the process of step S204 that the first matching score and the second matching score are not different from each other (step S204: No), the operation shown in FIG.

[0121] In this way, the information processing device 20a performs an information processing method in which it acquires biometric information of a subject, performs biometric authentication of the subject using the biometric information, obtains multiple matching scores corresponding to multiple body parts of the subject calculated in the biometric authentication, and presents the multiple matching scores if the first matching score and the second matching score included in the multiple matching scores diverge.

[0122] The information processing device 20a described above may be realized by a computer reading a computer program recorded on a recording medium. In this case, the recording medium may have recorded thereon a computer program for causing the computer to execute an information processing method for acquiring biometric information of a subject, performing biometric authentication of the subject using the biometric information, obtaining multiple matching scores corresponding to multiple body parts of the subject calculated in the biometric authentication, and presenting the multiple matching scores when a first matching score and a second matching score included in the multiple matching scores diverge.

[0123] (Technical Effect) According to the information processing device 20a of the eighth embodiment, it is possible to cooperate with, for example, security guards at important facilities. Therefore, according to the information processing device 20a, it is possible to detect suspicious individuals in cooperation with, for example, security guards.

[0124] <Supplementary Notes> A part or all of the above-described embodiments can be described as, but are not limited to, the following supplementary notes.

[0125] (Supplementary Note 1) An information processing device comprising: an acquisition means for acquiring a plurality of matching scores corresponding to a plurality of body parts of a subject, the matching scores being calculated in biometric authentication performed using the subject's biometric information; and a presentation means for presenting the plurality of matching scores when a first matching score and a second matching score included in the plurality of matching scores diverge.

[0126] (Supplementary Note 2) The information processing device according to Supplementary Note 1, wherein the presenting means displays an image on a display device in which an indicated value of a needle of an analog meter indicates each of the plurality of comparison scores.

[0127] (Supplementary Note 3) The information processing device according to Supplementary Note 1, wherein the presenting means presents the plurality of matching scores by changing a display mode of each of the plurality of body parts in accordance with the corresponding matching score.

[0128] (Supplementary Note 4) The information processing device according to Supplementary Note 1, wherein the presenting means presents, in addition to the plurality of matching scores, a degree of disturbance, which is an external factor causing a decrease in the matching score.

[0129] (Supplementary Note 5) In the information processing device described in Supplementary Note 1, when authentication processing related to the biometric authentication is performed multiple times in a single biometric authentication of the target, the acquisition means acquires the largest matching score among multiple matching scores for each of the multiple body parts, and the presentation means presents the multiple matching scores by changing the display mode of each of the multiple body parts in accordance with the corresponding matching score.

[0130] (Supplementary Note 6) The information processing device according to Supplementary Note 2, wherein the display means is a head-mounted display, and the presentation means displays the image near the target on the head-mounted display.

[0131] (Supplementary Note 7) The information processing device according to Supplementary Note 4, further comprising a head-mounted display, wherein the presentation means displays the plurality of matching scores and the degree of disturbance near the target on the head-mounted display.

[0132] (Supplementary Note 8) The information processing device according to Supplementary Note 1, wherein the presenting means presents past matching scores related to the target in addition to the plurality of matching scores.

[0133] (Supplementary Note 9) The information processing device according to Supplementary Note 1, further comprising: a display device arranged near an area through which the subject passes when the biometric authentication is performed; and the presenting means displays the plurality of matching scores on the display device.

[0134] (Supplementary Note 10) The information processing device according to Supplementary Note 4, further comprising a display device arranged near an area through which the subject passes when the biometric authentication is performed, and the presentation means displays the plurality of matching scores and the degree of disturbance on the display device.

[0135] (Supplementary Note 11) The information processing device according to Supplementary Note 1, wherein the presenting means presents the plurality of matching scores using sound.

[0136] (Supplementary Note 12) The information processing device according to Supplementary Note 4, wherein the presenting means presents the plurality of matching scores and the degree of disturbance using sound.

[0137] (Supplementary Note 13) The information processing device according to Supplementary Note 11, wherein the presenting means presents the plurality of matching scores using a plurality of sounds that correspond to a plurality of parts of the target, respectively, and that are each represented by a tuplet.

[0138] (Supplementary Note 14) The information processing device according to Supplementary Note 12, wherein the presentation means presents the plurality of matching scores and the degree of disturbance using a plurality of sounds that correspond to a plurality of parts of the target, respectively, and that are each represented by a tuplet.

[0139] (Supplementary Note 15) The information processing device according to Supplementary Note 1, wherein the plurality of matching scores include at least two of a matching score relating to the face of the target, a matching score relating to the right eye of the target, a matching score relating to the left eye of the target, and a matching score relating to both eyes of the target.

[0140] (Supplementary Note 16) The information processing device according to Supplementary Note 1, wherein the presenting means presents the plurality of matching scores when a difference between the first matching score and the second matching score is equal to or greater than a predetermined value.

[0141] (Supplementary Note 17) An information processing method comprising: obtaining a plurality of matching scores corresponding to a plurality of body parts of a subject, the matching scores being calculated in biometric authentication performed using the subject's biometric information; and presenting the plurality of matching scores when a first matching score and a second matching score included in the plurality of matching scores diverge.

[0142] (Supplementary Note 18) A recording medium having recorded thereon a computer program for causing a computer to execute an information processing method, the method comprising: obtaining a plurality of matching scores corresponding to a plurality of body parts of a subject, calculated in biometric authentication performed using the subject's biometric information; and presenting the plurality of matching scores when a first matching score and a second matching score included in the plurality of matching scores diverge.

[0143] (Supplementary Note 19) An information processing system comprising: a first acquisition means for acquiring biometric information of a subject; an authentication means for performing biometric authentication of the subject using the biometric information; a second acquisition means for acquiring a plurality of matching scores calculated in the biometric authentication, each corresponding to a plurality of body parts of the subject; and a presentation means for presenting the plurality of matching scores when a first matching score and a second matching score included in the plurality of matching scores diverge.

[0144] (Supplementary Note 20) An information processing method comprising: acquiring biometric information of a subject; performing biometric authentication of the subject using the biometric information; obtaining a plurality of matching scores calculated in the biometric authentication and corresponding to a plurality of body parts of the subject; and presenting the plurality of matching scores when a first matching score and a second matching score included in the plurality of matching scores diverge.

[0145] (Supplementary Note 21) A recording medium having recorded thereon a computer program for causing a computer to execute an information processing method, which includes: acquiring biometric information of a subject; performing biometric authentication of the subject using the biometric information; obtaining a plurality of matching scores calculated in the biometric authentication and corresponding to a plurality of body parts of the subject; and presenting the plurality of matching scores when a first matching score and a second matching score included in the plurality of matching scores diverge.

[0146] Furthermore, some or all of the configurations described in Supplementary Notes 2 to 16, which are dependent on Supplementary Note 1, may also be dependent on Supplementary Notes 17 to 21 in the same dependent relationship as Supplementary Notes 2 to 16. Furthermore, not limited to Supplementary Notes 1 and 17 to 21, some or all of the configurations described as Supplements may be made dependent on various hardware, software, various recording means for recording software, or systems, within the scope of each of the above-mentioned embodiments.

[0147] This disclosure may be modified as appropriate within the scope that does not contradict the gist or idea of ​​the invention that can be read from the claims and the entire specification, and information processing devices, information processing systems, information processing methods, and recording media that involve such modifications are also included in the technical idea of ​​this disclosure.

[0148] 1 Information processing system 10, 20, 20a Information processing device 11, 211 Acquisition unit 12, 212 Presentation unit 32, 214 Authentication unit

Claims

1. An acquisition means for acquiring a plurality of collation scores respectively corresponding to a plurality of parts of the subject, the collation scores being calculated in biometric authentication performed using the biometric information of the subject; and a presentation means for presenting the plurality of collation scores when a first collation score and a second collation score included in the plurality of collation scores deviate from each other. An information processing apparatus comprising:

2. The information processing apparatus according to claim 1, wherein the presentation means displays, on a display device, an image indicating each of the plurality of collation scores as an indication value of a pointer of an analog meter.

3. The information processing apparatus according to claim 1, wherein the presentation means presents the plurality of collation scores by changing a display mode of each of the plurality of parts according to a corresponding collation score.

4. The information processing apparatus according to claim 1, wherein the presentation means presents, in addition to the plurality of collation scores, a degree of disturbance which is an external factor causing a decrease in the collation score.

5. In a single biometric authentication for the subject, when an authentication process related to the biometric authentication is performed a plurality of times, the acquisition means acquires a maximum collation score among a plurality of collation scores for each of the plurality of parts, and the presentation means presents the plurality of collation scores by changing a display mode of each of the plurality of parts according to a corresponding collation score. The information processing apparatus according to claim 1.

6. The display means is a head-mounted display, and the presentation means displays the image in the vicinity of the subject on the head-mounted display. The information processing apparatus according to claim 2.

7. A head-mounted display is provided, and the presentation means displays the plurality of collation scores and the degree of disturbance in the vicinity of the subject on the head-mounted display. The information processing apparatus according to claim 4.

8. The information processing apparatus according to claim 1, wherein the presentation means presents, in addition to the plurality of collation scores, past collation scores related to the subject.

9. A display device is provided in the vicinity of an area through which the subject passes when the biometric authentication is performed, and the presentation means displays the plurality of collation scores on the display device. The information processing apparatus according to claim 1.

10. The information processing apparatus according to claim 4, further comprising a display device disposed near a region through which the subject passes when the biometric authentication is performed, wherein the presentation means displays the plurality of collation scores and the degree of disturbance on the display device.

11. The information processing apparatus according to claim 1, wherein the presentation means presents the plurality of collation scores using sound.

12. The information processing apparatus according to claim 4, wherein the presentation means presents the plurality of collation scores and the degree of disturbance using sound.

13. The information processing apparatus according to claim 11, wherein the presentation means corresponds to a plurality of parts of the subject, and presents the plurality of collation scores using a plurality of sounds each represented by a tie note.

14. The information processing apparatus according to claim 12, wherein the presentation means corresponds to a plurality of parts of the subject, and presents the plurality of collation scores and the degree of disturbance using a plurality of sounds each represented by a tie note.

15. The information processing apparatus according to claim 1, wherein the plurality of collation scores includes at least two of a collation score related to the face of the subject, a collation score related to the right eye of the subject, a collation score related to the left eye of the subject, and a collation score related to both eyes of the subject.

16. The information processing apparatus according to claim 1, wherein the presentation means presents the plurality of collation scores when a difference between the first collation score and the second collation score is equal to or greater than a predetermined value.

17. An information processing method, comprising: obtaining a plurality of collation scores respectively corresponding to a plurality of parts of a subject, the plurality of collation scores being calculated in biometric authentication performed using the biometric information of the subject; and presenting the plurality of collation scores when a first collation score and a second collation score included in the plurality of collation scores deviate from each other.

18. A recording medium having recorded thereon a computer program for causing a computer to execute an information processing method, the information processing method comprising: obtaining a plurality of collation scores respectively corresponding to a plurality of parts of a subject, the plurality of collation scores being calculated in biometric authentication performed using the biometric information of the subject; and presenting the plurality of collation scores when a first collation score and a second collation score included in the plurality of collation scores deviate from each other.

19. An information processing system comprising: a first acquisition means for acquiring biometric information of a subject; an authentication means for performing biometric authentication of the subject using the biometric information; a second acquisition means for acquiring a plurality of collation scores respectively corresponding to a plurality of parts of the subject, the plurality of collation scores being calculated in the biometric authentication; and a presentation means for presenting the plurality of collation scores when a first collation score and a second collation score included in the plurality of collation scores deviate from each other.

20. An information processing method comprising: acquiring biometric information of a subject; performing biometric authentication of the subject using the biometric information; acquiring a plurality of collation scores respectively corresponding to a plurality of parts of the subject, the plurality of collation scores being calculated in the biometric authentication; and presenting the plurality of collation scores when a first collation score and a second collation score included in the plurality of collation scores deviate from each other.

Images