Information processing device, information processing system, information processing method, and program

Abstract

To provide an information processing device, an information processing system, an information processing method, and a program for supporting authentication using biological information allowing an authenticated operation capable of acquiring high-quality biological information from an object in a short time.SOLUTION: An information processing device 1 comprises: an acquisition part 11 for acquiring biological information of an object; a proficiency score calculation part 12 for calculating a proficiency score indicating an operation proficiency for authentication using the biological information, in accordance with at least one of time information indicating the time related to authentication using the biological information and quality information indicating the quality of the biological information; and an output part 13 for outputting information related to the proficiency score.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present disclosure relates to the technical fields of an information processing device, an information processing system, an information processing method, and a program. [Background technology]

[0002] As an example of this type of device, a device has been proposed that outputs a warning message to a user if a captured image determined to be of a quality sufficient for use in authentication cannot be obtained within a specified time (see Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] International Publication No. 2023 / 233943 Summary of the Invention [Problem to be solved by the invention]

[0004] An object of this disclosure is to provide an information processing device, an information processing system, an information processing method, and a program that aim to improve the technology related to the above-mentioned prior art documents. [Means for solving the problem]

[0005] One aspect of an information processing device includes an acquisition means for acquiring biometric information of a target, a proficiency score calculation means for calculating a proficiency score indicating the proficiency of an action for authentication using the biometric information based on at least one of time information indicating the time related to authentication using the biometric information and quality information indicating the quality of the biometric information, and an output means for outputting information related to the proficiency score.

[0006] One aspect of the information processing system includes an acquisition means for acquiring biometric information of a target, a proficiency score calculation means for calculating a proficiency score indicating the proficiency of an action for authentication using the biometric information based on at least one of time information indicating the time related to authentication using the biometric information and quality information indicating the quality of the biometric information, and an output means for outputting information related to the proficiency score.

[0007] One aspect of the information processing method is an information processing method executed by a computer, which acquires biometric information of a target, calculates a proficiency score indicating the proficiency of an action for authentication using the biometric information based on at least one of time information indicating the time related to authentication using the biometric information and quality information indicating the quality of the biometric information, and outputs information related to the proficiency score.

[0008] One aspect of the program causes a computer to execute an information processing method that acquires biometric information of a target, calculates a proficiency score indicating the proficiency of an action for authentication using the biometric information based on at least one of time information indicating the time related to authentication using the biometric information and quality information indicating the quality of the biometric information, and outputs information related to the proficiency score. [Brief explanation of the drawings]

[0009] [Figure 1] 1 is a block diagram illustrating a configuration of an example of an information processing apparatus according to an embodiment. [Figure 2] 10 is a flowchart illustrating an example of an operation of the information processing device according to the embodiment. [Figure 3] 1 is a block diagram illustrating a configuration of an example of an information processing apparatus according to an embodiment. [Figure 4] 10 is a flowchart illustrating an example of an operation of the information processing device according to the embodiment. [Figure 5] FIG. 10 is a diagram illustrating an example of guidance to be output. [Figure 6] 10 is a flowchart illustrating a modified example of the operation of the information processing device according to the embodiment. [Figure 7]1 is a block diagram illustrating a configuration of an example of an information processing apparatus according to an embodiment. [Figure 8] 10 is a flowchart illustrating an example of an operation of the information processing device according to the embodiment. [Figure 9] 10 is a flowchart illustrating a modified example of the operation of the information processing device according to the embodiment. [Figure 10] 10 is a flowchart illustrating a modified example of the operation of the information processing device according to the embodiment. [Figure 11] 1 is a block diagram illustrating a configuration of an example of an information processing apparatus according to an embodiment. [Figure 12] 1 is a block diagram illustrating a configuration of an example of an information processing apparatus according to an embodiment. [Figure 13] 10 is a flowchart illustrating an example of an operation of the information processing device according to the embodiment. [Figure 14] 1 is a block diagram illustrating a configuration of an example of an information processing apparatus according to an embodiment. [Figure 15] 10 is a flowchart illustrating an example of an operation of the information processing device according to the embodiment. [Figure 16] 1 is a block diagram illustrating a configuration of an example of an information processing apparatus according to an embodiment. [Figure 17] 10 is a flowchart illustrating an example of an operation of the information processing device according to the embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0010] Hereinafter, embodiments of an information processing device, an information processing system, an information processing method, and a program will be described with reference to the drawings. [1: First embodiment]

[0011] A first embodiment of an information processing device, an information processing system, an information processing method, and a program will be described with reference to Fig. 1 and Fig. 2. Hereinafter, the first embodiment of an information processing device, an information processing system, an information processing method, and a program will be described using an information processing device 1.

[0012] 1, the information processing device 1 includes an acquisition unit 11, a proficiency score calculation unit 12, and an output unit 13. The operation of the information processing device 1 will be described with reference to the flowchart of FIG.

[0013] 2, the acquisition unit 11 acquires biometric information of a target to be authenticated using the biometric information (step S11). The "target" to be authenticated using the biometric information is the target of biometric authentication (i.e., authentication using the biometric information). Therefore, the "target" may also be referred to as a person to be authenticated.

[0014] Biometric information is information relating to the physical characteristics of a subject. Examples of biometric information include at least one of a facial image including the subject's face, an iris image including the subject's iris, a fingerprint pattern of the subject, a palm print pattern of the subject, a vein pattern of the subject's fingers and palm, audio information including the subject's voice, and sound information including the subject's otoacoustic emissions. Examples of authentication using biometric information include at least one of face authentication, iris authentication, fingerprint authentication, palm print authentication, vein authentication, voiceprint authentication, and earacoustic authentication. A person to be authenticated may be authenticated using one piece of biometric information. Alternatively, a person to be authenticated may be authenticated using a combination of multiple pieces of biometric information. In other words, a person to be authenticated may be a target of multimodal biometric authentication.

[0015] The proficiency score calculation unit 12 calculates a proficiency score indicating the proficiency of the target's action based on at least one of time information indicating the time required for authentication using biometric information and quality information indicating the quality of the biometric information (step S12). The "time required for authentication using biometric information" is not limited to the time required to match the target's biometric information with pre-registered registration information, but also includes, for example, the time required to acquire the biometric information. For example, even if the target is the registrant, authentication may be repeated multiple times until the target is determined to be the registrant. Therefore, the "time required for authentication using biometric information" may be the time required from the first acquisition of the target's biometric information until the target is determined to be the registrant. In other words, the "time required for authentication using biometric information" may refer to the time required for multiple authentication attempts. In other words, the "time required for authentication using biometric information" may include the time required for re-attempting authentication. However, the "time required for authentication using biometric information" may also refer to the time required for one authentication attempt.

[0016] The "time required for authentication using biometric information" may be a portion of the time required for authentication. For example, the "time required for authentication using biometric information" may be the time required to acquire the target's biometric information. This is because, for example, the time required to match the target's biometric information with pre-registered registration information is determined according to the performance of the authentication device and is not affected by the target's behavior. The target's behavior is the behavior performed by the target for biometric authentication. Note that the behavior performed by the target for biometric authentication will hereinafter be referred to as the "behavior to be authenticated" as appropriate. The proficiency score is a score indicating the target's proficiency in the behavior to be authenticated. Note that the higher the subject's proficiency in the behavior to be authenticated, the higher the proficiency score may be. For example, when an image containing the target (e.g., at least one of a face image and an iris image) is acquired as biometric information, a subject familiar with biometric authentication can turn their face toward the camera relatively quickly. On the other hand, a subject unfamiliar with biometric authentication may, for example, not know which direction to turn their face in. Therefore, it can be said that the time required for authentication using the biometric information of a subject familiar with biometric authentication is shorter than the time required for authentication using the biometric information of a subject unfamiliar with biometric authentication. Therefore, it can be said that the time required for authentication using biometric information varies depending on the level of proficiency.

[0017] In biometric authentication, a subject's biometric information is compared with pre-registered registration information. Here, if the quality of the biometric information is relatively low, it may be difficult to match it with the registration information. In other words, if the quality of the biometric information is relatively low, there is a high possibility that the biometric authentication will not be performed properly compared to when the quality of the biometric authentication is relatively high. For example, the time required for biometric authentication for a subject familiar with biometric authentication is often shorter than the time required for biometric authentication for a subject unfamiliar with biometric authentication. This is because the quality of biometric information obtained from a subject familiar with biometric authentication is often higher than the quality of biometric information obtained from a subject unfamiliar with biometric authentication. Therefore, it can be said that the quality of biometric information changes depending on the level of proficiency.

[0018] If a subject can perform an action so that biometric information is acquired in a relatively short time, the subject's proficiency in the action to be authenticated can be evaluated as high. Furthermore, if a subject can perform an action so that biometric information of relatively high quality is acquired, the subject's proficiency in the action to be authenticated can be evaluated as high. Therefore, the proficiency score calculation unit 12 determines the proficiency of the subject's action to be authenticated based on at least one of time information indicating the time related to authentication using biometric information and quality information indicating the quality of the biometric information. The more suitable the subject's action to be authenticated is for biometric authentication, the higher the proficiency score is expected to be. Therefore, the proficiency score may be rephrased as an index evaluating an appropriate action to be authenticated that the subject performs voluntarily. Furthermore, the proficiency score may be rephrased as an index evaluating the proficiency of the subject's active action. Note that the time information indicating the time related to authentication using biometric information and the quality information indicating the quality of the biometric information will be described in other embodiments.

[0019] The output unit 13 outputs information related to the proficiency score (step S13). The information related to the proficiency score may be information indicating the proficiency score itself, or information indicating a processing result using the proficiency score, such as a comparison result with a past proficiency score. The information related to the proficiency score may be, for example, text information indicating the proficiency score, image information related to the proficiency score, or audio information related to the proficiency score. The information related to the proficiency score may also be information indicating a graded evaluation according to the proficiency score. The graded evaluation may include at least two of, for example, "Excellent," "Very Good," and "Good." By outputting information related to the proficiency score, the proficiency of the subject's action to be authenticated can be notified to the subject in an easy-to-understand manner.

[0020] In this way, the information processing device 1 performs an information processing method in which it acquires the target biometric information, calculates a proficiency score indicating the proficiency of the action for authentication using the biometric information based on at least one of time information indicating the time related to authentication using the biometric information and quality information indicating the quality of the biometric information, and outputs information related to the proficiency score.

[0021] The above-described information processing device 1 may be realized by a computer reading a computer program recorded on a recording medium. In this case, the computer program may cause the computer to execute an information processing method that acquires biometric information of a target, calculates a proficiency score indicating a proficiency level of an action for authentication using the biometric information based on at least one of time information indicating a time related to authentication using the biometric information and quality information indicating the quality of the biometric information, and outputs information related to the proficiency score. [Technical Effects]

[0022] As described above, the higher the subject's proficiency in the action to be authenticated, the higher the proficiency score may be. In the information processing device 1, information regarding the proficiency score is output by the output unit 13. Therefore, the subject can refer to the information regarding his or her own proficiency score to recognize the appropriateness of his or her action to be authenticated. In addition, by outputting the information regarding the proficiency score, a subject can compare the information regarding his or her own proficiency score with the information regarding the proficiency scores of other subjects. Therefore, for example, a subject can be expected to try to obtain information regarding a better proficiency score. In other words, the information regarding the proficiency score can motivate a subject to try to improve the action to be authenticated. Therefore, the information processing device 1 according to this disclosure calculates and outputs a proficiency score indicating the subject's proficiency in the action to be authenticated, thereby helping a subject who is unfamiliar with biometric authentication to become accustomed to biometric authentication. The proficiency score is calculated based on at least one of time information indicating the time required for authentication using biometric information and quality information indicating the quality of the biometric information. The shorter the time required to acquire biometric information, the higher the proficiency score may be. Furthermore, the higher the quality of the biometric information, the higher the proficiency score may be. Therefore, improvement in the information on the proficiency score may mean at least one of that the subject has performed the action to be authenticated so as to shorten the time required to acquire biometric information and that the subject has performed the action to be authenticated so as to improve the quality of the biometric information. Therefore, the information processing device 1 can support the subject in performing the action to be authenticated in a short time, which allows high-quality biometric information to be acquired from the subject.

[0023] As described above, a subject can compare information about his or her own proficiency score with information about the proficiency scores of other subjects. Therefore, a subject may compete with other subjects over information about the proficiency score. In other words, by having the information processing device 1 output information about the proficiency score, the subject can enjoy skillfully performing the action to be authenticated. In other words, the subject can perform the action to be authenticated as if it were a game. The information processing device 1 can help the subject practice the appropriate action to be authenticated while having fun. Because the information processing device 1 outputs information about the proficiency score, the subject can be expected to perform a more appropriate action to be authenticated the next time biometric information is acquired. Furthermore, by having the subject perform the action to be authenticated as if it were a game, the information processing device 1 can reduce the perceived discomfort of biometric authentication among subjects who are not familiar with biometric authentication. [2: Second embodiment]

[0024] A second embodiment of an information processing device, an information processing system, an information processing method, and a program will be described with reference to Fig. 3 to Fig. 6. Hereinafter, the second embodiment of an information processing device, an information processing system, an information processing method, and a program will be described using an information processing device 2. Note that, for the second embodiment, descriptions that overlap with the description of the first embodiment will be omitted as appropriate. [2-1: Configuration of information processing device 2]

[0025] 3, the information processing device 2 includes an arithmetic unit 21, a storage device 22, a communication device 23, an input device 24, and an output device 25. The arithmetic unit 21, the storage device 22, the communication device 23, the input device 24, and the output device 25 may be connected via a data bus 26. The arithmetic unit 21 may include, for example, at least one of a central processing unit (CPU), a graphics processing unit (GPU), a field programmable gate array (FPGA), a tensor processing unit (TPU), and a quantum processor.

[0026] The storage device 22 may include, for example, at least one of a RAM (Random Access Memory), a ROM (Read Only Memory), a hard disk device, a magneto-optical disk device, an SSD (Solid State Drive), and an optical disk array. In other words, the storage device 22 may include a non-transitory recording medium. The storage device 22 is capable of storing desired data. For example, the storage device 22 may temporarily store a computer program executed by the calculation device 21. The storage device 22 may temporarily store data that is temporarily used by the calculation device 21 when the calculation device 21 is executing a computer program.

[0027] The communication device 23 may be capable of communicating with devices external to the information processing device 2. The communication device 23 may perform wired communication or wireless communication.

[0028] The input device 24 is a device capable of accepting information input to the information processing device 2 from the outside. The input device 24 may include an operation device (e.g., a keyboard, a mouse, a touch panel, etc.) that can be operated by a user of the information processing device 2. The input device 24 may include a recording medium reading device that can read information recorded on a recording medium that is detachable from the information processing device 2, such as a USB (Universal Serial Bus) memory. Note that when information is input to the information processing device 2 via the communication device 23 (in other words, when the information processing device 2 obtains information via the communication device 23), the communication device 23 may function as an input device.

[0029] The output device 25 is a device capable of outputting information to the outside of the information processing device 2. The output device 25 may output visual information such as characters or images, auditory information such as sound, or tactile information such as vibration, as the information. The output device 25 may include, for example, at least one of a display, a speaker, a printer, and a vibration motor. The output device 25 may be capable of outputting information to a recording medium detachable from the information processing device 2, such as a USB memory. Note that when the information processing device 2 outputs information via the communication device 23, the communication device 23 may function as the output device.

[0030] The arithmetic device 21 in this embodiment has an image acquisition unit 211, a proficiency score calculation unit 212, and an output unit 213 as logically realized functional blocks or as physically realized processing circuits. The "image acquisition unit 211," "proficiency score calculation unit 212," and "output unit 213" are components corresponding to the "acquisition unit 11," "proficiency score calculation unit 12," and "output unit 13" in the first embodiment, respectively. The image acquisition unit 211 may have an imaging control unit 2111 and a biometric information acquisition unit 2112. The proficiency score calculation unit 212 may have a time calculation unit 2121 and a quality information generation unit 2122.

[0031] The arithmetic device 21 in this embodiment may further include an authentication unit 214 as a logically realized functional block or as a physically realized processing circuit. In other words, the information processing device 2 may be a device capable of performing authentication using the target's biometric information. The authentication unit 214 may include a matching score calculation unit 2141. The arithmetic device 21 in this embodiment may further include a guidance output unit 215 and an entry / exit control unit 216 as a logically realized functional block or as a physically realized processing circuit.

[0032] At least one of the image acquisition unit 211, the proficiency score calculation unit 212, the output unit 213, the authentication unit 214, the guidance output unit 215, and the entry / exit control unit 216 may be realized in a format in which a logical function block and a physical processing circuit (i.e., hardware) are mixed. When at least one of the image acquisition unit 211, the proficiency score calculation unit 212, the output unit 213, the authentication unit 214, the guidance output unit 215, and the entry / exit control unit 216 is a function block, at least one of the image acquisition unit 211, the proficiency score calculation unit 212, the output unit 213, the authentication unit 214, the guidance output unit 215, and the entry / exit control unit 216 may be realized by the calculation device 21 executing a predetermined computer program.

[0033] The arithmetic device 21 may acquire (in other words, read) the predetermined computer program from the storage device 22. The arithmetic device 21 may read the predetermined computer program stored in a computer-readable, non-transitory recording medium using a recording medium reading device (not shown) included in the information processing device 2. The arithmetic device 21 may acquire (in other words, download or read) the predetermined computer program from a device (not shown) external to the information processing device 2 via the communication device 23. Note that the recording medium for recording the predetermined computer program executed by the arithmetic device 21 may be at least one of an optical disk, a magnetic medium, a magneto-optical disk, a semiconductor memory, and any other medium capable of storing a program.

[0034] Furthermore, the information processing device 2 may be equipped with a camera CAM. The biological information of the subject may be information that can be acquired from an image captured by the camera CAM. The camera CAM may be a camera capable of capturing light in the visible wavelength range (a so-called visible light camera). The camera CAM may be a camera capable of capturing light in the near-infrared wavelength range (a so-called near-infrared camera). Alternatively, the information processing device 2 may be equipped with a visible light camera and a near-infrared camera. The camera CAM may be provided so as to capture an image of the subject from a position facing the front of the subject, for example.

[0035] The biometric information of the subject may be an image including a predetermined part of the subject. The biometric information of the subject may also be a facial image of the subject. In this case, the image acquisition unit 211 may acquire an image from the camera CAM and acquire a facial image of the subject's facial region from the image. In other words, the biometric information is a partial image acquired from a captured image. The biometric information of the subject may also be an image of the eye region including the subject's iris. In this case, the image acquisition unit 211 may acquire an image from the camera CAM and acquire an iris image of the subject's iris region from the image. The biometric information of the subject may also be information indicating the subject's fingerprint. In this case, the image acquisition unit 211 may acquire fingerprint information from a fingerprint scanner.

[0036] In this embodiment, a case will be described in which the image acquisition unit 211 acquires a face image as an example of biometric information. Therefore, in this embodiment, a case will be described in which the authentication unit 214 performs face authentication as an example of biometric authentication.

[0037] The guidance output unit 215 may output guidance regarding the target's action to be authenticated. Here, "guidance" may mean at least one of explanation, instruction, and guidance to enable the target to perform the appropriate action to be authenticated. By having the guidance output unit 215 in the information processing device 2, it is expected that a target for whom it is difficult to perform biometric authentication alone will be able to perform biometric authentication alone. Examples of "targets for whom it is difficult to perform biometric authentication alone" include at least one of children and elderly people. A child may be an infant who has not yet entered elementary school and is capable of performing actions in response to guidance such as audio and video. The following description will be given taking the case where the target is a child as an example.

[0038] The information processing device 2 according to this embodiment may perform face recognition to manage entry and exit to a predetermined area. The predetermined area may be, for example, a kindergarten classroom. The predetermined area may also be the inside of a school bus. The information processing device 2 according to this embodiment may be applied to a situation where entry and exit of children to and from a predetermined area is managed by face recognition. [2-2: Information processing method executed by information processing device 2]

[0039] An information processing method executed by the information processing device 2 will be described with reference to Fig. 4 and Fig. 5. Fig. 4 is a flowchart showing an example of the flow of the information processing method executed by the information processing device 2. Fig. 5 shows an example of a child's behavior in response to guidance output by the information processing device 2.

[0040] The information processing device 2 may have a mechanism for detecting the presence of an object near the camera CAM and a mechanism for detecting an object in front of the camera CAM. For example, the information processing device 2 may detect an object near the camera CAM and an object in front of the camera CAM based on an image captured by the camera CAM. Note that the image captured by the camera CAM may be a concept that includes a moving image.

[0041] For example, when a child is detected near the camera CAM, the guidance output unit 215 of the information processing device 2 may output guidance to encourage the child to come in front of the camera CAM. For example, in a scene where a door is opened by facial recognition, the guidance output unit 215 of the information processing device 2 may output a voice message such as "If you want to open the door, come in front of the camera." Furthermore, because children tend to pay attention to moving objects, the guidance output unit 215 of the information processing device 2 may display a moving image as at least a part of the guidance in a position in front of the camera CAM where the child is to be attracted.

[0042] For example, the camera CAM may be placed near a door (at least one of a classroom door and a school bus door). Whether to open the door or unlock the door may be determined depending on the result of facial authentication. When the information processing device 2 detects a child in front of the camera CAM, it may determine that the child wants to open the door. When the information processing device 2 detects a child in front of the camera CAM, it may start processing to acquire a facial image in order to perform facial authentication to open the door. As shown in FIG. 4(a), when a child in front of the camera CAM is detected (step S21: Yes), the imaging control unit 2111 controls the camera CAM to capture an image of the child in front of the camera CAM (step S22). The time calculation unit 2121 may start measuring time.

[0043] If a child in front of the camera CAM is detected (step S21: Yes), the guidance output unit 215 may output guidance to have the child take an action (i.e., an action to be authenticated) so that the camera CAM can capture an image of the child's face. The guidance output unit 215 may control the output device 25 to output the guidance. For example, the camera CAM may be installed so that it can capture an image of the child's face when the child places their hands in a predetermined position. In this case, the guidance output unit 215 may display an image I as exemplified in FIG. 5(a). That is, the guidance output unit 215 may display two hand marks H on both sides below the camera CAM. When the child places their hands on the two hand marks H, the center of the child's face T is positioned directly in front of the camera, as exemplified in FIG. 5(b), and the distance between the child's face T and the camera CAM may be set appropriately.

[0044] The biometric information acquisition unit 2112 acquires a face image as biometric information (step S23). If the image acquisition unit 211 can detect a face from the image acquired by the camera CAM, the biometric information acquisition unit 2112 may acquire the face image from the image.

[0045] The image acquisition unit 211 may sequentially acquire images from the camera CAM. For example, as shown in Fig. 4(b), the biometric information acquisition unit 2112 determines whether a facial image, as an example of biometric information, can be acquired from the image acquired by the image acquisition unit 211 from the camera CAM (step S230). The biometric information acquisition unit 2112 may repeat this operation until it is determined in the processing of step S230 that a facial image can be acquired (step S230: Yes).

[0046] The proficiency score calculation unit 212 calculates the proficiency score (step S24). The proficiency score calculation unit 212 calculates the proficiency score based on the time related to the authentication using the biometric information calculated by the time calculation unit 2121 and the quality information indicating the quality of the biometric information generated by the quality information generation unit 2122.

[0047] The time calculation unit 2121 may calculate the time from the start of capturing an image of the child in front of the camera CAM (start of acquiring biometric information) to the acquisition of a facial image as the time related to authentication using biometric information. In this embodiment, the case where a face is detected from the image acquired by capturing an image with the camera CAM and a facial image of the face area is acquired may be considered to be the case where biometric information is acquired. That is, the time calculation unit 2121 may calculate the time from step S22 to step S23. The shorter the time required for biometric authentication, the better for both the person to be authenticated and the person performing the biometric authentication. Therefore, the proficiency score calculation unit 212 calculates a higher proficiency score as the time related to authentication using biometric information becomes shorter.

[0048] The quality information generation unit 2122 generates quality information based on the position of the facial image in the extracted image and the degree to which the facial area is hidden. The closer the face is to the center of the image, the smaller the lens distortion, resulting in a facial image suitable for biometric authentication. On the other hand, if the face is captured at the edge of the image, the facial image is more likely to be distorted, resulting in a facial image that is not suitable for biometric authentication. This is particularly noticeable when capturing an image with a wide-angle lens. Therefore, the quality information generation unit 2122 may generate quality information that indicates higher quality the closer the position of the facial image in the extracted image is to the center of the image. The quality information generation unit 2122 may evaluate the quality of the biometric information as being higher the closer the biometric information area is to the center of the image. The proficiency score calculation unit 212 calculates a higher proficiency score the closer the biometric information area in the image is included in the center of the image. Furthermore, the quality information generation unit 2122 may generate quality information that indicates higher quality the less the facial area is hidden. The quality information generating unit 2122 may evaluate that the more the area of ​​the biometric information is not hidden, the higher the quality of the biometric information. The proficiency score calculating unit 212 calculates a higher proficiency score as the more the area of ​​the biometric information in the image is not hidden.

[0049] In this embodiment, a person who performs actions that enable high-quality biometric information to be obtained in a short time is considered to be an experienced person to be authenticated. In this embodiment, the higher the quality of biometric information that can be obtained in a short time, the higher the proficiency score is set.

[0050] The matching score calculation unit 2141 calculates the matching score (step S25). The matching score may mean a value indicating the degree of match between the target biometric information and pre-registered biometric information. The matching score may mean a value indicating the degree of match between a feature extracted from the target biometric information and a pre-registered feature. The matching score calculation unit 2141 may calculate the matching score by matching the facial image with a pre-registered facial image. Alternatively, the matching score calculation unit 2141 may calculate the matching score by matching the feature extracted from the facial image with a pre-registered feature. The matching score may be expressed as a value ranging from 0 to 100, for example.

[0051] The authentication unit 214 determines whether the biometric authentication is successful (step S26). In biometric authentication, if the matching score is equal to or greater than a predetermined threshold, it is determined that the subject (i.e., the person to be authenticated) is a person who has been registered in advance (i.e., a registrant). The authentication unit 214 may determine that the biometric authentication is successful if the matching score exceeds the predetermined threshold. In this case, the authentication unit 214 may determine that the biometric authentication is unsuccessful if the matching score is smaller than the predetermined threshold. Note that if the matching score is equal to the predetermined threshold, it may be determined that the biometric authentication is successful or unsuccessful.

[0052] Here, in biometric authentication, for example, the false acceptance rate (FAR) and the false rejection rate (FRR) are often taken into consideration to achieve both authentication accuracy and user convenience. Therefore, the predetermined threshold for determining whether authentication is successful or unsuccessful may be set to a value that, for example, allows an unregistered person (i.e., a stranger) to be mistaken for a registered person, but hardly allows a registered person to be rejected. The larger the matching score, the lower the false acceptance rate. When the false acceptance rate is negligibly small, it can be said that the authentication is successful and reliable. Therefore, it is preferable to perform biometric authentication using biometric information that can obtain a high matching score. The matching score tends to be higher as the quality of the biometric information improves. Therefore, quality information is used to calculate the proficiency core so that the target action for authentication that obtains high-quality biometric information can be targeted.

[0053] If the biometric authentication is successful (step S26: Yes), the output unit 213 outputs the proficiency score (step S27). The output unit 213 may present the proficiency score to the child. For example, the output unit 213 may output a comparison result between the current proficiency score and the previous or previous proficiency score. The entry / exit control unit 216 controls the door to open (step S28), allowing the child to enter and exit.

[0054] If the biometric authentication fails (step S26: No), the process may return to step S23. Alternatively, if the biometric authentication fails (step S26: No), the information processing device 2 may output an error and end the series of operations.

[0055] The time related to authentication using biometric information may be the time from the start of biometric information acquisition to the acquisition of biometric information usable for biometric authentication. Biometric information usable for biometric authentication may be, for example, biometric information of a predetermined quality or higher. The time related to authentication using biometric information may be the time from the start of biometric information acquisition to the execution of biometric authentication. Biometric authentication may be performed when biometric information of a desired quality is acquired. The time related to authentication using biometric information may be the time from the start of biometric information acquisition to successful biometric authentication. In this case, the proficiency score may be calculated when the biometric authentication is successful. In other words, successful biometric authentication may trigger the calculation of the proficiency score. In the case of the flow of information processing operations illustrated in FIG. 4, the operation of step S24 may be performed immediately before the operation of step S27. [2-3: Variation]

[0056] When the proficiency score is smaller than a predetermined value, the guidance output unit 215 may output guidance so that the proficiency score becomes larger than the predetermined value. The proficiency score may be a score that improves by receiving guidance. While the user is still unfamiliar with biometric authentication, receiving guidance may enable the user to perform the action to be authenticated. When the user becomes accustomed to biometric authentication, the aim may be to be able to spontaneously perform the action to be authenticated without receiving guidance. In a modified example, when the proficiency score is smaller than a predetermined value, guidance is output so that the proficiency score becomes larger than the predetermined value.

[0057] A modified example of the information processing method executed by the information processing device 2 will be described with reference to FIG. 6. FIG. 6 is a flowchart showing an example of the flow of the modified example of the information processing method executed by the information processing device 2. As shown in FIG. 6, when the proficiency score is calculated (step S24), the guidance output unit 215 determines whether the proficiency score is greater than a predetermined value (step S29). If the proficiency score is greater than the predetermined value (step S29: No), the processing from step S25 onwards is carried out as in the above-described embodiment. If the proficiency score is less than the predetermined value (step S29: Yes), in the modified example, the operation of acquiring biometric information may be repeated. Also, in the modified example, if a child in front of the camera CAM is detected (step S21: Yes), the guidance output unit 215 may not output guidance.

[0058] If the proficiency score is smaller than the predetermined value (step S29: Yes), the guidance output unit 215 outputs guidance to the target child (step S30). The guidance output unit 215 may output guidance on an action to acquire a facial image in a shorter time. The guidance output unit 215 may output guidance on an action to include a facial image in the center of the image. For example, the guidance output unit 215 may output guidance instructing where to position the face. The guidance output unit 215 may output guidance on an action to prevent the area of ​​the facial image in the image from being hidden. For example, the guidance output unit 215 may output guidance instructing not to put hands in front of the face. The guidance output unit 215 may output guidance on aligning the hands, for example, as illustrated in FIG. 5.

[0059] The information processing device 2 is not only a mechanism for managing entry and exit using biometric authentication, but also a mechanism for improving the child's proficiency in the action to be authenticated. Therefore, if the proficiency score is lower than a predetermined value, guidance may be provided and the child may be made to perform the action to be authenticated again, thereby improving the child's proficiency in the action to be authenticated.

[0060] As another example of the guidance, the guidance output unit 215 may display an image captured by the camera CAM and a facial mark including a jaw line. The guidance output unit 215 may have the child move so that the chin in the image captured by the camera CAM matches the jaw line of the facial mark.

[0061] For example, when guiding a user to a location suitable for face authentication by aligning the hand as illustrated in FIG. 5 , the information processing device 2 may perform hand-related authentication such as fingerprint authentication, palm print authentication, or vein authentication in addition to face authentication. Furthermore, the information processing device 2 may perform iris authentication in addition to or instead of face authentication. In this case, the biometric information acquisition unit 2112 may acquire an eye image including the iris from the face image. When acquiring an iris image and performing iris authentication, the guidance output unit 215 may output guidance for operations that allow the iris image to be appropriately acquired using a device that allows a user to see an image when looking through, such as a telescope or binoculars. Furthermore, when acquiring an iris image and performing iris authentication, the quality information generation unit 2122 may generate quality information based on the position of the iris image in the image from which the iris image was extracted and the degree to which the iris area is obscured.

[0062] Although a child has been described as an example of the subject, the subject may be any person to be authenticated in biometric authentication. The information processing operation executed by the information processing device 2 is particularly useful when the subject is unfamiliar with biometric authentication. [2-4: Technical Effects]

[0063] The information processing device 2 according to this disclosure helps children and others who are unfamiliar with biometric authentication to become familiar with biometric authentication. It is particularly important to become familiar with biometric authentication in situations where everyday actions, such as entering and leaving kindergarten and getting on and off the school bus, are managed by biometric authentication. The information processing device 2 notifies the child of information related to the proficiency score, allowing the child to enjoy skillfully performing the authenticated action. The information processing device 2 can help the child become proficient in the appropriate authenticated action while having fun.

[0064] When performing authentication using biometric information acquired from an image, it is important for the subject to perform the action to be authenticated so that the biometric information is properly captured in the image. The information processing device 2 according to this disclosure outputs guidance to subjects, such as children, who are unfamiliar with biometric authentication, on actions that will properly capture the biometric information in the image, so that the subject, such as children, can learn how to perform actions that will properly capture the biometric information in the image. This is expected to enable subjects, such as children, to perform the action to be authenticated properly in a relatively short period of time. Furthermore, if the proficiency score is lower than a predetermined value, guidance is output and the subject is prompted to retry the action to be authenticated, thereby improving proficiency. [3: Third embodiment]

[0065] A third embodiment of an information processing device, an information processing system, an information processing method, and a program will be described with reference to FIGS. 7 to 9. Hereinafter, the third embodiment of an information processing device, an information processing system, an information processing method, and a program will be described using an information processing device 3. Note that, for the third embodiment, descriptions that overlap with the descriptions of the first and second embodiments will be omitted as appropriate. In this embodiment, a case where the target is a child will be described as an example. Note that, in the drawings, parts common to the first and second embodiments are denoted by the same reference numerals.

[0066] In this embodiment, the authentication unit 214 may perform face authentication as biometric authentication. In this embodiment, the authentication unit 214 may perform iris authentication in addition to face authentication. In this embodiment, in addition to improving the proficiency of the action to be authenticated in face authentication, the aim is to improve the proficiency of the action to be authenticated in iris authentication. However, in this embodiment, iris authentication does not have to be performed. The action to be authenticated in iris authentication is more difficult than the action to be authenticated in face authentication. Therefore, in case a child becomes able to behave like an adult and becomes an authenticated person in multimodal authentication using face authentication and iris authentication, support may be provided for improving the proficiency of the action to be authenticated.

[0067] Specifically, in this embodiment, if there is a factor that is expected to improve the proficiency of the authenticated action of biometric authentication, a proficiency score is added. Even if the face position in the image is correct, iris authentication may fail. For example, iris authentication may fail if the eyes are closed or the whites of the eyes are showing playfully. Therefore, to ensure that the authenticated action of iris authentication can be performed appropriately, if there is a factor that will increase the iris authentication matching score, a proficiency score is added.

[0068] Factors that increase the iris authentication matching score include the eyes being open and being open by a predetermined amount or more, and the eyes not being obscured by hair, eyelashes, etc. Eyelids, hair, eyelashes, etc., can be obstacles in iris authentication. Therefore, a state in which the iris is obscured by obstacles to a predetermined degree or less can be considered a desirable state for reliable iris authentication. Another factor that increases the iris authentication matching score is the appropriate positional relationship between the camera and the iris, i.e., the iris being in focus. Therefore, a state in which the degree of focus of the child's iris in the face image is at a predetermined level or higher can be considered a desirable state for reliable iris authentication. Another factor that increases the iris authentication matching score is the iris being in the center of the eye, i.e., not the white of the eye. Therefore, a state in which the degree of match between the center of the child's eye area in the face image and the position of the child's iris is at a predetermined level or higher can be considered a desirable state for reliable iris authentication. Another factor that can increase the matching score of iris authentication is that the gaze is fixed and the eyes do not move, such as looking up, down, left, or right. Therefore, a state in which the degree of movement of a child's gaze is less than a predetermined level can be cited as a desirable state for highly reliable iris authentication.

[0069] Furthermore, in many cases, registered face images are images of faces facing forward. Therefore, a face facing forward can be cited as a factor in increasing the matching score of face recognition. Therefore, a state in which the degree of match between the child's face orientation in the face image and the frontal orientation of the face is at least a predetermined level can be cited as a desirable state for highly reliable face recognition.

[0070] As described above, the matching score of face recognition increases when the face image is acquired from the center of the image and when the degree to which the child's face is occluded in the face image is less than a predetermined value. In other words, a state in which the face image is acquired from the center of the image and a state in which the degree to which the child's face is occluded in the face image is less than a predetermined value can be considered as a desirable state for highly reliable face recognition. The actions that allow the face image to be acquired from the center of the image and the actions that allow the degree to which the face is occluded in the face image to be less than a predetermined value may also be referred to as basic actions to be recognized. [3-1: Configuration of information processing device 3]

[0071] 7, the arithmetic device 21 included in the information processing device 3 may have, as a logically realized functional block or as a physically realized processing circuit, an image acquisition unit 211, a proficiency score calculation unit 212, an output unit 213, an authentication unit 214, a guidance output unit 315, and an entry / exit control unit 216, as well as a score addition unit 317. The score addition unit 317 adds a proficiency score when a child included in a face image is in a predetermined state. In other words, a predetermined state is when there is a factor that causes the proficiency score to be added.

[0072] The predetermined state may be a state desirable for highly reliable face authentication and a state desirable for highly reliable iris authentication. As described above, desirable states for highly reliable face authentication include a state in which the degree of match between the orientation of the child's face in the face image and the frontal orientation of the face is equal to or greater than a predetermined value, a state in which the face image is acquired from the center of the image, and a state in which the degree of occlusion of the child's face in the face image is less than a predetermined value. Also, as described above, desirable states for highly reliable iris authentication include a state in which the degree of occlusion of the child's iris in the face image is less than a predetermined value, a state in which the degree of focus of the child's iris in the face image is equal to or greater than a predetermined value, a state in which the degree of match between the center of the child's eye region in the face image and the position of the child's iris is equal to or greater than a predetermined value, and a state in which the degree of movement of the child's gaze is less than a predetermined value.

[0073] Therefore, the score adding unit 317 adds a proficiency score when the degree of agreement between the orientation of the child's face in the face image and the orientation of the front of the face is equal to or greater than a predetermined value, the degree to which the child's iris is obscured in the face image is less than a predetermined value, the degree to which the child's iris is focused in the face image is equal to or greater than a predetermined value, the degree to which the center of the child's eye area in the face image and the position of the child's iris match is equal to or greater than a predetermined value, or the degree to which the child's gaze moves is less than a predetermined value. Note that in this embodiment, the evaluations of the state in which the face image is acquired from the center of the image and the state in which the child's face in the face image is obscured to a less than predetermined value are included in the quality information when calculating the proficiency score, and are therefore excluded from the addition. [3-2: Information processing method executed by information processing device 3]

[0074] An information processing method executed by the information processing device 3 will be described with reference to Fig. 8. Fig. 8 is a flowchart showing an example of the flow of the information processing method executed by the information processing device 3.

[0075] 8, if a child in front of the camera CAM is detected (step S21: Yes), the imaging control unit 2111 controls the camera CAM to capture an image of the child in front of the CAM (step S22). The biometric information acquisition unit 2112 acquires a face image as biometric information (step S23). The proficiency score calculation unit 212 calculates the proficiency score (step S24).

[0076] The addition factor detection unit 3171 detects whether the child included in the face image is in the above-described predetermined state, i.e., whether there is a factor for adding a proficiency score (step S31). If it is detected that the child is in the above-described predetermined state (step S31: Yes), the score addition unit 317 adds a proficiency score (step S32). As described above, the score addition unit 317 adds a proficiency score when the degree of agreement between the child's facial orientation in the face image and the frontal orientation of the face is equal to or greater than a predetermined level, the degree to which the child's iris in the face image is hidden is less than a predetermined level, the degree to which the child's iris is focused in the face image is equal to or greater than a predetermined level, the degree to which the center of the child's eye region in the face image and the position of the child's iris are equal to or greater than a predetermined level, or the degree to which the child's line of sight moves is less than a predetermined level.

[0077] The matching score calculation unit 2141 calculates the matching score (step S25). The authentication unit 214 determines whether the biometric authentication is successful (step S26). If the biometric authentication is successful (step S26: Yes), the output unit 213 outputs the proficiency score (step S27). The output unit 213 may present the proficiency score to the child himself / herself. For example, the output unit 213 may output a comparison result between the current proficiency score and the previous or previous proficiency score. The entry / exit control unit 216 controls the door to open (step S28), allowing the child to enter and exit. [3-3: Variation 1]

[0078] If the child included in the face image is not in the predetermined state described above, guidance for bringing the child into the predetermined state may be output. In Modification 1, if the child is not in the predetermined state, guidance for bringing the child into the predetermined state is output. In Modification 1, by outputting guidance, the aim is to improve the proficiency of the action to be authenticated.

[0079] Variation 1 of the information processing method executed by the information processing device 3 will be described with reference to Fig. 9. Fig. 9 is a flowchart showing an example of the flow of Variation 1 of the information processing method executed by the information processing device 3. As shown in Fig. 9, when the addition element detection unit 3171 does not detect that the child included in the face image is in the above-mentioned predetermined state (step S31: No), the guidance output unit 315 outputs guidance for bringing the child into the above-mentioned predetermined state (step S33).

[0080] For example, if the degree of correspondence between the orientation of the child's face in the facial image and the orientation of the front of the face is not greater than a predetermined value, the guidance output unit 315 may output guidance instructing the child to face forward. Furthermore, if the degree to which the child's irises are obscured in the facial image is not less than a predetermined value, the guidance output unit 315 may output guidance instructing the child to open their eyes fully. Furthermore, if the degree to which the child's irises are focused in the facial image is not greater than a predetermined value, the guidance output unit 315 may output guidance instructing the child to move their face closer to the camera CAM (or move their face away from the camera CAM). Furthermore, if the degree of correspondence between the center of the child's eye region in the facial image and the position of the child's irises is not greater than a predetermined value, the guidance output unit 315 may output guidance instructing the child to look straight ahead. Furthermore, if the degree of movement of the child's line of sight is not less than a predetermined value, the guidance output unit 315 may output guidance instructing the child not to move their eyes.

[0081] The biometric information acquisition unit 2112 acquires a facial image of the child who has received the guidance (step S34). When it is detected that the child who has received the guidance is in a predetermined state, the score addition unit 317 adds a proficiency score (step S35). In other words, when a movement in accordance with the guidance is detected, the score addition unit 317 adds a proficiency score. Alternatively, when it is detected that the child is in a predetermined state within a predetermined time after receiving the guidance, the score addition unit 317 may add a proficiency score. [3-4: Variation 2]

[0082] Alternatively, when the proficiency score is smaller than a predetermined value, guidance for achieving a predetermined state may be output. In a second modification, when the proficiency score is smaller than a predetermined value, guidance for achieving a predetermined state may be output and the proficiency score may be increased.

[0083] As shown in FIG. 10, once the proficiency score is calculated (step S24), the guidance output unit 315 may determine whether the proficiency score is greater than a predetermined value (step S36). If the proficiency score is greater than the predetermined value (step S29: No), the process from step S25 onwards is carried out as in the above-described embodiment. If the proficiency score is less than the predetermined value (step S36: Yes), the guidance output unit 315 outputs guidance for the child to achieve the predetermined state described above (step S33). The biometric information acquisition unit 2112 acquires a facial image of the child who has received the guidance (step S34). If it is detected that the child who has received the guidance is in the predetermined state, the score addition unit 317 adds up the proficiency score (step S35). [3-5: Technical Effects]

[0084] The information processing device 3 according to this disclosure adds a proficiency score when a subject performs an action other than the basic action to be authenticated that improves the quality of biometric information. In this way, the information processing device 3 supports the subject in being able to perform actions other than the basic action to be authenticated that improve the quality of biometric information. Furthermore, by outputting guidance on actions that improve the quality of biometric information, the information processing device 3 enables the subject to perform more appropriate actions to be authenticated, and higher quality biometric information can be obtained. [4: Fourth embodiment]

[0085] A fourth embodiment of an information processing device, an information processing system, an information processing method, and a program will be described with reference to FIG. 11 . Hereinafter, the fourth embodiment of an information processing device, an information processing system, an information processing method, and a program will be described using an information processing device 4. Note that, for the fourth embodiment, descriptions that overlap with the descriptions of the first to third embodiments will be omitted as appropriate. In this embodiment, a case where the target is a child will be described as an example. Note that, in the drawings, parts common to the first to third embodiments are designated by the same reference numerals.

[0086] As shown in FIG. 11 , the arithmetic device 21 included in the information processing device 4 may include, as logically realized functional blocks or as physically realized processing circuits, an image acquisition unit 211, a proficiency score calculation unit 212, an output unit 413, an authentication unit 214, a guidance output unit 215, and an entry / exit control unit 216. The output unit 413 includes a ranking output means 4131. The ranking output means 4131 sorts and outputs information indicating each of a plurality of children according to the child's proficiency score. For example, the ranking output means 4131 may display the names of the children with the highest proficiency scores in descending order of proficiency score. For example, the ranking output means 4131 may display facial images of the children with the highest proficiency scores. The ranking output means 4131 may display the names of the children with the highest proficiency scores for each month. For example, the ranking output means 4131 may display a facial image of the child with the highest score once a month to award the child. The ranking output means 4131 may display the ranking of the proficiency score near the camera CAM. By displaying the ranking in a place that is easy to notice, it is expected that the child will make an effort to improve the proficiency of the authenticated action in order to increase the proficiency score.

[0087] As in the other embodiments, the output unit 413 may output information about the child's proficiency score to the child each time biometric authentication is performed. For example, the output unit 413 may output information praising the child for improving the proficiency of the action to be authenticated compared with the child's past actions to be authenticated. [Technical Effects]

[0088] The information processing device 4 according to this disclosure outputs a ranking of proficiency scores, allowing children to learn appropriate actions to be authenticated while competing with each other in a game-like manner. The information processing device 4 outputs a ranking of proficiency scores, which can increase children's motivation to master the actions to be authenticated. [5: Fifth embodiment]

[0089] A fifth embodiment of an information processing device, an information processing system, an information processing method, and a program will be described with reference to Figs. 12 and 13. Hereinafter, the fifth embodiment of an information processing device, an information processing system, an information processing method, and a program will be described using an information processing device 5. Note that, for the fifth embodiment, descriptions that overlap with the descriptions of the first to fourth embodiments will be omitted as appropriate. Note that, in the drawings, parts common to the first to fourth embodiments are denoted by the same reference numerals.

[0090] As shown in FIG. 12 , the arithmetic device 21 included in the information processing device 5 may include, as logically realized functional blocks or as physically realized processing circuits, an image acquisition unit 211, a proficiency score calculation unit 212, an output unit 213, an authentication unit 514, a guidance output unit 215, and an entry / exit control unit 216. The authentication unit 514 may include a matching score calculation unit 5141. In this embodiment, the operation of the authentication unit 514 may differ from the operation of an authentication unit (e.g., the authentication unit 214) in other embodiments. Furthermore, the operation of the matching score calculation unit 5141 may differ from the operation of a matching score calculation unit (e.g., the matching score calculation unit 2141) in other embodiments. In this embodiment, the authentication unit 514 determines whether to authenticate the target based on the matching score and the proficiency score.

[0091] The authentication unit 514 may set a matching threshold according to the proficiency score. The authentication unit 514 determines whether to authenticate the target based on a comparison between the matching score and the set matching threshold. For example, to prevent impersonation, the threshold for the matching score may be increased when the proficiency score is low. That is, the authentication unit 514 may set the matching threshold higher as the proficiency score decreases. In this case, if the proficiency score is relatively low, authentication will not be successful unless the matching score is relatively high. On the other hand, if the proficiency score is relatively high, authentication will be successful even if the matching score is relatively low.

[0092] Alternatively, in step S51, the matching score calculation unit 5141 may calculate a fusion score by combining the matching score and the proficiency score. For example, the matching score calculation unit 5141 may calculate the average value of the matching score and the proficiency score as the fusion score. The matching score calculation unit 5141 may calculate the fusion score by assigning different weights to the matching score and the proficiency score (for example, by calculating a weighted average of the matching score and the proficiency score). In this case, in step S52, the authentication unit 514 may determine whether or not to recognize the target as the registrant (i.e., whether or not authentication is successful) based on a comparison between the fusion score and a predetermined threshold. That is, in the fifth embodiment, the proficiency score is combined with the matching score, and the proficiency score is also used for the final authentication decision. [Technical Effects]

[0093] The information processing device 5 according to this disclosure can perform authentication taking into consideration the process of acquiring biometric information, etc., by using the proficiency score for authentication as well. [6: Sixth embodiment]

[0094] An information processing device, an information processing system, an information processing method, and a program according to a sixth embodiment will be described with reference to Figs. 14 and 15. Hereinafter, the sixth embodiment will be described using an information processing device 6. Note that, for the sixth embodiment, descriptions that overlap with the descriptions of the first to fifth embodiments will be omitted as appropriate. Note that, in the drawings, parts common to the first to fifth embodiments are designated by the same reference numerals.

[0095] The information processing device 6 may be a device that performs matching using biometric information, determines whether the target is an impersonator, and determines whether the target is recognized as the registered user (i.e., whether authentication is successful). The information processing device 6 may determine whether the biometric information used for matching is biometric information acquired from a living body, and determines whether the target can be authenticated. Examples of biometric information that is not acquired from a living body include information acquired from a counterfeit of a person the target is impersonating. Counterfeits of a person may include, for example, photographs of a person, objects such as displays displaying a person, and three-dimensional objects such as dolls impersonating a person and face masks made of silicone or the like. When the biometric information is a face image, information acquired from an image of the counterfeit of the person falls under the category of biometric information that is not acquired from a living body. When the biometric information is an iris image of the target, information acquired from an image of the counterfeit of the person or information acquired by capturing an image of the iris of a subject wearing a prosthetic eye falls under the category of biometric information that is not acquired from a living body.

[0096] 14, the arithmetic device 21 included in the information processing device 6 may have, as logically realized functional blocks or as physically realized processing circuits, an image acquisition unit 211, a proficiency score calculation unit 212, an output unit 213, an authentication unit 614, a guidance output unit 215, and an entry / exit control unit 216. The authentication unit 614 may have a matching score calculation unit 5141 and an impersonation determination score calculation unit 6142. In this embodiment, the cases in which the authentication unit 614 does not recognize the subject as the registrant (that is, does not determine that the authentication is successful) may include at least one of the cases in which it is determined that the subject is impersonating someone else and the case in which it is determined that the matching of biometric information has failed.

[0097] As shown in FIG. 15, once the proficiency score is calculated (step S24), the spoofing determination score calculation unit 6142 calculates the spoofing determination score (step S61). The spoofing determination score calculation unit 6142 may calculate the spoofing determination score using a face area included in an image captured by the camera CAM. Note that the more likely it is that the subject is the real person (in other words, not an impersonator), the larger the spoofing determination score may be. However, the more likely it is that the subject is the real person, the smaller the spoofing determination score may be. In the following, it is assumed that the more likely it is that the subject is the real person, the larger the spoofing determination score.

[0098] The spoofing determination score calculation unit 6142 may perform spoofing determination involving a target's behavior and calculate the spoofing determination score. Spoofing determination involving a target's behavior can be, for example, a method of prompting the target to perform a behavior and analyzing the behavior. The behavior of the target may be a behavior for achieving the above-mentioned predetermined state. In other words, in this embodiment, a behavior in response to the guidance may be used for spoofing determination. Note that the behavior of the target may be a behavior other than a behavior for achieving the predetermined state. For example, it may be a behavior such as blinking or shaking one's head.

[0099] The spoofing determination score calculation unit 6142 may perform spoofing determination without involving the target's movement and calculate the spoofing determination score. An example of spoofing determination without involving the target's movement is a method of shining light on the target and analyzing its reflection, shadow, etc. The light may be light using visible light. Alternatively, the light may be light using near-infrared light. Alternatively, the spoofing determination score calculation unit 6142 may analyze the temperature distribution within the image. Alternatively, the spoofing determination score calculation unit 6142 may analyze the brightness difference within the image.

[0100] The authentication unit 614 determines whether to authenticate the target based on the result of matching the biometric authentication with the registered information and the result of the spoofing determination. The spoofing determination is a determination based on a comparison between the spoofing determination score and the spoofing determination threshold. In the fifth embodiment, whether to authenticate the target is determined based on the proficiency score in addition to the matching score. In this embodiment, the spoofing determination score and the proficiency score are used to determine whether the target is spoofing. The authentication unit 614 determines whether to authenticate the target based on the matching score, the spoofing determination score, and the proficiency score.

[0101] The authentication unit 614 may set an impersonation judgment threshold according to the proficiency score. The authentication unit 614 determines whether or not a target is impersonating someone else based on a comparison between the impersonation judgment score and the set impersonation judgment threshold. For example, the authentication unit 614 may set the impersonation judgment threshold so that the lower the proficiency score, the higher the impersonation judgment threshold. In this case, if the proficiency score is relatively low, the impersonation judgment threshold becomes relatively high. Therefore, unless the impersonation judgment score is higher than the relatively high impersonation judgment threshold, it is determined that the target is not impersonating someone else. On the other hand, if the proficiency score is relatively high, the impersonation judgment threshold becomes relatively low. Therefore, if the impersonation judgment score is higher than the relatively low impersonation judgment threshold, it is determined that the target is not impersonating someone else.

[0102] Alternatively, in step S61, the spoofing determination score calculation unit 6142 may calculate a fusion score by combining the spoofing determination score and the proficiency score. For example, the spoofing determination score calculation unit 6142 may calculate the fusion score by averaging the spoofing determination score and the proficiency score. The spoofing determination score calculation unit 6142 may calculate the fusion score by assigning different weights to the spoofing determination score and the proficiency score (for example, by calculating a weighted average of the spoofing determination score and the proficiency score). In this case, in step S62, the authentication unit 614 may perform spoofing determination based on a comparison of the fusion score with a predetermined threshold, and determine whether to authenticate the target based on the comparison result of the biometric information. [Technical Effects]

[0103] The information processing device 6 according to this disclosure uses the proficiency score to determine whether a target is impersonating someone. The information processing device 6 can also use the matching score, the spoofing determination score, and the proficiency score to determine whether a target can be authenticated. [7: Seventh embodiment]

[0104] A seventh embodiment of an information processing device, an information processing system, an information processing method, and a program will be described with reference to FIGS. 16 and 17. Hereinafter, the seventh embodiment of an information processing device, an information processing system, an information processing method, and a program will be described using an information processing device 7. Note that, for the seventh embodiment, descriptions that overlap with the descriptions of the first to sixth embodiments will be omitted as appropriate. In this embodiment, a case where the target is a child will be described as an example. Note that, in the drawings, parts common to the first to sixth embodiments are designated by the same reference numerals. [7-1: Configuration of information processing device 7]

[0105] As shown in FIG. 16, the information processing device 7 includes a computing device 21, a storage device 22, a communication device 23, an input device 24, an output device 25, and a camera CAM, as well as a camera CAM7. The camera CAM7 captures an image within a predetermined area. The predetermined area may be, for example, a kindergarten classroom. The predetermined area may also be the interior of a school bus. The camera CAM7 may be a camera capable of capturing light in the visible wavelength range (a so-called visible light camera). The camera CAM7 may be a camera capable of capturing light in the near-infrared wavelength range (a so-called near-infrared camera). When the camera CAM7 is a near-infrared camera, it can obtain an image in which a child's face can be detected even when the predetermined area is dark.

[0106] 16, the arithmetic device 21 included in the information processing device 7 may include, as logically realized functional blocks or physically realized processing circuits, an image acquisition unit 211, a proficiency score calculation unit 212, an output unit 213, an authentication unit 214, a guidance output unit 215, and an entry / exit control unit 216, as well as an area image acquisition unit 718 and an alert output unit 719. The area image acquisition unit 718 acquires images output from the camera CAM7. For example, if the predetermined area is the interior of a school bus, the area image acquisition unit 718 acquires images captured of the interior of the school bus. The following description will be given taking the case where the predetermined area is the interior of a school bus as an example. The area image acquisition unit 718 may sequentially acquire images of the interior of the school bus captured by the camera CAM7. The area image acquisition unit 718 may include an administrator absence determination unit 7181 and a face detection unit 7182. The operations of the manager absence determining unit 7181, face detecting unit 7182, and alert output unit 719 will be described with reference to the flowchart of FIG. [7-2: Information Processing Method Executed by Information Processing Device 7]

[0107] An information processing method executed by the information processing device 7 will be described with reference to Fig. 17. Fig. 17 is a flowchart showing an example of the flow of the information processing method executed by the information processing device 7.

[0108] 17, the manager absence determination unit 7181 determines whether the bus driver, who is the manager who manages the interior of the school bus, is inside the school bus based on the image of the interior of the school bus (step S71). If the bus driver gets out of the school bus (step S71: Yes), the alert output unit 719 starts measuring time. If the time measured by the alert output unit 719 has exceeded a predetermined time (step S72: Yes) and the face detection unit 7182 has detected a child's face from the image of the interior of the school bus (step S73: Yes), the alert output unit 719 outputs an alert (step S74).

[0109] The alert output unit 719 may notify the bus driver of information indicating that a child is on the school bus. The alert output unit 719 may transmit information to a terminal device carried by the bus driver. The alert output unit 719 may notify a kindergarten staff member who operates the school bus of information indicating that a child is on the school bus. The alert output unit 719 may transmit information to a terminal device used by the kindergarten staff member who operates the school bus. The alert output unit 719 may identify who is on the school bus from the child's face, and notify the parent or guardian of the identified child of information indicating that a child is on the school bus. The alert output unit 719 may transmit information to a terminal device carried by the parent or guardian.

[0110] Furthermore, the alert output unit 719 may execute a predetermined process in response to the output of the alert. Examples of the predetermined process include operating the air conditioner inside the school bus, opening and closing the windows of the school bus, etc.

[0111] The bus driver's seat may also be equipped with a weight detection mechanism that detects changes in weight. The manager absence determination unit 7181 may use the weight detection mechanism to determine whether the bus driver is inside the school bus. For example, the weight detection mechanism may be realized by a spring or the like in the bus driver's seat. Note that the weight detection mechanism may also be provided in a location other than the bus driver's seat. In this case, the weight detection mechanism can be used to detect dangerous objects such as explosives, detect items left behind by passengers, etc. [7-3: Technical Effects]

[0112] For example, there are places where it is not desirable for children to freely exit, such as classrooms and school buses. It is particularly dangerous if children can freely disembark from a school bus. For this reason, it is preferable for school buses to be in a state where they can be disembarked by the bus driver or other personnel. On the other hand, if children cannot freely disembark from a school bus, a problem may occur in which children are left behind on the bus. The information processing device 7 according to this disclosure outputs an alert when a child is detected in a predetermined area where an administrator is not present, thereby preventing children from being left behind in a predetermined area, such as a school bus. [8: Eighth embodiment]

[0113] An eighth embodiment relating to an information processing device, an information processing system, an information processing method, and a program will be described. The information processing system according to the eighth embodiment performs the above-described information processing method. The information processing system according to the eighth embodiment may include one or more information processing devices (not shown). Each of the one or more information processing devices may include a calculation device 21, a storage device 22, a communication device 23, an input device 24, and an output device 25, similar to the information processing devices according to the other embodiments. In other embodiments, one information processing device performs the above-described information processing method, but in the eighth embodiment, one or more information processing devices may perform the above-described information processing method. That is, each of the multiple steps included in the above-described information processing method may be performed by a different information processing device. For example, some of the multiple steps included in the above-described information processing method may be performed by a first information processing device, and the remaining steps of the multiple steps included in the above-described information processing method may be performed by a second information processing device. [9: Note] Some or all of the above embodiments can be described as, but are not limited to, the following supplementary notes. [Appendix 1] an acquisition means for acquiring biometric information of a target; a proficiency score calculation means for calculating a proficiency score indicating a proficiency of an action for authentication using the biometric information based on at least one of time information indicating a time related to authentication using the biometric information and quality information indicating a quality of the biometric information; and an output means for outputting information related to the proficiency score; An information processing device comprising: [Appendix 2] The biological information is acquired from an image taken by imaging. The time required for the authentication using the biometric information is: The time from the start of the imaging to the acquisition of the biological information. 10. The information processing device according to claim 1. [Appendix 3] the acquiring means acquires the biometric information from an image; The quality information is generated based on at least one of the position of the biometric information in the image and the degree to which the area of ​​the biometric information in the image is hidden. 10. The information processing device according to claim 1. [Appendix 4] The proficiency score calculation means The shorter the time required for authentication using the biometric information, the higher the calculated proficiency score. The more the area of ​​the biometric information in the image is included in the central part of the image, the higher the proficiency score is calculated; The more the area of ​​the biometric information in the image is not hidden, the higher the calculated proficiency score. 3. The information processing device according to claim 2. [Appendix 5] an operation for acquiring the biometric information in a shorter time than when the proficiency score is calculated; an operation for including the biometric information in a central portion of the image; and a guidance output unit that outputs guidance for an action including at least one action for preventing the area of ​​the biometric information in the image from being hidden; 3. The information processing device according to claim 2. [Appendix 6] When the proficiency score is lower than a predetermined value, the guidance output means outputs guidance for the action. 6. The information processing device according to claim 5. [Appendix 7] the biological information is a partial image acquired from an image captured by imaging, a detection means for detecting that the object included in the partial image is in a predetermined state; an adding means for adding the proficiency score when it is detected that the target is in the predetermined state; Equipped with 10. The information processing device according to claim 1. [Appendix 8] the partial image is a face image, The predetermined state is a state in which the degree of agreement between the face direction of the subject in the face image and the front direction of the face is equal to or greater than a predetermined value; a state in which the degree to which the iris of the subject in the face image is occluded is less than a predetermined value; a state in which the degree of focus of the iris in the face image is equal to or greater than a predetermined value; A state in which the degree of coincidence between the center of the eye region of the subject in the face image and the position of the iris is equal to or greater than a predetermined value; and A state in which the degree of movement of the subject's line of sight is less than a predetermined value Includes at least one of 8. The information processing device according to claim 7. [Appendix 9] a guidance output means for outputting guidance for bringing the object into the predetermined state when the detection means does not detect that the object included in the partial image is in the predetermined state, The adding means adds the proficiency score when it is detected that the target who has received the guidance is in the predetermined state. 8. The information processing device according to claim 7. [Appendix 10] The output means sorts and outputs information indicating the plurality of objects according to the proficiency score corresponding to the object. 10. The information processing device according to claim 1. [Appendix 11] and an authentication means for authenticating the target using the biometric information. 10. The information processing device according to claim 1. [Appendix 12] The authentication means authenticates the subject based on a matching score calculated by matching the biometric information with registered biometric information of the subject. 12. The information processing device according to claim 11. [Appendix 13] The authentication means determines whether to authenticate the target based on the matching score and the proficiency score. 13. The information processing device according to claim 12. [Appendix 14] The authentication means sets a matching threshold in accordance with the proficiency score, and determines whether to authenticate the target based on a comparison between the matching score and the matching threshold. 13. The information processing device according to claim 12. [Appendix 15] The authentication means calculates a spoofing determination score, and determining whether the target is impersonating another based on the impersonation determination score and the proficiency score. 12. The information processing device according to claim 11. [Appendix 16] The authentication means sets a spoofing determination threshold in accordance with the proficiency score, and determines whether the target is spoofing based on a comparison between the spoofing determination score and the spoofing determination threshold. 12. The information processing device according to claim 11. [Appendix 17] an imaging means for imaging a predetermined area; a face detection means for detecting a face of the subject from an image within the area captured by the imaging means; an alert output means for outputting alert information when the face is detected in a situation where a predetermined time has elapsed since an administrator who manages the predetermined area has left the predetermined area; Equipped with 10. The information processing device according to claim 1. [Appendix 18] The biological information is acquired from an image taken by imaging. The time required for the authentication using the biometric information is: The time from the start of the imaging to the successful authentication using the biometric information. 10. The information processing device according to claim 1. [Appendix 19] If the proficiency score is lower than a predetermined value, the detection means detects that the object included in the partial image is in a predetermined state; when the detection means does not detect that the object included in the partial image is in the predetermined state, the guidance output means outputs guidance for causing the object to become the predetermined state; The adding means adds the proficiency score when it is detected that the target is in the predetermined state. 10. The information processing device according to claim 9. [Appendix 20] 1. A computer-implemented information processing method, comprising: Acquire the subject's biometric information, calculating a proficiency score indicating a proficiency of an action for authentication using the biometric information based on at least one of a time required for authentication using the biometric information and quality information indicating quality of the biometric information; Outputting information about the proficiency score Information processing methods. [Appendix 21] On the computer, Acquire the subject's biometric information, calculating a proficiency score indicating a proficiency of an action for authentication using the biometric information based on at least one of a time required for authentication using the biometric information and quality information indicating quality of the biometric information; Outputting information about the proficiency score A program that executes an information processing method. [Appendix 22] an acquisition means for acquiring biometric information of a target; a proficiency score calculation means for calculating a proficiency score indicating a proficiency of an action for authentication using the biometric information, based on at least one of time information indicating a time related to authentication using the biometric information and quality information indicating a quality of the biometric information; and an output means for outputting information related to the proficiency score; An information processing system comprising:

[0114] Furthermore, some or all of the configurations described in Supplementary Notes 2 to 18, which are dependent on Supplementary Notes 1 described above, and Supplementary Notes 19 and 20 may also be dependent in the same manner as Supplementary Notes 2 to 18. Furthermore, not limited to Supplementary Notes 1, 19, and 20, some or all of the configurations described as Supplements may be made dependent on various hardware, software, various recording means for recording software, or systems, within the scope of each of the above-mentioned embodiments.

[0115] This disclosure may be modified as appropriate within the scope that does not contradict the gist or idea of ​​the invention that can be read from the claims and the entire specification, and information processing devices, information processing systems, information processing methods, and programs that involve such modifications are also included in the technical idea of ​​this disclosure. [Explanation of symbols]

[0116] 1,2,3,4,5,6,7 Information processing device 11 acquired part 12,212 Proficiency score calculation section 13,213,413 Output section 211 Image acquisition unit 2111 Imaging control unit 2112 Biometric information acquisition unit 2121 Time calculation section 2122 Quality information generation section 214,514,614 Authentication Department 2141,5141 Matching score calculation unit 215,315 Guidance output section 216 Entrance / Exit Control Unit 317 Score Addition Section 3171 Addition element detection unit 4131 Ranking output means 6142 Spoofing judgment score calculation unit 718 Area Image Acquisition Unit 7181 Administrator absence determination unit 7182 Face detection unit 719 Alert Output Unit

Claims

1. an acquisition means for acquiring biometric information of a target; a proficiency score calculation means for calculating a proficiency score indicating a proficiency of an action for authentication using the biometric information, based on at least one of time information indicating a time related to authentication using the biometric information and quality information indicating a quality of the biometric information; and an output means for outputting information related to the proficiency score; An information processing device comprising:

2. The biological information is acquired from an image taken by imaging. the time related to the authentication using the biometric information is the time from the start of the imaging to the acquisition of the biometric information, The quality information is generated based on at least one of the position of the biometric information in the image and the degree to which the area of ​​the biometric information in the image is hidden. The information processing device according to claim 1 .

3. an operation for acquiring the biometric information in a shorter time than when the proficiency score is calculated; an operation for including the biometric information in a central portion of the image; and a guidance output unit that outputs guidance for an action including at least one action for preventing the area of ​​the biometric information in the image from being hidden; The information processing device according to claim 2 .

4. the biological information is a partial image acquired from an image captured by imaging, a detection means for detecting that the object included in the partial image is in a predetermined state; an adding means for adding the proficiency score when it is detected that the target is in the predetermined state; The information processing device according to claim 1 , comprising:

5. The output means sorts and outputs information indicating the plurality of objects according to the proficiency score corresponding to the object. The information processing device according to claim 1 .

6. and an authentication means for determining whether to authenticate the subject based on a matching score calculated by matching the biometric information with registered biometric information of the subject and the proficiency score. The information processing device according to claim 1 .

7. an imaging means for imaging a predetermined area; a face detection means for detecting a face of the subject from an image within the area captured by the imaging means; an alert output means for outputting alert information when the face is detected in a situation where a predetermined time has elapsed since an administrator who manages the predetermined area has left the predetermined area; The information processing device according to claim 1 , comprising:

8. an acquisition means for acquiring biometric information of a target; a proficiency score calculation means for calculating a proficiency score indicating a proficiency of an action for authentication using the biometric information, based on at least one of time information indicating a time related to authentication using the biometric information and quality information indicating a quality of the biometric information; and an output means for outputting information related to the proficiency score; An information processing system comprising:

9. 1. A computer-implemented information processing method, comprising: Acquire the subject's biometric information, calculating a proficiency score indicating a proficiency level of an action for authentication using the biometric information based on at least one of time information indicating a time related to authentication using the biometric information and quality information indicating a quality of the biometric information; Outputting information about the proficiency score Information processing methods.

10. On the computer, Acquire the subject's biometric information, calculating a proficiency score indicating a proficiency level of an action for authentication using the biometric information based on at least one of time information indicating a time related to authentication using the biometric information and quality information indicating a quality of the biometric information; Outputting information about the proficiency score A program that executes an information processing method.

Images