Information processing device, information processing method, and recording medium

Abstract

This information processing device is provided with: a first acquisition means that acquires first identification information that can identify a target; an authentication means that executes authentication processing using the first identification information; a first output means that outputs first message information indicating that the authentication processing has been completed if the authentication processing has been completed; a second acquisition means that acquires second identification information that can identify a target; an assessment means that, by comparing the first identification information and the second identification information, assesses whether or not the target has been replaced; and a second output means that, on the basis of results of the assessment, outputs second message information for the target for which the second identification information was acquired. With this information processing device, it is possible to appropriately execute authentication processing for a target.

Description

Information processing device, information processing method, and recording medium

[0001] The present disclosure relates to the technical fields of an information processing device, an information processing method, and a recording medium.

[0002] Known examples of this type of device include a device that performs authentication processing for a target. For example, Patent Document 1 discloses a technology that performs identity verification processing using personal information, identification card information, and an image of the target acquired from the target.

[0003] Japanese Patent Application Laid-Open No. 2019-106018

[0004] An object of this disclosure is to provide an information processing device, an information processing method, and a recording medium that aim to improve upon the techniques disclosed in prior art documents.

[0005] One aspect of the information processing device disclosed herein comprises a first acquisition means for acquiring first identification information capable of identifying a target, an authentication means for performing an authentication process using the first identification information, a first output means for outputting first message information indicating that the authentication process has been completed when the authentication process is completed, a second acquisition means for acquiring second identification information capable of identifying the target after the first message information has been output, a determination means for determining whether the target has been swapped by comparing the first identification information with the second identification information, and a second output means for outputting second message information directed to the target for which the second identification information has been acquired based on the result of the determination.

[0006] One aspect of the information processing method disclosed herein involves at least one computer acquiring first identification information capable of identifying a target, performing an authentication process using the first identification information, and outputting first message information indicating that the authentication process has been completed when the authentication process is complete, acquiring second identification information capable of identifying the target after the output of the first message information, comparing the first identification information with the second identification information to determine whether the target has been swapped, and outputting second message information directed to the target for which the second identification information was acquired based on the result of the determination.

[0007] One aspect of the recording medium of this disclosure is a recording medium having recorded thereon a computer program that causes at least one computer to execute an information processing method, which includes acquiring first identification information capable of identifying a target, performing an authentication process using the first identification information, and outputting, when the authentication process is completed, first message information indicating that the authentication process has been completed, acquiring second identification information capable of identifying the target after outputting the first message information, comparing the first identification information with the second identification information to determine whether the target has been switched, and outputting, based on the result of the determination, second message information directed to the target for which the second identification information was acquired.

[0008] 1 is a block diagram showing the hardware configuration of a first information processing device. 2 is a block diagram showing the functional configuration of the first information processing device. 3 is a flowchart showing the flow of authentication operation by the first information processing device. 4 is a flowchart showing the flow of authentication operation by the second information processing device. 5 is a side view showing an example of the device configuration of a third information processing device. 6 is a flowchart showing the flow of authentication operation by the third information processing device. 7 is a block diagram showing the functional configuration of a fourth information processing device. 8 is a flowchart showing the flow of an abnormality detection operation by the fourth information processing device.

[0009] Hereinafter, embodiments of an information processing device, an information processing method, and a recording medium will be described with reference to the drawings.

[0010] First Embodiment A first information processing apparatus will be described with reference to FIGS. 1 to 3. FIG.

[0011] (Hardware Configuration) First, the hardware configuration of the first information processing apparatus will be described with reference to Fig. 1. Fig. 1 is a block diagram showing the hardware configuration of the first information processing apparatus.

[0012] 1, the first information processing device 1 includes a processor 11, a RAM (Random Access Memory) 12, a ROM (Read Only Memory) 13, a storage device 14, an input device 15, and an output device 16. The processor 11, RAM 12, ROM 13, storage device 14, input device 15, and output device 16 are connected to each other via a data bus 17. The data bus 17 may be an interface other than a data bus (for example, a LAN, a USB, etc.).

[0013] The processor 11 loads a computer program. For example, the processor 11 is configured to load a computer program stored in at least one of the RAM 12, the ROM 13, and the storage device 14. Alternatively, the processor 11 may load a computer program stored in a computer-readable storage medium using a storage medium reading device (not shown). The processor 11 may acquire (i.e., load) the computer program from a device (not shown) located outside the first information processing device 1 via a network interface. The processor 11 executes the loaded computer program to perform various processes. When the processor 11 executes the loaded computer program, functional blocks related to the processes performed by the first information processing device 1 are realized within the processor 11. In other words, the processor 11 may function as a controller that executes each control in the first information processing device 1.

[0014] The processor 11 may be configured as, for example, a central processing unit (CPU), a graphics processing unit (GPU), a field-programmable gate array (FPGA), a digital signal processor (DSP), an application-specific integrated circuit (ASIC), or a quantum processor. The processor 11 may be configured as one of these, or may be configured to use multiple processors in parallel.

[0015] The RAM 12 temporarily stores computer programs executed by the processor 11. The RAM 12 temporarily stores data that the processor 11 temporarily uses while it is executing the computer programs. The RAM 12 may be, for example, a dynamic random access memory (D-RAM) or a static random access memory (SRAM). Alternatively, other types of volatile memory may be used instead of the RAM 12.

[0016] The ROM 13 stores computer programs executed by the processor 11. The ROM 13 may also store fixed data. The ROM 13 may be, for example, a programmable read-only memory (PROM) or an erasable read-only memory (EPROM). Alternatively, other types of non-volatile memory may be used instead of the ROM 13.

[0017] The storage device 14 stores data that is to be saved long-term by the information processing device 1. The storage device 14 may operate as a temporary storage device for the processor 11. The storage device 14 may store computer programs executed by the processor 11. The storage device 14 may include, for example, at least one of a hard disk device, a magneto-optical disk device, an SSD (Solid State Drive), and a disk array device.

[0018] The input device 15 is a device that receives input instructions from a user of the information processing device 1. The input device 15 may include, for example, at least one of a keyboard, a mouse, and a touch panel. The input device 15 may also be, for example, a device that includes a microphone and is capable of voice input.

[0019] The output device 16 is a device that outputs information related to the information processing device 1 to the outside. For example, the output device 16 may be a display device (e.g., a display or a monitor) that can display information related to the information processing device 1. The output device 16 may also be a speaker or the like that can output information related to the information processing device 1 as audio.

[0020] The first information processing device 1 may be configured to include some of the components described in Fig. 1. For example, the first information processing device 1 may be configured to include only the processor 11, RAM 12, and ROM 13 among the above-mentioned components. In this case, the storage device 14, input device 15, and output device 16 may each be provided as a device external to the first information processing device 1. Furthermore, some of the calculation functions of the first information processing device 1 may be realized by an external server, a cloud, or the like.

[0021] (Functional Configuration) Next, the functional configuration of the first information processing device 1 will be described with reference to Fig. 2. Fig. 2 is a block diagram showing the functional configuration of the first information processing device.

[0022] 2, the first information processing device 1 is configured to be able to execute authentication processing of the target using identification information acquired from the target. The first information processing device 1 is configured to include, as components for realizing its functions, a first identification information acquisition unit 110, an authentication unit 120, a first output unit 130, a second identification information acquisition unit 140, a determination unit 150, and a second output unit 160. Note that each of the first identification information acquisition unit 110, the authentication unit 120, the first output unit 130, the second identification information acquisition unit 140, the determination unit 150, and the second output unit 160 may be a processing block realized by the above-mentioned processor 11 (see FIG. 1).

[0023] The first identification information acquisition unit 110 is configured to acquire first identification information. The first identification information is information that can identify a target. For example, the first identification information may be information acquired from an identification card (e.g., an ID card, a driver's license, a My Number card, a passport, etc.) held by the target or a device (e.g., a smartphone, etc.) held by the target. In this case, the first identification information acquisition unit may acquire the first identification information by scanning the identification card held by the target or by communicating with the device held by the target. Alternatively, the first identification information may be information acquired from the target's biological information (e.g., information related to the face, iris, fingerprint, palm print, etc.). In this case, the first identification information acquisition unit 110 may, for example, detect a specific biological part from an image of the target and acquire the first identification information from the detected part. The first identification information may include multiple types of information. The first identification information acquired by the first identification information acquisition unit 110 is configured to be output to each of the authentication unit 120 and the determination unit 150.

[0024] The authentication unit 120 is configured to be able to perform authentication processing of a target using the first identification information acquired by the first identification information acquisition unit 110. The authentication unit 120 may perform authentication processing of a target by matching using the first identification information. Specifically, the authentication unit 120 may authenticate whether the target is the registered user by matching the first identification information with pre-registered registration information (i.e., information of the registered user). The authentication unit 120 may calculate an authentication score indicating the degree of match between the first identification information and the registration information, and determine that the target is the registered user if the authentication score is equal to or greater than a predetermined threshold. The authentication unit 120 may perform 1:1 authentication by matching the first identification information with one piece of registration information. Alternatively, the authentication unit 120 may perform 1:N authentication by matching the first identification information with multiple pieces of registration information. Information regarding the result of the authentication processing by the authentication unit 120 (hereinafter referred to as the "authentication result") is configured to be output to the first output unit 130. The authentication result by the authentication unit 120 may be output to an external device capable of executing various processes based on the authentication result. For example, the authentication result may be output to a gate device installed at the entrance of a facility. In this case, the gate device may execute a process to allow a target whose authentication process has been successful to pass through the gate, and to prohibit a target whose authentication process has failed from passing through the gate.

[0025] The first output unit 130 is configured to output first message information when the authentication process by the authentication unit 120 is completed. Here, "when the authentication process is completed" typically refers to when the target authentication process is successful, but may also refer to when the target authentication process fails, or when the authentication process is stopped without being successfully executed (e.g., when an error occurs). The first message information is information indicating that authentication has been completed. For example, the first message information may include a message such as "Authentication has been successful." In this case, the first output unit 130 may display the first message information on a display. Alternatively, the first output unit 130 may output the first message information audibly through a speaker. The first message information may also be information indicating that authentication has been completed other than a message (i.e., words or sentences). For example, the first message information may be information including an image indicating that authentication has been completed (e.g., an image of a circle indicating successful authentication or an X indicating unsuccessful authentication), or may be information that causes a light or the like to flash in a color indicating that authentication has been completed (e.g., blue indicating successful authentication or red indicating unsuccessful authentication).

[0026] The second identification information acquisition unit 140 is configured to acquire the second identification information. The second identification information, like the first identification information, is information capable of identifying an object. The second identification information may be the same type of information as the first identification information, or may be a different type of information from the first identification information. When the first identification information and the second identification information are the same type of information, the second identification information acquisition unit 140 may acquire the second identification information using the same method as the first identification information acquisition unit 110 acquires the first identification information. In other words, the first identification information acquisition unit 110 and the second identification information acquisition unit 140 may acquire the first identification information and the second identification information using common hardware (e.g., the same camera, scanner, etc.). The second identification information acquisition unit 140 is particularly configured to acquire the second identification information after the first output unit 130 outputs the first message information. That is, the second identification information acquisition unit 140 acquires the second identification information after the authentication process using the first identification information is completed and the first message information indicating the completion of the authentication process is output. The second identification information acquired by the second identification information acquisition unit 140 is configured to be output to the determination unit 150.

[0027] The determination unit 150 is configured to be able to determine whether the objects have been swapped by comparing the first identification information with the second identification information. Specifically, the determination unit 150 may determine that the objects have been swapped if the first identification information and the second identification information do not match. For example, if the authentication process for a target is successful, it is considered that the target will be swapped with the next target (e.g., the target behind it in line). In this case, the second identification information will be acquired from a target other than the target from which the first identification information was acquired. Therefore, the first identification information and the second identification information do not match, and the determination unit 150 can determine that the objects have been swapped. Furthermore, the determination unit 150 may determine that the objects have not been swapped if the first identification information and the second identification information match. For example, even if the authentication process for a target is successful, if the target is unfamiliar with the target, it may not recognize that the authentication process was successful. In such a case, it is considered that the target will not be swapped with the next target and will attempt to continue the authentication process. In this case, the second identification information is acquired from the same target from which the first identification information was acquired. Therefore, the first identification information and the second identification information match, and the determination unit 150 can determine that the target has not been swapped. The matching of the first identification information and the second identification information by the determination unit 150 may be performed as a tracking process using the target's biometric information. For example, the determination unit 150 temporarily stores facial information of the target acquired as the first identification information. Then, the determination unit 150 performs a tracking process while acquiring facial information of the current target as second identification information based on the stored facial information. During tracking of the target, the stored facial information (i.e., the first identification information) matches the acquired facial information (i.e., the second identification information), so the determination unit 150 continues to determine that the target has not been swapped. On the other hand, if the target's face moves out of the tracking range and facial information of another target is acquired as second identification information, the determination unit 150 determines that the target has been swapped. The determination result by the determination unit 150 is output to the second output unit 160 .

[0028] The second output unit 160 is configured to output second message information to a target that has acquired the second identification information. The second message information may be the same type of information as the first message information, or may be a different type of information from the first message information. When the first message information and the second message information are the same type, the second output unit 160 may output the second message information in the same manner as the first output unit 130 outputs the first message information. In other words, the first output unit 130 and the second output unit 160 may output the first message information and the second message information using common hardware (e.g., the same display, speaker, etc.). The second output unit 160 outputs the second message information based on the determination result of the determination unit 150. For example, the second output unit 160 may change the content of the second message information based on the determination result of the determination unit 150. Specifically, the second output unit 160 may output a second message having different content depending on whether the determination unit 150 determines that the targets have been swapped or not. Alternatively, the second output unit 160 may change whether to output the second message information based on the determination result by the determination unit 150. Specifically, the second output unit 160 may output the second message information when the determination unit 150 determines that the targets have not been swapped, and may not output the second message information when the determination unit 150 determines that the targets have been swapped. Specific examples of the second message information will be described in detail in other embodiments described later.

[0029] (Authentication Operation) Next, the flow of the authentication operation (i.e., the operation when executing the target authentication process) by the first information processing device 1 will be described with reference to Fig. 3. Fig. 3 is a flowchart showing the flow of the authentication operation by the first information processing device.

[0030] 3, when the authentication operation by the first information processing device 1 is started, the first identification information acquisition unit 110 first acquires first identification information from the target (step S101). Then, the authentication unit 120 executes authentication processing of the target using the first identification information acquired by the first identification information acquisition unit 110 (step S102).

[0031] Next, when the authentication process by the authentication unit 120 is completed, the first output unit 130 outputs first message information indicating that the authentication process is completed (step S103). Note that if the authentication process is not completed, the processes from step S103 onwards are not executed. In this case, the first information processing device 1 may repeatedly execute the processes of steps S101 and S102.

[0032] After the first output unit 130 outputs the first message information, the second identification information acquisition unit 140 acquires the second identification information from the target (step S104). Then, the determination unit 150 compares the first identification information used in the authentication process with the newly acquired second identification information to determine whether the target has been replaced (step S105).

[0033] Next, the second output unit 160 outputs the second message information based on the determination result of the determination unit 150 (step S106). Note that when changing whether or not to output the second message based on the determination result of the determination unit 150, the processing of step S106 may be omitted.

[0034] (Technical Effects) Next, technical effects obtained by the first information processing device 1 will be described.

[0035] 1 to 3, in the first information processing device 1, when the authentication process using the first identification information is completed, a first message indicating that the authentication process is completed is output. After the first message is output, whether or not the target has been replaced is determined using the second identification information, and a second message is output. In this way, it is possible to output appropriate information depending on whether the target has been replaced after the authentication process is completed.

[0036] For example, even if the authentication process is completed, if the target does not understand that the authentication process has been completed, the target may try to continue the authentication process. If such a target exists, the authentication process will be executed multiple times for the same target. In other words, unnecessary authentication processes will be executed. Furthermore, the execution of unnecessary authentication processes will make the authentication process per person take a long time, significantly reducing throughput. This may cause stress or anger to other targets waiting in line behind them.

[0037] However, according to the first information processing device 1, when the authentication process is completed, first message information is output, and the target is notified that the authentication process is completed. Furthermore, the first information processing device 1 determines whether the target has been replaced and outputs second message information. By outputting the first message information and the second message information in this manner, it is possible to convey appropriate information to the target performing the authentication process. For example, it is possible to encourage a target who does not want to be replaced even after the authentication process is completed to be replaced. Therefore, it is possible to prevent unnecessary authentication processes from being performed multiple times and to prevent a decrease in throughput due to an increase in the time required for authentication.

[0038] To cite a more specific example, at immigration checkpoints at international airports, hundreds of entrants undergo immigration control every time an aircraft arrives. During peak arrival times, thousands of people may line up in front of dozens of automated immigration control devices. The automated immigration control devices perform authentication processing using, for example, passports or facial images. However, since many of the subjects undergoing immigration control are elderly or non-English speakers, the aforementioned unnecessary authentication processing may be repeatedly performed, resulting in a significant decrease in throughput. Therefore, applying the first information processing device 1 to an automated immigration control device can solve the above-mentioned problem. Specifically, by outputting appropriate messages to subjects undergoing immigration control, it is possible to efficiently perform the authentication processing during immigration control.

[0039] Second Embodiment A second information processing device 1 will be described with reference to Fig. 4. The second information processing device 1 differs in some configurations and operations from the first information processing device 1 described above, but other parts may be similar to the first information processing device 1. Therefore, the following will describe in detail the parts that differ from the first embodiment, and will omit explanations of other overlapping parts as appropriate.

[0040] (Authentication Operation) First, the flow of authentication operation by the second information processing device 1 will be described with reference to Fig. 4. Fig. 4 is a flowchart showing the flow of authentication operation by the second information processing device. Note that in Fig. 4, the same processes as those shown in Fig. 3 are denoted by the same reference numerals.

[0041] 4, when the second information processing device 1 starts an authentication operation, the first identification information acquisition unit 110 first acquires first identification information from the target (step S101). Then, the authentication unit 120 executes authentication processing of the target using the first identification information acquired by the first identification information acquisition unit 110 (step S102).

[0042] Next, when the authentication process by the authentication unit 120 is completed, the first output unit 130 outputs first message information indicating that the authentication process is completed (step S103). Thereafter, the second identification information acquisition unit 140 acquires second identification information from the target (step S104).

[0043] Next, the determination unit 150 compares the first identification information used in the authentication process with the newly acquired second identification information to determine whether the target has been swapped (step S105). If it is determined that the target has not been swapped (step S201: NO), the second output unit 160 outputs second message information to the target encouraging the target to swap (step S202). For example, the second output unit 160 may output a message to the target that has not been swapped, saying, "Authentication is complete. Please take over with the next person."

[0044] After the second message information is output in step S202, the process is executed again from step S104. By repeating the process in this manner, the next authentication process will not be executed until the target is changed. In other words, it is possible to prevent the authentication process from being executed multiple times for the same target.

[0045] On the other hand, if it is determined that the target has been swapped (step S201: YES), the second output unit 160 outputs second message information to the target indicating that the authentication process will proceed (step S203). For example, the second output unit 160 may output a message saying "Authentication will begin" to the swapped target. Note that if it is determined that the target has been swapped, the second output unit 160 may not output the second message. In this case, the processing of step S203 may be omitted.

[0046] Next, the authentication unit 120 executes the authentication process using the second identification information acquired from the replaced target (step S204). That is, the authentication unit 120 executes the authentication process using the second identification information used to determine whether the target has been replaced. However, the authentication unit 120 may execute the authentication process by newly acquiring second identification information from the target, separate from the information used to determine whether the target has been replaced.

[0047] When the authentication process executed in step S204 is completed, first message information indicating that the authentication process is completed may be output. That is, when the authentication process executed in step S204 is completed, the process of step S103 may be executed again. In this case, the authentication process in step S204 is essentially executed as the authentication process of step S102 for another target. By repeating the process in this manner, authentication processes may be executed consecutively for multiple targets.

[0048] (Technical Effects) Next, technical effects obtained by the second information processing device 1 will be described.

[0049] As described in FIG. 4 , in the second information processing device 1, if the target has not been replaced, second message information prompting the user to replace the target with the next target is output. This makes it possible to prevent a target that has completed authentication processing from remaining in the same location, resulting in unnecessary authentication processing being executed multiple times and reducing throughput. Furthermore, in the second information processing device 1, if the target has been replaced, authentication processing is executed for the target after the replacement. This makes it possible to execute authentication processing for multiple targets consecutively, thereby enabling the authentication processing to continue more efficiently.

[0050] <Third embodiment> A third information processing device 1 will be described with reference to Figures 5 and 6. The third information processing device 1 differs in some configurations and operations from the first and second information processing devices 1 described above, but other parts may be similar to the first and second information processing devices 1. Therefore, the following will describe in detail the parts that differ from the embodiments already described, and will omit explanations of other overlapping parts as appropriate.

[0051] (Device Configuration) First, the device configuration of the third information processing device 1 will be described with reference to Fig. 5. Fig. 5 is a side view showing an example of the device configuration of the third information processing device.

[0052] 5, the third information processing device 1 is configured to be able to acquire identification card information, which is a specific example of personal belongings information, and facial information, which is a specific example of biometric information. Specifically, the third information processing device 1 acquires the identification card information by scanning the identification card held by the subject 50 using a scanner 21. The third information processing device 1 also acquires facial information by capturing an image of the subject's face using a facial camera 22. The identification card information and facial information can be acquired as first identification information and second identification information, respectively. That is, the first identification information acquisition unit 110 in the third information processing device 1 acquires the identification card information and facial information as the first identification information. The second identification information acquisition unit 140 in the third information processing device 1 acquires the identification card information and facial information as the first identification information.

[0053] The display 30 is configured to display the first message information and the second message information. The display 30 may also be configured to display the face of the target captured by the face camera 22 in real time. In this case, the first message information and the second message information may be displayed superimposed on the target's face. The display 30 may also be configured to include a speaker. In this case, the first message information and the second message information may be output as audio using the speaker built into the display 30.

[0054] (Authentication Operation) Next, the flow of the authentication operation by the third information processing device 1 will be described with reference to Fig. 6. Fig. 6 is a flowchart showing the flow of the authentication operation by the third information processing device. The following description will be given on the assumption that authentication processes for multiple targets are executed consecutively.

[0055] 6, in the authentication operation by the third information processing device 1, the subject 50 first holds his / her identification card over the scanner 21. The scanner 21 then scans the identification card 60 held by the subject 50 to obtain identification card information (step S301).

[0056] Next, the determination unit 150 determines whether the identification information acquired in step S301 matches the identification information acquired previously (i.e., the identification information acquired by the scanner 21 before step S301) (step S302). In step S302, the determination unit 150 uses the identification information to determine whether the target 50 has been replaced. In other words, the identification information in step S302 is treated as second identification information.

[0057] If the identification information matches the previous one (YES in step S302), the determination unit 150 determines that the target 50 has not been swapped. If it is determined that the target 50 has not been swapped, the second output unit 160 outputs second message information to the target 50 urging the target 50 to swap (step S303). In this case, the processes in steps S304 to S306 are omitted.

[0058] On the other hand, if the identification information does not match the previous one (step S302: NO), the determination unit 150 determines that the target 50 has not been swapped. If it is determined that the target 50 has been swapped, the face camera 22 captures an image of the face of the target 50 to acquire face information (step S304). Note that the second output unit 160 may output second message information stating "A face image will be captured" when capturing an image of the face of the target 50. In other words, the second message information indicating that the authentication process will proceed may be output.

[0059] Once the facial information is acquired, the authentication unit 120 performs authentication processing using the identification information and facial information (step S305). That is, the identification information and facial information here are treated as first identification information. The authentication unit 120 may perform authentication processing of the target 50 by comparing both the identification information and the facial information with registered information registered in a database. Alternatively, the authentication unit 120 may perform authentication processing of the target 50 by comparing the identification information with the facial information (for example, by comparing the facial information of the target included in the identification information with the facial information acquired from a facial image).

[0060] When the authentication process by the authentication unit 120 is completed, the first output unit 130 outputs first message information indicating that the authentication process is completed (step S306). Then, the scanner 21 temporarily becomes unable to read the identification information (step S307). Here, by making the identification information unreadable, a new authentication process is prevented from being started.

[0061] Next, the determination unit 150 starts tracking using the facial information of the target 50 (step S308). Specifically, based on the facial information acquired in step S304, a process is executed to track the face of the current target 50 while capturing an image of the face of the target 50 with the facial camera 22. In this tracking process, the facial information acquired in step S304 is treated as first identification information. Furthermore, facial information acquired from the face captured by the facial camera 22 during tracking is treated as second identification information.

[0062] If the faces being tracked have not been swapped (step S309: NO), the determination unit 150 determines that the target 50 has not been swapped. If it is determined that the target 50 has not been swapped, the second output unit 160 outputs second message information to the target 50 to urge the target 50 to swap (step S303). In this case, the tracking process continues.

[0063] On the other hand, if the face being tracked has been replaced (step S309: YES), the determination unit 150 determines that the target 50 has been replaced. If it is determined that the target 50 has been replaced, the scanner 21 becomes ready to read the identification information (step S310). Thereafter, the process is executed again from step S301.

[0064] In the series of processes shown in FIG. 6 , two processes are executed to determine whether the target 50 has been replaced: a process using identification information (i.e., the process of step S302) and a process using face information (i.e., the processes of steps S308 and S309). In this way, when multiple types of identification information are acquired from the target, each of the multiple types of identification information may be used to execute the process to determine whether the target 50 has been replaced. However, only one of these processes may be executed. For example, only one of the processes of step S302 and steps S308 and S309 may be executed.

[0065] (Technical Effects) Next, technical effects obtained by the third information processing device 1 will be described.

[0066] As described with reference to FIGS. 5 and 6 , the third information processing device 1 performs authentication processing using both identification information and facial information. This allows for two-factor authentication, thereby improving authentication accuracy and security compared to when authentication processing is performed using only one of the pieces of information. Furthermore, the third information processing device 1 determines whether a target has been replaced using the identification information and facial information. This allows for appropriate determination of whether a target for which authentication information has been completed has been replaced using the identification information and facial information used in two-factor authentication. <Fourth Embodiment> The fourth information processing device 1 will be described with reference to FIGS. 7 and 8 . The fourth information processing device 1 differs in some configurations and operations from the first to third information processing devices 1 described above, but may otherwise be similar to the first to third information processing devices 1. Therefore, the following will describe in detail the differences from the previously described embodiments, and will omit appropriate descriptions of other overlapping parts.

[0067] (Functional Configuration) First, the functional configuration of the fourth information processing device 1 will be described with reference to Fig. 7. Fig. 7 is a block diagram showing the functional configuration of the fourth information processing device. Note that in Fig. 7, the same elements as those shown in Fig. 2 are denoted by the same reference numerals.

[0068] 7, the fourth information processing device 1 is configured to include, as components for realizing its functions, a first identification information acquisition unit 110, an authentication unit 120, a first output unit 130, a second identification information acquisition unit 140, a determination unit 150, a second output unit 160, a motion detection unit 170, an abnormality determination unit 180, and a third output unit 190. That is, the fourth information processing device 1 further includes, in addition to the configuration described in the first embodiment (see FIG. 2), the motion detection unit 170, the abnormality determination unit 180, and the third output unit 190. Note that each of the motion detection unit 170, the abnormality determination unit 180, and the third output unit 190 may be a processing block realized by the above-described processor 11 (see FIG. 1).

[0069] The motion detection unit 170 is configured to detect the motion of a target undergoing the authentication process 50. The motion detection unit 170 may detect the motion of the target using an image of the target. Specifically, the motion detection unit 170 may detect the motion of the target using continuously captured images of the target (in other words, videos). In this case, the motion detection unit 170 may detect the motion of the target while tracking the target. Note that the image used by the motion detection unit 170 may be an image captured to acquire first identification information or second identification information from the target. For example, the motion detection unit 170 may detect motions related to the target's facial orientation and eye movement from a facial image of the target captured to acquire facial information as the first identification information or second identification information. Information related to the target's motion detected by the motion detection unit 170 is configured to be output to the abnormality determination unit 180.

[0070] The abnormality determination unit 180 is configured to determine whether the behavior of the target detected by the behavior detection unit 170 matches a predetermined abnormal behavior pattern. The abnormal behavior pattern may correspond to a behavior commonly seen in targets undergoing authentication processing. For example, the abnormal behavior pattern may correspond to a behavior performed by a target unfamiliar with authentication processing (e.g., a confused and restless behavior, etc.). Note that multiple abnormal behavior patterns may be set. In this case, the abnormality determination unit 180 may determine whether the behavior detected from the target matches any of the multiple abnormal behavior patterns. The determination result by the abnormality determination unit 180 is configured to be output to the third output unit 190.

[0071] The third output unit 190 is configured to output third message information when the abnormality determination unit 180 determines that the target's behavior matches an abnormal behavior pattern. The third message information is information indicating that the target is behaving abnormally. The third message information may be output to an observer monitoring the target undergoing authentication processing. The third message information may include a message to call the observer to the target behaving abnormally. For example, the third message information may include a message such as, "A target at Gate 2 is behaving abnormally. Please proceed to Gate 2 immediately." The third message information may also include information (e.g., map information) indicating the location of the target behaving abnormally.

[0072] (Abnormality detection operation) Next, the flow of the abnormality detection operation (i.e., the operation when detecting that an object is performing an abnormal operation) by the fourth information processing device 1 will be described with reference to Fig. 8. Fig. 8 is a flowchart showing the flow of the abnormality detection operation by the fourth information processing device.

[0073] 8 , when the fourth information processing device 1 starts an anomaly detection operation, the motion detection unit 170 first acquires an image of a target to be authenticated (step S401). Then, the motion detection unit 170 detects a motion of the target from the acquired image of the target (step S402).

[0074] Next, the abnormality determination unit 180 determines whether the target's motion detected by the motion detection unit 170 matches an abnormal behavior pattern (step S403). If the target's motion does not match an abnormal behavior pattern (step S403: NO), the subsequent processing may be omitted.

[0075] On the other hand, if the target's behavior matches the abnormal behavior pattern (step S403: YES), the third output unit 190 outputs third message information (step S405). If the target continues to perform abnormal behavior, the third output unit 190 may repeatedly output the third message information. Furthermore, if the target stops performing the abnormal behavior, the third output unit 190 may stop outputting the third message information. Furthermore, the third output unit 190 may output fourth message information indicating that the target has stopped performing the abnormal behavior.

[0076] The anomaly detection operation shown in Fig. 8 may be executed in parallel with the authentication operation described in the first to third embodiments (see Figs. 3, 4, 6, etc.). In this case, the authentication operation may be temporarily stopped when it is determined that the target is engaging in abnormal behavior. Then, the authentication operation may be resumed when it is confirmed that an observer or the like who has received the third message information has arrived at the target's location.

[0077] (Technical Effects) Next, technical effects obtained by the fourth information processing device 1 will be described.

[0078] 7 and 8, in the fourth information processing device 1, when it is determined that a target is engaging in abnormal behavior, third message information is output. In this way, it is possible to appropriately notify a monitor or the like of the presence of a target engaging in abnormal behavior. As a result, the target authentication process is executed smoothly, and it is possible to suppress a decrease in throughput.

[0079] For example, a subject unfamiliar with authentication processing may not know how to perform the authentication processing and may look around the device or its surroundings. When the fourth information processing device 1 detects such abnormal behavior, it outputs third message information to a monitor or the like. As a result, even if the subject is unable to properly perform the authentication processing on their own, the authentication processing can be performed with the assistance of the monitor. Therefore, even if a subject is unfamiliar with authentication processing, it is possible to prevent the authentication processing from being delayed.

[0080] The scope of each embodiment also includes a processing method in which a program that operates the configuration of each embodiment to realize the functions of the above-described embodiments is recorded on a recording medium, the program recorded on the recording medium is read as code, and the program is executed on a computer. In other words, a computer-readable recording medium is also included in the scope of each embodiment. Furthermore, each embodiment includes not only a recording medium on which the above-described program is recorded, but also the program itself.

[0081] Examples of recording media that can be used include floppy disks, hard disks, optical disks, magneto-optical disks, CD-ROMs, magnetic tapes, non-volatile memory cards, and ROMs. Furthermore, the scope of each embodiment is not limited to programs that execute processes by themselves, but also includes programs that execute processes by operating on an OS in conjunction with other software or expansion board functions. Furthermore, the program itself may be stored on a server, and part or all of the program may be downloadable from the server to a user terminal. The program may be provided to the user in, for example, a SaaS (Software as a Service) format.

[0082] <Supplementary Notes> The above-described embodiment may be further described as in the following supplementary notes, but is not limited to the following.

[0083] (Supplementary Note 1) The information processing device described in Supplementary Note 1 is an information processing device including: a first acquisition means for acquiring first identification information capable of identifying a target; an authentication means for performing an authentication process using the first identification information; a first output means for outputting first message information indicating that the authentication process has been completed when the authentication process has been completed; a second acquisition means for acquiring second identification information capable of identifying the target after the first message information has been output; a determination means for determining whether the target has been switched by comparing the first identification information with the second identification information; and a second output means for outputting second message information directed to the target for which the second identification information has been acquired based on the result of the determination.

[0084] (Supplementary Note 2) The information processing device described in Supplementary Note 2 is the information processing device described in Supplementary Note 1, wherein the second output means outputs the second message information including guidance information urging the target to be swapped with another target when it is determined that the target has not been swapped.

[0085] (Supplementary Note 3) The information processing device described in Supplementary Note 3 is the information processing device described in Supplementary Note 1 or 2, in which the authentication means performs the authentication process using the second identification information when it is determined that the target has been swapped.

[0086] (Appendix 4) The information processing device described in Appendix 4 is the information processing device described in any one of Appendices 1 to 3, wherein the first identification information includes personal item information obtained from personal items and biometric information obtained from a living body, and the authentication means performs the authentication process using both the personal item information and the biometric information.

[0087] (Appendix 5) The information processing device described in Appendix 5 is the information processing device described in Appendix 4, wherein the second identification information includes the belongings information and the biometric information, and the determination means determines whether the objects have been swapped by comparing at least one of the belongings information and the biometric information contained in the first identification information and the second identification information.

[0088] (Appendix 6) The information processing device described in Appendix 6 is the information processing device described in any one of Appendices 1 to 5, further including: a detection means for detecting a target's behavior; an abnormality determination means for determining whether the target's behavior matches a predetermined abnormal behavior pattern; and a third output unit for outputting third message information indicating that the target is behaving abnormally when the target's behavior matches the abnormal behavior pattern.

[0089] (Supplementary Note 7) The information processing method described in Supplementary Note 7 is an information processing method that, by at least one computer, acquires first identification information capable of identifying a target, performs authentication processing using the first identification information, and when the authentication processing is completed, outputs first message information indicating that the authentication processing has been completed, acquires second identification information capable of identifying the target after the output of the first message information, compares the first identification information with the second identification information to determine whether the target has been switched, and outputs second message information directed to the target for which the second identification information was acquired based on the result of the determination.

[0090] (Appendix 8) The recording medium described in Appendix 8 is a recording medium having recorded thereon a computer program for causing at least one computer to execute an information processing method, which includes acquiring first identification information capable of identifying a target, performing an authentication process using the first identification information, and outputting, when the authentication process is completed, first message information indicating that the authentication process has been completed, acquiring second identification information capable of identifying the target after outputting the first message information, comparing the first identification information with the second identification information to determine whether the target has been switched, and outputting, based on the result of the determination, second message information directed to the target for which the second identification information was obtained.

[0091] (Supplementary Note 9) The computer program described in Supplementary Note 9 is a computer program that causes at least one computer to execute an information processing method, which includes acquiring first identification information with which a target can be identified, performing an authentication process using the first identification information, outputting first message information indicating that the authentication process has been completed when the authentication process is completed, acquiring second identification information with which the target can be identified after the first message information has been output, comparing the first identification information with the second identification information to determine whether the target has been switched, and outputting second message information directed to the target for which the second identification information has been acquired based on the result of the determination.

[0092] This disclosure may be modified as appropriate within the scope that does not contradict the gist or idea of ​​the invention that can be read from the claims and the entire specification, and information processing devices, information processing methods, and recording media that involve such modifications are also included in the technical idea of ​​this disclosure.

[0093] REFERENCE SIGNS LIST 10 Information processing device 11 Processor 12 RAM 13 ROM 14 Storage device 15 Input device 16 Output device 17 Data bus 21 Scanner 22 Face camera 30 Display 50 Object 60 Identification card 110 First identification information acquisition unit 120 Authentication unit 130 First output unit 140 Second identification information acquisition unit 150 Determination unit 160 Second output unit 170 Motion detection unit 180 Abnormality determination unit 190 Third output unit

Claims

1. An information processing device comprising: a first acquisition means for acquiring first identification information capable of identifying a target; an authentication means for executing an authentication process using the first identification information; a first output means for outputting first message information indicating that the authentication process has been completed when the authentication process has been completed; a second acquisition means for acquiring second identification information capable of identifying the target after the first message information has been output; a determination means for determining whether the target has been swapped by comparing the first identification information with the second identification information; and a second output means for outputting second message information directed to the target for which the second identification information has been acquired based on the result of the determination.

2. The information processing device according to claim 1, wherein the second output means outputs the second message information including guidance information urging the user to switch places with another object when it is determined that the object has not been switched.

3. The information processing device according to claim 1, wherein the authentication means executes the authentication process using the second identification information when it is determined that the target has been swapped.

4. An information processing device as described in any one of claims 1 to 3, wherein the first identification information includes personal item information obtained from personal items and biometric information obtained from a living body, and the authentication means performs the authentication process using both the personal item information and the biometric information.

5. The information processing device of claim 4, wherein the second identification information includes the belongings information and the biometric information, and the determination means determines whether the objects have been swapped by comparing at least one of the belongings information and the biometric information contained in the first identification information and the second identification information.

6. An information processing device as described in any one of claims 1 to 3, further comprising: a detection means for detecting the behavior of a target; an abnormality determination means for determining whether the behavior of the target matches a predetermined abnormal behavior pattern; and a third output unit for outputting third message information indicating that the target is engaging in abnormal behavior when the behavior of the target matches the abnormal behavior pattern.

7. An information processing method comprising: by at least one computer, acquiring first identification information capable of identifying a target; performing an authentication process using the first identification information; outputting first message information indicating that the authentication process has been completed when the authentication process is completed; acquiring second identification information capable of identifying the target after the first message information has been output; comparing the first identification information with the second identification information to determine whether the target has been swapped; and outputting second message information directed to the target for which the second identification information was acquired based on the result of the determination.

8. A recording medium having recorded thereon a computer program for causing at least one computer to execute an information processing method, which comprises: acquiring first identification information capable of identifying a target; performing an authentication process using the first identification information; outputting first message information indicating that the authentication process has been completed when the authentication process is completed; acquiring second identification information capable of identifying the target after the first message information has been output; comparing the first identification information with the second identification information to determine whether the target has been swapped; and outputting second message information directed to the target for which the second identification information was acquired based on the result of the determination.

Images