Information processing device, information processing system, information processing method, and recording medium

Abstract

This information processing device (10) comprises an acquisition means (110) for acquiring biological information pertaining to a user present in an authentication region, an authentication means (120) for executing an authentication process on the basis of the biological information, an assessment means (130) for assessing an authentication difficulty level that indicates the possibility of a user arriving outside of the authentication region without completing the authentication process, and a determination means (140) for determining the output timing for the result of the authentication process in accordance with the authentication difficulty level. According to such an information processing device, it is possible to output authentication results at a suitable timing.

Description

Information processing device, information processing system, information processing method, and recording medium

[0001] The present disclosure relates to the technical fields of an information processing device, an information processing system, an information processing method, and a recording medium.

[0002] Known devices of this type use biometric authentication to manage user entry and exit. For example, Patent Document 1 discloses a method for simultaneously performing authentication processing for multiple visitors. Patent Document 2 discloses performing facial authentication of a person to be authenticated walking within a monitored area and projecting the results in a projection area. Patent Document 3 discloses a facial authentication system for managing entry and exit that advances the timing of outputting an unlocking signal the faster the user's moving speed.

[0003] International Publication No. 2022 / 003853 International Publication No. 2021 / 199234 International Publication No. 2021 / 006260

[0004] This disclosure aims to improve upon the techniques disclosed in the prior art documents.

[0005] One aspect of the information processing device disclosed herein comprises an acquisition means for acquiring biometric information of a user present in an authentication area, an authentication means for performing an authentication process based on the biometric information, a determination means for determining the difficulty of authentication indicating the possibility that the user will reach outside the authentication area without completing the authentication process, and a determination means for determining the timing of outputting the results of the authentication process in accordance with the difficulty of authentication.

[0006] One aspect of the information processing system disclosed herein comprises an acquisition means for acquiring biometric information of a user present in an authentication area, an authentication means for executing an authentication process based on the biometric information, a determination means for determining the difficulty of authentication indicating the possibility that the user will reach outside the authentication area without completing the authentication process, and a determination means for determining the timing of outputting the results of the authentication process in accordance with the difficulty of authentication.

[0007] One aspect of the information processing method disclosed herein involves using at least one computer to acquire biometric information of a user present in an authentication area, perform an authentication process based on the biometric information, determine an authentication difficulty level that indicates the likelihood that the user will reach outside the authentication area without completing the authentication process, and determine the timing to output the results of the authentication process based on the authentication difficulty level.

[0008] One aspect of the recording medium of this disclosure is a recording medium having recorded thereon a computer program that causes at least one computer to execute an information processing method, which acquires biometric information of a user present in an authentication area, performs an authentication process based on the biometric information, determines an authentication difficulty that indicates the possibility that the user will reach outside the authentication area without completing the authentication process, and determines the timing of outputting the results of the authentication process based on the authentication difficulty.

[0009] 1 is a block diagram showing a hardware configuration of an information processing device according to a first embodiment; FIG. 2 is a block diagram showing a functional configuration of the information processing device according to the first embodiment; FIG. 3 is a flowchart showing an operation flow of the information processing device according to the first embodiment; FIG. 4 is a plan view showing an example of displaying an authentication result by the information processing device according to the first embodiment; FIG. 5 is a flowchart showing an operation flow of displaying an authentication result by the information processing device according to the first embodiment; FIG. 6 is a flowchart showing an operation flow of the information processing device according to the second embodiment; FIG. 7 is a flowchart showing an operation flow of the information processing device according to the third embodiment; FIG. 8 is a flowchart showing an operation flow of the information processing device according to the fourth embodiment; FIG. 9 is a flowchart showing an operation flow of the information processing device according to the fifth embodiment; FIG. 10 is a flowchart showing an operation flow of the information processing device according to the sixth embodiment; FIG. 11 is a flowchart showing an operation flow of the information processing device according to the seventh embodiment; FIG. 12 is a block diagram showing a functional configuration of an information processing device according to an eighth embodiment; FIG. 13 is a flowchart showing an operation flow of the information processing device according to the eighth embodiment; FIG. 14 is a flowchart showing an operation flow of the information processing device according to the eighth embodiment.

[0010] Hereinafter, embodiments of an information processing device, an information processing system, an information processing method, and a recording medium will be described with reference to the drawings.

[0011] First Embodiment An information processing apparatus according to a first embodiment will be described with reference to FIGS. 1 to 5. FIG.

[0012] (Hardware Configuration) First, the hardware configuration of the information processing apparatus according to the first embodiment will be described with reference to Fig. 1. Fig. 1 is a block diagram showing the hardware configuration of the information processing apparatus according to the first embodiment.

[0013] 1 , an information processing device 10 according to the first embodiment includes a processor 11, a RAM (Random Access Memory) 12, a ROM (Read Only Memory) 13, and a storage device 14. The information processing device 10 may further include an input device 15, an output device 16, and a camera 20. The processor 11, RAM 12, ROM 13, storage device 14, input device 15, output device 16, and camera 20 are connected via a data bus 17.

[0014] The processor 11 loads a computer program. For example, the processor 11 is configured to load a computer program stored in at least one of the RAM 12, the ROM 13, and the storage device 14. Alternatively, the processor 11 may load a computer program stored in a computer-readable storage medium using a storage medium reading device (not shown). The processor 11 may acquire (i.e., load) the computer program from a device (not shown) located outside the information processing device 10 via a network interface. The processor 11 controls the RAM 12, the storage device 14, the input device 15, and the output device 16 by executing the loaded computer program. In particular, in this embodiment, when the processor 11 executes the loaded computer program, functional blocks for performing biometric authentication and outputting the authentication result are realized within the processor 11. In other words, the processor 11 may function as a controller that executes each control in the information processing device 10.

[0015] The processor 11 may be configured as, for example, a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), an FPGA (Field-Programmable Gate Array), a DSP (Demand-Side Platform), or an ASIC (Application Specific Integrated Circuit). The processor 11 may be configured as one of these, or may be configured to use multiple processors in parallel.

[0016] The RAM 12 temporarily stores computer programs executed by the processor 11. The RAM 12 temporarily stores data that the processor 11 temporarily uses while it is executing the computer programs. The RAM 12 may be, for example, a dynamic random access memory (D-RAM) or a static random access memory (SRAM). Alternatively, other types of volatile memory may be used instead of the RAM 12.

[0017] The ROM 13 stores computer programs executed by the processor 11. The ROM 13 may also store fixed data. The ROM 13 may be, for example, a PROM (Programmable Read Only Memory) or an EPROM (Erasable Read Only Memory). Alternatively, other types of non-volatile memory may be used instead of the ROM 13.

[0018] The storage device 14 stores data that is to be saved long-term by the information processing device 10. The storage device 14 may operate as a temporary storage device for the processor 11. The storage device 14 may include, for example, at least one of a hard disk device, a magneto-optical disk device, an SSD (Solid State Drive), and a disk array device.

[0019] The input device 15 is a device that receives input instructions from a user of the information processing device 10. The input device 15 may include, for example, at least one of a keyboard, a mouse, and a touch panel. The input device 15 may be configured as a mobile terminal such as a smartphone or a tablet. The input device 15 may also be, for example, a device that includes a microphone and is capable of voice input.

[0020] The output device 16 is a device that outputs information related to the information processing device 10 to the outside. For example, the output device 16 may be a display device (e.g., a display) that can display information related to the information processing device 10. The output device 16 may also be a speaker or the like that can output information related to the information processing device 10 as audio. The output device 16 may be configured as a mobile terminal such as a smartphone or a tablet. The output device 16 may also be configured as a device that performs projection mapping. The output device 16 may also be a device that outputs information in a format other than an image. For example, the output device 16 may be a speaker that outputs information related to the information processing device 10 as audio.

[0021] The camera 20 is configured to be able to capture images of the authentication area. The "authentication area" here is an area where user authentication processing is performed, and is set, for example, in front of a restricted area where only users who have successfully been authenticated are permitted to enter. The camera 20, for example, captures images of users who pass through the authentication area and attempt to enter the restricted area. The images captured by the camera 20 are used to acquire biometric information of the users. In this way, the camera 20 may be configured to be used in technology for managing the entry and exit and passage of users through authentication processing (biometric authentication). Multiple cameras 20 may be installed. Furthermore, in addition to or instead of the camera 20, other sensors capable of acquiring biometric information of users may be installed.

[0022] 1 illustrates an example of an information processing device 10 including multiple devices, but all or some of the functions may be realized by a single device. In this case, the information processing device may be configured to include only the processor 11, RAM 12, and ROM 13 described above, and the other components (i.e., the storage device 14, input device 15, output device 16, and camera 20) may be provided by an external device connected to the information processing device. Furthermore, some of the computing functions of the information processing device may be realized by an external device (e.g., an external server, a cloud, etc.).

[0023] (Functional Configuration) Next, the functional configuration of the information processing device 10 according to the first embodiment will be described with reference to Fig. 2. Fig. 2 is a block diagram showing the functional configuration of the information processing device according to the first embodiment.

[0024] 2, the information processing device 10 according to the first embodiment is configured to include, as components for realizing its functions, a biometric information acquisition unit 110, an authentication unit 120, a determination unit 130, and a decision unit 140. Each of the biometric information acquisition unit 110, the authentication unit 120, the determination unit 130, and the decision unit 140 may be a processing block realized by, for example, the above-mentioned processor 11 (see FIG. 1).

[0025] The biometric information acquisition unit 110 is configured to acquire biometric information of a user present in the authentication area. The biometric information acquisition unit 110 may be configured to acquire the user's biometric information from an image of the authentication area captured by the camera 20 (see FIG. 1 ). For example, the biometric information acquisition unit 110 may be configured to detect the user's face from the image of the authentication area and acquire the user's facial features. The biometric information acquisition unit 110 may also be configured to track the detected user within the authentication area and continue to periodically acquire the biometric information. Note that if multiple users are present in the authentication area, the biometric information acquisition unit 110 may be configured to acquire the biometric information of each of the multiple users. The biometric information acquired by the biometric information acquisition unit 110 is configured to be output to the authentication unit 120.

[0026] The authentication unit 120 is configured to be able to perform authentication processing (i.e., biometric authentication) based on the user's biometric information acquired by the biometric information acquisition unit 110. For example, the authentication unit 120 may be configured to perform facial authentication by comparing the facial features of the user acquired by the biometric information acquisition unit 110 with the facial features of pre-registered users. If the biometric information acquisition unit 110 has acquired the biometric information of multiple users, the authentication unit 120 may perform authentication processing for each of the multiple users. The authentication unit 120 is configured to be able to output the result of the authentication processing (hereinafter referred to as the "authentication result") via, for example, the output device 16 (see FIG. 1). The timing at which the authentication unit 120 outputs the authentication result is determined by the determination unit 140, which will be described later.

[0027] The determination unit 130 is configured to be able to determine the authentication difficulty. Here, the "authentication difficulty" is determined as a degree of likelihood that a user present in the authentication area will reach outside the authentication area without completing the authentication process. The determination unit 130 may determine the authentication difficulty using various information, in addition to an image captured by the camera 20, for example. Specific examples of information used by the determination unit 130 to determine the authentication difficulty (hereinafter referred to as "determination factors") will be described in detail in other embodiments described later. Information regarding the authentication difficulty determined by the determination unit 130 is configured to be output to the determination unit 140.

[0028] The determination unit 140 is configured to determine the timing for outputting the authentication result by the authentication unit 120, depending on the authentication difficulty determined by the determination unit 130. For example, the determination unit 140 may advance the output timing when the authentication difficulty is high (i.e., when there is a high possibility that the user will reach outside the authentication area without completing the authentication process), and may delay the output timing when the authentication difficulty is low (i.e., when there is a low possibility that the user will reach outside the authentication area without completing the authentication process). Furthermore, the determination unit 140 may be configured to determine only the output timing of a specific authentication result. For example, the determination unit 140 may be configured not to determine the output timing of the authentication result when the authentication process is successful, but to determine the output timing of the authentication result when the authentication process is unsuccessful (e.g., the timing for outputting an alert).

[0029] (Operation Flow) Next, the overall operation flow of the information processing device 10 according to the first embodiment will be described with reference to Fig. 3. Fig. 3 is a flowchart showing the operation flow of the information processing device according to the first embodiment.

[0030] 3, when the operation of the information processing device 10 according to the first embodiment is started, the biometric information acquisition unit 110 first acquires biometric information of a user present in the authentication area (step S101). Then, the authentication unit 120 executes authentication processing using the biometric information acquired by the biometric information acquisition unit 110 (step S102). Meanwhile, the determination unit 130 determines the difficulty of authentication (step S103).

[0031] Next, the determination unit 140 determines the timing of outputting the authentication result based on the authentication difficulty determined by the determination unit 130 (step S104). Then, the authentication unit 120 outputs the authentication result at the output timing determined by the determination unit 140 (step S105).

[0032] (Example of output of authentication result) Next, an example of output by the information processing device 10 according to the first embodiment (here, an example of display on a display) will be specifically described with reference to Fig. 4. Fig. 4 is a plan view showing an example of display of an authentication result by the information processing device according to the first embodiment. Note that Fig. 4 describes an example of performing face authentication on a user walking from the back side of the drawing to the front side.

[0033] As shown in Fig. 4, in the information processing device 10 according to the first embodiment, the authentication result may be displayed so as to be superimposed on the image of the authentication area captured by the camera 20. For example, the authentication result may be indicated by a rectangle displayed so as to surround the user's face in the image. Here, the rectangle displayed in the image is displayed in a different color depending on the progress of the authentication process. Specifically, for a user whose authentication process has been successful, a green rectangle is displayed, and it is determined that the user is allowed to pass. For a user whose authentication process has failed, a red rectangle is displayed, and it is determined that the user is not allowed to pass. For a user currently being authenticated (i.e., a user whose authentication has not yet been successful, but whose authentication has not yet been determined to have failed), a white rectangle is displayed.

[0034] For example, when a user enters the field of view of camera 20, the user's face is first detected, and a white rectangle is displayed around the detected user's face. Thereafter, for users whose face authentication is successful, the color of the rectangle changes from white (determination in progress) to green (OK to enter). Such users are users who pass through the authentication area and are subsequently permitted to enter the restricted area. On the other hand, for users whose face authentication is unsuccessful, the color of the rectangle changes from white (determination in progress) to red (NG to enter). Such users are users who should be prohibited from entering the restricted area. Therefore, it is necessary to take measures such as restricting entry for users for whom a red rectangle is displayed. This action may be taken, for example, by a monitor who is monitoring the authentication results.

[0035] (Display Operation) Next, the operation when outputting the above-mentioned display example will be described with reference to Fig. 5. Fig. 5 is a flowchart showing the flow of the operation when displaying the authentication result by the information processing device according to the first embodiment.

[0036] 5, in the information processing device 10 according to the first embodiment, the authentication unit 120 first determines whether the user to be authenticated is a user who has already been authenticated (i.e., a user who has been successfully authenticated) (step S151). Note that whether the user is an authenticated user can be determined, for example, by storing a person ID corresponding to a user who has been successfully authenticated.

[0037] If the user to be authenticated is an authenticated user (step S151: YES), the authentication unit 120 continues to display "OK to pass" (i.e., a green rectangle) as the authentication result (step S154). On the other hand, if the user to be authenticated is not an authenticated user (step S151: NO), the authentication unit 120 performs face authentication (step S152). Then, if the face authentication is successful (step S153: YES), the authentication unit 120 displays "OK to pass" (i.e., a green rectangle) as the authentication result (step S154).

[0038] On the other hand, if the face authentication is not successful (step S153: NO), the authentication unit 120 determines whether an alert has already been output (i.e., whether a red rectangle is displayed) (step S155). If an alert has already been output (step S155: YES), the authentication unit 120 continues to display a message indicating that the user is not permitted to pass (i.e., a red rectangle) as the authentication result (step S158). On the other hand, if an alert has not yet been output (step S155: NO), the determination unit 140 determines a threshold value N based on the authentication difficulty. The "threshold value N" here is a threshold value set to determine the timing of displaying the authentication result (specifically, the red rectangle indicating authentication failure), and N is a value corresponding to the number of frames of the image captured by the camera 20. For example, the threshold value N is determined to be smaller as the authentication difficulty increases.

[0039] Once the threshold value N is determined, the authentication unit 120 determines whether the number of frames acquired without successful authentication (hereinafter referred to as the "number of consecutive frames") exceeds the threshold value N (step S157). If the number of consecutive frames exceeds N (step S157: YES), the authentication unit 120 displays "No Passage" (i.e., a red rectangle) as the authentication result (step S158). On the other hand, if the number of consecutive frames does not exceed N (step S157: NO), the authentication unit 120 displays a white rectangle indicating that the determination is in progress (step S159).

[0040] The above-described series of processes is repeatedly executed, for example, each time one frame of an image is acquired. As a result, the color of the rectangle changes from white to green for users who are successfully authenticated, and changes from white to red for users who are not successfully authenticated. In this embodiment, in particular, the timing at which the red rectangle is displayed changes depending on the threshold value N, and as a result, the timing at which the authentication result is output changes depending on the authentication difficulty.

[0041] (Technical Effects) Next, technical effects obtained by the information processing device 10 according to the first embodiment will be described.

[0042] As described with reference to FIGS. 1 to 5 , in the information processing device 10 according to the first embodiment, the timing for outputting the authentication result is determined based on the authentication difficulty. This allows the authentication result for each user to be output at an appropriate timing. As a result, it is possible to prevent users who reach the outside of the authentication area without completing the authentication process from being overlooked. For example, for users with a high authentication difficulty (i.e., users who are difficult to authenticate), the timing for outputting the authentication result is determined to be earlier, and an alert is output at an early stage. This makes it possible to properly identify users who should not be allowed to pass through the authentication area. On the other hand, for users with a low authentication difficulty (i.e., users who are easy to authenticate), the timing for outputting the authentication result is determined to be later, and an alert is output after the authentication process has been completed with sufficient time. This prevents unnecessary alerts from being issued, and as a result, it becomes possible to properly identify users who should not be allowed to pass through the authentication area.

[0043] Second Embodiment An information processing device 10 according to a second embodiment will be described with reference to Fig. 6. Note that the second embodiment describes specific examples of determination factors for determining the authentication difficulty, and other aspects may be the same as those of the first embodiment. Therefore, the following will describe in detail the aspects that differ from the first embodiment already described, and will omit appropriate descriptions of other overlapping aspects.

[0044] (Operation Flow) First, the overall operation flow of the information processing device 10 according to the second embodiment will be described with reference to Fig. 6. Fig. 6 is a flowchart showing the operation flow of the information processing device according to the second embodiment. Note that in Fig. 6, the same processes as those shown in Fig. 3 are denoted by the same reference numerals.

[0045] 6, when the operation of the information processing device 10 according to the second embodiment starts, the biometric information acquisition unit 110 first acquires biometric information of a user present in the authentication area (step S101). Then, the authentication unit 120 executes authentication processing using the biometric information acquired by the biometric information acquisition unit 110 (step S102).

[0046] Meanwhile, the determination unit 130 acquires information about the user's movement speed as a determination factor for determining the authentication difficulty (step 201). For example, the determination unit 130 may acquire the user's movement speed from images captured by the camera 20 (e.g., the difference between the user's positions in consecutive frames). Alternatively, the determination unit 130 may acquire the user's movement speed using other means such as a speed sensor.

[0047] Next, the determination unit 130 determines the authentication difficulty level using the acquired information about the user's movement speed (step S202). For example, the determination unit 130 may determine that a user who moves quickly will pass through the authentication area quickly (in other words, the time available for authentication is short) and set the authentication difficulty level high. On the other hand, the determination unit 130 may determine that a user who moves slowly or is standing still will stay in the authentication area for a long time (in other words, the time available for authentication processing is long) and set the authentication difficulty level low.

[0048] Next, the determination unit 140 determines the timing of outputting the authentication result based on the authentication difficulty determined by the determination unit 130 (step S104). Then, the authentication unit 120 outputs the authentication result at the output timing determined by the determination unit 140 (step S105).

[0049] (Technical Effects) Next, technical effects obtained by the information processing device 10 according to the second embodiment will be described.

[0050] As described with reference to Fig. 6, the information processing device 10 according to the second embodiment determines the authentication difficulty level based on the user's movement speed. This makes it possible to accurately distinguish, for example, users who are likely to pass through the authentication area quickly or users who remain in the authentication area for a long time, thereby appropriately determining the authentication difficulty level. This makes it possible to output the authentication result at an appropriate time.

[0051] Third Embodiment An information processing device 10 according to a third embodiment will be described with reference to Fig. 7. Note that the third embodiment describes specific examples of determination elements, similar to the second embodiment described above, and other aspects may be the same as the first and second embodiments. Therefore, the following will describe in detail the aspects that differ from the embodiments already described, and will omit appropriate descriptions of other overlapping aspects.

[0052] (Operation Flow) First, the overall operation flow of the information processing device 10 according to the third embodiment will be described with reference to Fig. 7. Fig. 7 is a flowchart showing the operation flow of the information processing device according to the third embodiment. Note that in Fig. 7, the same processes as those shown in Fig. 3 are denoted by the same reference numerals.

[0053] 7, when the operation of the information processing device 10 according to the third embodiment starts, the biometric information acquisition unit 110 first acquires biometric information of a user present in the authentication area (step S101). Then, the authentication unit 120 executes authentication processing using the biometric information acquired by the biometric information acquisition unit 110 (step S102).

[0054] Meanwhile, the determination unit 130 acquires information about the user's position as a determination factor for determining the authentication difficulty (step 301). For example, the determination unit 130 may acquire the user's position in the authentication area (i.e., the user's position within the angle of view of the camera 20) from an image captured by the camera 20. Alternatively, the determination unit 130 may acquire the user's movement speed using other means such as a position sensor.

[0055] Next, the determination unit 130 determines the authentication difficulty using the acquired information about the user's location (step S302). For example, the determination unit 130 may determine that a user located near the exit of the authentication area will soon leave the authentication area (in other words, the time available for authentication is short), and set the authentication difficulty high. On the other hand, the determination unit 130 may determine that a user located near the entrance of the authentication area will remain in the authentication area for a while (in other words, the time available for authentication processing is long), and set the authentication difficulty low.

[0056] Next, the determination unit 140 determines the timing of outputting the authentication result based on the authentication difficulty determined by the determination unit 130 (step S104). Then, the authentication unit 120 outputs the authentication result at the output timing determined by the determination unit 140 (step S105).

[0057] (Technical Effects) Next, technical effects obtained by the information processing device 10 according to the third embodiment will be described.

[0058] 7, the information processing device 10 according to the third embodiment determines the authentication difficulty based on the user's location. This allows accurate identification of, for example, a user who is likely to leave the authentication area soon or a user who continues to stay in the authentication area for a long time, thereby appropriately determining the authentication difficulty. Therefore, it becomes possible to output the authentication result at an appropriate timing.

[0059] The authentication difficulty may be determined based on both the user's movement speed described in the second embodiment and the user's location described in the third embodiment. In this case, the authentication difficulty based on the user's movement speed and the authentication difficulty based on the user's location may be determined, and then either one (e.g., the higher one) may be selected. Alternatively, one authentication difficulty may be determined by comprehensively considering the user's movement speed and location. In this way, the authentication difficulty may be determined based on multiple determination factors. While an example using the user's movement speed and location has been given here, the authentication difficulty may also be determined by combining the determination factors described in the following embodiments.

[0060] Fourth Embodiment An information processing device 10 according to a fourth embodiment will be described with reference to Fig. 8. Note that the fourth embodiment describes specific examples of determination elements, similar to the second and third embodiments described above, and other aspects may be the same as the first to third embodiments. Therefore, the following will describe in detail the aspects that differ from the embodiments already described, and will omit appropriate descriptions of other overlapping aspects.

[0061] (Operation Flow) First, the overall operation flow of the information processing device 10 according to the fourth embodiment will be described with reference to Fig. 8. Fig. 8 is a flowchart showing the operation flow of the information processing device according to the fourth embodiment. Note that in Fig. 8, the same processes as those shown in Fig. 3 are denoted by the same reference numerals.

[0062] 8, when the operation of the information processing device 10 according to the fourth embodiment starts, the biometric information acquisition unit 110 first acquires biometric information of a user present in the authentication area (step S101). Then, the authentication unit 120 executes authentication processing using the biometric information acquired by the biometric information acquisition unit 110 (step S102).

[0063] Meanwhile, the determination unit 130 predicts whether a given user will overlap with another user as a determination factor for determining the authentication difficulty (step 401). That is, the determination unit 130 predicts whether a given user will be hidden behind another user as viewed from the camera 20. For example, the determination unit 130 may determine whether a given user will overlap with another user based on the positions, movement speeds, movement directions, etc. of the given user and the other user. Note that the prediction method here can be implemented using existing technology as appropriate, and therefore detailed description thereof will be omitted.

[0064] Next, the determination unit 130 determines the authentication difficulty level using the prediction result regarding user overlap (step S402). For example, the determination unit 130 may determine that a user who is predicted to overlap with another user will soon be hidden by the other user and will no longer be able to obtain biometric information (in other words, the time available for authentication is short), and set the authentication difficulty level high. On the other hand, the determination unit 130 may determine that a user who is not predicted to overlap with another user will be able to continue obtaining biometric information for a while (in other words, the time available for authentication processing is long), and set the authentication difficulty level low.

[0065] Next, the determination unit 140 determines the timing of outputting the authentication result based on the authentication difficulty determined by the determination unit 130 (step S104). Then, the authentication unit 120 outputs the authentication result at the output timing determined by the determination unit 140 (step S105).

[0066] (Technical Effects) Next, technical effects obtained by the information processing device 10 according to the fourth embodiment will be described.

[0067] As described with reference to Fig. 8, the information processing device 10 according to the fourth embodiment determines the authentication difficulty based on whether a user overlaps with another user. This makes it possible to identify users who will be difficult to authenticate in the future and appropriately determine the authentication difficulty. This makes it possible to output authentication results at an appropriate time.

[0068] Fifth Embodiment An information processing device 10 according to a fifth embodiment will be described with reference to Fig. 9. Note that the fifth embodiment describes specific examples of determination elements, similar to the second to fourth embodiments described above, and other aspects may be the same as the first to fourth embodiments. Therefore, the following will describe in detail the aspects that differ from the embodiments already described, and will omit appropriate descriptions of other overlapping aspects.

[0069] (Operation Flow) First, the overall operation flow of the information processing device 10 according to the fifth embodiment will be described with reference to Fig. 9. Fig. 9 is a flowchart showing the operation flow of the information processing device according to the fifth embodiment. Note that in Fig. 9, the same processes as those shown in Fig. 3 are denoted by the same reference numerals.

[0070] 9, when the operation of the information processing device 10 according to the fifth embodiment is started, the biometric information acquisition unit 110 first acquires biometric information of a user present in the authentication area (step S101). Then, the authentication unit 120 executes authentication processing using the biometric information acquired by the biometric information acquisition unit 110 (step S102).

[0071] On the other hand, the determination unit 130 determines whether the user is intentionally trying to avoid the authentication process as a determination factor for determining the authentication difficulty (step 501). For example, when the determination unit 130 detects that the user is hiding their face with both hands, wearing a mask and sunglasses to hide their face, or walking backwards, the determination unit 130 may determine that the user is intentionally trying to avoid the authentication process (i.e., attempting to pass illegally).

[0072] Next, the determination unit 130 determines the authentication difficulty level using the prediction result regarding fraudulent passage (step S502). For example, the determination unit 130 may determine that a user attempting fraudulent passage is intentionally creating a situation that makes authentication difficult and set the authentication difficulty level high. Alternatively, the determination unit 130 may set the authentication difficulty level high not only from the perspective of making authentication difficult but also from the perspective of preventing fraudulent passage. In other words, the determination unit 130 may determine that an authentication result (alert) should be output at an early stage for a user attempting fraudulent passage and set the authentication difficulty level high so that the output timing is earlier.

[0073] Next, the determination unit 140 determines the timing of outputting the authentication result based on the authentication difficulty determined by the determination unit 130 (step S104). Then, the authentication unit 120 outputs the authentication result at the output timing determined by the determination unit 140 (step S105).

[0074] (Technical Effects) Next, technical effects obtained by the information processing device 10 according to the fifth embodiment will be described.

[0075] 9, the information processing device 10 according to the fifth embodiment determines the authentication difficulty based on whether the user is intentionally attempting to circumvent the authentication process. This makes it possible to identify users who are fraudulently attempting to bypass the authentication process and appropriately determine the authentication difficulty. This makes it possible to output the authentication result at an appropriate time.

[0076] Sixth Embodiment An information processing device 10 according to a sixth embodiment will be described with reference to Fig. 10. Note that the sixth embodiment describes specific examples of determination elements, similar to the second to fifth embodiments described above, and other aspects may be the same as the first to fifth embodiments. Therefore, the following will describe in detail the aspects that differ from the embodiments already described, and will omit appropriate descriptions of other overlapping aspects.

[0077] (Operation Flow) First, the overall operation flow of the information processing device 10 according to the sixth embodiment will be described with reference to Fig. 10. Fig. 10 is a flowchart showing the operation flow of the information processing device according to the sixth embodiment. Note that in Fig. 10, the same processes as those shown in Fig. 3 are denoted by the same reference numerals.

[0078] 10 , when the operation of the information processing device 10 according to the sixth embodiment starts, the biometric information acquisition unit 110 first acquires biometric information of a user present in the authentication area (step S101). Then, the authentication unit 120 executes authentication processing using the biometric information acquired by the biometric information acquisition unit 110 (step S102).

[0079] Meanwhile, the determination unit 130 acquires information about the user's accessories as a determination factor for determining the authentication difficulty (step 601). For example, the determination unit 130 may acquire information about a mask, sunglasses, full-face helmet, or the like worn by the user from an image captured by the camera 20. Note that the accessories listed here are only examples, and accessories that may affect the difficulty of authentication may be detected as appropriate.

[0080] Next, the determination unit 130 determines the authentication difficulty level using the acquired information about the user's clothing (step S602). For example, the determination unit 130 may determine that it is difficult to acquire facial features for a user wearing a mask or sunglasses (in other words, it is difficult to properly perform facial authentication), and set the authentication difficulty level high. On the other hand, the determination unit 130 may determine that it is easy to acquire facial features for a user not wearing a mask or sunglasses (in other words, it is possible to properly perform facial authentication), and set the authentication difficulty level low.

[0081] Next, the determination unit 140 determines the timing of outputting the authentication result based on the authentication difficulty determined by the determination unit 130 (step S104). Then, the authentication unit 120 outputs the authentication result at the output timing determined by the determination unit 140 (step S105).

[0082] (Technical Effects) Next, technical effects obtained by the information processing device 10 according to the sixth embodiment will be described.

[0083] 10, the information processing device 10 according to the sixth embodiment determines the authentication difficulty based on the user's clothing. This allows the device to recognize when the user's clothing makes authentication difficult and appropriately determine the authentication difficulty. This makes it possible to output the authentication result at an appropriate time.

[0084] Seventh Embodiment An information processing device 10 according to a seventh embodiment will be described with reference to Fig. 11 . Note that the seventh embodiment describes specific examples of determination elements, similar to the second to sixth embodiments described above, and other aspects may be the same as the first to sixth embodiments. Therefore, the following will describe in detail the aspects that differ from the embodiments already described, and will omit appropriate descriptions of other overlapping aspects.

[0085] (Operation Flow) First, the overall operation flow of the information processing device 10 according to the seventh embodiment will be described with reference to Fig. 11. Fig. 11 is a flowchart showing the operation flow of the information processing device according to the seventh embodiment. Note that in Fig. 11, the same processes as those shown in Fig. 3 are denoted by the same reference numerals.

[0086] 11 , when the operation of the information processing device 10 according to the seventh embodiment starts, the biometric information acquisition unit 110 first acquires biometric information of a user present in the authentication area (step S101). Then, the authentication unit 120 executes authentication processing using the biometric information acquired by the biometric information acquisition unit 110 (step S102).

[0087] Meanwhile, the determination unit 130 acquires information on at least one of the user's facial orientation, posture, and movement direction as a determination factor for determining the authentication difficulty (step 701). For example, the determination unit 130 may acquire the user's facial orientation, posture, and movement direction from an image captured by the camera 20. Alternatively, the determination unit 130 may acquire the user's facial orientation, posture, and movement direction using various sensors other than the camera 20.

[0088] Next, the determination unit 130 determines the authentication difficulty level using the acquired information on at least one of the user's facial orientation, posture, and movement direction (step S702). For example, if the user's face is not facing forward (i.e., toward the camera 20), if the user's face is difficult to see from the camera 20 due to the user's posture (e.g., because the user is leaning forward), or if the user's movement direction is not toward the camera 20, the determination unit 130 may determine that it is difficult to acquire the user's facial features (in other words, it is difficult to properly execute biometric information processing), and may set the authentication difficulty level high. However, if the user's movement direction is different from the expected direction (e.g., not toward the restricted area), the determination unit 130 may determine that the user does not intend to enter the restricted area (in other words, there is no need to output an alert even if authentication is not possible), and may set the authentication difficulty level low.

[0089] Next, the determination unit 140 determines the timing of outputting the authentication result based on the authentication difficulty determined by the determination unit 130 (step S104). Then, the authentication unit 120 outputs the authentication result at the output timing determined by the determination unit 140 (step S105).

[0090] (Technical Effects) Next, technical effects obtained by the information processing device 10 according to the seventh embodiment will be described.

[0091] 11 , the information processing device 10 according to the seventh embodiment determines the authentication difficulty based on at least one of the user's facial orientation, posture, and movement direction. This makes it possible to distinguish users who are difficult to authenticate or users who do not necessarily need to be authenticated, and appropriately determine the authentication difficulty. This makes it possible to output the authentication result at an appropriate time.

[0092] Eighth Embodiment An information processing device 10 according to an eighth embodiment will be described with reference to Figures 12 and 13. Note that the eighth embodiment differs only in part of the configuration and operation from the first to seventh embodiments described above, and other parts may be the same as the first to seventh embodiments. Therefore, the following will describe in detail the parts that differ from the embodiments already described, and will omit a description of other overlapping parts as appropriate.

[0093] (Functional Configuration) First, the functional configuration of the information processing device 10 according to the eighth embodiment will be described with reference to Fig. 12. Fig. 12 is a block diagram showing the functional configuration of the information processing device according to the eighth embodiment. Note that in Fig. 12, the same elements as those shown in Fig. 2 are denoted by the same reference numerals.

[0094] 12, the information processing device 10 according to the eighth embodiment is configured to include, as components for realizing its functions, a biometric information acquisition unit 110, an authentication unit 120, a determination unit 130, a decision unit 140, and a change unit 150. That is, the information processing device 10 according to the eighth embodiment is configured to further include a change unit 150 in addition to the configuration of the first embodiment (see FIG. 2). The change unit 150 may be a processing block realized by, for example, the above-mentioned processor 11 (see FIG. 1).

[0095] The change unit 150 is configured to change the output mode of the authentication result depending on the type of determination factor for the authentication difficulty determined by the determination unit 130. For example, the change unit 150 may change the output mode of the authentication result depending on whether the determination unit 130 determines the authentication difficulty using the user's movement speed or the user's location. Furthermore, when the determination unit 130 determines the authentication difficulty using multiple determination factors, the change unit 150 may change the output mode of the authentication result when all of the determination factors are different, or may change the output mode of the authentication result when some of the determination factors are different. For example, the determination unit 130 determines the authentication difficulty using the user's movement speed and location and the determination unit 130 determines the authentication difficulty using the user's movement speed and attachments in common in that the user's movement speed is used as a determination factor, but the other determination factors are different. In such a case, the change unit 150 may determine that all of the determination factors are the same and not change the output mode, or may determine that some of the determination factors are different and change the output mode.

[0096] When changing the output mode, the change unit 150 may change, for example, the color, size, shape, degree of emphasis, etc., when displaying the authentication result. Alternatively, the change unit 150 may change the volume, tone, etc., of the sound when outputting the authentication result as audio. The change unit 150 may change the output mode of the authentication result to one that corresponds to the determination factor. For example, when the determination factor is the result of a user's unauthorized passage determination (see the fifth embodiment), the change unit 150 may determine that the user is one that requires closer attention and change the output mode to one that is more emphasized (for example, a conspicuous color, a large display, a flashing display, a loud sound, etc.).

[0097] (Operation Flow) Next, the overall operation flow of the information processing device 10 according to the eighth embodiment will be described with reference to Fig. 13. Fig. 13 is a flowchart showing the operation flow of the information processing device according to the eighth embodiment. Note that in Fig. 13, the same processes as those shown in Fig. 3 are denoted by the same reference numerals.

[0098] 13 , when the operation of the information processing device 10 according to the eighth embodiment is started, the biometric information acquisition unit 110 first acquires biometric information of a user present in the authentication area (step S101). Then, the authentication unit 120 executes authentication processing using the biometric information acquired by the biometric information acquisition unit 110 (step S102). Meanwhile, the determination unit 130 determines the authentication difficulty (step S103). Note that information related to the determination factors used by the determination unit 130 when determining the authentication difficulty is output to the change unit 150.

[0099] Next, the determination unit 140 determines the output timing of the authentication result based on the authentication difficulty determined by the determination unit 130 (step S104). In addition, particularly in this embodiment, the change unit 150 changes the output mode of the authentication result based on the determination factors used by the determination unit 130 (step S801). Then, the authentication unit 120 outputs the authentication result at the output timing determined by the determination unit 140 and in the output mode changed by the change unit 150 (step S802).

[0100] (Technical Effects) Next, technical effects obtained by the information processing device 10 according to the eighth embodiment will be described.

[0101] 12 and 13 , in the information processing device 10 according to the eighth embodiment, the output mode of the authentication result is changed depending on the type of determination element. In this way, the importance of the authentication result can be recognized by the difference in output mode. For example, if it is determined from the type of determination element that the user should be closely monitored, the authentication result is output in an output mode appropriate for the monitor or other person receiving the authentication result, so that the importance of the authentication result can be easily recognized by the monitor who receives the authentication result.

[0102] Ninth Embodiment An information processing device 10 according to a ninth embodiment will be described with reference to Fig. 14. Note that the ninth embodiment differs only in some of the operations from the first to eighth embodiments described above, and other parts may be the same as the first to eighth embodiments. Therefore, the following will describe in detail the parts that differ from the embodiments already described, and will omit explanations of other overlapping parts as appropriate.

[0103] (Operation Flow) First, the overall operation flow of the information processing device 10 according to the ninth embodiment will be described with reference to Fig. 14. Fig. 14 is a flowchart showing the operation flow of the information processing device according to the ninth embodiment. Note that in Fig. 14, the same processes as those shown in Fig. 3 are denoted by the same reference numerals.

[0104] 14 , when the operation of the information processing device 10 according to the ninth embodiment is started, the biometric information acquisition unit 110 first acquires biometric information of a user present in the authentication area (step S101). Then, the authentication unit 120 executes authentication processing using the biometric information acquired by the biometric information acquisition unit 110 (step S102). Meanwhile, the determination unit 130 determines the authentication difficulty (step S103). Note that information related to the determination factors used by the determination unit 130 when determining the authentication difficulty is output to the change unit 150.

[0105] Next, the determination unit 140 determines the timing to output the authentication result based on the authentication difficulty determined by the determination unit 130 and the available number of personnel (step S901). That is, the determination unit 140 according to this embodiment determines the timing to output the authentication result by taking into account the available number of personnel in addition to the authentication difficulty described in each of the above-described embodiments. The "available number of personnel" here refers to the number of personnel (e.g., monitors) who can respond when a user is found who reaches outside the authentication area without completing the authentication process. The available number of personnel may be a preset number (e.g., a number based on the attendance management information of the staff for that time period), or may be a value output by detecting the available monitors each time.

[0106] For example, when the number of users available is relatively small, the determination unit 140 may determine that the system will be unable to handle all users if many users who should be handled are detected at the same time, and may determine to delay the timing of outputting the authentication result. Furthermore, when the number of users available is relatively large, the determination unit 140 may determine that the system will be able to handle all users even if many users who should be handled are detected at the same time, and may determine to advance the timing of outputting the authentication result. Thereafter, the authentication unit 120 outputs the authentication result at the output timing determined by the determination unit 140 (i.e., the output timing determined based on the authentication difficulty and the number of users available) (step S902).

[0107] (Technical Effects) Next, technical effects obtained by the information processing device 10 according to the ninth embodiment will be described.

[0108] 14, in the information processing device 10 according to the ninth embodiment, the timing of outputting the authentication result is determined based on the number of available personnel in addition to the authentication difficulty. In this way, the authentication result can be output at a more appropriate timing than when only the authentication difficulty is used.

[0109] The scope of each embodiment also includes a processing method in which a program that operates the configuration of each embodiment to realize the functions of the above-described embodiments is recorded on a recording medium, the program recorded on the recording medium is read as code, and the program is executed on a computer. In other words, a computer-readable recording medium is also included in the scope of each embodiment. Furthermore, each embodiment includes not only a recording medium on which the above-described program is recorded, but also the program itself.

[0110] Examples of recording media that can be used include floppy disks, hard disks, optical disks, magneto-optical disks, CD-ROMs, magnetic tapes, non-volatile memory cards, and ROMs. Furthermore, the scope of each embodiment is not limited to programs that execute processing by themselves, but also includes programs that execute processing by operating on an OS in cooperation with other software or functions of an expansion board. Furthermore, the program itself may be stored on a server, and part or all of the program may be downloaded from the server to a user terminal.

[0111] <Supplementary Notes> The above-described embodiment may be further described as in the following supplementary notes, but is not limited to the following.

[0112] (Supplementary Note 1) The information processing device described in Supplementary Note 1 is an information processing device that includes an acquisition means for acquiring biometric information of a user present in an authentication area, an authentication means for executing an authentication process based on the biometric information, a determination means for determining the difficulty of authentication indicating the possibility that the user will reach outside the authentication area without completing the authentication process, and a determination means for determining the timing of outputting a result of the authentication process depending on the difficulty of authentication.

[0113] (Supplementary Note 2) The information processing device according to Supplementary Note 2 is the information processing device according to Supplementary Note 1, wherein the determination means determines the authentication difficulty level based on a moving speed of the user.

[0114] (Supplementary Note 3) The information processing device according to Supplementary Note 3 is the information processing device according to Supplementary Note 1 or 2, wherein the determination means determines the authentication difficulty level based on a location of the user.

[0115] (Supplementary Note 4) The information processing device described in Supplementary Note 4 is the information processing device described in any one of Supplements 1 to 3, wherein the determination means determines the authentication difficulty based on whether or not it is predicted that the user will overlap with another user, as viewed from a sensor that acquires the biometric information.

[0116] (Appendix 5) The information processing device described in Appendix 5 is the information processing device described in any one of Appendices 1 to 4, wherein the determination means determines the authentication difficulty based on whether the user is intentionally attempting to avoid the authentication process.

[0117] (Supplementary Note 6) The information processing device according to Supplementary Note 6 is the information processing device according to any one of Supplementary Notes 1 to 5, wherein the determination means determines the authentication difficulty level based on an item worn by the user.

[0118] (Appendix 7) The information processing device described in Appendix 7 is the information processing device described in any one of Appendices 1 to 6, wherein the determination means determines the authentication difficulty based on at least one of the user's facial orientation, posture, and movement direction.

[0119] (Appendix 8) The information processing device described in Appendix 8 is the information processing device described in any one of Appendices 1 to 7, further comprising a change means for changing the output mode of the result of the authentication process depending on the type of judgment element of the authentication difficulty in the judgment means.

[0120] (Supplementary Note 9) The information processing device described in Supplementary Note 9 is the information processing device described in any one of Supplements 1 to 8, wherein the determination means determines the timing of outputting the result of the authentication process according to the number of personnel available to handle a user who has reached outside the authentication area without completing the authentication process, in addition to the authentication difficulty level.

[0121] (Supplementary Note 10) The information processing system described in Supplementary Note 10 is an information processing system including: an acquisition means for acquiring biometric information of a user present in an authentication area; an authentication means for executing an authentication process based on the biometric information; a determination means for determining the difficulty of authentication indicating the possibility that the user will reach outside the authentication area without completing the authentication process; and a determination means for determining the timing of outputting a result of the authentication process in accordance with the difficulty of authentication.

[0122] (Appendix 11) The information processing method described in Appendix 9 is an information processing method that, using at least one computer, acquires biometric information of a user present in an authentication area, performs authentication processing based on the biometric information, determines an authentication difficulty that indicates the possibility that the user will reach outside the authentication area without completing the authentication processing, and determines the timing of outputting the results of the authentication processing according to the authentication difficulty.

[0123] (Appendix 12) The recording medium described in Appendix 10 is a recording medium having recorded thereon a computer program that causes at least one computer to execute an information processing method, which includes acquiring biometric information of a user present in an authentication area, performing an authentication process based on the biometric information, determining an authentication difficulty that indicates the possibility that the user will reach outside the authentication area without completing the authentication process, and determining the timing of outputting the results of the authentication process based on the authentication difficulty.

[0124] (Appendix 13) The computer program described in Appendix 11 is a computer program that causes at least one computer to execute an information processing method, which acquires biometric information of a user present in an authentication area, performs authentication processing based on the biometric information, determines an authentication difficulty that indicates the possibility that the user will reach outside the authentication area without completing the authentication processing, and determines the timing of outputting the result of the authentication processing according to the authentication difficulty.

[0125] This disclosure may be modified as appropriate within the scope that does not contradict the gist or idea of ​​the invention that can be read from the claims and the entire specification, and information processing devices, information processing systems, information processing methods, and recording media that involve such modifications are also included in the technical idea of ​​this disclosure.

[0126] REFERENCE SIGNS LIST 10 Information processing device 11 Processor 110 Biometric information acquisition unit 120 Authentication unit 130 Determination unit 140 Decision unit 150 Change unit

Claims

1. An acquisition means for acquiring biometric information of a user present in an authentication area; an authentication means for executing an authentication process based on the biometric information; a determination means for determining an authentication difficulty level indicating a possibility that the user will reach outside the authentication area without completing the authentication process; a determination means for determining a timing for outputting a result of the authentication process in accordance with the authentication difficulty; An information processing device comprising:

2. the determination means determines the authentication difficulty level based on a moving speed of the user. The information processing device according to claim 1 .

3. the determination means determines the authentication difficulty level based on a location of the user.

3. The information processing device according to claim 1 or 2.

4. the determination means determines the authentication difficulty level based on whether or not it is predicted that the user will overlap with another user as viewed from a sensor that acquires the biometric information.

3. The information processing device according to claim 1 or 2.

5. the determination means determines the authentication difficulty level based on whether or not the user is intentionally trying to evade the authentication process.

3. The information processing device according to claim 1 or 2.

6. The determination means determines the authentication difficulty level based on an item worn by the user.

3. The information processing device according to claim 1 or 2.

7. the determination means determines the authentication difficulty level based on at least one of a facial orientation, a posture, and a moving direction of the user.

3. The information processing device according to claim 1 or 2.

8. a change unit that changes an output mode of the result of the authentication process according to a type of determination factor of the authentication difficulty determined by the determination unit, 3. The information processing device according to claim 1 or 2.

9. by at least one computer, Acquire biometric information of a user present in an authentication area; Executing an authentication process based on the biometric information; determining an authentication difficulty level indicating a possibility that the user will reach outside the authentication area without completing the authentication process; determining a timing for outputting a result of the authentication process according to the authentication difficulty; Information processing methods.

10. At least one computer Acquire biometric information of a user present in an authentication area; Executing an authentication process based on the biometric information; determining an authentication difficulty level indicating a possibility that the user will reach outside the authentication area without completing the authentication process; determining a timing for outputting a result of the authentication process according to the authentication difficulty; A computer program for executing an information processing method.