Information processing device, information processing system, information processing method, and recording medium
Patent Information
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- NEC CORP
- Filing Date
- 2022-06-22
- Publication Date
- 2026-06-30
Smart Images
Figure 0007882321000001 
Figure 0007882321000002 
Figure 0007882321000003
Abstract
Description
Technical Field
[0005] ,
[0001] This disclosure relates to the technical field of information processing apparatuses, information processing systems, information processing methods, and recording media.
Background Art
[0002] As this type of device, there is known one that performs entry and exit management of users using biometric authentication. For example, in Patent Document 1, it is disclosed that authentication processing of a plurality of entrants is collectively performed. In Patent Document 2, it is disclosed that face authentication of an authentication target person walking in a monitoring area is executed and the result is projected onto a projection area. In Patent Document 3, it is disclosed that in a face authentication system for managing entry and exit rooms, the output timing of an unlocking signal is advanced as the moving speed of a user is faster.
Prior Art Documents
Patent Documents
[0003]
Patent Document 1
Patent Document 2
Patent Document 3
Summary of the Invention
Problems to be Solved by the Invention
[0004] This disclosure aims to improve the technologies disclosed in the prior art documents.
Means for Solving the Problems
[0005] One aspect of the information processing apparatus of this disclosure includes: acquisition means for acquiring biometric information of a user present in an authentication area; authentication means for executing an authentication process based on the biometric information; determination means for determining the difficulty of authentication, which indicates the possibility that the user may reach outside the authentication area without completing the authentication process; and determination means for determining the timing of outputting the result of the authentication process according to the difficulty of authentication.
[0006] One aspect of the information processing system disclosed herein includes: acquisition means for acquiring biometric information of a user present in an authentication area; authentication means for executing an authentication process based on the biometric information; determination means for determining the difficulty of authentication, which indicates the possibility that the user may reach outside the authentication area without completing the authentication process; and determination means for determining the timing of outputting the result of the authentication process according to the difficulty of authentication.
[0007] One aspect of the information processing method disclosed herein involves using at least one computer to acquire biometric information of a user present in an authentication area, performing an authentication process based on the biometric information, determining an authentication difficulty level indicating the possibility that the user may reach the outside of the authentication area without completing the authentication process, and determining the timing of outputting the results of the authentication process according to the authentication difficulty level.
[0008] One aspect of the recording medium of this disclosure includes recording on at least one computer a computer program that causes the computer program to execute an information processing method which involves acquiring a user's biometric information present in an authentication area, performing an authentication process based on the biometric information, determining an authentication difficulty level that indicates the possibility of the user reaching outside the authentication area without completing the authentication process, and determining the timing of outputting the result of the authentication process according to the authentication difficulty level. [Brief explanation of the drawing]
[0009] [Figure 1] This is a block diagram showing the hardware configuration of the information processing device according to the first embodiment. [Figure 2]This is a block diagram showing the functional configuration of the information processing apparatus according to the first embodiment. [Figure 3] This is a flowchart showing the operation flow of the information processing device according to the first embodiment. [Figure 4] This is a plan view showing an example of how authentication results are displayed by the information processing device according to the first embodiment. [Figure 5] This flowchart shows the operation flow for displaying the authentication result by the information processing device according to the first embodiment. [Figure 6] This is a flowchart showing the operation flow of the information processing device according to the second embodiment. [Figure 7] This is a flowchart showing the operation flow of the information processing device according to the third embodiment. [Figure 8] This is a flowchart showing the operation flow of the information processing device according to the fourth embodiment. [Figure 9] This is a flowchart showing the operation flow of the information processing device according to the fifth embodiment. [Figure 10] This is a flowchart showing the operation flow of the information processing device according to the sixth embodiment. [Figure 11] This is a flowchart showing the operation flow of the information processing device according to the seventh embodiment. [Figure 12] This is a block diagram showing the functional configuration of the information processing apparatus according to the eighth embodiment. [Figure 13] This is a flowchart showing the operation flow of the information processing device according to the 8th embodiment. [Figure 14] This is a flowchart showing the operation flow of the information processing device according to the 8th embodiment. [Modes for carrying out the invention]
[0010] The following describes embodiments of the information processing device, information processing system, information processing method, and recording medium with reference to the drawings.
[0011] <First Embodiment> The information processing apparatus according to the first embodiment will be described with reference to FIGS. 1 to 5.
[0012] (Hardware Configuration) First, with reference to FIG. 1, the hardware configuration of the information processing apparatus according to the first embodiment will be described. FIG. 1 is a block diagram showing the hardware configuration of the information processing apparatus according to the first embodiment.
[0013] As shown in FIG. 1, the information processing apparatus 10 according to the first embodiment includes a processor 11, a RAM (Random Access Memory) 12, a ROM (Read Only Memory) 13, and a storage device 14. The information processing apparatus 10 may further include an input device 15, an output device 16, and a camera 20. The above-described processor 11, RAM 12, ROM 13, storage device 14, input device 15, output device 16, and camera 20 are connected via a data bus 17.
[0014] The processor 11 reads a computer program. For example, the processor 11 is configured to read a computer program stored in at least one of the RAM 12, ROM 13, and storage device 14. Alternatively, the processor 11 may read a computer program stored in a computer-readable recording medium using a recording medium reading device (not shown). The processor 11 may acquire (i.e., read) a computer program from a device (not shown) disposed outside the information processing apparatus 10 via a network interface. The processor 11 controls the RAM 12, storage device 14, input device 15, and output device 16 by executing the read computer program. In particular, in this embodiment, when the processor 11 executes the read computer program, a functional block for performing biometric authentication and outputting an authentication result is realized within the processor 11. That is, the processor 11 may function as a controller for executing each control in the information processing apparatus 10.
[0015] The processor 11 may be configured as, for example, a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), an FPGA (field-programmable gate array), a DSP (Demand-Side Platform), or an ASIC (Application Specific Integrated Circuit). The processor 11 may consist of one of these, or it may be configured to use multiple of them in parallel.
[0016] RAM12 temporarily stores computer programs executed by processor 11. RAM12 also temporarily stores data that processor 11 uses temporarily while executing computer programs. RAM12 may be, for example, D-RAM (Dynamic Random Access Memory) or SRAM (Static Random Access Memory). Alternatively, other types of volatile memory may be used instead of RAM12.
[0017] ROM 13 stores computer programs executed by processor 11. ROM 13 may also store other static data. ROM 13 may be, for example, P-ROM (Programmable Read Only Memory) or EPROM (Erasable Read Only Memory). Alternatively, other types of non-volatile memory may be used instead of ROM 13.
[0018] The storage device 14 stores data that the information processing device 10 will save for a long period of time. The storage device 14 may also operate as a temporary storage device for the processor 11. The storage device 14 may include, for example, at least one of a hard disk drive, a magneto-optical disk drive, an SSD (Solid State Drive), and a disk array device.
[0019] The input device 15 is a device that receives input instructions from the user of the information processing device 10. The input device 15 may include, for example, at least one of a keyboard, a mouse, and a touch panel. The input device 15 may be configured as a mobile terminal such as a smartphone or tablet. The input device 15 may also be a device capable of voice input, for example, including a microphone.
[0020] The output device 16 is a device that outputs information related to the information processing device 10 to the outside. For example, the output device 16 may be a display device (e.g., a display) capable of displaying information related to the information processing device 10. Alternatively, the output device 16 may be a speaker or the like capable of outputting information related to the information processing device 10 as sound. The output device 16 may be configured as a mobile terminal such as a smartphone or tablet. The output device 16 may be configured as a device that performs projection mapping. Furthermore, the output device 16 may be a device that outputs information in a format other than an image. For example, the output device 16 may be a speaker that outputs information related to the information processing device 10 as sound.
[0021] Camera 20 is configured to capture images of the authentication area. Here, the "authentication area" is an area where user authentication processing is performed, and is set up, for example, in front of a restricted area where only users who have successfully authenticated are allowed to enter. Camera 20 captures images of users, for example, those who are passing through the authentication area and attempting to enter the restricted area. The images captured by camera 20 are used to acquire the user's biometric information. Thus, camera 20 may be configured to be used in technology that manages user entry and exit and passage through authentication processing (biometric authentication). Multiple cameras 20 may be installed. In addition to or instead of camera 20, other sensors capable of acquiring the user's biometric information may be installed.
[0022] Although Figure 1 shows an example of an information processing device 10 comprising multiple devices, all or some of these functions may be implemented in a single device. In that case, the information processing device may be configured to include only the processor 11, RAM 12, and ROM 13 described above, and the other components (i.e., storage device 14, input device 15, output device 16, camera 20) may be provided by external devices connected to the information processing device. Furthermore, the information processing device may implement some of its computational functions through external devices (e.g., external servers or cloud services).
[0023] (Functional configuration) Next, the functional configuration of the information processing device 10 according to the first embodiment will be described with reference to Figure 2. Figure 2 is a block diagram showing the functional configuration of the information processing device according to the first embodiment.
[0024] As shown in Figure 2, the information processing device 10 according to the first embodiment is configured to include a biometric information acquisition unit 110, an authentication unit 120, a determination unit 130, and a decision unit 140 as components for realizing its functions. Each of the biometric information acquisition unit 110, the authentication unit 120, the determination unit 130, and the decision unit 140 may be a processing block realized by, for example, the processor 11 (see Figure 1) described above.
[0025] The biometric information acquisition unit 110 is configured to acquire biometric information of users present in the authentication area. The biometric information acquisition unit 110 may be configured to acquire user biometric information from images of the authentication area captured by the camera 20 (see Figure 1). For example, the biometric information acquisition unit 110 may be configured to detect the user's face from the image of the authentication area and acquire the user's facial features. The biometric information acquisition unit 110 may also be configured to track the detected user within the authentication area and continuously acquire biometric information periodically. If multiple users are present in the authentication area, the biometric information acquisition unit 110 may be configured to acquire the biometric information of each of the multiple users. The biometric information acquired by the biometric information acquisition unit 110 is output to the authentication unit 120.
[0026] The authentication unit 120 is configured to perform authentication processing (i.e., biometric authentication) based on the user's biometric information acquired by the biometric information acquisition unit 110. For example, the authentication unit 120 may be configured to perform facial authentication by comparing the facial feature quantities of the user acquired by the biometric information acquisition unit 110 with the facial feature quantities of registered users that have been registered in advance. If the biometric information acquisition unit 110 has acquired the biometric information of multiple users, the authentication unit 120 may perform authentication processing for each of the multiple users. The authentication unit 120 is configured to output the result of the authentication processing (hereinafter referred to as "authentication result") via, for example, an output device 16 (see Figure 1). The timing at which the authentication unit 120 outputs the authentication result is determined by a determination unit 140, which will be described later.
[0027] The determination unit 130 is configured to determine the authentication difficulty. Here, "authentication difficulty" is determined as the degree to which a user in the authentication area is likely to leave the authentication area without completing the authentication process. The determination unit 130 may determine the authentication difficulty using various information, such as images captured by the camera 20. Specific examples of the information used by the determination unit 130 to determine the authentication difficulty (hereinafter referred to as "determination elements") will be explained in detail in other embodiments described later. The information regarding the authentication difficulty determined by the determination unit 130 is output to the decision unit 140.
[0028] The determination unit 140 is configured to determine the timing of the authentication result output by the authentication unit 120 according to the authentication difficulty determined by the judgment unit 130. For example, the determination unit 140 may set the output timing earlier when the authentication difficulty is high (i.e., when there is a high possibility that the user will reach outside the authentication area without completing the authentication process), and set the output timing later when the authentication difficulty is low (i.e., when there is a low possibility that the user will reach outside the authentication area without completing the authentication process). The determination unit 140 may also be configured to determine only the output timing of a specific authentication result. For example, the determination unit 140 may not determine the output timing of the authentication result when the authentication process is successful, but may be configured to determine the output timing of the authentication result when the authentication process fails (for example, the timing of outputting an alert).
[0029] (Flow of operations) Next, with reference to Figure 3, the overall operation flow of the information processing device 10 according to the first embodiment will be described. Figure 3 is a flowchart showing the operation flow of the information processing device according to the first embodiment.
[0030] As shown in Figure 3, when the operation of the information processing device 10 according to the first embodiment is started, first the biometric information acquisition unit 110 acquires the biometric information of the user present in the authentication area (step S101). Then, the authentication unit 120 performs authentication processing using the biometric information acquired by the biometric information acquisition unit 110 (step S102). Meanwhile, the determination unit 130 determines the difficulty level of authentication (step S103).
[0031] Next, the determination unit 140 determines the timing for outputting the authentication result based on the authentication difficulty level determined by the judgment unit 130 (step S104). Then, the authentication unit 120 outputs the authentication result at the output timing determined by the determination unit 140 (step S105).
[0032] (Example of authentication result output) Next, with reference to Figure 4, we will specifically describe an example of output by the information processing device 10 according to the first embodiment (here, an example of display on a display). Figure 4 is a plan view showing an example of the display of authentication results by the information processing device according to the first embodiment. In Figure 4, we will explain an example of performing facial recognition on a user walking from the back of the drawing to the front.
[0033] As shown in Figure 4, in the information processing device 10 according to the first embodiment, the authentication result may be displayed superimposed on the image of the authentication area captured by the camera 20. For example, the authentication result may be indicated by a rectangle displayed around the user's face in the image. Here, the rectangle displayed in the image is displayed in a different color depending on the progress of the authentication process. Specifically, for users whose authentication process has been successful, a green rectangle is displayed, indicating that passage is OK. For users whose authentication process has failed, a red rectangle is displayed, indicating that passage is NOT OK. For users who are currently being authenticated (i.e., users whose authentication has not yet been successful, but who have not yet been determined to have failed), a white rectangle is displayed.
[0034] For example, when a user enters the field of view of camera 20, the user's face is detected first, and a white rectangle is displayed around the detected user's face. Subsequently, for users whose facial recognition is successful, the color of the rectangle changes from white (determining) to green (pass OK). Such users are permitted to pass through the authentication area and enter the subsequent restricted area. On the other hand, for users whose facial recognition fails, the color of the rectangle changes from white (determining) to red (pass NG). Such users should be prohibited from entering the restricted area. Therefore, measures such as restricting entry are necessary for users whose rectangles are displayed in red. This measure may be taken, for example, by a monitor monitoring the authentication results.
[0035] (Display operation) Next, with reference to Figure 5, the operation when outputting the above-mentioned display example will be explained. Figure 5 is a flowchart showing the flow of operation when displaying the authentication result by the information processing device according to the first embodiment.
[0036] As shown in Figure 5, in the information processing device 10 according to the first embodiment, the authentication unit 120 first determines whether the user to be authenticated is already an authenticated user (i.e., a user whose authentication has been successful) (step S151). Whether or not a user is already authenticated can be determined, for example, by storing the person ID corresponding to a user whose authentication has been successful.
[0037] If the user being authenticated is already authenticated (Step S151: YES), the authentication unit 120 continues to display "OK to pass" (i.e., a green rectangle) as the authentication result (Step S154). On the other hand, if the user being authenticated is not already authenticated (Step S151: NO), the authentication unit 120 performs facial recognition (Step S152). If facial recognition is successful (Step S153: YES), the authentication unit 120 displays "OK to pass" (i.e., a green rectangle) as the authentication result (Step S154).
[0038] On the other hand, if facial recognition is unsuccessful (step S153: NO), the authentication unit 120 determines whether or not an alert has already been output (i.e., whether or not a red rectangle is being displayed) (step S155). If an alert has already been output (step S155: YES), the authentication unit 120 continues to display "No entry" (i.e., a red rectangle) as the authentication result (step S158). On the other hand, if an alert has not already been output (step S155: NO), the determination unit 140 determines a threshold N based on the authentication difficulty. Here, "threshold N" is a threshold set to determine the timing of displaying the authentication result (specifically, a red rectangle indicating authentication failure), and N is a value corresponding to the number of frames of the image captured by the camera 20. The threshold N is determined to be a smaller value, for example, the higher the authentication difficulty.
[0039] Once the threshold N is determined, the authentication unit 120 determines whether the number of frames acquired without successful authentication (hereinafter referred to as "number of consecutive frames") exceeds the threshold N (step S157). If the number of consecutive frames exceeds N (step S157: YES), the authentication unit 120 displays "No Entry" (i.e., a red rectangle) as the authentication result (step S158). On the other hand, if the number of consecutive frames does not exceed N (step S157: NO), the authentication unit 120 displays a white rectangle indicating that the determination is in progress (step S159).
[0040] The series of processes described above are repeated each time, for example, an image frame is acquired. As a result, the color of the rectangle changes from white to green for users who are successfully authenticated, and from white to red for users who are not successfully authenticated. In this embodiment in particular, the timing at which the red rectangle is displayed changes depending on the threshold N, so as a result, the timing of outputting the authentication result changes according to the authentication difficulty.
[0041] (Technical effects) Next, the technical effects obtained by the information processing device 10 according to the first embodiment will be described.
[0042] As explained in Figures 1 to 5, in the information processing device 10 according to the first embodiment, the timing of outputting the authentication result is determined based on the authentication difficulty. In this way, the authentication result for each user can be output at an appropriate time. As a result, it is possible to prevent missing users who reach the outside of the authentication area without completing the authentication process. For example, for users with a high authentication difficulty (i.e., those who are difficult to authenticate), the timing of outputting the authentication result is determined to be earlier, so an alert is output at an early stage. Therefore, it becomes possible to appropriately identify users who should not be allowed to pass through the authentication area. On the other hand, for users with a low authentication difficulty (i.e., those who are easy to authenticate), the timing of outputting the authentication result is determined to be later, so an alert is output after sufficient time has been used to perform the authentication process. Therefore, unnecessary alerts are suppressed, and as a result, it becomes possible to appropriately identify users who should not be allowed to pass through the authentication area.
[0043] <Second Embodiment> The information processing device 10 according to the second embodiment will be described with reference to Figure 6. Note that the second embodiment describes a specific example of the determination element for determining the difficulty of authentication, and other parts may be the same as those of the first embodiment. Therefore, the following will describe in detail the parts that differ from the first embodiment already described, and will omit explanations of other overlapping parts as appropriate.
[0044] (Flow of operations) First, the overall operation flow of the information processing device 10 according to the second embodiment will be explained with reference to Figure 6. Figure 6 is a flowchart showing the operation flow of the information processing device according to the second embodiment. Note that in Figure 6, the same reference numerals are used for the same processes as shown in Figure 3.
[0045] As shown in Figure 6, when the operation of the information processing device 10 according to the second embodiment is started, first the biometric information acquisition unit 110 acquires the biometric information of the user present in the authentication area (step S101). Then, the authentication unit 120 performs authentication processing using the biometric information acquired by the biometric information acquisition unit 110 (step S102).
[0046] Meanwhile, the determination unit 130 acquires information about the user's movement speed as a determination element for determining the difficulty of authentication (step 201). For example, the determination unit 130 may acquire the user's movement speed from images captured by the camera 20 (for example, the difference in the user's position in consecutive frames). Alternatively, the determination unit 130 may acquire the user's movement speed using other means such as a speed sensor.
[0047] Next, the determination unit 130 uses the acquired information regarding the user's movement speed to determine the authentication difficulty (step S202). For example, the determination unit 130 may determine that a user with a fast movement speed will pass through the authentication area quickly (in other words, the time available for authentication is short) and set the authentication difficulty to a high level. Conversely, the determination unit 130 may determine that a user with a slow movement speed or who is standing still will remain in the authentication area for a long time (in other words, the time available for authentication processing is long) and set the authentication difficulty to a low level.
[0048] Next, the determination unit 140 determines the timing for outputting the authentication result based on the authentication difficulty level determined by the judgment unit 130 (step S104). Then, the authentication unit 120 outputs the authentication result at the output timing determined by the determination unit 140 (step S105).
[0049] (Technical effects) Next, the technical effects obtained by the information processing device 10 according to the second embodiment will be described.
[0050] As explained in Figure 6, in the information processing device 10 according to the second embodiment, the authentication difficulty is determined based on the user's movement speed. In this way, it is possible to accurately identify, for example, users who are likely to pass through the authentication area quickly and users who remain in the authentication area for a long time, thereby appropriately determining the authentication difficulty. As a result, it becomes possible to output the authentication result at the appropriate time.
[0051] <Third Embodiment> The information processing device 10 according to the third embodiment will be described with reference to Figure 7. The third embodiment, like the second embodiment described above, describes specific examples of determination elements, and other parts may be the same as those of the first and second embodiments. Therefore, the following will describe in detail the parts that differ from the embodiments already described, and will omit explanations of other overlapping parts as appropriate.
[0052] (Flow of operations) First, the overall operation flow of the information processing device 10 according to the third embodiment will be explained with reference to Figure 7. Figure 7 is a flowchart showing the operation flow of the information processing device according to the third embodiment. Note that in Figure 7, the same reference numerals are used for the same processes as shown in Figure 3.
[0053] As shown in Figure 7, when the operation of the information processing device 10 according to the third embodiment is started, first the biometric information acquisition unit 110 acquires the biometric information of the user present in the authentication area (step S101). Then, the authentication unit 120 performs authentication processing using the biometric information acquired by the biometric information acquisition unit 110 (step S102).
[0054] Meanwhile, the determination unit 130 acquires information about the user's position as a determination element for determining the difficulty of authentication (step 301). For example, the determination unit 130 may acquire the user's position in the authentication area (i.e., the user's position within the field of view of the camera 20) from the image captured by the camera 20. Alternatively, the determination unit 130 may acquire the user's movement speed using other means such as a position sensor.
[0055] Next, the determination unit 130 uses the acquired information regarding the user's location to determine the authentication difficulty (step S302). For example, the determination unit 130 may determine that a user located on the exit side of the authentication area will soon leave the authentication area (in other words, the time available for authentication is short) and set the authentication difficulty to a high level. Conversely, the determination unit 130 may determine that a user located on the entrance side of the authentication area will remain in the authentication area for a while (in other words, the time available for authentication processing is long) and set the authentication difficulty to a low level.
[0056] Next, the determination unit 140 determines the timing for outputting the authentication result based on the authentication difficulty level determined by the judgment unit 130 (step S104). Then, the authentication unit 120 outputs the authentication result at the output timing determined by the determination unit 140 (step S105).
[0057] (Technical effects) Next, the technical effects obtained by the information processing device 10 according to the third embodiment will be described.
[0058] As explained in Figure 7, in the information processing device 10 according to the third embodiment, the authentication difficulty is determined based on the user's location. This allows for accurate identification of users who are likely to leave the authentication area soon, or users who will remain in the authentication area for a long time, thereby enabling appropriate determination of the authentication difficulty. Consequently, it becomes possible to output the authentication result at the appropriate time.
[0059] The authentication difficulty may be determined based on both the user's movement speed described in the second embodiment and the user's position described in the third embodiment. In this case, the authentication difficulty based on the user's movement speed and the authentication difficulty based on the user's position may be determined separately, and then one of them (for example, the higher one) may be selected. Alternatively, a single authentication difficulty may be determined by comprehensively considering the user's movement speed and position. Thus, the authentication difficulty may be determined based on multiple determination factors. Although an example using the user's movement speed and position has been given here, the authentication difficulty may be determined by combining the various determination factors described in subsequent embodiments.
[0060] <Fourth Embodiment> The information processing device 10 according to the fourth embodiment will be described with reference to Figure 8. The fourth embodiment, like the second and third embodiments described above, describes specific examples of determination elements, and other parts may be the same as those of the first to third embodiments. Therefore, the following will describe in detail the parts that differ from the embodiments already described, and will omit explanations of other overlapping parts as appropriate.
[0061] (Flow of operations) First, the overall operation flow of the information processing device 10 according to the fourth embodiment will be explained with reference to Figure 8. Figure 8 is a flowchart showing the operation flow of the information processing device according to the fourth embodiment. Note that in Figure 8, the same reference numerals are used for the same processes as shown in Figure 3.
[0062] As shown in Figure 8, when the operation of the information processing device 10 according to the fourth embodiment is started, first the biometric information acquisition unit 110 acquires the biometric information of the user present in the authentication area (step S101). Then, the authentication unit 120 performs authentication processing using the biometric information acquired by the biometric information acquisition unit 110 (step S102).
[0063] On the other hand, the determination unit 130 predicts whether one user will overlap with another user as a determination element for determining the difficulty of authentication (step 401). That is, the determination unit 130 predicts whether one user will be hidden by another user from the perspective of the camera 20. For example, the determination unit 130 may determine whether a user at a given location will overlap with another user based on the position, speed of movement, and direction of movement of one user and the other user. Note that existing technologies can be appropriately adopted for the prediction method here, so a detailed explanation will be omitted.
[0064] Next, the determination unit 130 determines the authentication difficulty using the prediction results regarding user overlap (step S402). For example, for users who are predicted to overlap with other users, the determination unit 130 may determine that they will soon be hidden by other users and their biometric information will no longer be obtainable (in other words, the time available for authentication is short) and set the authentication difficulty to a high level. Conversely, for users who are not predicted to overlap with other users, the determination unit 130 may determine that they can continue to obtain biometric information for a while (in other words, the time available for performing the authentication process is long) and set the authentication difficulty to a low level.
[0065] Next, the determination unit 140 determines the timing for outputting the authentication result based on the authentication difficulty level determined by the judgment unit 130 (step S104). Then, the authentication unit 120 outputs the authentication result at the output timing determined by the determination unit 140 (step S105).
[0066] (Technical effects) Next, the technical effects obtained by the information processing device 10 according to the fourth embodiment will be described.
[0067] As explained in Figure 8, in the information processing device 10 according to the fourth embodiment, the authentication difficulty is determined based on whether or not the user overlaps with other users. In this way, it is possible to identify users who will be difficult to authenticate in the future and appropriately determine the authentication difficulty. Therefore, it becomes possible to output the authentication result at the appropriate time.
[0068] <Fifth Embodiment> The information processing device 10 according to the fifth embodiment will be described with reference to Figure 9. The fifth embodiment, like the second to fourth embodiments described above, describes specific examples of determination elements, and other parts may be the same as those of the first to fourth embodiments. Therefore, the following will describe in detail the parts that differ from the embodiments already described, and will omit explanations of other overlapping parts as appropriate.
[0069] (Flow of operations) First, the overall operation flow of the information processing device 10 according to the fifth embodiment will be explained with reference to Figure 9. Figure 9 is a flowchart showing the operation flow of the information processing device according to the fifth embodiment. Note that in Figure 9, the same reference numerals are used for the same processes as shown in Figure 3.
[0070] As shown in Figure 9, when the operation of the information processing device 10 according to the fifth embodiment is started, first the biometric information acquisition unit 110 acquires the biometric information of the user present in the authentication area (step S101). Then, the authentication unit 120 performs authentication processing using the biometric information acquired by the biometric information acquisition unit 110 (step S102).
[0071] On the other hand, the determination unit 130 determines whether the user is intentionally trying to circumvent the authentication process as a determination element for determining the difficulty of authentication (step 501). For example, the determination unit 130 may determine that the user is intentionally trying to circumvent the authentication process (i.e., trying to pass through illegally) if it detects that the user is covering their face with both hands, wearing a mask and sunglasses to prevent their face from being exposed, or walking backward.
[0072] Next, the determination unit 130 determines the authentication difficulty using the prediction results regarding unauthorized access (step S502). For example, the determination unit 130 may determine that a user attempting unauthorized access is intentionally creating a situation that makes authentication difficult, and set the authentication difficulty high. Alternatively, the determination unit 130 may set the authentication difficulty high not only from the perspective of difficulty in authentication, but also from the perspective of suppressing unauthorized access. That is, it may determine that an authentication result (alert) should be output at an early stage for a user attempting unauthorized access, and set the authentication difficulty high to speed up the output timing.
[0073] Next, the determination unit 140 determines the timing for outputting the authentication result based on the authentication difficulty level determined by the judgment unit 130 (step S104). Then, the authentication unit 120 outputs the authentication result at the output timing determined by the determination unit 140 (step S105).
[0074] (Technical effects) Next, the technical effects obtained by the information processing device 10 according to the fifth embodiment will be described.
[0075] As explained in Figure 9, in the information processing device 10 according to the fifth embodiment, the authentication difficulty is determined based on whether or not the user is intentionally trying to bypass the authentication process. In this way, it is possible to identify users who are trying to fraudulently bypass the authentication process and to appropriately determine the authentication difficulty. Therefore, it becomes possible to output the authentication result at the appropriate time.
[0076] <Sixth Embodiment> The information processing device 10 according to the sixth embodiment will be described with reference to Figure 10. The sixth embodiment, like the second to fifth embodiments described above, describes specific examples of determination elements, and other parts may be the same as those of the first to fifth embodiments. Therefore, the following will describe in detail the parts that differ from the embodiments already described, and will omit explanations of other overlapping parts as appropriate.
[0077] (Flow of operations) First, the overall operation flow of the information processing device 10 according to the sixth embodiment will be explained with reference to Figure 10. Figure 10 is a flowchart showing the operation flow of the information processing device according to the sixth embodiment. Note that in Figure 10, the same reference numerals are used for the same processes as shown in Figure 3.
[0078] As shown in Figure 10, when the operation of the information processing device 10 according to the sixth embodiment is started, first the biometric information acquisition unit 110 acquires the biometric information of the user present in the authentication area (step S101). Then, the authentication unit 120 performs authentication processing using the biometric information acquired by the biometric information acquisition unit 110 (step S102).
[0079] Meanwhile, the determination unit 130 acquires information about the user's worn items as a determination element for determining the difficulty of authentication (step 601). For example, the determination unit 130 may acquire information about the mask, sunglasses, or full-face helmet worn by the user from the image captured by the camera 20. Note that the worn items listed here are just examples, and any worn items that may affect the difficulty of authentication may be detected as appropriate.
[0080] Next, the determination unit 130 uses the acquired information about the user's worn items to determine the authentication difficulty (step S602). For example, the determination unit 130 may determine that it is difficult to acquire facial features (in other words, it is difficult to perform facial recognition successfully) for users wearing masks or sunglasses, and may set the authentication difficulty to a high level. Conversely, the determination unit 130 may determine that it is easy to acquire facial features (in other words, it is possible to perform facial recognition successfully) for users not wearing masks or sunglasses, and may set the authentication difficulty to a low level.
[0081] Next, the determination unit 140 determines the timing for outputting the authentication result based on the authentication difficulty level determined by the judgment unit 130 (step S104). Then, the authentication unit 120 outputs the authentication result at the output timing determined by the determination unit 140 (step S105).
[0082] (Technical effects) Next, the technical effects obtained by the information processing device 10 according to the sixth embodiment will be described.
[0083] As explained in Figure 10, in the information processing device 10 according to the sixth embodiment, the authentication difficulty is determined based on the user's worn items. In this way, it is possible to recognize when authentication is difficult due to the worn items and to appropriately determine the authentication difficulty. Therefore, it is possible to output the authentication result at the appropriate time.
[0084] <Seventh Embodiment> The information processing device 10 according to the seventh embodiment will be described with reference to Figure 11. The seventh embodiment, like the second to sixth embodiments described above, describes specific examples of determination elements, and other parts may be the same as those of the first to sixth embodiments. Therefore, the following will describe in detail the parts that differ from the embodiments already described, and will omit explanations of other overlapping parts as appropriate.
[0085] (Flow of operations) First, the overall operation flow of the information processing device 10 according to the seventh embodiment will be explained with reference to Figure 11. Figure 11 is a flowchart showing the operation flow of the information processing device according to the seventh embodiment. Note that in Figure 11, the same reference numerals are used for the same processes as shown in Figure 3.
[0086] As shown in Figure 11, when the information processing device 10 according to the seventh embodiment starts operating, first the biometric information acquisition unit 110 acquires the biometric information of the user present in the authentication area (step S101). Then, the authentication unit 120 performs authentication processing using the biometric information acquired by the biometric information acquisition unit 110 (step S102).
[0087] Meanwhile, the determination unit 130 acquires information on at least one of the user's face orientation, posture, and direction of movement as determination elements for determining the difficulty of authentication (step 701). For example, the determination unit 130 may acquire the user's face orientation, posture, and direction of movement from an image captured by the camera 20. Alternatively, the determination unit 130 may acquire the user's face orientation, posture, and direction of movement using various sensors other than the camera 20.
[0088] Next, the determination unit 130 determines the authentication difficulty using the acquired information regarding at least one of the user's face orientation, posture, and direction of movement (step S702). For example, if the user's face is not facing forward (i.e., towards the camera 20), or if the user's face is difficult to see from the camera 20 due to the user's posture (e.g., leaning forward), or if the user's direction of movement is not toward the camera 20, the determination unit 130 may determine that it is difficult to acquire the user's facial features (in other words, it is difficult to properly perform biometric data acquisition) and set the authentication difficulty to a high level. However, if the user's direction of movement is different from the expected direction (e.g., not toward the restricted area), the determination unit 130 may determine that the user does not intend to enter the restricted area (in other words, there is no need to output an alert even if authentication fails) and set the authentication difficulty to a low level.
[0089] Next, the determination unit 140 determines the timing for outputting the authentication result based on the authentication difficulty level determined by the judgment unit 130 (step S104). Then, the authentication unit 120 outputs the authentication result at the output timing determined by the determination unit 140 (step S105).
[0090] (Technical effects) Next, the technical effects obtained by the information processing device 10 according to the seventh embodiment will be described.
[0091] As explained in Figure 11, in the information processing device 10 according to the seventh embodiment, the authentication difficulty is determined based on at least one of the user's face orientation, posture, and direction of movement. In this way, it is possible to identify users who are difficult to authenticate or users who do not necessarily need to be authenticated, and to appropriately determine the authentication difficulty. Therefore, it is possible to output the authentication result at the appropriate time.
[0092] <Eighth Embodiment> The information processing device 10 according to the eighth embodiment will be described with reference to Figures 12 and 13. Note that the eighth embodiment differs from the first to seventh embodiments described above only in some configurations and operations; other parts may be identical to the first to seventh embodiments. Therefore, the following will describe in detail the parts that differ from the embodiments already described, while omitting explanations of other overlapping parts as appropriate.
[0093] (Functional configuration) First, the functional configuration of the information processing device 10 according to the eighth embodiment will be described with reference to Figure 12. Figure 12 is a block diagram showing the functional configuration of the information processing device according to the eighth embodiment. Note that in Figure 12, the same reference numerals are used for elements similar to those shown in Figure 2.
[0094] As shown in Figure 12, the information processing device 10 according to the eighth embodiment is configured to include a biometric information acquisition unit 110, an authentication unit 120, a determination unit 130, a decision unit 140, and a modification unit 150 as components for realizing its functions. That is, the information processing device 10 according to the eighth embodiment is configured to further include a modification unit 150 in addition to the configuration of the first embodiment (see Figure 2). The modification unit 150 may be, for example, a processing block realized by the processor 11 (see Figure 1) described above.
[0095] The modification unit 150 is configured to change the output manner of the authentication result according to the type of authentication difficulty determination element in the determination unit 130. For example, the modification unit 150 may change the output manner of the authentication result depending on whether the determination unit 130 determines the authentication difficulty using the user's movement speed or using the user's position. Furthermore, if the determination unit 130 determines the authentication difficulty using multiple determination elements, the modification unit 150 may change the output manner of the authentication result if all of the determination elements are different, or it may change the output manner of the authentication result if some of the determination elements are different. For example, when the determination unit 130 determines the authentication difficulty using the user's movement speed and position, and when it determines the authentication difficulty using the user's movement speed and worn items, both use the user's movement speed as a determination element, but the other determination elements are not common. In such a case, it may be determined that all of the determination elements are the same and the output manner may not be changed, or it may be determined that some of the determination elements are different and the output manner may be changed.
[0096] When changing the output mode, the modification unit 150 may change, for example, the color, size, shape, emphasis, etc., when displaying the authentication result. Alternatively, the modification unit 150 may change the volume, tone, etc., when outputting the authentication result as sound. The modification unit 150 may also change the output mode of the authentication result according to the judgment element. For example, if the judgment element is the result of a user's unauthorized passage (see the fifth embodiment), the modification unit 150 may determine that the user is one that requires more attention and change the output mode to something more emphasized (for example, a conspicuous color, a larger display, a flashing display, a louder sound, etc.).
[0097] (Flow of operations) Next, the overall operation flow of the information processing device 10 according to the eighth embodiment will be described with reference to Figure 13. Figure 13 is a flowchart showing the operation flow of the information processing device according to the eighth embodiment. Note that in Figure 13, the same reference numerals are used for the same processes as shown in Figure 3.
[0098] As shown in Figure 13, when the operation of the information processing device 10 according to the eighth embodiment is started, first the biometric information acquisition unit 110 acquires the biometric information of the user present in the authentication area (step S101). Then, the authentication unit 120 performs authentication processing using the biometric information acquired by the biometric information acquisition unit 110 (step S102). Meanwhile, the determination unit 130 determines the difficulty level of authentication (step S103). Information regarding the determination elements used by the determination unit 130 when determining the difficulty level of authentication is output to the modification unit 150.
[0099] Next, the determination unit 140 determines the timing for outputting the authentication result based on the authentication difficulty level determined by the judgment unit 130 (step S104). In this embodiment in particular, the modification unit 150 changes the output mode of the authentication result based on the judgment elements used by the determination unit 130 (step S801). Then, the authentication unit 120 outputs the authentication result at the output timing determined by the determination unit 140 and with the output mode changed by the modification unit 150 (step S802).
[0100] (Technical effects) Next, the technical effects obtained by the information processing device 10 according to the eighth embodiment will be described.
[0101] As explained in Figures 12 and 13, in the information processing device 10 according to the eighth embodiment, the output manner of the authentication result is changed according to the type of determination element. In this way, the importance of the authentication result can be recognized by the difference in output manner. For example, if it can be determined from the type of determination element that the user should be closely monitored, the authentication result is output to the monitoring person or other recipient in an appropriate output manner, so that the monitoring person who receives the authentication result can easily recognize its importance.
[0102] <Ninth Embodiment> The information processing device 10 according to the ninth embodiment will be described with reference to Figure 14. Note that the ninth embodiment differs from the first to eighth embodiments described above only in some operations; other parts may be identical to the first to eighth embodiments. Therefore, the following will describe in detail the parts that differ from the embodiments already described, and will omit explanations of other overlapping parts as appropriate.
[0103] (Flow of operations) First, the overall operation flow of the information processing device 10 according to the ninth embodiment will be explained with reference to Figure 14. Figure 14 is a flowchart showing the operation flow of the information processing device according to the ninth embodiment. Note that in Figure 14, the same reference numerals are used for the same processes as shown in Figure 3.
[0104] As shown in Figure 14, when the operation of the information processing device 10 according to the ninth embodiment begins, the biometric information acquisition unit 110 first acquires the biometric information of the user present in the authentication area (step S101). Then, the authentication unit 120 performs authentication processing using the biometric information acquired by the biometric information acquisition unit 110 (step S102). Meanwhile, the determination unit 130 determines the difficulty level of authentication (step S103). Information regarding the determination elements used by the determination unit 130 when determining the difficulty level of authentication is output to the modification unit 150.
[0105] Next, the determination unit 140 determines the timing for outputting the authentication result based on the authentication difficulty level determined by the judgment unit 130 and the number of people that can be handled (step S901). That is, the determination unit 140 according to this embodiment determines the timing for outputting the authentication result by considering the number of people that can be handled in addition to the authentication difficulty level described in each of the embodiments described above. Here, "number of people that can be handled" refers to the number of personnel (e.g., monitors, etc.) that can handle a user who is found to have reached the outside of the authentication area without completing the authentication process. The number of people that can be handled may be a number set in advance (for example, a number corresponding to the attendance management information of staff for that time period), or it may be a value that is output by detecting the number of monitors that can actually handle the situation each time.
[0106] The decision unit 140 may, for example, determine that if the number of users that can be handled is relatively small, it will be unable to handle a large number of users simultaneously, and may decide to delay the timing of outputting the authentication result. Conversely, if the number of users that can be handled is relatively large, the decision unit 140 may determine that it can handle a large number of users simultaneously, and may decide to speed up the timing of outputting the authentication result. Subsequently, the authentication unit 120 outputs the authentication result at the output timing determined by the decision unit 140 (i.e., the output timing determined based on the authentication difficulty and the number of users that can be handled) (step S902).
[0107] (Technical effects) Next, the technical effects obtained by the information processing device 10 according to the ninth embodiment will be described.
[0108] As explained in Figure 14, in the information processing device 10 according to the ninth embodiment, the timing of outputting the authentication result is determined not only by the authentication difficulty but also by the number of personnel who can handle it. In this way, the authentication result can be output at a more appropriate timing compared to when only the authentication difficulty is used.
[0109] The processing method of recording a program that operates the configuration of each embodiment in order to realize the functions of each embodiment described above on a recording medium, reading the program recorded on the recording medium as code, and executing it on a computer is also included in the scope of each embodiment. In other words, a computer-readable recording medium is also included in the scope of each embodiment. Furthermore, not only the recording medium on which the above-mentioned program is recorded, but also the program itself is included in each embodiment.
[0110] Examples of recording media that can be used include floppy disks, hard disks, optical disks, magneto-optical disks, CD-ROMs, magnetic tapes, non-volatile memory cards, and ROMs. Furthermore, the scope of each embodiment is not limited to programs that perform processing on the recording media alone, but also includes programs that operate on the OS and perform processing in cooperation with other software and the functions of expansion boards. In addition, the program itself may be stored on a server, and part or all of the program may be made available for download from the server to the user terminal.
[0111] <Note> The embodiments described above may also be described in the following appendix, but are not limited to these.
[0112] (Note 1) The information processing device described in Appendix 1 is an information processing device comprising: acquisition means for acquiring biometric information of a user present in an authentication area; authentication means for executing an authentication process based on the biometric information; determination means for determining the difficulty of authentication, which indicates the possibility that the user may reach outside the authentication area without completing the authentication process; and determination means for determining the timing of outputting the result of the authentication process according to the difficulty of authentication.
[0113] (Note 2) The information processing device described in Appendix 2 is the same as the information processing device described in Appendix 1, wherein the determination means determines the authentication difficulty based on the user's movement speed.
[0114] (Note 3) The information processing device described in Appendix 3 is the information processing device described in Appendix 1 or 2, wherein the determination means determines the authentication difficulty based on the user's location.
[0115] (Note 4) The information processing device described in Appendix 4 is an information processing device described in any one of Appendix 1 to 3, wherein the determination means determines the authentication difficulty based on whether or not it is predicted that the user will overlap with another user, as seen from the sensor that acquires the biometric information.
[0116] (Note 5) The information processing device described in Appendix 5 is the information processing device described in any one of Appendix 1 to 4, wherein the determination means determines the difficulty of authentication based on whether the user is intentionally trying to circumvent the authentication process.
[0117] (Note 6) The information processing device described in Appendix 6 is an information processing device described in any one of Appendix 1 to 5, wherein the determination means determines the authentication difficulty based on the user's worn items.
[0118] (Note 7) The information processing device described in Appendix 7 is the information processing device described in any one of Appendix 1 to 6, wherein the determination means determines the authentication difficulty based on at least one of the user's face orientation, posture, and direction of movement.
[0119] (Note 8) The information processing device described in Appendix 8 is the information processing device described in any one of Appendix 1 to 7, further comprising a changing means for changing the output manner of the authentication process result according to the type of authentication difficulty determination element in the determination means.
[0120] (Note 9) The information processing device described in Appendix 9 is an information processing device described in any one of Appendix 1 to 8, wherein the determination means determines the timing of outputting the result of the authentication process in addition to the authentication difficulty, according to the number of personnel available to handle a user who has reached outside the authentication area without completing the authentication process.
[0121] (Note 10) The information processing system described in Appendix 10 is an information processing system comprising: acquisition means for acquiring biometric information of a user present in an authentication area; authentication means for executing an authentication process based on the biometric information; determination means for determining the difficulty of authentication, which indicates the possibility that the user may reach outside the authentication area without completing the authentication process; and determination means for determining the timing of outputting the result of the authentication process according to the difficulty of authentication.
[0122] (Note 11) The information processing method described in Appendix 9 is an information processing method which involves at least one computer acquiring the biometric information of a user present in the authentication area, performing an authentication process based on the biometric information, determining the authentication difficulty level indicating the possibility that the user may reach the outside of the authentication area without completing the authentication process, and determining the timing of outputting the result of the authentication process according to the authentication difficulty level.
[0123] (Note 12) The recording medium described in Appendix 10 is a recording medium on which a computer program is recorded that causes at least one computer to execute an information processing method that acquires the biometric information of a user present in an authentication area, performs an authentication process based on the biometric information, determines the difficulty level of authentication which indicates the possibility that the user may reach outside the authentication area without completing the authentication process, and determines the timing of outputting the result of the authentication process according to the difficulty level of authentication.
[0124] (Note 13) The computer program described in Appendix 11 is a computer program that causes at least one computer to execute an information processing method which includes acquiring the biometric information of a user present in an authentication area, performing an authentication process based on the biometric information, determining the difficulty level of authentication which indicates the possibility that the user may reach the outside of the authentication area without completing the authentication process, and determining the timing of outputting the result of the authentication process according to the difficulty level of authentication.
[0125] This disclosure may be modified as appropriate, insofar as it does not contradict the gist or idea of the invention as can be inferred from the claims and the specification as a whole, and information processing devices, information processing systems, information processing methods, and recording media that include such modifications are also included in the technical idea of this disclosure. [Explanation of symbols]
[0126] 10 Information Processing Devices 11 processors 110 Biological Information Acquisition Unit 120 Authentication Department 130 Judgment section 140 Decision Section 150 Changes
Claims
1. A means for acquiring the user's biometric information present in the authentication area, Authentication means that performs authentication processing based on the aforementioned biometric information, A determination means for determining the authentication difficulty, which indicates the possibility that the user may reach the outside of the authentication area without completing the authentication process, based on the information indicating the user's status. A determination means for determining the timing of outputting the results of the authentication process according to the authentication difficulty level, An information processing device equipped with the following features.
2. The determination means determines the authentication difficulty based on the user's movement speed. The information processing apparatus according to claim 1.
3. The determination means determines the authentication difficulty based on the user's location. The information processing apparatus according to claim 1 or 2.
4. The acquisition means acquires the biometric information from the captured image taken by the camera that photographs the authentication area, The determination means determines the authentication difficulty based on whether or not it is predicted that the user will overlap with another user as seen from the camera. The information processing apparatus according to claim 1 or 2.
5. The determination means determines the authentication difficulty based on whether the user is intentionally trying to circumvent the authentication process. The information processing apparatus according to claim 1 or 2.
6. The determination means determines the authentication difficulty level based on the user's worn items. The information processing apparatus according to claim 1 or 2.
7. The determination means determines the authentication difficulty based on at least one of the user's face orientation, posture, and direction of movement. The information processing apparatus according to claim 1 or 2.
8. The determination means further includes a modification means for changing the output manner of the authentication process result according to the type of authentication difficulty determination element in the determination means. The information processing apparatus according to claim 1 or 2.
9. By at least one computer, Obtain the user's biometric information present in the authentication area, Based on the aforementioned biometric information, an authentication process is performed. Based on the information indicating the user's status, the authentication difficulty level is determined, which indicates the likelihood that the user may reach the outside of the authentication area without completing the authentication process. The timing of outputting the results of the authentication process is determined according to the authentication difficulty level. Information processing methods.
10. On at least one computer, Obtain the user's biometric information present in the authentication area, Based on the aforementioned biometric information, an authentication process is performed. Based on the information indicating the user's status, the authentication difficulty level is determined, which indicates the likelihood that the user may reach the outside of the authentication area without completing the authentication process. The timing of outputting the results of the authentication process is determined according to the authentication difficulty level. A computer program that executes information processing methods.