Authentication device, method for controlling authentication device, and program

Abstract

To reduce the time required from when a person is photographed by an imaging apparatus until when the person is authenticated, compared to a configuration in which all images created through photographing performed by a plurality of imaging apparatuses are processed by an authentication device.SOLUTION: An authentication device comprises acquisition means that acquires an image, and processing means that, when an image created through photographing performed by an imaging apparatus satisfies predetermined conditions, starts processing including authentication of the face of a person captured in the image. One of the conditions is that a moving body is detected from the image created through the photographing. The processing means performs authentication of a face captured in an image satisfying the conditions, from among images created through the photographing performed respectively by a plurality of imaging apparatuses.SELECTED DRAWING: Figure 5

Description

[Technical Field]

[0001] The present invention relates to an authentication device, a control method for an authentication device, and a program. [Background technology]

[0002] Authentication devices for authenticating people have been known for some time. For example, in order to manage people's entry and exit from a room, the authentication device photographs the person's face, compares the photographed face with the person's face, and unlocks the door when the person's face is recognized as a result of the comparison. Patent Document 1 discloses that the facial image of a person using an IC passport at check-in is compared with the captured comparison image to confirm whether the person is the person in question. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2023-074752 Summary of the Invention [Problem to be solved by the invention]

[0004] Here, there are cases where an imaging device is provided for each door that is unlocked by person authentication, and while multiple imaging devices are used to capture images of the person to be authenticated, processing including authentication of the person appearing in the images is performed by a single authentication device. In such a case, if all images generated by each of the multiple imaging devices are processed by the authentication device, it may take a long time for the person to be authenticated by the authentication device after being photographed by the imaging device. The present invention aims to shorten the time required from when a person is photographed by an imaging device to when they are authenticated, compared to a configuration in which all images generated by each of multiple imaging devices are processed by an authentication device. [Means for solving the problem]

[0005] In order to solve the above problem, the authentication device of the present invention comprises an acquisition means for acquiring an image, and a processing means for starting processing including authentication of the face of a person appearing in an image generated by photographing with an imaging device when the image satisfies predetermined conditions, at least one of which is that a moving object is detected in the image generated by photographing, and the processing means targets faces appearing in images that satisfy the conditions among images generated by photographing with each of a plurality of imaging devices for authentication. [Effects of the Invention]

[0006] According to the present invention, the time required from when a person is photographed by an imaging device to when they are authenticated can be shortened compared to a configuration in which all images generated by each of multiple imaging devices are processed by an authentication device. [Brief explanation of the drawings]

[0007] [Figure 1] FIG. 1 is a diagram illustrating an example of the overall configuration of an authentication system. [Figure 2] FIG. 1 is a schematic diagram showing an overview of an authentication system. [Figure 3] FIG. 2 illustrates an example of a hardware configuration of an authentication device. [Figure 4] 10A and 10B are diagrams for explaining a method by which a moving object detection unit of a camera detects a moving object from an image. [Figure 5] FIG. 10 is a flowchart showing the flow of authentication processing. [Figure 6] FIG. 10 is a flowchart showing the flow of another method for authenticating a person by the authentication system. [Figure 7] 7 is a diagram showing the relationship between the number of cameras provided in an authentication system and authentication time when the method shown in FIG. 6 is used for person authentication by the authentication system. FIG. [Figure 8] 10 is a diagram illustrating an example of the relationship between the detection of a moving object by a moving object detection unit of a camera and the control processing by a control unit of an authentication device. [Figure 9] FIG. 10 is a flowchart showing the flow of an authentication process as a modified example. [Figure 10] FIG. 2 is a diagram for explaining the relationship between an image generated by a camera and a person. [Figure 11] FIG. 10 is a diagram for explaining the relationship between a plurality of cameras and a door. [Figure 12] FIG. 10 is a diagram illustrating a configuration of an authentication system according to a first modified example. [Figure 13] FIG. 10 is a diagram illustrating a configuration of an authentication system according to a second modification. DETAILED DESCRIPTION OF THE INVENTION

[0008] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. Fig. 1 is a diagram showing an example of the overall configuration of an authentication system 1. Fig. 2 is a schematic diagram showing an overview of the authentication system 1. The authentication system 1 shown in FIG. 1 is a system for authenticating a person. The authentication system 1 includes multiple cameras 420, an authentication device 400, and multiple doors 430. Although only one camera 420 is shown in the example shown in FIG. 1, as described above, multiple cameras 420 are provided in the authentication system 1. Furthermore, although only one door 430 is shown in the example shown in FIG. 1, as described above, multiple doors are provided in the authentication system 1. In the authentication system 1, for example, a camera 420 may be provided for each door 430. Furthermore, in this embodiment, the number of cameras 420 and the number of doors 430 provided in the authentication system 1 are both seven or more.

[0009] An example of authentication of a person by the authentication system 1 will be described. As shown in FIG. 2, in the authentication system 1, a camera 420 is installed in front of a room having a locked door 430 at the entrance. The camera 420 continuously captures video and transmits the captured images to the authentication device 400. Here, when a person 304 approaches the locked door 430 and enters the field of view of the camera 420, the person 304 appears in the video captured by the camera 420. Furthermore, when the authentication device 400 acquires an image in which the person 304 appears from the camera 420, it detects the face of the person 304 appearing in the acquired image and compares the detected face. Then, if the authentication device 400 does not authenticate the person 304 as a result of the comparison, it keeps the door 430 locked, and if the person 304 is authenticated, it unlocks the door 430.

[0010] As shown in FIG. 1, a camera 420 as an example of an imaging device includes an imaging unit 421, a moving object detection unit 422, and a communication unit 423. The imaging unit 421 generates an image by capturing an image of a subject. The imaging unit 421 of this embodiment continuously captures a moving image of an area included in the angle of view. The moving object detection unit 422, which is an example of a moving object detection means, detects a moving object in an image generated by the image capture unit 421. Examples of a method for detecting a moving object by the moving object detection unit 422 include background subtraction. The moving object detection unit 422 may also detect a moving object from an image based on the results of machine learning. The moving object detection unit 422 of this embodiment continuously detects a moving object from a video generated by the image capture unit 421. More specifically, the moving object detection unit 422 continuously monitors the video, and each time a new image is generated by the image capture unit 421, determines whether or not a moving object is captured in the new image. In this case, each time the moving object detection unit 422 determines whether or not a moving object is captured in an image, it generates information indicating the determination result, i.e., information indicating whether or not a moving object is captured in the image. Hereinafter, the information indicating the determination result by the moving object detection unit 422 may be referred to as result information. Furthermore, when the moving object detection unit 422 detects a moving object from an image, it extracts a portion of the video in which the detected moving object appears. Note that the image extracted by the moving object detection unit 422, i.e., the image of the portion of the video in which the moving object appears, may be referred to as a moving object image hereinafter. A moving object image can also be regarded as an image generated in association with shooting by the camera 420. The moving object detection unit 422 associates the generated moving object image with result information indicating that a moving object appearing in the moving object image has been detected. The communication unit 423 communicates with the authentication device 400 to transmit and receive information to and from the authentication device 400. The communication unit 423 transmits result information to the authentication device 400. Furthermore, when the moving object detection unit 422 detects that a moving object is captured in an image, the communication unit 423 transmits an image of the moving object to the authentication device 400 in response to a request from the authentication device 400. Furthermore, the communication unit 423 may transmit the generated image to the authentication device 400 every time an image is generated by image capture by the imaging unit 421.

[0011] The authentication device 400 is a server that authenticates a person and includes a communication unit 401, a storage unit 402, an instruction unit 404, a registration acceptance unit 405, and a control unit 403. The communication unit 401, which is an example of an acquisition unit, communicates with the camera 420 to send and receive information to and from the camera 420. The communication unit 401 receives result information, moving object images, and the like from the camera 420. The storage unit 402 stores information such as moving object images received by the communication unit 401 . In response to an instruction from the control unit 403, the instruction unit 404 instructs the door 430 to unlock the door 430, thereby causing the door 430 to be unlocked. The registration acceptance unit 405 accepts the registration of a person who is to unlock the door 430. More specifically, the registration acceptance unit 405 acquires an image showing the face of the person who is to unlock the door 430, associates the acquired image with information that identifies the person who is to unlock the door 430, and stores the image in the storage unit 402. Note that the image showing the face of the person who is to unlock the door 430, acquired by the registration acceptance unit 405, may be referred to as a target image hereinafter.

[0012] The control unit 403, which is an example of a processing unit, controls the operation of the authentication device 400. The control unit 403 has a face detection unit 408, an extraction unit 409, and a matching unit 410. The face detection unit 408 detects a person's face from the image sent from the camera 420 to the authentication device 400, that is, from the moving object image. When a face is detected from the moving object image by the face detection unit 408, the extraction unit 409 extracts facial feature amounts from the moving object image. More specifically, the extraction unit 409 extracts feature amounts by indexing the features of each part of the face, such as the eyes and nose. The matching unit 410 matches the face of a person captured in a moving object image. Specifically, the matching unit 410 compares the feature amount for each part of the face extracted by the extraction unit 409 with the feature amount for each part of the face of a person captured in a target image to determine whether the face of the person captured in the moving object image matches the face of the person captured in the target image. In this case, the matching unit 410 compares the face of the person captured in the moving object image with the face of the person captured in the moving object image for each target image stored in the storage unit 402 until it determines that the face of the person captured in the moving object image matches the face of the person captured in the target image. Then, when the matching unit 410 determines that the face of the person captured in the moving object image matches the face of the person captured in the target image, it instructs the instruction unit 404 to unlock the door 430. Furthermore, when the matching unit 410 determines that the face of the person in the moving object image does not match any of the faces of the people in the target images stored in the storage unit 402, it does not issue an instruction to unlock the door 430. In this case, the door 430 remains locked.

[0013] The authentication device 400 is connected to each camera 420 and each door 430 via a network. The type of this network is not particularly limited as long as it is capable of transmitting and receiving data, and may be, for example, the Internet, a LAN (Local Area Network), a WAN (Wide Area Network), etc. Furthermore, the communication line used for transmitting and receiving data may be either wired or wireless.

[0014] 3 is a diagram showing an example of the hardware configuration of the authentication device 400. The authentication device 400 has a CPU 501, a ROM 502, a RAM 503, a hard disk drive (HDD) 504, a disk drive 505, a network interface 506, an input device 507, a display device 508, and a GPU 509. The CPU 501 controls the authentication device 400. The ROM 502 stores a program used by the CPU 501 to control the authentication device 400. A secondary storage device may be provided instead of the ROM 502. The RAM 503 is a memory in which the CPU 501 loads a program read from the ROM 502 and executes processing. The RAM 503 is also used as a primary storage memory, providing a storage area for temporarily storing various types of information. The HDD 504 stores information such as target images. If the CPU 501 references target images via a disk drive 505 or a network interface 506, the authentication device 400 may not need to be provided with an HDD 504. The disk drive 505 reads target images. If the CPU 501 references target images via the HDD 504 or the network interface 506, the authentication device 400 may not need to be provided with a disk drive 505. The network interface 506 is an interface for communicating with external devices. The display device 508 is a device such as a display that displays information such as images. The input device 507 is a device for inputting information. Examples of the input device 507 include a keyboard, a pointing device, a mouse, a touch panel, etc. The GPU 509 is a processor that processes images. In this embodiment, the CPU 501 executes a program to realize various functions of the authentication device 400. Regarding image processing, the GPU 509 may execute the program instead of the CPU 501, or both the CPU 501 and the GPU 509 may execute the program.

[0015] FIG. 4 is a diagram for explaining a method by which the moving object detection unit 422 of the camera 420 detects a moving object from an image. FIG. 4(A) is a diagram showing an image 700 generated by image capture by the imaging unit 421 of the camera 420. A person walking toward the camera 420 is captured in a central display area 700R of the image 700. In this case, the moving object detection unit 422 of the camera 420 detects the person as a moving object from the image 700, and generates a moving object image 701 shown in FIG. 4(B) based on the detection result. Note that the moving object image 701 may be an image showing only the moving object. Alternatively, the moving object image 701 may be an image showing not only the moving object but also the area surrounding the moving object, making it possible to identify the area in which the moving object is displayed.

[0016] 5 is a flowchart showing the flow of authentication processing. The authentication processing is processing in which authentication device 400 authenticates a person. In this embodiment, the authentication processing is started every time camera 420 transmits result information to authentication device 400. The communication unit 401 acquires the result information (step (hereinafter referred to as "S") 101). The face detection unit 408 determines whether or not the image captured by the camera 420 satisfies a processing condition (S102). The processing condition is a condition under which the authentication device 400 starts processing to authenticate a person. In this embodiment, the processing condition is set as the detection of a moving object from an image captured by the camera 420. The face detection unit 408 determines whether or not the processing condition is satisfied by referring to the result information acquired by the communication unit 401. Note that the image to be determined in step 102 is the image captured by the camera 420, which is the destination of the result information acquired in step 101. Furthermore, if the processing condition is not satisfied, that is, if a moving object is not detected from the image (no in S102), the authentication process ends.

[0017] If the processing condition is satisfied (yes in S102), the face detection unit 408 acquires a moving object image from the camera 420 by requesting the moving object image from the camera 420 via the communication unit 401 (S103). The camera 420 from which the face detection unit 408 requests a moving object image is the camera 420 to which result information acquired by the communication unit 401 in the ongoing authentication processing is to be transmitted. The moving object image requested by the face detection unit 408 is a moving object image associated with the result information acquired by the communication unit 401 in the ongoing authentication processing. The face detection unit 408 determines whether or not a face has been detected from the acquired moving object image (S104). If the face detection unit 408 has not detected a face from the moving object image, in other words, if the moving object image does not include a human face (no in S104), the authentication process ends.

[0018] If the face detection unit 408 detects a face from the moving object image (yes in S104), the extraction unit 409 extracts the feature amount of the face from the moving object image in which the face was detected (S105). The matching unit 410 matches the faces of people appearing in the moving object images (S106). The matching unit 410 determines whether or not to authenticate the person appearing in the moving object image (S107). If the person is not authenticated by the verification unit 410 (no in S107), the authentication process ends. If the person is authenticated by the verification unit 410 (yes in S107), the instruction unit 404 unlocks the door 430 (S108).

[0019] In this manner, in this embodiment, when multiple cameras 420 are capturing images, authentication processing proceeds for images transmitted from a camera 420 capturing an image of a moving object, and authentication processing ends for images transmitted from a camera 420 not capturing an image of a moving object. In other words, authentication processing proceeds for images transmitted from a camera 420 only when the camera 420 is capturing an image of a moving object.

[0020] As described above, in this embodiment, when an image captured by the camera 420 satisfies the processing conditions, the control unit 403 of the authentication device 400 starts processing, including authentication of the face of a person appearing in the image. Here, at least one of the processing conditions is that a moving object is detected in the image. As described above, the authentication system 1 of this embodiment is provided with multiple cameras 420, and each camera 420 continuously captures video, generates result information, and transmits the generated result information to the authentication device 400. The authentication device 400 then performs the above-described authentication processing (see FIG. 5 ) for each received result information, and if it is determined that a moving object has been detected in the image during the authentication processing, it proceeds with the processing. That is, the control unit 403 targets faces appearing in images that satisfy the processing conditions among the images captured by each of the multiple cameras 420 as authentication targets. In other words, the control unit 403 restricts processing for images in which a moving object is not detected. Here, as a method of authenticating a person by the authentication system, other methods different from the above-described method of authenticating a person by the authentication system 1 of this embodiment can also be considered. One example of such other method is a method in which the authentication device performs processing such as determining whether or not to authenticate a person for each image generated by each camera.

[0021] Fig. 6 is a flowchart showing the flow of another method for authenticating a person by the authentication system. In the method shown in Fig. 6, each camera provided in the authentication system transmits the generated image to the authentication device every time it captures an image. The authentication device acquires an image from a camera (S201), detects a face from the acquired image (S202), and extracts features of the face detected in the image (S203).The authentication device also collates the face shown in the image by comparing the extracted features with the features of the face in the target image (S204), and determines whether or not to authenticate the person based on the result of the collation (S205). In this way, even if the authentication system processes all images generated by each camera, person authentication can be achieved. However, in this case, it tends to take a long time from when the person is photographed until when they are authenticated.

[0022] Fig. 7 is a diagram showing the relationship between the number of cameras provided in an authentication system and authentication time when the method shown in Fig. 6 is used for authenticating a person by the authentication system. Note that the authentication time is the time from when the authentication device acquires an image to when the person is authenticated. In the example shown in Fig. 6, the authentication time is the time from when the processing of step 201 starts to when the processing of step 205 ends. When the method shown in Fig. 6 is used to authenticate a person using an authentication system, the authentication time increases exponentially as the number of cameras installed in the authentication system increases. In addition, when each camera continuously captures and transmits video to the authentication device, the authentication device simultaneously performs the process shown in Fig. 6 on multiple images acquired from each camera, and therefore the authentication time increases as the number of cameras installed in the authentication system increases. Furthermore, Fig. 7 shows that when seven or more cameras are installed in the authentication system, the authentication time exceeds one second, which makes users of the authentication system more likely to feel that the authentication process takes a long time.

[0023] In contrast, when the authentication device 400 starts processing to authenticate a person only when processing conditions are satisfied, as in the authentication system 1 of this embodiment, there is no need to process images that do not capture moving objects. In this case, the time required from when a person is photographed by the camera 420 to when the person is authenticated is reduced compared to a configuration in which all images generated by photographing each of the multiple cameras 420 are processed by the authentication device 400. In addition, even if the number of cameras 420 provided in the authentication system 1 is increased, the processing load on the authentication device 400 is reduced by the amount of moving object detection from images performed by the cameras 420, and an increase in authentication time is suppressed. The function of the communication unit 401 of the authentication device 400 can also be regarded as an acquisition function that acquires an image generated in association with the image capture by the camera 420. The function of the control unit 403 of the authentication device 400 can also be regarded as a processing function that starts processing including authentication of the face of a person appearing in an image when the image generated by the image capture by the camera 420 satisfies a processing condition.

[0024] In this embodiment, the communication unit 401 acquires information about the result of the detection of a moving object from the moving object detection unit 422 of the camera 420. Examples of the information about the result of the detection of a moving object include result information and an image of the moving object. In this case, the authentication device 400 does not need to perform a process of detecting a moving object from an image.

[0025] In this embodiment, the control unit 403 detects a person's face from an image generated by shooting if the image satisfies the processing conditions. In this case, the control unit 403 does not need to perform processing to detect a face from an image that does not satisfy the processing conditions. Furthermore, in this embodiment, if a person's face is not detected from a moving object image in the authentication process, face matching is not performed (see FIG. 5). That is, when an image generated by shooting satisfies the processing conditions, if a person's face is not detected from an image acquired by the communication unit 401, the control unit 403 restricts face matching. In this case, the control unit 403 does not need to perform processing to match a person's face using a moving object image in which a face is not detected.

[0026] 8(A) is a diagram showing an example of the relationship between the detection of a moving object by the moving object detection unit 422 of the camera 420 and the control processing by the control unit 403 of the authentication device 400. The control processing is processing performed by the control unit 403 to authenticate a person. The control processing also includes detecting the person's face from an image, extracting features of the detected face, matching the detected face, and authenticating the person. 8, ON of the moving object detection by the moving object detection unit 422 means a state in which the moving object detection unit 422 has detected a moving object from an image generated by image capture by the camera 420. OFF of the moving object detection by the moving object detection unit 422 means a state in which the moving object detection unit 422 has not detected a moving object from an image generated by image capture by the camera 420. Furthermore, ON of the control process by the control unit 403 means a state in which the control unit 403 is performing the control process, and OFF of the control process by the control unit 403 means a state in which the control unit 403 is not performing the control process.

[0027] 8(A), when the detection of a moving object by the moving object detection unit 422 is ON, the control process of the control unit 403 is ON. When the detection of a moving object by the moving object detection unit 422 is OFF, the control process of the control unit 403 is OFF. In this case, if the moving object detection unit 422 fails to detect a moving object, chattering occurs in the control process by the control unit 403.

[0028] 8(B), when moving object detection by the moving object detection unit 422 is turned ON, the control process by the control unit 403 may be kept ON until a predetermined time has elapsed since the moving object detection by the moving object detection unit 422 was turned OFF. In addition, when moving object detection by the moving object detection unit 422 is turned ON, the control unit 403 may continue the control process for the image transmitted from the camera 420 until a predetermined time has elapsed since the moving object detection by the moving object detection unit 422 was turned OFF. Then, the control unit 403 may end the control process for the image transmitted from the camera 420 when a predetermined time has elapsed since the moving object detection by the moving object detection unit 422 was turned OFF.

[0029] 9 is a flowchart showing the flow of a modified authentication process. The authentication process is not limited to the example shown in FIG. In the authentication process shown in FIG. 9, steps 301 and 302 are the same as steps 101 and 102 in the authentication process shown in FIG. If the processing condition is met (yes in S302), the control unit 403 of the authentication device 400 determines whether the number of cameras 420 that are the targets of the ongoing authentication process is equal to or greater than a predetermined number (S303). The number of cameras 420 that are the targets of the ongoing authentication process means the number of cameras 420 that are capturing images in which a moving object has been detected, i.e., images that satisfy the processing condition. The predetermined number is a plurality of cameras that is equal to or less than the number of cameras 420 provided in the authentication system 1. The predetermined number is, for example, 7.

[0030] If the number of cameras 420 that are the targets of the ongoing authentication process is equal to or greater than a predetermined number (yes in S303), the control unit 403 does not immediately proceed with the process for authenticating the person. In this case, the control unit 403 determines whether a restart condition is satisfied (S304). The restart condition is a condition set for the authentication device 400 to restart the process for authenticating the person in the ongoing authentication process. In this embodiment, the restart condition is the elapse of a predetermined time after the control unit 403 determines in step 303 that the number of cameras 420 that are the targets of the ongoing authentication process is equal to or greater than a predetermined number. The predetermined time may be the same regardless of the number of cameras 420 that are the targets of the ongoing authentication process, or may be longer as the number of cameras 420 that are the targets of the ongoing authentication process increases. Furthermore, while a negative result continues (no in S304), the process of step 304 is repeated.

[0031] If the number of cameras 420 that are the targets of the ongoing authentication process is less than the predetermined number (no in S303), or if the restart condition is met (yes in S304), the process proceeds to the next step. 5. In the authentication process shown in FIG. 9, steps 305 to 310 are the same as steps 103 to 108 in the authentication process shown in FIG.

[0032] As described above, in the modified example, when an image generated by photography satisfies new processing conditions, the control unit 403 restricts the start of new processing if the number of cameras 420 capturing images that satisfy the processing conditions is equal to or greater than a predetermined number. If multiple images captured simultaneously by multiple cameras 420 satisfy any one of the processing conditions, authentication device 400 will simultaneously perform authentication processing on each of the multiple images that satisfy the processing condition. Therefore, in the authentication system 1 of this embodiment, when the number of authentication processes that authentication device 400 simultaneously performs increases, authentication device 400 is restricted from starting new processes, thereby preventing the time required for authentication in authentication processes that are already being performed from increasing. The restart condition is not limited to the above, and may be, for example, that the number of cameras 420 that are the targets of the ongoing authentication process falls below a predetermined number.

[0033] Furthermore, in the present embodiment, the processing condition is that a moving object is detected from an image captured by the camera 420, but the present invention is not limited to this. When detecting a moving object from an image generated by shooting, the moving object detection unit 422 may detect an area in the image where the center of gravity of the moving object is located. Then, it may be a processing condition that the center of gravity of the moving object detected by the moving object detection unit 422 is located within a predetermined area in the image.

[0034] Furthermore, when detecting a moving object from a video generated by shooting, the moving object detection unit 422 may specify the area of ​​the moving object in the image. Then, the moving object detection unit 422 may specify whether the moving object is approaching the camera 420 from a change over time in the area of ​​the moving object in the video. In this case, the processing condition may be that the moving object detection unit 422 specifies that the moving object is approaching the camera 420. For example, the moving object detection unit 422 may specify that the moving object is approaching the camera 420 when the area of ​​the moving object in the video increases over time, and may specify that the moving object is moving away from the camera 420 when the area of ​​the moving object in the video decreases over time.

[0035] FIG. 10 is a diagram for explaining the relationship between the image generated by the camera 420 and the person 304. In FIG. As shown in FIG. 10 , assume that camera 420 is installed on the left wall of a hallway in the drawing, and person 304 attempting authentication approaches camera 420 from the opposite side of camera 420 through door 430. In this case, person 304 begins to appear in the captured image from the left side of the angle of view of camera 420. Therefore, a processing condition may be defined that a moving object is detected from the left area of ​​the image generated by capturing with camera 420. Alternatively, a processing condition may be defined that the moving object detection unit 422 detects that the moving object in the video moves to the right over time. In this way, the processing condition may be defined based on the direction in which the moving object is moving relative to camera 420.

[0036] As described above, in this embodiment, the processing conditions further include that, when a moving object is detected from an image generated by photographing, the moving object is displayed in a predetermined area of ​​the image. In this case, the processing load on the authentication device 400 is reduced compared to a configuration in which all images generated by each of the multiple cameras 420 and in which moving objects are detected are processed by the authentication device 400.

[0037] In addition, in this embodiment, the processing conditions further include the condition that, when a moving object is detected from a moving image generated by shooting, a condition defined regarding a change in the display area of ​​the moving object in the moving image is satisfied. In this case, the processing load on the authentication device 400 is reduced compared to a configuration in which all images generated by each of the multiple cameras 420 and in which moving objects are detected are processed by the authentication device 400.

[0038] 11 is a diagram for explaining the relationship between the multiple cameras 420 and the door 430. In the illustrated example, the side above the door 430 in the drawing is the near side of the door. 11, authentication system 1 is provided with camera 420A and camera 420B. In the example shown, camera 420A is provided on the front side of door 430, and camera 420B is provided on the back side of door 430. Here, when authenticating a person appearing in an image captured by either camera 420A or camera 420B, authentication device 400 unlocks door 430 for a predetermined time. In this case, authentication device 400 may not perform authentication processing or control processing for camera 420A and camera 420B until unlocked door 430 is locked. If authentication device 400 does not perform authentication processing or control processing until a predetermined time has elapsed since unlocking door 430, any person will be able to pass through door 430. Therefore, in order to record a history of people who have passed through door 430, each image captured by camera 420A and camera 420B may be saved until a predetermined time has elapsed since authentication device 400 unlocked door 430. In this case, each image may be saved by camera 420 that took the image, or by authentication device 400.

[0039] As described above, in this embodiment, the multiple imaging devices include a first imaging device and a second imaging device that is pre-associated with the first imaging device. Examples of the first imaging device and the second imaging device include camera 420A and camera 420B. Furthermore, when authenticating a face captured in an image captured by the first imaging device, control unit 403 restricts processing of the image captured by the second imaging device until a condition related to authentication that is satisfied by authentication is no longer satisfied. Examples of the condition related to authentication that is satisfied by authentication include the door 430 being unlocked by authenticating a person, or a predetermined time not having passed since the door 430 was unlocked by authenticating a person. Furthermore, "control unit 403 restricts processing" includes "an image captured by the second imaging device being sent to authentication device 400 but not being processed by control unit 403." Furthermore, "the control unit 403 restricts processing" includes "the image generated by capturing an image with the second imaging device is not sent to the authentication device 400, and therefore this image is not processed by the control unit 403." In this case, the processing load on the authentication device 400 regarding the second imaging device is reduced.

[0040] (Variation 1) 12 is a diagram showing the configuration of authentication system 1 of Modification 1. Note that in Modification 1, configurations different from the above-described authentication system 1 will be described, and descriptions of configurations that are the same as those of the above-described authentication system 1 will be omitted. The authentication system 1 of the first modification includes a plurality of cameras 420, a moving object detection device 440, an authentication device 400, and a plurality of doors 430. In this case, each camera 420 is not provided with a moving object detection unit 422 (see FIG. 1).

[0041] The moving object detection device 440 includes a communication unit 441 and a moving object detection unit 442 . The communication unit 441 communicates with the camera 420 and the authentication device 400 to send and receive information to and from the camera 420 and the authentication device 400. The communication unit 441 receives, from each camera 420, an image generated by photographing. The moving object detection unit 442, which is an example of a moving object detection means, has the same function as the moving object detection unit 422 of the camera 420 shown in Fig. 1. That is, the moving object detection unit 442 determines whether or not a moving object is captured in the video generated by each camera 420, and generates result information each time it determines. Furthermore, when the moving object detection unit 442 detects a moving object in the video, it generates a moving object image. Furthermore, the moving object detection unit 442 transmits the result information and the moving object image to the authentication device 400 via the communication unit 441.

[0042] In this way, a moving object detection means of a device different from either authentication device 400 or camera 420 may detect a moving object from an image generated by capturing. Then, communication unit 401 of authentication device 400 may acquire result information and an image of the moving object from the moving object detection means. In this case, authentication device 400 may acquire an image showing the detected moving object from camera 420 that captured the detected moving object only when the moving object detection means detects a moving object.

[0043] (Variation 2) Fig. 13 is a diagram showing the configuration of authentication system 1 of Modification 2. Note that in Modification 2, configurations different from authentication system 1 shown in Fig. 1 will be described, and descriptions of configurations that are the same as those of authentication system 1 shown in Fig. 1 will be omitted. The authentication system 1 of the second modification includes a plurality of cameras 420, an authentication device 400, and a plurality of doors 430. In this case, each camera 420 is not provided with a moving object detection unit 422 (see FIG. 1). In the second modification, the communication unit 401 of the authentication system 1 receives an image generated by each camera 420 every time the camera 420 captures an image.

[0044] The authentication device 400 of the second modification also includes a moving object detection unit 406 . The moving object detection unit 406, which is an example of a moving object detection means, has the same function as the moving object detection unit 422 of the camera 420 shown in Fig. 1. That is, the moving object detection unit 406 determines whether or not a moving object is captured in the video generated by the shooting of each camera 420, and generates result information each time it makes a determination. Furthermore, when the moving object detection unit 406 detects a moving object in the video, it generates a moving object image. In this way, the authentication device 400 may further include a moving object detection means. In this case, the processing load on the camera 420 is reduced compared to when the camera 420 detects a moving object from an image.

[0045] In this embodiment, the authentication device 400 detects a person's face from an image, but the present invention is not limited to this. The camera 420 may have the same function as the face detection unit 408 and detect a person's face from an image generated by capturing. When the camera 420 detects a face from the image, the camera 420 may transmit the image in which the face appears to the authentication device 400. Furthermore, another device other than authentication device 400 and camera 420 may have the same function as face detection unit 408 and detect a person's face from an image generated by capturing. When the other device detects a face from an image, it may transmit the image containing the face to authentication device 400.

[0046] In this way, the communication unit 401 of the authentication device 400 may acquire information about the result of face detection from the face detection means. The information about the result of face detection may include an image showing a face. In this case, the processing load on authentication device 400 is reduced compared to a configuration in which authentication device 400 detects a face from an image.

[0047] The processing conditions may further include that a human face is detected from an image that includes a moving object. If the processing conditions are satisfied, the control unit 403 may start processing from step 105 or step 307 onward in the authentication processing (see FIGS. 5 and 9). In this case, the processing load on the authentication device 400 is reduced compared to a configuration in which all images generated by each of the multiple cameras 420 and in which moving objects are detected are processed by the authentication device 400.

[0048] Furthermore, the processing conditions are not limited to the above-mentioned examples. Each time the camera 420 generates a moving object image, the camera 420 may transmit the generated moving object image to the authentication device 400. Then, acquisition of the moving object image by the authentication device 400 may be defined as a processing condition.

[0049] Furthermore, in this embodiment, the authentication system 1 detects a moving object from a video, but this is not limiting. The camera 420 may also capture a still image at predetermined intervals. The predetermined interval may be any length of time, for example, one second. The authentication system 1 may then detect a moving object from multiple still images generated by the camera 420. Furthermore, in the authentication process, the image used in the process after face detection by the control unit 403 may be a moving object image or an image generated by capturing an image with the camera 420. In other words, the image used in the process after face detection by the control unit 403 may be any image generated in relation to capturing an image with the camera 420.

[0050] The present invention also includes cases where a software program that realizes the functions of each of the above-described embodiments is supplied to a system or device having a computer that can execute the program directly from a recording medium or via wired / wireless communication, and the program is executed. Therefore, the program code itself, supplied to and installed on a computer to implement the functional processes described above, also embodies the present invention. In other words, the computer program itself for implementing the functional processes of the present invention is also included in the present invention. In this case, the program may take any form, such as object code, a program executed by an interpreter, or script data supplied to an OS, as long as it has the program's functionality. Recording media for providing the program may include, for example, a hard disk, a magnetic recording medium such as a magnetic tape, an optical / magneto-optical storage medium, or a non-volatile semiconductor memory. Another possible method for providing the program is to store the computer program forming the present invention on a server on a computer network, and then download the computer program to a connected client computer. Furthermore, an operating system or the like running on a computer may perform some or all of the actual processing based on the instructions of the program code, and the functions of the above-described embodiments may be realized by this processing. Furthermore, program code read from a storage medium may be written to memory provided on a function expansion board inserted into a computer or a function expansion unit connected to the computer. Then, a CPU or the like provided on the function expansion board or function expansion unit may perform some or all of the actual processing based on the instructions of the program code. Even in this case, the functions of the above-described embodiments are realized.

[0051] The disclosure of this embodiment includes the following configuration. (Configuration 1) an acquisition means for acquiring an image; a processing means for starting a process including authentication of a face of a person appearing in an image captured by an imaging device when the image satisfies a predetermined condition; Equipped with At least one of the conditions is that a moving object is detected from the image generated by the photographing, The processing means targets a face that appears in an image that satisfies the condition among images captured by each of a plurality of image capture devices as the target of authentication. (Configuration 2) 2. The authentication device according to claim 1, wherein the acquisition means acquires information about a result of detection from a moving object detection means that detects a moving object from the image generated by the photographing. (Configuration 3) 3. The authentication device according to claim 1, further comprising a moving object detection unit that detects a moving object from the image generated by the photographing. (Configuration 4) The conditions further include that a human face is detected from an image showing a moving object; 4. The authentication device according to any one of configurations 1 to 3, wherein the processing includes matching the face detected from the image that satisfies the condition. (Configuration 5) 5. The authentication device according to configuration 4, wherein the acquisition means acquires information about a result of face detection from face detection means that detects a face from the image in which the moving object is detected. (Configuration 6) the processing includes detecting a human face from the image acquired by the acquisition means; 6. The authentication device according to any one of configurations 1 to 5, wherein the processing means performs the detection in the processing when the image generated by the photographing satisfies the condition. (Configuration 7) the processing includes matching the face detected from the image acquired by the acquisition means; The authentication device according to configuration 6, wherein the processing means limits the matching if the image generated by the photographing satisfies the condition and a human face is not detected from the image acquired by the acquisition means. (Configuration 8) the plurality of imaging devices include a first imaging device and a second imaging device associated in advance with the first imaging device; The authentication device according to any one of configurations 1 to 7, wherein the processing means, when authenticating a face appearing in an image generated by capturing an image with the first imaging device, restricts the processing of the image generated by capturing an image with the second imaging device until a condition set for the authentication that is satisfied by the authentication is no longer satisfied. (Configuration 9) The authentication device according to any one of configurations 1 to 8, wherein the conditions further include that, when a moving object is detected from the image generated by the photographing, the moving object is displayed in a predetermined area of ​​the image. (Configuration 10) The authentication device according to any one of the configurations 1 to 9, wherein the conditions further include that, when a moving object is detected from the video generated by the shooting, a condition defined regarding a change in the display area of ​​the moving object in the video is satisfied. (Configuration 11) the number of the plurality of imaging devices is equal to or greater than a predetermined number, The authentication device according to any one of configurations 1 to 10, wherein the processing means restricts the start of a new process when the image generated by the photographing newly satisfies the condition and the number of imaging devices capturing the image that satisfies the condition is equal to or greater than the predetermined number.

[0052] Although the preferred embodiments of the present invention have been described above, the present invention is not limited to these embodiments and various modifications and changes are possible within the scope of the gist of the present invention. [Explanation of symbols]

[0053] 1...Authentication system, 400...Authentication device, 420...Camera, 430...Door

Claims

1. an acquisition means for acquiring an image; a processing means for starting a process including authentication of a face of a person appearing in an image captured by an imaging device when the image satisfies a predetermined condition; Equipped with At least one of the conditions is that a moving object is detected from the image generated by the photographing, The processing means targets a face that appears in an image that satisfies the condition among images captured by each of a plurality of image capture devices as the target of authentication.

2. The authentication device according to claim 1 , wherein the acquisition means acquires information about a result of detection from a moving object detection means that detects a moving object from the image generated by the photographing.

3. The authentication device according to claim 1 , further comprising: a moving object detection unit that detects a moving object from the image generated by the photographing.

4. The conditions further include that a human face is detected from an image showing a moving object; The authentication device according to claim 1 , wherein the processing includes matching the face detected from the image that satisfies the condition.

5. 5. The authentication device according to claim 4, wherein the acquisition means acquires information about a result of face detection from face detection means that detects a face from the image in which the moving object is detected.

6. the processing includes detecting a human face from the image acquired by the acquisition means; The authentication device according to claim 1 , wherein the processing means performs the detection of the processing when the image generated by the photographing satisfies the condition.

7. the processing includes matching the face detected from the image acquired by the acquisition means; The authentication device according to claim 6, wherein the processing means limits the matching if the image generated by the photographing satisfies the condition and a human face is not detected from the image acquired by the acquisition means.

8. the plurality of imaging devices include a first imaging device and a second imaging device associated in advance with the first imaging device; 2. The authentication device according to claim 1, wherein when authenticating a face appearing in an image generated by capturing an image with the first imaging device, the processing means restricts the processing of the image generated by capturing an image with the second imaging device until a condition defined for the authentication and that is satisfied by the authentication is no longer satisfied.

9. The authentication device of claim 1, wherein the conditions further include that when a moving object is detected from the image generated by the photographing, the moving object is displayed in a predetermined area of ​​the image.

10. The authentication device of claim 1, wherein the conditions further include that, when a moving object is detected from the video generated by the shooting, a condition defined regarding a change in the display area of ​​the moving object in the video is satisfied.

11. the number of the plurality of imaging devices is equal to or greater than a predetermined number, 2. The authentication device according to claim 1, wherein the processing means restricts the start of a new process when the image generated by the photographing newly satisfies the condition and the number of imaging devices capturing the image that satisfies the condition is equal to or greater than the predetermined number.

12. A control method for an authentication device, comprising: an acquisition step of acquiring an image; a processing step of starting a process including authentication of a face of a person appearing in an image captured by the imaging device when the image satisfies a predetermined condition; and At least one of the conditions is that a moving object is detected from the image generated by the photographing, A method for controlling an authentication device, wherein in the processing step, a face appearing in an image that satisfies the condition among images generated by each of a plurality of image capture devices is set as the target of authentication.

13. On the computer, an acquisition function for acquiring an image; a processing function that starts processing including authentication of the face of a person appearing in an image captured by the imaging device when the image satisfies a predetermined condition; Realize this, At least one of the conditions is that a moving object is detected from the image generated by the photographing, The processing function is a program that targets a face that appears in an image that satisfies the conditions among images generated by each of a plurality of imaging devices as the target of authentication.

Images