Information processing system, information processing method, and computer program

Abstract

This information processing system S1 includes: a first acquisition unit 11 that acquires a first image in which is imaged a first range that includes at least a portion of a first region adjacent to a second region with a gate interposed therebetween; an authentication unit 12 that authenticates a person included in the first image; a second acquisition unit 13 that acquires a second image in which is imaged a second range that includes at least a portion of the first region; a determination unit 14 that determines whether the person included in the second image is the person successfully authenticated by the authentication unit 12; and a gate control unit 15 that controls the opening / closing of the gate in accordance with the determination result of the determination unit 14.

Description

Information processing system, information processing method, and recording medium

[0001] The present disclosure relates to the technical fields of an information processing system, an information processing method, and a recording medium.

[0002] Patent Literature 1 describes a technology for improving authentication accuracy and authentication speed in face authentication by acquiring a first image obtained by photographing a subject at a first distance, extracting a first biometric information group including biometric information of a first person detected from the first image from a registered biometric information group including biometric information of a plurality of registered persons, and comparing biometric information of a second person detected from a second image obtained by photographing the subject at a second distance shorter than the first image with the biometric information included in the first biometric information group. Patent Literature 2 describes a technology for acquiring biometric information of a person to be authenticated who is present in an authentication area, transmitting an authentication request including the acquired biometric information to a server device, detecting the person entering the device using a sensor for detecting a person entering the device, determining whether the person entering and the person to be authenticated are the same person, and controlling a gate to allow the person to pass if the authentication by the server device is successful and the person entering and the person to be authenticated are the same person, thereby preventing unauthorized users from passing through.

[0005] Patent Literature 3 describes a technology in which at least a part of an imaging range captured by a camera is used as a monitoring area, the position of a person who has been successfully authenticated within the monitoring area is monitored using the imaging results from the camera, and when the authentication is successful and an electric lock is controlled to an unlocked state, if the monitoring result indicates that the person who has been successfully authenticated is located in a near area near the door, the unlocked state is maintained, and if the monitoring result indicates that the person who has been successfully authenticated is located in a far area away from the door, the electric lock is switched to a locked state, and the locking timing is adjusted according to the location of the person who has been successfully authenticated. Patent Literature 4 describes a technology in which a first biometric information group including biometric information of a first person detected from a first image captured in a first area is obtained from a registered biometric information group including biometric information of a plurality of registered persons, and biometric information of a second person detected from a second image captured in a second area different from the first area is compared with the biometric information included in the first biometric information group, thereby improving authentication accuracy and authentication speed in face authentication.Patent Document 5 describes a facial recognition system that performs facial recognition on people passing through an authentication area to determine whether or not the person is allowed to pass. The system photographs the authentication area to sequentially acquire input images, stores registered facial images of pre-registered users, compares the facial image of the person extracted from the input image with the registered facial image, authenticates that the person is a user, and allows the person to pass if the size of the area showing the authenticated person in the input image is equal to or larger than a predetermined size. Even if the person is authenticated as a legitimate user through facial recognition, if the authenticated person is located away from the camera, they will not be allowed to pass, but will allow the person to pass when it is detected that the authenticated person is approaching the camera.

[0003] International Publication No. 2021 / 191966 International Publication No. 2021 / 186628 JP 2021-130994 A JP 2020-057191 A JP 2015-001790 A

[0004] An object of this disclosure is to provide an information processing system, an information processing method, and a recording medium that aim to improve upon the techniques described in prior art documents.

[0005] One aspect of the information processing system includes a first acquisition means for acquiring a first image of a first range including at least a part of a first area adjacent to a second area via a gate, an authentication means for authenticating a person included in the first image, a second acquisition means for acquiring a second image of a second range including at least a part of the first area, a determination means for determining whether the person included in the second image is a person who has been successfully authenticated by the authentication means, and a gate control means for controlling the opening and closing of the gate depending on the determination result by the determination means.

[0006] One aspect of the information processing method involves acquiring a first image of a first range including at least a portion of a first area adjacent to a second area via a gate, authenticating a person included in the first image, acquiring a second image of a second range including at least a portion of the first area, determining whether the person included in the second image is a person who has been successfully authenticated as the person included in the first image, and controlling the opening and closing of the gate depending on the determination result.

[0007] One aspect of the recording medium has recorded thereon a computer program for causing a computer to execute an information processing method that acquires a first image of a first range including at least a part of a first area adjacent to a second area via a gate, authenticates a person included in the first image, acquires a second image of a second range including at least a part of the first area, determines whether the person included in the second image is a person who has been successfully authenticated as the person included in the first image, and controls the opening and closing of the gate depending on the determination result.

[0008] FIG. 1 is a block diagram showing the configuration of an information processing system according to a first embodiment. FIG. 2 is a conceptual diagram of an information processing system according to a second embodiment. FIG. 3 is a block diagram showing the configuration of an information processing system according to the second embodiment. FIG. 4 is a flowchart showing the flow of authentication operations of the information processing system according to the second embodiment. FIG. 5 is a flowchart showing the flow of gate control operations of the information processing system according to the second embodiment. FIG. 6 is a diagram showing an example scene of the information processing system according to the second embodiment. FIG. 7 is a conceptual diagram of an information processing system according to a third embodiment. FIG. 8 is a block diagram showing the configuration of an information processing system according to the third embodiment. FIG. 9A is a flowchart showing the flow of authentication operations of the information processing system according to the third embodiment. FIG. 9B is a flowchart showing a modified example of the flow of authentication operations of the information processing system according to the third embodiment. FIG. 10 is a block diagram showing the configuration of an information processing system according to a fourth embodiment. FIG. 11 is a flowchart showing the flow of gate control operations of the information processing system according to the fourth embodiment. FIG. 12 is a flowchart showing the flow of gate control operations of the information processing system according to a fifth embodiment.

[0009] Hereinafter, an information processing system, an information processing method, and a recording medium according to an embodiment will be described with reference to the drawings. [1: First Embodiment]

[0010] A first embodiment of an information processing system, an information processing method, and a recording medium will be described below. Hereinafter, the first embodiment of the information processing system, the information processing method, and the recording medium will be described using an information processing system S1 to which the first embodiment of the information processing system, the information processing method, and the recording medium is applied. [1-1: Configuration of Information Processing System S1]

[0011] Fig. 1 is a block diagram showing the configuration of an information processing system S1 according to the first embodiment. As shown in Fig. 1, the information processing system S1 includes a first acquisition unit 11, an authentication unit 12, a second acquisition unit 13, a determination unit 14, and a gate control unit 15.

[0012] The first acquisition unit 11 acquires a first image capturing a first range including at least a part of the first area adjacent to the second area via the gate. The authentication unit 12 authenticates a person included in the first image. The second acquisition unit 13 acquires a second image capturing a second range including at least a part of the first area. The determination unit 14 determines whether the person included in the second image is a person who has been successfully authenticated by the authentication unit 12. The gate control unit 15 controls the opening and closing of the gate depending on the determination result by the determination unit 14. [1-2: Technical Effects of Information Processing System S1]

[0013] The information processing system S1 in the first embodiment controls the opening and closing of the gate depending on whether a person present in the second range is a person who has been successfully authenticated in the first range, and therefore can control the opening and closing of the gate depending on the person authentication result. [2: Second Embodiment]

[0014] Next, a second embodiment of the information processing system, the information processing method, and the recording medium will be described. Hereinafter, the second embodiment of the information processing system, the information processing method, and the recording medium will be described using an information processing system S2 to which the second embodiment of the information processing system, the information processing method, and the recording medium is applied. [2-1: Overall Configuration of Information Processing System S2]

[0015] 2 is a conceptual diagram of an information processing system S2 according to the second embodiment. As shown in FIG. 2, the information processing system S2 according to the second embodiment may include a gate device G as a gate, a first imaging device C1 as a first imaging means, a second imaging device C2 as a second imaging means, and an information processing device 2.

[0016] 2, the area below the gate device G in the drawing is referred to as a first area A1, and the area above the gate device G in the drawing is referred to as a second area A2. In other words, the first area A1 and the second area A2 are adjacent to each other with the gate device G interposed therebetween.

[0017] The gate device G is a device capable of controlling the passage of target persons P1, P2, and P3 (when not distinguished, they will be referred to as target persons P). The gate device G includes a plurality of flapper gates FG.

[0018] The second area A2 is a destination of the target person P, and may be a restricted area that only authenticated target person P can enter. A gate is controlled to open for the authenticated target person P, and the target person P can move from the first area A1 to the second area A2 through the gate.

[0019] The flapper gate FG is a plate-like member capable of controlling the passage of the target person P. Note that a gate bar, which is a rod-like member capable of controlling the passage of the target person P, may be used in addition to or instead of the flapper gate FG. The state of the flapper gate FG is controlled by the information processing device 2 based on the information processing result of the target person P by the information processing device 2. Specifically, if the information processing device 2 successfully authenticates the target person P (i.e., it is determined that the target person P matches a registered person), the information processing device 2 controls the state of the flapper gate FG to an open state that allows the target person P to pass through the flapper gate FG. The registered person may be, for example, a person permitted to enter the second area A2. On the other hand, if the information processing device 2 fails to authenticate the target person P (i.e., it is determined that the target person P does not match a registered person), the information processing device 2 controls the state of the flapper gate FG to a closed state that prevents the target person P from passing through the flapper gate FG.

[0020] The flapper gates FG include a flapper gate FG1, a flapper gate FG2 adjacent to one side of the flapper gate FG1, and a flapper gate FG3 adjacent to the other side of the flapper gate FG1. A target person P can pass through at least one of the flapper gates FG1, FG2, and FG3.

[0021] The first imaging device C1 captures an image of a first range R1 including at least a portion of the first area A1 and generates a first image. The first imaging device C1 is installed in the second area A2. The first imaging device C1 captures an image of the target at the same size regardless of the distance from the first imaging device C1 to the target. The first imaging device C1 may be a camera with a narrower angle of view than the second imaging device C2. The first imaging device C1 may also be capable of capturing an image of a target person P who is relatively far from the gate device G. Because the first imaging device C1 captures an image with a narrow angle of view from a position behind the gate device G and away from the gate device G, it can also capture an image of a target person P behind the gate device G with the accuracy required for authentication. The second imaging device C2 can capture an image for facial recognition of a target person P who may suddenly appear in front of the gate device G unexpectedly.

[0022] The second imaging device C2 captures an image of a second range R2 including at least a portion of the first area A1 and generates a second image. The second range R2 is closer to the gate device G than the first range R1. That is, the imaging target of the second imaging device C2 may be a target person P located closer to the gate device G than the target person P imaged by the first imaging device C1. The second imaging device C2 is installed at or near the gate device G. FIG. 2 illustrates an example in which the second imaging device C2 is installed at the gate device G. The shorter the distance from the second imaging device C2 to the imaging target, the larger the image of the target is captured by the second imaging device C2. The second imaging device C2 may be a camera with a wider angle of view than the first imaging device C1. Because the second imaging device C2 captures images near the gate device G with a wide angle of view, it can capture images in which the target person P1, who is immediately in front of the gate device G, and the target person P2, who is behind the target person P1, are significantly different in size. It is possible to easily identify which of the target person P1 and the target person P2 is about to pass through the gate device G from the image captured by the second imaging device C2.

[0023] The second image capturing device C2 may be a camera that captures images with a lower resolution than the images captured by the first image capturing device C1. The second image capturing device C2 may be an infrared camera. [2-2: Configuration of the information processing device 2]

[0024] 3 is a block diagram of an information processing system S2 according to the second embodiment. As shown in FIG. 2, the information processing device 2 includes a calculation device 21 and a storage device 22. The information processing device 2 may further include a communication device 23, an input device 24, and an output device 25. However, the information processing device 2 does not necessarily have to include at least one of the communication device 23, the input device 24, and the output device 25. The calculation device 21, the storage device 22, the communication device 23, the input device 24, and the output device 25 may be connected via a data bus 26.

[0025] The arithmetic device 21 includes, for example, at least one of a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), and an FPGA (Field Programmable Gate Array). The arithmetic device 21 reads a computer program. For example, the arithmetic device 21 may read a computer program stored in the storage device 22. For example, the arithmetic device 21 may read a computer program stored in a computer-readable, non-transitory recording medium using a recording medium reading device (e.g., an input device 24 described later) not shown in the drawings that is included in the information processing device 2. The arithmetic device 21 may acquire (i.e., download or read) the computer program from a device (not shown) located outside the information processing device 2 via the communication device 23 (or another communication device). The arithmetic device 21 executes the read computer program. As a result, logical functional blocks for executing the operations to be performed by the information processing device 2 are realized within the arithmetic device 21. In other words, the arithmetic device 21 can function as a controller for realizing logical functional blocks for executing the operations (in other words, processing) to be performed by the information processing device 2.

[0026] FIG. 3 shows an example of logical functional blocks implemented within the computing device 21 to perform information processing operations. As shown in FIG. 2 , the computing device 21 includes a first acquisition unit 211, which is a specific example of a “first acquisition means” described in the appendix, an authentication unit 212, which is a specific example of an “authentication means” described in the appendix, a second acquisition unit 213, which is a specific example of a “second acquisition means” described in the appendix, a determination unit 214, which is a specific example of a “determination means” described in the appendix, a gate control unit 215, which is a specific example of a “gate control means” described in the appendix, and a registration control unit 216, which is a specific example of a “registration control means” described in the appendix. However, the computing device 21 does not necessarily have to include the registration control unit 216. Details of the respective operations of the first acquisition unit 211, authentication unit 212, second acquisition unit 213, determination unit 214, gate control unit 215, and registration control unit 216 will be described later with reference to FIGS. 4 and 5 .

[0027] The storage device 22 can store desired data. For example, the storage device 22 may temporarily store a computer program executed by the arithmetic device 21. The storage device 22 may temporarily store data temporarily used by the arithmetic device 21 when the arithmetic device 21 is executing a computer program. The storage device 22 may store data to be stored long-term by the information processing device 2. The storage device 22 may include at least one of a RAM (Random Access Memory), a ROM (Read Only Memory), a hard disk device, a magneto-optical disk device, an SSD (Solid State Drive), and a disk array device. In other words, the storage device 22 may include a non-transitory recording medium. The storage device 22 may include a determination information list 221. In the second embodiment, the determination information list 221 may be a storage means for temporarily storing biometric information of the target person P included in the first image that has been successfully authenticated. However, the storage device 22 may not include the determination information list 221. In this case, the determination information list 221 may be realized in another device. Furthermore, the storage device 22 may include a biometric information database DB. In the second embodiment, the biometric information database DB may be a database in which biometric information of registered individuals is registered. A registered individual may be, for example, an individual who is permitted to enter the second area A2. However, the storage device 22 does not have to include the biometric information database DB. In this case, the biometric information database DB may be realized in another device.

[0028] The communication device 23 is capable of communicating with devices external to the information processing device 2 via a communication network (not shown). The information processing device 2 may transmit and receive signals to and from each of the gate device G, the first imaging device C1, and the second imaging device C2 via the communication device 23.

[0029] The input device 24 is a device that accepts information input to the information processing device 2 from outside the information processing device 2. For example, the input device 24 may include an operation device (e.g., at least one of a keyboard, a mouse, and a touch panel) that can be operated by an operator of the information processing device 2. For example, the input device 24 may include a reading device that can read information recorded as data on a recording medium that can be externally attached to the information processing device 2.

[0030] The output device 25 is a device that outputs information to the outside of the information processing device 2. For example, the output device 25 may output information as an image. That is, the output device 25 may include a display device (a so-called display) that can display an image showing the information to be output. For example, the output device 25 may output information as sound. That is, the output device 25 may include an audio device (a so-called speaker) that can output sound. For example, the output device 25 may output information on paper. That is, the output device 25 may include a printing device (a so-called printer) that can print desired information on paper. [2-3: Information Processing Operation Performed by the Information Processing Device 2]

[0031] Next, the information processing operation performed by the information processing device 2 in the second embodiment will be described with reference to Fig. 4 and Fig. 5. Fig. 4 is a flowchart showing the flow of the authentication operation performed by the information processing device 2 in the second embodiment. Fig. 5 is a flowchart showing the flow of the gate control operation performed by the information processing device 2 in the second embodiment. [Authentication Operation]

[0032] The operations from "Start" to "End" shown in FIG. 4 may be operations related to a single first image. For example, if the first imaging device C1 is capturing a video, the operations from "Start" to "End" shown in FIG. 4 may be operations for each frame. As shown in FIG. 4, the first acquisition unit 211 acquires a first image capturing a first range R1 (step S20). The first range R1 includes at least a portion of the first area A1 adjacent to the second area A2 via the gate device G. The first acquisition unit 211 may acquire, via the communication device 23, the first image generated by the first imaging device C1 capturing an image of the first range R1. In the second embodiment, authentication may be face authentication using a face image. The first range R1 may be a face authentication area where face authentication is performed.

[0033] The first acquisition unit 211 detects the face area of ​​the target person P included in the first image (step S21).

[0034] The first acquisition unit 211 extracts characteristic facial information (also referred to as "features") from the image of the face region (step S22). The features may be an example of biometric information of the target person P. The authentication unit 212 authenticates the target person P included in the first image (step S23). The authentication unit 212 may authenticate the target person P by comparing the features extracted in step S22 with features registered in the biometric information database DB.

[0035] The registration control unit 216 determines whether the authentication is successful (step S24). If the authentication is successful, the registration control unit 216 registers the feature amount as biometric information of the target person P in the determination information list 221 (step S25).

[0036] If the first image includes multiple target persons P, the calculation device 21 performs authentication processing on all target persons P included in the first image. The first acquisition unit 211 determines whether authentication processing has been performed on all target persons P (step S26). If authentication processing has been performed on all target persons P (step S26: Yes), the operation for one first image ends. If there is a target person P for which authentication processing has not been performed (step S26: No), the process returns to step S22.

[0037] Since the first imaging device C1 also captures an image of a target person P who is relatively far from the gate device G, the authentication unit 212 can also authenticate a target person P who is relatively far away. The authentication unit 212 can perform authentication not only for a target person P1 who is in front of the gate device G, but also for target persons P2 and P3 from when they are relatively far away, and determine whether or not the target person P is a target person P who is allowed to pass through the gate device G. [Gate Control Operation]

[0038] The actions from "Start" to "End" shown in FIG. 5 may be actions related to a single second image. For example, if the second imaging device C2 is capturing a video, the actions from "Start" to "End" shown in FIG. 5 may be actions for each frame. As shown in FIG. 5, the second acquisition unit 213 acquires a second image capturing a second range R2 (step S30). The second range R2 includes at least a portion of the first area A1. The second acquisition unit 213 may acquire the second image generated by the second imaging device C2 capturing the second range R2 via the communication device 23. The second range R2 may be an unlocking area where a determination is made as to whether or not to control the gate device G to open. The second range R2 may be a range within which it is possible to determine that a target person P will pass through a specific flapper gate FG. The second range R2 may include a range within the first area A1 in which the target person P closest to the flapper gate FG is located.

[0039] The second acquisition unit 213 detects the face area of ​​the target person P included in the second image (step S31). When the second image includes multiple target persons P, the second acquisition unit 213 detects the face area of ​​the target person P that is closest to the flapper gate FG. The second acquisition unit 213 may detect the largest face area among the face areas included in the second image as the face area of ​​the target person P that is closest to the flapper gate FG.

[0040] 6 , if the gate device G includes multiple flapper gates FG, the second acquisition unit 213 may detect the face area of ​​the target person P closest to each flapper gate FG. The operations from step S31 onward may be performed for a single flapper gate FG. For example, as shown in FIG. 6 , assume that a target person Pa is in front of a flapper gate FG1, a target person Pb is in front of a flapper gate FG2, and a target person Pc is in front of a flapper gate FG3. In this case, the information processing device 2 may perform a control operation of the flapper gate FG1 for the target person Pa, a control operation of the flapper gate FG2 for the target person Pb, and a control operation of the flapper gate FG3 for the target person Pc.

[0041] The second acquisition unit 213 extracts characteristic facial information (also referred to as "features") from the image of the face region (step S32). The determination unit 214 determines whether the target person P included in the second image is a target person P who has been successfully authenticated by the authentication unit 212 (step S33). The determination unit 214 compares the features extracted in step S32 with the features registered in the determination information list 221, and determines whether the target person P has been successfully authenticated by the authentication unit 212 (step S34).

[0042] The image generated by the second imaging device C2 may have lower image quality than the image generated by the first imaging device C1. The second image may be a relatively low-resolution image because it is used for matching with a relatively small number of matching targets, rather than an image used for matching with a very large number of matching targets for the purpose of identifying an individual. Matching using the image generated by the second imaging device C2 may be less accurate than matching using the image generated by the first imaging device C1. The matching operation performed by the determination unit 214 may have a smaller processing load than the matching operation performed by the authentication unit 212.

[0043] If the target person P has been successfully authenticated by the authentication unit 212 (step S34: Yes), the gate control unit 215 controls the flapper gate FG to open (step S35).

[0044] The gate control unit 215 determines whether the target person P has passed through the flapper gate FG (step S36). If the target person P has passed through the flapper gate FG (step S36: Yes), the gate control unit 215 controls the flapper gate FG to close (step S37). The gate control unit 215 repeats the determination of S36 until the target person P has passed through the flapper gate FG.

[0045] If the authentication by the authentication unit 212 is not successful (step S34: No), the operation for one second image ends. That is, the gate control unit 215 controls the opening and closing of the gate according to the determination result by the determination unit 214.

[0046] In the above description, the registration control unit 216 registers feature amounts in the determination information list 221. However, the feature amounts registered in the determination information list 221 may be the feature amounts extracted in step S22 or the feature amounts registered in the biometric information database DB used in the authentication operation in step S23. Alternatively, the registration control unit 216 may register the image of the face area detected from the first image in the determination information list 221. When the registration control unit 216 registers the image of the face area detected from the first image in the determination information list 221, the second acquisition unit 213 may also extract feature amounts from the image of the face area registered in the determination information list 221. In this case, the feature amount extraction operation by the first acquisition unit 211 and the feature amount extraction operation by the second acquisition unit 213 may be different operations.

[0047] Furthermore, if the second image capturing device C2 is an infrared camera, the information processing device 2 may also perform spoofing detection using infrared images, for example, before and after the operation of step S33. By using the infrared images, it is possible to determine whether the image of the face area is a photograph, a tablet screen, or the like. Furthermore, the information processing device 2 may use the infrared images to detect whether the face surface is generating heat, for example, before and after the operation of step S33. [Modification]

[0048] In the above embodiment, when authentication by the authentication unit 212 is successful, the registration control unit 216 registers the biometric information of the target person P included in the first image in the determination information list 221. As another example, when authentication by the authentication unit 212 fails, the registration control unit 216 may register the biometric information of the target person P included in the first image in the determination information list 221. In this case, in step S34, the determination unit 214 may compare the feature amount extracted in step S32 with the feature amount registered in the determination information list 221, and if the comparison is successful, may determine that the target person P is one who failed to be authenticated by the authentication unit 212.

[0049] That is, the registration control unit 216 may register the biometric information of the target person P included in the first image in the determination information list 221 according to the authentication result by the authentication unit 212. The registration control unit 216 may create a list of biometric information of the target person P who has been successfully authenticated, or may create a list of biometric information of the target person P who has failed to be authenticated. [2-4: Technical Effects of the Information Processing System S2]

[0050] In the information processing system S2 of the second embodiment, the matching performed before the gate is a matching with a small number of matching targets registered in the determination information list 221, so matching can be performed in a short time. Furthermore, since the matching is performed with the authentication result by the authentication unit 212, strict matching accuracy is not required, and matching can be performed in a short time. Therefore, the waiting time for the target person P who wants to pass through the gate can be shortened.

[0051] In addition, the image used for the authentication operation is captured by the first imaging device C1 installed in the second area A2, and the image used for the judgment operation is captured by the second imaging device C2 installed at the gate device G or near the gate device G, so that an image suitable for the operation can be used.

[0052] If the first imaging device C1 were a wide-angle camera, a distant target person P would be captured small, and it may not be possible to capture the target person P's face with the resolution required for facial recognition. In contrast, the first imaging device C1 captures the target person P at the same size regardless of the distance from the first imaging device C1 to the target person P. Therefore, the facial areas of all target people P included in the first image are images suitable for recognition, making it possible to authenticate target people P who are far away. If the second imaging device C2 were a narrow-angle camera, the target person P1 immediately in front of the gate and the target person P2 behind the target person P1 would be projected at approximately the same size in the second image, making it difficult to distinguish between the target person P1 and the target person P2 who are passing through the gate. In contrast, the second imaging device C2 captures the target person P at a larger size the shorter the distance from the second imaging device C2 to the target person P. Therefore, it is possible to quickly determine which target person P is closest to the gate device G and identify which target person P is in front of the flapper gate FG.

[0053] Even if a target person P suddenly appears in front of the flapper gate FG contrary to expectations, if the authentication unit 212 has determined that the target person P can pass through the gate, the gate can be controlled to open in a short time, thereby preventing the target person P from having to wait and preventing the target person P who wants to pass through the gate device G from staying behind. In other words, the information processing device 2 does not authenticate the target person P after determining that they are a target for gate control. The information processing device 2 allows the target person P who appears in front of the flapper gate FG to pass through the flapper gate FG, regardless of the movements of the target person P until they appear in front of the flapper gate FG.

[0054] Furthermore, since the information processing device 2 uses a facial image as biometric information, there is no need to use a special imaging device. [3: Third Embodiment]

[0055] An information processing system, an information processing method, and a recording medium according to a third embodiment will be described below. Hereinafter, the third embodiment of the information processing system, the information processing method, and the recording medium will be described using an information processing system S3 to which the third embodiment of the information processing system, the information processing method, and the recording medium is applied. [3-1: Overall Configuration of Information Processing System S3]

[0056] 7 is a conceptual diagram of an information processing system S3 according to the third embodiment. As shown in FIG. 7, the information processing system S3 according to the third embodiment may include a gate device G, a first imaging device C1, a second imaging device C2, an information processing device 3, and an authentication device 100. The gate device G, the first imaging device C1, and the second imaging device C2 according to the third embodiment may each have the same features as the gate device G, the first imaging device C1, and the second imaging device C2 according to the second embodiment.

[0057] 7 illustrates one each of the gate device G, first imaging device C1, second imaging device C2, and information processing device 3, but in the third embodiment, the information processing system S3 may include a plurality of gate control mechanism sets each including the gate device G, first imaging device C1, second imaging device C2, and information processing device 3. In this case, each information processing device 3 may transmit and receive signals to and from a single authentication device 100.

[0058] The configurations of the information processing device 3 and the authentication device 100 in the third embodiment will be described with reference to Fig. 8. Fig. 8 is a block diagram of the information processing system S3 in the third embodiment. [3-2: Configuration of the information processing device 3]

[0059] As shown in FIG. 8 , the information processing device 3 in the third embodiment includes a calculation device 21 and a storage device 22, similar to the information processing device 2 in the second embodiment. Furthermore, the information processing device 3 may include a communication device 23, an input device 24, and an output device 25, similar to the information processing device 2 in the second embodiment. However, the information processing device 3 does not need to include at least one of the communication device 23, the input device 24, and the output device 25. The information processing device 3 in the third embodiment differs from the information processing device 2 in the second embodiment in that the calculation device 21 does not include an authentication unit 212. Other features of the information processing device 3 may be the same as other features of the information processing device 2 in the second embodiment. Therefore, hereinafter, differences from the embodiments already described will be described in detail, and descriptions of other overlapping parts will be omitted as appropriate. [3-3: Configuration of Authentication Device 100]

[0060] 8, the authentication device 100 according to the third embodiment includes a calculation device 1001, a storage device 1002, and a communication device 1003. The calculation device 1001, the storage device 1002, and the communication device 1003 may be connected via a data bus 1006.

[0061] The arithmetic device 1001 includes, for example, at least one of a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), and an FPGA (Field Programmable Gate Array). The arithmetic device 1001 loads a computer program. For example, the arithmetic device 1001 may load a computer program stored in the storage device 1002. For example, the arithmetic device 1001 may load a computer program stored in a computer-readable, non-transitory storage medium using a storage medium reading device (not shown) included in the authentication device 100. The arithmetic device 1001 may acquire (i.e., download or load) the computer program from a device (not shown) located outside the authentication device 100 via the communication device 1003 (or another communication device). The arithmetic device 1001 executes the loaded computer program. As a result, a logical function block for executing the operation to be performed by the authentication device 100 is realized within the arithmetic device 1001. In other words, the arithmetic device 1001 can function as a controller for realizing the logical function block for executing the operation (in other words, processing) to be performed by the authentication device 100.

[0062] 8, an authentication unit 212 is implemented in the arithmetic device 1001. The authentication unit 212 in the third embodiment may operate in the same manner as the authentication unit 212 implemented in the arithmetic device 21 provided in the information processing device 2 in the second embodiment.

[0063] The storage device 1002 can store desired data. For example, the storage device 1002 may temporarily store a computer program executed by the arithmetic device 1001. The storage device 1002 may temporarily store data that the arithmetic device 1001 temporarily uses when the arithmetic device 1001 is executing a computer program. The storage device 1002 may store data that the authentication device 100 stores long-term. The storage device 1002 may include at least one of a RAM (Random Access Memory), a ROM (Read Only Memory), a hard disk device, a magneto-optical disk device, an SSD (Solid State Drive), and a disk array device. In other words, the storage device 1002 may include a non-transitory recording medium. The storage device 1002 may include a biometric information database DB. The biometric information database DB in the third embodiment may have the same mechanism as the biometric information database DB in the third embodiment.

[0064] The communication device 1003 can communicate with devices external to the authentication device 100 via a communication network (not shown). The authentication device 100 may transmit and receive signals to and from the information processing device 3 via the communication device 23. [3-4: Information Processing Operation Performed by the Information Processing System S3] [Authentication Operation]

[0065] Next, the information processing operation performed by the information processing system S3 in the third embodiment will be described with reference to Figures 9A and 9B. Figures 9A and 9B are flowcharts showing the flow of the authentication operation performed by the information processing system S3 in the third embodiment.

[0066] 9A and 9B may be operations related to one first image. For example, when the first imaging device C1 is capturing a video, the operations from "start" to "end" shown in FIG. 9A and 9B may be operations for each frame.

[0067] 9A and 9B, the authentication operation in the third embodiment differs from the authentication operation in the second embodiment shown in Fig. 4 in the operation of step S23. As shown in Fig. 9A, part of the authentication operation in the third embodiment is performed by the authentication device 100. [Authentication Operation 1]

[0068] As shown in FIG. 9A, when the first acquisition unit 211 extracts features from the image of the face area in step S22, the first acquisition unit 211 in the information processing device 3 transmits the face features to the authentication device 100 via the communication device 23 (step S231).

[0069] In the authentication device 100, the authentication unit 212 receives the feature from the information processing device 3 via the communication device 1003 (step S232). In the authentication device 100, the authentication unit 212 authenticates the target person P included in the first image (step S233). In the authentication device 100, the authentication unit 212 transmits the authentication result of the target person P to the information processing device 3 via the communication device 1003 (step S234).

[0070] In the information processing device 3, the registration control unit 216 receives the authentication result from the authentication device 100 via the communication device 23 (step S235). The registration control unit 216 determines whether or not the face authentication has been successful (step S24). [Authentication Operation 2]

[0071] The authentication operation in the third embodiment may be performed according to the flow shown in Fig. 9B . As shown in Fig. 9B , in step S20, the first acquisition unit 211 acquires a first image capturing a first range R1, and then extracts feature amounts from each image of the facial region of all target persons P included in the first image. That is, the operations of steps S21 and S22 are repeated until the determination in step S26' is Yes.

[0072] In step S231, the first acquisition unit 211 transmits all the extracted feature amounts to the authentication device 100 via the communication device 23. In step S233, the authentication unit 212 performs authentication on all the received feature amounts. In step S234, the authentication unit 212 transmits all the authentication results to the information processing device 3. In step S25', the registration control unit 216 registers, in the determination information list 221, feature amounts as biometric information of target persons P whose face authentication has been successful, out of all target persons P included in the first image. In the case of authentication operation 2, the transmission and reception operation between the information processing device 3 and the authentication device 100 is performed once per first image, regardless of the number of target persons P included in the first image. [Gate control operation]

[0073] The gate control operation in the third embodiment is performed in the information processing device 3. The gate control operation in the third embodiment may be the same as the gate control operation in the second embodiment. That is, the gate control operation is completed in the information processing device 3. Since there is no communication operation between the information processing device 3 and the authentication device 100, the gate control operation, which requires high processing speed, can be performed at high speed.

[0074] The biometric information database DB stored in the storage device 1002 of the authentication device 100 and the determination information list 221 stored in the storage device 22 of the information processing device 3 have different purposes of use. The information registered in the biometric information database DB is information for identifying an individual. The information registered in the biometric information database DB may be used not only for authentication for opening control of the gate device G, but also for an edge server that grants access to confidential information, and for authentication for granting access to confidential information. For example, a company may have one cloud server as the authentication device 100 and a biometric information database DB that manages personal information of employees. On the other hand, the information registered in the determination information list 221 does not need to be registered in association with personal information such as name, employee number, etc. [3-5: Technical Effects of the Information Processing System S3]

[0075] In the information processing system S3 of the third embodiment, the authentication device 100 performs the matching operation for authentication, and the information processing device 3 performs the gate control operation. Therefore, the security of the information used for authentication is ensured, while gate control can be performed at high speed. Furthermore, since the information registered in the determination information list 221 does not need to be registered in association with personal information such as name, employee number, etc., the risk of information registered in the determination information list 221 being leaked is relatively low. [4: Fourth Embodiment]

[0076] An information processing system, an information processing method, and a recording medium according to a fourth embodiment will be described below. Hereinafter, the information processing system, the information processing method, and the recording medium according to the fourth embodiment will be described using an information processing system S4 to which the information processing system, the information processing method, and the recording medium according to the fourth embodiment are applied. [4-1: Configuration of Information Processing System S4]

[0077] The configuration of an information processing system S4 in the fourth embodiment will be described with reference to Fig. 10. Fig. 10 is a block diagram showing the configuration of the information processing system S4 in the fourth embodiment. As shown in Fig. 10, the information processing system S4 in the fourth embodiment may include a gate device G, a first imaging device C1, a second imaging device C2, and an information processing device 4, similar to the information processing system S2 in the second embodiment.

[0078] As shown in FIG. 10 , the information processing device 4 in the fourth embodiment includes a calculation device 21 and a storage device 22, similar to the information processing device 2 in the second embodiment. Furthermore, the information processing device 4 may include a communication device 23, an input device 24, and an output device 25, similar to the information processing device 2 in the second embodiment. However, the information processing device 4 does not need to include at least one of the communication device 23, the input device 24, and the output device 25. The information processing device 4 in the fourth embodiment differs from the information processing device 2 in the second embodiment in that the calculation device 21 further includes a notification unit 417. The notification unit 417 may be a mechanism for controlling the output of the output device 25. Other features of the information processing device 4 may be the same as other features of the information processing device 2 in the second embodiment. Therefore, hereinafter, differences from the embodiments already described will be described in detail, and descriptions of other overlapping parts will be omitted as appropriate. [4-2: Information Processing Operation Performed by Information Processing Device 4]

[0079] The information processing operation performed by the information processing device 4 in the fourth embodiment will be described with reference to Fig. 11. Fig. 11 is a flowchart showing the flow of the information processing operation performed by the information processing device 4 in the fourth embodiment. As shown in Fig. 11, the operation when the determination in step S34 is No differs from the gate control operation in the second embodiment shown in the flowchart in Fig. 5.

[0080] When a target person P who has been successfully authenticated is registered in the judgment information list 221, if the judgment unit 214 judges that the target person P is a target person P who has not been successfully authenticated by the authentication unit 212, the notification unit 417 notifies that the authentication has not been successful (step S40).

[0081] Alternatively, if the determination information list 221 contains a registration of a target person P who has failed authentication, and the determination unit 214 determines that the target person P is a target person P who has failed authentication by the authentication unit 212, the notification unit 417 may notify the user that authentication has failed.

[0082] In the fourth embodiment, the output device 25 may include a display device capable of displaying an image. This display device may display an image indicating that authentication has not been successful in response to control of the notification unit 417. In the fourth embodiment, the output device 25 may include an audio device capable of outputting audio. This audio device may output an audio guide indicating that authentication has not been successful in response to control of the notification unit 417. In the fourth embodiment, the output device 25 may include a printing device capable of printing desired information on paper. This printing device may print and output information indicating that authentication has not been successful in response to control of the notification unit 417.

[0083] The authentication operation in the fourth embodiment may be the same as the authentication operation in the second embodiment shown in the flowchart of FIG.

[0084] Also, in the fourth embodiment, as in the third embodiment, the authentication device 100 may include the authentication unit 212, and the authentication operation may be performed in the authentication device 100. In this case, the authentication operation in the fourth embodiment may be the same as the authentication operation in the third embodiment shown in the flowchart of Figure 9A or 9B. [4-3: Technical Effects of Information Processing System S4]

[0085] The information processing system S4 in the fourth embodiment can notify the target person P when the gate device G cannot be controlled to open. [5: Fifth Embodiment]

[0086] Next, a fifth embodiment of an information processing system, an information processing method, and a recording medium will be described. Hereinafter, the fifth embodiment of the information processing system, the information processing method, and the recording medium will be described using an information processing system to which the fifth embodiment of the information processing system, the information processing method, and the recording medium is applied.

[0087] The information processing system in the fifth embodiment may have the same configuration as at least one of the information processing system S2 in the second embodiment to the information processing system S4 in the fourth embodiment. The information processing system in the fifth embodiment differs from the information processing system S2 in the second embodiment to the information processing system S4 in the fourth embodiment in the operation of the registration control unit 216. [5-1: Information Processing Operation Performed by the Information Processing System]

[0088] The information processing operation performed by the information processing system in the fifth embodiment will be described with reference to Fig. 12. Fig. 12 is a flowchart showing the flow of the information processing operation performed by the information processing system in the fifth embodiment.

[0089] As shown in FIG. 12 , the registration control unit 216 determines whether a predetermined condition is satisfied (step S50). The predetermined condition may include a case where a predetermined number of people have passed through the gate device G after the target person P has passed through the gate device G. In other words, step S50 may be an operation performed after step S37 for a certain target person P. The predetermined number of people may be, for example, 10 people. The predetermined condition may include a case where a predetermined time has passed after the target person P passed through the gate device G. The predetermined time may be, for example, 10 seconds. The predetermined condition may include a case where the number of pieces of biometric information registered in the determination information list 221 exceeds a predetermined number. The predetermined number may be, for example, 100. The predetermined condition may include a case where a predetermined period of time has passed after registration in the determination information list 221. The predetermined period of time may be, for example, 5 minutes.

[0090] If the predetermined condition is satisfied (step S50: Yes), the registration control unit 216 deletes the biometric information of the corresponding target person P registered in the determination information list 221 (step S51). The registration control unit 216 may repeat the operation of step S50 until the predetermined condition is satisfied.

[0091] That is, the information registered in the determination information list 221 may be temporary information. The registration control unit 216 performs a deletion operation when a predetermined condition is met, so the amount of information registered in the determination information list 221 can be limited to a certain range. Since the amount of biometric information registered in the determination information list 221 is limited to a certain range, the determination unit 214 only needs to compare with a limited amount of biometric information. Since the number of objects to be compared is relatively small, the processing load on the determination unit 214 can be reduced. Furthermore, the operating time of the determination unit 214 is shortened, so that it is possible to prevent the target person P in front of the gate device G from having to wait. [5-2: Technical Effects of the Information Processing System]

[0092] In the information processing system according to the fifth embodiment, the determination unit 214 can perform accurate matching with a small processing load. [6: Sixth Embodiment]

[0093] Next, a sixth embodiment of an information processing system, an information processing method, and a recording medium will be described. Hereinafter, the sixth embodiment of the information processing system, the information processing method, and the recording medium will be described using an information processing system to which the sixth embodiment of the information processing system, the information processing method, and the recording medium is applied.

[0094] The information processing system in the sixth embodiment may have the same configuration as at least one of the information processing systems S2 in the second embodiment to the fifth embodiment. The information processing system in the sixth embodiment differs from the information processing systems S2 in the second embodiment to the fifth embodiment in the collation operation. [6-1: Collation Operation Performed by the Information Processing System]

[0095] In the sixth embodiment, the threshold for matching by the authentication unit 212 is larger than the threshold for matching by the determination unit 214. For example, even if the feature amount extracted from the first image used by the authentication unit 212 and the feature amount extracted from the first image used by the determination unit 214 are the same, the threshold for matching by the authentication unit 212 is set larger than the threshold for matching by the determination unit 214. In other words, it may be determined whether the matching by the authentication unit 212 is more similar than the matching by the determination unit 214.

[0096] Furthermore, the algorithm used by the first acquisition unit 211 and the algorithm used by the second acquisition unit 213 may be different. For example, the first acquisition unit 211 may extract characteristic facial information from the image of the face region using a feature extraction model (e.g., a feature extraction model using a neural network) constructed by machine learning (e.g., deep learning). On the other hand, the second acquisition unit 213 may extract characteristic facial information from the image of the face region using technology such as eigenfaces. That is, the first acquisition unit 211 may use more advanced technology than the second acquisition unit 213. In other words, the second acquisition unit 213 may be realized by technology with a smaller processing load and a relatively inexpensive mechanism compared to the first acquisition unit 211. In this case, the characteristic facial information used by the authentication unit 212 may be different from the characteristic facial information used by the determination unit 214. [6-2: Technical Effects of the Information Processing System]

[0097] The information processing system according to the sixth embodiment can perform processing suited to the situation, and can reduce the processing load while performing the required processing. [7: Supplementary Note]

[0098] The following supplementary notes are further disclosed with respect to the above-described embodiment. [Supplementary Note 1] An information processing system including: a first acquisition means for acquiring a first image capturing a first range including at least a part of a first area adjacent to a second area via a gate; authentication means for authenticating a person included in the first image; a second acquisition means for acquiring a second image capturing a second range including at least a part of the first area; determination means for determining whether the person included in the second image is a person who has been successfully authenticated by the authentication means; and a gate control means for controlling opening and closing of the gate in accordance with the determination result by the determination means. [Supplementary Note 2] The information processing system according to Supplementary Note 1 further includes a registration control means for registering biometric information of the person included in the first image in a determination information storage means in accordance with the authentication result by the authentication means, wherein the determination means compares the biometric information of the person included in the second image with the biometric information registered in the determination information storage means and determines whether the person is a person who has been successfully authenticated by the authentication means. [Supplementary Note 3] The information processing system according to Supplementary Note 2, wherein the biometric information is a facial image. [Supplementary Note 4] The information processing system according to Supplementary Note 2 or 3, further including a notification means for notifying that authentication has not been successful when the determination means determines that the relevant person has not been successfully authenticated by the authentication means. [Supplementary Note 5] The information processing system according to any one of Supplementary Notes 2 to 4, wherein the registration control means deletes the biometric information of the relevant person registered in the determination information storage means when the gate control means controls to open the gate and the relevant person passes through the gate. [Supplementary Note 6] The information processing system according to any one of Supplementary Notes 2 to 5, wherein the authentication means performs authentication by comparing the biometric information of the person included in the first image with pre-registered biometric information, and a threshold for matching by the authentication means is larger than a threshold for matching by the determination means. [Supplementary Note 7] The information processing system described in any one of Supplementary Notes 1 to 6 further includes: a first imaging means installed in the second area, imaging the first range, and generating the first image; and a second imaging means installed at or near the gate, imaging the second range, and generating the second image.[Supplementary Note 8] The information processing system according to Supplementary Note 7, wherein the first imaging means images the target at the same size regardless of the distance from the first imaging means to the target, and the second imaging means images the target at a larger size as the distance from the second imaging means to the target becomes shorter. [Supplementary Note 9] The information processing system according to Supplementary Note 2, wherein the information processing system includes an information processing device and an authentication device, wherein the information processing device comprises the first acquisition means, the registration control means, the second acquisition means, the determination means, and the gate control means, and the authentication device comprises the authentication means. [Supplementary Note 10] An information processing method, comprising: acquiring a first image capturing a first range including at least a part of a first area adjacent to a second area via a gate; authenticating a person included in the first image; acquiring a second image capturing a second range including at least a part of the first area; determining whether the person included in the second image is a person whose authentication of the person included in the first image has been successful; and controlling opening and closing of the gate according to the determination result. [Supplementary Note 11] A recording medium having recorded thereon a computer program for causing a computer to execute an information processing method of: acquiring a first image capturing a first range including at least a part of a first area adjacent to a second area via a gate; authenticating a person included in the first image; acquiring a second image capturing a second range including at least a part of the first area; determining whether the person included in the second image is a person who has been successfully authenticated as the person included in the first image; and controlling opening and closing of the gate depending on the determination result.

[0099] At least some of the constituent elements of each of the above-described embodiments can be appropriately combined with at least some of the other constituent elements of each of the above-described embodiments. Some of the constituent elements of each of the above-described embodiments may not be used. Furthermore, to the extent permitted by law, the disclosures of all documents (e.g., published patent applications) cited in this disclosure are incorporated by reference as part of the description of this disclosure.

[0100] This disclosure may be modified as appropriate within the scope of the claims and the technical idea that can be read from the entire specification. Information processing systems, information processing methods, and recording media that involve such modifications are also included in the technical idea of ​​this disclosure.

[0101] S1, S2, S3, S4 Information processing system 2, 3, 4 Information processing device C1 First imaging device C2 Second imaging device G Gate device FG Flapper gate P Target person A1 First area A2 Second area R1 First range R2 Second range 100 Authentication device 11, 211 First acquisition unit 12, 212 Authentication unit 13, 213 Second acquisition unit 14, 214 Determination unit 15, 215 Gate control unit 216 Registration control unit 417 Notification unit 221 Determination information list DB Biometric information database

Claims

1. a first acquisition means for acquiring a first image capturing a first range including at least a part of a first region adjacent to a second region via a gate; an authentication means for authenticating a person included in the first image; A second acquisition means for acquiring a second image capturing a second range including at least a part of the first region; a determination means for determining whether or not a person included in the second image is a person who has been successfully authenticated by the authentication means; a gate control means for controlling opening and closing of the gate in accordance with a result of the determination by the determination means; An information processing system comprising:

2. a registration control means for registering biometric information of a person included in the first image in a determination information storage means according to an authentication result by the authentication means, The determination means compares biometric information of the person included in the second image with biometric information registered in the determination information storage means, and determines whether the person is a person who has been successfully authenticated by the authentication means. The information processing system according to claim 1 .

3. The method further includes a notification means for notifying the user that authentication has not been successful when the determination means determines that the user has not been successfully authenticated by the authentication means. The information processing system according to claim 2 .

4. The registration control means deletes the biometric information of the person registered in the determination information storage means when the gate control means controls to open the gate and the person passes through the gate.

4. The information processing system according to claim 2 or 3.

5. the authentication means performs authentication by matching biometric information of the person included in the first image with biometric information registered in advance; The threshold value for the verification by the authentication means is larger than the threshold value for the verification by the determination means.

4. The information processing system according to claim 2 or 3.

6. a first imaging means that is installed in the second area and captures an image of the first range to generate the first image; a second imaging means that is installed at or near the gate, and captures an image of the second range and generates the second image; The information processing system according to claim 1 or 2, further comprising:

7. the first imaging means captures an image of the imaging target at a uniform size regardless of a distance from the first imaging means to the imaging target; The second imaging means captures an image of the imaging target at a larger size as the distance from the second imaging means to the imaging target becomes shorter.

7. The information processing system according to claim 6.

8. The information processing system includes an information processing device and an authentication device, the information processing device includes the first acquisition means, the registration control means, the second acquisition means, the determination means, and the gate control means; The authentication device includes the authentication means. The information processing system according to claim 2 .

9. A first image is obtained by capturing an image of a first range including at least a part of a first region adjacent to the second region via a gate; authenticating a person in the first image; acquiring a second image capturing a second range including at least a portion of the first region; determining whether or not a person included in the second image is a person who has been successfully authenticated as a person included in the first image; The gate is controlled to open or close depending on the result of the determination. A computer implemented information processing method.

10. On the computer, A first image is obtained by capturing an image of a first range including at least a part of a first region adjacent to the second region via a gate; authenticating a person in the first image; acquiring a second image capturing a second range including at least a portion of the first region; determining whether or not a person included in the second image is a person who has been successfully authenticated as a person included in the first image; The gate is controlled to open or close depending on the result of the determination. A computer program for executing an information processing method.