Information processing device, information processing system, information processing method, and program

Abstract

Provided is an information processing device that works regardless of the presence of a gate.　An information processing device according to the present invention is characterized by comprising: an image acquisition means that acquires an image that includes an entry / exit area that has a first region; and an information processing means that registers information about a first person that is in the first region as included in the image at a management list. The first person can enter a second region that is adjacent to the first region by biometric authentication in the first region, and the information processing device is characterized in that the information processing means removes the information about the first person from the management list when the first person has exited the entry / exit area from a prescribed side that is different from a side that corresponds to an entry / exit boundary between the first region and the second region.

Description

Information processing device, information processing system, information processing method, and program

[0001] The present disclosure relates to the technical fields of an information processing device, an information processing system, an information processing method, and a program.

[0002] A method is generally known that can detect a person attempting to pass through a gate and appropriately control the state of the gate based on the detection results (Patent Document 1, etc.).

[0003] Japanese Patent Application Laid-Open No. 2005-70850

[0004] However, the above-mentioned Patent Document 1 aims at gate control and assumes the entrance or exit (hereinafter referred to as "entry / exit") of a person using a gate. Therefore, it does not describe what kind of information processing should be performed when there is no gate. The purpose of the present disclosure is to provide an information processing device that processes information regarding entrance and exit, regardless of the presence or absence of a gate.

[0005] According to one aspect of the present disclosure, there is provided an information processing device comprising: an image acquisition means for acquiring an image including an entry / exit area having a first area; and an information processing means for registering information regarding a first person in the first area included in the image in a management list, wherein the first person can enter a second area adjacent to the first area through biometric authentication in the first area; and the information processing means deletes information regarding the first person from the management list when the first person exits the entry / exit area from a specified side different from the side corresponding to the entry / exit boundary between the first area and the second area.

[0006] According to one aspect of the present disclosure, there is provided an information processing method including: a computer acquiring an image including an entry / exit area having a first area; registering information regarding a first person in the first area included in the image in a management list; the first person being able to enter a second area adjacent to the first area through biometric authentication in the first area; and the information processing means deleting the information regarding the first person from the management list when the first person exits the entry / exit area from a specified side different from the side corresponding to the entry / exit boundary between the first area and the second area.

[0007] According to one aspect of the present disclosure, there is provided a program that causes a computer to operate in the following manner: acquire an image including an entry / exit area having a first area; register information about a first person in the first area included in the image in a management list; enable the first person to enter a second area adjacent to the first area through biometric authentication in the first area; and when the first person exits the entry / exit area from a specified side different from the side corresponding to the entry / exit boundary between the first area and the second area, delete the information about the first person from the management list.

[0008] According to one aspect of the present disclosure, there is provided an information processing system comprising: an image acquisition means for acquiring an image including an entry / exit area having a first area; and an information processing means for registering information regarding a first person in the first area included in the image in a management list, wherein the first person can enter a second area adjacent to the first area through biometric authentication in the first area; and the information processing means deletes the information regarding the first person from the management list when the first person exits the entry / exit area from a specified side different from the side corresponding to the entry / exit boundary between the first area and the second area.

[0009] 11 is a diagram showing an example of an entrance / exit area. FIG. 12 is a diagram showing an example of the configuration of an information processing device. FIG. 13 is a flowchart showing an example of the operation of the information processing device of FIG. 2. FIG. 14 is a diagram showing an example of the configuration of an information processing device. FIG. 15 is a diagram showing an example of an entrance / exit area. FIG. 16 is a flowchart showing an example of the operation of the information processing device of FIG. 4. FIG. 17 is a sequence diagram showing an embodiment of the information processing device of FIG. 4. FIG. 18 is a diagram showing an example of an entrance / exit area. FIG. 19 is a diagram showing an example of the configuration of an information processing device. FIG. 19 is a flowchart showing an example of the operation of the information processing device of FIG. 12. FIG. 19 is a diagram showing an example of the configuration of an information processing device. FIG. 20 is a diagram showing an example of the display of areas and boundary lines. FIG. 21 is a diagram showing an example of the configuration of an information processing device.

[0010] First Embodiment A first embodiment of an information processing device, an information processing system, an information processing method, and a program will be described with reference to FIGS. 1 to 3. FIG.

[0011] This embodiment is applied to a situation where at least one of entry into a predetermined area and exit from a predetermined area (sometimes referred to as "entry and exit") is managed. FIG. 1( a) illustrates an example of a situation where this embodiment is applied. As illustrated in FIG. 1( a), in this embodiment, a first area a01 and a second area a02 are defined. The first area a01 and the second area a02 are adjacent to each other. A person in the first area a01 (sometimes referred to as a "first person") can enter the second area a02 by biometric authentication in the first area a01. A method of managing entry and exit from the first area a01 to the second area a02 is referred to as a first method. In other words, the first method is a method of managing entry and exit using biometric authentication in the first area a01.

[0012] In this embodiment, an entry / exit area a00 is defined. The entry / exit area a00 includes a first area a01. For example, the entry / exit area a00 may be a range including the first area a01 and an area surrounding the first area a01. The range of the entry / exit area a00 may also coincide with the range of the first area a01. The boundary between the entry / exit area a00 and an area other than the entry / exit area a00 has a side b00 and a side b01 different from the side b00 (sometimes referred to as a "predetermined side"). The side b00 corresponds to the boundary b12 (sometimes referred to as the "entry / exit boundary") between the first area a01 and the second area a02. While FIG. 1A illustrates a case in which the side b00 and the entry / exit boundary b12 do not coincide, the side b00 may coincide with the entry / exit boundary b12.

[0013] Note that, based on the direction of movement of the person, the area behind the direction of movement may be defined as the first area, and the area ahead of the direction of movement may be defined as the second area. For example, as illustrated in FIG. 1( b), if area X and area Y exist and person Z is moving from area X to area Y, area X may be defined as the first area, and area Y may be defined as the second area. In this case, the area including area X may be defined as the entry / exit area a00. Furthermore, as illustrated in FIG. 1( c), if person Z is moving from area Y to area X, area Y may be defined as the first area, and area X may be defined as the second area. In this case, the area including area Y may be defined as the entry / exit area a00. <Configuration Description>

[0014] Fig. 2 is a block diagram showing the configuration of the information processing device 100 according to this disclosure. As shown in Fig. 2, the information processing device 100 includes an image acquisition unit 11 and an information processing unit 14. The operations of the image acquisition unit 11 and the information processing unit 14 will be described with reference to Fig. 3. <Explanation of Operation>

[0015] The information processing operation performed by the information processing device 100 will be described with reference to Fig. 3. Fig. 3 is a flowchart showing an example of the flow of the information processing operation performed by the information processing device 100.

[0016] 3A, the image acquisition unit 11 acquires an image including an entrance / exit area a00 (step S10). The information processing unit 14 registers information about a person in a first area a01 included in the image in a management target list (step S11).

[0017] The operation illustrated in Fig. 3(b) may be an operation performed after the operation illustrated in Fig. 3(a). As illustrated in Fig. 3(b), the image acquisition unit 11 acquires an image including the entrance / exit area a00 (step S10). When a person exits the entrance / exit area a00, if the person exits from a predetermined side b01 (step S16: Yes), the information processing unit 14 deletes information about the person from the management list (step S17). For example, the information deleted in the operation illustrated in Fig. 3(b) may be information registered in the operation illustrated in Fig. 3(a).

[0018] Second Embodiment A second embodiment of an information processing device, an information processing system, an information processing method, and a program will be described with reference to FIG.

[0019] 4, the information processing device 1 includes an image acquisition unit 11, a person tracking unit 12, an information acquisition unit 13, an information processing unit 14, and an entry / exit management unit 15. The information acquisition unit 13 may include a face image acquisition unit 131. The information processing unit 14 may include a determination unit 141, a flag setting unit 142, and a flag confirmation unit 143. The entry / exit management unit 15 may include a biometric authentication unit 151. The entry / exit management unit 15 manages entry of a person in a first area a01 into a second area a02 using a first method based on biometric authentication. The entry / exit management unit 15 manages people who attempt to enter or exit. In a second embodiment, the entry / exit management unit 15 manages people who attempt to enter or exit using biometric authentication. In another embodiment, the entry / exit management unit may determine whether a person is permitted to enter or exit based on whether the person possesses an item (e.g., a ticket) that allows entry and exit. In other embodiments, the entry / exit management unit may perform both management by biometric authentication and management by determining whether or not a person possesses an item that allows entry / exit. Hereinafter, a person passing through each of a plurality of areas may be referred to as an authentication target. The information processing device 1 may further include an imaging unit 10. The information processing device 1 processes information related to an authentication target who passes through each of a plurality of areas. The information related to an authentication target may be information necessary for managing an authentication target who enters and exits between areas. Furthermore, entry / exit refers to entering and exiting a specified area.

[0020] The multiple areas may be multiple entrance / exit areas provided in multiple buildings, respectively. The multiple areas may also be multiple entrance / exit areas provided in multiple spaces in a single building, respectively. The multiple areas may also be multiple entrance / exit areas provided in a single space in a single building, respectively. The areas may be set not only indoors but also outdoors. For example, the present invention may be applicable to bus stops, outdoor live music venues, etc.

[0021] The entry / exit area will be described with reference to FIG. 5 . The entry / exit area a00 may include a first area a01 and a second area a02. For example, a case where an entry / exit area is provided at a train station or the like will be described. If the area outside the station is defined as the first area a01 and the area inside the station is defined as the second area a02, the space near the ticket gate separating the first area a01 and the second area a02 may be defined as the entry / exit area a00. Another example will be a case where an entry / exit area is provided at a bus stop. A camera may be installed at the bus stop, and the area captured by the camera may be defined as the entry / exit area a00. The camera may also be installed inside the bus. The camera may be installed so that its image capture range includes both the inside and outside of the bus. The outside of the bus may be defined as the first area a01, and the inside of the bus may be defined as the second area a02. Furthermore, if areas are separated by biometric authentication-based entry / exit management, the area where biometric authentication is performed may be defined as the entry / exit area a00. For example, when biometric authentication is performed in a first area a01 outside the station and the person enters the station, the first area a01 may be the entrance / exit area a00. On the other hand, when the person exits from a second area a02 inside the station to the outside, biometric authentication may be performed in the second area a02, and the second area a02 may be the entrance / exit area a00. Furthermore, the area including the area where biometric authentication is performed may be the entrance / exit area a00. In other words, the entrance / exit area a00 may include the area where biometric authentication is performed, and the entrance / exit area a00 and the area where biometric authentication is performed do not have to be the same. For example, the entrance / exit area a00 may be set larger than the first area a01. Even if the person to be authenticated leaves the first area a01 where biometric authentication is performed, information about the person to be authenticated does not need to be deleted if they are still within the entrance / exit area a00, which is set larger than the first area a01. For example, tracking may be initiated when the person to be authenticated enters the entrance / exit area a00, and facial authentication may be initiated when the person to be authenticated enters the first area a01. In this case, even if the person to be authenticated leaves the first area a01 and returns to the first area a01, tracking of the person to be authenticated can continue within the entry / exit area a00, and information about the person to be authenticated can be taken over without being deleted.Therefore, by storing the biometric information, the biometric authentication can be performed smoothly, and by storing the biometric authentication result, it is possible to skip the need for biometric authentication again.

[0022] 1 and 5, each area is shown as a rectangle, but this is not limited to this, and the sides of the area may be straight or curved, or a combination of straight and curved lines. Alternatively, the entry / exit area a00 may not be set on the system, but may be the entire imaging range of an imaging device such as a camera.

[0023] The image acquisition unit 11 acquires an image including the entry / exit area a00. The image including the entry / exit area a00 may also include an area other than the entry / exit area a00. The image acquired by the image acquisition unit 11 may be an image captured by the imaging unit 10 capable of capturing an image including at least a portion of the entry / exit area a00. For example, when facial authentication is performed in the first area a01 and a person enters the second area a02, an area including the first area a01 may be set as the entry / exit area a00, and an image capturing an area including at least the first area a01 may be acquired. The imaging unit 10 may be, for example, an imaging device capable of capturing video or images, such as a digital camera or a surveillance camera. For example, an information processing system may be configured with an information processing device and the imaging unit 10 capable of capturing an image including at least a portion of the entry / exit area a00. Furthermore, the image acquisition unit 11 may acquire not only images, but also, for example, video captured by the imaging unit 10.

[0024] The person tracking unit 12 tracks the person to be authenticated who is present in the image based on the moving image acquired by the image acquisition unit 11. For example, when a person attempts to enter the station from outside using biometric authentication, the person tracking unit 12 determines whether the person to be authenticated is present in a first area a01 included in the entrance / exit area a00. If the person to be authenticated is present in the first area a01, the person tracking unit 12 tracks the person to be authenticated. Existing technologies can be applied to methods of determining whether a person is present in an image and methods of tracking a person who is present in an image, so detailed explanations will be omitted.

[0025] The information acquisition unit 13 acquires information about the person to be authenticated who is being tracked by the person tracking unit 12. The information processing unit 14 registers the information about the person to be authenticated acquired by the information acquisition unit 13 in a management target list. Examples of information about the person to be authenticated that is registered in the management target list include the person's biometric information, clothing, belongings, identification information, biometric authentication results, and information indicating entry and exit. The biometric information of the person to be authenticated may include a facial image. The facial image registered in the management target list is compared with a registered facial image by the biometric authentication unit 151. The biometric authentication unit 151 will be described later.

[0026] As a specific example, an example of registering information about a person to be authenticated in the management target list will be described. First, the person tracking unit 12 detects and tracks the person to be authenticated from a moving image acquired by the image acquisition unit 11. At this time, the person tracking unit 12 may detect the face region or body region of the person to be authenticated. Next, the information acquisition unit 13 acquires information about the person to be authenticated from the face region or body region using image recognition technology. Next, when the person to be authenticated enters a first area a01, which is a face authentication area, the information processing unit 14 registers a face image of the person to be authenticated in the management target list. The determination unit 141 determines that the person to be authenticated as a first person who entered the first area a01 from a boundary different from the entry / exit boundary b12 is a person to be authenticated by face recognition using a face image. The face image acquisition unit 131 acquires a face image of the person to be facially authenticated from the image acquired by the image acquisition unit 11. For example, the face image acquisition unit 131 may acquire a face image from the face region, or may acquire facial features from the face region. As for the image recognition technology, existing technologies such as pattern recognition technology using machine learning and deep learning can be applied, and therefore detailed description thereof will be omitted. As a specific example, although it has been described that the person tracking unit 12 detects a face region and a body region, the face region and the body region may be detected from an image including the person to be authenticated that is being tracked by the information acquisition unit 13. The information acquisition unit 13 is not limited to information about the person to be authenticated that can be acquired from an image, and may be configured to acquire information about the person to be authenticated from a mobile terminal carried by the person to be authenticated.

[0027] The information processing unit 14 registers the biometric information of the person to be authenticated in the management target list. For example, the face image acquisition unit 131 may acquire a face image from an image including the person to be authenticated captured by the imaging unit 10, and the information processing unit 14 may register the image. Alternatively, the information acquisition unit 13 may detect an iris image from an image including the person to be authenticated, and the information processing unit 14 may register the image. Gait information of the person to be authenticated may be identified from multiple images including the person to be authenticated and registered. In addition, biometric information such as fingerprints, palm prints, veins, auricles, and ear sounds may be acquired from a terminal held by the person to be authenticated, a device worn by the person to be authenticated, and a sensor installed to acquire biometric information, and registered in the management target list.

[0028] Furthermore, if there is no management target list in which information about the person to be authenticated is registered, the information processing unit 14 may create a new management target list. A management target list may be created for each person tracked by the person tracking unit 12. Furthermore, information about multiple people to be authenticated may be registered in one management target list. For example, a management target list may be created for each facility such as a station, for each entrance / exit area, and for each biometric authentication area. Furthermore, the management target list may be deleted or initialized after a predetermined period has elapsed since its creation. For example, the management target list may be deleted or initialized at regular intervals such as one day or one month.

[0029] An example of acquiring biometric information from a device held by a person to be authenticated will be described. First, the information acquisition unit 13 identifies the location of the device using conventional positioning technology, such as beacon positioning using Bluetooth (registered trademark), positioning using a geomagnetic sensor, or positioning using a Global Positioning System (GPS). Next, the person tracking unit 12 identifies the location of the person being tracked in the image and associates the location of the device with the location of the person. For example, the location of the device may be replaced with the location in the image to link the person and the device. The information acquisition unit 13 can link biometric information obtainable from the device held by the person to be authenticated and the person being tracked by the person tracking unit 12. The information processing unit 14 can link the biometric information obtainable from the device obtained by the information acquisition unit 13 with the person to be authenticated who holds the device and register the linked information in a management list. Furthermore, if the person tracking unit 12 is tracking only one person, the information acquisition unit 13 can determine that the holder of the device and the person correspond to each other, and can link the tracked person with biometric information obtainable from the device without performing terminal positioning.

[0030] The information processing unit 14 may register the clothing and belongings of the person to be authenticated in the management list. For example, the information processing unit 14 may acquire the type, material, shape, color, etc. of the clothing and accessories worn by the person to be authenticated from an image including the person to be authenticated captured by the imaging unit 10, and the information processing unit 14 may register the clothing and accessories. For example, green high heels, a white dress, a black cap, black sunglasses, and red earrings may be registered as clothing in the management list. Furthermore, the type, material, shape, color, etc. of belongings carried by the person to be authenticated may be identified from an image including the person to be authenticated captured by the imaging unit 10 and registered. For example, a black handbag, a blue carry case, a white bracelet-type wearable device, and white earphones may be registered in the management list. The method by which the information processing unit 14 identifies the clothing and belongings of the person to be authenticated can be performed using conventional image recognition technology, so detailed description thereof will be omitted.

[0031] The information processing unit 14 may register the identification information of the person to be authenticated in the management target list. The identification information is information that can identify the person to be authenticated, such as a number or ID assigned to each person to be authenticated. The identification information may be registered based on biometric authentication performed by the biometric authentication unit 151 using biometric information registered in the management target list. Furthermore, for example, the information acquisition unit 13 may acquire identification information transmitted from a terminal such as a mobile terminal or a wearable device held by the person to be authenticated, and the information processing unit 14 may register the information as the identification information of the person to be authenticated. The association between the identification information of the person to be authenticated acquired from the terminal and the person being tracked by the person tracking unit 12 is not described here because the same content as that described in the example of acquiring biometric information from a terminal can be applied.

[0032] The information processing unit 14 may register the biometric authentication result in the management target list. The biometric authentication result includes information indicating that authentication was successful, information indicating that authentication was unsuccessful, and information indicating that authentication is currently in progress. For example, when a person to be authenticated enters the first area a01, which is the face authentication area, a facial image of the person to be authenticated is registered in the management target list, and face authentication is performed by the biometric authentication unit 151. Therefore, information indicating that authentication is currently in progress can be registered in the management target list as a face authentication result. Furthermore, when the biometric authentication unit 151 outputs the face authentication result, the information processing unit 14 can change the biometric authentication result from information indicating that authentication is currently in progress to information indicating whether authentication was successful or unsuccessful based on whether the face authentication was successful, and register the biometric authentication result in the management target list. The biometric authentication result may be acquired by the information acquisition unit 13 or the information processing unit 14 and registered in the management target list.

[0033] For example, the flag setting unit 142 may set a flag associated with the person to be authenticated. The value of the flag changes depending on the authentication result of the biometric authentication unit 151. For example, the flag setting unit 142 may set a flag associated with the person to be authenticated when the person to be authenticated enters the first area a01. For example, the value of the flag may be "0" until the biometric authentication unit 151 successfully authenticates the person to be authenticated. In this case, the flag setting unit 142 may change the value of the flag associated with the person to be authenticated to "1" when the biometric authentication unit 151 successfully authenticates the person to be authenticated. The flag may be included in information about the person to be authenticated registered in the management list. By checking the set flag, it is possible to determine whether the authentication of the person to be authenticated has been successful or unsuccessful. Therefore, it is possible to preferentially authenticate a person to whom a flag indicating unsuccessful authentication has been set. The flag determination unit 143 may determine the value of the flag associated with the person to be authenticated when the person to be authenticated leaves the first area a01. That is, the flag setting unit 142 may be able to change the value of the flag associated with the person to be authenticated until the person to be authenticated leaves the first area a01. By checking the determined flag of the person to be authenticated, it is possible to determine whether the person to be authenticated has been successfully authenticated to enter the second area a02. Furthermore, if the determined flag indicates that the authentication has not been successful, a notification may be sent to the person to be authenticated or an administrator. Furthermore, the flag determination unit 143 may determine the value of the flag when the person to be authenticated enters within a predetermined distance (e.g., within 2 m from the boundary) of the boundary between the first area a01 and the second area a02. By determining the flag of the person to be authenticated who is within a predetermined distance from the boundary, it is possible to notify the person to be authenticated or an administrator that the authentication has not been successful before the person to be authenticated enters the second area a02.

[0034] Furthermore, the flag setting unit 142 sets a flag each time a biometric authentication result is output. When the biometric authentication unit 151 performs multiple authentications on the same person who entered the first area a01, the authentication frequency can be changed according to the value of the flag. For example, if the flag value is "0," indicating that authentication was not successful, the biometric authentication unit 151 may perform biometric authentication when a predetermined time n (e.g., 1 second) has elapsed since the flag value was set to "0." On the other hand, if the flag value is "1," indicating that authentication was successful, the biometric authentication unit 151 may perform biometric authentication when a predetermined time m (e.g., 3 seconds) has elapsed since the flag value was set to "1." In other words, biometric authentication may be performed on an authentication target whose biometric authentication has not been successful so that the number of authentications per unit time is greater than that for an authentication target whose biometric authentication has been successful. Furthermore, if an authentication target whose authentication has been successful and whose flag is "1" fails authentication once or multiple times, the flag may be changed to "0." By changing the frequency of authentication depending on the flag, it is possible to prioritize authentication of people who have not been successfully authenticated, and to prevent people who have been successfully authenticated from being mistakenly identified as impersonators or as another registered user.

[0035] The information processing unit 14 may register information indicating entry and exit. For example, when the person to be authenticated enters the second area a02 from the first area a01, the information processing unit 14 may register information indicating entry in the management target list. The information indicating entry may be, for example, at least one of an entry / exit flag indicating entry into the premises of Station A, information indicating which of the multiple face recognition areas at Station A the person entered into the premises of Station A from, and location information. By registering information indicating entry in the management target list, it is possible to determine whether the person to be authenticated has entered, which can be used for entrance / exit management and fee billing processing such as fares. For example, when the person enters the premises from the first area a01 of Station A, a '1' is entered as the entry / exit flag indicating entry. Next, when the person exits the premises from the second area a02 within the premises of Station A, it may determine whether the information indicating entry and exit in the management target list is '1' and enter a '0' as the entry / exit flag indicating exit. By checking the information indicating entry and exit in the management target list, it is possible to determine whether the person to be authenticated is inside or outside the premises. Furthermore, for example, information indicating which area the user has entered may be registered as information indicating entry / exit. The information indicating entry / exit may be acquired by the information acquisition unit 13 or the information processing unit 14 and registered in the management target list.

[0036] If facial authentication is successful, the information processing unit 14 may replace the facial image in the management target list with identification information (e.g., ID) of the person to be authenticated. Alternatively, the information processing unit 14 may determine that facial authentication is complete and delete the facial image of the person to be authenticated when the person to be authenticated enters the second area a02 from the entrance / exit area a00 including the first area a01. Replacing the facial image with identification information allows the facial image to be deleted, thereby reducing the amount of data and protecting personal information. On the other hand, if facial authentication fails, the information about the person to be authenticated, such as biometric information, clothing, and belongings, may be notified to the administrator.

[0037] When the person to be authenticated leaves a predetermined side b01 of the entrance / exit area a00, the information processing unit 14 deletes information about the person to be authenticated that is registered in the management target list. For example, the information processing unit 14 may delete images including the person to be authenticated that are acquired by the image acquisition unit 11, and information such as the face image, clothing, and belongings of the person to be authenticated that has been tracked.

[0038] When the entrance / exit area a00 is a first area a01 where biometric authentication is performed and entry from the first area a01 to a second area a02 is managed, the predetermined edge b01 of the entrance / exit area a00 is a different edge from the edge where the first area a01 and the second area a02 meet. When a person to be authenticated who is present in the entrance / exit area exits from the predetermined edge b01, it is determined that the person has no intention of entering through biometric authentication, and an image including the person's face can be deleted from the management list. By setting the predetermined edge b01, information about the person to be authenticated who is attempting to enter the second area a02 from the first area a01 is retained. On the other hand, when the person to be authenticated is present in the entrance / exit area a00 including the first area a01 and takes an action such as turning back the way they came without entering the second area a02, it is determined that the person has no intention of entering the second area a02, and the information about the person to be authenticated can be deleted.

[0039] The biometric authentication unit 151 compares biometric information registered in the management list with biometric information of a person to be authenticated that has been registered in advance. For example, when face authentication is performed in the first area a01 and the person enters a station premises including the second area a02, the biometric authentication unit 151 may acquire a face image registered in the management list of the person to be authenticated in the first area a01, compare it with face images of multiple people to be authenticated that have been registered in advance, and output a result indicating whether or not the person to be authenticated was matched. If the match is successful, the biometric authentication unit 151 may output identification information as a result. The biometric authentication performed by the biometric authentication unit 151 may be not only face authentication, but also iris authentication, gait authentication, fingerprint authentication, palm print authentication, vein authentication, auricle authentication, ear acoustic authentication, and the like. Conventional technologies can be applied to each biometric authentication method, and therefore a description thereof will be omitted.

[0040] <Explanation of Operation> The operation of the information processing device 1 will be described using the flowchart in Fig. 6. In this embodiment, the entrance / exit area a00 and the first area a01, which is the biometric authentication area, are the same, and an authentication target person in the first area a01 enters the second area a02 through facial authentication.

[0041] The image acquisition unit 11 acquires an image captured by the imaging unit 10 of an area including the entrance / exit area a00 (step S11). The imaging unit 10 may be a camera integrated with the information processing device 1, or may be, for example, a monitoring camera of an external device. The image acquisition unit 11 acquires the image captured by the imaging unit 10 including the entrance / exit area a00 via wired or wireless communication.

[0042] The person tracking unit 12 tracks the person to be authenticated included in the image acquired by the image acquisition unit 11 (step S12). The person tracking unit 12 may detect whether a person is included in the image, and may track the person as the person to be authenticated if a person is included.

[0043] The information acquisition unit 13 acquires information about the person to be authenticated who is being tracked by the person tracking unit 12 (step S13). Next, the information processing unit 14 registers the person in the management target list (step S14). The information processing unit 14 may acquire information about the person to be authenticated when a person is detected and register the information in the management target list. Alternatively, the information processing unit 14 may register the person to be authenticated in the management target list when the person enters the entrance / exit area a00 or the first area a01. By registering information about the person to be authenticated when the person enters the entrance / exit area a00 or the first area a01, it is possible to avoid registering excess information about a person who has been tracked but who may not necessarily use the first area, thereby reducing the amount of data.

[0044] The biometric authentication unit 151 compares the biometric information registered in the management target list with the biometric information of the person to be authenticated that has been registered in advance (step S15). The comparison may be started when the person to be authenticated enters the first area a01, which is the entrance / exit area a00. For example, the comparison may be started when the person to be authenticated enters the first area a01, which is the entrance / exit area a00, from a side other than the border between the first area a01 and the second area a02. For example, the person tracking unit 12 may track the person to be authenticated, determine whether or not the person has entered the first area a01, which is the biometric authentication area, and instruct the biometric authentication unit 151 to compare the person to be authenticated. Alternatively, the information processing unit 14 may register the authentication result in the management target list when biometric authentication is started and completed in step S15.

[0045] The person tracking unit 12 determines whether the person to be authenticated has exited the predetermined side b01 of the entrance / exit area a00 (step S16). The information processing unit 14 deletes information about the person to be authenticated if the person to be authenticated has exited the predetermined side b01 of the entrance / exit area (step S17). The operations of steps S16 and S17 may be performed not only after biometric authentication is performed in step S15, but also at any time after information about the person to be authenticated has been registered. On the other hand, if it is determined in step S16 that the person has not exited the entrance / exit area a00, the processing ends.

[0046] <Explanation of the embodiment> Next, a specific example of the information processing device 1 will be described with reference to Fig. 7. This description is an example of the embodiment, and does not limit the operation of the information processing device 1.

[0047] First, the image acquisition unit 11 acquires an image including the entrance / exit area a00. The person tracking unit 12 acquires the image from the image acquisition unit 11 (Seq 01). Next, the person tracking unit 12 detects and tracks a person based on the image acquired from the image acquisition unit (Seq 02).

[0048] The information acquisition unit 13 acquires an image including the person being tracked from the person tracking unit 12 (Seq 03). The information acquisition unit 13 acquires information about the person being tracked from the image including the person being tracked (Seq 04). The information about the person includes biometric information, clothing, belongings, identification information, etc. of the person to be authenticated.

[0049] The information processing unit 14 acquires information about the person from the information acquisition unit 13 (Seq 05). The information processing unit 14 associates the information about the person acquired in Seq 05 with the person being tracked and registers it in the management target list (Seq 06).

[0050] The information processing unit 14 may acquire information indicating that the person being tracked by the person tracking unit 12 has entered a first area a01 where entry and exit management is performed using biometric authentication (Seq 07). Alternatively, for example, the information processing unit 14 may determine that the person being tracked by the information acquiring unit 13 has entered the first area a01 from an image including the person, and transmit information indicating that the person has entered the first area a01 to the information processing unit 14.

[0051] Next, the information processing unit 14 may register information indicating that the person has entered the first area a01 as information indicating entry / exit in the management target list corresponding to the person being tracked (Seq 08). The information processing unit 14 may register the information indicating entry / exit by, for example, setting the value of an entry / exit flag to "1".

[0052] The biometric authentication unit 151 acquires biometric information included in the management target list when an entry / exit flag of "1" indicating that a person has entered the first area where biometric authentication is performed is registered in the management target list (Seq 09). The biometric authentication unit 151 performs biometric authentication based on the acquired biometric information (Seq 10). Alternatively, the biometric authentication unit 151 may perform biometric authentication when the person tracking unit 12 or the information acquisition unit 13 determines that the person to be authenticated has entered the first area a01. Alternatively, the biometric authentication unit 151 may perform biometric authentication when the information processing unit registers biometric information in the management target list.

[0053] The information processing unit 14 acquires the authentication result from the biometric authentication unit 151 (Seq 11). The information processing unit 14 registers the authentication result in the management target list (Seq 12). Furthermore, for example, the identification information of the person being tracked based on the authentication result may be registered in the management target list.

[0054] Next, the information processing unit 14 may acquire information indicating that the person being tracked by the person tracking unit 12 has entered the second area a02 (Seq 13). Alternatively, for example, the information acquiring unit 13 may determine that the person being tracked has entered the second area a02 from an image including the person, and transmit information indicating that the person has entered the second area a02 to the information processing unit 14.

[0055] The information processing unit 14 registers information indicating that the person has entered the second area a02 as information indicating entry / exit in the management target list corresponding to the person being tracked (Seq 14). For example, the entry / exit flag may be set to "2."

[0056] The information processing unit 14 acquires information indicating that the person being tracked by the person tracking unit 12 has left the predetermined edge b01 (Seq 15). Alternatively, for example, the information acquiring unit 13 may determine from an image containing the person being tracked that the person has left the predetermined edge b01, and transmit information indicating that the person has left the predetermined edge b01 to the information processing unit 14. The information processing unit 14 then deletes information about the person being tracked from the management target list (Seq 16). Alternatively, for example, if it is determined in Seq 15 that the person has left the predetermined edge b01 while biometric authentication is being performed in Seq 10, the biometric authentication may be terminated, and Seq 16 may be executed.

[0057] <Explanation of Effects> The information processing device 1 can track a person to be authenticated who is in the entrance / exit area a00, and delete information about the person to be authenticated who has left a predetermined edge b01 of the entrance / exit area a00. This makes it possible to determine whether the person intends to enter or exit without the need for a gate or any operation by the person to be authenticated, such as receiving a ticket. Furthermore, by deleting information about a person to be authenticated who has no intention of entering or exiting, it becomes possible to protect privacy. Note that receiving a ticket refers to the act of presenting a ticket, and may also be the act of having information read. The act of having information read may include the act of having an image read. The image may include a two-dimensional code, a one-dimensional code, etc.

[0058] Third Embodiment Next, a third embodiment will be described. The third embodiment differs from the second embodiment in that a third region a03 is provided in addition to the components of the second embodiment.

[0059] The entry / exit area will be described with reference to FIG. 8 . The entry / exit area in the third embodiment includes a first area a01 and a third area a03 adjacent to the first area a01. The third area a03 is an area where entry to the second area is performed using a third method different from the first method set for the first area a01. The first method may be a method for managing entry and exit of people in the first area a01, and the third method may be a method for managing entry and exit of people in the third area a03. Alternatively, entry to the second area may be possible from the first area a01 using the first method, and from the third area a03 using the third method. The first method may be, for example, an entry / exit management method using facial recognition. The third method may be, for example, an entry / exit management method using a gate using an IC card or a ticket. The third area a03 may be an area where entry and exit management is performed using a biometric authentication method different from that used for the first area a01. That is, the third method may be an entrance / exit management method using biometric authentication. Below, differences from the second embodiment will be specifically described, and overlapping descriptions will be omitted as appropriate.

[0060] 9 , the information processing device 2 includes an image acquisition unit 21, a person tracking unit 22, an information acquisition unit 23, an information processing unit 24, and an entry / exit management unit 25. The information processing device 2 may further include an imaging unit 10. The information processing unit 24 may include an estimation unit 244 and a return determination unit 245. The entry / exit management unit 25 may include a biometric authentication unit 251. The entry / exit management unit 25 manages entry of a person in a first area a01 into a second area a02 by a first method, and manages entry of a person in a third area a03 into the second area a02 by a third method different from the first method.

[0061] The image acquisition unit 21 acquires an image including an entrance / exit area a00. The entrance / exit area a00 may be an area including a first area a01 and a third area a03. For example, if entrance / exit management is performed using facial recognition in the first area a01 and using a ticket gate in the third area, the area including the first area a01 and the third area a03 may be set as the entrance / exit area a00.

[0062] The person tracking unit 22 tracks a person who is present in the entrance / exit area a00 from the image acquired by the image acquisition unit 21 as a person to be authenticated.

[0063] The information acquisition unit 23 acquires information about the person to be authenticated being tracked by the person tracking unit 22. The information processing unit 24 registers the information about the person to be authenticated acquired by the information acquisition unit 23 in a management target list. The information processing unit 24 may also determine whether the person being tracked by the person tracking unit 22 moves from the first area a01 to the third area a03. The estimation unit 244 may, for example, determine whether the person to be authenticated has crossed the border between the first area a01 and the third area a03, and estimate that the person to be authenticated will enter the second area a02, which is within the station, from the third area a03, where entry and exit management is performed by a ticket gate. In other words, when the person to be authenticated moves from the first area a01 to the third area a03, the estimation unit 244 estimates that the person to be authenticated will enter the second area a02 by the third method.

[0064] When the person to be authenticated leaves a predetermined side b02 of the entrance / exit area a00, the information processing unit 24 deletes information about the person to be authenticated from the management target list. The predetermined side b02 is a side other than the side where the entrance / exit area a00, which includes the first area a01 and the third area a03, meets the second area a02. The information processing unit 24 may also delete information about the person to be authenticated from the management target list when the person to be authenticated moves from the first area a01 to the third area a03. For example, when the information processing unit 24 determines that the person to be authenticated has moved from the first area a01, which is a biometric authentication area, to the third area a03, which is where the ticket gate is located, the information processing unit 24 may delete biometric information from the information about the person to be authenticated included in the management target list.

[0065] On the other hand, for example, entry to the third area a03 may be managed using a biometric authentication method different from that used in the first area a01, and when it is determined that the authentication target has moved from the first area a01 to the third area a03, information related to the biometric authentication may not be deleted from the management list. When biometric authentication is performed in both the first area a01 and the third area a03, the biometric information acquired in the first area a01 can be used in the third area a03. Furthermore, although the description has been given of movement from the first area a01 to the third area a03, similar processing can also be performed for movement in the opposite direction.

[0066] In another embodiment, when a person moves from the first area a01 to the third area a03, if the distance between the boundary between the first area a01 and the third area a03 and the person to be authenticated who moved to the third area a03 is within a predetermined distance, the information processing unit 24 may not delete information about the person to be authenticated from the management list. A specific example will now be described. Assume that entrance and exit management is performed in the first area a01 using facial recognition, and entrance and exit management is performed in the third area using a ticket gate. The information processing unit 24 determines that the person to be authenticated, who is being tracked by the person tracking unit 22, has moved from the first area a01 to the third area a03. Next, the return determination unit 245 determines whether the distance of the person to be authenticated from the boundary between the first area a01 and the third area a03 is within a predetermined distance. The return / entry determination unit 245 determines that the person to be authenticated is a person to be biometrically authenticated in the first area a01 if the distance between the person to be authenticated in the third area a03 and the boundary between the first area a01 and the third area a03 is within a predetermined distance. The information processing unit 24 does not delete the biometric information of the person to be authenticated registered in the management information list if the distance between the person to be authenticated and the boundary between the first area a01 and the third area a03 is within the predetermined distance. On the other hand, if the distance between the person to be authenticated and the boundary between the first area a01 and the third area a03 is not within the predetermined distance, the information processing unit 24 deletes the biometric information of the person to be authenticated registered in the management information list. The predetermined distance may be set so as not to delete information about the person to be authenticated that is included in the management information list of the person to be authenticated who has accidentally moved between multiple areas. For example, if a person to be authenticated who entered the first area a01 accidentally enters the third area a03, and the distance between the boundary between the first area a01 and the third area a03 and the person to be authenticated is within 100 cm, information about the person to be authenticated may not be deleted. Alternatively, by setting a predetermined time instead of a predetermined distance, information about the person to be authenticated may not be deleted from the management list for the predetermined time even if the person moves between areas. For example, the information processing unit 24 determines the person to be authenticated who has moved between areas and determines which area the person to be authenticated is located in 10 seconds later. Next, if the person to be authenticated is still located in the area to which the person moved after 10 seconds have elapsed, the information processing unit 24 deletes information about the person to be authenticated.On the other hand, if the person to be authenticated remains in the area they were in before moving between areas after 10 seconds have passed, the information about the person to be authenticated will not be deleted. This allows the information about the person to be authenticated to be retained even if the person to be authenticated moves between areas, enabling efficient management of the information management list.

[0067] Furthermore, when there is bidirectional entry and exit between the first area a01 and the second area a02, it is possible that the person to be authenticated may leave the area to give way, resulting in the deletion of information about the person to be authenticated from the management list. Therefore, when the person tracking unit 22 determines that the person to be authenticated has left the first area a01, the information processing unit 24 may determine whether another person is present within a predetermined distance from the person to be authenticated. If another person is present within the predetermined distance from the person to be authenticated, the information processing unit 24 may wait a predetermined time before deleting information about the person to be authenticated. Furthermore, the information processing unit 24 may determine whether a person is present in the second area a02. If a person is present, it may determine whether the distance between the person to be authenticated and the person present in the second area a02 is within a predetermined distance. If the distance is within the predetermined distance, the information processing unit 24 does not delete information about the person to be authenticated from the management list. On the other hand, if there is no person in the second area a02 or if the person is not within the predetermined distance, the information about the person to be authenticated may be deleted from the management list. The predetermined distance may be determined based on the distance between two people when one person makes a right-of-way gesture. For example, the person tracking unit 22 tracks two people traveling in opposite directions within each area. When one person stops and then deviates from the direction of travel, and the opposing person moves between areas, it can be determined that a right-of-way exchange has occurred. The information processing unit 24 may record multiple distances between the two people when a right-of-way exchange is determined to have occurred, and set the predetermined distance based on the average. For example, the predetermined distance may be set to 200 cm. Alternatively, a predetermined distance may not be set. For example, the information processing unit 24 may identify two or more people whose traveling directions intersect from the tracking results of the person tracking unit 22, determine that a right-of-way exchange has occurred when one person deviates from the direction of travel, exits the area, and stops, and temporarily retain information about the person to be authenticated included in the information management list. If the person to be authenticated returns to the area from which it left, the information about the person to be authenticated may not be deleted, and if the person does not return to the area, the information about the person to be authenticated may be deleted.

[0068] The biometric authentication unit 251 compares the biometric information of the person to be authenticated registered in the management target list with biometric information of the person to be authenticated that has been registered in advance, and outputs the result.

[0069] <Explanation of Operation> The operation of the information processing device 2 will be explained using the flowchart in Fig. 10. Here, a case will be explained in which entrance / exit management is performed by facial recognition in the first area a01, and entrance / exit management is performed by a gate using an IC card in the third area a03. The contents explained in the second embodiment will be omitted as appropriate.

[0070] The image acquisition unit 21 acquires an image of an area including the entrance / exit area a00 captured by the imaging unit 10 (step S21). The image acquisition unit 21 acquires the image including the entrance / exit area a00 captured by the imaging unit 10 via wired or wireless communication.

[0071] The person tracking unit 22 tracks the person to be authenticated included in the image acquired by the image acquisition unit 21 (step S22). The person tracking unit 22 may detect whether a person is included in the image, and may track the person as the person to be authenticated if a person is included.

[0072] The information acquisition unit 23 acquires information about the person to be authenticated who is being tracked by the person tracking unit 22 (step S23). The information processing unit 24 registers the information about the person to be authenticated acquired by the information acquisition unit 23 in the management target list (step S24). The information processing unit 24 may also register biometric information of the person to be authenticated in the management target list when the person to be authenticated enters the entrance / exit area a00 or the first area a01.

[0073] The biometric authentication unit 251 compares the biometric information registered in the management target list with the biometric information of the person to be authenticated that has been registered in advance (step S25). The comparison may be initiated when the person to be authenticated enters the first area a01. For example, the comparison may be initiated when the person to be authenticated enters the first area a01 from a side other than the border between the first area a01 and the second area a02. For example, the person tracking unit 22 may track the person to be authenticated, determine whether or not the person has entered the first area a01, which is a biometric authentication area, and instruct the biometric authentication unit 251 to compare the person to be authenticated. Furthermore, if the third area a03 is subject to entrance and exit management using a different biometric authentication method than the first area a01, the biometric authentication performed in the third area a03 may be initiated when the person to be authenticated enters the third area a03.

[0074] The person tracking unit 22 determines whether the person to be authenticated has exited the predetermined side b02 of the entrance / exit area a00 (step S26). The information processing unit 24 deletes information about the person to be authenticated when the person to be authenticated has exited the predetermined side b02 of the entrance / exit area (step S27). The operations of steps S26 and S27 may be performed not only after biometric authentication is performed in step S25, but also at any time after information about the person to be authenticated has been registered.

[0075] Next, the person tracking unit 22 determines whether the person to be authenticated has moved from the first area a01 to the third area a03 (step S28). If it is determined that the person to be authenticated has moved, the information processing unit 24 deletes information about the person to be authenticated registered in the management target list (step S29). If the person to be authenticated has moved from the first area a01 to the third area a03, the estimation unit 244 may estimate that the person to be authenticated will enter the second area a02 by the third method. If the estimation unit 244 estimates that the person to be authenticated will enter the second area a02 by the third method, the information processing unit 24 may delete information about the person to be authenticated registered in the management target list. Furthermore, in step S29, biometric information may be deleted from information about the person to be authenticated registered in the management target list. The operations of steps S28 and S29 may be performed at any time after information about the person to be authenticated is registered in step S24.

[0076] If the third area a03 performs entry / exit management using a different biometric authentication method from the first area a01, step S28 may further determine whether the person to be authenticated has moved from the third area a03 to the first area a01. Alternatively, if it is determined that the person to be authenticated has moved, the information processing unit 24 may not delete information about the person to be authenticated registered in the management list, instead of step S29. For example, if face authentication is performed in the first area a01 and iris authentication is performed in the third area a03, an image including the iris acquired in the third area a03 can be used in face authentication in the first area a01.

[0077] <Hardware Configuration> The configuration of the information processing device 2 will be described with reference to FIG. 11 . The information processing device 2 includes a calculation device H3, a storage device H4, and a communication device H5. The information processing device 2 may further include an input device H1 and an output device H2. The information processing device 2 does not necessarily include at least one of the input device H1 and the output device H2. In the information processing device 2, the input device H1, the output device H2, the calculation device H3, the storage device H4, and the communication device H5 may be connected via a data bus. The information processing device 2 may be implemented by a terminal device such as a notebook personal computer, or by a server device such as a cloud server.

[0078] The arithmetic device H3 may include, for example, at least one of a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), an FPGA (Field Programmable Gate Array), a TPU (Tensor Processing Unit), and a quantum processor.

[0079] The storage device H4 may include, for example, at least one of a RAM (Random Access Memory), a ROM (Read Only Memory), a hard disk device, a magneto-optical disk device, an SSD (Solid State Drive), and an optical disk array. In other words, the storage device H4 may include a non-transitory recording medium. The storage device H4 is capable of storing desired data. For example, the storage device H4 may temporarily store a computer program executed by the calculation device H3. The storage device H4 may temporarily store data that is temporarily used by the calculation device H3 when the calculation device H3 is executing a computer program.

[0080] The communication device H5 may be capable of communicating with devices external to the information processing device 2. The communication device H5 may perform wired communication or wireless communication.

[0081] The input device H1 is a device capable of accepting information input to the information processing device 2 from the outside. The input device H1 may include an operating device (e.g., a keyboard, a mouse, a touch panel, etc.) that can be operated by an operator of the information processing device 2. The input device H1 may include a recording medium reading device that can read information recorded on a recording medium that is detachable from the information processing device 2, such as a USB (Universal Serial Bus) memory. The input device H1 may include an imaging unit 10 that is an imaging device such as a camera, an infrared camera, or a surveillance camera. Note that when information is input to the information processing device 2 via the communication device H5 (in other words, when the information processing device 2 acquires information via the communication device H5), the communication device H5 may function as an input device.

[0082] The output device H2 is a device capable of outputting information to the outside of the information processing device 2. The output device H2 may output visual information such as text or images, auditory information such as sound, or tactile information such as vibration, as the information. The output device H2 may include, for example, at least one of a display, a speaker, a printer, and a vibration motor. The output device H2 may be capable of outputting information to a recording medium detachable from the information processing device 2, such as a USB memory. Note that when the information processing device 2 outputs information via the communication device H5, the communication device H5 may function as an output device.

[0083] The calculation device H3 may have an image acquisition unit 21, a person tracking unit 22, an information acquisition unit 23, an information processing unit 24, and an entry / exit management unit 25 as logically realized functional blocks or as physically realized processing circuits. At least one of the image acquisition unit 21, the person tracking unit 22, the information acquisition unit 23, the information processing unit 24, and the entry / exit management unit 25 may be realized in a form that combines logical functional blocks and physical processing circuits (i.e., hardware). When at least some of the image acquisition unit 21, the person tracking unit 22, the information processing unit 24, and the entry / exit management unit 25 are functional blocks, at least some of the image acquisition unit 21, the person tracking unit 22, the information processing unit 24, and the entry / exit management unit 25 may be realized by the calculation device H3 executing a predetermined computer program.

[0084] The arithmetic device H3 may acquire (in other words, read) the predetermined computer program from the storage device H4. The arithmetic device H3 may read the predetermined computer program stored in a computer-readable, non-transitory recording medium using a recording medium reading device (not shown) included in the information processing device 2. The arithmetic device H3 may acquire (in other words, download or read) the predetermined computer program from a device (not shown) external to the information processing device 2 via the communication device H5. Note that the recording medium for recording the predetermined computer program executed by the arithmetic device H3 may be at least one of an optical disk, a magnetic medium, a magneto-optical disk, a semiconductor memory, and any other medium capable of storing a program.

[0085] <Explanation of Effects> The information processing device 2 can track an individual to be authenticated who has left a predetermined edge b02 of the entrance / exit area a00 and delete information about the individual to be authenticated. By deleting information about the individual to be authenticated, it is possible to determine whether the individual intends to enter or exit without the need for a gate or other action by the individual to be authenticated, such as receiving a ticket. Furthermore, by deleting information about an individual to be authenticated who has no intention of entering or exiting, privacy can be protected. This embodiment can prevent duplicate registration of an individual to be authenticated in the management list when a person who once exited the entrance / exit area a00 to prevent entry re-enters. This embodiment describes the appropriate processing of information about the individual to be authenticated in the management list when moving between the first area a01 and the third area a03. For example, if biometric authentication is successfully performed in the first area a01, but the individual then enters through the third area a03, a duplicate entry determination can be made, preventing an error from occurring when exiting.

[0086] Fourth Embodiment Next, a fourth embodiment will be described. The fourth embodiment differs from the above-described embodiments in that a priority for determining the order in which biometric authentication is performed is calculated.

[0087] 12, the information processing device 3 includes an image acquisition unit 21, a person tracking unit 22, an information acquisition unit 23, an information processing unit 34, an entry / exit management unit 35, and a priority setting unit 36. The entry / exit management unit 35 includes a biometric authentication unit 351. The priority setting unit 36 ​​includes a priority calculation unit 361. The information processing device 3 may further include an imaging unit 10. Differences from the third embodiment will be specifically described below, and overlapping descriptions will be omitted as appropriate.

[0088] The priority setting unit 36 ​​sets a higher priority for each person to be biometrically authenticated, the closer the distance between the face authentication subject and the entry / exit boundary b12. The priority calculation unit 361 calculates a priority that determines the order in which biometric authentication is performed on each person to be biometrically authenticated. For example, a case will be described in which a person enters a second area within a train station from either a first area a01, where entry is managed by biometric authentication, or a third area a03, where entry is managed by a ticket-based gate. First, the person tracking unit 22 tracks the person to be biometrically authenticated based on the image acquired by the image acquisition unit 21. Next, when the tracked person to be biometrically authenticated enters the first area a01, the priority calculation unit 361 calculates a priority that indicates the order in which biometric authentication is performed on the person to be biometrically authenticated. Next, the biometric authentication unit 351 determines the person to be biometrically authenticated based on the priority and performs biometric authentication using biometric information registered in the corresponding management target list. The priority calculation unit 361 can calculate the priority based on various factors.

[0089] An example of a factor used by the priority calculation unit 361 to calculate the priority is distance. For example, the closer a person is to the second area a02 in the station, the more likely they are to enter the station from the first area a01. Therefore, the priority can be determined based on the distance between the person to be authenticated and the second area a02. For example, the closer the position of the person to be authenticated detected from the image captured by the imaging unit 10 is to the second area a02, the higher the priority can be set.

[0090] For example, when face authentication is performed in the first area a01, the priority can be calculated based on the size of the face image captured by the imaging unit 10 and detected within the first area a01. Furthermore, the priority can be calculated based not only on the size of the face image but also on the distance between the eyes of the person being authenticated. A method for calculating the distance between the eyes from a detected face image is omitted here because conventional techniques can be applied. For example, if the imaging range of the camera (imaging unit 10) is set to face the direction of travel of the person being authenticated moving from the first area a01 and the third area a03 to the second area a02, the detected face is expected to become larger as the person being authenticated approaches the second area a02. Therefore, the larger the size or distance between the eyes of the detected face, the higher the priority can be set. Alternatively, the position of the detected face in the image captured by the imaging unit 10 can be identified, and the closer it is to the second area a02, the higher the priority can be set.

[0091] Furthermore, the camera serving as the imaging unit 10 does not necessarily need to be installed facing the direction of travel of the person to be authenticated. Depending on the installation position of the camera, the person to be authenticated who is closest to the camera is not necessarily closest to the second area a02. Therefore, the priority setting unit 36 ​​may associate the position in the captured image with the actual position from the second area a02. The priority calculation unit 361 may calculate the priority based on, for example, the position in the image where the person to be authenticated is captured.

[0092] As an example of positional association, the priority setting unit 36 ​​may use conversion coefficients such that the face size and eye distance of a person to be authenticated that is closer to the second region a02 are calculated to be larger. The priority setting unit 36 ​​sets conversion coefficients such that the closer a person to the second region a02 in the image is to the face, the larger the conversion coefficient. The priority setting unit 36 ​​sets conversion coefficients for each predetermined region in the image, and sets larger conversion coefficients for faces detected in predetermined regions closer to the second region a02 than for other predetermined regions. As a result, even if the face size of a person to be authenticated closest to the camera is detected to be larger in the actual image than the face size of a person to be authenticated closest to the second region a02, the face size and eye distance are corrected by the conversion coefficients, so the priority setting unit 36 ​​can set higher priorities for people to be authenticated that are closer to the second region a02.

[0093] Furthermore, when different biometric authentication methods are performed in the first area a01 and the third area a03, the priority setting unit 36 ​​may determine the priority based on the positional relationship of the person to be authenticated. More specifically, the priority setting unit 36 ​​may set a higher priority for the person to be authenticated who is closer to the second area based on the positional relationship of the person to be authenticated who is present in the combined area of ​​the first area a01 and the third area a03.

[0094] Furthermore, the priority setting unit 36 ​​may set weights according to the processing loads of the biometric authentication performed in the first area a01 and the third area a03. For example, when the processing load of the third area a03 is greater than that of the first area a01, the priority setting unit 36 ​​may set weights so that biometric authentication of the authentication subject A, who is in the first area a01, and the authentication subject B, who is in the third area a03, both have the same distance from the second area a02, can be performed first, thereby giving the authentication subject B a higher priority.

[0095] Furthermore, the quality of biometric information is an example of a factor used by the priority calculation unit 361 to calculate priorities. For example, the higher the quality of a detected face image, the more accurate face authentication can be performed. Therefore, the priority setting unit 36 ​​can set a higher priority for a detected face image with higher quality.

[0096] Furthermore, an example of an element used by the priority calculation unit 361 to calculate priorities is a face-likeness score, which is an evaluation value that evaluates the face-likeness of a detected face image. For example, a higher face-likeness score indicates that a detected face image is more face-like. Therefore, the priority setting unit 36 ​​can set a higher priority for a detected face image with a higher face-likeness score. In addition to face images, the priority setting unit 36 ​​can also evaluate iris images, ear acoustic information, and the like to determine whether they match the characteristics unique to each piece of biometric information, and set a high priority based on the evaluation value.

[0097] Furthermore, an example of an element used by the priority calculation unit 361 to calculate the priority is the value of the flag set by the flag setting unit 142. For example, the biometric authentication unit 351 sets "0" if authentication is unsuccessful, and sets "1" if authentication is successful. If "0" indicating unsuccessful authentication is set, a weight may be assigned to the priority so that the person can be authenticated before a person for whom "1" is set. For example, by weighting based on the flag value in addition to the priority calculated based on the above-mentioned elements, it is possible to preferentially process authentication subjects who are unsuccessful in authentication.

[0098] The priority calculation unit 361 can calculate the priority based on any one or a combination of the above-mentioned factors. For example, the priority calculation unit 361 may calculate the priority based on the distance from the second area a02 and the quality of the biometric information as factors for calculating the priority. For example, the priority setting unit 36 ​​may set a higher priority to a face image of the person to be authenticated that is closest to the second area a02 and has the highest quality among the detected face images of the person to be authenticated. Furthermore, the priority setting unit 36 ​​may set a higher priority to a face image having a larger value obtained by multiplying a value indicating the image quality by the face-likeness score among the face images of the person to be authenticated. The priority setting unit 36 ​​may also set a lower priority value as the priority increases.

[0099] The information processing unit 34 registers the priorities calculated by the priority calculation unit 361 in a management target list corresponding to each authentication target. The biometric authentication unit 351 performs biometric authentication on the authentication targets in descending order of priority based on the priorities registered in the management target list.

[0100] The priority calculation unit 361 may calculate the priority from the image acquired by the image acquisition unit 21, may calculate the priority from an image including the person to be authenticated that is being tracked by the person tracking unit 22, or may calculate the priority from information about the person to be authenticated that is acquired by the information acquisition unit 23. For example, the information acquisition unit 23 may acquire a face image from an image including the person to be authenticated that is captured by the imaging unit 10, and the priority calculation unit 361 may calculate the priority from the face image acquired by the information acquisition unit 23.

[0101] The priority calculation unit 361 may calculate multiple priorities at a specific timing, or may calculate a priority at each timing. For example, the priority calculation unit 361 calculates a priority based on the distance from the second area a02 from an image including the person to be authenticated that is being tracked by the person tracking unit 22, and calculates a priority based on the quality of the biometric information each time the information acquisition unit 23 acquires information about the person to be authenticated. The priority setting unit 36 ​​may determine which biometric information from the multiple biometric information to use for biometric authentication based on the person to be authenticated who has the highest priority calculated based on the distance from the second area a02 and the priority calculated based on the quality of the biometric information of the person to be authenticated. The priority setting unit 36 ​​may also calculate an overall priority by multiplying the priority calculated based on the distance from the second area a02 by the priority calculated based on the quality of the biometric information of the person to be authenticated, and determine the order of biometric authentication based on the overall priority.

[0102] Another specific example will now be described. The information acquisition unit 23 identifies the location of the terminal using conventional positioning technology and associates it with the person to be authenticated who appears in the image, and the information processing unit 34 registers the location of the terminal and the biometric information related to the corresponding person to be authenticated in the management target list. The priority setting unit 36 ​​may set a higher priority for the person to be authenticated when the location information of the terminal is closer to the second area a02, and the biometric authentication unit 351 may perform biometric authentication of the biometric information registered in the management target list in accordance with the priority.

[0103] As described in the above embodiments, the information processing unit 34 can delete information about a target person registered in the management list if the target person has no intention of entering the station or if the target person moves from the area where biometric authentication is performed to a different area. Furthermore, when multiple pieces of biometric information about the same target person are registered, the information processing unit 34 may delete biometric information with a low priority. Deleting biometric information with a low priority reduces data volume and avoids unnecessary authentication processing. Furthermore, the biometric information to be deleted may be determined using factors for calculating the priority rather than the priority. For example, if facial authentication is performed in the first area a01 and the target person enters the second area within the station, when the target person enters the first area a01, the person tracking unit 22 can sequentially acquire facial images of the target person being tracked and store them in the management list. Next, the priority is determined based on the quality of the facial images. If the target person does not leave the specified edge b01, facial images with a priority below a predetermined threshold can be deleted from the management list.

[0104] <Explanation of Operation> The operation of the information processing device 3 will be explained using the flowchart in Fig. 13. Here, a case will be explained in which entrance / exit management is performed by facial recognition in the first area a01, and entrance / exit management is performed by a gate using an IC card in the third area a03. The contents explained in the above embodiment will be omitted as appropriate.

[0105] The priority calculation unit 361 calculates a priority from the facial image of the person to be authenticated being tracked by the person tracking unit 22 (step S31). The timing for calculating the priority may be when the image acquisition unit 21 acquires an image, when the person tracking unit 22 tracks the person to be authenticated, or when the information processing unit 34 registers biometric information in the management target list. Therefore, step S31 may be executed any time before step S33, which performs biometric authentication as described below, is executed. For example, the priority calculation unit 361 may calculate the priority of the facial image when the person to be authenticated enters the first area a01, which is the facial authentication area.

[0106] The information processing unit 34 registers the facial image and priority of the person to be authenticated who is being tracked in step S22 in the management target list (step S32). Furthermore, multiple facial images and priorities of the person to be authenticated who is being tracked may be registered. The operation of acquiring and registering multiple facial images and priorities may be performed each time person tracking is performed, or may be performed at predetermined time intervals. Furthermore, the information processing unit 34 may store information about the person to be authenticated before executing step S31, and register the priority calculated by the priority calculation unit 361 from the biometric information in the management target list in the corresponding management target list.

[0107] The biometric authentication unit 351 performs face authentication on the authentication subjects in descending order of priority calculated by the priority calculation unit 361 (step S33). For example, when there are multiple authentication subjects in the first area a01, face authentication is performed on the authentication subjects in descending order of priority registered in the management target list of each authentication subject. The timing for performing biometric authentication may be when the subject enters the first area a01 or when the priority reaches or exceeds a predetermined threshold. For example, when the quality of biometric information is used as a factor for calculating the priority, the biometric authentication unit 351 may start biometric authentication when the quality of the biometric information registered in the management target list is equal to or exceeds a predetermined quality.

[0108] The biometric authentication unit 351 deletes information about the authentication target who has no intention of undergoing biometric authentication in the first area a01 (steps S26 to S29). The biometric authentication unit 351 deletes biometric information with a low priority from among multiple pieces of biometric information registered in the management list of the authentication target (the authentication target who has the intention of undergoing biometric authentication) who exists in the first area a01. For example, if the priority is set based on the size of the face image of the authentication target, the biometric information with a priority lower than a predetermined threshold may be deleted (step S34).

[0109] <Explanation of Effect> By calculating the priority, the information processing device 3 can perform biometric authentication starting with people who are likely to enter the second area a02, such as inside a train station. Even if the authentication target person was registered in the management list last, the order in which biometric authentication is performed can be determined based on the priority. For example, even if a person enters by cutting in line from the third area a03, where entry and exit are managed by a gate using an IC card or ticket, to the first area a01, where entry and exit are managed by biometric authentication, the order in which biometric authentication is performed can be determined more appropriately based on the priority.

[0110] Fifth Embodiment Next, a fifth embodiment will be described. The fifth embodiment differs from the above-described embodiments in that the boundary lines of each region are displayed.

[0111] 14, the information processing device 4 includes an image acquisition unit 21, a person tracking unit 22, an information acquisition unit 23, an information processing unit 34, an entry / exit management unit 35, a priority setting unit 36, and a boundary display unit 46. The information processing device 4 may further include an imaging unit 10. Below, differences from the fourth embodiment will be specifically described, and overlapping descriptions will be omitted as appropriate.

[0112] The boundary display unit 46 displays a boundary line indicating at least one of the entry / exit area a00, the first area a01, the second area a02, and the third area a03. For example, as shown in FIG. 15a, a boundary line may be displayed surrounding the entry / exit area a00 so as to indicate which area is set as the entry / exit area a00. Furthermore, as shown in FIG. 15b, boundary lines may be displayed to indicate not only one area but also multiple areas, and the color or type of the boundary line may be different for each area so as to make it easier to identify each area. For example, as shown in FIG. 15c, a boundary line indicating the boundary between the first area a01 and the third area a03 may be displayed. Furthermore, a boundary line indicating the boundary between the first area a01, where entry / exit management is performed using facial recognition, and the second area a02, which is a restricted area such as a train station, may be displayed. Note that the boundary line may be a combination of a line surrounding an area and a line separating the areas. Furthermore, the boundary line display unit 46 may display not only boundary lines but also areas. For example, to make it easier to distinguish between the first area a01 and third area a03 set outside the station and the second area a02 set inside the station, the color gradation or line spacing may be changed as the area approaches the boundary between the two areas, as shown in Figure 15d, so that the area and its boundary can be more easily identified by the person being authenticated.

[0113] The boundary line display unit 46 may display the boundary lines and areas using a display installed on the floor. Alternatively, the boundary lines and areas may be projected onto the floor using a projector. The boundary lines displayed by the display or projector may be not only on the floor but also on a wall. For example, a boundary line indicating the boundary separating a first area outside the station from a second area inside the station may be projected onto a wall. Alternatively, the boundary lines and areas may be displayed using AR (Augmented Reality) technology. For example, the boundary lines and areas may be displayed by superimposing them on a moving image acquired through a camera through a display of VR (Virtual Reality) goggles, a wearable eyeglasses-type device, or a mobile terminal.

[0114] <Explanation of Effects> By displaying boundary lines and areas, the information processing device 4 can make it easier to understand each area. By visually checking the displayed boundary lines and areas, the person to be authenticated can easily understand how far they need to go before biometric authentication will be performed and how far they need to go before they will have entered the station premises. Since it becomes easier for the person to be authenticated to consciously enter and exit the area, it is possible to prevent them from being unnecessarily registered in the management target list without intending to enter through biometric authentication.

[0115] Sixth Embodiment Next, a sixth embodiment will be described. The sixth embodiment differs from any of the above-described embodiments in that it includes a notification unit that performs notification.

[0116] 16, the information processing device 5 includes an image acquisition unit 21, a person tracking unit 22, an information acquisition unit 23, an information processing unit 34, an entry / exit management unit 35, a priority setting unit 36, a boundary line display unit 46, and a notification unit 57. The information processing device 5 may further include an imaging unit 10. Below, differences from the fifth embodiment will be specifically described, and overlapping descriptions will be omitted as appropriate.

[0117] The notification unit 57 may notify notification information indicating what information on the authentication subject has been acquired when the information acquisition unit 23 acquires the information on the authentication subject. Furthermore, the notification unit 57 may notify notification information indicating what information on the authentication subject has been processed when the information processing unit 34 registers or deletes information on the authentication subject in the management target list. Additionally, the notification unit 57 may notify notification information indicating the result of biometric authentication when the biometric authentication unit 351 performs biometric authentication.

[0118] The notification unit 57 may notify the authentication subject or an administrator of notification information based on information about the authentication subject included in the information management list. Examples of the notification information include the authentication subject's biometric information, clothing, belongings, identification information, biometric authentication results, and information indicating entry and exit, which are included in the information management list. For example, if the biometric authentication unit 351 fails biometric authentication, the notification unit 57 may notify the administrator of information about the authentication subject, such as biometric information, clothing, and belongings. Furthermore, if the biometric authentication is successful, the notification unit 57 may notify the authentication subject of notification information indicating that the biometric authentication was successful using a contact address linked to the pre-registered biometric information. For example, if the authentication subject enters from the first area a01 to the second area a02 using facial authentication, the authentication subject may be notified via a terminal carried by the authentication subject that they can exit using facial authentication when they exit.

[0119] Furthermore, when a person enters the second area a02 from the first area a01 or the third area a03, the method of entry may be notified based on the area from which the person entered. For example, in the entrance / exit area a00, entrance / exit management may be performed using facial recognition in the first area a01, and in the third area a03, entrance / exit management may be performed using a gate using an IC card or ticket while also performing facial recognition. In other words, the first area a01 may be set to overlap the third area a03. When a person to be authenticated enters the second area a02 using an IC card while performing facial recognition in the third area a03, the information processing unit 34 may register the facial recognition result and information indicating entry using an IC card in the management list. Next, the notification unit 57 may notify the device carried by the person to be authenticated of information indicating entry using an IC card from the contact information associated with the person to be authenticated obtained by facial recognition as notification information. In addition, the notification information may include information indicating that facial authentication was successful and a notification that exit processing using facial recognition is possible upon exit.

[0120] <Explanation of Effects> By notifying the authentication target person or the administrator of notification information, the information processing device 5 allows the authentication target person or the administrator to easily understand registered information, authentication results, etc. Also, by notifying the administrator of information about people for whom biometric authentication was not performed properly, it is possible to obtain information about authentication target people for whom proper entry processing was not performed, and to provide support to users who are using the wrong entry method to find the appropriate entry method. In addition, it is also possible to identify suspicious people or people who have committed fraud.

[0121] <Supplementary Notes> A part or all of the above-described embodiments can be described as, but are not limited to, the following supplementary notes.

[0122] (Supplementary Note 1) An information processing device comprising: an image acquisition means for acquiring an image including an entry / exit area having a first area; and an information processing means for registering information about a first person in the first area that is included in the image in a management list, wherein the first person can enter a second area adjacent to the first area by biometric authentication in the first area, and the information processing means deletes the information about the first person from the management list when the first person exits the entry / exit area from a predetermined side that is different from the side that corresponds to the entry / exit boundary between the first area and the second area. (Supplementary Note 2) The information processing device according to Supplementary Note 1, comprising: a person tracking means for tracking a person moving within the entry / exit area based on the image; and an entry / exit management means for managing the entry of the first person into the second area by a first method using biometric authentication. (Supplementary Note 3) The information processing device according to Supplementary Note 2, wherein the image acquisition means acquires an image including the entry / exit area having the first area and a third area adjacent to the first area, and the entry / exit management means manages entry of the first person into the second area by the first method, and manages entry of a person in the third area into the second area by a third method different from the first method. (Supplementary Note 4) The information processing device according to Supplementary Note 3, wherein the information processing means deletes at least a part of information related to the first person from the management target list when the first person moves from the first area to the third area. (Supplementary Note 5) The information processing device according to Supplementary Note 4, further comprising an estimation means for estimating that the first person will enter the second area using the third method when the first person moves from the first area to the third area, and the information processing means deletes at least a portion of the information relating to the first person from the management target list when it is estimated that the first person will enter the second area using the third method.(Supplementary Note 6) The information processing device according to Supplementary Note 3, comprising: a determination means for determining that the first person who entered the first area from a boundary different from the entry / exit boundary is a person to be authenticated by face authentication using a face image; and a face image acquisition means for acquiring a face image of the person to be authenticated from the image, wherein the entry / exit management means has a biometric authentication means for performing face authentication of the person to be authenticated based on the face image. (Supplementary Note 7) The information processing device according to Supplementary Note 3, comprising: a flag setting means for setting a flag, the value of which changes depending on the result of the biometric authentication, in association with the first person; and a flag determination means for determining the value of the flag when the first person leaves the first area. (Supplementary Note 8) The information processing device according to Supplementary Note 3, comprising: an entry / exit determination means for determining that the person in the third area is a person to be authenticated by the first method when the distance between the person in the third area and the boundary between the first area and the third area is within a predetermined distance. (Supplementary Note 9) The information processing device according to Supplementary Note 6, further comprising: priority setting means for setting a higher priority as the distance between the face authentication target person and the entry / exit boundary becomes shorter; and the biometric authentication means compares the face image with registered face images in descending order of priority. (Supplementary Note 10) The information processing device according to Supplementary Note 1, further comprising: when the first person leaves the first area and there is another person within a predetermined distance from the first person, the information processing means waits for a predetermined time before deleting information about the first person. (Supplementary Note 11) The information processing device according to Supplementary Note 3, further comprising: display means for displaying at least one of the first area, the third area, and the boundary line between the first area and the third area. (Supplementary Note 12) The information processing device according to Supplementary Note 11, further comprising: a projector for projecting at least one of the first area, the third area, and the boundary line between the first area and the third area.(Supplementary Note 13) An information processing method including: a computer acquiring an image including an entry / exit area having a first area; registering information about a first person in the first area included in the image in a management target list; the first person being able to enter a second area adjacent to the first area through biometric authentication in the first area; and the information processing means deleting the information about the first person from the management target list when the first person leaves the entry / exit area from a predetermined side different from the side corresponding to the entry / exit boundary between the first area and the second area. (Supplementary Note 14) A program that causes a computer to operate in the following manner: the computer acquires an image including an entry / exit area having a first area; registers information about a first person in the first area included in the image in a management list; the first person is allowed to enter a second area adjacent to the first area by biometric authentication in the first area; and the information processing means deletes the information about the first person from the management list when the first person exits the entry / exit area from a specified side different from the side corresponding to the entry / exit boundary between the first area and the second area. (Supplementary Note 15) An information processing system comprising: an image acquisition means for acquiring an image including an entry / exit area having a first area; and an information processing means for registering information about a first person in the first area included in the image in a management target list, wherein the first person can enter a second area adjacent to the first area by biometric authentication in the first area, and the information processing means deletes the information about the first person from the management target list when the first person exits the entry / exit area from a predetermined side different from the side corresponding to the entry / exit boundary between the first area and the second area.

[0123] Furthermore, some or all of the configurations described in Supplementary Notes 2 to 9 that are dependent on Supplementary Note 1 above may also be dependent on Supplementary Notes 10, 11, and 12 in the same dependent relationship as Supplementary Notes 2 to 9. Furthermore, not limited to Supplementary Notes 1, 10, 11, and 12, some or all of the configurations described as Supplements may be made dependent on various hardware, software, various recording means for recording software, or systems, within the scope of each of the above-mentioned embodiments.

[0124] This disclosure is not limited to the above-described embodiments, and may be modified as appropriate within the scope that does not contradict the gist or idea of ​​the invention that can be read from the claims and the entire specification. It is not necessarily limited to the configuration of each embodiment, and embodiments may be combined within the scope that does not create contradictions. Information processing systems, information processing methods, and recording media that involve such modifications are also included in the technical scope of this disclosure.

[0125] 100, 1, 2, 3, 4, 5, 6 Information processing device 10 Imaging unit 11, 21 Image acquisition unit 12, 22 Person tracking unit 13, 23 Information acquisition unit 131 Face image acquisition unit 14, 24, 34 Information processing unit 141 Determination unit 142 Flag setting unit 143 Flag confirmation unit 15, 25, 35 Entry / exit management unit 151, 251, 351 Biometric authentication unit 244 Estimation unit 245 Return determination unit 36 ​​Priority setting unit 361 Priority calculation unit 46 Boundary line display unit 57 Notification unit

Claims

1. An information processing device comprising: an image acquisition means for acquiring an image including an entry / exit area having a first area; and an information processing means for registering information regarding a first person within the first area included in the image in a management list, wherein the first person can enter a second area adjacent to the first area through biometric authentication in the first area, and the information processing means deletes the information regarding the first person from the management list when the first person exits the entry / exit area from a specified side other than the side corresponding to the entry / exit boundary between the first area and the second area.

2. An information processing device as described in claim 1, comprising: a person tracking means for tracking a person moving within the entrance / exit area based on the image; and an entrance / exit management means for managing the entry of the first person into the second area by a first method using biometric authentication.

3. The information processing device of claim 2, wherein the image acquisition means acquires an image including the entry / exit area having the first area and a third area adjacent to the first area, and the entry / exit management means manages the entry of the first person into the second area by the first method, and manages the entry of a person within the third area into the second area by a third method different from the first method.

4. The information processing device according to claim 3, wherein the information processing means deletes at least a portion of the information relating to the first person from the managed list when the first person moves from the first area to the third area.

5. An information processing device as described in claim 4, further comprising an estimation means for estimating that the first person will enter the second area using the third method when the first person moves from the first area to the third area, and wherein the information processing means deletes at least a portion of the information regarding the first person from the managed area list when it is estimated that the first person will enter the second area using the third method.

6. An information processing device as described in claim 3, comprising: a determination means for determining that the first person who entered the first area from a boundary different from the entry / exit boundary is a person to be face-authenticated by face recognition using a face image; and a face image acquisition means for acquiring a face image of the person to be face-authenticated from the image, wherein the entry / exit management means has a biometric authentication means for performing face authentication of the person to be face-authenticated based on the face image.

7. An information processing device as described in claim 3, comprising: a flag setting means for setting a flag, the value of which changes depending on the result of the biometric authentication, in correspondence with the first person; and a flag determination means for determining the value of the flag when the first person leaves the first area.

8. An information processing device as described in claim 3, further comprising an entry / exit determination means for determining that a specified person in the third area is an authentication target person whose entry / exit is managed by the first method when the distance between the specified person in the third area and the boundary between the first area and the third area is within a specified distance.

9. The information processing device according to claim 6, further comprising a priority setting means for setting a higher priority for the closer the distance between the person to be face-recognized and the entrance / exit boundary, and wherein the biometric authentication means compares the face image with registered face images in the order of decreasing priority.

10. The information processing device according to claim 1, wherein the information processing means waits a predetermined time before deleting information about the first person if there is another person within a predetermined distance from the first person when the first person leaves the first area.

11. An information processing device according to claim 3, further comprising a display means for displaying at least one of the first area, the third area, and the boundary line between the first area and the third area.

12. The information processing device according to claim 11, wherein the display means is a projector that projects at least one of the first area, the third area, and the boundary line between the first area and the third area.

13. An information processing method comprising: a computer acquiring an image including an entry / exit area having a first area; registering information regarding a first person in the first area included in the image in a management list; the first person being able to enter a second area adjacent to the first area through biometric authentication in the first area; and, when the first person leaves the entry / exit area from a specified side other than the side corresponding to the entry / exit boundary between the first area and the second area, the information processing means deleting the information regarding the first person from the management list.

14. A program that causes a computer to operate as follows: acquire an image including an entry / exit area having a first area; register information about a first person in the first area included in the image in a management list; enable the first person to enter a second area adjacent to the first area through biometric authentication in the first area; and when the first person leaves the entry / exit area from a specified side other than the side corresponding to the entry / exit boundary between the first area and the second area, the information processing means deletes the information about the first person from the management list.

15. An information processing system comprising: an image acquisition means for acquiring an image including an entrance / exit area having a first area; and an information processing means for registering information regarding a first person within the first area included in the image in a management list, wherein the first person can enter a second area adjacent to the first area through biometric authentication in the first area, and the information processing means deletes the information regarding the first person from the management list when the first person exits the entrance / exit area from a specified side other than the side corresponding to the entrance / exit boundary between the first area and the second area.

Images