Information processing device, information processing method, and recording medium

Abstract

This information processing device comprises a first acquisition unit, an authentication unit, a second acquisition unit, and an identification unit. The first acquisition unit acquires authentication information of a person to be authenticated in a first passage area. The authentication unit authenticates the person to be authenticated on the basis of the authentication information. The second acquisition unit acquires a second passage area image obtained by imaging a second passage area through which the person will pass after the first passage area. A first person to be authenticated, who is a person to be authenticated whose authentication has failed, is identified in the second passage area image by the identification unit on the basis of the appearance of the first person to be authenticated.

Description

Information processing device, information processing method, and recording medium

[0001] The present disclosure relates to an information processing device, an information processing method, and a recording medium.

[0002] A technology related to this disclosure is disclosed in Patent Document 1. The technology disclosed in Patent Document 1 controls entry to an authorized area using authentication processing and a gate. Specifically, this technology performs facial authentication on people at a gate installed at the entrance to the authorized area, and controls so that people whose facial authentication is successful can pass through the gate.

[0003] Japanese Patent Application Laid-Open No. 2022-136288

[0004] In the case of technology that allows only those who have been successfully authenticated to pass through a gate, those who have failed authentication cannot pass through the gate. In this case, the person must retry authentication at the gate or wait for a worker there, and the occurrence of such incidents reduces throughput.

[0005] One example of the purpose of this disclosure is to improve the throughput problem in a technology that controls entry into an authorized area through an authentication process.

[0006] The information processing device disclosed herein comprises a first acquisition means for acquiring authentication information of an authenticated person in a first passage area, an authentication means for authenticating the authenticated person based on the authentication information, a second acquisition means for acquiring a second passage area image capturing a second passage area through which the authenticated person will pass after passing through the first passage area, and an identification means for identifying the first authenticated person in the second passage area image based on the appearance of the first authenticated person, who is the authenticated person who failed the authentication.

[0007] The disclosed information processing method involves one or more computers acquiring authentication information for a person to be authenticated in a first traffic area, authenticating the person to be authenticated based on the authentication information, acquiring a second traffic area image capturing a second traffic area that the person will pass through after passing through the first traffic area, and identifying the first person to be authenticated in the second traffic area image based on the appearance of the first person to be authenticated, who is the person to be authenticated who failed the authentication.

[0008] The recording medium of this disclosure records a program that causes a computer to function as: a first acquisition means that acquires authentication information of an authenticated person in a first passage area; an authentication means that authenticates the authenticated person based on the authentication information; a second acquisition means that acquires a second passage area image that captures a second passage area that the authenticated person will pass through after passing through the first passage area; and an identification means that identifies the first authenticated person in the second passage area image based on the appearance of the first authenticated person, who is the authenticated person who failed the authentication.

[0009] 1 is a diagram illustrating an example of a functional block diagram of an information processing device; FIG. 2 is a flowchart illustrating an example of a processing flow of an information processing device; FIG. 3 is a diagram illustrating an example of a hardware configuration of an information processing device; FIG. 4 is a diagram illustrating an example of a usage scenario of an information processing device; FIG. 5 is a diagram illustrating another example of a usage scenario of an information processing device; FIG. 6 is a flowchart illustrating another example of a processing flow of an information processing device; FIG. 7 is a flowchart illustrating another example of a processing flow of an information processing device; FIG. 8 is a diagram illustrating another example of a usage scenario of an information processing device; FIG. 9 is a diagram illustrating an example of a functional block diagram of an information processing device;

[0010] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings. In this disclosure, the drawings relate to one or more embodiments. In all drawings, similar components are designated by similar reference numerals, and descriptions thereof will be omitted as appropriate.

[0011] <<First Embodiment>> Fig. 1 is a functional block diagram showing an overview of an information processing device 10. As shown in Fig. 1, the information processing device 10 has a first acquisition unit 11, an authentication unit 12, a second acquisition unit 13, and an identification unit 14. These functional units execute the processing of the flowchart in Fig. 2.

[0012] In S10, the first acquisition unit 11 acquires authentication information of the person to be authenticated in the first passage area. In S11, the authentication unit 12 authenticates the person to be authenticated based on the authentication information. In S12, the second acquisition unit 13 acquires a second passage area image captured of a second passage area that the person will pass through after passing through the first passage area. In S13, the first person to be authenticated is identified in the second passage area image based on the appearance of the first person to be authenticated, who has failed authentication.

[0013] In this way, the information processing device 10 acquires authentication information in the first traffic area and performs authentication based on the authentication information. After that, the information processing device 10 identifies the first authenticatee who failed authentication in the second traffic area that the information processing device 10 will pass through after the first traffic area.

[0014] When using the information processing device 10 that identifies a first authenticated person who has failed authentication within a second passage area, the worker can take action against the first authenticated person who has failed authentication (such as confirmation work or requesting that the person leave) in the "second passage area." In other words, the worker does not need to take action against the first authenticated person who has failed authentication at the spot (gate, etc.) where authentication information is acquired in the "first passage area." In this case, it is possible to allow all authenticated people to pass through the spot (gate, etc.) where authentication information is acquired in the "first passage area" regardless of the authentication result.

[0015] Acquisition of authentication information for authentication is usually performed one person at a time. For this reason, there tends to be a waiting line at the spot (gate, etc.) where authentication information is acquired. If a worker at such a spot where authentication information is acquired takes action (such as confirmation work or requesting the worker to leave) on a first authenticated person who has failed authentication, processing at that spot is temporarily halted, resulting in poor throughput. The information processing device 10, which can avoid taking action on the first authenticated person at such a spot (gate, etc.) where authentication information is acquired, can improve the throughput problem in a technology that controls entry to a permitted area through authentication processing.

[0016] Incidentally, in the case of an information processing device 10 that acquires a second traffic area image photographed from a second traffic area, a method of detecting a person's face within the second traffic area image and performing facial authentication of the person to be authenticated based on the detected face can also be considered.

[0017] However, in this case, the authentication method is limited to facial authentication, and other methods such as fingerprint authentication, IC (Integrated Circuit) card authentication, etc. cannot be used. Furthermore, the second traffic area image is a so-called surveillance camera image, and if facial authentication is performed using an image of the person to be authenticated that happens to appear in the surveillance camera image, the orientation and size of the person's face may not be optimal, which may result in poor authentication accuracy.

[0018] In response to this, the information processing device 10 acquires authentication information separately from the surveillance camera image and performs authentication based on the authentication information. The information processing device 10 then identifies the first person to be authenticated who failed authentication in the surveillance camera image. This information processing device 10 can solve the problems of the limitations of the above authentication method and the problem of authentication accuracy.

[0019] <<Second Embodiment>> <Overview> An information processing apparatus 10 according to a second embodiment is a specific implementation of the configuration of the information processing apparatus 10 according to the first embodiment. A detailed description will be given below.

[0020] <Hardware Configuration> First, an example of the hardware configuration of the information processing device 10 will be described. Each functional unit of the information processing device 10 is realized by any combination of hardware and software. Those skilled in the art will understand that there are various variations in the realization method and device. The software includes programs that are pre-stored in the device before shipping, and programs downloaded from recording media such as CDs (Compact Discs) or servers on the Internet.

[0021] FIG. 3 is a block diagram illustrating an example of the hardware configuration of an information processing device 10. As shown in FIG. 3, the information processing device 10 has a processor 1A, a memory 2A, an input / output interface 3A, a peripheral circuit 4A, and a bus 5A. The peripheral circuit 4A includes various modules. The information processing device 10 does not necessarily have to have the peripheral circuit 4A. Note that the information processing device 10 may be composed of multiple devices that are physically and / or logically separated. In this case, each of the multiple devices may have the above hardware configuration.

[0022] The bus 5A is a data transmission path for the processor 1A, memory 2A, peripheral circuit 4A, and input / output interface 3A to mutually transmit and receive data. The processor 1A is, for example, a processing unit such as a CPU or a graphics processing unit (GPU). The memory 2A is, for example, a random access memory (RAM) or a read-only memory (ROM). The input / output interface 3A includes interfaces for acquiring information from input devices, external devices, external servers, external sensors, cameras, etc., and interfaces for outputting information to output devices, external devices, external servers, etc. The input / output interface 3A also includes an interface for connecting to a communication network such as the Internet. Examples of input devices include a keyboard, mouse, microphone, physical buttons, touch panel, etc. Examples of output devices include a display, speaker, printer, mailer, etc. The processor 1A can issue commands to each module and perform calculations based on the results of those calculations.

[0023] <Use Situation> Next, an example of a use situation of the information processing device 10 will be described with reference to Fig. 4. Note that the configuration described here is merely an example, and the information processing device 10 is not limited to this configuration.

[0024] In the example of FIG. 4, the first traffic area A １ and the second traffic area A ２ The person to be authenticated P who wishes to enter the permitted area is １ is the first traffic area A １ After passing through the second traffic area A ２ In the example shown in the figure, the first traffic area A １ and the second traffic area A ２ The first traffic area A is adjacent to the first traffic area B. １ and the second traffic area A ２ There may be other areas between.

[0025] The "permitted area" is the area where the authenticated person P ２ The permitted area includes, but is not limited to, inside a building, a portion of a building, inside a facility, a portion of a facility, or a partitioned outdoor area.

[0026] "First Traffic Area A １ " is the name of the authenticated person P who wishes to enter the permitted area. １ The first traffic area A is an area for acquiring authentication information from the １ is an area through which a person passes before entering the permitted area. １ is the second traffic area A ２ This is the area you pass through before passing through the

[0027] First traffic area A １ At least one passing spot is provided in the authorized area. １ passes through one of the passing spots. At this passing spot, the person to be authenticated P １ The number of passing spots is not particularly limited.

[0028] In the example of FIG. 4, three lanes L are provided as passing spots. １ passes through one of the three lanes L and enters the second traffic area A ２ Enter.

[0029] In the example of FIG. 4, a camera C １ This camera C is installed. １ is the person to be authenticated P １ This external image serves as authentication information.

[0030] Camera C １ is the person to be authenticated P １ A facial image of the camera C may be generated, or a full-body image may be generated. １ The camera C may generate still images or moving images. １ The camera C may detect visible light and create an image, or may detect other electromagnetic waves and create an image. １ The camera C is communicably connected to an information processing device 10 (not shown). １ transmits the generated image to the information processing device 10 in real time processing.

[0031] For example, the authenticatee P １ is Camera C １ The person to be authenticated P may stop in front of the camera and take a photo. １ When the shooting is completed, the robot passes through the passing spot and moves to the second area A. ２ Regardless of the result of authentication based on the authentication information acquired at the passing spot, the person to be authenticated P １ When the shooting is completed, the robot passes through the passing spot and moves to the second area A. ２ You can enter.

[0032] In this example, camera C １ is Camera C １ The person to be authenticated P is standing in front of １ A photograph of multiple persons to be authenticated P １ At the same time, camera C １ However, in order to improve the accuracy of authentication, it is possible to have each person stand in front of the camera C １In this example, for example, the person to be authenticated P １ The user can take a photo by following the instructions displayed on the screen while checking their face and whole body on the screen (viewfinder). Taking such an image for authentication can be achieved using any well-known technology.

[0033] As another example, the authenticatee P １ is Camera C １ Pass through the passing spot (lane L) without stopping in front of the second area A ２ Regardless of the result of authentication based on the authentication information acquired at the passing spot, the person to be authenticated P １ passes through the passing spot and enters the second area A ２ You can enter.

[0034] In this example, camera C １ is Camera C １ The person to be authenticated P passes in front of １ That is, the person to be authenticated P is photographed in a so-called walk-through manner. １ A photograph of multiple persons to be authenticated P １ At the same time, camera C １ However, in order to improve the accuracy of authentication, it is possible to have cameras C for each person. １ It is preferable that the user passes in front of the authentication device and is photographed. Such a walk-through type of photographing for authentication can be realized by using any well-known technology.

[0035] As a modification of the configuration of the passing spot, as shown in FIG. １ In addition, a device D may be installed at the passing spot.

[0036] Device D is camera C １ The authenticatee P generated by １ Information different from the external appearance image is acquired as authentication information.

[0037] Certifier P １In the example of FIG. 4, in which an appearance image is acquired as authentication information, face information, iris information, physique information, gait information, and the like that can be acquired from the appearance image can be used for authentication.

[0038] In the example of FIG. 5 , device D can acquire other information as authentication information. For example, device D may be a device (sensor, microphone, etc.) that acquires biometric information such as a fingerprint, voiceprint, ear pinna, or palm shape. Device D may also be a reader / writer that communicates with an IC card. Device D may also be an input device that accepts input of a user ID (identifier) ​​and a password. Examples of input devices include, but are not limited to, a touch panel, physical buttons, a keyboard, a mouse, a microphone, etc. Device D may also be a code reader that reads a code (one-dimensional code, two-dimensional code, etc.). Note that the example here is merely an example, and device D can acquire any authentication information using any widely known technology.

[0039] In the modified example of FIG. 5, the person to be authenticated P １ The person stops at the passing spot and inputs the authentication information via the device D. At that time, the camera C １ is the person to be authenticated P １ This appearance image is not for authentication purposes, but for the first person P who has failed authentication in the second traffic area image. ３ is used to identify the

[0040] When the input of the authentication information via the device D is completed, the person to be authenticated P １ passes through the passing spot and enters the second area A ２ Regardless of the result of authentication based on the authentication information acquired at the passing spot, the person to be authenticated P １ After completing the input of authentication information via device D, the user passes through the passing spot and enters the second area A. ２ You can enter.

[0041] The device D is communicably connected to an information processing device 10 (not shown). The device D transmits the acquired authentication information to the information processing device 10 in real time.

[0042] "Second Traffic Area A２ " is the first person P who failed in authentication. ３ Regardless of the authentication result, this area is used to identify all the authenticated persons P １ is the first traffic area A １ Passing through the second traffic area A ２ Then, the first person to be authenticated P who failed the authentication can enter ３ is the second traffic area A ２ Identified within.

[0043] Second Traffic Area A ２ The second traffic area A may be a part of the permitted area or may be a different area from the permitted area. ２ If the area is different from the permitted area, for example, the second traffic area A ２ Further ahead there is a permitted area.

[0044] As mentioned above, regardless of the authentication result, all the authenticatees P １ is the first traffic area A １ Passing through the second traffic area A ２ You can enter the second traffic area A. ２ If P is part of the authorized area, the first authenticated person P ３ This configuration allows, for example, a first person to be authenticated P who has failed authentication to enter the permitted area. ３ This configuration may also be used in cases where a first person P who has failed authentication is allowed to enter the authorized area temporarily but is not allowed to stay there for a long time. ３ Some areas of the permitted area (second traffic area A ２ It may also be used in cases where a person is permitted to enter one area but is not permitted to enter other areas.

[0045] Second Traffic Area A ２ Camera C ２ Camera C is installed. ２ is the second traffic area A ２ Camera C ２ is a so-called surveillance camera, and the second traffic area A ２ Continue to shoot. Camera C２ The number of is not limited to two as shown in FIGS.

[0046] Camera C ２ The camera C may generate still images or moving images. ２ The camera C may detect visible light and create an image, or may detect other electromagnetic waves and create an image. ２ The camera C is communicably connected to an information processing device 10 (not shown). ２ transmits the generated image to the information processing device 10 in real time processing.

[0047] Also, Camera C ２ 4 and 5, may be fixed in a predetermined position, or may be installed in the second traffic area A (not shown). ２ The camera C may be installed on a moving object that moves within the ２ and the second traffic area A ２ Camera C installed on a moving object moving within ２ The mobile object may be an autonomous mobile robot or a robot that moves under the remote control of an operator. The mobile object may move on land (on the floor), in the air, or along walls or ceilings.

[0048] <Functional Configuration> Next, a detailed description will be given of the functional configuration of the information processing device 10. Fig. 1 shows an example of a functional block diagram of the information processing device 10. As shown in the figure, the information processing device 10 has a first acquisition unit 11, an authentication unit 12, a second acquisition unit 13, and an identification unit 14.

[0049] The first acquisition unit 11 acquires the first traffic area A １ In this case, the person to be authenticated P １ Specifically, the first acquisition unit 11 acquires authentication information for the first traffic area A. １ The authentication information acquired by the device installed in the first traffic area A is acquired. １ The device installed in the example of FIG. １ 5. The first acquisition unit 11 acquires the first traffic area A １The authentication information acquired by the device installed in the can be acquired in real time processing.

[0050] The authentication information is １ The external image acquired as the authentication information may be an external image of the person to be authenticated P. １ Alternatively, the external appearance image may be an image of the face of the person to be authenticated P. １ Alternatively, the external image may be an image of the iris of the person to be authenticated P. １ The image may be a whole-body image.

[0051] Alternatively, the authentication information may be other biometric information that can be used for biometric authentication, such as fingerprint information, voiceprint information, ear information, and hand shape information, but is not limited to these.

[0052] Alternatively, the authentication information may be character string information (user identification information, password, passcode, etc.) consisting of an arrangement of numbers, letters, and symbols.

[0053] The first acquisition unit 11 acquires, for example, a first traffic area A as shown in FIG. １ Camera C installed at the passing spot (lane L) １ The authenticatee P generated by １ An external image of the device may be acquired as authentication information.

[0054] In addition, the first acquisition unit 11 acquires the first traffic area A as shown in FIG. １ In this example, the first acquisition unit 11 may acquire authentication information acquired by the device D installed in the passing spot (lane L) of the first passage area A. １ Camera C installed at the passing spot １ The authenticatee P generated by １ In this example, an external image of the person to be authenticated P １ The appearance image of the first person to be authenticated P who failed authentication in the second traffic area image is not for authentication purposes. ３ In this example, the authentication subject P １ The appearance image of the person to be authenticated P １or an image of the face of the person to be authenticated P １ This is a full-body image of the animal.

[0055] The first acquisition unit 11 acquires the authentication subject P １ An image of each person, or an image of the person to be authenticated P １ The information entered by each person can be acquired as authentication information. By using such authentication information for authentication, the accuracy of authentication is improved.

[0056] The authentication unit 12 performs authentication based on the authentication information acquired by the first acquisition unit 11 .

[0057] The authentication can be realized by using any of the widely known techniques. For example, １ Each piece of authentication information is stored in a storage device. The storage device may be provided within the information processing device 10, or may be provided in an external device communicatively connected to the information processing device 10. The authentication unit 12 then compares the authentication information acquired by the first acquisition unit 11 with authentication information previously stored in the storage device. If authentication information that matches the authentication information acquired by the first acquisition unit 11 is stored in the storage device, the authentication unit 12 determines that the authentication is successful. On the other hand, if authentication information that matches the authentication information acquired by the first acquisition unit 11 is not stored in the storage device, the authentication unit 12 determines that the authentication is unsuccessful. The criteria for determining a "match" can be set using any widely known technology.

[0058] The second acquisition unit 13 acquires the first traffic area A １ The second traffic area A that will be passed through after ２ A second traffic area image is acquired by capturing the above.

[0059] The second acquisition unit 13 is fixed at a predetermined position and acquires the second traffic area A ２ Camera C takes a picture of ２ In addition, the second acquisition unit 13 may acquire the second traffic area image generated by the second traffic area A. ２ Camera C installed on a moving object moving within ２ Alternatively, the second acquisition unit 13 may be fixed at a predetermined position and acquire the second traffic area image generated by the second traffic area A.２ Camera C takes a picture of ２ and the second traffic area image generated by ２ Camera C installed on a moving object moving within ２ The second acquisition unit 13 may acquire both the second traffic area image generated by the camera C and the second traffic area image generated by the camera C. ２ The generated second traffic area image can be acquired through real-time processing.

[0060] The identification unit 14 identifies the authenticated person P １ The first person to be authenticated P who failed to be authenticated by the authentication unit 12 in ３ Based on the appearance of the first person to be authenticated, the first person to be authenticated P is identified in the second traffic area image. ３ The identification unit 14 identifies the first authentication subject P acquired by the first acquisition unit 11. ３ The identification can be achieved based on an external image of the object. The identification can be achieved using any well-known technology.

[0061] For example, the identifying unit 14 identifies the first authentication subject P acquired by the first acquiring unit 11. ３ From the appearance image of the first person to be authenticated, ３ The feature quantities are exemplified by, but not limited to, facial feature quantities, physique feature quantities, gait feature quantities, possession feature quantities, clothing feature quantities, hairstyle feature quantities, age group, gender, nationality, etc. Furthermore, the identification unit 14 detects people within the second traffic area image. Next, the identification unit 14 extracts feature quantities of the appearance of the people detected within the second traffic area image. Then, the identification unit 14 identifies the first authentication subject P from among the people detected within the second traffic area image. ３ By searching for a person whose similarity to the feature amount of the appearance of the first person to be authenticated P is equal to or greater than a threshold, the first person to be authenticated P is identified in the second traffic area image. ３ The process illustrated here is merely an example, and the first person to be authenticated P is identified in the second traffic area image. ３ The process of identifying the target is not limited to this.

[0062] After the identification, the identification unit 14 identifies the first authentication subject P ３can be tracked in the second traffic area image (moving image). The tracking can be realized by using any well-known technology.

[0063] The identification unit 14 identifies the first person P to be authenticated in the second traffic area image. ３ Once the problem is identified, the result can be notified to the worker.

[0064] For example, the identification unit 14 may transmit the first notification information to a terminal for a worker. The terminal for a worker may be a mobile terminal or a stationary terminal installed in an office, etc. Transmission of the first notification information to a predetermined terminal can be realized using any widely known technology.

[0065] The first notification information is a first authentication subject P identified in the second traffic area image. ３ The information may include information indicating the location of the

[0066] For example, the second traffic area A ２ A plurality of cameras C are positioned at predetermined positions within ２ is installed and the second traffic area image is generated, the identification unit 14 ３ The camera C that generated the second traffic area image in which ２ Then, the identification unit 14 identifies the identification information of the identified camera C. ２ Identification information of the identified camera C ２ The installation location of the identified camera C ２ The first notification information can include the photographing area of ​​the camera C. ２ The installation location and camera C ２ The shooting area is set in advance by camera C ２ The information processing device 10 stores the ID information of the user ID and the password associated with the user ID.

[0067] Other cameras installed on moving objects ２ The first person to be authenticated P is identified in the second traffic area image generated by ３ is detected, the identification unit 14 ３ The camera C when the second traffic area image was generated ２ For example, the position of the camera C２ At least one of the first and second mobile objects has a function of acquiring and recording current location information. The current location information may be included in the metadata of the second traffic area image. The current location information may also include a timestamp. The identification unit 14 identifies the first authentication-subject P based on this information. ３ The camera C when the second traffic area image was generated ２ Then, the identifying unit 14 identifies the position of the identified camera C ２ The location of the first notification information can be included in the first notification information.

[0068] In addition, the first notification information is ３ In addition, in the second traffic area image included in the first notification information, the first authentication subject P ３ There are various ways to highlight the first authenticated person P. ３ A frame surrounding the above may be displayed on the second traffic area image.

[0069] Next, an example of the processing flow of the information processing device 10 will be described using the flowcharts of Figures 6 and 7. Note that the following processing flow is merely an example, and the processing flow of the information processing device 10 is not limited to this.

[0070] First, the process of Fig. 6 will be described. １ In this case, the person to be authenticated P １ Next, the information processing device 10 acquires the authentication information of the authenticatee P based on the authentication information acquired in S20. １ The person to be authenticated P is authenticated (S21). １ Regardless of the authentication result, １ Passing through the second traffic area A ２ You can enter.

[0071] If the authentication fails (No in S22), the information processing device 10 ３The information (recognition result, appearance information, etc.) is registered in the tracking target list (S23). If the authentication is successful (Yes in S22), the information processing device 10 does not execute S23.

[0072] Thereafter, if there is no instruction to end the process (No in S24), the process returns to S20 and the same process is repeated.

[0073] Next, the processing of Fig. 7 will be described. The information processing device 10 adds the first authentication subject P ３ If the information is registered (Yes in S30), the information processing device 10 acquires the second traffic area image as a processing target (S31). In S31, the information processing device 10 can acquire the latest second traffic area image.

[0074] Then, the information processing device 10 detects the first person P registered in the tracking target list within the acquired second traffic area image. ３ is searched for (S32).

[0075] The first person to be authenticated P is identified in the second traffic area image. ３ If the second traffic area image cannot be identified (No in S33), the information processing device 10 returns to S31, acquires a new second traffic area image as a processing target, and repeats the same processing.

[0076] On the other hand, in the second traffic area image, the first person to be authenticated P ３ If the first authentication subject P can be identified (Yes in S33), the information processing device 10 ３ The information processing device 10 outputs information indicating the position of the object (S34). For example, the information processing device 10 may transmit the first notification information to a terminal for the worker. The first notification information has been described above, so a description thereof will be omitted here.

[0077] Thereafter, if there is no instruction to end the process (No in S35), the process returns to S30 and the same process is repeated.

[0078] In addition, if a plurality of first authenticatees P are included in the tracking target list, ３ When the information of the first authentication subjects P is registered, the information processing device 10 ３ The process of searching for these can be performed in parallel at the same time.

[0079] <Effects> According to the information processing device 10 of the second embodiment, the same effects as those of the information processing device 10 of the first embodiment are achieved.

[0080] Furthermore, the information processing device 10 of the second embodiment is configured to identify the first person P identified in the second traffic area image. ３ Based on the notification, the worker can then determine the location of the first person to be authenticated P. ３ The worker can then determine the location of the first person to be authenticated P and head to that location. ３ This allows them to be caught and take appropriate action, such as checking the situation or asking them to leave.

[0081] In the example configuration of FIG. 4, camera C １ The generated appearance image is used as "information for authentication" and "information for identifying the first person to be authenticated P in the second traffic area image." ３ In this way, the information processing device 10, which can use one piece of information for multiple purposes, can make effective use of data and reduce waste of resources and devices.

[0082] Furthermore, the information processing device 10 １ An image of each person, or an image of the person to be authenticated P １ The information entered by each person can be acquired as authentication information. By using such authentication information for authentication, the accuracy of authentication is improved.

[0083] Third Embodiment The information processing device 10 detects a first person to be authenticated P in a second traffic area image by a predetermined time limit. ３ If the system is unable to identify the cause of the problem, it notifies the worker accordingly. This will be explained in detail below.

[0084] The identification unit 14 identifies the first person to be authenticated P in the second traffic area image by a predetermined time limit. ３ If the operator is unable to identify the cause, the operator will be notified accordingly.

[0085] The "predetermined time limit" is a time after a predetermined time has elapsed from a predetermined count start timing.

[0086] The "count start timing" is, for example, the first authentication subject P３ The timing at which the authentication information of the first person P is acquired in the first passage area is also set. ３ The timing may be the timing when the vehicle passes through a passing spot (e.g., lane L in FIGS. 4 and 5). １ The counting start timing is not limited to the example given here, and other timings similar to the example given here may be used.

[0087] The "predetermined time" is the time from the start of the predetermined counting period to the second traffic area A. ２ This can be determined in advance based on the estimated time required to reach the destination.

[0088] The identification unit 14 identifies the first person P to be authenticated in the second traffic area image. ３ If the predetermined time limit has passed without the first person to be authenticated P being identified within the second traffic area image, the identification unit 14 can monitor the arrival of the predetermined time limit while searching for the first person to be authenticated P. ３ The operator is notified that the problem cannot be identified.

[0089] The identification unit 14 identifies a plurality of first authentication subjects P in the second traffic area image. ３ While performing the process of searching for the first authenticated person P ３ The predetermined time limit can be monitored for each authentication target P. ３ may vary from one

[0090] The identification unit 14 identifies the first person to be authenticated P in the second traffic area image by a predetermined time limit. ３ If the worker cannot identify the worker's terminal, the second notification information can be transmitted to the worker's terminal. The worker's terminal may be a mobile terminal or a stationary terminal installed in an office or the like. Transmission of the second notification information to the specified terminal can be realized by using any well-known technology.

[0091] The second notification information is a notification of the first person P who could not be identified in the second traffic area image by a predetermined time limit. ３ Contains information about.

[0092] The second notification information is ３ The appearance information may include an appearance image of the first traffic area A. １ In camera C １ The first authenticatee P generated by ３ Based on such second notification information, the worker can identify the first person to be authenticated P who could not be identified in the second traffic area image by the predetermined time limit. ３ You can search for.

[0093] In addition, the second notification information is ３ The first person to be authenticated P is estimated from the appearance image of ３ The attribute information may include, but is not limited to, age group, sex, nationality, physique, gait, belongings, clothing, hairstyle, etc. The identification unit 14 may have a function to estimate and generate such attribute information from the appearance image. This function can be realized by using any well-known technology. Based on such second notification information, the worker can identify the first authenticated person P who could not be identified in the second traffic area image by the predetermined deadline. ３ You can search for.

[0094] In addition, the second notification information is ３ is the first traffic area A １ The second notification information may indicate the time when the first authenticated person P passed through the passing spot (e.g., lane L in FIGS. 4 and 5 ) or the elapsed time since that time. Based on such second notification information, the worker can identify the first authenticated person P who could not be identified in the second traffic area image by the predetermined time limit. ３ The current position of the

[0095] In addition, the second notification information is ３ Such second notification information may indicate information identifying the passing spot (e.g., lane L in FIGS. 4 and 5) through which the vehicle has passed. １ This can be used when a plurality of passing spots are provided in the camera C. １ Alternatively, the first authenticatee P is authenticated by the device D.３ By identifying whether the authentication information of the first authenticated person P has been acquired, ３ Based on such second notification information, the worker can identify the passing spots through which the first authenticated person P has passed. ３ The current position of the

[0096] In addition, the second notification information is ３ The passing spot (e.g., lane L in FIGS. 4 and 5) that the first authenticated person P has passed through is designated as ３ Other authenticated persons P who passed before or after １ It may also include information about:

[0097] "Other certified persons P １ "Information about other certified persons P １ The image includes the appearance of the object and the attribute information described above.

[0098] "Other certified persons P １ " is the first authenticatee P ３ The person to be authenticated P who passed just before １ and the first authenticated person P ３ The person to be authenticated P passed immediately after １ In addition, other authentication subjects P １ is the first authenticatee P ３ The person to be authenticated P who passed just before １ From the first authenticatee P ３ The Nth person to be authenticated, P １ In addition, other authentication subjects P １ is the first authenticatee P ３ The person to be authenticated P passed immediately after １ From the first authenticatee P ３ The person P who passed after M people １ N and M are integers of 2 or more.

[0099] First authenticatee P ３ The passing spot (e.g., lane L in FIGS. 4 and 5) that the first authenticated person P has passed through is designated as ３ Other authenticated persons P who passed before or after １is the second traffic area A ２ In the first authentication subject P ３ It is likely to be near

[0100] Also, the first authenticatee P ３ The passing spot (e.g., lane L in FIGS. 4 and 5) that the first authenticated person P has passed through is designated as ３ Other authenticated persons P who passed before or after １ is the first authenticatee P ３ In this case, the person in the second traffic area A ２ Other authenticated persons P １ is the first authenticatee P ３ This increases the chances of you being close to them.

[0101] The worker can identify such other authenticated persons P １ The first person to be authenticated P who could not be identified in the second traffic area image by the predetermined time limit is identified by using the information about the first person to be authenticated P. ３ You can search for.

[0102] Next, an example of the processing flow of the information processing device 10 will be described using the flowcharts of Figures 6 and 8. Note that the following processing flow is merely an example, and the processing flow of the information processing device 10 is not limited to this.

[0103] First, the process of Fig. 6 will be described. In the third embodiment, the process when authentication fails (No in S22) differs from the process described in the second embodiment.

[0104] If the authentication fails (No in S22), the information processing device 10 ３ In addition to the recognition result and appearance information, the timing at which counting starts is registered as information of the first person to be authenticated P (S23). ３ The count start timing is registered for each time. The other processes are the same as those described in the second embodiment.

[0105] Next, the flow of the process in Fig. 8 will be described. The information processing device 10 adds the first authentication subject P ３If the information is registered (Yes in S40), the information processing device 10 acquires the second traffic area image as a processing target (S41). In S41, the information processing device 10 can acquire the latest second traffic area image.

[0106] Then, the information processing device 10 detects the first person P registered in the tracking target list within the acquired second traffic area image. ３ is searched for (S42).

[0107] The first person to be authenticated P is identified in the second traffic area image. ３ If the time cannot be identified (No in S43), the information processing device 10 determines whether a predetermined time limit has passed (S45). Specifically, the information processing device 10 determines whether the elapsed time from the count start timing has exceeded a threshold.

[0108] If the predetermined time limit has not passed (No in S45), the information processing device 10 returns to S41, acquires a new second traffic area image as a processing target, and repeats the same processing.

[0109] On the other hand, if the predetermined time limit has passed (Yes in S45), the information processing device 10 determines whether the first person to be authenticated P has been identified within the second traffic area image by the predetermined time limit. ３ The information processing device 10 notifies the worker that the user cannot identify the location (S46). For example, the information processing device 10 may transmit second notification information to the worker's terminal. The second notification information has been described above, so a description thereof will be omitted here.

[0110] In addition, the first person to be authenticated P is identified in the second traffic area image. ３ If the first authentication subject P can be identified (Yes in S43), the information processing device 10 ３ The information processing device 10 outputs information indicating the position of the object (S44). For example, the information processing device 10 may transmit the first notification information to a terminal for the worker. The first notification information has been described above, so a description thereof will be omitted here.

[0111] Thereafter, if there is no instruction to end the process (No in S47), the process returns to S40 and the same process is repeated.

[0112] In addition, if a plurality of first authenticatees P are included in the tracking target list, ３When the information of the first authentication subjects P is registered, the information processing device 10 ３ The process of searching for these can be performed in parallel at the same time.

[0113] Other configurations of the information processing apparatus 10 of the third embodiment are similar to those of the information processing apparatus 10 of the first and second embodiments.

[0114] According to the information processing device 10 of the third embodiment, the same effects as those of the information processing device 10 of the first and second embodiments are realized.

[0115] Furthermore, the information processing device 10 of the third embodiment detects the first person to be authenticated P in the second traffic area image by a predetermined time limit. ３ If the first person to be authenticated P cannot be identified, the worker can be notified of this. ３ By notifying the worker at an appropriate time, the first person to be authenticated P can be found by himself / herself. ３ is the second traffic area A ２ As a result, the first person to be authenticated P ３ This can reduce the inconvenience of losing track of the target.

[0116] Furthermore, the information processing device 10 can notify the worker of the second notification information. The worker can use the second notification information to ３ can be efficiently searched for.

[0117] <<Fourth embodiment>> The information processing device 10 is a first authentication subject P ３ By searching the second traffic area image for a person whose appearance similarity to the first person P is equal to or greater than a threshold, the first person P is identified. ３ Then, the first person to be authenticated P is identified in the second traffic area image by a predetermined time limit. ３ If the first person to be authenticated P cannot be identified, the information processing device 10 performs the search by lowering the threshold value, thereby identifying the first person to be authenticated P in the second traffic area image. ３ This will be explained in detail below.

[0118] The identification unit 14 detects a person in the second traffic area image. Next, the identification unit 14 detects the first authentication subject P acquired by the first acquisition unit 11. ３ Based on the appearance image of the first person to be authenticated, ３ The degree of similarity in appearance between the "person detected in the first traffic area image" and the "person detected in the second traffic area image" is calculated. The calculation of the degree of similarity can be realized using any well-known technology.

[0119] The identification unit 14 identifies the first authentication subject P ３ A person whose appearance similarity with the first person P is equal to or greater than a first threshold value is searched for in the second traffic area image. ３ The identification unit 14 then identifies the position of the identified person in the second traffic area image. ３ The worker can be notified of this information as the location of the object.

[0120] The identification unit 14 identifies the first person P to be authenticated in the second traffic area image by the above method within a predetermined time limit. ３ If the threshold value of the similarity cannot be determined, the threshold value of the similarity is reduced from the first threshold value to a second threshold value, the first threshold value being higher than the second threshold value.

[0121] That is, the identification unit 14 identifies the first person to be authenticated P in the second traffic area image by the above method within a predetermined time limit. ３ If the first authentication subject P ３ A person whose appearance similarity with the first person P is equal to or greater than a second threshold value is searched for in the second traffic area image. ３ The identification unit 14 then identifies the position of the identified person in the second traffic area image. ３ The worker can be notified of this information as the location of the object.

[0122] The predetermined time limit is as explained in the third embodiment.

[0123] The first threshold value and the second threshold value are determined in advance and stored in the information processing device 10 .

[0124] An example of the processing flow of the information processing device 10 is shown in the flowcharts of Figures 6 and 9. Note that this processing flow is merely an example, and the processing flow of the information processing device 10 is not limited to this.

[0125] The processing flow in FIG. 6 is the same as that in the third embodiment.

[0126] Next, the flow of the process in Fig. 9 will be described. The information processing device 10 adds the first authentication subject P ３ If the information is registered (Yes in S50), the information processing device 10 acquires the second traffic area image as a processing target (S51). In S51, the information processing device 10 can acquire the latest second traffic area image.

[0127] Then, the information processing device 10 detects the first person P registered in the tracking target list within the acquired second traffic area image. ３ Specifically, the information processing device 10 searches for the first authentication subject P ３ A person whose appearance similarity to the first person is equal to or greater than a first threshold is searched for in the second traffic area image.

[0128] The first person to be authenticated P is identified in the second traffic area image. ３ If the time cannot be identified (No in S53), the information processing device 10 determines whether a predetermined time limit has passed (S55). Specifically, the information processing device 10 determines whether the elapsed time from the count start timing has exceeded a threshold.

[0129] If the predetermined time limit has not passed (No in S55), the information processing device 10 returns to S51, acquires a new second traffic area image as a processing target, and repeats the same processing.

[0130] On the other hand, if the predetermined time limit has passed (Yes in S55), the information processing device 10 ３ The second traffic area image is searched for people whose appearance similarity to the first person is equal to or greater than a second threshold (S56). The second threshold is lower than the first threshold.

[0131] The first person to be authenticated P is identified in the second traffic area image. ３If the search cannot be identified (No in S57), the information processing apparatus 10 determines whether the search deadline has passed (S58). The search deadline is, for example, a predetermined time after the start of the search using the second threshold.

[0132] If the search deadline has not passed (No in S58), the information processing device 10 acquires a new second traffic area image as a processing target (S59). In S59, the information processing device 10 can acquire the latest second traffic area image. Then, the information processing device 10 acquires the latest second traffic area image of the first authenticated user P ３ The second traffic area image is searched for people whose appearance similarity to the first person is equal to or greater than a second threshold (S60).Then, the process returns to S57 and the same process is repeated.

[0133] On the other hand, if the search deadline has passed (Yes in S58), the first person to be authenticated P is not found in the second traffic area image within the search deadline. ３ The information processing device 10 notifies the worker that the user cannot identify the location of the object (S61). For example, the information processing device 10 may transmit second notification information to the worker's terminal. The second notification information has been described in the third embodiment, and therefore will not be described here.

[0134] In addition, the first person to be authenticated P is identified in the second traffic area image. ３ If the first authentication subject P can be identified (Yes in S53, Yes in S57), the information processing device 10 ３ The information processing device 10 outputs information indicating the position of the object (S54). For example, the information processing device 10 may transmit the first notification information to a terminal for the worker. The first notification information has been described in the second embodiment, and therefore will not be described here.

[0135] Thereafter, if there is no instruction to end the process (No in S62), the process returns to S50 and the same process is repeated.

[0136] In addition, if a plurality of first authenticatees P are included in the tracking target list, ３ When the information of the first authentication subjects P is registered, the information processing device 10 ３ The process of searching for these can be performed in parallel at the same time.

[0137] Other configurations of the information processing apparatus 10 of the fourth embodiment are similar to those of the information processing apparatus 10 of the first to third embodiments.

[0138] According to the information processing device 10 of the fourth embodiment, the same effects as those of the information processing devices 10 of the first to third embodiments are realized.

[0139] Furthermore, the information processing device 10 of the fourth embodiment detects the first person to be authenticated P in the second traffic area image by a predetermined time limit. ３ If the first person to be authenticated P cannot be identified, the threshold value of the similarity is lowered, and the first person to be authenticated P ３ By lowering the threshold value of the similarity and performing a search, it is possible to search for the first authentication subject P ３ This can reduce missed detections.

[0140] If the threshold value of the similarity is lowered, the first person to be authenticated P ３ As a result, the accuracy of identifying the first authenticated person P ３ A person similar to the first authenticated person P ３ However, as described in the first embodiment, the worker may identify the first person to be authenticated P identified in the second traffic area image. ３ Finally, the worker will be able to determine whether the person identified in the second traffic area image is really the first person to be authenticated P. ３ Since it is possible to determine whether the first person to be authenticated P is a person to be authenticated in the second traffic area image, a slight decrease in accuracy is not a problem. ３ The problem is that the threshold value of the similarity is lowered in the fourth embodiment, taking such a balance into consideration.

[0141] A modification of the fourth embodiment will now be described.

[0142] In the processing example of FIG. 9, the information processing device 10 (identification unit 14) searches for the first authentication-subject P in the latest second traffic area image by the search deadline. ３ If a person whose appearance similarity to the first person is equal to or greater than the second threshold cannot be identified (Yes in S58), the worker is notified of this (S61).

[0143] In a modified example, the identification unit 14 may search for the first person P to be authenticated in the latest second traffic area image by the search deadline. ３ If a person whose appearance similarity to the first person is equal to or greater than the second threshold cannot be identified (Yes in S58), the next process may be performed.

[0144] That is, the identification unit 14 identifies the first person P ３ Alternatively, a person whose appearance has a similarity to the person of interest equal to or greater than a second threshold may be identified.

[0145] The "second past traffic area image" is a first authentication subject P based on a first threshold. ３ and then searches for the first authenticated person P based on the second threshold. ３ This is a second traffic area image in which the search is not performed.

[0146] Then, the identification unit 14 identifies the first person P to be authenticated in the past second traffic area image. ３ When the first authentication subject P is identified, ３ The identification unit 14 can notify the worker of at least one of the movement direction and movement trajectory of the identified first authentication-subject P. ３ By tracking the first person P in the second traffic area image (moving image), the first person P is identified. ３ At least one of the direction of movement and the trajectory of movement can be identified.

[0147] According to this modification, the worker can identify the first person to be authenticated P based on the content of the notification. ３ The current position of the

[0148] <<Fifth embodiment>> The information processing device 10 detects a first person P to be authenticated in a second traffic area image. ３ This will be explained in detail below.

[0149] As shown in FIGS. 4 and 5, the first traffic area A １ has a plurality of passing spots (three lanes L in the illustrated example). １ passes through one of the passing spots.

[0150] The identification unit 14 identifies the first authentication subject P ３ The identification unit 14 identifies the passing spot through which the camera C passed. １ Alternatively, the first authenticatee P is authenticated by the device D. ３ By identifying whether the authentication information of the first authenticated person P has been acquired, ３ It is possible to identify the passing spot through which the

[0151] Then, the identification unit 14 identifies the first authentication subject P ３ Based on the result of identifying the passing spot that the first person to be authenticated P has passed through, ３ In the second traffic area image, the identifying unit 14 can perform the following first or second process.

[0152] "First process" For example, multiple cameras C ２ When a plurality of second traffic area images are generated at the same time by ３ The identification unit 14 then processes the second traffic area images in the determined order of priority to identify the first person P. ３ in the second traffic area image. The identification unit 14 processes the second traffic area image having a higher priority first.

[0153] Priority is given to multiple cameras C ２ Each of them and the first authenticatee P ３ The identification unit 14 determines the priority of the second traffic area images in descending order of distance.

[0154] For example, as shown in FIGS. 4 and 5, the second traffic area A ２ Camera C takes a picture of ２ When a plurality of cameras are installed, a plurality of cameras C are installed in advance for each passing spot. ２ The priority of the cameras C may be set and registered in the information processing device 10. ２ The priority is determined by the installation location's proximity to each passing spot.

[0155] Then, the identification unit 14 identifies the first person to be authenticated P who has passed through the first passing spot. ３ In the case where the first passing spot is detected in the second passing area image, for example, based on the registered information as described above, ２ Then, the specification unit 14 specifies the priority of the cameras C. ２ The second traffic area image generated by the first person to be authenticated P is processed in the order of the specified priority, and the first person to be authenticated P is identified from the second traffic area image. ３ The identification unit 14 searches for the camera C with the highest priority. ２ The second traffic area image generated by is processed first.

[0156] Other, second traffic area A ２ Camera C installed on a moving object moving within ２ When the first person P generates the second traffic area image, the identification unit 14 identifies the photographing position of each second traffic area image and the ３ The identification unit 14 calculates the distance between the second traffic area image and the first passing spot through which the vehicle has passed. The identification unit 14 can then prioritize the second traffic area images in ascending order of the calculated distance. The photographing position of each second traffic area image can be identified using any well-known technology, such as a GPS (global positioning system).

[0157] "Second Process" The identification unit 14 compares the movement trajectory of the person detected in the second traffic area image with the first person P ３ Based on the positional relationship with the passing spot that the first person to be authenticated P has passed through, ３ can be identified in the second traffic area image.

[0158] The identification unit 14 can identify the movement trajectory of a person detected in the second traffic area image by tracking the person detected in the second traffic area image within the second traffic area image (moving image).

[0159] If a plurality of people are detected in the second traffic area image, the identification unit 14 identifies the first person to be authenticated P ３ First, a person moving from the passing spot where the first person to be authenticated P３ The similarity can be calculated and compared with a threshold value.

[0160] The determination of "from which passing spot the person detected in the second traffic area image has moved" can be realized by various methods. For example, a representative movement trajectory of a person who has passed through each passing spot may be registered in advance in the information processing device 10. Then, the identification unit 14 may calculate the similarity between the movement trajectory of the person detected in the second traffic area image and the representative movement trajectory of a person who has passed through each passing spot. Then, the identification unit 14 may determine that the person detected in the second traffic area image has moved from the passing spot with the highest similarity. The calculation of the similarity between the two movement trajectories can be realized by using any widely known technology.

[0161] Other configurations of the information processing apparatus 10 of the fifth embodiment are similar to those of the information processing apparatus 10 of the first to fourth embodiments.

[0162] According to the information processing device 10 of the fifth embodiment, the same effects as those of the information processing devices 10 of the first to fourth embodiments are realized.

[0163] Furthermore, the information processing apparatus 10 of the fifth embodiment is ３ The passing spot that the first person P has passed through is identified, and based on the result of the identification, the first person P is identified. ３ For example, the information processing device 10 can identify the location of the vehicle in the second traffic area image by using a plurality of cameras C ２ When the second traffic area image is generated in ３ Based on the result of identifying the passing spots that the first person P has passed through, the information processing device 10 can appropriately determine the processing order of the plurality of second traffic area images. ３ Based on the result of identifying the passing spots through which the person has passed, the processing order of the detected people can be appropriately determined.

[0164] By performing the process in the appropriate order, the first person to be authenticated P can be identified more quickly. ３ can be identified in the second traffic area image.

[0165] <<Sixth embodiment>> The information processing device 10 detects a first person P to be authenticated in a second traffic area image. ３ It also has other functions for efficiently identifying the following, which will be explained in detail below.

[0166] As shown in FIGS. 4 and 5, the first traffic area A １ has a plurality of passing spots (three lanes L in the illustrated example). １ passes through one of the passing spots.

[0167] The identification unit 14 identifies the first authentication subject P ３ The passing spot that the first person to be authenticated P passed through is ３ Other authenticated persons P who passed before or after １ Based on the information about the first authenticatee P ３ is identified in the second traffic area image.

[0168] "Other certified persons P １ "Information about" and "Other Certified Persons P １ " is as explained in the third embodiment.

[0169] As explained in the third embodiment, other authentication subjects P １ is the second traffic area A ２ In the first authentication subject P ３ There is a high possibility that other people to be authenticated P are nearby. １ is the first authenticatee P ３ In this case, the other person to be authenticated P １ is the second traffic area A ２ In the first authentication subject P ３ This increases the chances of you being close to them.

[0170] The identification unit 14 identifies other authentication subjects P １ Based on the information (appearance image, etc.) about the other person P to be authenticated in the second traffic area image, １ When a plurality of people are detected in the second traffic area image, the identification unit 14 identifies other persons to be authenticated P. １ (e.g., other persons to be certified P)１ ) within a predetermined distance from the first person to be authenticated P ３ The similarity between the image and the target image can be calculated and compared with a threshold. An example of this process will be described below, but the present invention is not limited to this process.

[0171] For example, when a plurality of people are detected in the second traffic area image, the identification unit 14 determines one of them as the processing target by any means. ３ and other certified persons P １ Based on the appearance image of the first person to be authenticated, ３ and other certified persons P １ This determination is realized, for example, by calculating the similarity of appearance as described above and comparing the similarity with a threshold value.

[0172] The person to be processed is the first person to be authenticated P ３ If it is determined that the first authentication subject P ３ The process of identifying the

[0173] On the other hand, if the person to be processed is the first person to be authenticated P ３ Other authenticated persons P １ If it is determined that the person is the person to be processed (other person to be authenticated P １ ) surroundings (e.g., other authenticated persons P １ The next person to be processed is determined from among those who are within a predetermined distance from the target. Then, the same process is repeated.

[0174] In addition, if the person to be processed is the first person to be authenticated P ３ Other authenticated persons P １ If it is determined that the next processing target is not the specified one, the specifying unit 14 determines the next processing target by any means, and then repeats the same processing.

[0175] Other configurations of the information processing apparatus 10 of the sixth embodiment are similar to those of the information processing apparatuses 10 of the first to fifth embodiments.

[0176] According to the information processing device 10 of the sixth embodiment, the same effects as those of the information processing devices 10 of the first to fifth embodiments are realized.

[0177] Furthermore, the information processing apparatus 10 of the sixth embodiment is ３ The passing spot that the first person to be authenticated P passed through is ３ Other authenticated persons P who passed before or after １ Based on the information about the first authenticatee P ３ can be identified in the second traffic area image.

[0178] As explained in the third embodiment, other authentication subjects P １ is the second traffic area A ２ In the first authentication subject P ３ There is a high possibility that other people to be authenticated P are nearby. １ is the first authenticatee P ３ In this case, the other person to be authenticated P １ is the second traffic area A ２ In the first authentication subject P ３ The possibility that such other authenticated persons P are in the vicinity of the authenticated persons P increases. １ By using the information about the first person to be authenticated, ３ can be efficiently identified in the second traffic area image.

[0179] <<Seventh Embodiment>> In the seventh embodiment, as shown in FIG. 10, １ The person to be authenticated P １ The gate G is provided for the person to be authenticated P to pass through. １ The information processing device 10 has a function of controlling the opening and closing of this gate G using a unique method. This will be described in detail below. In the example of FIG. 10, a device D may also be installed in each lane L.

[0180] 11 shows an example of a functional block diagram of the information processing device 10. As shown in the figure, the information processing device 10 has a first acquisition unit 11, an authentication unit 12, a second acquisition unit 13, an identification unit 14, and a gate control unit 15.

[0181] The gate control unit 15 controls the opening and closing of the gate G.

[0182] For example, the gate control unit 15 may １ In response to the authentication information obtained from the authentication unit 12, the gate G can be opened regardless of the authentication result. The authentication is performed by the authentication unit 12. When the gate G is opened, the person to be authenticated P １ passes through gate G and enters the second traffic area A ２ You can enter.

[0183] As another example, the gate control unit 15 may １ The gate G may be opened in response to the completion of authentication based on the authentication information acquired from the authentication unit 12, regardless of the authentication result. １ passes through gate G and enters the second traffic area A ２ You can enter.

[0184] As another example, the gate control unit 15 may １ If the authentication information acquired from satisfies a predetermined quality condition, the gate G may be opened regardless of the authentication result. This authentication is performed by the authentication unit 12. When the gate G is opened, the person to be authenticated P １ passes through gate G and enters the second traffic area A ２ You can enter.

[0185] The quality condition is that "the quality of the authentication information is such that the authentication result can be obtained with a desired accuracy." The quality condition corresponding to each piece of authentication information is set in advance and registered in the information processing device 10. For example, if the authentication information is １ In the case where the authentication information is an appearance image of the person P, the quality condition may be "the size of the face in the appearance image is within a predetermined range," "the orientation of the face in the appearance image is a predetermined orientation," or "the appearance image is not blurred." １If the authentication information is an external appearance image, the quality condition may be a condition in which the above multiple conditions are connected with an AND condition. If the authentication information is a voiceprint, the quality condition may be that a voice of a predetermined volume or more is input. If the authentication information is a fingerprint or a palm shape, the quality condition may be that the missing parts are less than a predetermined percentage. Note that the quality conditions exemplified here are merely examples and are not limited to these.

[0186] The information processing device 10 uses any widely known technology to identify the person to be authenticated P at the gate G. １ It can be determined whether the authentication information obtained from satisfies the quality conditions described above.

[0187] Other configurations of the information processing apparatus 10 of the seventh embodiment are similar to the configurations of the information processing apparatuses 10 of the first to sixth embodiments.

[0188] According to the information processing device 10 of the seventh embodiment, the same effects as those of the information processing devices 10 of the first to sixth embodiments are realized.

[0189] Furthermore, the information processing apparatus 10 of the seventh embodiment receives the authentication subject P at the gate G. １ By this control, the information processing device 10 can obtain high-quality authentication information suitable for authentication.

[0190] Regardless of the authentication result, the information processing device 10 opens the gate G and allows the authenticated person P １ According to the information processing device 10, it is possible to avoid the inconvenience of the processing being temporarily stopped at the gate G, which would result in a decrease in throughput.

[0191] <<Modifications>> In the first to seventh embodiments, the first passing area A １ Camera C installed at １ is the person to be authenticated P １ Then, the information processing device 10 uses such a camera C １ The authenticatee P generated by １ An external image was obtained.

[0192] As a modified example, the authenticatee P １The person P may take an external image of himself / herself using his / her mobile terminal and transmit the image to the information processing device 10. Then, the information processing device 10 receives the external image of the person P generated by such a mobile terminal. １ An external image of the object may be acquired.

[0193] The mobile terminal may be, but is not limited to, a smartphone, a tablet terminal, a mobile phone, a smart watch, a laptop computer, etc. For example, the person to be authenticated P １ can take an image of their own appearance and transmit it to the information processing device 10 via an application installed on their mobile terminal.

[0194] In this modification, the same effects as those of the first to seventh embodiments are achieved.

[0195] Although this disclosure has been described above with reference to the embodiments, this disclosure is not limited to the above-described embodiments. Various modifications that can be understood by those skilled in the art can be made to the configuration and details of this disclosure within the scope of this disclosure. Furthermore, each embodiment can be combined with other embodiments as appropriate.

[0196] In addition, in the flowcharts used in the above description, multiple steps (processes) are described in order. However, the order of the steps performed in each embodiment is not limited to the order described. In each embodiment, the order of the steps shown in the drawings can be changed as long as it does not cause any problems in terms of the content. Furthermore, the above-mentioned embodiments can be combined as long as the content does not contradict each other.

[0197] Some or all of the above embodiments may be described as, but are not limited to, the following supplementary notes: 1. An information processing device comprising: a first acquisition means for acquiring authentication information of an authenticated person in a first passage area; an authentication means for authenticating the authenticated person based on the authentication information; a second acquisition means for acquiring a second passage area image capturing a second passage area that the authenticated person will pass through after the first passage area; and an identification means for identifying the first authenticated person in the second passage area image based on the appearance of the first authenticated person who failed the authentication. 2. The information processing device described in 1, wherein the identification means notifies an operator of the fact if the first authenticated person cannot be identified in the second passage area image by a predetermined deadline. 3. The information processing device according to 1 or 2, wherein the identification means identifies the first person to be authenticated in the second traffic area image by searching the second traffic area image for a person whose degree of similarity in appearance to the first person to be authenticated is equal to or greater than a first threshold, and if the first person to be authenticated cannot be identified in the second traffic area image by a predetermined deadline, identifies the first person to be authenticated in the second traffic area image by searching the second traffic area image for a person whose degree of similarity in appearance to the first person to be authenticated is equal to or greater than a second threshold, and the first threshold is higher than the second threshold. 4. The information processing device according to 3, wherein the identification means identifies a person whose degree of similarity in appearance to the first person to be authenticated is equal to or greater than the second threshold in the second traffic area image after the predetermined deadline, and notifies an operator of information indicating the location of the identified person as information indicating the location of the first person to be authenticated. 5. The information processing device according to claim 4, wherein the specifying means, when unable to specify a person in the second traffic area image whose degree of similarity in appearance to the first person to be authenticated is equal to or greater than the second threshold, specifies a person in the past second traffic area image whose degree of similarity in appearance to the first person to be authenticated is equal to or greater than the second threshold, and notifies an operator of at least one of the movement direction and movement trajectory of the first person to be authenticated specified in the past second traffic area image. 6. The information processing device according to any of claims 2 to 5, wherein the predetermined deadline is a predetermined time period after a predetermined count start timing.7. The information processing device according to any one of 1 to 6, wherein the first traffic area has a plurality of passing spots, and the person to be authenticated passes through any one of the passing spots, and the identification means identifies the passing spots passed by the first person to be authenticated, and identifies the first person to be authenticated in the second traffic area image based on the identification result. 8. The information processing device according to 7, wherein the identification means identifies the first person to be authenticated in the second traffic area image based on the positional relationship between a movement trajectory of a person detected in the second traffic area image and the passing spots passed by the first person to be authenticated. 9. The information processing device according to any one of 1 to 8, wherein the first traffic area has a plurality of passing spots, and the person to be authenticated passes through any one of the passing spots, and the identification means identifies the first person to be authenticated in the second traffic area image based on information about other people who passed the passing spot passed by the first person to be authenticated before or after the first person to be authenticated. 10. The information processing device according to any one of 1 to 9, wherein the first passage area has a gate through which the authenticated person passes, and further comprises gate control means for opening the gate in response to acquiring the authentication information from the authenticated person at the gate, regardless of the authentication result. 11. The information processing device according to any one of 1 to 9, wherein the first passage area has a gate through which the authenticated person passes, and further comprises gate control means for opening the gate in response to acquiring the authentication information from the authenticated person at the gate, regardless of the authentication result, if the authentication information acquired from the authenticated person at the gate satisfies a predetermined quality condition. 12. The information processing device according to any one of 1 to 9, wherein the first passage area has a gate through which the authenticated person passes, and further comprises gate control means for opening the gate in response to completing authentication based on the authentication information acquired from the authenticated person at the gate, regardless of the authentication result. 13. The information processing device according to any one of 1 to 12, wherein the identification means notifies an operator of information indicating the position of the first authenticated person identified within the second passage area image.14. The information processing device according to any one of 1 to 13, wherein the first acquisition means acquires an external image of the authenticated person as the authentication information, and the identification means identifies the first authenticated person in the second traffic area image based on the external image of the first authenticated person. 15. The information processing device according to any one of 1 to 14, wherein the first acquisition means acquires images of the authenticated people one by one, or information individually entered by each of the authenticated people, as the authentication information. 16. An information processing method in which one or more computers acquire authentication information of the authenticated person in a first traffic area, authenticate the authenticated person based on the authentication information, acquire a second traffic area image taken of a second traffic area that the authenticated person will pass through after the first traffic area, and identify the first authenticated person in the second traffic area image based on the external appearance of the first authenticated person, who is the authenticated person who failed the authentication. 17. A recording medium having recorded thereon a program that causes a computer to function as: a first acquisition means that acquires authentication information of a person to be authenticated in a first passage area; an authentication means that authenticates the person to be authenticated based on the authentication information; a second acquisition means that acquires a second passage area image that captures a second passage area that the person to be authenticated will pass through after passing through the first passage area; and an identification means that identifies the first person to be authenticated in the second passage area image based on the appearance of the first person to be authenticated, who is the person to be authenticated who failed the authentication.

[0198] Some or all of Supplements 2 to 15 that are dependent on the information processing device of Supplement 1 described above may also be dependent on the information processing method of Supplement 16 and the recording medium of Supplement 17 in the same dependent relationship as Supplement 1 and Supplements 2 to 15. Furthermore, within the scope of each of the above-mentioned embodiments, some or all of the configurations described as Supplements can be realized in various hardware, software, various recording means for recording software, or systems.

[0199] REFERENCE SIGNS LIST 10 Information processing device 11 First acquisition unit 12 Authentication unit 13 Second acquisition unit 14 Identification unit 15 Gate control unit 1A Processor 2A Memory 3A Input / output I / F 4A Peripheral circuit 5A Bus

Claims

1. An information processing device comprising: a first acquisition means for acquiring authentication information of a person to be authenticated in a first passage area; an authentication means for authenticating the person to be authenticated based on the authentication information; a second acquisition means for acquiring a second passage area image capturing a second passage area through which the person will pass after passing through the first passage area; and an identification means for identifying the first person to be authenticated in the second passage area image based on the appearance of the first person to be authenticated, who is the person to be authenticated who failed the authentication.

2. The information processing device according to claim 1, wherein the identification means notifies an operator if the first authenticated person cannot be identified within the second traffic area image by a predetermined time limit.

3. The information processing device according to claim 1 or 2, wherein the identification means identifies the first person to be authenticated in the second traffic area image by searching for a person in the second traffic area image whose degree of similarity in appearance to the first person to be authenticated is equal to or greater than a first threshold, and if the first person to be authenticated cannot be identified in the second traffic area image by a predetermined deadline, identifies the first person to be authenticated in the second traffic area image by searching for a person in the second traffic area image whose degree of similarity in appearance to the first person to be authenticated is equal to or greater than a second threshold, and the first threshold is higher than the second threshold.

4. The information processing device according to claim 3, wherein the identification means identifies a person whose appearance similarity to the first person to be authenticated is equal to or greater than the second threshold value within the second traffic area image after the specified deadline, and notifies an operator of information indicating the location of the identified person as information indicating the location of the first person to be authenticated.

5. The information processing device according to claim 4, wherein, when the identification means cannot identify a person in the second traffic area image whose appearance similarity to the first authenticated person is equal to or greater than the second threshold, the identification means identifies a person in the past second traffic area image whose appearance similarity to the first authenticated person is equal to or greater than the second threshold, and notifies an operator of at least one of the movement direction and movement trajectory of the first authenticated person identified in the past second traffic area image.

6. An information processing device according to any one of claims 2 to 5, wherein the predetermined time limit is a predetermined time period after a predetermined count start timing.

7. An information processing device according to any one of claims 1 to 6, wherein the first traffic area has a plurality of passing spots, and the person to be authenticated passes through any one of the passing spots, and the identification means identifies the passing spot through which the first person to be authenticated passed, and based on the identification result, identifies the first person to be authenticated within the second traffic area image.

8. An information processing device as described in claim 7, wherein the identification means identifies the first person to be authenticated within the second traffic area image based on the positional relationship between the movement trajectory of a person detected within the second traffic area image and the passing spot through which the first person to be authenticated passed.

9. An information processing device as described in any one of claims 1 to 8, wherein the first passage area has a plurality of passing spots, and the person to be authenticated passes through any one of the passing spots, and the identification means identifies the first person to be authenticated within the second passage area image based on information regarding other people to be authenticated who passed through the passing spot passed by the first person to be authenticated before or after the first person to be authenticated.

10. An information processing device as claimed in any one of claims 1 to 9, wherein the first passage area has a gate through which the person to be authenticated passes, and further has a gate control means for opening the gate in response to obtaining the authentication information from the person to be authenticated at the gate, regardless of the result of the authentication.

11. An information processing device as described in any one of claims 1 to 9, wherein the first passage area has a gate through which the person to be authenticated passes, and further has a gate control means for opening the gate regardless of the result of the authentication when the authentication information obtained from the person to be authenticated at the gate satisfies predetermined quality conditions.

12. An information processing device as claimed in any one of claims 1 to 9, wherein the first passage area has a gate through which the person to be authenticated passes, and further has a gate control means for opening the gate upon completion of authentication based on the authentication information obtained from the person to be authenticated at the gate, regardless of the result of the authentication.

13. An information processing device according to any one of claims 1 to 12, wherein the identification means notifies an operator of information indicating the position of the first authenticated person identified within the second traffic area image.

14. An information processing device described in any one of claims 1 to 13, wherein the first acquisition means acquires an external image of the person to be authenticated as the authentication information, and the identification means identifies the first person to be authenticated within the second passage area image based on the external image of the first person to be authenticated.

15. An information processing device according to any one of claims 1 to 14, wherein the first acquisition means acquires, as the authentication information, images of the persons to be authenticated one by one, or information entered individually by each of the persons to be authenticated.

16. An information processing method in which one or more computers acquire authentication information of a person to be authenticated in a first passage area, authenticate the person to be authenticated based on the authentication information, acquire a second passage area image of a second passage area that the person will pass through after passing through the first passage area, and identify the first person to be authenticated in the second passage area image based on the appearance of the first person to be authenticated, who is the person to be authenticated who failed the authentication.

17. A recording medium having recorded thereon a program that causes a computer to function as: a first acquisition means for acquiring authentication information of a person to be authenticated in a first passage area; an authentication means for authenticating the person to be authenticated based on the authentication information; a second acquisition means for acquiring a second passage area image obtained by photographing a second passage area through which the person will pass after passing through the first passage area; and an identification means for identifying the first person to be authenticated in the second passage area image based on the appearance of the first person to be authenticated, who is the person to be authenticated who failed the authentication.

Images