Traffic management program, traffic management method, and traffic management device

Abstract

To improve the security for passage.SOLUTION: An identification information acquisition step of a passage management program acquires identification information of a user read by a reading unit 20 that is installed in a passage area and that reads the identification information from an authentication medium. A captured image acquisition step acquires a captured image of the passage area. A specifying step specifies, out of one or more face image regions included in the captured image, a face image region of a user who is carrying the authentication medium as a passerby face image. An authentication step authenticates, when the passerby face image matches a pre-stored correct face image corresponding to the identification information, the user who is carrying the authentication medium as an authorized person, and when the passerby face image does not match the correct face image, authenticates the user who is carrying the authentication medium as an unauthorized person.SELECTED DRAWING: Figure 2

Description

[Technical Field]

[0001] An embodiment of the present invention relates to a traffic management program, a traffic management method, and a traffic management device. [Background technology]

[0002] Systems for authenticating users passing through a passage area are known. For example, a system has been disclosed that determines that authentication is not possible if the positional relationship between the face position and other positions included in a photographed image of a pedestrian is abnormal. Another system has been disclosed that determines that unauthorized passage has occurred when further passage detected after the passage of a legitimate pedestrian has been detected. Another known technology determines that authentication is not possible if identification information read from an authentication medium on which the user's identification information is recorded does not match pre-stored identification information.

[0003] However, in the conventional technology, when both a user who is permitted to pass and a user who is not permitted to pass appear in the captured image of the verification target at the same time, or when a user who is not permitted to pass carries the authentication medium of a user who is permitted to pass, it can be difficult to detect fraud. In other words, in the conventional technology, security regarding passage can be reduced. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] International Publication No. 2020 / 152917 [Patent Document 2] Japanese Patent Application Laid-Open No. 2004-265232 Summary of the Invention [Problem to be solved by the invention]

[0005] The problem to be solved by the present invention is to provide a traffic management program, a traffic management method, and a traffic management device that can improve security regarding traffic. [Means for solving the problem]

[0006] The traffic management program according to the embodiment includes: A traffic management program to be executed by a computer, an identification information acquisition step of acquiring identification information read by a reading unit installed in a passage area that reads the user's identification information from an authentication medium; a captured image acquisition step of acquiring a captured image of the passage area; an identification step of identifying the face image area of ​​the user carrying the authentication medium as a passerby face image from one or more face image areas included in the captured image; and an authentication step of authenticating the user carrying the authentication medium as a person eligible for passage if the passerby face image matches a pre-stored correct face image corresponding to the identification information, and authenticating the user carrying the authentication medium as not eligible for passage if the passerby face image does not match the correct face image; The specifying step includes a carrying part specifying step of specifying a carrying part of the user's body that appears in the photographed image, where the authentication medium is carried, from the photographed image, and a passerby face image specifying step of specifying, as the passerby face image, the face image area of ​​a user that has the specified carrying part as a part of their body, from one or more face image areas included in the photographed image. [Brief explanation of the drawings]

[0007] [Figure 1] Schematic diagram of a traffic management system. [Figure 2] FIG. 2 is a functional block diagram of the traffic management device. [Figure 3] FIG. 3 is a schematic diagram of the data structure of user management information. [Figure 4] Schematic diagram of a captured image. [Figure 5] 1 is a flowchart of the flow of information processing. [Figure 6] Schematic diagram of a captured image. [Figure 7] Schematic diagram of a captured image. [Figure 8] Hardware configuration diagram. DETAILED DESCRIPTION OF THE INVENTION

[0008] The traffic management program, traffic management method, and traffic management device of the present embodiment will be described in detail below with reference to the accompanying drawings.

[0009] FIG. 1 is a schematic diagram of an example of a traffic management system 1 according to this embodiment.

[0010] The traffic management system 1 includes a traffic management device 10, a reading unit 20, and an imaging unit 22. The traffic management device 10, the reading unit 20, and the imaging unit 22 are connected to each other so as to be able to communicate with each other.

[0011] The traffic management device 10 is an information processing device for managing the traffic of a user U who attempts to pass through a traffic area S.

[0012] The traffic area S is an area subject to traffic management of the user U by the traffic management device 10. The traffic area S is, for example, an entrance used when entering or leaving a predetermined area, an area including a boundary between one area and another area, etc. The predetermined area is an area subject to entry and exit management. The predetermined area is, for example, an area within a specific building, an area where transportation such as a train is available, a specific outdoor area, etc., but is not limited to these.

[0013] In the passage area S, for example, a passageway housing 24 is provided. The passageway housing 24 is a housing installed in the passage area S. The passageway housing 24 is provided with a reading unit 20, a passageway opening / closing drive unit 26, and a door member 28.

[0014] The reading unit 20 is a reading device that reads the identification information of the user U from the authentication medium 30. The reading unit 20 is installed in the passage area S. In this embodiment, an example will be described in which the reading unit 20 is provided in a passageway housing 24 installed in the passage area S. The reading unit 20 may be a device that reads the identification information from the authentication medium 30 and transmits it to the passage management device 10 when the authentication medium 30 comes close to the reading unit 20 by contact or non-contact. Close proximity means that the authentication medium 30 and the reading unit 20 are located within a distance range where they can communicate with each other.

[0015] The reading unit 20 is, for example, a barcode reader that reads barcodes and transmits identification information, a magnetic card reader that reads magnetic information and transmits identification information, a device that reads identification information contained in a captured image from the captured image and transmits it, a device that reads identification information from a storage medium such as a memory card and transmits it, etc. The barcode may be, for example, a one-dimensional barcode or a two-dimensional barcode.

[0016] The authentication medium 30 is a medium that can be carried by the user U. The authentication medium 30 is also a medium that can provide the user U's identification information in a readable manner to the reading unit 20. The user U's identification information may be any information that can uniquely identify the user. For example, the user U's identification information may be the user U's management number such as an employee number, or a number such as a passport number that has been assigned to the user U in advance, but is not limited to these.

[0017] For example, the authentication medium 30 is a mobile terminal capable of displaying a barcode representing the identification information of the user U on a display screen. In this case, the authentication medium 30 is, for example, a smartphone, a tablet terminal, or the like equipped with a display unit. Also, for example, the authentication medium 30 is a medium such as paper or resin on which characters or a barcode representing the identification information of the user U are recorded by printing or the like. In this case, the authentication medium 30 is, for example, a transportation ticket such as a passport, an employee ID card, or the like. Also, for example, the authentication medium 30 has a storage medium that stores the identification information of the user U, and is a medium that allows the reading unit 20 to read the identification information stored in the storage medium by contacting or coming into proximity with the reading unit 20. In this case, the authentication medium 30 is, for example, a device equipped with a communication function and a storage medium.

[0018] In this embodiment, the authentication medium 30 is a paper medium on which characters or barcodes representing identification information are recorded, or a portable terminal capable of displaying characters or barcodes representing identification information. In addition, the present embodiment is described assuming that the reading unit 20 reads the identification information from the authentication medium 30 and transmits it to the passage management device 10 when the characters or barcodes representing the identification information on the authentication medium 30 come into contact with or are brought close to the reading unit 20.

[0019] The photographing unit 22 is a device that photographs the passage area S and transmits the photographed image data to the traffic management device 10. In the following description, the photographed image data will be simply referred to as a photographed image. The photographing unit 22 includes a reading unit 20 included in the passage area S, and the photographing angle of view and photographing direction are adjusted in advance so that an area including the face and other body parts of the user U when the user U is present near the reading unit 20 can be photographed. In this embodiment, an example will be described in which the photographing unit 22 sequentially photographs the passage area S in chronological order and sequentially transmits the photographed photographed images to the traffic management device 10. The photographing unit 22 also assigns a photographing time to the photographed image and transmits the photographed image with the attached photographing time to the traffic management device 10.

[0020] The passage opening / closing drive unit 26 is a drive mechanism that drives the door element 28. The passage opening / closing drive unit 26 and the passage management device 10 are connected so as to be able to communicate with each other. The passage opening / closing drive unit 26 drives the door element 28 in accordance with the control of the passage management device 10. By driving the door element 28, the passage opening / closing drive unit 26 switches the state of the door element 28 to allow or restrict passage of the user U through the passage area S. For example, the door element 28 is provided so as to be openable and closable. When the passage opening / closing drive unit 26 switches the door element 28 to the open state, the user U can pass through the passage area S, for example, in the direction of the arrow X. When the passage opening / closing drive unit 26 switches the door element 28 to the closed state, passage of the user U through the passage area S is restricted.

[0021] As described above, the authentication medium 30 is a medium that can be carried by the user U and that can provide the user U's identification information in a readable manner to the reading unit 20. A user U passing through the passage area S enters the passage area S carrying the authentication medium 30 and attempts to pass through the passage area S, for example, in the direction of arrow X, by bringing the authentication medium 30 into contact with or close to the reading unit 20. The passage of the user U attempting to pass through the passage area S is managed by the passage management device 10 (described in detail later).

[0022] 2 is a functional block diagram of an example of the traffic control device 10 of this embodiment. For the sake of explanation, the photographing unit 22, the reading unit 20, and the entrance opening / closing drive unit 26 are also shown in FIG.

[0023] The traffic management device 10 includes a memory unit 12, a UI (user interface) unit 14, a communication unit 16, and a control unit 18. The memory unit 12, the UI unit 14, the communication unit 16, and the control unit 18 are communicatively connected via a bus 17 or the like.

[0024] The storage unit 12 stores various types of data. In this embodiment, the storage unit 12 stores user management information 12A in advance.

[0025] FIG. 3 is a schematic diagram showing an example of the data structure of the user management information 12A.

[0026] The user management information 12A is a database for managing information about the user U to be permitted to pass. The data format of the user management information 12A is not limited to a database. The user management information 12A is a database that associates identification information of the user U with a correct facial image. The correct facial image is a facial image of the user U identified by the corresponding identification information. The facial image is, for example, data in which a facial image area is extracted from a photographed image of the user U. In the user management information 12A, for example, the identification information and the correct facial image of the user U identified by the identification information are registered in association with each other through a prior registration process by the control unit 18.

[0027] Returning to Figure 2, we continue the explanation.

[0028] The UI unit 14 has a display function for displaying various information and an input function for receiving user input. The display function is, for example, a display, a projection device, etc. The input function is, for example, a pointing device such as a mouse or a touchpad, a keyboard, etc. The UI unit 14 may be a touch panel that integrates the display function and the input function.

[0029] The communication unit 16 is a communication interface for communicating with an information processing device or the like external to the passage management device 10. In this embodiment, the communication unit 16 communicates wirelessly or wired via a network or the like with the photographing unit 22, the reading unit 20, and the passage opening / closing drive unit 26 provided in the passage entrance housing 24 of the passage area S.

[0030] In the present embodiment, the passage management device 10 will be described as an example of a configuration in which, for each passage area S that can be passed through by users U one at a time, the passage management device 10 manages the reading unit 20, the photographing unit 22, and the passage opening / closing drive unit 26 provided in that unit. Therefore, when multiple passage areas S are provided, the passage management device 10 will manage the reading unit 20, the photographing unit 22, and the passage opening / closing drive unit 26 provided in each of the multiple passage areas S. In the present embodiment, one reading unit 20, one photographing unit 22, and one passage opening / closing drive unit 26 are provided in one passage area S, and the passage management device 10 will be described as an example of a configuration in which the reading unit 20, the photographing unit 22, and the passage opening / closing drive unit 26 are managed by the passage management device 10.

[0031] At least one of the memory unit 12 and the UI unit 14 may be provided outside the traffic management device 10. In this case, at least one of the memory unit 12 and the UI unit 14 may be capable of communicating with the traffic management device 10 via the network and the communication unit 16.

[0032] In addition, at least one of the memory unit 12, UI unit 14, and one or more functional units described below included in the control unit 18 may be configured to be mounted on an external information processing device that is communicatively connected to the traffic management device 10 via a network or the like.

[0033] The control unit 18 executes information processing in the passage management device 10. The control unit 18 includes a captured image analysis unit 18A, an identification information acquisition unit 18B, a captured image acquisition unit 18C, an identification unit 18D, an authentication unit 18G, a passage control unit 18H, and an output control unit 181. The identification unit 18D includes a carrying part identification unit 18E and a passerby face image identification unit 18F.

[0034] The captured image analysis unit 18A, the identification information acquisition unit 18B, the captured image acquisition unit 18C, the identification unit 18D, the carrying part identification unit 18E, the passerby face image identification unit 18F, the authentication unit 18G, the passage control unit 18H, and the output control unit 18I are realized, for example, by one or more processors. For example, each of the above units may be realized by having a processor such as a CPU (Central Processing Unit) execute a program, i.e., by software. Each of the above units may be realized by a processor such as a dedicated IC or circuit, i.e., by hardware. Each of the above units may be realized by a combination of software and hardware. When multiple processors are used, each processor may realize one of the units, or two or more of the units.

[0035] The captured image analysis unit 18A sequentially receives captured images from the photographing unit 22. As described above, the photographing unit 22 photographs the passage area S and sequentially transmits the captured images, to which the photographing time has been assigned, to the traffic management device 10. The captured image analysis unit 18A sequentially receives the captured images, to which the photographing time has been assigned, from the photographing unit 22 via the communication unit 16. The photographing time is the time at which the photographed image 40 to which the photographing time has been assigned was captured.

[0036] Every time a new photographed image is received, the photographed image analysis unit 18A analyzes the photographed image and generates an analysis result.

[0037] Fig. 4 is a schematic diagram of an example of a captured image 40A. The captured image 40A is an example of a captured image 40 of the passage area S captured by the image capturing unit 22. Fig. 4 shows an example of a captured image 40 captured in a state where two users U, user Ux and user Uy, are present within the capture range of the passage area S captured by the image capturing unit 22, as shown in Fig. 1. User Ux and user Uy are examples of user U. Returning to Fig. 4, the explanation will continue.

[0038] The photographed image analysis unit 18A analyzes the face image area F of the user U captured in the photographed image 40A and the skeleton information B of the user U as analysis results.

[0039] The face image area F is a face area representing the face of the user U included in the photographed image 40. The photographed image analysis unit 18A can analyze the face image area F of the user U included in the photographed image 40 using a known image processing technique for identifying the face image area F from the photographed image 40. Examples of known image processing techniques for identifying the face image area F include, but are not limited to, "Henry A. Rowley, Shumeet Baluja, and Takeo Kanade: Neural Network-Based Face Detection, IEEE Transactions on Pattern Analysis and Machine Intelligence Vol. 20, 1, Jan. 1998, pp. 23--38."

[0040] 4, the captured image analysis unit 18A identifies a face image area Fa of the user Uy and a face image area Fb of the user Ux from the captured image 40A. The face image area Fa and the face image area Fb are examples of the face image area F.

[0041] The skeletal information B is information that represents the skeleton of the user U included in the photographed image 40. The skeletal information is information that represents the position and shape of each of the multiple skeletons that make up the user U in the photographed image 40. The skeletal information B makes it possible to identify the position in the photographed image 40 of each part of the user U's body that appears in the photographed image 40.

[0042] The captured image analysis unit 18A may analyze the skeletal information B using a known image processing technique for analyzing the skeletal information B from the captured image 40. Examples of known image processing techniques for analyzing the skeletal information B include, but are not limited to, "Z. Cao, G. Hidalgo Martinez, T. Simon, S. Wei, and YA Sheikh: OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fields, IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 43, 1, Jan. 2021, pp. 172-186."

[0043] 4, the captured image analysis unit 18A identifies skeletal information Ba of the user Uy and skeletal information Bb of the user Ux from the captured image 40A. The skeletal information Ba and the skeletal information Bb are examples of the skeletal information B.

[0044] Returning to Figure 2, we continue the explanation.

[0045] The photographed image analysis unit 18A analyzes each new photographed image 40 received from the photographing unit 22, associates the photographed image 40 with the analysis result and the photographing time, and sequentially stores the photographed image 40 in the storage unit 12. The photographed image analysis unit 18A may store the photographed images 40 in the storage unit 12 until a predetermined number or data amount is reached. When storing new photographed images 40 that exceed the predetermined number or data amount in the storage unit 12, the photographed image analysis unit 18A may delete the photographed images 40 from the storage unit 12 in order starting with the oldest photographed image, and store the newly received photographed image 40 in the storage unit 12 with the analysis result and the photographing time associated with each other. The photographed image analysis unit 18A may also control the storage of the photographed images 40 to be stored in the storage unit 12 so that photographed images 40 from a predetermined period of time are stored in the storage unit 12 going from the present to the past.

[0046] The identification information acquisition unit 18B acquires identification information read from the authentication medium 30 by the reading unit 20 installed in the passage area S. For example, a user U carrying the authentication medium 30 touches or brings the authentication medium 30 close to the reading unit 20, causing the reading unit 20 to read the identification information from the authentication medium 30. Every time the reading unit 20 reads identification information from the authentication medium 30, it associates the read identification information with the reading time and transmits them to the passage management device 10. The identification information acquisition unit 18B acquires the identification information and the reading time corresponding to the identification information from the reading unit 20 via the communication unit 16.

[0047] The photographed image acquisition unit 18C acquires the photographed image 40 of the passage area S. The photographed image acquisition unit 18C acquires the photographed image 40 of the passage area S by reading the photographed image 40 analyzed by the photographed image analysis unit 18A from the memory unit 12.

[0048] In detail, the photographed image acquiring unit 18C acquires at least the photographed image 40 when the reading unit 20 reads the identification information.

[0049] The captured image acquisition unit 18C acquires at least the captured image 40 at the time of reading by the identification information reading unit 20 by reading from the memory unit 12 the captured image 40 associated with the same shooting time as the reading time corresponding to the identification information acquired by the identification information acquisition unit 18B.

[0050] Furthermore, the photographed image acquiring unit 18C may acquire at least the photographed image 40 at the time of reading by the identification information reading unit 20 by reading from the storage unit 12 the photographed image 40 associated with a photographing time within a predetermined time from the read time corresponding to the identification information acquired by the identification information acquiring unit 18B. The predetermined time may be a period during which it is possible to determine that the read time of the identification information and the photographing time of the photographed image 40 match. In this embodiment, the photographed image acquiring unit 18C acquires the photographed image 40 and the analysis result by reading from the storage unit 12 the photographed image 40 that satisfies the above conditions and the analysis result corresponding to the photographed image 40.

[0051] The specifying unit 18D specifies, from among one or more face image areas F included in the photographed image 40, the face image area F of the user U carrying the authentication medium 30 as the passerby face image.

[0052] The identification unit 18D performs identification processing of the face image of a passerby using the captured image 40 acquired by the captured image acquisition unit 18C. As described above, the captured image acquisition unit 18C acquires at least the captured image 40 when the identification information is read by the reading unit 20. Then, the identification unit 18D performs identification processing of the face image of a passerby using the captured image 40 acquired by the captured image acquisition unit 18C. For this reason, the identification unit 18D identifies, as the face image of a passerby, the face image area F of the user U who is carrying the authentication medium 30 when the reading unit 20 reads the identification information from the authentication medium 30, out of one or more face image areas F included in the captured image 40.

[0053] The passerby face image is a face image of a user U passing through the passage area S. That is, the identification unit 18D identifies the face image area F of the user U who was carrying the authentication medium 30 when the reading unit 20 read the identification information from the authentication medium 30 as the passerby face image of the user U passing through the passage area S.

[0054] This will be explained using Fig. 1. For example, as shown in Fig. 1, a situation is assumed in which two users U, user Ux and user Uy, are present within the photographing range of a passage area S of the photographing unit 22. Also, a situation is assumed in which user Uy is attempting to pass through the passage area S while carrying an authentication medium 30.

[0055] In this case, the captured image 40 captured when the reading unit 20 reads the identification information from the authentication medium 30 includes the carrying part of the user Uy, such as the hand carrying the authentication medium 30.

[0056] Continuing the explanation, returning to Fig. 2, the identification unit 18D uses the captured image 40 at the time of reading by the reading unit 20 of at least the identification information acquired by the captured image acquisition unit 18C to identify the face image of the passerby included in the captured image 40.

[0057] The processing of the specification unit 18D will be described in detail.

[0058] The identification unit 18D has a carrying part identification unit 18E and a passerby face image identification unit 18F.

[0059] The carrying part identification unit 18E identifies, from the photographed image 40, the carrying part on the body of the user U that appears in the photographed image 40 where the authentication medium 30 is carried. The passerby face image identification unit 18F identifies, from one or more face image areas F included in the photographed image 40, the face image area F of the user U that has the carrying part identified by the carrying part identification unit 18E as a part of the body, as the passerby face image.

[0060] This will be explained using Fig. 4. For example, the carrying part identification unit 18E identifies the area of ​​the authentication medium 30 included in the photographed image 40A. A known image processing technique such as pattern matching may be used to identify the area of ​​the authentication medium 30 included in the photographed image 40A. Then, the identification unit 18D identifies a part of the user U's body that overlaps or is adjacent to the identified area of ​​the authentication medium 30 in the photographed image 40A as the carrying part P of the authentication medium 30 carried by the user U. The carrying part P is the part of the user U's body, such as the hands and feet, that carries the authentication medium 30.

[0061] In detail, the carrying part identification unit 18E identifies the carrying part P appearing in the photographed image 40A by using the analysis result corresponding to the photographed image 40A acquired by the photographed image acquisition unit 18C. As described above, the analysis result of the photographed image 40A by the photographed image analysis unit 18A includes skeletal information B. Also, as described above, the skeletal information B makes it possible to identify the position in the photographed image 40A of each part of the body of the user U appearing in the photographed image 40A.

[0062] Therefore, the identification unit 18D identifies, among the body parts of the user U identified by the skeletal information B in the captured image 40, a part that appears overlapping or adjacent to the identified area of ​​the authentication medium 30 as the carrying part P. Assume that the user U holds the authentication medium 30 in his / her hand and brings the authentication medium 30 into contact with or close to the reading unit 20, causing the reading unit 20 to read the identification information from the authentication medium 30. In this case, the identification unit 18D identifies the user U's hand as the carrying part P.

[0063] The part of the body where the user U carries the authentication medium 30 is not limited to the hand. For example, the user U may carry the authentication medium 30 on his / her arm, in a pocket of his / her clothes, or the like, and have the reading unit 20 read the identification information from the authentication medium 30. In this case, the identification unit 18D identifies a body part of the user, such as the arm or the chest where the pocket is located, as the carrying part P. In the case of the captured image 40A shown in FIG. 4, the identification unit 18D identifies the hand of the user Uy as the carrying part P.

[0064] The passerby face image identification unit 18F identifies, from one or more face image areas F (face image area Fa, face image area Fb) included in the captured image 40A, the face image area F of a user U who has the mobile part P identified by the mobile part identification unit 18E as part of their body, as the passerby face image FP.

[0065] The passerby face image identification unit 18F uses the positional relationship between the portable part P based on the skeletal information B of the user U included in the captured image 40 and the face position Q of each of one or more face image areas F based on the skeletal information B included in the captured image 40 to identify the face image area F of the user U who has the portable part P as part of their body as a passerby face image FP.

[0066] 4, the passerby face image specifying unit 18F specifies face image area Fa and face image area Fb as the face image areas F included in the analysis result corresponding to the photographed image 40A. The passerby face image specifying unit 18F also specifies face position Qa of face image area Fa and face position Qb of face image area Fb in the photographed image 40A. The face position Qa and the face position Qb are examples of the face position Q of the face image area F in the photographed image 40A.

[0067] Furthermore, the passerby face image specifying unit 18F specifies the skeletal information Ba and the skeletal information Bb as the skeletal information B included in the analysis result corresponding to the photographed image 40A.

[0068] Next, the passerby face image identification unit 18F uses the position of the portable part P identified by the portable part identification unit 18E in the captured image 40A, the skeletal information Ba and skeletal information Bb, the face position Qa of the face image area Fa and the face position Qb of the face image area Fb to identify the face image area Fa of the same user U as the user U who has the portable part P as the passerby face image FP.

[0069] In detail, the passerby face image specifying unit 18F uses the skeleton information B to specify, as the passerby face image FP, a face image area F of a face position Q that is present at the position of the head of a user U that has an appropriate positional relationship with a carrying part P, which is one of the body parts of the user U, and that is determined to be the same person as the user U who has the carrying part P. The criteria for determining the position of the head of the user U who is the same person as the carrying part P may be stored in advance in the storage unit 12 according to the type of the carrying part P. Then, the passerby face image specifying unit 18F specifies, using the type of the carrying part P and the corresponding criteria, the face image area F of the user U who is the same as the user U who has the carrying part P.

[0070] 4, the passerby face image specification unit 18F specifies, as the face image area F of the user U who is the same as the user Uy who has the carrying part P, a face image area Fa that is appropriate for the positional relationship of a single human body with respect to the carrying part P and that is located at a face position Qa that corresponds to the position of the head of the same user U as the carrying part P. Then, the passerby face image specification unit 18F specifies the specified face image area Fa as the passerby face image FP.

[0071] Through these processes, the specification unit 18D specifies, as a passerby face image FP, the face image area Fa of the user Uy who is carrying the authentication medium 30 when the identification information is read by the identification information reading unit 20, out of the face image area Fa and face image area Fb included in the captured image 40A. That is, in the case of the captured image 40A, the passerby face image specification unit 18F specifies, as a passerby face image FP, the face image area Fa of the user Uy who has the hand, which is the carrying part P that carries the authentication medium 30, as a part of his body.

[0072] Returning to Figure 2, we continue the explanation.

[0073] The captured image acquisition unit 18C may acquire, from the storage unit 12, a captured image 40 that allows the identification unit 18D to estimate the carrying part P of the user U when reading by the identification information reading unit 20. Therefore, the captured image 40 acquired by the captured image acquisition unit 18C is not limited to one captured image 40 when reading by the identification information reading unit 20.

[0074] For example, the captured image acquisition unit 18C may acquire from the storage unit 12 a plurality of captured images 40 captured in chronological order of the passage area S. In detail, the captured image acquisition unit 18C may acquire from the storage unit 12 any of a plurality of captured images 40 that are successive in time series from a capture time that is the same as the read time corresponding to the identification information acquired by the identification information acquisition unit 18B toward a past time, a plurality of captured images 40 that are successive in time series from a capture time that is the same as the read time toward a future time, or a plurality of captured images 40 that are successive in time series from the read time toward both a past time and a future time. At this time, the captured image acquisition unit 18C also reads from the storage unit 12 the analysis results corresponding to each of the plurality of captured images 40.

[0075] In this case, the carrying part identification unit 18E of the identification unit 18D can identify the carrying part P by inferring the carrying part P of the authentication medium 30 at the time the reading unit 20 reads the identification information based on the multiple captured images 40 acquired by the captured image acquisition unit 18C.

[0076] For example, the carrying part identification unit 18E tracks the movement of the carrying part P along the time series by identifying the carrying part P in each of a plurality of chronologically consecutive captured images 40. This tracking process may be performed using a known image processing technique. Then, the carrying part identification unit 18E may use the tracking results of the movement of the carrying part P to estimate the position of the carrying part P at the time the identification information is read, thereby identifying the position of the carrying part P.

[0077] In this case, even if it is difficult to identify the position of the portable part P from the captured image 40 at the time the identification information is read by the reading unit 20, the portable part identification unit 18E can estimate the position of the portable part P at the time the identification information is read by the above-mentioned tracking process.

[0078] Next, the authentication unit 18G will be described.

[0079] The authentication unit 18G determines whether or not the passerby face image FP identified by the identification unit 18D matches the correct face image corresponding to the identification information acquired by the identification information acquisition unit 18B.

[0080] The authentication unit 18G reads a correct facial image corresponding to the identification information acquired by the identification information acquisition unit 18B from the user management information 12A. Then, the authentication unit 18G determines whether the read correct facial image matches the passerby facial image FP identified by the identification unit 18D. The authentication unit 18G determines that the correct facial image matches the passerby facial image FP if the feature amounts of the correct facial image and the feature amounts of the passerby facial image FP are the same or similar. A known image processing technique may be used to derive the feature amounts from the image. To determine whether the passerby facial image FP and the correct facial image are similar, a threshold value for the difference in feature amounts that can be used to determine that the passerby facial image FP and the correct facial image are images of the face of the same person may be set in advance. Then, the authentication unit 18G determines that the correct facial image matches the passerby facial image FP if the difference in feature amounts is less than the threshold value.

[0081] If the authentication unit 18G determines that the correct face image and the passerby face image FP match, it authenticates the user U carrying the authentication medium 30 as a person to be permitted to pass. The user U carrying the authentication medium 30 is the user U carrying the authentication medium 30 from which the identification information acquired by the identification information acquisition unit 18B was read. In other words, the user U carrying the authentication medium 30 is the user U who was carrying the authentication medium 30 when the reading unit 20 read the identification information.

[0082] On the other hand, if the authentication unit 18G determines that the correct facial image and the passerby facial image FP do not match, it authenticates the user U carrying the authentication medium 30 as not eligible for passage. In other words, if the correct facial image and the passerby facial image FP do not match, the authentication unit 18G authenticates the user U who was carrying the authentication medium 30 when the reading unit 20 read the identification information as not eligible for passage.

[0083] Note that there are cases where the identification information acquired by the identification information acquisition unit 18B is not registered in the user management information 12 A. Therefore, when the identification information acquired by the identification information acquisition unit 18B is not registered in the user management information 12 A, the authentication unit 18G can authenticate the user U identified by the identification information as not being subject to passage permission.

[0084] There are also cases where the passerby face image specifying unit 18F cannot specify the passerby face image FP. For example, this may occur when the user U enters the passage area S while hiding his or her face. In this case, the face image area F of the user U, who has the carrying part P of the authentication medium 30 as part of his or her body, does not appear in the captured image 40. For this reason, there are cases where the passerby face image specifying unit 18F cannot specify the passerby face image FP. In this case, the authentication unit 18G may authenticate the user U identified by the identification information acquired by the identification information acquisition unit 18B as not being permitted to pass.

[0085] The passage control unit 18H controls the passage opening / closing drive unit 26 provided in the passage area S so as to permit or restrict the passage of the user U through the passage area S according to the authentication result by the authentication unit 18G.

[0086] This will be explained using Figure 1. When the authentication result by the authentication unit 18G indicates that the user is permitted to pass, the passage control unit 18H controls the passage opening / closing drive unit 26 to switch the door member 28 to an open state. As a result of the control of the passage opening / closing drive unit 26 by the passage control unit 18H, the passage opening / closing drive unit 26 switches the state of the door member 28 to an open state. When the passage opening / closing drive unit 26 switches the door member 28 to an open state, a user U attempting to pass through the passage area S can pass through the passage area S.

[0087] When the authentication result by the authentication unit 18G indicates that the user U is not subject to passage permission, the passage control unit 18H controls the passage opening / closing drive unit 26 to switch the door member 28 to the closed state. As a result of the control of the passage opening / closing drive unit 26 by the passage control unit 18H, the passage opening / closing drive unit 26 switches the state of the door member 28 to the closed state. As a result of the passage opening / closing drive unit 26 switching the door member 28 to the closed state, the user U attempting to pass through the passage area S is restricted from passing through the passage area S.

[0088] Returning to Figure 2, we continue the explanation.

[0089] The output control unit 18I outputs the authentication result by the authentication unit 18G. For example, the output control unit 18I displays the authentication result by the authentication unit 18G on the UI unit 14. The output control unit 18I may transmit the authentication result by the authentication unit 18G to an external information processing device via the communication unit 16. The output control unit 18I may also output the authentication result by the authentication unit 18G to an output mechanism provided in the passage housing 24. The output mechanism may be, for example, a display that displays images, a speaker that outputs sound, a light that emits light, or the like, but is not limited to these.

[0090] Next, an example of the flow of information processing executed by the traffic control device 10 of this embodiment will be described.

[0091] FIG. 5 is a flowchart showing an example of the flow of information processing executed by the traffic management device 10 of this embodiment.

[0092] The photographed image analysis unit 18A receives the photographed image 40 from the photographing unit 22 (step S100). The photographed image analysis unit 18A analyzes the photographed image 40 received in step S100 (step S102). The photographed image analysis unit 18A associates the analysis result obtained in step S102 with the photographed image 40 used in the analysis and the photographed time of the photographed image 40, and stores them in the storage unit 12 (step S104). The analysis result of the photographed image 40 includes a face image area F and skeletal information B.

[0093] By having the captured image analysis unit 18A analyze the captured image 40, the processing time from reading the identification information from the authentication medium 30 to outputting the authentication result can be shortened compared to when the identification unit 18D analyzes the captured image 40, derives the analysis results, and then executes the identification process.

[0094] The identification information acquisition unit 18B determines whether or not the identification information has been acquired from the reading unit 20 (step S106). If a negative determination is made in step S106 (step S106: No), the process returns to step S100. If a positive determination is made in step S106 (step S106: Yes), the process proceeds to step S108.

[0095] In step S108, the authentication unit 18G determines whether the identification information acquired in step S106 has been registered in the user management information 12A (step S108). If the authentication unit 18G determines that the identification information has not been registered (step S108: No), the process proceeds to step S128, which will be described later. If the authentication unit 18G determines that the identification information has been registered (step S108: Yes), the process proceeds to step S110.

[0096] In step S110, the photographed image acquisition unit 18C acquires the photographed image 40 of the passage area S (step S110). For example, the photographed image acquisition unit 18C acquires, from among the photographed images 40 analyzed by the photographed image analysis unit 18A, the photographed image 40 whose shooting time coincides with the reading time of the identification information acquired in step S106.

[0097] The carrying part identification unit 18E identifies the carrying part P of the authentication medium 30 on the body of the user U that appears in the photographed image 40 from the photographed image 40 acquired in step S110 (step S112).

[0098] The passerby face image identification unit 18F identifies the face image area F of the user U who has the mobile part P identified in step S112 as part of their body as a passerby face image FP from among one or more face image areas F included in the captured image 40 acquired in step S110 (step S114).

[0099] The authentication unit 18G determines whether or not the passerby face image FP was identified in step S114 (step S116). If the authentication unit 18G determines that the passerby face image FP was not identified (step S116: No), the process proceeds to step S128. If the authentication unit 18G determines that the passerby face image FP was identified (step S116: Yes), the process proceeds to step S118.

[0100] In step S118, the authentication unit 18G determines whether the passerby face image FP identified in step S114 matches the correct face image corresponding to the identification information acquired in step S106 (step S120). If the authentication unit 18G determines that they match (step S120: Yes), the process proceeds to step S122.

[0101] In step S122, the user U carrying the authentication medium 30 on which the identification information acquired in step S106 is recorded is authenticated as a person to be permitted to pass (step S122).

[0102] Next, the passage control unit 18H controls the passage gate opening / closing drive unit 26 provided in the passage area S to permit the user U to pass through the passage area S (step S124). The output control unit 18I outputs the authentication result indicating the subject of passage permit (step S126). Then, this routine ends.

[0103] On the other hand, if the authentication unit 18G determines that there is a mismatch in step S120 (step S120: No), the process proceeds to step S128.

[0104] In step S128, the authentication unit 18G authenticates the user U in the passage area S as not being permitted to pass (step S128). Through the processing of step S128, the authentication unit 18G authenticates the user U who was carrying the authentication medium 30 on which the identification information acquired in step S106 was recorded at the time the identification information reading unit 20 read the authentication medium 30 as not being permitted to pass.

[0105] Next, the passage control unit 18H controls the passage opening / closing drive unit 26 provided in the passage area S so as to restrict the passage of the user U through the passage area S (step S130). The output control unit 18I outputs an authentication result indicating that the user U is not permitted to pass (step S132). Then, this routine ends.

[0106] As described above, the passage management device 10 of this embodiment includes an identification information acquisition unit 18B, a captured image acquisition unit 18C, an identification unit 18D, and an authentication unit 18G. The captured image analysis unit 18A acquires identification information read by a reading unit 20 installed in the passage area S, which reads the user U's identification information from the authentication medium 30. The captured image acquisition unit 18C acquires a captured image 40 of the passage area S. The identification unit 18D identifies the face image area F of the user U carrying the authentication medium 30 as a passerby face image FP from one or more face image areas F included in the captured image 40. If the passerby face image FP matches a pre-stored correct face image corresponding to the identification information, the authentication unit 18G authenticates the user U carrying the authentication medium 30 as a person eligible for passage. If they do not match, the authentication unit 18G authenticates the user U carrying the authentication medium 30 as a person eligible for passage.

[0107] Here, a conventional technique has been disclosed that prevents unauthorized entry using a photograph of a legitimate user's face by determining that authentication is not permitted if the positional relationship between the face and non-face positions in a photographed image of the entrant is abnormal. However, this conventional technique cannot determine that authentication is not permitted if a user who is not hiding their face appears in a single photographed image 40 together with a user who is hiding their face. Furthermore, this conventional technique cannot determine that authentication is not permitted if a user whose face appears in a photographed image 40 passes through using an authentication medium 30 on which the identification information of another user is recorded.

[0108] Furthermore, a conventional technique has been disclosed that prevents unauthorized pedestrians from passing along with authorized pedestrians by determining that unauthorized passage has occurred when further passage detected after the passage of authorized pedestrians has been detected. However, with this conventional technique, it is difficult to determine whether unauthorized passage has occurred when authorized pedestrians and unauthorized pedestrians attempt to pass through the passage area S at the same time.

[0109] As described above, in the conventional technology, it may be difficult to detect fraud in situations such as when both a user U who is permitted to pass and a user U who is not permitted to pass appear in the captured image 40 to be verified at the same time, or when a user U who is not permitted to pass carries the authentication medium 30 of a user U who is permitted to pass. In other words, in the conventional technology, security regarding passage may be reduced.

[0110] On the other hand, in the passage management device 10 of this embodiment, the identification unit 18D identifies the facial image area F of the user U carrying the authentication medium 30 as a passerby facial image FP from one or more facial image areas F included in the captured image 40. Then, if the passerby facial image FP does not match the pre-stored correct facial image corresponding to the identification information read from the authentication medium 30, the authentication unit 18G authenticates the user U carrying the authentication medium 30 as not eligible for passage.

[0111] In this way, the passage management device 10 of this embodiment identifies the facial image area F of a user U carrying an authentication medium 30 on which identification information is recorded as a passerby facial image FP, and certifies whether the passerby is eligible for passage permission or not by comparing the passerby facial image FP with the correct facial image corresponding to the identification information.

[0112] Therefore, the passage management device 10 of this embodiment can accurately authenticate whether a user U is eligible for passage or not, even if both a user U who is eligible for passage and a user U who is not eligible for passage appear simultaneously in the captured image 40 to be verified, or even if a user U who is not eligible for passage carries the authentication medium 30 of a user U who is eligible for passage.

[0113] Therefore, the traffic control device 10 of this embodiment can improve security regarding traffic.

[0114] The effects of the traffic control device 10 of this embodiment will be described with specific examples using FIGS. 1, 4, 6 and 7. FIG.

[0115] For example, as shown in FIG. 1, assume a situation in which two users U, user Ux and user Uy, are present within the photographing range of the passage area S of the photographing unit 22. Also assume a situation in which the identification information and correct facial image of user Ux are associated and registered in the user management information 12A, but at least one of the identification information and correct facial image of user Uy is not registered in the user management information 12A. Also assume a situation in which user Uy is attempting to pass through the passage area S while carrying an authentication medium 30 on which the identification information of user Ux (see "UxID" in FIG. 1) is recorded, rather than his / her own identification information. Also assume a situation in which users Uy and Ux cooperate and adjust their positions so that users Uy and Ux are present within the photographing range of the photographing unit 22 when the reading unit 20 reads the authentication medium 30.

[0116] 4, 6 and 7 are explanatory diagrams of an example of a photographed image 40 photographed under the above assumption.

[0117] First, a description will be given with reference to Fig. 4. A photographed image 40A shown in Fig. 4 is an explanatory diagram of an example of a photographed image 40 in which two users U, a user Uy carrying an authentication medium 30 on which identification information "UxID" of the user Ux is recorded, and a user Ux not carrying the authentication medium 30, are photographed side by side diagonally.

[0118] In this case, the identification information acquisition unit 18B acquires the identification information "UxID" of the user Ux from the reading unit 20 that reads the authentication medium 30. Furthermore, the captured image acquisition unit 18C acquires a captured image 40A as the captured image 40 when the identification information "UxID" is read. The captured image 40A is analyzed by the captured image analysis unit 18A into the facial image area Fa of the user Uy, the skeletal information Ba of the user Uy, the facial image area Fb of the user Ux, and the skeletal information Bb of the user Ux.

[0119] The identification unit 18D performs the above-described identification process using the captured image 40A, thereby identifying the facial image area Fa of the user Uy carrying the authentication medium 30 when reading the identification information "UxID" as the passerby facial image FP. The authentication unit 18G then determines whether the correct facial image corresponding to the identification information "UxID" matches the identified passerby facial image FP. Here, the identification information read from the authentication medium 30 is the identification information "UxID" of the user Ux. Meanwhile, the user U carrying the authentication medium 30 is user Uy, and the passerby facial image FP identified by the identification unit 18D is the facial image area Fa of the user Uy. Therefore, the correct facial image corresponding to the identification information "UxID" does not match the identified passerby facial image FP. Therefore, in this case, the authentication unit 18G authenticates the user Uy carrying the authentication medium 30 as not being permitted to pass.

[0120] Therefore, when both a user Ux who is permitted to pass and a user U who is not permitted to pass appear simultaneously in the captured image 40 to be verified, and the user Uy who is not permitted to pass carries the authentication medium 30 on which the identification information of the user Ux who is permitted to pass is recorded, the passage management device 10 of this embodiment can authenticate the user as not being permitted to pass. In other words, the passage management device 10 can prevent the user Uy from impersonating the user Ux and illegally passing through the passage area S.

[0121] 6 is a schematic diagram of an example of the photographed image 40B. The photographed image 40B is an example of the photographed image 40.

[0122] The captured image 40B shown in Figure 6 is an explanatory diagram of an example of a captured image 40 that captures two users U: user Uy, who is carrying an authentication medium 30 on which user Ux's identification information "UxID" is recorded and whose face is hidden by a covering member C, and user Ux, who is not carrying an authentication medium 30.

[0123] In this case, the identification information acquisition unit 18B acquires the identification information "UxID" of the user Ux from the reading unit 20 that reads the authentication medium 30. Furthermore, the captured image acquisition unit 18C acquires the captured image 40B as the captured image 40 when the identification information "UxID" is read. The captured image 40B is analyzed by the captured image analysis unit 18A into the skeletal information Ba of the user Uy, the facial image area Fb of the user Ux, and the skeletal information Bb of the user Ux. Because the face of the user Uy is hidden by the covering member C, the facial image area F of the user Uy is not included in the analysis result.

[0124] The identification unit 18D executes the above-described identification process using the captured image 40B, but when reading the identification information "UxID," it is unable to identify the facial image area F of the user Uy carrying the authentication medium 30 on which the identification information is recorded. This is because the face of the user Uy is hidden by the covering member C. For this reason, the authentication unit 18G authenticates the user Uy carrying the authentication medium 30 as not being permitted to pass.

[0125] Therefore, the passage management device 10 of this embodiment can certify that a user Uy who is not eligible for passage permission is not eligible for passage permission when both the user Ux who is eligible for passage permission and the user U who is not eligible for passage permission appear simultaneously in the captured image 40 to be verified, and the user Uy who is not eligible for passage permission is hidden by a covering member C or the like.

[0126] 7 is a schematic diagram of an example of a photographed image 40C. The photographed image 40C is an example of the photographed image 40.

[0127] The captured image 40C shown in Figure 7 is an explanatory diagram of an example of a captured image 40 in which two users U, a user Uy carrying an authentication medium 30 on which the identification information "UxID" of the user Ux is recorded, and a user Ux not carrying the authentication medium 30, are captured side by side along the direction of entry into the passage area S (see the arrow X direction in Figure 1).

[0128] In this case, the identification information acquisition unit 18B acquires the identification information "UxID" of the user Ux from the reading unit 20 that reads the authentication medium 30. The captured image acquisition unit 18C also acquires a captured image 40C as the captured image 40 when the identification information "UxID" is read. The captured image 40C is analyzed by the captured image analysis unit 18A into the facial image area Fa of the user Uy, the skeletal information Ba of the user Uy, and the facial image area Fb of the user Ux. The skeletal information Bb of the user Ux is hidden by the user Uy during analysis and is not included in the analysis results.

[0129] The identification unit 18D executes the above-described identification process using the captured image 40C, thereby identifying the facial image area Fa of the user Uy carrying the authentication medium 30 as the passerby facial image FP when reading the identification information "UxID." That is, by using the analysis result, the identification unit 18D identifies the facial image area Fa of the user Uy carrying the authentication medium 30 as the passerby facial image FP, instead of the user Ux who appears overlapping behind the user Uy, as the facial image area F of the user U carrying the authentication medium 30.

[0130] Then, the authentication unit 18G determines whether the correct facial image corresponding to the identification information "UxID" matches the identified passerby facial image FP. Here, the identification information read from the authentication medium 30 is the identification information "UxID" of the user Ux. Meanwhile, the user U carrying the authentication medium 30 is user Uy, and the passerby facial image FP identified by the identification unit 18D is the facial image area Fa of user Uy. Therefore, the correct facial image corresponding to the identification information "UxID" does not match the identified passerby facial image FP. Therefore, in this case, the authentication unit 18G authenticates the user Uy carrying the authentication medium 30 as not being permitted to pass.

[0131] In addition, if the number of facial image areas F contained in the captured image 40C does not match the number of detected skeletal information B represented by the skeletal information B contained in the analysis result of the captured image 40C, the authentication unit 18G may authenticate the user U captured in the captured image 40C as not being eligible for passage.

[0132] Therefore, the passage management device 10 of this embodiment can certify that a user Ux who is eligible for passage and a user U who is not eligible for passage are not eligible for passage when both appear simultaneously in the captured image 40 to be verified, and the user Uy who is not eligible for passage carries an authentication medium 30 on which the identification information of the user Ux who is eligible for passage is recorded.

[0133] Therefore, the traffic control device 10 of this embodiment can improve security regarding traffic.

[0134] Next, an example of the hardware configuration of the traffic control device 10 of the above embodiment will be described.

[0135] FIG. 8 is a hardware configuration diagram of an example of the traffic management device 10 of the above embodiment.

[0136] The traffic management device 10 of the above embodiment is configured as a hardware using a normal computer, and includes a control device such as a CPU (Central Processing Unit) 90D, storage devices such as a ROM (Read Only Memory) 90E, a RAM (Random Access Memory) 90F, and a HDD (Hard Disk Drive) 90G, an I / F unit 90B that interfaces with various devices, an output unit 90A that outputs various information, an input unit 90C that accepts user operations, and a bus 90H that connects each unit. In this case, the control unit 18 in FIG. 2 corresponds to the control device such as the CPU 90D.

[0137] In the traffic management device 10 of the above embodiment, the CPU 90D reads out the traffic management program from the ROM 90E onto the RAM 90F and executes it, thereby realizing the above-mentioned respective units on the computer.

[0138] The traffic management program for executing each of the above processes executed by the traffic management device 10 of the above embodiment may be stored in the HDD 90G. Also, the traffic management program for executing each of the above processes executed by the traffic management device 10 of the above embodiment may be provided by being pre-installed in the ROM 90E.

[0139] Furthermore, the traffic management program for executing the above-described processes executed by the traffic management device 10 of the above-described embodiment may be stored in an installable or executable file format on a computer-readable storage medium such as a CD-ROM, CD-R, memory card, DVD (Digital Versatile Disc), or flexible disk (FD) and provided as a computer program product. Furthermore, the traffic management program for executing the above-described processes executed by the traffic management device 10 of the above-described embodiment may be stored on a computer connected to a network such as the Internet and provided by being downloaded via the network. Furthermore, the traffic management program for executing the above-described processes executed by the traffic management device 10 of the above-described embodiment may be provided or distributed via a network such as the Internet.

[0140] In the above, an example is shown in which the traffic management device 10 is composed of the traffic management device 10, the UI unit 14, and the communication unit 16, but the traffic management device of the present invention may also be composed of the control unit 18.

[0141] Although the embodiments of the present invention have been described above, these embodiments are presented as examples and are not intended to limit the scope of the invention. This novel embodiment can be embodied in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. This embodiment and its modifications are included within the scope and spirit of the invention, and are also included in the inventions and their equivalents as defined in the claims. [Explanation of symbols]

[0142] 10 Traffic control device 18B Identification information acquisition section 18C Image acquisition unit 18D Specific part 18E Mobile Part Identification Unit 18F Passerby face image identification unit 18G Authentication Department 18H Traffic Control Unit 18I Output control section

Claims

1. A traffic management program to be executed by a computer, an identification information acquisition step of acquiring the user's identification information read by a reading unit installed in the passage area and configured to read the user's identification information from the authentication medium; a photographed image acquisition step of acquiring a photographed image of the passage area; a step of identifying the face image area of ​​the user carrying the authentication medium as a passerby face image from among one or more face image areas included in the captured image; an authentication step of authenticating a user carrying the authentication medium as a person who is permitted to pass if the face image of the passerby matches a pre-stored correct face image corresponding to the identification information, and authenticating the user carrying the authentication medium as a person who is not permitted to pass if the face image of the passerby matches a correct face image; Including, The identifying step includes: a carrying part identification step of identifying a carrying part of the authentication medium on the user's body that appears in the photographed image from the photographed image; a passerby face image specifying step of specifying, as the passerby face image, the face image area of ​​a user who has the specified carrying part as a part of their body, from among the one or more face image areas included in the photographed image; Including, Traffic management program.

2. The identifying step includes: Among one or more facial image areas included in the captured image, the facial image area of ​​the user carrying the authentication medium is identified as the passerby facial image when the reading unit reads the identification information from the authentication medium. The traffic management program according to claim 1 .

3. The passerby face image specifying step includes: using a positional relationship between the carrying part based on skeletal information of the user included in the photographed image and each face image position of one or more of the face image areas based on the skeletal information included in the photographed image, the face image area of ​​the user who has the carrying part as a part of their body is identified as the passerby face image; The traffic management program according to claim 1 .

4. The carrying part is a user's hand. The traffic management program according to claim 1 .

5. The photographed image acquisition step includes: acquiring the captured image at the time of reading at least the identification information by the reading unit; The traffic management program according to claim 1 .

6. The photographed image acquisition step includes: acquiring a plurality of images of the passage area taken in time series; The carrying part specifying step includes: and identifying the carrying part by estimating the carrying part of the authentication medium at the time of reading the identification information by the reading unit based on the plurality of captured images. The traffic management program according to claim 1 .

7. an output control step of outputting an authentication result obtained by the authentication step; The traffic management program according to claim 1 , further comprising:

8. a passage control step of controlling a passage opening / closing drive unit provided in the passage area so as to permit or restrict passage of a user in the passage area according to the authentication result of the authentication step; The traffic management program according to claim 1 , further comprising:

9. A traffic management method executed by a control unit, an identification information acquisition step of acquiring the user's identification information read by a reading unit installed in the passage area and configured to read the user's identification information from the authentication medium; a photographed image acquisition step of acquiring a photographed image of the passage area; a step of identifying the face image area of ​​the user carrying the authentication medium as a passerby face image from among one or more face image areas included in the captured image; an authentication step of authenticating a user carrying the authentication medium as a person who is permitted to pass if the face image of the passerby matches a pre-stored correct face image corresponding to the identification information, and authenticating the user carrying the authentication medium as a person who is not permitted to pass if the face image of the passerby matches a correct face image; Including, The identifying step includes: a carrying part identification step of identifying a carrying part of the authentication medium on the user's body that appears in the photographed image from the photographed image; a passerby face image specifying step of specifying, as the passerby face image, the face image area of ​​a user who has the specified carrying part as a part of their body, from among the one or more face image areas included in the photographed image; Including, Traffic management method.

10. an identification information acquisition unit that is installed in the passage area and acquires the user's identification information read by a reading unit that reads the user's identification information from an authentication medium; a captured image acquisition unit that acquires a captured image of the passage area; an identifying unit that identifies the face image area of ​​the user carrying the authentication medium as a passerby face image from among one or more face image areas included in the captured image; an authentication unit that authenticates a user carrying the authentication medium as a person eligible for passage if the face image of the passerby matches a pre-stored correct face image corresponding to the identification information, and authenticates the user carrying the authentication medium as a person not eligible for passage if the face image of the passerby matches a correct face image; Equipped with The identification unit a carrying part specifying unit that specifies a carrying part of the authentication medium on the user's body that appears in the photographed image from the photographed image; a passerby face image specifying unit that specifies, as the passerby face image, the face image area of ​​a user who has the specified carrying part as a part of their body, from among the one or more face image areas included in the captured image; having Traffic control device.

Images