Attendance management system and attendance management terminal

Abstract

To provide an attendance management system and an attendance management terminal capable of acquiring accurate attendance times of persons who are targets for attendance management.SOLUTION: An attendance management system includes a terminal including a camera, and a data management device. The terminal performs face authentication based on a user's facial images captured by the camera, detects the user's direction of traffic based on the time-series facial images, determines whether the direction of traffic is an entry direction, which is the direction in which the user enters a work place, or an exit direction, which is the direction in which the user leaves the work place, thereby obtains stamped time as entry time or exit time (entry / exit time), and transmits it to the data management device. The data management device stores attendance time based on the entry / exit time received from the terminal in attendance management information as the user's attendance time.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to an attendance management system and an attendance management terminal. [Background technology]

[0002] A technology related to the present invention is an attendance management system (hereinafter referred to as the "conventional system") disclosed in Patent Document 1. The conventional system includes an entrance camera and an exit camera, an entrance receiving device and an exit receiving device, a personal authentication server, an image analysis server, and an attendance management server.

[0003] According to the conventional system, a mobile device carried by an employee transmits a push communication signal including the employee's authentication code to an entry receiving device or an exit receiving device. The personal authentication server receives the push communication signal including the employee's authentication code from the mobile device via the entry receiving device or the exit receiving device. The personal authentication server performs personal authentication based on the push communication signal, and outputs personal authentication information to the image analysis server if personal authentication is successful.

[0004] The image analysis server determines whether the employee is the person carrying the mobile device based on the employee's image taken by the entrance camera or the exit camera and the personal authentication information. If the image analysis server determines that the employee is the employee, it outputs the time when the employee entered the building through the entrance as the entrance passage time, and outputs the time when the employee left the building through the entrance as the exit passage time. The attendance management server manages the employee's attendance based on the entrance passage time and exit passage time input from the image analysis server. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Patent Publication No. 2021-182237 Summary of the Invention [Problem to be solved by the invention]

[0006] In the conventional system, the subject (employee) of attendance management needs to have a mobile terminal in order to perform personal authentication, which is inconvenient. Therefore, the inventors of the present application are considering constructing an attendance management system using face recognition, which uses a terminal equipped with a camera so that the subject does not need to have a mobile terminal, further eliminates the need for button operation for personal authentication, and further prevents fraud by impersonation. In this case, the terminal captures the subject's face with a camera to obtain a face image and performs face authentication of the subject based on the face image. However, such an attendance management system cannot determine whether the subject who has undergone face authentication has entered or left the workplace. Therefore, such an attendance management system makes it difficult to obtain the subject's accurate attendance time.

[0007] The present invention has been made to solve the above problems. That is, one of the objects of the present invention is to provide an attendance management system and an attendance management terminal that can obtain accurate attendance times of persons who are the subject of attendance management. [Means for solving the problem]

[0008] In order to solve the above-mentioned problems, the present invention provides an attendance management system including an attendance management terminal including a camera that captures an image of an imaging range and that is installed at a predetermined location to detect a user's entry and exit to a workplace, and a data management device including a storage device in which attendance management information for managing the user's attendance is stored, the attendance management terminal and the data management device being configured to be able to transmit and receive information to each other, the attendance management terminal performing face authentication to authenticate the user based on a facial image of the user captured by the camera, punch time detection to detect a specific time related to the face authentication as a punch time, and detecting the user's walking direction associated with the face authentication based on a time-series face image including the face image at the time of the face authentication, and detecting whether the walking direction is a direction in which the user is walking forward or backward. and determining whether the user's traffic direction is an entry direction, which is the direction in which the user enters the workplace, or an exit direction, which is the direction in which the user leaves the workplace.If the traffic direction is the entry direction, the stamping time is transmitted to the data management device as the user's entry time to the workplace, and if the traffic direction is the exit direction, the stamping time is transmitted to the data management device as the user's exit time from the workplace.The data management device is configured to store the attendance time based on the entry time received from the attendance management terminal in the attendance management information as the user's attendance time, and to store the attendance time based on the exit time received from the attendance management terminal in the attendance management information as the user's attendance time.

[0009] The attendance management system of the present invention includes an attendance management terminal including a camera that captures an image of an imaging range and is installed at a predetermined location to detect a user's entry and exit to a workplace, a data management device including a storage device in which attendance management information for managing the user's attendance is stored, and a user passage detector that detects the passage of the user at an entrance and exit to the workplace, the attendance management terminal and the data management device being configured to be able to transmit and receive information to each other, the attendance management terminal performs face authentication to authenticate the user based on a facial image of the user captured by the camera, punch time detection to detect a specific time related to the face authentication as a punch time, and detects the user's passing direction associated with the face authentication based on a time-series face image including the face image at the time of the face authentication, and if a door opening is detected after the face authentication during the period from the time of the face authentication to a time when a predetermined time has elapsed, the user's passing direction is determined to be the direction in which the user is passing through the workplace. and if the face authentication is performed between the time the user's passage is detected by the user passage detector and a time a predetermined time has elapsed since the time the user's passage was detected, a user passage direction determination is performed to determine that the user's passage direction is an exit direction, which is the direction in which the user leaves the workplace, and if the passage direction is the entry direction, transmits the punch time to the data management device as the entry time of the user into the workplace, and if the passage direction is the exit direction, transmits the punch time to the data management device as the exit time of the user from the workplace, and the data management device is configured to store the attendance time based on the entry time received from the attendance management terminal as the attendance time of the user in the attendance management information, and store the attendance time based on the exit time received from the attendance management terminal as the attendance time of the user in the attendance management information.

[0010] The attendance management terminal of the present invention is configured to be able to send and receive information to and from a data management device for managing a user's attendance, and includes a camera that captures an image of an imaging range and a control unit, and is installed in a predetermined location to detect a user's entry and exit to the workplace, and the control unit is configured to perform facial authentication to authenticate the user based on a facial image of the user captured by the camera, punch time detection to detect a specific time related to the facial authentication as the punch time, and user traffic direction determination to detect the user's walking direction associated with the facial authentication based on a time-series facial image including the facial image at the time of the facial authentication and determine whether the walking direction is an entry direction in which the user enters the workplace or an exit direction in which the user leaves the workplace, and if the walking direction is the entry direction, transmit the punch time to the data management device as the user's entry time to the workplace, and if the walking direction is the exit direction, transmit the punch time to the data management device as the user's exit time from the workplace.

[0011] Furthermore, the present invention corresponds to the above-mentioned terminal, device and system, and is a method implemented in the above-mentioned terminal, device and system, and a program used therein. Effect of the Invention

[0012] According to the present invention, accurate attendance times of persons who are the subject of attendance management can be obtained. [Brief description of the drawings]

[0013] [Figure 1] FIG. 1 is a system configuration diagram of an example of the system configuration of a time attendance management system according to a first embodiment of the present invention. [Diagram 2] FIG. 2 is a schematic diagram showing an example of the hardware configuration of the terminal 100. As shown in FIG. [Diagram 3] FIG. 3 is a diagram for explaining the user management table. [Figure 4] FIG. 4 is a diagram for explaining the attendance management table. [Diagram 5] FIG. 5 is a schematic diagram illustrating an example of a hardware configuration of the data management device. [Figure 6] FIG. 6 is a diagram for explaining an outline of the operation of the attendance management system. [Figure 7] FIG. 7 is a diagram for explaining a method for detecting the traffic direction. [Figure 8A] FIG. 8A is a diagram for explaining the entry determination. [Figure 8B] FIG. 8B is a diagram for explaining the entry determination. [Figure 8C] FIG. 8C is a diagram for explaining the room exit determination. [Figure 8D] FIG. 8D is a diagram for explaining the room exit determination. [Figure 9] FIG. 9 is a diagram for explaining a process flow executed by the terminal. [Figure 10] FIG. 10 is a system configuration diagram showing an example of the configuration of the attendance management system according to the second embodiment of the present invention. [Figure 11A] FIG. 11A is a diagram for explaining the operation of the attendance management system according to the second embodiment. [Figure 11B] FIG. 11B is a diagram for explaining the operation of the attendance management system according to the second embodiment. [Figure 12A] FIG. 12A is a diagram for explaining the operation of the attendance management system according to the third embodiment of the present invention. [Figure 12B] FIG. 12B is a diagram for explaining the operation of the attendance management system according to the third embodiment. [Figure 13A] FIG. 13A is a diagram for explaining a method for detecting a traffic direction. [Figure 13B] FIG. 13B is a diagram for explaining a method for detecting a traffic direction. [Figure 14A] FIG. 14A is a diagram for explaining the entry determination. [Figure 14B] FIG. 14B is a diagram for explaining the room exit determination. [Figure 15] FIG. 15 is a diagram for explaining an example of a setting screen of a terminal. [Figure 16A] FIG. 16A is a diagram for explaining a first example of the setting of the installation state and the traffic direction of the terminal. [Figure 16B] FIG. 16B is a diagram for explaining a first example of the setting of the installation state and the traffic direction of the terminal. [Figure 17A] FIG. 17A is a diagram for explaining a second example of the setting of the installation state and the traffic direction of the terminal. [Figure 17B] FIG. 17B is a diagram for explaining a second example of the setting of the installation state and the traffic direction of the terminal. [Figure 18] FIG. 18 is a diagram for explaining the installation state of the terminal. [Figure 19A] FIG. 19A is a diagram for explaining an example of a setting screen of a terminal. [Figure 19B] FIG. 19B is a diagram for explaining an example of a setting screen of a terminal. [Figure 20] FIG. 20 is a diagram for explaining an example of a setting screen of a terminal. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0014] Hereinafter, each embodiment of the present invention will be described with reference to the drawings. In addition, in all the drawings of the embodiments, the same or corresponding parts may be denoted by the same reference numerals.

[0015] In the following description, when describing identification information, expressions such as "ID" are used, but other identification information (for example, name, etc.) may be substituted. In addition, in the following description, processing may be described using functional blocks as the subject, but the subject of the processing may be a CPU or a device instead of a functional block. In addition, in the following description, various information may be described using expressions such as "table" and "record," but the various information may be expressed in data structures other than these. Entering a room may be expressed as "entering," and leaving a room may be expressed as "exiting."

[0016] <<First embodiment>> <Configuration> Fig. 1 is a system configuration diagram of an attendance management system according to a first embodiment of the present invention. As shown in Fig. 1, the attendance management system includes a terminal 100 and a data management device 200. The terminal 100 and the data management device 200 are connected to each other via a network NW1 so as to be able to transmit and receive information to and from each other. For convenience, the terminal 100 may be referred to as an "attendance management terminal."

[0017] 2 is a schematic diagram showing an example of the hardware configuration of the terminal 100. The terminal 100 includes a camera 110, a display 120, a CPU board 130, a storage device 140, and an interface (I / F) 150. These are connected via a bus (not shown) so as to be able to transmit and receive information to and from each other.

[0018] Every time a predetermined time elapses, the camera 110 captures an image of an imaging range in front of the camera 110. The camera 110 captures an image of the user Us1 who is present within the imaging range in front of the camera 110, and obtains a captured image of the user Us1.

[0019] The display 120 is a display device capable of displaying images, and in this example is a touch panel display that functions as both a display device and an input device.

[0020] The CPU board 130 is a board on which a CPU, a RAM, a ROM, etc. are mounted. The CPU loads a program stored in the ROM into the RAM. The CPU executes the program loaded into the RAM to realize various functions.

[0021] The storage device 140 is a non-volatile storage device (storage medium) from which data can be read and written.

[0022] The interface 150 is an interface for connecting the terminal 100 to the network NW1.

[0023] The data management device 200 includes a data management unit 210 and a database 220. The database 220 includes a user management table 230 and an attendance management table 240. The data management unit 210 acquires from the terminal 100 user punch information detected by the terminal 100, and stores attendance times based on the user punch information in the attendance management table 240 of the database 220. Here, the user punch information includes a user ID and an entry time and / or a leaving time. The attendance times are times for managing the attendance status of the user Us1, such as the arrival time, departure time, leaving time, and re-entry time (return time), for example.

[0024] FIG. 3 is a diagram for explaining the user management table 230. As shown in FIG. 3, the user management table 230 includes a user ID 311, a user name 312, and user feature information 313 as columns for storing information (values). In the user management table 230, information corresponding to each column related to user management is stored as information (records) on a row-by-row basis in association with each other. The user ID 311 stores identification information (user ID) for identifying the user Us1. The user name 312 stores the name of the user Us1. The user feature information 313 stores the facial feature amount of the user Us1 indicating the facial features of the user Us1.

[0025] FIG. 4 is a diagram for explaining the attendance management table 240. As shown in FIG. 4, the attendance management table 240 includes a day 411, a user 412, a working time 413, a clock-out time 414, a day out 415, and a re-entry time 416 as columns for storing information (values). In the attendance management table 240, information corresponding to each column related to attendance management is stored as information (records) in rows in association with each other. In the day 411, a date (year, month, and day) is stored. In the user 412, identification information (user ID) for identifying the user Us1 is stored. In the working time 413, a working time is stored. In the clock-out time 414, a clock-out time is stored. In the day out 415, a clock-out time is stored. In the re-entry time 416, a re-entry time (return time) is stored.

[0026] 5 is a schematic diagram showing an example of the hardware configuration of the data management device 200. The data management device 200 is configured, for example, by a computer (information processing device, server). The data management device 200 includes a CPU 510, a ROM 520, a RAM 530, a non-volatile storage device (HDD) 540 capable of reading and writing data, a network interface 550, and an input / output interface 560. These are connected to each other via a bus 570 so as to be able to communicate with each other. The data management device 200 may be configured by a plurality of information processing devices, or may be a virtual information processing device on the cloud.

[0027] The CPU 510 loads various programs (not shown) stored in the ROM 520 and / or the HDD 540 into the RAM 530 and executes the programs loaded into the RAM 530 to realize various functions including the function of the data management unit 210. As described above, various programs executed by the CPU 510 are loaded into the RAM 530, and data used when the CPU 510 executes the various programs is temporarily stored. The ROM 520 is a non-volatile storage medium, and various programs are stored. The HDD 540 stores (holds, stores) the database 220. The network interface 550 is an interface for connecting the data management device 200 to the network NW1. The input / output interface 560 is an interface for connecting to an operating device such as a keyboard and a mouse, and a display. The data management unit 210 corresponds to the programs stored in the ROM 520 and / or the HDD 540.

[0028] <Overview of operation> An overview of the operation of the attendance management system will be described. FIG. 6 is a diagram for explaining an overview of the operation of the attendance management system. As shown in FIG. 6, user Us1 moves along dashed arrow a1 to positions P1, P2, and P3 in this order, passes in front of terminal 100, opens door DR1, and enters the workplace (the room where user Us1 works). User Us1 opens door DR1 and leaves the workplace (the room where user Us1 works), and moves along dashed arrow b1 to positions P3, P2, and P1 in this order. Note that when user Us1 is at position P2 in front of terminal 100, he or she faces the front of terminal 100 to perform face authentication.

[0029] In this case, the terminal 100 performs facial authentication of the user Us1 present at the position P2, and transmits to the data management device 200 the user ID of the user Us1 identified by facial authentication, and the entry time and / or exit time obtained based on the stamping time and the passing direction associated with the facial authentication. That is, the terminal 100 transmits the user stamping information to the data management device 200. Note that in this example, the stamping time is the facial authentication time. In this specification, the time includes the date and time, which include the year, month, day, and time.

[0030] The data management device 200 stores in the attendance management table 240 the attendance time based on the received user time-stamping information (user ID and entry time and / or exit time).

[0031] The terminal 100 performs face detection. Using a known face recognition technique, the terminal 100 detects the face of the person being photographed (user Us1) appearing in the captured image captured by the camera 110. For example, the terminal 100 detects the face of the user Us1 appearing in the captured image including the face of the user Us1 (detects the face area) using a face detection classifier obtained in advance by machine learning the faces of many unspecified people.

[0032] The terminal 100 performs face authentication. For example, the terminal 100 extracts facial features of the user Us1 detected in a captured image. If the terminal 100 can identify the user Us1 whose extracted features match facial features registered in the user management table 230 of the data management device 200 based on the extracted features, the terminal 100 authenticates the user Us1 as the registered user. For convenience, the facial features may also be referred to as "facial feature information."

[0033] The terminal 100 detects (determines) the walking direction associated with the face authentication of the user Us1. As shown in Fig. 7, the terminal 100 detects the walking direction associated with the face authentication from the movement of the center coordinate CE1 of the face detection area R1 detected as a human face by the face detection described above. For example, when the center coordinate CE1 of the face detection area R1 changes from the right toward the center of the captured image IM1 in face images (referred to as "time-series face images") acquired (captured) at every predetermined time within a certain period including the time point at which face authentication was performed (for example, a period from a certain time point before the time point of face authentication to a certain time point after the time point of face authentication), the terminal 100 determines that the walking direction is from the right toward the center (from right to left) and detects the walking direction as from the right toward the center (from right to left). When the center coordinate CE1 of the face detection area in the time-series face images changes from the left toward the center of the captured image IM1, the terminal 100 determines that the traffic direction is from the left to the center (from left to right) and detects the traffic direction as being from the left to the center (from left to right).

[0034] The terminal 100 determines that the traffic direction is entering the room when the traffic direction is from the right toward the center, and determines that the traffic direction is leaving the room when the traffic direction is from the left toward the center.

[0035] This determination varies depending on the installation position of the terminal 100. That is, depending on the installation position of the terminal 100, the terminal 100 may determine that the traffic direction is the entrance direction when the traffic direction is from the left toward the center, and may determine that the traffic direction is the exit direction when the traffic direction is from the right toward the center.

[0036] In this example, as shown in Fig. 8A, the terminal 100 is installed on the wall on the right side of the passageway leading to the door DR1. Therefore, when the direction of passage is from the right toward the center, the terminal 100 determines that the direction of passage is the direction of entry, and when the direction of passage is from the left toward the center, the terminal 100 determines that the direction of passage is the direction of exit.

[0037] Specifically, as shown in FIG. 8A, the user Us1 moves along the dashed arrow from position P1 to position P2 and position P3 in that order, passes in front of the terminal 100, opens the door DR1, and enters the room. In this case, as shown in FIG. 8B, when the user Us1 is at position P1 before face authentication, the terminal 100 acquires a face image IM11 including the face of the user Us1 present on the right side of the terminal 100 by the camera 110. When the user Us1 is at position P2 and face authentication is performed, the terminal 100 acquires a face image IM12 including the face of the user Us1 present in front of the terminal 100 by the camera 110. When the user Us1 is at position P3 after face authentication, the terminal 100 acquires a face image IM13 including the face of the user Us1 present on the left side of the terminal 100 by the camera 110.

[0038] Since the center positions of the face detection areas of face images IM11 to IM13 (time-series face images) move from the right to the center (from right to left), terminal 100 detects the direction from the right to the center as the direction of passage, and further determines that the direction of passage is the direction of entry. Terminal 100 regards the time when face authentication of user Us1 was performed (punch time) as the entry time of user Us1 and transmits this to data management device 200. Data management device 200 registers (stores, memorizes) the attendance time in attendance management table 240 based on the entry time received from terminal 100.

[0039] As shown in FIG. 8C, the user Us1 opens the door DR1 and exits the room, and moves along the dashed arrow to positions P3, P2, and P1 in that order, passing in front of the terminal 100. In this case, as shown in FIG. 8D, when the user Us1 is at position P3 before face authentication, the terminal 100 acquires a face image IM21 including the face of the user Us1 present on the left side of the terminal 100 by the camera 110. When the user Us1 is at position P2 and face authentication is performed, the terminal 100 acquires a face image IM22 including the face of the user Us1 present in front of the terminal 100 by the camera 110. When the user Us1 is at position P1 after face authentication, the terminal 100 acquires a face image IM23 including the face of the user Us1 present on the right side of the terminal 100 by the camera 110.

[0040] Since the center positions of the face detection areas of face images IM21 to IM23 (time-series face images) move from the left to the center (left to right), terminal 100 detects the direction from the left to the center as the direction of passage, and further determines that the direction of passage is the direction of leaving the room. Terminal 100 regards the time when face authentication of user Us1 was performed (punch time) as the leaving time of user Us1, and transmits this to data management device 200. Data management device 200 registers (stores, memorizes) the attendance time in attendance management table 240 based on the leaving time received from terminal 100.

[0041] When the terminal 100 is installed on the wall on the left side of the passageway leading to the door DR1, the terminal 100 operates as follows: That is, the terminal 100 determines the direction from the right to the center, which is detected as the direction of passage, as the direction of exiting the room, and determines the direction from the left to the center, which is detected as the direction of passage, as the direction of entry, in the same manner as described above.

[0042] <Specific operation> 9 is a flowchart showing the process flow executed by the terminal 100. The terminal 100 starts the process from step 900, and executes the processes of steps 905 and 910 described below in order, and then proceeds to step 915.

[0043] Step 905: The terminal 100 detects the face of the user Us1 from a captured image (face image) including the face of the user Us1 captured by the camera 110.

[0044] Step 910: The terminal 100 performs face authentication based on the face image and traffic direction detection associated with the face authentication, as described above, to detect the traffic direction of the user Us1. The face authentication is performed by referring to the user management table 230 and identifying the user Us1 corresponding to the facial features that match the facial features extracted from the face image. If a user corresponding to the facial features that match the facial features extracted from the face image can be identified, the user Us1 is authenticated as a registered user, and if a user Us1 corresponding to the facial features that match the facial features extracted from the face image cannot be identified, the user Us1 is not authenticated as a registered user.

[0045] When the terminal 100 proceeds to step 915, the process branches depending on the walking direction of the user Us1 detected (determined) by the walking direction detection.

[0046] If the traffic direction detected by the traffic direction detection is from the right toward the center, the terminal 100 proceeds to step 920, determines that the traffic direction is entering (the traffic direction is the entering direction), and proceeds to step 930. If the traffic direction detected by the traffic direction detection is from the left toward the center, the terminal 100 proceeds to step 925, determines that the traffic direction is leaving (the traffic direction is the leaving direction), and proceeds to step 930. If the traffic direction detected by the traffic direction detection is unknown, the terminal 100 proceeds directly to step 930.

[0047] When the terminal 100 proceeds to step 930, it determines whether or not face authentication has been performed. That is, it determines whether or not it has been determined in the face authentication in step 910 whether or not the user is the registered user Us1.

[0048] If face authentication has not been performed, the terminal 100 determines “No” in step 930 and returns to step 905 .

[0049] If the face has been authenticated, the terminal 100 determines "Yes" in step 930 and proceeds to step 935 to determine whether the user Us1 whose face has been authenticated is a registered user Us1.

[0050] If the facially authenticated user Us1 is a registered user Us1, the terminal 100 judges "Yes" in step 935 and proceeds to step 940 to determine whether the direction of travel has been determined (whether it is the direction of entry or exit).

[0051] If the direction of travel has not been determined, the terminal 100 determines "No" in step 940 and proceeds to step 945, where it displays an entry / exit selection screen GM1 as a GUI screen on the display 120 of the terminal 100, and allows the user Us1 to select either entry or exit. This entry selection screen GM1 includes a message Ms1 (warning) instructing the user to select entry / exit, and an entry button IBt1 and an exit button EBt1, which are buttons formed of images. When the entry button IBt1 is touched by the user Us1, the terminal 100 determines that the user has entered the room, and when the exit button EBt1 is touched by the user Us1, the terminal 100 determines that the user has left the room. The terminal 100 then proceeds to step 950.

[0052] If the traffic direction has already been determined, the terminal 100 determines "Yes" in step 940 and proceeds directly to step 950. In step 950, the terminal 100 determines whether the room entry determination result is entry or not.

[0053] If the entry determination result is entry, the terminal 100 determines "Yes" in step 950 and proceeds to step 955, where it records (saves) the stamped time (entry time) as the entry of the registered user Us1 in the terminal 100, and proceeds to step 965. In this example, the face authentication time is used as the stamped time.

[0054] If the entry determination result is not entry (i.e., leaving), the terminal 100 determines "No" in step 950 and proceeds to step 960, where it records the punched time (exit time) as the leaving of the registered user Us1 in the terminal 100, and proceeds to step 965. In this example, the face authentication time is used as the punched time.

[0055] When the terminal 100 proceeds to step 965, it transmits the user ID of the user Us1 and either the entry time or the exit time recorded (saved) in the terminal 100 (hereinafter referred to as the "entrance / exit time") to the data management device 200 as user time-stamp information (attendance data). The data management device 200 registers (stores, memorizes) the attendance time based on the received user time-stamp information (user ID and entry / exit time) in the attendance management table 240. In this case, based on the received entry / exit time, the data management device 200 determines whether the entry / exit time is clocking in, clocking out, temporary exit, or return (re-entry) as follows, and registers (stores, memorizes) the received entry / exit time in the attendance management table 240. That is, the data management device 200 registers the earliest entry time in a predetermined period (for example, one day) as the attendance time. The data management device 200 registers the latest room leaving time in a specified period (e.g., one day) as a work clock out time in the attendance management table 240. The data management device 200 registers (stores, memorizes) a room leaving time other than the latest room leaving time in a specified period (e.g., one day) as a temporary leaving time (going out time) in the attendance management table 240. For example, if the data management device 200 receives room leaving time B after room leaving time A within a specified period, the data management device 200 registers (updates) the room leaving time A as the going out time and the room leaving time B as the work clock out time in the attendance management table 240. The data management device 200 registers an entry time other than the earliest entry time in a specified period (e.g., one day) as a return time (re-entry time) in the attendance management table 240.

[0056] Thereafter, the terminal 100 proceeds to step 995 and temporarily ends this processing flow.

[0057] In the above-mentioned step 935, if the user Us1 who has been face-authenticated is not a registered user, the terminal 100 judges "No" in step 935 and proceeds to step 970, where it displays a warning on the display 120 as an unregistered user and records (stores) the time when the unregistered user was detected in the terminal 100. After that, the terminal 100 proceeds to step 965, where it transmits information indicating that the user is an unregistered user and the time when the user was detected as an unregistered user to the data management device 200 as attendance data. The data management device 200 registers the ID indicating that the user is an unregistered user and the date and time when the unregistered user was detected in the attendance management table 240. The date is registered in the day 411, the ID is registered in the user 412, and the time when the user was detected is registered in the attendance 413. After that, the terminal 100 proceeds to step 995 and ends this processing flow for the time being.

[0058] In the above processing flow, the processing of step 965 may be executed at a predetermined time in a day, and the terminal 100 may transmit the user attendance time information (user ID, entry time, and exit time) recorded in the terminal 100 on a daily basis to the data management device 200.

[0059] <Effects> As described above, the attendance management system of the first embodiment of the present invention can obtain the accurate attendance time of user Us1 by determining whether the user Us1 who underwent facial authentication has entered or exited a room based on the direction of travel associated with the user's facial authentication.

[0060] <<Second embodiment>> The attendance management system according to the second embodiment of the present invention will be described. The attendance management system according to the second embodiment differs from the attendance management system according to the first embodiment only in the following points. The attendance management system includes a door opening / closing detector 1000, and determines whether the user Us1 has entered or left the facility based on the timing of the door opening detected by the door opening / closing detector 1000 and the timing of face authentication by the terminal 100.

[0061] The following explanation will focus on these differences.

[0062] 10 is a system configuration diagram showing an example of the configuration of the attendance management system according to the second embodiment of the present invention. As shown in FIG. 10, the attendance management system includes a terminal 100, a data management device 200, and a door opening / closing detector 1000.

[0063] The door opening / closing detector 1000 is a well-known door opening / closing sensor that detects whether the door DR1 is in an open state or a closed state. The door opening / closing detector 1000 is connected to the terminal 100 so as to be able to transmit information indicating whether the door DR1 is in an open state or a closed state to the terminal 100.

[0064] The door open / close detector 1000 detects whether the door DR1 is in an open state or a closed state, and transmits the detection result to the terminal 100. The terminal 100 detects that the door DR1 is open (door open) when the door DR1 changes from a closed state to an open state, and detects that the door DR1 is closed (door closed) when the door DR1 changes from an open state to a closed state.

[0065] 11A and 11B are diagrams for explaining the operation of the attendance management system according to the second embodiment. The attendance management system judges entry and exit as follows based on the door opening time, which is the time when the terminal 100 detects the door opening, and the face authentication time of the user Us1 of the terminal 100.

[0066] 11A, after the terminal 100 performs face authentication on the user Us1 at the position P11, if the terminal 100 detects the door being opened by the user Us1 at the position P12 during the time period from the time of face authentication until a preset predetermined time has elapsed, the terminal 100 determines that the user Us1 has entered the room. The terminal 100 then records the face authentication time as the entry time. The terminal 100 may also record the time when the user Us1 passed the terminal 100 or the time when the door opening was detected as the entry time.

[0067] 11B, after the door opening detector 1000 detects that the door is opened by the user Us1 at the position P12, if the terminal 100 performs face authentication on the user Us1 at the position P11 during the time period from the time the door opening is detected until a predetermined time has elapsed, the terminal 100 determines that the user has left the room. The terminal 100 then records the time of face authentication as the time of leaving the room. The terminal 100 may also record the time the user passes the terminal 100 or the time the door opening is detected as the time of leaving the room.

[0068] <Effects> As described above, the attendance management system according to the second embodiment of the present invention can obtain the accurate attendance time of user Us1 by determining whether the user Us1 who underwent facial authentication has entered or left a room based on the facial authentication time and the door opening detection time.

[0069] <<Third embodiment>> The attendance management system according to the third embodiment of the present invention will be described. The attendance management system according to the third embodiment differs from the attendance management system according to the first embodiment only in the following points. In the attendance management system, the terminal 100 is installed on the same wall as the door DR1, on the right side of the door DR1. The terminal 100 detects either the direction approaching the terminal 100 or the direction away from the terminal 100 as the direction of passage of the user Us1 associated with the facial authentication. The terminal 100 performs entry / exit determination based on the direction of passage associated with the facial authentication.

[0070] The following explanation will focus on these differences.

[0071] 12A and 12B are diagrams for explaining the operation of the attendance management system according to the third embodiment. The terminal 100 is installed on the wall on which the door DR1 is installed, on the right side of the door DR1. The terminal 100 is installed so that its front is facing the same direction as the front of the door DR1.

[0072] As shown in Fig. 12A, user Us1 moves from position P21 to position P22 and position P23 in this order along the dashed arrow, passes in front of terminal 100, opens door DR1 and enters the room where he works. As shown in Fig. 12B, user Us1 opens door DR1 and leaves the room where he works, and moves from position P23 to position P22 and position P21 in this order along the dashed arrow. Note that when user Us1 is at position P22 in front of terminal 100, he turns his face toward the front of terminal 100 to perform face authentication.

[0073] In this case, the terminal 100 performs face authentication of the user Us1 present at the position P22, and transmits to the data management device 200 the user ID of the user Us1 determined by the face authentication, and the entry time and / or exit time acquired based on the time stamped and the passing direction associated with the face authentication. That is, the terminal 100 transmits the user time stamp information to the data management device 200. The data management device 200 stores the attendance time in the attendance management table 240 based on the received user time stamp information.

[0074] 13A and 13B, the terminal 100 creates a classifier using features extracted in advance from a large amount of human face data by machine learning, and performs face detection on the face image IM13 acquired by the camera 110. The terminal 100 detects the passing direction associated with face recognition from the change in size of the area R13 detected as a human face, and further determines whether the passing direction is the entering direction or the leaving direction.

[0075] When the passing direction of user Us1 according to the facial authentication is a direction approaching terminal 100, terminal 100 determines that the passing direction is an entrance direction. When the passing direction of user Us1 according to the facial authentication is a direction away from terminal 100, terminal 100 determines that the passing direction is an exit direction.

[0076] In this example, as shown in FIG. 12A, the user Us1 moves along the dashed arrow from position P21 to position P22 and position P23 in that order, passes in front of the terminal 100, opens the door DR1, and enters a room that is a place of work. In this case, as shown in FIG. 14A, when the user Us1 is at position P21 before face authentication, the terminal 100 acquires a face image IM16 in which the face area of ​​the user Us1 in front of the terminal 100 is relatively small by the camera 110. When the user Us1 is at position P22 and face authentication is performed, the terminal 100 captures a face image IM15 in which the face area of ​​the user Us1 in front of the terminal 100 is relatively large by the camera 110. When the user Us1 is at position P23 (left side of the terminal 100) after face authentication, the terminal 100 acquires a face image IM14 including the rear side of the face of the user Us1 on the left side of the terminal 100 by the camera 110. In this case, the direction of approach to terminal 100 is detected as the direction of travel associated with face authentication of user Us1, and the direction of travel is determined to be the direction of entry. Terminal 100 regards the time of face authentication of user Us1 as the entry time of user Us1 authenticated by face authentication, and transmits this to data management device 200. Data management device 200 stores the attendance time based on the entry time received from terminal 100 in attendance management table 240.

[0077] As shown in FIG. 12B, the user Us1 opens the door DR1 and leaves the room where he / she works, and moves along the dashed arrow to positions P23, P22, and P21 in that order. In this case, as shown in FIG. 14B, when the user Us1 is at position P23 before face authentication, the terminal 100 acquires a face image IM14 including the front side of the face of the user Us1 present on the left side of the terminal 100 by the camera 110. When the user Us1 is at position P22 and face authentication is performed, the terminal 100 captures a face image IM15 of the user Us1 present in front of the terminal 100, in which the front area of ​​the face is relatively large, by the camera 110. When the user Us1 is at position P21 after face authentication, the terminal 100 acquires a face image of the user Us1 present in front of the terminal 100, in which the rear area of ​​the face is relatively small, by the camera 110. In this case, the direction of travel of user Us1 associated with the facial authentication is detected as a direction away from terminal 100, and the direction of travel is determined to be the direction of leaving the room. Terminal 100 regards the time of performing facial authentication of user Us1 as the leaving time of user Us1 authenticated by facial authentication, and transmits this to data management device 200. Data management device 200 stores the attendance time based on the leaving time received from terminal 100 in attendance management table 240.

[0078] <Effects> As described above, the attendance management system of the third embodiment of the present invention, like the first embodiment, can obtain the accurate attendance time of user Us1 by determining whether the user Us1 who underwent facial authentication has entered or left a room based on the direction of travel associated with the facial authentication of user Us1.

[0079] <<Fourth embodiment>> The attendance management system according to the fourth embodiment of the present invention will be described. The attendance management system according to the fourth embodiment differs from the attendance management system according to the first embodiment only in the following points. The terminal 100 of the attendance management system is capable of setting the direction of passage associated with face authentication to be determined as the direction of entry and the direction of passage associated with face authentication to be determined as the direction of exit.

[0080] The following description will focus on these differences.

[0081] FIG. 15 is a diagram for explaining an example of a setting screen (GUI screen) of the terminal 100. As shown in FIG. 15, the setting screen GM2 of the terminal 100 includes a first radio button Bt1 to a fourth radio button Bt4 for selecting whether to determine the direction of passage (directions from right to left and from left to right) associated with face authentication as either the entrance direction or the exit direction. When there is no need to distinguish between the first radio button Bt1 to the fourth radio button Bt4, these are referred to as "radio buttons Bt." When the radio button Bt is operated, a round mark is displayed when the option corresponding to the radio button Bt is in a selected state, and the round mark is hidden when the option corresponding to the radio button Bt is not in a selected state.

[0082] Either the first radio button Bt1 or the second radio button Bt2 is selected and the other is unselected by an operation by the user Us1. When the first radio button Bt1 is selected, the direction of passage (from right to left) associated with face authentication is set to be determined as the direction of entry. When the second radio button Bt2 is selected, the direction of passage (from right to left) associated with face authentication is set to be determined as the direction of exit.

[0083] Either the third radio button Bt3 or the fourth radio button Bt4 is selected and the other is unselected by the operation of the user Us1. When the third radio button Bt3 is selected, the direction of passage (from left to right) associated with the facial recognition is set to be determined as the direction of entry. When the fourth radio button Bt4 is selected, the direction of passage (from left to right) associated with the facial recognition is set to be determined as the direction of exit.

[0084] 16A and 16B are diagrams for explaining a first example of the installation state of the terminal 100 and the setting of the passage direction. In this first example, as shown in FIG. 16A, the terminal 100 is installed on the wall WR1 on the right side of the passage WA1 toward the door DR1. In this case, as shown in FIG. 16B, the user Us1 operates the setting screen GM2 of the terminal 100 to set the first radio button Bt1 to a selected state and the fourth radio button Bt4 to a selected state. This allows the passage direction to be appropriately determined as either the entrance direction or the exit direction.

[0085] 17A and 17B are diagrams for explaining a second example of the installation state of the terminal 100 and the setting of the passage direction. In this second example, as shown in FIG. 17A, the terminal 100 is installed on the wall WL1 on the left side of the passage WA1 toward the door DR1. In this case, as shown in FIG. 17B, the user Us1 operates the setting screen GM2 of the terminal 100 to set the second radio button Bt2 to a selected state and the third radio button Bt3 to a selected state. This allows the passage direction to be appropriately determined as either the entering direction or the leaving direction.

[0086] <Effects> As described above, according to the attendance management system of the fourth embodiment of the present invention, the direction of passage can be set to be determined as either the entrance direction or the exit direction, so that the direction of passage can be appropriately set to be determined as either the entrance direction or the exit direction depending on the installation position of the terminal 100.

[0087] <<Fifth embodiment>> The attendance management system according to the fifth embodiment of the present invention will be described. The attendance management system according to the fifth embodiment differs from the attendance management system according to the third embodiment only in the following points. The attendance management system includes two terminals 100 (a terminal 100 for detecting entry and a terminal 100 for detecting exit), and the terminal 100 for detecting entry detects the entry time, and the terminal 100 for detecting exit detects the exit time.

[0088] The following description will focus on these differences.

[0089] Fig. 18 is a diagram for explaining an installation state of the terminal 100. As shown in Fig. 18, the entrance detection terminal 100 is installed on the outside (opposite side from the room) of the wall W1 on which the door DR1 is installed, and the exit detection terminal 100 is installed on the inside (room side) of the wall W1 on which the door DR1 is installed.

[0090] As shown in FIG. 19A, the setting screen GM2 of the terminal 100 includes a fifth radio button Bt5 and a sixth radio button Bt6. Either the fifth radio button Bt5 or the sixth radio button Bt6 is selected and the other is unselected by the operation of the user Us1. As shown in FIG. 19A, when the fifth radio button Bt5 is selected, the terminal 100 is set for entry detection. As shown in FIG. 19B, when the sixth radio button Bt6 is selected, the terminal 100 is set for exit detection. The terminal 100 for entry detection detects the direction approaching the terminal 100 as the direction of passage associated with the face authentication of the user Us1, determines that direction as the direction of entry, and records the time of face authentication as the time of entry. The terminal 100 for exit detection detects the direction approaching the terminal 100 as the direction of passage associated with the face authentication of the user Us1, and records the time of face authentication by the terminal 100 for exit detection as the time of exit.

[0091] <Effects> As described above, according to the attendance management system of the fifth embodiment of the present invention, as in the first embodiment, the accurate attendance time of user Us1 can be obtained by determining whether the user Us1 who performed face authentication has entered or exited a room based on the direction of travel associated with user Us1's face authentication.

[0092] <<Modifications>> The present invention is not limited to the above-described embodiments, and various modifications can be adopted within the scope of the present invention. Furthermore, the above-described embodiments can be combined with each other without departing from the scope of the present invention.

[0093] In each of the above embodiments, the user management table 230 is stored in the storage device 540 of the data management device 200, but the user management table 230 may be stored in the storage device 140 of the terminal 100. In this case, face authentication may be performed as follows. The terminal 100 extracts facial features (facial feature information) of the user Us1 detected in a captured image. If the terminal 100 can identify the user Us1 whose extracted features match the facial features (facial feature information) registered in the user management table 230 stored in the storage device 140 based on the extracted features, the terminal 100 authenticates the user Us1 as the registered user.

[0094] In each of the above embodiments, the face authentication time is detected as either the entry time or the exit time, but the time when the user Us1 passes through the terminal 100 may be detected as either the entry time or the exit time. The passage time is a time based on the time range in which the terminal 100 detects the face of the user Us1 from the camera image. The passage time is, for example, the time at which the terminal 100 starts detection and is able to detect the face of the user Us1 from the captured image, or the time at which the terminal 100 is no longer able to detect the face of the user Us1 from the captured image after the terminal 100 is able to detect the face of the user Us1 from the captured image.

[0095] In each of the above embodiments, either the face authentication time or the passage time may be selectively set to be used as the punch time. In this case, the terminal 100 is set so that either the face authentication time or the passage time is used as the punch time by the attendance time selection screen GM3 as a GUI screen, as shown in Fig. 20. The attendance time selection screen GM3 includes a seventh radio button Bt7 and an eighth radio button Bt8.

[0096] Either the seventh radio button Bt7 or the eighth radio button Bt8 is selected and the other is unselected by the user Us1's operation. When the seventh radio button Bt7 is selected, the face recognition time is set to be used as the punch time. When the eighth radio button Bt8 is selected, the passage time is set to be used as the punch time.

[0097] The data management unit 210 of the data management device 200 may output the attendance management table to an external device (such as a display device or a terminal) based on the attendance management table 240. For example, the attendance management table is a table similar to the attendance management table 240.

[0098] In each of the above embodiments, the terminal 100 is installed at an entrance to a room, for example, near the door of the room. However, the terminal 100 may be installed at an entrance to a building or the like that contains the workplace, for example, near the entrance to the building or the like that contains the workplace.

[0099] In each of the above embodiments, the terminal 100 may be configured to omit the display 120. In each of the above embodiments, the setting by an operation on the GUI screen may be a setting by an API to the terminal 100, a setting in a web browser, or the like.

[0100] In the second embodiment, a user passage detector that detects the passage of a user through the entrance of a workplace may be used instead of the door opening / closing detector 1000. In this case, the detection of door opening is the same as in the second embodiment, except that the detection of user passage is different.

[0101] The present invention can have the following configurations.

[0102] [1] A terminal for attendance management, which includes a camera for capturing an image of an imaging range and is installed in a predetermined location to detect the entry and exit of a user to a workplace; A data management device including a storage device storing attendance management information for managing the attendance of the user; Including, An attendance management system in which the attendance management terminal and the data management device are configured to be able to transmit and receive information to each other, The attendance management terminal includes: face authentication for authenticating the user based on a face image of the user captured by the camera; a time stamp detection for detecting a specific time related to the face authentication as a time stamp; a user traffic direction determination that detects a traffic direction of the user associated with the face authentication based on a time-series face image including the face image at the time of the face authentication, and determines whether the traffic direction is an entry direction in which the user enters the workplace, or an exit direction in which the user leaves the workplace; Run If the direction of travel is the entry direction, the stamped time is transmitted to the data management device as the entry time of the user to the workplace; When the traffic direction is the exit direction, the stamped time is transmitted to the data management device as an exit time of the user from the workplace, The data management device includes: The attendance time based on the entry time received from the attendance management terminal is stored in the attendance management information as the attendance time of the user, and the attendance time based on the exit time received from the attendance management terminal is stored in the attendance management information as the attendance time of the user. Attendance management system.

[0103] [2] In the attendance management system described in [1], The attendance management terminal includes a storage device, In either the storage device of the attendance management terminal or the storage device of the data management device, user management information is stored as information for identifying the user, the user management information including user identification information for identifying the user and facial feature information of the user that is associated with the user identification information and is used to identify the user in the facial authentication, The attendance management terminal includes: and applying facial feature information extracted from the face image of the user captured by the camera to the user management information to identify the user, thereby authenticating the user, thereby performing the face authentication. It was configured as follows: Attendance management system.

[0104] [3] In the attendance management system described in [1], The specific time is a time when the face authentication was performed or a time when the face authentication was performed based on a time range in which the user can be detected from an image captured by the camera. Attendance management system.

[0105] [4] In the attendance management system described in [1], The attendance management terminal includes: In the traffic direction determination, Detecting, as the passing direction, either a direction from left to right of the attendance management terminal or a direction from right to left of the attendance management terminal. It was configured as follows: Attendance management system.

[0106] [5] In the attendance management system described in [1], The attendance management terminal includes: In the traffic direction determination, Detecting, as the traffic direction, either a direction approaching the attendance management terminal or a direction away from the attendance management terminal, and determining, when the direction approaching the attendance management terminal is detected as the traffic direction, that the traffic direction is the entry direction; When a direction away from the attendance management terminal is detected as the travel direction, the travel direction is determined to be the exit direction. It was configured as follows: Attendance management system.

[0107] [6] In the attendance management system described in [1], The attendance management terminal includes: The traffic direction detected in the traffic direction determination may be set to be determined to be either the entrance direction or the exit direction. It was configured as follows: Attendance management system.

[0108] [7] In the attendance management system described in [1], The attendance management terminal includes a display device capable of displaying images, The attendance management terminal includes: When the traffic direction cannot be detected in the traffic direction determination, a screen is displayed on the display device to prompt the user to input that the traffic direction is either entry or exit; If the input on the screen is entry, the punch time is transmitted to the data management device as the entry time of the user; if the input to the screen is an exit, the stamped time is transmitted to the data management device as the exit time of the user; It was configured as follows: Attendance management system.

[0109] [8] In the attendance management system described in [1], The attendance management terminal includes: In the determination of the traffic direction, the traffic direction is detected based on a moving direction of a face position in the time-series face images. It was configured as follows: Attendance management system.

[0110] [9] In the attendance management system described in [1], The attendance management terminal includes: In the determination of the traffic direction, the traffic direction is detected based on a change in size of the user's face in the time-series face images. It was configured as follows: Attendance management system.

[0111]

[10] In the attendance management system described in [1], The two attendance management terminals are included, One of the attendance management terminals is installed outside the entrance of the workplace and is used as the attendance management terminal for entrance detection; The other attendance management terminal is installed inside an entrance / exit of the workplace and is used as the attendance management terminal for exit detection, The attendance management terminal for entrance detection determines the detected passage direction as the entrance direction in the user passage direction determination, The attendance management terminal for detecting an exit determines, in the user's traffic direction determination, that the detected traffic direction is the exit direction. It was configured as follows: Attendance management system.

[0112]

[11] In the attendance management system described in

[10] , The attendance management terminal can be set to either the attendance management terminal for entry detection or the attendance management terminal for exit detection. It is configured as follows: One of the attendance management terminals is set as the attendance management terminal for the entry detection, The other attendance management terminal is set as the attendance management terminal for detecting the exit. Attendance management system.

[0113]

[12] In the attendance management system described in [1], The attendance management terminal includes: The specific time detected as the stamp time can be set to either the time when the face authentication was performed or a passage time based on a time range including the time of the face authentication in which the user can be detected from the captured image captured by the camera. It was configured as follows: Attendance management system.

[0114]

[13] A terminal for attendance management, which includes a camera for capturing an image of an imaging range and is installed in a predetermined location to detect the entry and exit of a user to a workplace; A data management device including a storage device storing attendance management information for managing the attendance of the user; a user passage detector for detecting passage of the user through an entrance / exit to the workplace; Including, An attendance management system in which the attendance management terminal and the data management device are configured to be able to transmit and receive information to each other, The attendance management terminal includes: face authentication for authenticating the user based on a face image of the user captured by the camera; a time stamp detection for detecting a specific time related to the face authentication as a time stamp; a user flow direction determination that detects the user's flow direction associated with the face authentication based on a time-series face image including the face image at the time of the face authentication, and if the user flow detector detects the user's flow after the face authentication during a period from the time of face authentication until a predetermined time has elapsed, determines that the user's flow direction is an entry direction in which the user enters the workplace, and if the user authentication is performed after the user flow detector detects the user's flow and during a period from the time of the user's flow detection until a predetermined time has elapsed, determines that the user's flow direction is an exit direction in which the user leaves the workplace; Run If the direction of travel is the entry direction, the stamped time is transmitted to the data management device as the entry time of the user to the workplace; When the traffic direction is the exit direction, the stamped time is transmitted to the data management device as an exit time of the user from the workplace, The data management device includes: The attendance time based on the entry time received from the attendance management terminal is stored in the attendance management information as the attendance time of the user, and the attendance time based on the exit time received from the attendance management terminal is stored in the attendance management information as the attendance time of the user. Attendance management system.

[0115]

[14] In the attendance management system described in

[13] , the user passage detector is a door opening / closing detector installed in the workplace having a door at an entrance / exit and detecting opening / closing of the door, The door opening / closing detector detects the passage of the user by detecting the opening of the door. It was configured as follows: Attendance management system.

[0116]

[15] A terminal for attendance management is configured to be capable of transmitting and receiving information to and from a data management device for managing a user's attendance, includes a camera for capturing an image of an image capturing range, and a control unit, and is installed in a predetermined location to detect the entry and exit of a user to and from a workplace, The control unit is face authentication for authenticating the user based on a face image of the user captured by the camera; a time stamp detection for detecting a specific time related to the face authentication as a time stamp; a user traffic direction determination that detects a traffic direction of the user associated with the face authentication based on a time-series face image including the face image at the time of the face authentication, and determines whether the traffic direction is an entry direction in which the user enters the workplace, or an exit direction in which the user leaves the workplace; Run If the direction of travel is the entry direction, the stamped time is transmitted to the data management device as the entry time of the user to the workplace; When the traffic direction is the exit direction, the punch time is transmitted to the data management device as the exit time of the user from the workplace. Attendance management terminal.

[0117] Each of the above-described embodiments corresponds to the above-described terminal, device, and system, and includes a method implemented in and a program used in the above-described terminal, device, and system. [Explanation of symbols]

[0118] 100... terminal, 110... camera, 120... display, 200... data management device, 210... data management section, 220... database, 230... user management table, 240... attendance management table, 1000... door opening / closing detector

Claims

1. A terminal for attendance management, which includes a camera for capturing an image of an imaging range and is installed in a predetermined location to detect the entry and exit of a user to a workplace; A data management device including a storage device storing attendance management information for managing the attendance of the user; Including, An attendance management system in which the attendance management terminal and the data management device are configured to be able to transmit and receive information to each other, The attendance management terminal includes: face authentication for authenticating the user based on a face image of the user captured by the camera; a time stamp detection for detecting a specific time related to the face authentication as a time stamp; a user traffic direction determination that detects a traffic direction of the user associated with the face authentication based on a time-series face image including the face image at the time of the face authentication, and determines whether the traffic direction is an entry direction in which the user enters the workplace, or an exit direction in which the user leaves the workplace; Run If the direction of travel is the entry direction, the stamped time is transmitted to the data management device as the entry time of the user to the workplace; When the traffic direction is the exit direction, the stamped time is transmitted to the data management device as an exit time of the user from the workplace, The data management device includes: The attendance time based on the entry time received from the attendance management terminal is stored in the attendance management information as the attendance time of the user, and the attendance time based on the exit time received from the attendance management terminal is stored in the attendance management information as the attendance time of the user. Attendance management system.

2. In the attendance management system according to claim 1, The attendance management terminal includes a storage device, In either the storage device of the attendance management terminal or the storage device of the data management device, user management information is stored as information for identifying the user, the user management information including user identification information for identifying the user and facial feature information of the user that is associated with the user identification information and is used to identify the user in the facial authentication, The attendance management terminal includes: and applying facial feature information extracted from the face image of the user captured by the camera to the user management information to identify the user, thereby authenticating the user, thereby performing the face authentication. It was configured as follows: Attendance management system.

3. In the attendance management system according to claim 1, The specific time is a time when the face authentication was performed or a time when the face authentication was performed based on a time range in which the user can be detected from an image captured by the camera. Attendance management system.

4. In the attendance management system according to claim 1, The attendance management terminal includes: In the traffic direction determination, Detecting, as the passing direction, either a direction from left to right of the attendance management terminal or a direction from right to left of the attendance management terminal. It was configured as follows: Attendance management system.

5. In the attendance management system according to claim 1, The attendance management terminal includes: In the traffic direction determination, Detecting, as the traffic direction, either a direction approaching the attendance management terminal or a direction away from the attendance management terminal, and determining, when the direction approaching the attendance management terminal is detected as the traffic direction, that the traffic direction is the entry direction; When a direction away from the attendance management terminal is detected as the travel direction, the travel direction is determined to be the exit direction. It was configured as follows: Attendance management system.

6. In the attendance management system according to claim 1, The attendance management terminal includes: The traffic direction detected in the traffic direction determination may be set to be determined to be either the entrance direction or the exit direction. It was configured as follows: Attendance management system.

7. In the attendance management system according to claim 1, The attendance management terminal includes a display device capable of displaying images, The attendance management terminal includes: When the traffic direction cannot be detected in the traffic direction determination, a screen is displayed on the display device to prompt the user to input that the traffic direction is either entry or exit; If the input on the screen is entry, the punch time is transmitted to the data management device as the entry time of the user; if the input to the screen is an exit, the stamped time is transmitted to the data management device as the exit time of the user; It was configured as follows: Attendance management system.

8. In the attendance management system according to claim 1, The attendance management terminal includes: In the determination of the traffic direction, the traffic direction is detected based on a moving direction of a face position in the time-series face images. It was configured as follows: Attendance management system.

9. In the attendance management system according to claim 1, The attendance management terminal includes: In the determination of the traffic direction, the traffic direction is detected based on a change in size of the user's face in the time-series face images. It was configured as follows: Attendance management system.

10. In the attendance management system according to claim 1, The two attendance management terminals are included, One of the attendance management terminals is installed outside the entrance of the workplace and is used as the attendance management terminal for entrance detection; The other attendance management terminal is installed inside an entrance / exit of the workplace and is used as the attendance management terminal for exit detection, The attendance management terminal for entrance detection determines the detected passage direction as the entrance direction in the user passage direction determination, The attendance management terminal for detecting an exit determines, in the user's traffic direction determination, that the detected traffic direction is the exit direction. It was configured as follows: Attendance management system.

11. In the attendance management system according to claim 10, The attendance management terminal is configured to be set to either the attendance management terminal for entry detection or the attendance management terminal for exit detection, One of the attendance management terminals is set as the attendance management terminal for the entry detection, The other attendance management terminal is set as the attendance management terminal for detecting the exit. Attendance management system.

12. In the attendance management system according to claim 1, The attendance management terminal includes: The specific time detected as the stamp time can be set to either the time when the face authentication was performed or the time of passage based on a time range including the time of the face authentication in which the user can be detected from the captured image captured by the camera. It was configured as follows: Attendance management system.

13. A terminal for attendance management, which includes a camera for capturing an image of an imaging range and is installed in a predetermined location to detect the entry and exit of a user to a workplace; A data management device including a storage device storing attendance management information for managing the attendance of the user; a user passage detector for detecting passage of the user through an entrance / exit to the workplace; Including, An attendance management system in which the attendance management terminal and the data management device are configured to be able to transmit and receive information to each other, The attendance management terminal includes: face authentication for authenticating the user based on a face image of the user captured by the camera; a time stamp detection for detecting a specific time related to the face authentication as a time stamp; a user flow direction determination that detects the user's flow direction associated with the face authentication based on a time-series face image including the face image at the time of the face authentication, and if the user flow detector detects the user's flow after the face authentication during a period from the time of face authentication until a predetermined time has elapsed, determines that the user's flow direction is an entry direction in which the user enters the workplace, and if the user authentication is performed after the user flow detector detects the user's flow and during a period from the time of the user's flow detection until a predetermined time has elapsed, determines that the user's flow direction is an exit direction in which the user leaves the workplace; Run If the direction of travel is the entry direction, the stamped time is transmitted to the data management device as the entry time of the user to the workplace; When the traffic direction is the exit direction, the stamped time is transmitted to the data management device as an exit time of the user from the workplace, The data management device includes: The attendance time based on the entry time received from the attendance management terminal is stored in the attendance management information as the attendance time of the user, and the attendance time based on the exit time received from the attendance management terminal is stored in the attendance management information as the attendance time of the user. Attendance management system.

14. In the attendance management system according to claim 13, the user passage detector is a door opening / closing detector installed in the workplace having a door at an entrance / exit and detecting opening / closing of the door, The door opening / closing detector detects the passage of the user by detecting the opening of the door. It was configured as follows: Attendance management system.

15. A terminal for attendance management is configured to be capable of transmitting and receiving information to and from a data management device for managing a user's attendance, includes a camera for capturing an image of an image capturing range, and a control unit, and is installed in a predetermined location to detect the entry and exit of a user to and from a workplace, The control unit is face authentication for authenticating the user based on a face image of the user captured by the camera; a time stamp detection for detecting a specific time related to the face authentication as a time stamp; a user traffic direction determination that detects a traffic direction of the user associated with the face authentication based on a time-series face image including the face image at the time of the face authentication, and determines whether the traffic direction is an entry direction in which the user enters the workplace, or an exit direction in which the user leaves the workplace; Run If the direction of travel is the entry direction, the stamped time is transmitted to the data management device as the entry time of the user to the workplace; When the traffic direction is the exit direction, the punch time is transmitted to the data management device as the exit time of the user from the workplace. Attendance management terminal.

Images