Attendance operation determination method and device, storage medium and electronic device
By setting up image acquisition devices on attendance equipment and analyzing the movement direction of target objects, the problem of traditional attendance systems being unable to identify complex attendance situations is solved, enabling accurate judgment and abnormal recording of attendance operations.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- SHANGHAI SHANMA INTELLIGENT TECH CO LTD
- Filing Date
- 2023-10-25
- Publication Date
- 2026-04-21
AI Technical Summary
Traditional attendance systems cannot effectively identify complex attendance situations and cannot confirm whether personnel have actually entered the work area.
By setting up an image acquisition device on the attendance equipment, images of the target object are captured at multiple adjacent moments. The direction of movement is analyzed, and combined with preset detection rules and auxiliary areas, it is determined whether the attendance operation is abnormal.
It improves the accuracy of attendance operation recognition, reduces the risk of false detection, and ensures the accuracy of attendance results.
Smart Images

Figure CN117456626B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of artificial intelligence, and more specifically, to a method and apparatus for determining attendance operations, a storage medium, and an electronic device. Background Technology
[0002] Traditional attendance systems, strictly speaking, only record that people appear in front of the attendance machine; they cannot confirm whether people have actually entered the work area. For example, someone might swipe their card at the attendance machine and then manually turn the one-way door, but not actually enter. Therefore, such attendance systems cannot handle complex attendance situations.
[0003] There is currently no effective solution to the problem that related technologies cannot effectively identify complex attendance situations.
[0004] Therefore, it is necessary to improve the relevant technology to overcome the aforementioned defects. Summary of the Invention
[0005] The present invention provides a method and apparatus for determining attendance operations, a storage medium and an electronic device, so as to at least solve the problem of being unable to effectively identify complex attendance situations.
[0006] According to one aspect of the present invention, a method for determining attendance operations is provided, comprising: when a target object performs an attendance operation on an attendance device, controlling an image acquisition device to acquire images of the target object and the attendance device to obtain first attendance images of the target object at N adjacent time points, wherein the image acquisition device is set within a preset range of the attendance device, and N is an integer greater than 1; determining the movement direction of the target object after performing the attendance operation based on the N first attendance images, wherein the movement direction includes: a first movement direction moving from the attendance device to a work area, or a second movement direction moving from the attendance device to any position away from the work area; and determining whether the attendance operation is abnormal based on the movement direction.
[0007] In an exemplary embodiment, the method for determining the movement direction of the target object after completing the attendance operation based on N first attendance images includes: determining a first position corresponding to the attendance device in each of the N first attendance images and a second position corresponding to the entrance of the work area; calculating the distance between the first position and the second position to obtain N target distances; determining the actual movement direction of the target object as a first movement direction when multiple target distances decrease consecutively among the N target distances; and determining the actual movement direction of the target object as a second movement direction when multiple target distances increase consecutively among the N target distances.
[0008] In an exemplary embodiment, determining whether the attendance operation is abnormal based on the movement direction includes: adding an auxiliary region to the first attendance image according to a preset detection rule, wherein the auxiliary region is used to identify the number of times the target object performs the attendance operation within a target period, and the auxiliary region includes: a direction indicator; determining the target direction indicator after the target object last performed the attendance operation in the auxiliary region; and determining whether the attendance operation is abnormal based on the target direction indicator and the movement direction.
[0009] In an exemplary embodiment, determining whether the attendance operation is abnormal based on the target indication direction and the movement direction includes: determining that the attendance operation is not abnormal when the target indication direction and the movement direction are the same and the movement direction is a first movement direction; determining that the attendance operation is abnormal when the target indication direction and the movement direction are the same and the movement direction is a second movement direction; determining that the attendance operation is abnormal when the target indication direction and the movement direction are not the same and the movement direction is a first movement direction; and determining that the attendance operation is abnormal when the target indication direction and the movement direction are not the same and the movement direction is a second movement direction.
[0010] In an exemplary embodiment, after determining whether the attendance operation is abnormal based on the movement direction, the method further includes: if a door exists at the second position corresponding to the entrance of the work area, controlling the image acquisition device to acquire an image at the second position to obtain a second attendance image of the target object at M adjacent times, wherein the second attendance image is an image including the target object and the door acquired by the image acquisition device, the second position is within the acquisition range of the image acquisition device, and M is an integer greater than 1; identifying the number of doorposts and the position parameters of the doorposts appearing in the M second attendance images; and determining the door type based on the number of doorposts and the position parameters.
[0011] In an exemplary embodiment, the method further includes: determining the movement state of the target object at the door based on the M second attendance images; identifying the amount of change in the position parameter when the movement state indicates that the target object is passing through the door; determining the difference between the amount of change and a preset amount of change for the target object passing through the door to determine whether the target object has finally entered the work area; and determining the attendance result of the target object based on the result of the target object entering the work area and the confirmation result corresponding to the attendance operation.
[0012] In an exemplary embodiment, determining the attendance result of the target object based on the entry result of the target object into the work area and the abnormal situation corresponding to the attendance operation includes: determining the attendance result of the target object as successful when the entry result indicates that the target object finally entered the work area and the confirmation result indicates that the attendance operation is normal; determining the attendance result of the target object as failed when the entry result indicates that the target object did not finally enter the work area and the confirmation result indicates that the attendance operation is normal; sending a prompt message to the target object when the entry result indicates that the target object finally entered the work area and the confirmation result indicates that the attendance operation is abnormal, wherein the prompt message is used to prompt the target object to make up for the missed attendance; and generating an absence record for the target object when the entry result indicates that the target object did not finally enter the work area and the confirmation result indicates that the attendance operation is abnormal.
[0013] According to another aspect of the present invention, an attendance operation determination device is also provided, comprising: a data acquisition module, configured to control an image acquisition device to acquire images of the target object and the attendance device when a target object performs an attendance operation on an attendance device, thereby obtaining first attendance images of the target object at N adjacent time points, wherein the image acquisition device is set within a preset range of the attendance device, and N is an integer greater than 1; a first determination module, configured to determine the movement direction of the target object after performing the attendance operation based on the N first attendance images, wherein the movement direction includes: a first movement direction moving from the attendance device to the work area, or a second movement direction moving from the attendance device to any position away from the work area; and a second determination module, configured to determine whether the attendance operation is abnormal based on the movement direction.
[0014] According to another aspect of the present invention, a computer-readable storage medium is also provided, wherein a computer program is stored in the computer program, wherein the computer program is configured to execute the above-described method for determining attendance operations when it is run.
[0015] According to another aspect of the present invention, an electronic device is also provided, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the attendance operation determination method via the computer program.
[0016] This invention addresses the issue of an image acquisition device capturing images of a target object and the attendance device when the target object performs an attendance operation. The image acquisition device captures images of the target object at N adjacent time points, where N is an integer greater than 1, and the image acquisition device is positioned within a preset range of the attendance device. Based on these N first attendance images, the movement direction of the target object after completing the attendance operation is determined. This movement direction includes either a first movement direction (moving from the attendance device towards the work area) or a second movement direction (moving from the attendance device to any location away from the work area). The movement direction is then used to determine whether the attendance operation is abnormal. In other words, by determining the movement direction of the target object after performing the attendance operation, the invention uses this movement direction to identify whether the target object's attendance operation is abnormal in real time, and records any abnormalities. This improves the accuracy of determining whether a target object has entered the work area, reduces deployment complexity and the probability of false detection, and solves the problem of not being able to effectively identify complex attendance situations. Attached Figure Description
[0017] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this application and, together with the description, serve to explain the principles of this application.
[0018] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, for those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0019] Figure 1 This is a schematic diagram of the application environment for an optional attendance operation determination method according to an embodiment of this application;
[0020] Figure 2 This is a flowchart of an optional attendance operation determination method according to an embodiment of the present invention;
[0021] Figure 3 This is an optional normal attendance diagram based on related technologies;
[0022] Figure 4 This is an optional abnormal attendance diagram based on related technologies;
[0023] Figure 5 This is a schematic diagram illustrating the implementation of an attendance system with the addition of an AI system according to an embodiment of the present invention;
[0024] Figure 6 This is a schematic diagram illustrating an application scenario of a detection line according to an embodiment of the present invention;
[0025] Figure 7 This is a schematic diagram illustrating an application scenario of a revolving door according to an embodiment of the present invention;
[0026] Figure 8 This is a schematic diagram of the operation of a revolving door according to an embodiment of the present invention;
[0027] Figure 9 This is a structural block diagram of the attendance operation determination device according to an embodiment of the present invention;
[0028] Figure 10 This is a computer system architecture block diagram of an optional electronic device according to an embodiment of this application;
[0029] Figure 11 This is a schematic diagram of the structure of an optional electronic device according to an embodiment of this application. Detailed Implementation
[0030] To enable those skilled in the art to better understand the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present application, and not all embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative effort should fall within the scope of protection of the present application.
[0031] It should be noted that the terms "first," "second," etc., in the specification, claims, and accompanying drawings of this application are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of this application described herein can be implemented in orders other than those illustrated or described herein. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus.
[0032] The present application will be described below with reference to embodiments:
[0033] According to one aspect of the embodiments of this application, a method for determining attendance operations is provided. Optionally, in this embodiment, the above-described method for determining attendance operations can be applied to, for example... Figure 1 The hardware environment shown consists of server 101 and attendance system device 103. For example... Figure 1 As shown, server 101 is connected to attendance system device 103 via a network and can be used to provide services to attendance system device 103 or application 107 installed on attendance system device 103. Application 107 can be a determination application for attendance operations, etc. Database 105 can be set up on server 101 or independently of server 101 to provide data storage services for server 101, such as attendance data storage server, image data storage server, etc. The network can include, but is not limited to, wired network and wireless network. The wired network includes local area network, metropolitan area network and wide area network. The wireless network includes Bluetooth, WIFI and other networks that enable wireless communication. Attendance system device 103 can be a terminal configured with an application, which can include, but is not limited to, vehicle terminal. The server 101 can be a single server, a server cluster composed of multiple servers, or a cloud server. Application 107 using the above-mentioned attendance operation determination method is displayed through attendance system device 103 or other connected display devices.
[0034] Combination Figure 1 As shown, the method for determining the above attendance operation can be implemented in the attendance system device 103 through the following steps: Figure 2 Steps S202-S206 are implemented as follows:
[0035] Optionally, in this embodiment, the method for determining the attendance operation described above can also be implemented through a server, for example, Figure 1 It can be implemented in server 101 shown; or it can be implemented by the attendance system equipment and the server together.
[0036] The above is merely an example, and this embodiment does not impose any specific limitations.
[0037] Alternatively, as an alternative implementation method, such as Figure 2 As shown, the method for determining the above attendance operation includes the following steps S202-S206:
[0038] Step S202: When the target object performs an attendance operation on the attendance device, control the image acquisition device to acquire images of the target object and the attendance device to obtain the first attendance image of the target object at N adjacent times, wherein the image acquisition device is set within a preset range of the attendance device, and N is an integer greater than 1;
[0039] Step S204: Determine the movement direction of the target object after completing the attendance operation based on N first attendance images, wherein the movement direction includes: a first movement direction moving from the attendance device to the work area, or a second movement direction moving from the attendance device to any position away from the work area;
[0040] As an optional example, the image acquisition device can be a camera or video camera with image recognition capabilities. During the acquisition process, an auxiliary area can be set in the acquired screen. This auxiliary area can be a detection line with a corresponding directional indicator. Optionally, the directional indicator can be an arrow. This directional indicator can provide preliminary guidance on the direction of movement of the target object after completing the attendance operation on the attendance device. Specifically, the arrow can be set to point towards the work area, and movement along the arrow direction can be defined as the forward movement direction, equivalent to the first movement direction in the above embodiment; movement in the opposite direction of the arrow direction can be defined as the reverse movement direction, equivalent to the second movement direction in the above embodiment.
[0041] Step S206: Determine whether the attendance operation is abnormal based on the direction of movement.
[0042] It should be noted that the above method of determining attendance operations by movement direction can quickly determine whether the target object has only performed the attendance operation but has no tendency to enter the work area by obtaining the movement direction of the target object after the attendance operation is completed. This enables the rapid identification of abnormal attendance operations of "only taking attendance but not entering the work area".
[0043] Through the above steps, when the target object performs an attendance operation on the attendance device, the image acquisition device is controlled to acquire images of the target object and the attendance device, obtaining the first attendance images of the target object at N adjacent time points. The image acquisition device is set within a preset range of the attendance device, and N is an integer greater than 1. Based on the N first attendance images, the movement direction of the target object after performing the attendance operation is determined. This movement direction includes either a first movement direction from the attendance device towards the work area, or a second movement direction from the attendance device to any position away from the work area. The movement direction is then used to determine whether the attendance operation is abnormal. In other words, by determining the movement direction of the target object after performing the attendance operation, the movement direction is used to identify whether the target object's attendance operation is abnormal in real time, and then an abnormality is recorded. This improves the accuracy of determining whether the target object has entered the work area, reduces the complexity of deployment, and lowers the probability of false detection, thus solving the problem of not being able to effectively identify complex attendance situations.
[0044] In an exemplary embodiment, step S206 above can determine the movement direction of the target object after the attendance operation is completed by determining N first attendance images through the following steps S11-S14:
[0045] Step S11: Determine the first position of the attendance device in each of the N first attendance images and the second position of the entrance to the work area;
[0046] Step S12: Calculate the distance between the first position and the second position to obtain N target distances;
[0047] Step S13: If multiple target distances decrease consecutively among the N target distances, determine the actual movement direction of the target object as the first movement direction;
[0048] Step S14: If multiple target distances increase consecutively among the N target distances, determine the actual movement direction of the target object as the second movement direction.
[0049] Furthermore, it should be noted that since the aforementioned movement direction is determined by N first attendance images, in order to ensure the real-time effectiveness of determining the movement direction, it is necessary to acquire multiple images of the target object after completing the attendance operation, according to the preset acquisition cycle of the first attendance images.
[0050] For example, assuming the current attendance device is a facial recognition device, after the target object completes facial recognition, images of the target object within 10 seconds are acquired, and the target object's movement changes between different images are identified. When determining the target object's movement direction, in order to avoid interference from repeated movement of the target object, the straight-line distance between the target object and the work area is used to determine the movement direction.
[0051] Optionally, if the straight-line distance between the target object and the work area continues to decrease in multiple first attendance images, it indicates that the target object is gradually moving towards the work area. By subsequently judging the result of the target object passing through the door corresponding to the target area, the final attendance result of the target object can be determined.
[0052] Optionally, if the straight-line distance between the target object and the work area continues to increase in multiple first attendance images, it indicates that the target object is gradually moving in the opposite direction of the work area. In this case, the attendance result of the target object can be determined as an attendance anomaly.
[0053] In an exemplary embodiment, determining whether the attendance operation is abnormal based on the movement direction includes: adding an auxiliary region to the first attendance image according to a preset detection rule, wherein the auxiliary region is used to identify the number of times the target object performs the attendance operation within a target period, and the auxiliary region includes: a direction indicator; determining the target direction indicator after the target object last performed the attendance operation in the auxiliary region; and determining whether the attendance operation is abnormal based on the target direction indicator and the movement direction.
[0054] In an exemplary embodiment, determining whether the attendance operation is abnormal based on the target indication direction and the movement direction includes: determining that the attendance operation is not abnormal when the target indication direction and the movement direction are the same and the movement direction is a first movement direction; determining that the attendance operation is abnormal when the target indication direction and the movement direction are the same and the movement direction is a second movement direction; determining that the attendance operation is abnormal when the target indication direction and the movement direction are not the same and the movement direction is a first movement direction; and determining that the attendance operation is abnormal when the target indication direction and the movement direction are not the same and the movement direction is a second movement direction.
[0055] As an optional example, once the target object enters the frame, the AI system begins tracking its movement path. When the target object first passes through the auxiliary area in a forward direction, its status is recorded and the image is saved as evidence, indicating that the target object has begun clocking in / out. When the target object passes through the auxiliary area in a reverse direction, its status is recorded and the image is saved as evidence, indicating that the target object has left the clocking-in / out area and has not entered the work area normally. If the target object passes through the auxiliary area in a forward direction again, its status is recorded, indicating that the target object has re-entered the clocking-in / out area. After the target object leaves the frame, a comprehensive judgment is made based on its complete path. If the target object first passes through the auxiliary area in a reverse direction, it indicates that the target object needs to leave the work area. This is considered normal, and further judgment is abandoned.
[0056] Optionally, if the target object passes through the auxiliary area in a forward direction the first time, it indicates that the target object needs to enter the work area, and subsequent judgments continue. If it ultimately passes through the auxiliary area in a forward direction, it indicates that the target object has finally entered the work area, and attendance is normal. If it ultimately passes through the auxiliary area in a reverse direction, it indicates that the target object has not ultimately entered the work area, and attendance is abnormal (in this case, it can be reported in conjunction with the previously saved evidence image).
[0057] In an exemplary embodiment, the above method may further include the following steps S22-S24: determining:
[0058] Step S22: After determining whether the attendance operation is abnormal based on the movement direction, if there is a door at the second position of the entrance corresponding to the work area, control the image acquisition device to acquire an image at the second position to obtain the second attendance image of the target object at M adjacent times. The second attendance image is an image of the target object and the door acquired by the image acquisition device. The second position is within the acquisition range of the image acquisition device, and M is an integer greater than 1.
[0059] Step S23: Identify the number of door bars and the position parameters of the door bars appearing in the M second attendance images;
[0060] Step S24: Determine the door type based on the number of door bars and the position parameters.
[0061] It should be noted that the analysis method for determining the entry of the target object into the work area by using images will differ depending on the type of doors present in the work area.
[0062] In an exemplary embodiment, after performing step 22 above, the method further includes: determining the movement state of the target object at the door based on the M second attendance images; identifying the change in the position parameter when the movement state indicates that the target object is passing through the door; determining the difference between the change and a preset change for the target object passing through the door to determine whether the target object has finally entered the work area; and determining the attendance result of the target object based on the result of the target object entering the work area and the confirmation result corresponding to the attendance operation.
[0063] For example, based on the aforementioned auxiliary area as the detection line, the analysis methods can include the following:
[0064] Method 1: When the door to the work area is a one-way door, the coordinates of the one-way door and the detection line in the image captured by the camera can be obtained, and the pointing direction of the door arm (i.e. the orientation of the door arm) can be determined. After the target object passes the detection line in the forward direction after the attendance operation is performed, the change in distance between the pointing direction of the door arm and the detection line can be calculated. If the distance change is reasonable, it is considered that the person has entered the work area; otherwise, it is considered an abnormal attendance operation.
[0065] Method 2: When the door leading to the work area is a revolving door, after determining the coordinates of the revolving door and the detection line in the image through the same process as Method 1, it is also necessary to determine the distance between the first door arm of the revolving door and the detection line as the first distance, and the distance between the second door arm and the detection line as the second distance. When the target object enters the work area, the revolving door rotates, and the first and second distances change, confirming that the target object has entered the work area and that the current attendance operation is a normal attendance operation. If the first and second distances do not change, it can be determined as an abnormal attendance operation.
[0066] Method 3: When the door leading to the work area is a high-lift door or a retractable door, if the door bar of a high-lift door rises or the door bar of a retractable door retracts when the target object enters the work area, the position coordinates of the door bar will change on the image. This can be identified as a normal attendance operation; otherwise, it is an abnormal attendance operation.
[0067] In an exemplary embodiment, determining the attendance result of the target object based on the entry result of the target object into the work area and the abnormal situation corresponding to the attendance operation includes: determining the attendance result of the target object as successful when the entry result indicates that the target object finally entered the work area and the confirmation result indicates that the attendance operation is normal; determining the attendance result of the target object as failed when the entry result indicates that the target object did not finally enter the work area and the confirmation result indicates that the attendance operation is normal; sending a prompt message to the target object when the entry result indicates that the target object finally entered the work area and the confirmation result indicates that the attendance operation is abnormal, wherein the prompt message is used to prompt the target object to make up for the missed attendance; and generating an absence record for the target object when the entry result indicates that the target object did not finally enter the work area and the confirmation result indicates that the attendance operation is abnormal.
[0068] This means that by observing the specific circumstances of the target object entering the work area through the door and the occurrence of abnormal attendance operations, the current attendance of the target object can be accurately recorded, and corresponding image information can be stored in the attendance record. Then, when the target object has any objection to the attendance, the actual attendance status can be quickly determined by calling the image information in the attendance record as evidence, avoiding the problem that a single attendance record cannot determine the abnormality or effectively record the corresponding abnormal image.
[0069] Obviously, the embodiments described above are merely some embodiments of the present invention, and not all embodiments. To better understand the above method, the following description, in conjunction with embodiments, illustrates the process, but is not intended to limit the technical solutions of the embodiments of the present invention. Specifically:
[0070] In one embodiment, an attendance system is proposed, consisting of an attendance machine and a one-way door, specifically, as follows: Figure 3 As shown, Figure 3 This is an optional normal attendance diagram of related technologies; personnel (equivalent to the target object in the above embodiment) first clock in at the attendance machine (equivalent to the attendance equipment in the above embodiment) (card swiping, fingerprint, facial image recognition, etc., equivalent to the attendance operation in the above embodiment), and then enter the work area through the one-way door. The system judges the clock-in operation and the rotation of the one-way door to complete the attendance record.
[0071] However, the aforementioned attendance system only records that people appear in front of the attendance machine; it cannot confirm whether people have actually entered the work area. For example, Figure 4 This is an optional abnormal attendance diagram based on related technologies. Someone swipes their card at the attendance machine and then manually turns the one-way door, but does not actually enter. In this case, the combination of the attendance machine and the one-way door cannot be detected.
[0072] To address the issue that existing attendance systems cannot identify and judge behaviors such as clocking in without entering the work area, this invention proposes a new attendance system in an optional embodiment. This system adds an AI system connected to a camera to the existing system. The camera is deployed in the attendance machine area, displaying the attendance machine and the one-way door on the screen. A virtual detection line is established; it should be noted that the detection line has a direction, and movement in the direction of the arrow indicates the positive direction of crossing the line. The normal entry direction is set as the positive direction of crossing the line.
[0073] Specifically, Figure 5 This is a schematic diagram illustrating the implementation of an attendance system with added AI according to an embodiment of the present invention. When a person enters the screen, the AI system begins to track the person's movement path. When the person crosses the detection line forward for the first time, the system records the status and saves the image as evidence, indicating that the person has begun clocking in. When the person crosses the detection line backward, the system records the status and saves the image as evidence, indicating that the person has left the attendance area and has not entered the work area normally. If the person crosses the detection line forward again, the system records the status, indicating that the person has re-entered the attendance area. After the person leaves the screen, the system comprehensively judges the person's complete path. If the person first crossed the detection line backward, it indicates that the person needs to leave the work area. This is a normal situation, and further judgment is abandoned.
[0074] Optionally, if a person passes the detection line forward on their first attempt, it indicates that they are required to enter the work area, and further assessments are conducted. If they ultimately pass the detection line forward, it indicates that they have entered the work area and their attendance is normal. If they ultimately pass the detection line backward, it indicates that they have not entered the work area and their attendance is abnormal (in this case, the previously preserved evidence images can be used for reporting).
[0075] It should be noted that in practical applications, some turnstiles are bidirectional, with entry and exit occurring in the same location, requiring special handling. For example, the attendance images and records of bidirectional turnstiles can be stored in the corresponding database of the attendance system, with a set data generation time. When a person passes through the turnstile in the work area, a record is generated, generating corresponding exit data. This exit data is then summarized with the data in the database to determine how many times the person has clocked in and out. Combined with the time of entry and exit from the target area, the duration the person spent in the work area is determined. This duration is compared with the standard time required by the work area to ultimately determine whether the person's attendance is valid.
[0076] Furthermore, it's worth noting that during event detection, due to issues such as camera angle, using a straight line as the detection line may not provide complete monitoring. Therefore, a continuous broken line can also be used as the detection line. Figure 6 This is a schematic diagram of an application scenario of a detection line according to an embodiment of the present invention.
[0077] Optionally, when the types of doors in the work area differ, the method for determining whether a person ultimately enters the work area may vary, specifically including:
[0078] Method 1: When the door to the work area is a one-way door, the coordinates of the one-way door and the detection line in the image captured by the camera can be obtained, and the pointing direction of the door arm (i.e. the orientation of the door arm) can be determined. After checking that the employee has passed the detection line in the forward direction of clocking in, the change in distance between the pointing direction of the door arm and the detection line can be calculated. If the distance change is reasonable, the employee has entered the work area; otherwise, the clocking in is abnormal.
[0079] Method 2: When the door to the work area is a revolving door, after determining the coordinates of the revolving door and the detection line in the image through the same process as Method 1, it is also necessary to determine the distance between the first door arm of the revolving door and the detection line as the first distance, and the distance between the second door arm and the detection line as the second distance. When an employee enters the work area, the revolving door rotates, and the first and second distances change, confirming that the target object has entered the work area and determining that the current check-in is a normal check-in. If the first and second distances do not change, it can be determined as an abnormal check-in.
[0080] Specifically, Figure 7This is a schematic diagram of an application scenario of a revolving door according to an embodiment of the present invention; when not in the work area, the first and second door rods are perpendicular or parallel to the detection line (or at a certain angle). Figure 8 This is a schematic diagram of the operation scenario of a revolving door according to an embodiment of the present invention. When an employee enters the work area, the angles between the first and second door bars and the detection line change (α and β). At this time, it is determined to be a normal check-in. If the angles do not change, it is determined to be an abnormal check-in.
[0081] Method 3: If the door to the work area is a high-lift door or a retractable door, when an employee enters the work area, if the door bar of a high-lift door rises or the door bar of a retractable door retracts, the position coordinates of the door bar will change on the image. If this is the case, it can be determined as a normal clock-in; otherwise, it is an abnormal clock-in.
[0082] In summary, by introducing cameras and AI systems into the attendance system through the above implementation methods, and simultaneously collecting images of personnel clocking in and out, the system can accurately determine whether personnel have actually entered the work area using predetermined attendance rules. This improves the accuracy of the judgment. Furthermore, the detection lines can be adjusted according to actual needs, significantly reducing missed detections. The actual detection only involves adding a small number of detection lines to the image, reducing deployment complexity. Moreover, using evidence images of leaving the detection lines allows for facial recognition, facilitating personnel identification. Finally, utilizing the complete path judgment logic prevents repeated crossings, effectively reducing false detections and improving the overall recognition efficiency and accuracy of the attendance system.
[0083] It is understood that in the specific embodiments of this application, data such as user information are involved. When the above embodiments of this application are applied to specific products or technologies, user permission or consent is required, and the collection, use and processing of related data must comply with the relevant laws, regulations and standards of the relevant countries and regions.
[0084] It should be noted that, for the sake of simplicity, the foregoing method embodiments are all described as a series of actions. However, those skilled in the art should understand that this application is not limited to the described order of actions, as some steps may be performed in other orders or simultaneously according to this application. Furthermore, those skilled in the art should also understand that the embodiments described in the specification are preferred embodiments, and the actions and modules involved are not necessarily essential to this application.
[0085] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods according to the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) and includes several instructions to cause an attendance system device to execute the methods of the various embodiments of the present invention.
[0086] This embodiment also provides a device for determining attendance operations. This device is used to implement the above embodiments and preferred embodiments, and will not be repeated for details already described. As used below, the term "module" can be a combination of software and / or hardware that implements a predetermined function. Although the device described in the following embodiments is preferably implemented in software, hardware implementation, or a combination of software and hardware, is also possible and contemplated.
[0087] Figure 9 This is a structural block diagram of an attendance operation determination device according to an embodiment of the present invention, the device comprising:
[0088] The acquisition module 92 is used to control the image acquisition device to acquire images of the target object and the attendance device when the target object performs an attendance operation on the attendance device, so as to obtain the first attendance image of the target object at N adjacent times, wherein the image acquisition device is set within a preset range of the attendance device, and N is an integer greater than 1;
[0089] The first determining module 94 is used to determine the movement direction of the target object after performing the attendance operation based on N first attendance images, wherein the movement direction includes: a first movement direction moving from the attendance device to the work area, or a second movement direction moving from the attendance device to any position away from the work area;
[0090] The second determining module 96 is used to determine whether the attendance operation is abnormal based on the direction of movement.
[0091] Using the aforementioned device, when a target object performs an attendance operation on the attendance device, an image acquisition device is controlled to acquire images of the target object and the attendance device, obtaining first attendance images of the target object at N adjacent times. The image acquisition device is set within a preset range of the attendance device, and N is an integer greater than 1. Based on the N first attendance images, the movement direction of the target object after performing the attendance operation is determined. This movement direction includes either a first movement direction from the attendance device towards the work area, or a second movement direction from the attendance device to any location away from the work area. The movement direction is then used to determine whether the attendance operation is abnormal. In other words, by determining the movement direction of the target object after performing the attendance operation, the device uses this movement direction to identify whether the target object's attendance operation is abnormal in real time, and then records any abnormalities. This improves the accuracy of determining whether the target object has entered the work area, reduces the complexity of deployment, and lowers the probability of false detection, thus solving the problem of not being able to effectively identify complex attendance situations.
[0092] In an exemplary embodiment, the first determining module 94 is further configured to determine the first position corresponding to the attendance device in each of the N first attendance images and the second position corresponding to the entrance of the work area; calculate the distance between the first position and the second position to obtain N target distances; if multiple target distances decrease consecutively among the N target distances, determine the actual movement direction of the target object as the first movement direction; if multiple target distances increase consecutively among the N target distances, determine the actual movement direction of the target object as the second movement direction.
[0093] In an exemplary embodiment, the second determining module 96 is further configured to add an auxiliary region to the first attendance image according to a preset detection rule, wherein the auxiliary region is used to identify the number of times the target object performs attendance operations within a target period, and the auxiliary region includes: a direction indicator; determining the target direction indicator after the target object performs the last attendance operation in the auxiliary region; and determining whether the attendance operation is abnormal based on the target direction indicator and the movement direction.
[0094] In an exemplary embodiment, the second determining module 96 is further configured to: determine that the attendance operation is not abnormal when the target indicating direction and the movement direction are the same and the movement direction is a first movement direction; determine that the attendance operation is abnormal when the target indicating direction and the movement direction are the same and the movement direction is a second movement direction; determine that the attendance operation is abnormal when the target indicating direction and the movement direction are not the same and the movement direction is a first movement direction; and determine that the attendance operation is abnormal when the target indicating direction and the movement direction are not the same and the movement direction is a second movement direction.
[0095] In an exemplary embodiment, the above-mentioned device further includes a third determining module, configured to, after determining whether the attendance operation is abnormal based on the movement direction, control the image acquisition device to acquire images of the second position at the corresponding entrance of the work area if a door exists there, to obtain second attendance images of the target object at M adjacent times, wherein the second attendance image is an image including the target object and the door acquired by the image acquisition device, the second position is within the acquisition range of the image acquisition device, and M is an integer greater than 1; identify the number of doorposts and the position parameters of the doorposts appearing in the M second attendance images; and determine the door type based on the number of doorposts and the position parameters.
[0096] In an exemplary embodiment, the third determining module further includes: a difference unit, configured to determine the movement state of the target object at the door based on the M second attendance images; identify the amount of change in the position parameter when the movement state indicates that the target object is passing through the door; determine the difference between the amount of change and a preset amount of change for the target object passing through the door, so as to determine whether the target object has finally entered the work area; and determine the attendance result of the target object based on the result of the target object entering the work area and the confirmation result corresponding to the attendance operation.
[0097] In an exemplary embodiment, the aforementioned difference unit is further configured to: determine that the attendance result corresponding to the target object is successful when the entry result indicates that the target object has finally entered the work area and the confirmation result indicates that the attendance operation is normal; determine that the attendance result corresponding to the target object is unsuccessful when the entry result indicates that the target object has not finally entered the work area and the confirmation result indicates that the attendance operation is normal; send a prompt message to the target object when the entry result indicates that the target object has finally entered the work area and the confirmation result indicates that the attendance operation is abnormal, wherein the prompt message is used to prompt the target object to make up for the missed attendance; and generate an absence record for the target object when the entry result indicates that the target object has not finally entered the work area and the confirmation result indicates that the attendance operation is abnormal.
[0098] According to one aspect of this application, a computer program product is provided, comprising a computer program / instructions containing program code for performing the methods shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network via a communication section 809, and / or installed from a removable medium 811. When the computer program is executed by a central processing unit 801, it performs various functions provided in embodiments of this application.
[0099] The sequence numbers of the embodiments in this application are for descriptive purposes only and do not represent the superiority or inferiority of the embodiments.
[0100] Figure 10 A schematic block diagram of a computer system architecture for implementing an electronic device according to embodiments of the present application is shown.
[0101] It should be noted that, Figure 10 The computer system 800 of the electronic device shown is merely an example and should not impose any limitation on the functionality and scope of use of the embodiments of this application.
[0102] like Figure 10As shown, the computer system 800 includes a central processing unit (CPU) 801, which can perform various appropriate actions and processes based on programs stored in read-only memory (ROM) 802 or programs loaded from storage section 808 into random access memory (RAM). The random access memory 803 also stores various programs and data required for system operation. The CPU 801, ROM 802, and RAM 803 are interconnected via a bus 804. An input / output interface 805 (I / O interface) is also connected to the bus 804.
[0103] The following components are connected to the input / output interface 805: an input section 806 including a keyboard, mouse, etc.; an output section 807 including a cathode ray tube (CRT), liquid crystal display (LCD), etc., and speakers, etc.; a storage section 808 including a hard disk, etc.; and a communication section 809 including a network interface card such as a local area network card, modem, etc. The communication section 809 performs communication processing via a network such as the Internet. A drive 810 is also connected to the input / output interface 805 as needed. A removable medium 811, such as a disk, optical disk, magneto-optical disk, semiconductor memory, etc., is installed on the drive 810 as needed so that computer programs read from it can be installed into the storage section 808 as needed.
[0104] Specifically, according to embodiments of this application, the processes described in the various method flowcharts can be implemented as computer software programs. For example, embodiments of this application include a computer program product comprising a computer program carried on a computer-readable medium, the computer program containing program code for performing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via communication section 809, and / or installed from removable medium 811. When the computer program is executed by central processing unit 801, it performs various functions defined in the system of this application.
[0105] According to another aspect of the embodiments of this application, an electronic device for implementing the above-described attendance determination method is also provided. This electronic device may be... Figure 1 The attendance system device or server shown is illustrated. This embodiment uses the electronic device as an example of an attendance system device. Figure 11As shown, the electronic device includes a memory 902 and a processor 904. The memory 902 stores a computer program, and the processor 904 is configured to execute the steps in any of the above method embodiments via the computer program.
[0106] Optionally, in this embodiment, the aforementioned electronic device may be located in at least one of a plurality of network devices in a computer network.
[0107] Optionally, in this embodiment, the processor can be configured to perform the following steps via a computer program:
[0108] S1, when the target object performs an attendance operation on the attendance device, control the image acquisition device to acquire images of the target object and the attendance device, and obtain the first attendance image of the target object at N adjacent times, wherein the image acquisition device is set within a preset range of the attendance device, and N is an integer greater than 1;
[0109] S2, determine the movement direction of the target object after performing the attendance operation based on N first attendance images, wherein the movement direction includes: a first movement direction moving from the attendance device to the work area, or a second movement direction moving from the attendance device to any position away from the work area;
[0110] S3, determine whether the attendance operation is abnormal based on the direction of movement.
[0111] Alternatively, as those skilled in the art will understand, Figure 11 The structure shown is for illustrative purposes only; electronic devices or electronic equipment can also be attendance system devices. Figure 11 This does not limit the structure of the aforementioned electronic devices or electronic equipment. For example, electronic devices or electronic equipment may also include components that are more... Figure 11 The more or fewer components shown (such as network interfaces, etc.), or having the same Figure 11 The different configurations shown.
[0112] The memory 902 can be used to store software programs and modules, such as the program instructions / modules corresponding to the attendance operation determination method and device in this embodiment. The processor 904 executes various functional applications and data processing by running the software programs and modules stored in the memory 902, thereby realizing the attendance operation determination method described above. The memory 902 may include high-speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some instances, the memory 902 may further include memory remotely located relative to the processor 904, and these remote memories can be connected to the terminal via a network. Examples of such networks include, but are not limited to, the Internet, corporate intranets, local area networks, mobile communication networks, and combinations thereof. Specifically, the memory 902 may be used, but is not limited to, for information such as logs containing sensitive data. As an example, such as... Figure 11 As shown, the memory 902 may include, but is not limited to, the acquisition module 92, the determination module 94, and the control module 96 from the attendance operation determination device. Furthermore, it may include, but is not limited to, other module units from the attendance operation determination device, which will not be elaborated upon in this example.
[0113] Optionally, the aforementioned transmission device 906 is used to receive or send data via a network. Specific examples of the network may include wired and wireless networks. In one example, the transmission device 906 includes a network adapter (Network calculates the distance between the first location and the second location to obtain N target distances via Interface Controller (NIC)), which can be connected to other network devices and routers via a network cable to communicate with the Internet or a local area network. In one example, the transmission device 906 is a radio frequency (RF) module used to communicate with the Internet wirelessly.
[0114] In addition, the aforementioned electronic device also includes: a display 908; and a connection bus 910 for connecting various module components in the aforementioned electronic device.
[0115] In other embodiments, the attendance system device or server described above can be a node in a distributed system, wherein the distributed system can be a blockchain system, which is a distributed system formed by connecting multiple nodes through network communication. The nodes can form a peer-to-peer (P2P) network, and any form of computing device, such as a server, terminal, or other electronic device, can become a node in the blockchain system by joining this peer-to-peer network.
[0116] According to one aspect of this application, a computer-readable storage medium is provided, from which a processor of a computer device reads computer instructions, and the processor executes the computer instructions, causing the computer device to perform the attendance operation determination method provided in the various optional implementations described above.
[0117] Optionally, in this embodiment, the computer-readable storage medium may be configured to store a computer program for performing the following steps:
[0118] S1, when the target object performs an attendance operation on the attendance device, control the image acquisition device to acquire images of the target object and the attendance device, and obtain the first attendance image of the target object at N adjacent times, wherein the image acquisition device is set within a preset range of the attendance device, and N is an integer greater than 1;
[0119] S2, determine the movement direction of the target object after performing the attendance operation based on N first attendance images, wherein the movement direction includes: a first movement direction moving from the attendance device to the work area, or a second movement direction moving from the attendance device to any position away from the work area;
[0120] S3, determine whether the attendance operation is abnormal based on the direction of movement.
[0121] Optionally, in this embodiment, those skilled in the art will understand that all or part of the steps in the various methods of the above embodiments can be implemented by a program instructing the hardware related to the attendance system device. The program can be stored in a computer-readable storage medium, which may include: flash drive, read-only memory (ROM), random access memory (RAM), disk or optical disk, etc.
[0122] The sequence numbers of the embodiments in this application are for descriptive purposes only and do not represent the superiority or inferiority of the embodiments.
[0123] If the integrated units in the above embodiments are implemented as software functional units and sold or used as independent products, they can be stored in the aforementioned computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause one or more computer devices (which may be personal computers, servers, or network devices, etc.) to execute all or part of the steps of the methods described in the various embodiments of this application.
[0124] In the above embodiments of this application, the descriptions of each embodiment have different focuses. For parts not described in detail in a certain embodiment, please refer to the relevant descriptions of other embodiments.
[0125] In the several embodiments provided in this application, it should be understood that the disclosed client can be implemented in other ways. The device embodiments described above are merely illustrative; for example, the division of units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces, indirect coupling or communication connection between units or modules, and may be electrical or other forms.
[0126] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.
[0127] Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.
[0128] The above description is only a preferred embodiment of this application. It should be noted that for those skilled in the art, several improvements and modifications can be made without departing from the principle of this application, and these improvements and modifications should also be considered within the scope of protection of this application.
Claims
1. A method for determining attendance operations, characterized in that, include: When the target object performs an attendance operation on the attendance device, the image acquisition device is controlled to acquire images of the target object and the attendance device to obtain the first attendance image of the target object at N adjacent times. The image acquisition device is set within a preset range of the attendance device, and N is an integer greater than 1. The movement direction of the target object after completing the attendance operation is determined based on N first attendance images, wherein the movement direction includes: a first movement direction moving from the attendance device to the work area, or a second movement direction moving from the attendance device to any position away from the work area; Determine whether the attendance operation is abnormal based on the direction of movement; After determining whether the attendance operation is abnormal based on the direction of movement, the method further includes: If there is a door at the second position corresponding to the entrance of the work area, the image acquisition device is controlled to acquire an image at the second position to obtain a second attendance image of the target object at M adjacent times. The second attendance image is an image of the target object and the door acquired by the image acquisition device. The second position is within the acquisition range of the image acquisition device, and M is an integer greater than 1. Identify the number of doorposts and the position parameters of the doorposts appearing in the M second attendance images; The door type is determined based on the number of doorposts and the position parameters.
2. The method for determining attendance operations according to claim 1, characterized in that, Determining the movement direction of the target object after completing the attendance operation based on N first attendance images includes: Determine the first position of the attendance device in each of the N first attendance images and the second position of the entrance to the work area; Calculate the distance between the first position and the second position to obtain N target distances; If multiple target distances decrease consecutively among N target distances, the actual movement direction of the target object is determined as the first movement direction; If multiple target distances increase consecutively among N target distances, the actual movement direction of the target object is determined to be the second movement direction.
3. The method for determining attendance operations according to claim 1, characterized in that, Determining whether the attendance operation is abnormal based on the direction of movement includes: An auxiliary region is added to the first attendance image according to a preset detection rule. The auxiliary region is used to identify the number of times the target object performs attendance operations within the target period. The auxiliary region includes: a direction indicator. Determine the target indication direction of the target object in the auxiliary area after the last attendance operation; The attendance operation is determined to be abnormal based on the target indication direction and the movement direction.
4. The method for determining attendance operations according to claim 3, characterized in that, Determining whether the attendance operation is abnormal based on the target indication direction and the movement direction includes: If the target indication direction and the movement direction are the same, and the movement direction is the first movement direction, it is determined that the attendance operation has not encountered any abnormalities. If the target indication direction and the movement direction are the same, and the movement direction is the second movement direction, it is determined that the attendance operation has malfunctioned. If the target indication direction and the movement direction are not the same, and the movement direction is the first movement direction, it is determined that the attendance operation has malfunctioned. If the target indication direction and the movement direction are not the same, and the movement direction is the second movement direction, it is determined that the attendance operation has malfunctioned.
5. The method for determining attendance operations according to claim 1, characterized in that, The method further includes: The movement state of the target object at the door is determined based on the M second attendance images; When the movement state indicates that the target object is passing through the door, the amount of change in the position parameter is identified; The difference between the change amount and the preset change amount of the target object passing through the door is determined to determine whether the target object ultimately enters the work area; The attendance result of the target object is determined based on the entry result of the target object into the work area and the confirmation result corresponding to the attendance operation.
6. The method for determining attendance operations according to claim 5, characterized in that, The attendance result of the target object is determined based on the entry result of the target object into the work area and the abnormal situation corresponding to the attendance operation, including: If the entry result indicates that the target object has finally entered the work area, and the confirmation result indicates that the attendance operation is normal, then the attendance result corresponding to the target object is determined to be successful. If the entry result indicates that the target object did not ultimately enter the work area, and the confirmation result indicates that the attendance operation was normal, the attendance result corresponding to the target object is determined to be an attendance failure. If the entry result indicates that the target object has finally entered the work area, and the confirmation result indicates that the attendance operation is abnormal, a prompt message is sent to the target object, wherein the prompt message is used to prompt the target object to make up for the attendance operation; If the entry result indicates that the target object did not ultimately enter the work area, and the confirmation result indicates that the attendance operation is abnormal, an absence record for the target object is generated.
7. A device for determining attendance operations, characterized in that, include: The acquisition module is used to control the image acquisition device to acquire images of the target object and the attendance device when the target object performs an attendance operation on the attendance device, so as to obtain the first attendance image of the target object at N adjacent time moments, wherein the image acquisition device is set within a preset range of the attendance device, and N is an integer greater than 1; The first determining module is used to determine the movement direction of the target object after performing the attendance operation based on N first attendance images, wherein the movement direction includes: a first movement direction moving from the attendance device to the work area, or a second movement direction moving from the attendance device to any position away from the work area; The second determining module is used to determine whether the attendance operation is abnormal based on the direction of movement. The second determining module is further configured to: If there is a door at the second position corresponding to the entrance of the work area, the image acquisition device is controlled to acquire an image at the second position to obtain a second attendance image of the target object at M adjacent times. The second attendance image is an image of the target object and the door acquired by the image acquisition device. The second position is within the acquisition range of the image acquisition device, and M is an integer greater than 1. Identify the number of doorposts and the position parameters of the doorposts appearing in the M second attendance images; The door type is determined based on the number of doorposts and the position parameters.
8. A computer-readable storage medium, characterized in that, The computer-readable storage medium includes a stored program, wherein the program, when executed, performs the method for determining the attendance operation as described in any one of claims 1 to 6.
9. An electronic device comprising a memory and a processor, characterized in that, The memory stores a computer program, and the processor is configured to execute the method for determining the attendance operation as described in any one of claims 1 to 6 through the computer program.
Citation Information
Patent Citations
Detection method, apparatus and system based on iBeacon technology
CN105957169A
Distributed attendance method and system based on RFID
CN111091629A