A data monitoring system based on millimeter wave technology
By combining data acquisition from millimeter-wave detection and infrared cameras with historical data analysis, the status control of cameras in attendance gates has been optimized, solving the problems of inaccurate attendance information updates and high energy consumption in existing technologies, and achieving energy saving and extended equipment life.
Patent Information
- Application Number
- CN202310359254.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2023-04-06
- Publication Date
- 2025-11-14
- Estimated Expiration
- 2043-04-06
AI Technical Summary
Existing data monitoring systems based on millimeter-wave technology fail to effectively combine facial information with attendance data updates in attendance gates, leading to inaccurate results. Furthermore, in densely populated areas, the frequent switching of cameras results in high energy consumption and shortened equipment lifespan.
The data acquisition module acquires information from the millimeter-wave detector and infrared camera, and the historical data analysis module predicts the attendance time interval. The status of the infrared camera is controlled to optimize energy consumption and extend equipment life. Multi-network converged communication is used to transmit data and analyze and update attendance information.
It enables energy saving of cameras when no one is around, reduces energy loss and shortens equipment life caused by frequent switching, and improves the accuracy of attendance information and the energy efficiency of the system.
Smart Images

Figure CN116386158B_ABST
Abstract
Description
Technical Field
[0001] This invention relates to the field of communication technology, specifically to a data monitoring system based on millimeter wave technology. Background Technology
[0002] With the development of my country's economy and the improvement of science and technology, in order to improve attendance efficiency and corresponding detection accuracy, millimeter-wave detection technology has been applied to attendance gates in production and daily life. This enables the detection of attendance personnel and transmits the detection results back to the analysis system for data analysis, thereby determining whether the person in front of the attendance gate is an attendance personnel and the corresponding attendance time. To a certain extent, this saves labor costs.
[0003] Existing data monitoring systems based on millimeter-wave technology, when applied to attendance gates, simply control the gate's opening and closing by sensing whether anyone is present around it. This method has significant drawbacks, as it doesn't update attendance information based on facial data, leading to substantial discrepancies in attendance results. Another approach involves using cameras to capture facial images and controlling the camera's operation via millimeter-wave detection. However, this method doesn't account for high-density situations during attendance periods, resulting in frequent camera switching within a given timeframe. It fails to adjust camera control based on actual time, and repeated switching can damage the cameras. Furthermore, repeated switching consumes more energy, making this method also problematic. Summary of the Invention
[0004] The purpose of this invention is to provide a data monitoring system based on millimeter wave technology to solve the problems mentioned in the background art.
[0005] To address the aforementioned technical problems, this invention provides the following technical solution: a data monitoring system based on millimeter-wave technology, comprising:
[0006] The data acquisition module acquires the detection results of the millimeter-wave detector installed on the attendance gate, the status of the infrared camera, and the captured images of the infrared camera when it is in operation.
[0007] The historical data analysis module obtains data collection results corresponding to different times in the historical database to obtain the historical time interval of the infrared camera's operation.
[0008] The first time interval acquisition module obtains the first time interval based on the changes in the attendance time intervals of personnel in the historical database and the historical time intervals of the infrared camera's operation.
[0009] The data acquisition device status determination module controls the status of the infrared camera in the data acquisition device based on the detection results of the millimeter-wave detector and the current time.
[0010] The attendance information analysis module transmits the detection results of the millimeter-wave detector and the images captured by the infrared camera during operation to the command center through multi-network converged communication, analyzes the transmitted data, and updates the attendance information based on the analysis results.
[0011] The multi-network converged communication includes 4G, 5G and self-organizing network. The self-organizing network is a network that combines mobile communication and computer network. The information exchange of the network adopts the packet switching mechanism in computer network. The user terminal is a portable terminal that can be moved. Each user terminal in the self-organizing network has both router and host functions.
[0012] The attendance result management module obtains updated attendance information, marks abnormal attendance information, and issues warnings to the command center.
[0013] This invention analyzes historical data to identify concentrated intervals in the historical attendance times of different personnel within the same period. It also combines the changes in the attendance times of the same personnel across different periods in the historical data to predict the first time interval corresponding to the given time. Furthermore, it uses millimeter-wave detection results and the corresponding detection time to determine the status of the infrared camera in the attendance gate. This approach considers both the energy-saving issue of the infrared camera when no one is present and the energy loss and shortened lifespan of the camera due to frequent switching of the camera's on / off state during periods of high attendance frequency.
[0014] Furthermore, the millimeter-wave detector in the data acquisition module includes a millimeter-wave signal transmitter and a millimeter-wave signal receiver.
[0015] The millimeter-wave signal transmitter transmits a millimeter-wave signal once every first unit time t3, where the first unit time t3 is a pre-defined constant in the database.
[0016] The time when the millimeter-wave signal transmitter emits the millimeter-wave signal is denoted as t1, and the time when the millimeter-wave signal receiver receives the corresponding millimeter-wave signal is denoted as t2. The sum of t1 and a first threshold a1 is compared with t2. The first threshold a1 is a pre-set constant in the database.
[0017] If the millimeter-wave signal receiver does not receive the corresponding millimeter-wave signal within the time interval [t1, t1+a1], then the detection result of the millimeter-wave detector installed on the attendance gate is determined to be that there is no person in front of the attendance gate.
[0018] When t1+a1≥t2, it is determined that the millimeter-wave detector installed on the attendance gate indicates that there is a person in front of the attendance gate.
[0019] The status of the infrared camera includes working status and sleep status.
[0020] This invention determines the millimeter-wave detection result based on the time difference between the reception time and the transmission time of the same millimeter-wave signal. The value of a1 is adjusted according to the actual situation, and a1 may vary for different environments. It represents the maximum error range of the difference between the reception time and the transmission time of the same millimeter-wave signal. Setting the working state and sleep state of the infrared camera takes into account the energy saving problem of the infrared camera in the case of no one to perform attendance.
[0021] Furthermore, the historical data analysis module uses one day as a time period to obtain the detection results of the millimeter-wave detector at each time point within each time period in the historical data. One time period is divided into n time segments, each with an equal duration. Each time segment within each time period is numbered, with the j-th time segment within the first i-th time period denoted as Tij. The detection results of the millimeter-wave detector at each time point within the first b time periods in the historical data are statistically analyzed. The duration of each time segment within each time period is an integer multiple of the first unit time t3, and b is an integer multiple of 2.
[0022] Within the time period numbered Tij, the detection results for each signal emitted by the millimeter-wave signal transmitter are the number of signals indicating the presence of a person in front of the attendance gate, Aij, and the total number of detection results, Bij.
[0023] Calculate the first detection value Cj corresponding to time period j in the most recent b time periods.
[0024]
[0025] when If the value is 0, then fij = 0.
[0026] when When, then determine
[0027]
[0028] For each time period with different values of j, the first detection value Cj is compared with a second threshold, which is a pre-set constant in the database.
[0029] When the first detection value Cj corresponding to time period j is greater than or equal to the second threshold, the first marking method is used to mark time period j.
[0030] If the first detection value Cj corresponding to time period j is less than the second threshold, then time period j will not be marked.
[0031] The union of the time periods marked using the first marking method within the same period is calculated to obtain the historical time interval of the infrared camera's operation.
[0032] The historical data analysis module of this invention divides a time period into n time periods. This is because the working hours of attendance personnel are periodic, and the attendance time of each attendance personnel generally fluctuates within a certain range in different periods. Therefore, the historical time interval of infrared camera operation can be obtained based on the concentrated interval of attendance time of different attendance personnel. In the process of calculating the first detection value Cj corresponding to the time period numbered j in the most recent b time periods, the number of signals Aij indicating the presence of people in front of the attendance gate and the total number of detection results Bij in the time period numbered Tij are taken into account. This facilitates the accurate acquisition of the first detection value Cj and provides data reference for subsequent screening of time intervals that need to be marked.
[0033] Furthermore, the historical data analysis module obtains the corresponding attendance personnel from the historical data, assigns a number to each attendance personnel, and obtains the initial time when the face image of each attendance personnel is captured by the infrared camera in the first b time periods. The initial time when the face image of the kth attendance personnel is captured by the infrared camera in the first i time periods is denoted as CTik. The initial time represents the minimum value among all time points when the face image is captured by the infrared camera.
[0034] The historical data analysis module obtains the attendance time offset Pk of the k-th attendance personnel in the previous b time periods.
[0035] Pk=F{k,[1,0.5*b]}-F{k,[0.5*b+1,b]}
[0036] Where F{k, [1, 0.5*b]} represents the total attendance time of the k-th attendance personnel from the first time period to the first 0.5*b time period, and F{k, [0.5*b+1, b]} represents the total attendance time of the k-th attendance personnel from the first 0.5*b+1 time period to the first b time period.
[0037] Calculate the average value PZk of the initial times when the face image of the k-th attendance personnel is captured by the infrared camera within the first b time periods.
[0038]
[0039] For the kth attendance personnel, in each of the CTik corresponding to the first time period to the first 0.5*b time period, enter each CTik greater than or equal to PZk into a blank set to obtain the first set of the kth attendance personnel, and enter each CTik less than or equal to PZk into a blank set to obtain the second set of the kth attendance personnel.
[0040] For the kth attendance personnel, in each of the CTik corresponding to the first 0.5*b+1 time period to the first b time period, enter each CTik greater than or equal to PZk into a blank set to obtain the third set of the kth attendance personnel, and enter each CTik less than or equal to PZk into a blank set to obtain the fourth set of the kth attendance personnel.
[0041] Compare the number of elements in the first set of the kth attendance personnel with the number of elements in the second set of the kth attendance personnel, and obtain the average value of each element in the set with more elements, to get F{k, [1, 0.5*b]};
[0042] Compare the number of elements in the third set of the kth attendance personnel with the number of elements in the fourth set of the kth attendance personnel, and obtain the average value of each element in the set with more elements, to get F{k, [0.5*b+1, b]};
[0043] The average value of Pk for each different value of k is denoted as PM.
[0044] PM is added to each time point in the historical time interval of the infrared camera to obtain the historical time interval after attendance offset calibration, which is recorded as the first historical time interval.
[0045] The attendance time offset Pk of the kth attendance personnel in the previous b time periods in the historical data analysis module of this invention takes into account that the attendance time of the attendance personnel in each time period changes with the change of time period. For example, the attendance time of the attendance personnel in different seasons is different. Therefore, by calculating the attendance time offset PK, it is convenient to accurately determine the first historical time interval in the subsequent process.
[0046] Furthermore, the first time interval acquisition module acquires the historical time interval of the infrared camera's operation and the first historical time interval, and calculates the union of the two to obtain the first time interval.
[0047] Furthermore, the data acquisition device status determination module obtains the detection results from the millimeter-wave detector and the current time point.
[0048] If the infrared camera in the acquisition device was in sleep mode before the time point corresponding to the most recent millimeter-wave detector detection result at the current time, then the most recent millimeter-wave detector detection result ZG corresponding to the current time point is acquired.
[0049] If there is no one in front of the attendance gate (ZG), then the infrared camera in the data collection device corresponding to the current time will be set to sleep mode.
[0050] If there is a person in front of the attendance gate (ZG), then the infrared camera in the data collection device corresponding to the current time will be set to working status.
[0051] If, prior to the time point corresponding to the most recent millimeter-wave detector detection result, the infrared camera in the acquisition device was in an active state, then the most recent millimeter-wave detector detection result ZG corresponding to the current time point is acquired.
[0052] If there is someone in front of the attendance gate (ZG), then the infrared camera in the data collection device corresponding to the current time will be set to active status.
[0053] If ZG indicates that there is no one in front of the attendance gate, obtain the time point TXM where the infrared camera is in sleep mode closest to the current time, and obtain the second time interval [TXM, TDQ], where TDQ represents the time point corresponding to the current time. Obtain the maximum time point in the infrared camera's image that recognizes a face within the second time interval and denot it as TRH.
[0054] If the current time corresponds to a time interval within the first time interval and TDQ-TRH is greater than or equal to a first preset value, then the infrared camera in the acquisition device corresponding to the current time is set to sleep mode.
[0055] If the current time corresponds to a time interval within the first time interval and TDQ-TRH is less than a first preset value, then the infrared camera in the acquisition device corresponding to the current time is set to the working state.
[0056] If the current time does not belong to the first time interval and TDQ-TRH is greater than or equal to the second preset value, then the infrared camera in the acquisition device corresponding to the current time is set to sleep mode.
[0057] If the current time does not belong to the first time interval and TDQ-TRH is less than the second preset value, then the infrared camera in the acquisition device corresponding to the current time is set to the working state.
[0058] The second preset value is a constant pre-set in the database. The first preset value is greater than the second preset value. The system obtains the interval between two adjacent user face images recognized by the attendance gate in each of the previous b time periods from the historical data. The average of the modes obtained from each interval is calculated to obtain the first time interval value.
[0059] The time interval between the attendance gate recognizing adjacent first user face images and second user face images within a corresponding cycle is equal to the difference between the minimum time point TDL2 for recognizing the second user face image and the maximum time point TDL1 for recognizing the first user face image within the corresponding cycle, where TDL2 > TDL1.
[0060] When the second preset value is less than the first time interval value, the first preset value is equal to the first time interval value;
[0061] When the second preset value is greater than or equal to the first time interval value, the first preset value is equal to the sum of the second preset value and the first time interval value.
[0062] The device status determination module of this invention determines the status of the infrared camera on the attendance gate based on the detection results of the millimeter-wave detector and the current time. This takes into account both the energy-saving issue of the infrared camera when no one is present and the energy loss and shortened lifespan of the camera due to frequent switching of the camera's on / off state during the more frequent attendance periods. When calculating the second preset value, the interval between two adjacent user face images identified by the attendance gate in each cycle is taken into account, based on the first preset value and historical data. This is to accurately adjust the size of the second preset value and facilitate effective control of the infrared camera status.
[0063] Furthermore, the attendance information analysis module transmits the data to the command center as {t, ZTH, HMT, HMS}, where t represents the time point corresponding to the data transmission, and ZTH represents the most recent detection result of the millimeter-wave detector corresponding to t.
[0064] HMT represents the state of the infrared camera corresponding to t. HMT is either 0 or 1. HMT equals 0, indicating sleep mode, and HMT equals 1, indicating active mode.
[0065] When HMT equals 0, HMS is empty; when HMT equals 0, HMS is the image captured by the infrared camera corresponding to t.
[0066] The attendance information analysis module identifies the screen corresponding to HMS in the transmitted data and compares the identification results with the pre-set attendance personnel in the database.
[0067] When the identification result is an attendance person, it is further compared whether the attendance information of the attendance person corresponding to the identification result has been updated within the corresponding period. If the attendance information of the attendance person corresponding to the identification result has been updated within the corresponding period, it is determined that the attendance information will not be updated. If the attendance information of the attendance person corresponding to the identification result has not been updated within the corresponding period, the time point corresponding to the transmission data of the identification result is obtained, and the obtained time point is used as the attendance time of the identified attendance person within the corresponding period, and the attendance information is updated.
[0068] If the recognition result is empty or the recognition result is not a person being recorded, the attendance information will not be updated.
[0069] The attendance information analysis module of this invention transmits data to the command center for two purposes: firstly, to save the monitoring data on the attendance gates, and secondly, to identify the facial information of the monitored attendance personnel and update the attendance information accordingly.
[0070] Furthermore, the attendance result management module obtains the updated attendance information and compares the attendance time corresponding to each attendee in the updated attendance information with the attendance time threshold. Attendance times that exceed the attendance time threshold and their corresponding attendees are considered abnormal attendance information. The attendance time threshold is a pre-set constant in the database.
[0071] Compared with the prior art, the beneficial effects achieved by the present invention are as follows: The present invention analyzes the relatively concentrated intervals in the historical attendance times of different attendance personnel in the same period based on historical data, and combines the changes in the attendance time of the same attendance personnel in different periods in historical data to predict the first time interval corresponding to the corresponding time; then, combined with the millimeter wave detection results and the corresponding detection time, it determines the status of the infrared camera in the attendance gate. On the one hand, it takes into account the energy saving problem of the infrared camera when no one is present, and on the other hand, it also takes into account the energy loss and shortened working life of the camera caused by frequent switching of the camera on and off in the time interval where attendance is more frequent, thus realizing effective control of the camera on and off status. Attached Figure Description
[0072] The accompanying drawings are provided to further illustrate the invention and form part of the specification. They are used in conjunction with embodiments of the invention to explain the invention and do not constitute a limitation thereof. In the drawings:
[0073] Figure 1 This is a schematic diagram of the structure of a data monitoring system based on millimeter wave technology according to the present invention;
[0074] Figure 2 This is a flowchart illustrating the status determination module of the data acquisition device in a data monitoring system based on millimeter-wave technology according to the present invention. Detailed Implementation
[0075] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.
[0076] Please see Figures 1-2 The present invention provides a technical solution: a data monitoring system based on millimeter wave technology, comprising:
[0077] The data acquisition module acquires the detection results of the millimeter-wave detector installed on the attendance gate, the status of the infrared camera, and the captured images of the infrared camera when it is in operation.
[0078] The historical data analysis module obtains data collection results corresponding to different times in the historical database to obtain the historical time interval of the infrared camera's operation.
[0079] The first time interval acquisition module obtains the first time interval based on the changes in the attendance time intervals of personnel in the historical database and the historical time intervals of the infrared camera's operation.
[0080] The data acquisition device status determination module controls the status of the infrared camera in the data acquisition device based on the detection results of the millimeter-wave detector and the current time.
[0081] The attendance information analysis module transmits the detection results of the millimeter-wave detector and the images captured by the infrared camera during operation to the command center through multi-network converged communication, analyzes the transmitted data, and updates the attendance information based on the analysis results.
[0082] The multi-network converged communication includes 4G, 5G and self-organizing network. The self-organizing network is a network that combines mobile communication and computer network. The information exchange of the network adopts the packet switching mechanism in computer network. The user terminal is a portable terminal that can be moved. Each user terminal in the self-organizing network has both router and host functions.
[0083] The attendance result management module obtains updated attendance information, marks abnormal attendance information, and issues warnings to the command center.
[0084] The millimeter-wave detector in the data acquisition module includes a millimeter-wave signal transmitter and a millimeter-wave signal receiver.
[0085] The millimeter-wave signal transmitter transmits a millimeter-wave signal once every first unit time t3, where the first unit time t3 is a pre-defined constant in the database.
[0086] The time when the millimeter-wave signal transmitter emits the millimeter-wave signal is denoted as t1, and the time when the millimeter-wave signal receiver receives the corresponding millimeter-wave signal is denoted as t2. The sum of t1 and a first threshold a1 is compared with t2. The first threshold a1 is a pre-set constant in the database.
[0087] If the millimeter-wave signal receiver does not receive the corresponding millimeter-wave signal within the time interval [t1, t1+a1], then the detection result of the millimeter-wave detector installed on the attendance gate is determined to be that there is no person in front of the attendance gate.
[0088] When t1+a1≥t2, it is determined that the millimeter-wave detector installed on the attendance gate indicates that there is a person in front of the attendance gate.
[0089] The status of the infrared camera includes working status and sleep status.
[0090] In this implementation, the first unit of time is 1 second, and the first threshold is 0.01 seconds.
[0091] The historical data analysis module uses one day as a time period, acquiring the detection results of the millimeter-wave detector at each time point within each time period in the historical data. One time period is divided into n time segments, each with an equal duration. Each time segment within each time period is numbered, with the j-th time segment within the first i-th time period denoted as Tij. The module then calculates the detection results of the millimeter-wave detector at each time point within the first b time periods in the historical data. The duration of each time segment within each time period is an integer multiple of the first unit time t3, where b is an integer multiple of 2.
[0092] In this embodiment, n represents 144 time periods, each time period has a duration of 10 minutes, and b represents 30 days.
[0093] Within the time period numbered Tij, the detection results for each signal emitted by the millimeter-wave signal transmitter are the number of signals indicating the presence of a person in front of the attendance gate, Aij, and the total number of detection results, Bij.
[0094] Calculate the first detection value Cj corresponding to time period j in the most recent b time periods.
[0095]
[0096] when If the value is 0, then fij = 0.
[0097] when When, then determine
[0098]
[0099] For each time period with different values of j, the first detection value Cj is compared with a second threshold, which is a pre-set constant in the database.
[0100] When the first detection value Cj corresponding to time period j is greater than or equal to the second threshold, the first marking method is used to mark time period j.
[0101] If the first detection value Cj corresponding to time period j is less than the second threshold, then time period j will not be marked.
[0102] The union of the time periods marked using the first marking method within the same period is calculated to obtain the historical time interval of the infrared camera's operation.
[0103] In this embodiment, the second threshold is 0.0015.
[0104] The historical data analysis module obtains the corresponding attendance personnel from the historical data, assigns a number to each attendance personnel, and obtains the initial time when the face image of each attendance personnel is captured by the infrared camera in the first b time periods. The initial time when the face image of the kth attendance personnel is captured by the infrared camera in the first i time periods is denoted as CTik. The initial time represents the minimum value among all time points when the face image is captured by the infrared camera.
[0105] The historical data analysis module obtains the attendance time offset Pk of the k-th attendance personnel in the previous b time periods.
[0106] Pk=F{k,[1,0.5*b]}-F{k,[0.5*b+1,b]}
[0107] Where F{k, [1, 0.5*b]} represents the total attendance time of the k-th attendance personnel from the first time period to the first 0.5*b time period, and F{k, [0.5*b+1, b]} represents the total attendance time of the k-th attendance personnel from the first 0.5*b+1 time period to the first b time period.
[0108] Calculate the average value PZk of the initial times when the face image of the k-th attendance personnel is captured by the infrared camera within the first b time periods.
[0109]
[0110] For the kth attendance personnel, in each of the CTik corresponding to the first time period to the first 0.5*b time period, enter each CTik greater than or equal to PZk into a blank set to obtain the first set of the kth attendance personnel, and enter each CTik less than or equal to PZk into a blank set to obtain the second set of the kth attendance personnel.
[0111] For the kth attendance personnel, in each of the CTik corresponding to the first 0.5*b+1 time period to the first b time period, enter each CTik greater than or equal to PZk into a blank set to obtain the third set of the kth attendance personnel, and enter each CTik less than or equal to PZk into a blank set to obtain the fourth set of the kth attendance personnel.
[0112] Compare the number of elements in the first set of the kth attendance personnel with the number of elements in the second set of the kth attendance personnel, and obtain the average value of each element in the set with more elements, to get F{k, [1, 0.5*b]};
[0113] Compare the number of elements in the third set of the kth attendance personnel with the number of elements in the fourth set of the kth attendance personnel, and obtain the average value of each element in the set with more elements, to get F{k, [0.5*b+1, b]};
[0114] The average value of Pk for each different value of k is denoted as PM.
[0115] PM is added to each time point in the historical time interval of the infrared camera to obtain the historical time interval after attendance offset calibration, which is recorded as the first historical time interval.
[0116] The first time interval acquisition module acquires the historical time interval of the infrared camera's operation and the first historical time interval, and calculates the union of the two to obtain the first time interval.
[0117] The data acquisition device status determination module obtains the detection results of the millimeter-wave detector and the current time point.
[0118] If the infrared camera in the acquisition device was in sleep mode before the time point corresponding to the most recent millimeter-wave detector detection result at the current time, then the most recent millimeter-wave detector detection result ZG corresponding to the current time point is acquired.
[0119] If there is no one in front of the attendance gate (ZG), then the infrared camera in the data collection device corresponding to the current time will be set to sleep mode.
[0120] If there is a person in front of the attendance gate (ZG), then the infrared camera in the data collection device corresponding to the current time will be set to working status.
[0121] If, prior to the time point corresponding to the most recent millimeter-wave detector detection result, the infrared camera in the acquisition device was in an active state, then the most recent millimeter-wave detector detection result ZG corresponding to the current time point is acquired.
[0122] If there is someone in front of the attendance gate (ZG), then the infrared camera in the data collection device corresponding to the current time will be set to active status.
[0123] If ZG indicates that there is no one in front of the attendance gate, obtain the time point TXM where the infrared camera is in sleep mode closest to the current time, and obtain the second time interval [TXM, TDQ], where TDQ represents the time point corresponding to the current time. Obtain the maximum time point in the infrared camera's image that recognizes a face within the second time interval and denot it as TRH.
[0124] If the current time corresponds to a time interval within the first time interval and TDQ-TRH is greater than or equal to a first preset value, then the infrared camera in the acquisition device corresponding to the current time is set to sleep mode.
[0125] If the current time corresponds to a time interval within the first time interval and TDQ-TRH is less than a first preset value, then the infrared camera in the acquisition device corresponding to the current time is set to the working state.
[0126] If the current time does not belong to the first time interval and TDQ-TRH is greater than or equal to the second preset value, then the infrared camera in the acquisition device corresponding to the current time is set to sleep mode.
[0127] If the current time does not belong to the first time interval and TDQ-TRH is less than the second preset value, then the infrared camera in the acquisition device corresponding to the current time is set to the working state.
[0128] The second preset value is a constant pre-set in the database. The first preset value is greater than the second preset value. The system obtains the interval between two adjacent user face images recognized by the attendance gate in each of the previous b time periods from the historical data. The average of the modes obtained from each interval is calculated to obtain the first time interval value.
[0129] In this embodiment, the second preset value is 10 seconds.
[0130] The time interval between the attendance gate recognizing adjacent first user face images and second user face images within a corresponding cycle is equal to the difference between the minimum time point TDL2 for recognizing the second user face image and the maximum time point TDL1 for recognizing the first user face image within the corresponding cycle, where TDL2 > TDL1.
[0131] When the second preset value is less than the first time interval value, the first preset value is equal to the first time interval value;
[0132] When the second preset value is greater than or equal to the first time interval value, the first preset value is equal to the sum of the second preset value and the first time interval value.
[0133] The attendance information analysis module transmits the data to the command center as {t, ZTH, HMT, HMS}, where t represents the time point corresponding to the data transmission, and ZTH represents the most recent detection result of the millimeter-wave detector corresponding to t.
[0134] HMT represents the state of the infrared camera corresponding to t. HMT is either 0 or 1. HMT equals 0, indicating sleep mode, and HMT equals 1, indicating active mode.
[0135] When HMT equals 0, HMS is empty; when HMT equals 0, HMS is the image captured by the infrared camera corresponding to t.
[0136] The attendance information analysis module identifies the screen corresponding to HMS in the transmitted data and compares the identification results with the pre-set attendance personnel in the database.
[0137] When the identification result is an attendance person, it is further compared whether the attendance information of the attendance person corresponding to the identification result has been updated within the corresponding period. If the attendance information of the attendance person corresponding to the identification result has been updated within the corresponding period, it is determined that the attendance information will not be updated. If the attendance information of the attendance person corresponding to the identification result has not been updated within the corresponding period, the time point corresponding to the transmission data of the identification result is obtained, and the obtained time point is used as the attendance time of the identified attendance person within the corresponding period, and the attendance information is updated.
[0138] If the recognition result is empty or the recognition result is not a person being recorded, the attendance information will not be updated.
[0139] The attendance result management module obtains the updated attendance information and compares the attendance time of each attendee with the attendance time threshold. Attendance times exceeding the attendance time threshold and their corresponding attendees are considered abnormal attendance information. The attendance time threshold is a pre-set constant in the database.
[0140] In this embodiment, the attendance time threshold is 9:00 AM every day.
[0141] It should be noted that, in this document, relational terms such as "first" and "second" are used only to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such process, method, article, or apparatus.
[0142] Finally, it should be noted that the above descriptions are merely preferred embodiments of the present invention and are not intended to limit the present invention. Although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art can still modify the technical solutions described in the foregoing embodiments or make equivalent substitutions for some of the technical features. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of the present invention should be included within the protection scope of the present invention.
Claims
1. A data monitoring system based on millimeter-wave technology, characterized in that, include: The data acquisition module acquires the detection results of the millimeter-wave detector installed on the attendance gate, the status of the infrared camera, and the captured images of the infrared camera when it is in operation. The historical data analysis module obtains data collection results corresponding to different times in the historical database to obtain the historical time interval of the infrared camera's operation. The first time interval acquisition module obtains the first time interval based on the changes in the attendance time intervals of personnel in the historical database and the historical time intervals of the infrared camera's operation. The data acquisition device status determination module controls the status of the infrared camera in the data acquisition device based on the detection results of the millimeter-wave detector and the current time. The attendance information analysis module transmits the detection results of the millimeter-wave detector and the images captured by the infrared camera during operation to the command center, analyzes the transmitted data, and updates the attendance information based on the analysis results. The attendance result management module obtains updated attendance information, marks abnormal attendance information, and issues an early warning to the command center. The data acquisition device status determination module obtains the detection results of the millimeter-wave detector and the current time point. If, prior to the time point corresponding to the most recent millimeter-wave detector detection result, the infrared camera in the acquisition device was in an active state, then the most recent millimeter-wave detector detection result ZG corresponding to the current time point is acquired. If there is someone in front of the attendance gate (ZG), then the infrared camera in the data collection device corresponding to the current time will be set to active status. If ZG indicates that there is no one in front of the attendance gate, obtain the time point TXM where the infrared camera is in sleep mode closest to the current time, and obtain the second time interval [TXM, TDQ], where TDQ represents the time point corresponding to the current time. Obtain the maximum time point in the infrared camera's image that recognizes a face within the second time interval and denot it as TRH. If the current time corresponds to a time interval within the first time interval and TDQ-TRH is greater than or equal to a first preset value, then the infrared camera in the acquisition device corresponding to the current time is set to sleep mode. If the current time corresponds to a time interval that is within the first time interval and TDQ-TRH is less than the first preset value, then the infrared camera in the acquisition device corresponding to the current time is controlled to be in working state.
2. The data monitoring system based on millimeter-wave technology according to claim 1, characterized in that: The millimeter-wave detector in the data acquisition module includes a millimeter-wave signal transmitter and a millimeter-wave signal receiver. The millimeter-wave signal transmitter transmits a millimeter-wave signal once every first unit time t3, where the first unit time t3 is a pre-defined constant in the database. The time when the millimeter-wave signal transmitter emits the millimeter-wave signal is denoted as t1, and the time when the millimeter-wave signal receiver receives the corresponding millimeter-wave signal is denoted as t2. The sum of t1 and a first threshold a1 is compared with t2. The first threshold a1 is a pre-set constant in the database. If the millimeter-wave signal receiver does not receive the corresponding millimeter-wave signal within the time interval [t1, t1+a1], then the detection result of the millimeter-wave detector installed on the attendance gate is determined to be that there is no person in front of the attendance gate. When t1+a1≥t2, it is determined that the millimeter-wave detector installed on the attendance gate indicates that there is a person in front of the attendance gate. The status of the infrared camera includes working status and sleep status.
3. A data monitoring system based on millimeter-wave technology according to claim 2, characterized in that: The historical data analysis module uses one day as a time period, acquiring the detection results of the millimeter-wave detector at each time point within each time period in the historical data. One time period is divided into n time segments, each with an equal duration. Each time segment within each time period is numbered, with the j-th time segment within the first i-th time period denoted as Tij. The module then calculates the detection results of the millimeter-wave detector at each time point within the first b time periods in the historical data. The duration of each time segment within each time period is an integer multiple of the first unit time t3, where b is an integer multiple of 2. Within the time period numbered Tij, the detection results for each signal emitted by the millimeter-wave signal transmitter are the number of signals indicating the presence of a person in front of the attendance gate, Aij, and the total number of detection results, Bij. Calculate the first detection value Cj corresponding to time period j in the most recent b time periods. when If the value is 0, then fij = 0. when When, then determine For each time period with different values of j, the first detection value Cj is compared with a second threshold, which is a pre-set constant in the database. When the first detection value Cj corresponding to time period j is greater than or equal to the second threshold, the first marking method is used to mark time period j. If the first detection value Cj corresponding to time period j is less than the second threshold, then time period j will not be marked. The union of the time periods marked using the first marking method within the same period is calculated to obtain the historical time interval of the infrared camera's operation.
4. A data monitoring system based on millimeter-wave technology according to claim 3, characterized in that: The historical data analysis module obtains the corresponding attendance personnel from the historical data, assigns a number to each attendance personnel, and obtains the initial time when the face image of each attendance personnel is captured by the infrared camera in the first b time periods. The initial time when the face image of the kth attendance personnel is captured by the infrared camera in the first i time periods is denoted as CTik. The initial time represents the minimum value among all time points when the face image is captured by the infrared camera. The historical data analysis module obtains the attendance time offset Pk of the k-th attendance personnel in the previous b time periods. Pk=F{k,[1,0.5*b]}-F{k,[0.5*b+1,b]} Where F{k, [1, 0.5*b]} represents the total attendance time of the k-th attendance personnel from the first time period to the first 0.5*b time period, and F{k, [0.5*b+1, b]} represents the total attendance time of the k-th attendance personnel from the first 0.5*b+1 time period to the first b time period. Calculate the average value PZk of the initial times when the face image of the k-th attendance personnel is captured by the infrared camera within the first b time periods. For the kth attendance personnel, in each of the CTik corresponding to the first time period to the first 0.5*b time period, enter each CTik greater than or equal to PZk into a blank set to obtain the first set of the kth attendance personnel, and enter each CTik less than or equal to PZk into a blank set to obtain the second set of the kth attendance personnel. For the kth attendance personnel, in each of the CTik corresponding to the first 0.5*b+1 time period to the first b time period, enter each CTik greater than or equal to PZk into a blank set to obtain the third set of the kth attendance personnel, and enter each CTik less than or equal to PZk into a blank set to obtain the fourth set of the kth attendance personnel. Compare the number of elements in the first set of the kth attendance personnel with the number of elements in the second set of the kth attendance personnel, and obtain the average value of each element in the set with more elements, to get F{k, [1, 0.5*b]}; Compare the number of elements in the third set of the kth attendance personnel with the number of elements in the fourth set of the kth attendance personnel, and obtain the average value of each element in the set with more elements, to get F{k, [0.5*b+1, b]}; The average value of Pk for each different value of k is denoted as PM. PM is added to each time point in the historical time interval of the infrared camera to obtain the historical time interval after attendance offset calibration, which is recorded as the first historical time interval.
5. A data monitoring system based on millimeter-wave technology according to claim 4, characterized in that: The first time interval acquisition module acquires the historical time interval of the infrared camera's operation and the first historical time interval, and calculates the union of the two to obtain the first time interval.
6. A data monitoring system based on millimeter-wave technology according to claim 1, characterized in that: In the data acquisition device status determination module If the infrared camera in the acquisition device was in sleep mode before the time point corresponding to the most recent millimeter-wave detector detection result at the current time, then the most recent millimeter-wave detector detection result ZG corresponding to the current time point is acquired. If there is no one in front of the attendance gate (ZG), then the infrared camera in the data collection device corresponding to the current time will be set to sleep mode. If there is a person in front of the attendance gate (ZG), then the infrared camera in the data collection device corresponding to the current time will be set to working status. If the current time does not belong to the first time interval and TDQ-TRH is greater than or equal to the second preset value, then the infrared camera in the acquisition device corresponding to the current time is set to sleep mode. If the current time does not belong to the first time interval and TDQ-TRH is less than the second preset value, then the infrared camera in the acquisition device corresponding to the current time is set to the working state. The second preset value is a constant pre-set in the database. The first preset value is greater than the second preset value. The system obtains the interval between two adjacent user face images recognized by the attendance gate in each of the previous b time periods from the historical data. The average of the modes obtained from each interval is calculated to obtain the first time interval value. The time interval between the attendance gate recognizing adjacent first user face images and second user face images within a corresponding cycle is equal to the difference between the minimum time point TDL2 for recognizing the second user face image and the maximum time point TDL1 for recognizing the first user face image within the corresponding cycle, where TDL2 > TDL1. When the second preset value is less than the first time interval value, the first preset value is equal to the first time interval value; When the second preset value is greater than or equal to the first time interval value, the first preset value is equal to the sum of the second preset value and the first time interval value.
7. A data monitoring system based on millimeter-wave technology according to claim 1, characterized in that: The attendance information analysis module transmits the data to the command center as {t, ZTH, HMT, HMS}, where t represents the time point corresponding to the data transmission, and ZTH represents the most recent detection result of the millimeter-wave detector corresponding to t. HMT represents the state of the infrared camera corresponding to t. HMT is either 0 or 1. HMT equals 0, indicating sleep mode, and HMT equals 1, indicating active mode. When HMT equals 0, HMS is empty; when HMT equals 0, HMS is the image captured by the infrared camera corresponding to t. The attendance information analysis module identifies the screen corresponding to HMS in the transmitted data and compares the identification results with the pre-set attendance personnel in the database. When the identification result is an attendance person, it is further compared whether the attendance information of the attendance person corresponding to the identification result has been updated within the corresponding period. If the attendance information of the attendance person corresponding to the identification result has been updated within the corresponding period, it is determined that the attendance information will not be updated. If the attendance information of the attendance person corresponding to the identification result has not been updated within the corresponding period, the time point corresponding to the transmission data of the identification result is obtained, and the obtained time point is used as the attendance time of the identified attendance person within the corresponding period, and the attendance information is updated. If the recognition result is empty or the recognition result is not a person being recorded, the attendance information will not be updated.
8. A data monitoring system based on millimeter-wave technology according to claim 1, characterized in that: The attendance result management module obtains the updated attendance information and compares the attendance time of each attendee with the attendance time threshold. Attendance times exceeding the attendance time threshold and their corresponding attendees are considered abnormal attendance information. The attendance time threshold is a pre-set constant in the database.
Citation Information
Patent Citations
Attendance management terminal and attendance management program
JP2007286912A
Attendance management device and attendance management program
JP6737459B1