Human activity monitoring device based on high-altitude platform

Abstract

The invention discloses a man-made activity monitoring device based on a high-altitude platform, the man-made activity monitoring device comprises a monitoring unit for monitoring man-made activities, and the man-made activity monitoring device is connected with a communication module for data transmission. According to the invention, data collected by the monitoring unit can be identified through the network training module, key point detection and attitude estimation of a human body and various vehicles are learned by using OpenPose, 2D and 3D key points of a target can be positioned at the same time, and a plurality of interchangeable target parts can be identified. Then the feature extraction module and the comparison module are used in cooperation to calculate the type of the human activity, the feature verification processing module can check the numerical value calculated by the device and the network picture, so that the type of the human activity can be calculated, and the first-level early warning module, the second-level early warning module and the third-level early warning module are called; the functions of monitoring the human activities in real time and intelligently calculating the types of the human activities are achieved.

Description

Technical Field

[0001] The invention relates to the technical field of human activity monitoring, and in particular to a human activity monitoring device based on a high-altitude platform. Background Art

[0002] When monitoring a designated area, a high-altitude platform monitoring device is required to conduct real-time monitoring of various factors such as construction, agriculture, road construction, and logging around the device, making it easier to monitor and intervene in surrounding human activities, and preventing people from conducting illegal human activities in the area.

[0003] When monitoring a designated area, a high-altitude platform monitoring device is required. Among them, the "human activity monitoring method, device and server" disclosed in the publication number "CN108537204A" has solved the problem that if the target geographical area is large, a large number of monitoring terminals need to be installed, and the possible distance between the monitoring terminals is also large, resulting in various disadvantages of inconvenient installation and maintenance.

[0004] However, there are still many defects in the actual use of human activity monitoring devices with similar structures. For example, the devices in the prior art are not convenient for real-time monitoring of human activities and inferring the types of human activities, resulting in a single monitoring target for the high-altitude monitoring device and the need to set up a variety of monitoring devices, which reduces the intelligent effect of the device and narrows the scope of application of the device. It is not convenient for the device to be promoted and used. Therefore, it is necessary to design a human activity monitoring device based on a high-altitude platform. Summary of the invention

[0005] In view of the deficiencies in the prior art, the present invention provides a human activity monitoring device based on a high-altitude platform to solve the above problems.

[0006] To achieve the above objectives, the present invention is implemented through the following technical solutions: A human activity monitoring device based on a high-altitude platform comprises:

[0007] A human activity monitoring device, the human activity monitoring device comprising a monitoring unit for monitoring human activities, the human activity monitoring device being connected to a communication module for data transmission, and the communication module being connected to a ground terminal for data transmission;

[0008] The ground terminal includes a classification module, a storage device, and an early warning device. The classification module includes a network training module. The network training module is connected to a feature extraction module for extracting features from monitoring unit monitoring data. The feature extraction module is connected to a comparison module for data processing. The comparison module is connected to a feature verification processing module for secondary verification of module processing data. The feature verification processing module is respectively connected to a first-level early warning module, a second-level early warning module, and a third-level early warning module for data transmission. The classification module is connected to a storage device for data storage, and the classification module is connected to an early warning device for warning of human activities;

[0009] The communication module includes a network fluctuation monitoring module, and the network fluctuation monitoring module is connected to a network modulator for data transmission.

[0010] Preferably, the monitoring unit includes a sunlight sensor, the sunlight sensor is connected to an infrared camera for photographing human activities, and the sunlight sensor is also connected to a radar scanner and a thermal imaging scanner for monitoring human activities in poorly lit environments.

[0011] Preferably, the monitoring unit is connected to a coordination module for real-time control of multiple groups of devices, the coordination module is connected to a linkage module for real-time adjustment of the device operating status, and the monitoring unit is connected to a basic module for basic configuration.

[0012] Preferably, the monitoring unit is bidirectionally connected to a data preprocessing center for preprocessing monitoring data of the monitoring unit, and the data preprocessing center includes a database, and the database is connected to a verification module and a modification module for data modification.

[0013] Preferably, the human activity monitoring device is connected to a power supply unit to provide power for the operation of the device, the power supply unit includes a power supply controller, the power supply controller is connected to an energy storage module for storing power, the energy storage module is connected to an inverter for stabilizing the current, and the inverter is connected to an external power supply for providing power supply for the operation of the device.

[0014] Preferably, the ground terminal is connected to a linkage center for basic configuration, and the linkage center is respectively connected to a natural resources department, an ecological environment department, and a forestry department for restricting human activities.

[0015] Preferably, the monitoring unit is connected to a control module for controlling electrical equipment inside the device, and the monitoring unit is connected to a networking module for communicating with a cloud network.

[0016] Preferably, the network modulator is connected to a switch for data transmission, the switch is connected to a twisted pair for transmitting network data, the network fluctuation monitoring module is also connected to a bridge for data transmission, the bridge is connected to a wireless local area network for transmitting the device's wireless electromagnetic signal, and the wireless local area network is connected to a wireless device for receiving data sent by the human activity monitoring device.

[0017] Preferably, the energy storage module is connected to a light power supply device for providing power supply for the operation of the device, and the energy storage module is also connected to a fuel cell for providing power supply for the operation of the device.

[0018] Beneficial Effects

[0019] The present invention provides a human activity monitoring device based on a high-altitude platform. Compared with the prior art, it has the following beneficial effects:

[0020] 1. The human activity monitoring device based on the high-altitude platform can identify the data collected by the monitoring unit through the network training module, and learn the human activity type by importing network pictures through the operator. By using OpenPose to learn the target key point detection and posture estimation, it can simultaneously locate the 2D and 3D key points of the target, and identify multiple interchangeable target parts. Then, with the help of OpenPose, the image data is processed through a convolutional neural network, and the 3D posture of the human activity is estimated. OpenPose combines regression and classification and uses a deep learning network to predict the depth of each key point. The high computing power of the network training module can facilitate the calculation of 2D and 3D limbs and key points calculated by formulas, so that The human activities can be calculated, and the type of human activities can be inferred by using the feature extraction module in conjunction with the comparison module. The device calculated values ​​can be checked with network images through the feature verification processing module to calculate the type of human activities. The corresponding instructions can be triggered according to the calculation results. By calling the first-level early warning module, the second-level early warning module, and the third-level early warning module, the types of human activities can be divided into construction, logging, arson, etc., realizing the function of real-time monitoring of human activities and intelligently inferring the types of human activities, avoiding the problem that the existing high-altitude monitoring module has a single monitoring target and cannot infer multiple types of human activities, increasing the intelligent effect of the use of the device, expanding the scope of application of the device, and facilitating the promotion and use of the device.

[0021] 2. The human activity monitoring device based on the high-altitude platform can monitor the communication status of the device in real time through the network fluctuation monitoring module. When the communication status of the device is abnormal, it can bridge the external wireless LAN through the bridge, and transmit the sending and receiving instructions between the device and the wireless device through the wireless LAN. When the communication status is restored, the network modulator and the switch can be used in conjunction to communicate with the external equipment in a timely manner with the help of twisted pair cables, thereby realizing the function of improving the stability and reliability of the device, avoiding the problem of the device being unable to communicate in time due to network restrictions, ensuring the reliable effect of using the device, and facilitating the promotion and use of the device.

[0022] 3. The human activity monitoring device based on the high-altitude platform can mobilize the natural resources department, ecological environment department, forestry department, etc. to communicate in time according to the monitoring results of the device through the linkage center, so as to facilitate the timely prevention of illegal human activities, realize the function of providing intelligent device, shorten the response time of restricting human activities, and increase the automation of using the device. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] Figure 1 It is a schematic diagram of the system principle of the present invention;

[0024] Figure 2 It is a schematic diagram of the energy supply unit of the present invention;

[0025] Figure 3 It is a schematic diagram of a communication module of the present invention;

[0026] Figure 4 It is a schematic diagram of the ground terminal of the present invention;

[0027] Figure 5 Schematic diagram of the grading module of the present invention

[0028] Figure 6 It is a schematic diagram of the monitoring unit of the present invention;

[0029] Figure 7 It is a schematic diagram of the installation position of the present invention. DETAILED DESCRIPTION

[0030] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0031] See also Figure 1-Figure 6 The human activity monitoring device based on the high-altitude platform provides two technical solutions:

[0032] The first implementation method includes:

[0033] A human activity monitoring device, the human activity monitoring device includes a monitoring unit for monitoring human activities, the human activity monitoring device is connected to a communication module for data transmission, and the communication module is connected to a ground terminal for data transmission;

[0034] The ground terminal includes a classification module, a storage device, and an early warning device. The classification module includes a network training module. The network training module is connected to a feature extraction module for extracting features from monitoring unit monitoring data. The feature extraction module is connected to a comparison module for data processing. The comparison module is connected to a feature verification processing module for secondary verification of module processing data. The feature verification processing module is respectively connected to a first-level early warning module, a second-level early warning module, and a third-level early warning module for data transmission. The classification module is connected to a storage device for data storage, and the classification module is connected to an early warning device for warning of human activities.

[0035] The communication module includes a network fluctuation monitoring module, which is connected to a network modulator for data transmission. The monitoring unit includes a sunlight sensor, which is connected to an infrared camera for photographing human activities. The sunlight sensor is also connected to a radar scanner and a thermal imaging scanner for monitoring human activities in poorly lit environments.

[0036] The monitoring unit is connected to a coordination module for real-time control of multiple groups of devices, the coordination module is connected to a linkage module for real-time adjustment of the device operation status, and the monitoring unit is connected to a basic module for basic configuration;

[0037] The monitoring unit is bidirectionally connected to a data preprocessing center for preprocessing the monitoring data of the monitoring unit, the data preprocessing center includes a database, the database is connected to a verification module and a modification module for data modification, the human activity monitoring device is connected to an energy supply unit to provide power for the device operation, the energy supply unit includes a power supply controller, the power supply controller is connected to an energy storage module for storing power, the energy storage module is connected to an inverter for stabilizing the current, and the inverter is connected to an external power supply for providing power supply for the device operation;

[0038] The ground end is connected to the linkage center for basic configuration. The linkage center is respectively connected to the natural resources department, ecological environment department, and forestry department for restricting human activities. The energy storage module is connected to the solar power supply equipment for providing power supply for the operation of the device, and the energy storage module is also connected to the fuel cell for providing power supply for the operation of the device.

[0039] Infrared cameras can be used to monitor human activities in poor lighting environments. Infrared cameras use the characteristics of infrared light to monitor and shoot at night or in low-light environments. They sense the existence and shape of objects by emitting infrared light and receiving reflected infrared light, and convert it into electrical signals to eventually generate video images. Infrared cameras can be used to record and monitor poorly lit environments. Sunlight sensors can be used to monitor the environment around the device in real time, and radar scanners and thermal imaging scanners can be intelligently controlled to monitor human activities, thereby improving the stability of monitoring human activities, avoiding the problem that the device is easily affected by light, and increasing the reliability of the device.

[0040] The coordination module and linkage module can be used together to control multiple groups of devices, so that multiple groups of devices can perform distributed monitoring of designated areas, which increases the convenience of using the device. The external power supply can be used together with the inverter and energy storage module to facilitate the use of external AC power, providing power supply for the operation of the device.

[0041] The light power supply device can be used to convert sunlight from the outside into photoelectricity, and transmit electricity to the energy storage module for storage through wires. The energy storage module can also be used to supply power when the device suddenly loses power, which increases the emergency processing function of the device and avoids the problem that the device is easily affected by external power. The power is stored and converted inside the energy storage module through the fuel cell and the light power supply device, which is convenient for subsequent use of the device, avoiding the damage of the electronic components of the device caused by the high-voltage current entering the device, and plays the role of transit voltage stabilization and rectification. The fuel cell can provide backup power supply for the device, avoiding the problem that the device cannot work due to power failure;

[0042] The network training module can identify the data collected by the monitoring unit. At the same time, the operator can import network pictures to learn and train the types of human activities. By using OpenPose to learn human key point detection and full body posture estimation, the 2D and 3D key points of the human body can be located at the same time, and multiple interchangeable human parts can be identified.

[0043] OpenPose uses a convolutional neural network to process image data. Assume that the input image is (I) and the output is a set of key points f{P} = {p1, p2, ..., p n}, where n is the number of key points, p i =(x i ,y i ) represents the pixel coordinates of the i-th key point, and the output of CNN can be expressed as P = f(I; 0), where f() is the function of CNN, (I; 0) is the parameter of the network, and the key nodes for locating the human limbs can be obtained;

[0044] By estimating the 3D pose of human activities, OpenPose combines regression and classification and uses a deep learning network to predict the depth (d i ), and then calculate the 3D coordinates f{Q}i through camera parameters (such as focal length, optical center, etc.), where the formula is expressed as Q i =K·[d i ,pix,piy] T Where K is the camera intrinsic parameter matrix, p {ix} and p {iy} They are the horizontal and vertical coordinates of the key points on the image, respectively. The high computing power of the network training module can facilitate the calculation of the 2D and 3D limbs and key points calculated by the formula, so as to facilitate the calculation of human activities.

[0045] The type of human activity can be inferred by using the feature extraction module in conjunction with the comparison module. The device inferred value can be checked with the network image through the feature verification processing module, so as to calculate the type of human activity. Then, the corresponding instruction can be triggered according to the calculation result. By calling the first-level warning module, the second-level warning module, and the third-level warning module, the types of human activities can be divided into construction, logging, arson, etc., realizing the function of real-time monitoring of human activities and intelligent inference of human activity types.

[0046] The feature extraction module and feature verification processing module can facilitate the monitoring of various types of engineering construction and road construction vehicles, and the network training module can identify the data collected by the monitoring unit, so as to facilitate the monitoring and collection of multiple data such as the color, driving direction, and number of passengers of the driving vehicle, thereby improving the intelligence of the device and facilitating the monitoring and recording of human activities in different scenes;

[0047] Through the linkage center, the natural resources department, ecological environment department, forestry department, etc. can be mobilized for timely communication based on the monitoring results of the device, thereby facilitating timely cessation of illegal human activities, realizing the function of providing intelligent devices, shortening the response time for restricting human activities, and increasing the automation of the use of the device.

[0048] The second implementation mode is mainly different from the first implementation mode in that: the network modulator is connected to a switch for data transmission, the switch is connected to a twisted pair for transmitting network data, the network fluctuation monitoring module is also connected to a bridge for data transmission, the bridge is connected to a wireless local area network for transmitting the wireless electromagnetic signal of the device, and the wireless local area network is connected to a wireless device for receiving data sent by the human activity monitoring device; the monitoring unit is connected to a control module for controlling the electrical equipment inside the device, and the monitoring unit is connected to a networking module for communicating with the cloud network.

[0049] The control module can be used to power on the electrical equipment inside the intelligent control device, and the networking module can be used to facilitate timely communication between the device and the network, so that the operator can remotely understand the operating status of the device;

[0050] The network fluctuation monitoring module can be used to monitor the communication status of the device in real time. When the communication status of the device is abnormal, the bridge is used to bridge the external wireless LAN, and the sending and receiving instructions between the device and the wireless device are transmitted through the wireless LAN. When the communication status is restored, the network modulator and the switch are used in conjunction to communicate with the external equipment in a timely manner with the help of twisted pair cables, thereby realizing the function of improving the stability and reliability of the device and facilitating the promotion and use of the device.

[0051] It should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device.

[0052] Although embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that various changes, modifications, substitutions and variations may be made to the embodiments without departing from the principles and spirit of the present invention, and that the scope of the present invention is defined by the appended claims and their equivalents.

Claims

1. A human activity monitoring device based on a high-altitude platform, characterized in that: include: A human activity monitoring device, the human activity monitoring device comprising a monitoring unit for monitoring human activities, the human activity monitoring device being connected to a communication module for data transmission, and the communication module being connected to a ground terminal for data transmission; The ground terminal includes a classification module, a storage device, and an early warning device. The classification module includes a network training module. The network training module is connected to a feature extraction module for extracting features from monitoring unit monitoring data. The feature extraction module is connected to a comparison module for data processing. The comparison module is connected to a feature verification processing module for secondary verification of the comparison module processed data. The feature verification processing module is respectively connected to a first-level early warning module, a second-level early warning module, and a third-level early warning module for data transmission. The classification module is connected to a storage device for data storage, and the classification module is connected to an early warning device for warning of human activities; The communication module includes a network fluctuation monitoring module, and the network fluctuation monitoring module is connected to a network modulator for data transmission.

2. The human activity monitoring device based on a high altitude platform according to claim 1, characterized in that: The monitoring unit comprises a sunshine sensor, the sunshine sensor is connected to an infrared camera for photographing human activities, and the sunshine sensor is also connected to a radar scanner and a thermal imaging scanner for monitoring human activities in a poorly illuminated environment.

3. The human activity monitoring device based on a high altitude platform according to claim 1, characterized in that: The monitoring unit is connected to a coordination module for real-time control of multiple groups of devices, the coordination module is connected to a linkage module for real-time adjustment of the device operation status, and the monitoring unit is connected to a basic module for basic configuration.

4. The human activity monitoring device based on a high altitude platform according to claim 1, characterized in that: The monitoring unit is bidirectionally connected to a data preprocessing center for preprocessing monitoring data of the monitoring unit. The data preprocessing center includes a database. The database is connected to a verification module and a modification module for data modification.

5. The human activity monitoring device based on a high altitude platform according to claim 1, characterized in that: The human activity monitoring device is connected to an energy supply unit to provide power for the operation of the device. The energy supply unit includes a power supply controller, the power supply controller is connected to an energy storage module for storing power, the energy storage module is connected to an inverter for stabilizing the current, and the inverter is connected to an external power supply for providing power supply for the operation of the device.

6. The human activity monitoring device based on a high altitude platform according to claim 1, characterized in that: The ground end is connected to a linkage center for basic configuration, and the linkage center is respectively connected to a natural resources department, an ecological environment department, and a forestry department for restricting human activities.

7. The human activity monitoring device based on a high altitude platform according to claim 1, characterized in that: The monitoring unit is connected to a control module for controlling the electrical equipment inside the device, and the monitoring unit is connected to a networking module for communicating with a cloud network.

8. The human activity monitoring device based on a high altitude platform according to claim 1, characterized in that: The network modulator is connected to a switch for data transmission, the switch is connected to a twisted pair for network data transmission, the network fluctuation monitoring module is also connected to a bridge for data transmission, the bridge is connected to a wireless local area network for transmitting the device's wireless electromagnetic signal, and the wireless local area network is connected to a wireless device for receiving data sent by the human activity monitoring device.

9. The human activity monitoring device based on a high altitude platform according to claim 5, characterized in that: The energy storage module is connected to a light power supply device for providing power supply for the operation of the device, and the energy storage module is also connected to a fuel cell for providing power supply for the operation of the device.

Images