Intelligent guard electronic sentry system and method

Abstract

The invention relates to an intelligent guard electronic guard system and method. The system comprises an aggregation device and a detection device. The detection equipment comprises a detection host and a vibration detector; the detection host comprises a networking module, an environment sensing module and a power supply module; the detection equipment and the aggregation equipment carry out wireless ad hoc network through the networking module; the vibration detector is uniquely registered in the detection host through the networking module. By adopting the method, the detection false alarm can be reduced while the power consumption is greatly reduced.

Description

Technical Field

[0001] The present application relates to the field of unmanned guard technology, and in particular to an intelligent guard electronic sentry system and method. Background Art

[0002] When patrolling in unmanned areas, the main problems are that there are too many points and long lines with few personnel, the environment is complex and lacks means (mountains, hills, lakes, rainforests, etc.), the system is messy and irregular, and information is delayed and difficult to share. In particular, in terms of timely and accurate grasp of relevant information on the border, in many cases, there is "willingness but insufficient strength", and the timeliness and effectiveness of handling emergencies are difficult to guarantee.

[0003] The existing electronic sentinel system does not support the ability to quickly deploy applications in an environment without electricity or network, and cannot be used when executing border tasks. In addition, most of them use Zigebee networking and WIFI networking technologies, which cannot achieve long-distance transmission and have defects such as high environmental requirements, long response time, and low intelligence. The recognition front end mostly uses sound, infrared and other sensors for recognition, which has defects such as low detection rate, small detection range, and high false alarm rate. The recognition front end uses camera recordings to transmit to the background for manual review, which has defects such as low recognition efficiency, high maintenance cost, and low intelligence. Summary of the invention

[0004] Based on this, it is necessary to provide an intelligent electronic sentry system and method to address the above technical problems.

[0005] An intelligent electronic sentry system, comprising:

[0006] Aggregation equipment, detection equipment and alarm management equipment; the detection equipment includes: a vibration sensor and a detection host;

[0007] The detection device includes: a detection host and a vibration detector; the detection host includes: a networking module and an environment perception module;

[0008] The detection device and the aggregation device are wirelessly self-organized through the networking module; the vibration detector is uniquely registered in the detection host through the networking module;

[0009] The vibration detector outputs the vibration alarm result and the alarm location information to the detection host through the networking module; the detection host identifies the acquired environmental information through the environmental perception module to obtain the alarm detection result;

[0010] The detection host sends the alarm detection result and the alarm location information to the aggregation device, and the aggregation device uploads the alarm detection result and the alarm location information to the alarm management device.

[0011] In one of the embodiments, the networking module includes: a Lora module and a radio module; the Lora module and the radio module perform wireless transmission and reception through an antenna; the detection device and the aggregation device perform wireless self-organizing networking through the Lora module and the radio module; the radio module is used for broadband self-organizing networking, and the Lora module is used for narrowband self-organizing networking.

[0012] In one embodiment, the environmental perception module includes: an ambient light sensor, a visible light camera, and an infrared camera; the ambient light sensor is used to obtain current ambient lighting information, and select to turn on the visible light camera or the infrared camera according to the current ambient lighting information; the visible light camera and the infrared camera are both used to obtain image information or video information of the environment.

[0013] In one of the embodiments, the image information or video information is transmitted to the aggregation device via the radio module.

[0014] In one of the embodiments, the vibration alarm result is transmitted to the detection host through the Lora module, and the text information in the alarm detection result is transmitted to the aggregation device through the Lora module.

[0015] In one of the embodiments, a Lora narrowband ad hoc network is established between the detection device and the aggregation device through the Lora module, and lora routing information is generated; a radio broadband ad hoc network is dynamically established between the detection device and the aggregation device through the radio module, and radio routing information is generated.

[0016] In one of the embodiments, after being turned on, a Lora narrowband self-organizing network is established between the detection devices through the Lora module, and a node tree is generated; the aggregation device generates a networking instruction and broadcasts it to each detection device, the detection device receives the networking instruction, and completes the radio broadband self-organizing network according to the networking instruction and connects to the TCP server of the aggregation device, and reports the generated node tree to the aggregation device. The aggregation device generates a full routing path for the node trees of all detection devices in sequence through the Dijkstra shortest path algorithm, and sends it to the detection device for storage.

[0017] In one of the embodiments, the Lora narrowband ad hoc network and the radio broadband ad hoc network are automatically switched when the signal strength is lower than a threshold and under interference conditions.

[0018] In one of the embodiments, the alarm management device displays all the alarm detection information on a map according to the alarm location information, and processes the alarm detection information.

[0019] An intelligent on-duty electronic sentry method, characterized in that it is applied to the above-mentioned intelligent on-duty electronic sentry system.

[0020] In order to improve the low power consumption performance of the unmanned system, the above-mentioned intelligent on-duty electronic sentinel system and method put the detection host, the main power-consuming device in the system, into a dormant state, so that its endurance can be greatly improved in a normal non-alarm state. In addition, in order to improve the on-duty capability of the intelligent on-duty electronic sentinel system, the initial analysis and classification of the intrusion is first performed through the vibration detector arranged at the front end. When the actual intrusion is detected, the detection host is awakened, and the second analysis and classification of the intrusion is performed in the detection host through the environmental perception method. In this process, the alarm detection information is saved, and video recording and image shooting are performed at the same time, and the alarm location information of the alarm is obtained. When this information is sent to the alarm management device through the aggregation device, on the one hand, the location of the alarm can be clearly observed globally, and on the other hand, based on the alarm detection information, images and videos, the alarm is handled conveniently, thereby greatly improving the alarm handling efficiency and improving the efficiency of task execution in unmanned areas. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] Figure 1 A structural block diagram of an intelligent on-duty electronic sentry system in one embodiment;

[0022] Figure 2 is a structural block diagram of a detection device in one embodiment;

[0023] Figure 3 A flowchart of a vibration sensor in one embodiment;

[0024] Figure 4 A schematic diagram for introducing an optimal path in an embodiment;

[0025] Figure 5 is a structural block diagram of a portable aggregation device in one embodiment;

[0026] Figure 6 is a structural block diagram of a fixed polymerization device in one embodiment;

[0027] Figure 7 The present invention is a flowchart of the execution process of the intelligent electronic sentry system in one embodiment. DETAILED DESCRIPTION

[0028] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0029] In one embodiment, Figure 1As shown, an intelligent on-duty electronic sentry system is provided, including an aggregation device 100, a detection device 200 and an alarm management device; the detection device 200 includes: a detection host 210 and a vibration detector 220; the detection host 210 includes: a networking module 211, an environmental perception module 212 and a power module 213; the detection device 200 and the aggregation device 100 are wirelessly self-networked through the networking module 211; the vibration detector 220 is uniquely registered in the detection host 210 through the networking module 211; the vibration detector outputs the vibration alarm result and the alarm positioning information to the detection host through the networking module; the detection host identifies the acquired environmental information through the environmental perception module to obtain the alarm detection result; the detection host sends the alarm detection result and the alarm positioning information to the aggregation device, and the aggregation device uploads the alarm detection result and the alarm positioning information to the alarm management device.

[0030] In order to improve the low power consumption performance of the unmanned system, the above-mentioned intelligent on-duty electronic sentinel system puts the detection host, the main power-consuming device in the system, into a dormant state. Therefore, its battery life can be greatly improved in a normal non-alarm state. In addition, in order to improve the on-duty capability of the intelligent on-duty electronic sentinel system, the vibration detector arranged at the front end is first used to perform the initial analysis and classification of the intrusion. When the actual intrusion is detected, the detection host is awakened, and the second analysis and classification of the intrusion is performed in the detection host through environmental perception. In this process, the alarm detection information is saved, and video recording and image shooting are performed at the same time, and the alarm location information of the alarm is obtained. When this information is sent to the alarm management device through the aggregation device, on the one hand, the location of the alarm can be clearly observed globally, and on the other hand, based on the alarm detection information, images and videos, the alarm is handled conveniently, thereby greatly improving the alarm handling efficiency and improving the efficiency of task execution in unmanned areas.

[0031] In one embodiment, Figure 2 As shown in the figure, the detection host includes a power management module, SOC, MCU and a memory card, and then the functional modules include Beidou positioning module, networking module, Lora module, infrared camera, visible light camera, external lithium battery and solar power supply. For the vibration sensor, the main body includes a power management module and MCU, and the functional modules include Beidou positioning module, Lora module, seismic detector and sound sensor. In the working state, Figure 3As shown, the detection host is in sleep mode, while the vibration sensor is in working mode, which consumes less power. The vibration sensor in working mode can detect vibration information and sound information, so as to conduct preliminary detection of the alarm event. Specifically, after detecting the vibration information, the sound sensor is awakened to identify the target, and at the same time, the vibration and sound data are fused and output through the vibration-sound fusion algorithm, and transmitted to the detection host through the Lora module. If the sound detection fails to identify the target, the vibration alarm result is directly transmitted to the detection host.

[0032] In this embodiment, the detection host is awakened after receiving the Lora message, and at the same time wakes up the environmental perception device to perceive the environment, including image shooting, video shooting, etc., so as to use the AI ​​recognition algorithm to identify the target in the shooting.

[0033] In one embodiment, the networking module includes: a Lora module and a radio module; the Lora module and the radio module perform wireless transmission and reception through antennas; the detection device and the aggregation device perform wireless self-organizing networking through the Lora module and the radio module; the radio module is used for broadband self-organizing networking, and the Lora module is used for narrowband self-organizing networking. Specifically, multiple sets of detection devices and aggregation devices automatically complete the Lora narrowband self-organizing network when deployed, and the radio broadband self-organizing network of multiple sets of detection devices and aggregation devices is dynamically established during the communication process.

[0034] In one of the embodiments, the environment perception module includes: an ambient light sensor, a visible light camera, and an infrared camera; the ambient light sensor is used to obtain the current ambient lighting information, and the visible light camera or the infrared camera is selected to be turned on according to the current ambient lighting information; the visible light camera and the infrared camera are both used to obtain image information or video information of the environment. Specifically, the visible light camera, the infrared camera, and the positioning module are powered off and do not work when no alarm occurs, the detection host runs in sleep mode, and the device is in a low power consumption state to reduce battery power consumption. In addition, when the detection host is awakened, the SOC, the visible light camera, and the infrared camera are awakened first. The visible light camera or the infrared camera performs extremely fast capture to detect targets based on the captured images or videos. In this process, the radio station self-organizing network is established, and after the radio station self-organizing network is established, image and video data are transmitted.

[0035] In one embodiment, the image information or video information is transmitted to the aggregation device via a radio module. In this embodiment, since the image information or video information occupies a large bandwidth, it can be transmitted via a radio module.

[0036] In one embodiment, the seismic-acoustic fusion information is transmitted to the detection host through the Lora module, and the alarm detection information is transmitted to the aggregation device through the Lora module. In this embodiment, the seismic-acoustic fusion information and the alarm detection information are both text, with low bandwidth requirements and fast time requirements. In order to further reduce power consumption and improve response time, the alarm information can be transmitted through the Lora module.

[0037] In one embodiment, the detection device and the aggregation device establish a Lora narrowband ad hoc network through the Lora module and generate Lora routing information; the detection device and the aggregation device dynamically establish a radio broadband ad hoc network through the radio module and generate radio routing information. In this embodiment, the Lora narrowband ad hoc network and the radio broadband ad hoc network are automatically switched when the signal strength is lower than the threshold and under interference conditions.

[0038] Specifically, Figure 4 As shown, a Lora narrowband self-organizing network is established between the detection device and the aggregation device through the Lora module, and a node tree is generated; the aggregation device generates a networking instruction and broadcasts it to each detection device. The detection device receives the networking instruction, completes the radio broadband self-organizing network according to the networking instruction, connects to the TCP server of the aggregation device, and reports the generated node tree to the aggregation device. The aggregation device generates a full routing path for the node trees of all detection devices in sequence through the Dijkstra shortest path algorithm, and sends it to the detection device for storage.

[0039] The aggregation device can be a mobile aggregation device or a fixed aggregation device. For mobile aggregation devices, such as Figure 5 As shown, for fixed polymerization equipment, Figure 6 As shown, the difference between the two lies in the different power supply methods. Compared with the detection equipment, it reduces the visible light and infrared camera detection functions.

[0040] In other embodiments, Figure 7 As shown, an execution flow chart of an intelligent electronic sentry system is provided, and the specific process is as follows:

[0041] 1. When the vibration sensor is turned on, it will report its own Beidou positioning to the detection host. When the detection host is turned on, it will report its own and the vibration sensor's Beidou positioning to the aggregation device through narrowband transmission according to the optimal path for display on the platform;

[0042] 2. The vibration sensor enters the long-term detection mode, and the detection device host is in the sleep mode for a long time;

[0043] 3. After the vibration sensor recognizes the target, it wakes up the internal sound sensor for target recognition. After the target is recognized, the vibration and sound fusion algorithm is used to fuse the vibration and sound data for result output, which is transmitted to the bound detection host through the LORA private network. If the sound does not recognize the target, the vibration alarm result is directly output and transmitted to the bound detection host through the LORA private network;

[0044] 4. The detection host is awakened after receiving the LORA private network message sent by the vibration sensor. After being awakened, the SOC and visible light / infrared camera are turned on to quickly capture the scene pictures. After waiting for the device to be fully started, AI target recognition is performed on the captured pictures, and AI target recognition is performed on the real-time video recording of the scene at the same time;

[0045] 5. After the detection host recognizes the target, it will continue to record the real-time AI target recognition video for local storage according to the set duration, and at the same time start the self-organizing network radio, and wake up the devices in the middle of the optimal transmission path from the detection host to the aggregation device in sequence according to the optimal transmission path. The alarm event results will be transmitted through narrowband first, and after the broadband transmission network is established, the video and picture information of the alarm event will be transmitted to the aggregation device;

[0046] 6. After the detection device host recognizes the target, it calculates the final result through the seismic-visual fusion algorithm and transmits it to the aggregation device through the optimal transmission path and narrowband networking.

[0047] 7. After receiving the alarm information, the fixed aggregation device will store it locally and send the alarm message to the alarm management device via satellite / ad hoc network / 4G / 5G / optical fiber / network port transmission. The alarm location, time, target type, identification process and other information will be displayed on the alarm management device, and remote processing is supported;

[0048] 8. After receiving the alarm information, the portable aggregation device will store it locally and transmit the alarm message to the alarm management device via WIFI. The alarm location, time, target type, identification process and other information will be displayed on the alarm management device, and remote processing is supported.

[0049] For fixed aggregation equipment, it can be connected to fixed digital alarm management equipment, and for portable aggregation equipment, it can be connected to mobile alarm management equipment.

[0050] In one embodiment, the intelligent on-duty electronic sentinel method is applied to the above-mentioned intelligent on-duty electronic sentinel system. The detection host records the video through the environmental perception module to obtain video information and image information. The detection host sends the video information and image information to the aggregation device through a wireless ad hoc network, and the unmanned operation in the area is completed by the aggregation device.

[0051] For the specific definition of the intelligent on-duty electronic sentinel method, please refer to the definition of the intelligent on-duty electronic sentinel system above, which will not be repeated here. Each step in the above-mentioned intelligent on-duty electronic sentinel method can be implemented in whole or in part by software, hardware and a combination thereof. The above-mentioned modules can be embedded in or independent of the processor in the computer device in the form of hardware, or can be stored in the memory of the computer device in the form of software, so that the processor can call and execute the operations corresponding to the above modules.

[0052] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to memory, storage, database or other media used in the embodiments provided in this application can include non-volatile and / or volatile memory. Non-volatile memory can include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM) or flash memory. Volatile memory can include random access memory (RAM) or external cache memory. As an illustration and not limitation, RAM is available in many forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).

[0053] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0054] The above-mentioned embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the invention patent. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the patent of the present application shall be subject to the attached claims.

Claims

1. An intelligent electronic sentry system, characterized in that: The system includes: an aggregation device, a detection device and an alarm management device; the detection device includes: a vibration sensor and a detection host; The detection device includes: a detection host and a vibration detector; the detection host includes: a networking module and an environment perception module; The detection device and the aggregation device are wirelessly self-organized through the networking module; the vibration detector is uniquely registered in the detection host through the networking module; The vibration detector outputs the vibration alarm result and the alarm location information to the detection host through the networking module; the detection host identifies the acquired environmental information through the environmental perception module to obtain the alarm detection result; The detection host sends the alarm detection result and the alarm location information to the aggregation device, and the aggregation device uploads the alarm detection result and the alarm location information to the alarm management device.

2. The system according to claim 1, characterized in that The networking module includes: a Lora module and a radio module; The Lora module and the radio module perform wireless transmission and reception via antennas; The detection device and the aggregation device form a wireless ad hoc network through the Lora module and the radio module; The radio module is used for broadband ad hoc networks, and the Lora module is used for narrowband ad hoc networks.

3. The system according to claim 2, characterized in that The environment perception module includes: an ambient light sensor, a visible light camera, and an infrared camera; The ambient light sensor is used to obtain current ambient light information, and select to turn on the visible light camera or the infrared camera according to the current ambient light information; The visible light camera and the infrared camera are both used to obtain image information or video information of the environment.

4. The system according to claim 3, characterized in that The image information or video information is transmitted to the aggregation device through the radio module.

5. The system according to claim 2, characterized in that The vibration alarm result is transmitted to the detection host through the Lora module, and the text information in the alarm detection result is transmitted to the aggregation device through the Lora module.

6. The system according to claim 2, characterized in that The detection device and the aggregation device establish a Lora narrowband ad hoc network through the Lora module and generate Lora routing information; The detection device and the aggregation device dynamically establish a radio broadband self-organizing network through the radio module and generate radio routing information.

7. The system according to claim 6, characterized in that After being turned on, a Lora narrowband ad hoc network is established between the detection devices through the Lora module, and a node tree is generated; The aggregation device generates a networking instruction and broadcasts it to each detection device. The detection device receives the networking instruction, completes the radio broadband self-networking according to the networking instruction, connects to the TCP server of the aggregation device, and reports the generated node tree to the aggregation device. The aggregation device generates a full routing path for the node trees of all detection devices in sequence through the Dijkstra shortest path algorithm, and sends it to the detection device for storage.

8. The system according to claim 7, characterized in that The Lora narrowband ad hoc network and the radio broadband ad hoc network are automatically switched when the signal strength is lower than a threshold and under interference conditions.

9. The system according to claim 3, characterized in that The alarm management device displays all the alarm detection information on a map according to the alarm location information, and processes the alarm detection information.

10. An intelligent electronic sentry guarding method, characterized in that: Applicable to the intelligent on-duty electronic sentinel system as described in any one of claims 1 to 9.

Images