Intelligent security comprehensive management and control system based on cloud service

Abstract

The invention provides an intelligent security comprehensive management and control system based on cloud service, and aims to improve the coverage rate and accuracy of security monitoring. The system comprises a plurality of fixed-point monitoring modules, a plurality of mobile monitoring modules and a cloud server. The fixed-point monitoring module is composed of a camera module, an angle sensing module, an orientation sensing module, an angle adjusting module and an orientation adjusting module, and view orientation data of a monitoring area can be obtained through data collection and analysis. The mobile monitoring module is provided with a mobile module, a positioning module and a camera module, and can automatically cruise and supplement monitoring in a monitoring blind area. By adopting a security and protection monitoring deployment strategy and calculating and comparing the coverage conditions of the fixed-point monitoring area and the security and protection boundary area, the system can intelligently identify and fill the monitoring blind area, and the comprehensive coverage of the security and protection area is ensured. The fixed-point monitoring module and the mobile monitoring module work cooperatively, and data processing is carried out in combination with the cloud server, so that the monitoring accuracy and efficiency are improved, and the security and protection reliability is enhanced.

Description

Technical Field

[0001] The present application relates to the field of security, and in particular to a cloud-based integrated intelligent security management and control. Background Art

[0002] The security control system is a comprehensive management platform that integrates multiple security functions such as video surveillance, access control, and intrusion alarm.

[0003] The security control systems currently on the market mainly include intelligent analysis systems based on video surveillance, comprehensive security systems based on the Internet of Things, and distributed security systems based on cloud computing. These systems can achieve all-weather, all-round security monitoring, can promptly discover and deal with various safety hazards, and effectively reduce the incidence of safety accidents. Through deep learning and artificial intelligence technology, the system can intelligently identify suspicious behaviors and abnormal events, and automatically alarm, greatly improving the efficiency and accuracy of security work.

[0004] However, the existing security control system still has many shortcomings. First, the system integration is not high, and the data sharing and linkage between the subsystems are not perfect, resulting in the widespread existence of information islands. Secondly, the system's intelligence level is limited, and the recognition accuracy in complex scenarios is not ideal, and false alarms and missed alarms often occur.

[0005] Moreover, when an intrusion occurs, the existing security control system can only display the intruder in a certain monitoring screen, but cannot track the intruder's movement trajectory and position changes in real time. This problem of fuzzy positioning makes it difficult for security personnel to quickly find the intruder's exact location based on the video screen even if the system detects the presence of the intruder, thus delaying the time to deal with it. Summary of the invention

[0006] This application provides a cloud-based intelligent security integrated management and control system, including: Multiple fixed-point monitoring modules; Multiple mobile monitoring modules; Cloud servers; Wherein, each of the fixed-point monitoring modules and each of the mobile monitoring modules are communicatively connected to the cloud server, and each of the fixed-point monitoring modules is respectively positioned and installed at a preset monitoring installation position; Wherein, the fixed-point monitoring module includes a first camera module, an angle sensing module, an azimuth sensing module, an angle adjustment module and an azimuth adjustment module, and the angle sensing module, the azimuth sensing module, the angle adjustment module and the azimuth adjustment module are respectively connected to the first camera module; Wherein, the mobile monitoring module comprises a mobile module, a positioning module and a second camera module, and the positioning module and the second camera module are respectively connected to the mobile module; The cloud-based smart security integrated management and control system further includes a security monitoring deployment strategy, including the following steps: A1, surveying and mapping the preset security area to obtain the corresponding digital model data of the security area; A2, determining corresponding security boundary area data according to the security area digital model data and the preset boundary width; A3, obtaining corresponding camera pitch angle and camera azimuth angle through each of the fixed-point monitoring modules; A4, obtaining installation positioning data, vertical field of view angle and horizontal field of view angle corresponding to each of the fixed-point monitoring modules; A5, calculating corresponding monitoring field of view azimuth data according to the installation positioning data, vertical field of view angle, horizontal field of view angle, camera pitch angle and camera azimuth angle corresponding to each of the fixed-point monitoring modules; A6, determining the corresponding fixed-point monitoring area data respectively according to the monitoring field of view azimuth data corresponding to each of the fixed-point monitoring modules and the digital model data of the security area; A7, generating fixed-point monitoring coverage area data according to all fixed-point monitoring area data combinations; A8, determine the data of the boundary area not covered by the monitoring by comparing the data of the fixed-point monitoring coverage area with the data of the security boundary area; A9, controlling the mobile monitoring module to move to the area corresponding to the monitoring uncovered boundary area data and perform monitoring actions.

[0007] By adopting the above technical solution, the cloud service-based intelligent security integrated management and control system can not only accurately cover the boundaries of the security area, but also automatically identify and fill monitoring blind spots through the collaborative work of fixed-point monitoring modules and mobile monitoring modules, combined with data analysis and management of cloud servers, thereby improving the reliability of security monitoring.

[0008] Optionally, the cloud server includes a storage unit, an identification unit, a communication unit and a control unit, the storage unit, the identification unit and the communication unit are data-connected to the control unit, and the communication unit is communicatively connected to each of the fixed-point monitoring modules and each of the mobile monitoring modules; The cloud-based smart security integrated management and control system further includes a security monitoring and early warning strategy, including the following steps: B1, obtaining corresponding fixed-point monitoring video data through each of the fixed-point monitoring modules; B2, real-time transmission of each fixed-point monitoring video data to the cloud server; B3, the cloud server generates corresponding event confidence and data time according to each fixed-point monitoring video data through a preset event recognition algorithm; B4, if the event confidence is greater than the preset event trigger threshold, the corresponding data moment is defined as the event trigger moment, and a preset event trigger warning is sent to the preset monitoring background.

[0009] By adopting the above technical solution, the cloud service-based intelligent security integrated management and control system can perform real-time analysis of surveillance videos through event recognition algorithms, and through quantitative evaluation of event confidence and threshold triggering mechanisms, it can accurately identify and quickly respond to potential security threats, thereby improving the early warning efficiency and accuracy of the security system and providing security managers with timely and reliable decision-making support.

[0010] Optionally, the storage unit includes a temporary storage module, a high-performance storage module and a general storage module, the high-performance storage module and the general storage module are respectively data-connected to the temporary storage module, and the temporary storage module is respectively data-connected to the communication unit and the identification unit; The cloud-based smart security integrated management and control system further includes a security monitoring video storage strategy, including the following steps: C1, after the cloud server receives the fixed-point monitoring video data, the fixed-point monitoring video data is stored in the temporary storage module; C2, storing the fixed-point monitoring video data in the temporary storage module to the general storage module; C3, determining the corresponding event time window data according to all event triggering moments corresponding to the fixed-point monitoring video data; C4, obtain the corresponding event time window video data set from the fixed-point monitoring video data according to the event time window data; C5, stores the event time window video data set in the high-performance storage module.

[0011] By adopting the above technical solution, the cloud service-based intelligent security integrated management and control system can realize classified management of monitoring video data through a hierarchical storage architecture of temporary storage modules, high-performance storage modules and general storage modules, and can preferentially store important event video data in high-performance storage modules to ensure fast access and efficient processing of key video data. At the same time, all video data is saved through general storage modules, which not only improves the system's response speed and query efficiency to important security events, but also has a backup effect on key video data.

[0012] Optionally, the recognition unit includes an event recognition module, a person recognition module and a face recognition module, and the event recognition module, the person recognition module and the face recognition module are data-connected to the temporary storage module and the control unit respectively.

[0013] By adopting the above technical solution, the cloud service-based intelligent security integrated management and control system can capture all dimensions of security events from the global to the local through a progressive recognition process of three levels: event recognition, person recognition and face recognition. This layered recognition not only improves the recognition accuracy and efficiency of the system, but also provides more detailed event information and personnel characteristics, providing strong technical support for security management and event tracing.

[0014] Optionally, the cloud service-based smart security integrated management and control system further includes an event information identification strategy, including the following steps: D1, the event recognition module generates corresponding event confidence and data time through an event recognition algorithm according to the fixed-point monitoring video data; D2, if the event confidence is greater than the event triggering threshold, the event video frame corresponding to the data moment is transmitted to the person recognition module; D3, the human recognition module identifies the event video frame through a preset human recognition algorithm to determine the corresponding human image data; D4, if the human body image data is not a null value, then according to the human body image data, the face recognition module generates corresponding face image data through a preset face recognition algorithm; D5, generating event information data according to the data time and the corresponding event video frame, human image data and face image data, and the monitoring number information corresponding to the fixed-point monitoring video data; D6, transmit event information data to the monitoring background.

[0015] By adopting the above technical solution, the cloud service-based intelligent security integrated management and control system can realize all-round information collection and integration of security events through the serial processing of event recognition, human recognition and face recognition, combined with timestamps and monitoring numbers. This progressive recognition process can not only ensure the accuracy and completeness of recognition, but also efficiently screen and integrate key information, provide security managers with detailed event reports, and improve the information timeliness and decision-making support capabilities of the security system.

[0016] Optionally, the event information identification strategy further includes the following steps: E1, matching and searching the face image data in the event information data with the preset known person face database; E2, if the facial image data successfully matches the known person face database, then add the corresponding known person information to the event information data; E3, if the facial image data fails to match the known person facial database, then add the preset unknown person warning information to the event information data; E4, if the unknown person warning information exists in the event information data, estimating the corresponding unknown person location data according to the event information data and the corresponding fixed-point monitoring area data of the fixed-point monitoring module; E5, add unknown person location data to the event information data.

[0017] By adopting the above technical solution, the cloud service-based intelligent security integrated management and control system can not only quickly identify known persons, but also mark and estimate the positions of unknown persons through real-time matching with the known person database, thereby improving the early warning capability for suspicious persons and providing accurate spatial information for subsequent security responses through the estimation of position data, greatly enhancing the active defense and rapid response capabilities of the security system.

[0018] Optionally, the event information identification strategy further includes the following steps for estimating unknown person location data: E401, determining a corresponding horizontal length and a corresponding vertical length of the area according to the fixed-point monitoring area data of the fixed-point monitoring module corresponding to the event information data; E402, determining a corresponding human body recognition frame in the event video frame according to the human body image data in the event information data; E403, determining the pixel coordinates of the midpoint of the bottom edge of the human body recognition frame in the event video frame and defining them as the pixel coordinates of the human body position; E404, determining the corresponding horizontal coordinate percentage position and vertical coordinate percentage position in the event video frame according to the pixel coordinates of the human body position; E405, determining the corresponding unknown person positioning data according to the horizontal coordinate percentage position and the vertical coordinate percentage position in the fixed-point monitoring area data.

[0019] By adopting the above technical solution, the cloud service-based intelligent security integrated management and control system can realize the conversion from two-dimensional image to actual space coordinates by mapping the pixel coordinates in the video frame with the physical size of the actual monitoring area, combining the bottom midpoint positioning and percentage position calculation of the human body recognition frame. It not only takes into account the actual size characteristics of the monitoring area, but also improves the accuracy and applicability of position estimation through standardized percentage positioning, providing reliable spatial reference data for the positioning and tracking of unknown personnel.

[0020] Optionally, the event information identification strategy further includes the following steps: F1, display the corresponding personnel identification graphic in the digital model data of the security area according to the unknown personnel positioning data; F2, controlling the mobile monitoring module to go to a corresponding area according to the unknown person positioning data, and obtaining the mobile positioning data corresponding to the mobile monitoring module; F3, display the corresponding mobile monitoring identification graphic in the digital model data of the security area according to the mobile positioning data; F4, determining the best moving path data according to the unknown person positioning data, the mobile positioning data and the digital model data of the security area, and displaying the corresponding moving path graph in the digital model data of the security area.

[0021] By adopting the above technical solution, the cloud-based intelligent security integrated management and control system can realize intuitive management of security monitoring by displaying the personnel location, mobile monitoring equipment location and optimal moving path in real time on the digital model. It can automatically plan the optimal patrol path and then intelligently dispatch the mobile monitoring module for dynamic tracking. At the same time, through graphical display, security personnel can intuitively grasp the on-site situation, which greatly improves the real-time monitoring effect and emergency response capability of the security system.

[0022] In summary, the present application includes at least one of the following beneficial technical effects: 1. Through the collaborative work of fixed-point monitoring modules and mobile monitoring modules, combined with data analysis and management of cloud servers, not only can the boundaries of security areas be accurately covered, but also blind spots can be automatically identified and filled, thus improving the reliability of security monitoring.

[0023] 2. The event recognition algorithm can be used to perform real-time analysis of surveillance videos. Through the quantitative evaluation of event confidence and the threshold trigger mechanism, potential security threats can be accurately identified and quickly responded to, thereby improving the early warning efficiency and accuracy of the security system and providing security managers with timely and reliable decision-making support.

[0024] 3. The hierarchical storage architecture of temporary storage modules, high-performance storage modules and general storage modules can be used to achieve classified management of surveillance video data. Important event video data can be stored in high-performance storage modules first to ensure fast access and efficient processing of key video data. At the same time, all video data can be saved in general storage modules, which not only improves the system's response speed and query efficiency to important security events, but also serves as a backup for key video data. BRIEF DESCRIPTION OF THE DRAWINGS

[0025] Figure 1 It is a schematic diagram of the principle of a cloud service-based intelligent security integrated management and control system of the present invention.

[0026] Figure 2 It is a process schematic diagram of a cloud service-based intelligent security integrated management and control system of the present invention. DETAILED DESCRIPTION

[0027] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0028] The embodiments of the present application are further described in detail below in conjunction with the drawings in the specification.

[0029] refer to Figure 1 and Figure 2 The present invention provides a cloud service-based intelligent security integrated management and control system, including: Multiple fixed-point monitoring modules 10; A plurality of mobile monitoring modules 20; Cloud server 30; Wherein, each of the fixed-point monitoring modules 10 and each of the mobile monitoring modules 20 are communicatively connected to the cloud server 30, and each of the fixed-point monitoring modules 10 is respectively positioned and installed at a preset monitoring installation position; The fixed-point monitoring module 10 includes a first camera module 11, an angle sensor module 12, an orientation sensor module 13, an angle adjustment module 14 and an orientation adjustment module 15, wherein the angle sensor module 12, the orientation sensor module 13, the angle adjustment module 14 and the orientation adjustment module 15 are respectively connected to the first camera module 11; The mobile monitoring module 20 includes a mobile module 21 , a positioning module 22 and a second camera module 23 , and the positioning module 22 and the second camera module 23 are respectively connected to the mobile module 21 .

[0030] Each of the fixed-point monitoring modules 10 is mainly used to be fixedly installed at different locations, to obtain monitoring videos of various directions in the monitoring area, and to upload the monitoring videos to the cloud server 30 for storage and analysis.

[0031] The first camera module 11 is mainly used to obtain monitoring video data of the corresponding direction; The angle sensor module 12 is mainly used to obtain the pitch angle value of the first camera module 11 in the vertical direction; The azimuth sensing module 13 is mainly used to obtain the azimuth angle value of the first camera module 11 in the horizontal direction; The angle adjustment module 14 is mainly used to adjust the pitch angle of the first camera module 11 in the vertical direction; The azimuth adjustment module 15 is mainly used to adjust the azimuth angle of the first camera module 11 in the horizontal direction.

[0032] Each of the mobile monitoring modules 20 is mainly used to supplement the video monitoring of the fixed-point monitoring modules 10. On the one hand, it can be used to fill in the areas not covered by the monitoring. On the other hand, it can control the movement to monitor specific areas or objects according to needs.

[0033] The mobile module 21 is mainly used for controlled movement, so that the mobile monitoring module 20 has the ability to move. The mobile module 21 can be a carrier that can be controlled to move, such as various drones or unmanned vehicles; The positioning module 22 is mainly used to obtain the positioning data of the mobile monitoring module 20 to facilitate the control of movement; The second camera module 23 is mainly used to obtain corresponding monitoring videos to supplement the monitoring videos of each of the fixed-point monitoring modules 10; The cloud server 30 is mainly used to receive, store and analyze the monitoring video data obtained by the fixed-point monitoring module 10 and the mobile monitoring module 20 to detect risks and issue warnings.

[0034] The cloud-based smart security integrated management and control system further includes a security monitoring deployment strategy, including the following steps: A1, surveying and mapping the preset security area to obtain the corresponding digital model data of the security area; The security area is a pre-set area that needs to be monitored for security; The digital model data of the security area is the three-dimensional model data of the security area, which may include objects such as terrain, roads, and buildings. It can be obtained by mapping through specific surveying equipment, or by mapping through mobile photography of the security area by the mobile monitoring module 20. For example, existing mature technologies can establish a three-dimensional model through mapping by drone aerial photography.

[0035] A2, determining corresponding security boundary area data according to the security area digital model data and the preset boundary width; The boundary width is a preset width used to determine the width of the area to be monitored at the boundary of the security area, and can be set according to monitoring requirements or the performance of the monitoring equipment; The security boundary area data is the positioning information of the area around the security area that needs to be video monitored.

[0036] A3, obtaining the corresponding camera pitch angle and camera azimuth angle through each of the fixed-point monitoring modules 10; The camera pitch angle is the pitch angle of the first camera module 11 of the fixed-point monitoring module 10 in the vertical direction; The camera azimuth angle is the azimuth angle of the first camera module 11 of the fixed-point monitoring module 10 in the horizontal direction.

[0037] A4, obtaining the installation positioning data, vertical field of view angle and horizontal field of view angle corresponding to each of the fixed-point monitoring modules 10; The installation positioning data is the positioning data of the installation position of the positioning monitoring module 20, including horizontal coordinates and height data; The installation positioning data can be measured and determined when installing the fixed-point monitoring module 10; The vertical field of view angle is the field of view angle of the first camera module 11 of the fixed-point monitoring module 10 in the vertical direction, which determines the range of the image that can be captured by the first camera module 11 in the vertical direction; The horizontal field of view angle is the field of view angle of the first camera module 11 of the fixed-point monitoring module 10 in the horizontal direction, which determines the image range that the first camera module 11 can capture in the horizontal direction; The vertical field angle and the horizontal field angle can be determined when different types of the first camera modules 11 are selected.

[0038] A5, calculating the corresponding monitoring field of view azimuth data according to the installation positioning data, vertical field of view angle, horizontal field of view angle, camera pitch angle and camera azimuth angle corresponding to each of the fixed-point monitoring modules 10; The monitoring field of view azimuth data is the shooting direction and screen range of the monitoring video of the first camera module 11 of the fixed-point monitoring module 10. The corresponding shooting direction can be calculated according to the installation positioning data, the camera pitch angle and the camera azimuth angle, and the corresponding screen range can be calculated and determined according to the vertical field of view angle and the horizontal field of view angle; For example, the monitoring field of view azimuth data can be determined by calculating the ray azimuth data of the four vertices in the monitoring screen of the fixed-point monitoring module 10 based on the installation positioning data.

[0039] A6, determining the corresponding fixed-point monitoring area data according to the monitoring field of view azimuth data corresponding to each of the fixed-point monitoring modules 10 and the digital model data of the security area; The fixed-point monitoring area data is the positioning data of the area where the fixed-point monitoring module 10 can monitor and obtain the image, and the positioning data of the area that the monitoring image can cover; According to the monitoring field of view orientation data of the fixed-point monitoring module 10 projected onto the digital model data of the security area at the installation location, the coverage area of ​​the corresponding monitoring screen can be determined.

[0040] A7, generating fixed-point monitoring coverage area data according to all fixed-point monitoring area data combinations; The fixed-point monitoring coverage area data is a collection of the fixed-point monitoring area data corresponding to all the fixed-point monitoring modules 10 , reflecting the areas that can be monitored and covered by all the fixed-point monitoring modules 10 .

[0041] A8, determine the data of the boundary area not covered by the monitoring by comparing the data of the fixed-point monitoring coverage area with the data of the security boundary area; The monitoring uncovered boundary area data refers to the area not covered by the monitoring in the security boundary area data, which can be determined by comparing the fixed-point monitoring coverage area data with the security boundary area data; A9, controlling the mobile monitoring module 20 to move to the area corresponding to the monitoring uncovered boundary area data and perform monitoring actions; Control the mobile monitoring module 20 to move to an area not covered by the fixed-point monitoring module 10 for supplementary monitoring. For example, a drone equipped with a camera may be flown to the corresponding area for monitoring. Because the fixed-point monitoring module 10 may be controlled to adjust the shooting direction and angle due to other needs, thereby changing the original shooting area, a certain area may be left unmonitored, so it is necessary to detect and supplement the unmonitored area.

[0042] Through the above technical solutions, the cloud service-based intelligent security integrated management and control system can not only accurately cover the boundaries of the security area, but also automatically identify and fill monitoring blind spots through the collaborative work of fixed-point monitoring modules and mobile monitoring modules, combined with data analysis and management of cloud servers, thereby improving the reliability of security monitoring.

[0043] Furthermore, the cloud server 30 includes a storage unit 31, an identification unit 32, a communication unit 33 and a control unit 34, the storage unit 31, the identification unit 32 and the communication unit 33 are data connected to the control unit 34, and the communication unit 33 is communicatively connected to each of the fixed-point monitoring modules 10 and each of the mobile monitoring modules 20.

[0044] The storage unit 31 is mainly used to store the video image data collected by each of the fixed-point monitoring modules 10 and each of the mobile monitoring modules 20, as well as various data and information generated based on the analysis and processing of the video image data; The identification unit 32 is mainly used to identify and analyze the video image data to find possible security risk events; The communication unit 33 is mainly used to establish communication links and data transmission paths between the cloud server 30 and each of the fixed-point monitoring modules 10, each of the mobile monitoring modules 20 and the corresponding control background; The control unit 34 is mainly used to control each of the fixed-point monitoring modules 10 and each of the mobile monitoring modules 20 .

[0045] The cloud-based smart security integrated management and control system further includes a security monitoring and early warning strategy, including the following steps: B1, obtaining corresponding fixed-point monitoring video data through each of the fixed-point monitoring modules 10; The fixed-point monitoring video data is monitoring video data captured by the first camera module 11 of the fixed-point monitoring module 10 .

[0046] B2, real-time transmission of each fixed-point monitoring video data to the cloud server 30; The fixed-point monitoring video data is transmitted to the cloud server 30 for data analysis and data storage.

[0047] B3, the cloud server 30 generates corresponding event confidence and data time according to each fixed-point monitoring video data through a preset event recognition algorithm; The event recognition algorithm is a pre-set algorithm that can preliminarily recognize and determine whether an event has occurred in the video image based on the content of multiple video frames of the video data. For example, it can determine whether an object has moved by judging the change in the video image, and further estimate the reliability of the algorithm recognition based on the displacement degree or speed of the object, or it can train the corresponding machine learning model through certain training data to generate a corresponding recognition model that can perform event recognition, so as to recognize the occurrence of the event; The event confidence is the probability value of the event occurring obtained by the event recognition algorithm; The data moment is the moment corresponding to the event confidence, that is, the moment corresponding to the video frame currently identified by the event recognition algorithm. For example, the event recognition algorithm recognizes events by extracting video frames within a time window of 3 seconds, and the corresponding data moment can be the median moment of this time window.

[0048] B4, if the event confidence is greater than the preset event trigger threshold, the corresponding data moment is defined as the event trigger moment, and a preset event trigger warning is sent to the preset monitoring background; The event trigger threshold is a pre-set reference value used to determine whether the event confidence is large enough to be considered as an event; The event triggering moment is the data moment corresponding to the event confidence level of the possible event; Event trigger warning is a pre-set warning message used to remind the corresponding monitoring background staff; The monitoring background is the background for staff to monitor.

[0049] Through the above technical solutions, the cloud-based intelligent security integrated management and control system can perform real-time analysis of surveillance videos through event recognition algorithms, and can accurately identify and quickly respond to potential security threats through quantitative evaluation of event confidence and threshold triggering mechanisms, thereby improving the early warning efficiency and accuracy of the security system and providing security managers with timely and reliable decision-making support.

[0050] Further, the storage unit 31 includes a temporary storage module 311, a high-performance storage module 312 and a general storage module 313, the high-performance storage module 312 and the general storage module 313 are respectively data-connected to the temporary storage module 311, and the temporary storage module 311 is respectively data-connected to the communication unit 33 and the identification unit 32; The temporary storage module 311 is mainly used to temporarily store data. The temporary storage module 311 can be a memory in the cloud server. Since the read and write speed of the memory is much faster than that of the hard disk, when the cloud server 30 receives the video data, it is temporarily stored in the memory so that the recognition unit 32 can quickly read and recognize it. The high-performance storage module 312 is mainly used to read and store data at high speed. For example, it can be used to store video content of an event so that subsequent staff can quickly read and call it when reviewing it. The high-performance storage module 312 can be a high-performance read-write storage such as a solid-state hard disk in a cloud server; The general storage module 313 is mainly used for conventionally storing all received video contents for ready viewing. The general storage module 313 can be a storage device of general performance such as a mechanical hard disk in a cloud server.

[0051] The cloud-based smart security integrated management and control system further includes a security monitoring video storage strategy, including the following steps: C1, after the cloud server 30 receives the fixed-point monitoring video data, the fixed-point monitoring video data is stored in the temporary storage module 31; The fixed-point monitoring video data received from each of the fixed-point monitoring modules 10 is stored in the temporary storage module 31 so as to be quickly read and called by the recognition unit 32 .

[0052] C2, storing the fixed-point monitoring video data in the temporary storage module 31 to the general storage module 313; The fixed-point monitoring video data is completely stored in the general storage module 313, which can ensure the complete process of monitoring the video for subsequent viewing.

[0053] C3, determine the corresponding event time window data set according to all event triggering moments corresponding to the fixed-point monitoring video data; The event time window dataset is a data collection that determines the time window based on the triggering time of each event. For example, consecutive event triggering times can be identified as the time of the same event. Then these event triggering times can be connected to generate the corresponding event window to determine the continuous occurrence of events within the event window.

[0054] C4, obtain the corresponding event time window video data set from the fixed-point monitoring video data according to the event time window data set; The event time window video dataset is a collection of video data corresponding to each time window in the event time window data. Usually, one time window corresponds to a segment of video data.

[0055] C5, storing the event time window video data set in the high-performance storage module 312.

[0056] The event time window video data set is stored in the high-performance storage module 312 for subsequent quick retrieval and viewing.

[0057] Through the above technical solution, the cloud service-based intelligent security integrated management and control system can realize the classified management of monitoring video data through the hierarchical storage architecture of temporary storage modules, high-performance storage modules and general storage modules, and can store important event video data in high-performance storage modules in priority to ensure fast access and efficient processing of key video data. At the same time, all video data is saved through general storage modules, which not only improves the system's response speed and query efficiency to important security events, but also has a backup effect on key video data.

[0058] Furthermore, the recognition unit 32 includes an event recognition module 321 , a person recognition module 322 and a face recognition module 323 , and the event recognition module 321 , the person recognition module 322 and the face recognition module 323 are data-connected to the temporary storage module 311 and the control unit 34 , respectively.

[0059] The event recognition module 321 is mainly used to recognize whether an event has occurred in the video data; The person identification module 322 is mainly used to identify whether a person appears in the video data of an event.

[0060] The face recognition module 323 is mainly used to recognize and obtain face image data in video data where an event occurs and a person appears.

[0061] Through the above technical solutions, the cloud-based intelligent security integrated management and control system can capture all dimensions of security events from the global to the local through a three-level progressive recognition process of event recognition, person recognition and face recognition. This layered recognition not only improves the recognition accuracy and efficiency of the system, but also provides more detailed event information and personnel characteristics, providing strong technical support for security management and event tracing.

[0062] Furthermore, the cloud service-based intelligent security integrated management and control system also includes an event information identification strategy, including the following steps: D1, the event recognition module 321 generates corresponding event confidence and data time according to the fixed-point monitoring video data through the event recognition algorithm; The event recognition module 321 recognizes the fixed-point monitoring video data to generate corresponding event confidence and data time.

[0063] D2, if the event confidence is greater than the event triggering threshold, the event video frame corresponding to the data moment is transmitted to the person recognition module; The event video frame is a video frame corresponding to the fixed-point monitoring video data at the data moment, that is, a video frame corresponding to the event that is identified as occurring.

[0064] D3, the person recognition module 322 identifies the event video frame through a preset human body recognition algorithm to determine the corresponding human body image data; The human body recognition algorithm is a pre-set algorithm used to recognize human body images in event video frames; The human body image data is image data containing a human body in an event video frame.

[0065] D4, if the human body image data is not a null value, then according to the human body image data, the face recognition module 323 generates corresponding face image data through a preset face recognition algorithm; The face recognition algorithm is a pre-set algorithm used to recognize face image data in human image data; The face image data is image data containing a face in the human body image data; If the person recognition module 322 successfully recognizes the human image data, the face recognition module 323 attempts to recognize and obtain the face image data that may exist in the human image data.

[0066] D5, generating event information data according to the data time and the corresponding event video frame, human image data and face image data, and the monitoring number information corresponding to the fixed-point monitoring video data; The monitoring number information is the number information of the fixed-point monitoring module 10 corresponding to the fixed-point monitoring video data, and is used to distinguish each fixed-point monitoring module 10; The event information data is a collection of the data time when an event may occur, as well as event video frames, human body image data, face image data and monitoring number information.

[0067] D6, transmit event information data to the monitoring background; The event information data is transmitted to the monitoring background for staff to evaluate and make decisions.

[0068] Through the above steps, the cloud service-based intelligent security integrated management and control system can realize all-round information collection and integration of security events through the serial processing of event recognition, human recognition and face recognition, combined with timestamps and monitoring numbers. This progressive recognition process can not only ensure the accuracy and completeness of recognition, but also efficiently screen and integrate key information, provide security managers with detailed event reports, and improve the information timeliness and decision-making support capabilities of the security system.

[0069] Furthermore, the event information identification strategy further includes the following steps: E1, matching and searching the face image data in the event information data with the preset known person face database; The known person face database is a database containing pre-stored face data of known persons, which may be face data of work-related persons.

[0070] E2, if the facial image data successfully matches the known person face database, then add the corresponding known person information to the event information data; The known person information is the person information corresponding to the successfully matched facial image data in the known person face database.

[0071] E3, if the facial image data fails to match the known person facial database, then add the preset unknown person warning information to the event information data; The unknown person warning message is a pre-set warning message used to alert the staff in the monitoring background so that they can be alert and respond quickly.

[0072] E4, if the unknown person warning information exists in the event information data, estimating the corresponding unknown person location data according to the event information data and the corresponding fixed-point monitoring area data of the fixed-point monitoring module 10; The unknown person positioning data is the position positioning data of the unknown person, which can be estimated and determined based on the fixed-point monitoring area data of the fixed-point monitoring module 10 that obtains the video image of the unknown person.

[0073] E5, add unknown person location data to event information data; The unknown person location data is added to the event information data to supplement the event information data and provide a basis for tracking data for subsequent response measures of the monitoring background.

[0074] Through the above steps, the cloud service-based intelligent security integrated management and control system can not only quickly identify known persons, but also mark and estimate the position of unknown persons through real-time matching with the known person database, which not only improves the early warning capability of suspicious persons, but also provides accurate spatial information for subsequent security response through the estimation of position data, greatly enhancing the active defense and rapid response capabilities of the security system.

[0075] Furthermore, the event information identification strategy also includes the following steps for estimating the unknown person location data: E401, determining the corresponding horizontal length and vertical length of the area according to the fixed-point monitoring area data of the fixed-point monitoring module 10 corresponding to the event information data; The horizontal length of the area is the actual horizontal length of the area corresponding to the fixed-point monitoring area data; The vertical length of the area is the actual vertical length of the area corresponding to the fixed-point monitoring area data; The actual horizontal length and the actual vertical length can be converted according to the positioning data corresponding to the fixed-point monitoring area data.

[0076] E402, determining a corresponding human body recognition frame in the event video frame according to the human body image data in the event information data; The human body recognition frame is a recognition frame generated by a corresponding recognition algorithm when the human body image data is recognized and determined.

[0077] E403, determining the pixel coordinates of the midpoint of the bottom edge of the human body recognition frame in the event video frame and defining them as the pixel coordinates of the human body position; The human body position pixel coordinates are the pixel coordinates of the midpoint of the bottom edge of the human body recognition frame in the event video frame, and are used to estimate and determine the position of the human body foot in the event video frame.

[0078] E404, determining the corresponding horizontal coordinate percentage position and vertical coordinate percentage position in the event video frame according to the pixel coordinates of the human body position; The horizontal coordinate percentage position is the percentage value of the position of the midpoint of the bottom edge of the human body recognition frame in the horizontal direction in the event video frame; The vertical coordinate percentage position is a percentage value of the position of the midpoint of the bottom edge of the human body recognition frame in the event video frame in the vertical direction.

[0079] E405, determining the corresponding unknown person location data according to the horizontal coordinate percentage position and the vertical coordinate percentage position in the fixed-point monitoring area data; Unknown person location data refers to the location data of unknown persons in the fixed-point monitoring area data; The percentage position of the unknown person in the fixed-point monitoring area data can be mapped based on the horizontal coordinate percentage position and the vertical coordinate percentage position, and then the actual positioning data of the unknown person can be estimated and determined in the fixed-point monitoring area data.

[0080] Through the above steps, the cloud service-based intelligent security integrated management and control system can realize the conversion from two-dimensional image to actual space coordinates by mapping the pixel coordinates in the video frame with the physical size of the actual monitoring area, combining the bottom midpoint positioning and percentage position calculation of the human body recognition frame. It not only takes into account the actual size characteristics of the monitoring area, but also improves the accuracy and applicability of position estimation through standardized percentage positioning, providing reliable spatial reference data for the positioning and tracking of unknown personnel.

[0081] Furthermore, the event information identification strategy further includes the following steps: F1, display the corresponding personnel identification graphic in the digital model data of the security area according to the unknown personnel positioning data; The personnel identification graphic is a position identification graphic of the unknown personnel location data in the digital model data of the security area.

[0082] F2, controlling the mobile monitoring module 20 to go to the corresponding area according to the unknown person positioning data, and obtaining the mobile positioning data corresponding to the mobile monitoring module 20; The mobile positioning data is the positioning data of the mobile monitoring module 20 .

[0083] F3, display the corresponding mobile monitoring identification graphic in the digital model data of the security area according to the mobile positioning data; The mobile monitoring identification graphic is a location identification graphic of the mobile monitoring module 20 in the digital model data of the security area.

[0084] F4, determining the best moving path data according to the unknown person positioning data, the mobile positioning data and the digital model data of the security area, and displaying the corresponding moving path graph in the digital model data of the security area.

[0085] The optimal moving path data is the optimal path between the mobile monitoring module 20 and the unknown person, which can be determined by a specific algorithm planning; The moving path graph is a route identification graph of the optimal moving path data in the digital model data of the security area.

[0086] Through the above steps, the cloud service-based intelligent security integrated management and control system can realize intuitive management of security monitoring by displaying the personnel location, mobile monitoring equipment location and optimal movement path in real time on the digital model, automatically planning the optimal patrol path, and then intelligently dispatching the mobile monitoring module for dynamic tracking. At the same time, through graphical display methods, security personnel can intuitively grasp the on-site situation, greatly improving the real-time monitoring effect and emergency response capability of the security system.

[0087] The above are all preferred embodiments of the present application, and are not intended to limit the protection scope of the present application. Any feature disclosed in this specification (including the abstract and drawings), unless otherwise stated, can be replaced by other equivalent or alternative features with similar purposes. That is, unless otherwise stated, each feature is only an example of a series of equivalent or similar features.

Claims

1. A cloud-based intelligent security integrated management and control system, characterized in that: include: Multiple fixed-point monitoring modules; Multiple mobile monitoring modules; Cloud servers; Wherein, each of the fixed-point monitoring modules and each of the mobile monitoring modules are communicatively connected to the cloud server, and each of the fixed-point monitoring modules is respectively positioned and installed at a preset monitoring installation position; Wherein, the fixed-point monitoring module includes a first camera module, an angle sensing module, an azimuth sensing module, an angle adjustment module and an azimuth adjustment module, and the angle sensing module, the azimuth sensing module, the angle adjustment module and the azimuth adjustment module are respectively connected to the first camera module; Wherein, the mobile monitoring module includes a mobile module, a positioning module and a second camera module, and the positioning module and the second camera module are respectively connected to the mobile module; The cloud-based smart security integrated management and control system further includes a security monitoring deployment strategy, including the following steps: A1, surveying and mapping the preset security area to obtain the corresponding digital model data of the security area; A2, determining corresponding security boundary area data according to the security area digital model data and the preset boundary width; A3, obtaining corresponding camera pitch angle and camera azimuth angle through each of the fixed-point monitoring modules; A4, obtaining installation positioning data, vertical field of view angle and horizontal field of view angle corresponding to each of the fixed-point monitoring modules; A5, calculating corresponding monitoring field of view azimuth data according to the installation positioning data, vertical field of view angle, horizontal field of view angle, camera pitch angle and camera azimuth angle corresponding to each of the fixed-point monitoring modules; A6, determining the corresponding fixed-point monitoring area data respectively according to the monitoring field of view azimuth data corresponding to each of the fixed-point monitoring modules and the digital model data of the security area; A7, generating fixed-point monitoring coverage area data according to all fixed-point monitoring area data combinations; A8, determine the data of the boundary area not covered by the monitoring by comparing the data of the fixed-point monitoring coverage area with the data of the security boundary area; A9, controlling the mobile monitoring module to move to the area corresponding to the monitoring uncovered boundary area data and perform monitoring actions.

2. The cloud service-based intelligent security integrated management and control system according to claim 1 is characterized in that: The cloud server includes a storage unit, an identification unit, a communication unit and a control unit, wherein the storage unit, the identification unit and the communication unit are data-connected to the control unit, and the communication unit is communicatively connected to each of the fixed-point monitoring modules and each of the mobile monitoring modules; The cloud-based smart security integrated management and control system further includes a security monitoring and early warning strategy, including the following steps: B1, obtaining corresponding fixed-point monitoring video data through each of the fixed-point monitoring modules; B2, real-time transmission of each fixed-point monitoring video data to the cloud server; B3, the cloud server generates corresponding event confidence and data time according to each fixed-point monitoring video data through a preset event recognition algorithm; B4, if the event confidence is greater than the preset event trigger threshold, the corresponding data moment is defined as the event trigger moment, and a preset event trigger warning is sent to the preset monitoring background.

3. The cloud service-based intelligent security integrated management and control system according to claim 2 is characterized in that: The storage unit includes a temporary storage module, a high-performance storage module and a general storage module, the high-performance storage module and the general storage module are respectively data-connected to the temporary storage module, and the temporary storage module is respectively data-connected to the communication unit and the identification unit; The cloud-based smart security integrated management and control system further includes a security monitoring video storage strategy, including the following steps: C1, after the cloud server receives the fixed-point monitoring video data, the fixed-point monitoring video data is stored in the temporary storage module; C2, storing the fixed-point monitoring video data in the temporary storage module to the general storage module; C3, determining the corresponding event time window data according to all event triggering moments corresponding to the fixed-point monitoring video data; C4, obtain the corresponding event time window video data set from the fixed-point monitoring video data according to the event time window data; C5, stores the event time window video data set in the high-performance storage module.

4. The cloud service-based intelligent security integrated management and control system according to claim 3 is characterized in that: The recognition unit includes an event recognition module, a person recognition module and a face recognition module. The event recognition module, the person recognition module and the face recognition module are respectively data-connected to the temporary storage module and the control unit.

5. The cloud service-based intelligent security integrated management and control system according to claim 4 is characterized in that: The cloud service-based smart security integrated management and control system further includes an event information identification strategy, including the following steps: D1, the event recognition module generates corresponding event confidence and data time through an event recognition algorithm according to the fixed-point monitoring video data; D2, if the event confidence is greater than the event triggering threshold, the event video frame corresponding to the data moment is transmitted to the person recognition module; D3, the human recognition module identifies the event video frame through a preset human recognition algorithm to determine the corresponding human image data; D4, if the human body image data is not a null value, then according to the human body image data, the face recognition module generates corresponding face image data through a preset face recognition algorithm; D5, generating event information data according to the data time and the corresponding event video frame, human image data and face image data, and the monitoring number information corresponding to the fixed-point monitoring video data; D6, transmit event information data to the monitoring background.

6. The cloud service-based intelligent security integrated management and control system according to claim 5 is characterized in that: The event information identification strategy further includes the following steps: E1, matching and searching the face image data in the event information data with the preset known person face database; E2, if the facial image data successfully matches the known person face database, then add the corresponding known person information to the event information data; E3, if the facial image data fails to match the known person facial database, then add the preset unknown person warning information to the event information data; E4, if the unknown person warning information exists in the event information data, estimating the corresponding unknown person location data according to the event information data and the corresponding fixed-point monitoring area data of the fixed-point monitoring module; E5, add unknown person location data to the event information data.

7. The cloud service-based intelligent security integrated management and control system according to claim 6 is characterized in that: The event information identification strategy further includes the following steps for estimating the unknown person location data: E401, determining a corresponding horizontal length and a corresponding vertical length of the area according to the fixed-point monitoring area data of the fixed-point monitoring module corresponding to the event information data; E402, determining a corresponding human body recognition frame in the event video frame according to the human body image data in the event information data; E403, determining the pixel coordinates of the midpoint of the bottom edge of the human body recognition frame in the event video frame and defining them as the pixel coordinates of the human body position; E404, determining the corresponding horizontal coordinate percentage position and vertical coordinate percentage position in the event video frame according to the pixel coordinates of the human body position; E405, determining the corresponding unknown person positioning data according to the horizontal coordinate percentage position and the vertical coordinate percentage position in the fixed-point monitoring area data.

8. The cloud service-based intelligent security integrated management and control system according to claim 7 is characterized in that: The event information identification strategy further The following steps are involved: F1, display the corresponding personnel identification graphic in the digital model data of the security area according to the unknown personnel positioning data; F2, controlling the mobile monitoring module to go to a corresponding area according to the unknown person positioning data, and obtaining the mobile positioning data corresponding to the mobile monitoring module; F3, display the corresponding mobile monitoring identification graphic in the digital model data of the security area according to the mobile positioning data; F4, determining the best moving path data according to the unknown person positioning data, the mobile positioning data and the digital model data of the security area, and displaying the corresponding moving path graph in the digital model data of the security area.

Images