A security monitoring system, method, computer equipment and storage medium

Abstract

The present invention provides a security monitoring system, method, computer equipment and storage medium, including an acquisition unit, which is used to call the interface of real-time video monitoring to record and store real-time video when the monitoring device is activated by a moving object; a processing unit, which is used to read serialized video data, detect abnormal behavior of the video data, analyze the correlation of the video data of abnormal behavior according to multiple monitoring points, and record the monitoring points with correlation in real time; a display unit, which is used to query and review the video data of abnormal behavior with correlation, identify and display the target screen of abnormal behavior, and display multiple monitoring screens with correlation in the same display screen. The present invention can record and store abnormal events, facilitate event query, and is suitable for both manual and unmanned operation.

Description

Technical Field

[0001] The present application relates to the field of video surveillance technology, and in particular to a security monitoring system, method, computer equipment and storage medium. Background Art

[0002] With the development of the national economy, the security needs of various places are constantly increasing, and the demand for video surveillance systems is also growing explosively. There are often thousands of cameras installed in public places such as airports, subway stations, shopping malls, and residential areas. Faced with so many cameras, if the traditional manual on-duty method is adopted, a dedicated person will monitor the monitoring scene 24 hours a day, which requires a lot of manpower and material resources. At the same time, the trend of social aging in my country has led to an increase in labor costs year by year, resulting in high system operation and maintenance costs, and in some special circumstances (such as the influence of emotional instability and physical discomfort of the monitoring personnel), it is inevitable that missed reports and false reports will occur. Therefore, it is very necessary to use intelligent methods to analyze and process surveillance videos. Summary of the invention

[0003] (I) Purpose of application

[0004] In view of this, the purpose of the present application is to provide a security monitoring system, method, computer equipment and storage medium for solving the technical problem of untimely processing of monitored abnormal behavior events.

[0005] (II) Technical solution

[0006] The present application discloses a security monitoring system, comprising the following steps:

[0007] The acquisition unit is used to call the video real-time monitoring interface to record and store real-time video when the monitoring device is activated by a moving object;

[0008] A processing unit is used to read serialized video data, detect abnormal behavior of the video data, perform correlation analysis on the video data of abnormal behavior according to multiple monitoring points, and record the monitoring points with correlation in real time;

[0009] The display unit is used to query and review the associated abnormal behavior video data, identify and display the target screen of the abnormal behavior, and display multiple associated monitoring screens on the same display screen.

[0010] In a possible implementation, the acquisition unit includes:

[0011] The device registration module is used to read the json file that stores the basic information of the monitoring devices and register the monitoring devices in turn;

[0012] Motion detection module, used for registered monitoring devices to enable motion detection and record real-time video of moving objects;

[0013] The video storage module is used to determine whether the monitoring device stops recording within a scheduled period of time, name and store the video, and then start the next recording.

[0014] In a possible implementation, the processing unit includes:

[0015] A video reading module is used to read the video data in the acquisition unit;

[0016] Anomaly detection module, used to detect abnormal behavior in video data;

[0017] The video analysis module is used to compress the video data of abnormal behavior, perform correlation analysis on the video data of abnormal behavior based on multiple monitoring points, and record the monitoring points with correlation in real time.

[0018] In a possible implementation, the display unit includes:

[0019] Management module, used to add or delete monitoring device information in the management interface;

[0020] The backtracking module is used to view video data in real time and review abnormal events;

[0021] A display module is used to detect target images with abnormal behavior, mark and display them, and display multiple related monitoring images on the same display screen;

[0022] The tracking module is used to generate the moving route of the moving object, predict the possible moving path of the moving object based on the security map, and track the moving object;

[0023] The alarm module is used to generate alarm information and send it to the alarm terminal. The alarm information includes the location and possible moving path of the moving object.

[0024] As a second aspect of the present application, a security monitoring method is also provided, which is characterized by comprising:

[0025] When the monitoring device is activated by a moving object, the real-time video monitoring interface is called to record and store the real-time video;

[0026] Read serialized video data, detect abnormal behavior on the video data, conduct correlation analysis on the video data of abnormal behavior based on multiple monitoring points, and record the monitoring points with correlation in real time;

[0027] Query and review the associated abnormal behavior video data, identify and display the target screen of abnormal behavior, and display multiple associated monitoring screens on the same display screen.

[0028] In a possible implementation, the abnormal behavior includes abnormal wandering behavior, gathering of people behavior and illegal parking behavior.

[0029] In a possible implementation, the correlation analysis method includes:

[0030] The spatial attributes of the monitoring devices within a certain range are input into the spatial association model based on the Moran index to calculate whether there is a relationship between the monitoring devices within a certain range. The spatial association model is:

[0031]

[0032] Where n represents the total number of monitoring devices within the monitoring range, z i It represents the deviation between the number of abnormal behaviors of the i-th monitoring device and the average number of abnormal behaviors. ω i,j is the path weight between the i-th monitoring device and the j-th monitoring device, indicating the spatial adjacency relationship between the two points; S0 represents the sum of all path weights, When the I value is greater than 1, it means that there is a correlation between the two, and the larger the I value, the stronger the correlation.

[0033] In a possible implementation, the monitoring device stores video data intelligently, automatically deleting video data recorded by related monitoring devices after storing them for a long period, and automatically deleting other video data after storing them for a short period.

[0034] As a third aspect of the present application, the present application provides a computer device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements any of the methods described above when executing the computer program.

[0035] As a fourth aspect of the present application, the present application provides a computer-readable storage medium having a computer program stored thereon, which implements any of the methods described above when executed by a processor.

[0036] Beneficial effects:

[0037] The present application monitors moving objects and records them as videos, then performs abnormal behavior detection on the video data, performs correlation analysis on the monitoring points that captured the abnormal behavior video data, and obtains video data of adjacent monitoring points. When the camera where an abnormal event occurs does not clearly capture the corresponding facial information or license plate information, at this time, the video data of the adjacent monitoring points that have been saved in advance can be queried through the display unit. The correlation analysis of the processing unit can realize intelligent recording and storage of the video, thereby achieving effective storage. The present invention is applicable to both manned and unmanned operations, and reduces labor while improving security capabilities.

[0038] Other advantages, objectives and features of the present application will be described in the following description to some extent, and will be apparent to those skilled in the art based on the following examination and study, or can be taught from the practice of the present application to some extent. The objectives and other advantages of the present application can be achieved and obtained through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0039] The embodiments described below with reference to the accompanying drawings are exemplary and are intended to be used to explain and illustrate the present application, but should not be construed as limiting the scope of protection of the present application.

[0040] Figure 1 It is a structural block diagram of a security monitoring system of the present application;

[0041] Figure 2 It is a flowchart of a security monitoring method of the present application;

[0042] Figure 3 is a schematic diagram of the structure of the computer device of the present application;

[0043] Figure 4 It is a schematic diagram of the structure of the computer-readable storage medium of the present application. DETAILED DESCRIPTION

[0044] In order to make the purpose, technical solution and advantages of the embodiments of the present application clearer, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. The components of the embodiments of the present application described and shown in the drawings here can be arranged and designed in various different configurations.

[0045] Therefore, the following detailed description of the embodiments of the present application provided in the accompanying drawings is not intended to limit the scope of the present application for which protection is sought, but merely represents selected embodiments of the present application. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in the field without creative work are within the scope of protection of the present application.

[0046] It should be noted that similar reference numerals and letters denote similar items in the following drawings, and therefore, once an item is defined in one drawing, further definition and explanation thereof is not required in subsequent drawings.

[0047] like Figure 1 As shown, the present application discloses a security monitoring system, comprising:

[0048] The acquisition unit is used to call the video real-time monitoring interface to record and store real-time video when the monitoring device is activated by a moving object;

[0049] Among them, the monitoring device uses a monitoring camera to capture moving images, and the acquisition unit specifically includes:

[0050] The device registration module is used to read the json file that stores the basic information of the monitoring device and register the monitoring devices in turn. By registering using the SDK corresponding to the monitoring camera device, the interface of the monitoring camera device can be directly used.

[0051] Motion detection module, used for registered monitoring devices to enable motion detection and record real-time video of moving objects;

[0052] The video storage module is used to determine whether the monitoring device stops recording within a time period, name and store the video, and then start the next recording;

[0053] Among them, in one embodiment, it is determined every 10 seconds whether the camera stops monitoring and recording. If no moving object is found within 10 seconds, the recording can be stopped, the recorded video is named and stored, and then stored again.

[0054] The buffer unit is used to encode the stored video data in the sending queue and serialize it through Protobuf. On the one hand, it can further reduce the sending bandwidth. On the other hand, when the video data is intercepted, it cannot be used without the proto file, which further ensures the security of the video data.

[0055] A processing unit is used to read serialized video data, detect abnormal behavior of the video data, perform correlation analysis on the video data of abnormal behavior according to multiple monitoring points, and record the monitoring points with correlation in real time;

[0056] The processing unit includes:

[0057] A video reading module is used to read the video data in the acquisition unit;

[0058] Anomaly detection module, used to detect abnormal behavior in video data;

[0059] The video analysis module is used to compress the video data of abnormal behavior, perform correlation analysis on the video data of abnormal behavior based on multiple monitoring points, and record the monitoring points with correlation in real time.

[0060] The display unit is used to query and review the associated abnormal behavior video data, identify and display the target screen of the abnormal behavior, and display multiple associated monitoring screens on the same display screen.

[0061] The display units include:

[0062] Management module, used to add or delete monitoring device information in the management interface;

[0063] The backtracking module is used to view video data in real time and review abnormal events;

[0064] A display module is used to detect target images with abnormal behavior, mark and display them, and display multiple related monitoring images on the same display screen;

[0065] The tracking module is used to generate the moving route of the moving object, predict the possible moving path of the moving object based on the security map, and track the moving object;

[0066] The alarm module is used to generate alarm information and send it to the alarm terminal, wherein the alarm information includes the location and possible moving path of the moving object; specifically, the alarm terminal can be a communication device such as a walkie-talkie, a mobile phone, etc.

[0067] The security monitoring system provided by the present invention monitors moving objects and records them as videos, then performs abnormal behavior detection on the video data, performs correlation analysis on the monitoring points that shoot the abnormal behavior video data, and obtains the video data of the adjacent monitoring points. When the camera where the abnormal event occurs does not clearly shoot the corresponding facial information or license plate information, at this time, the video data of the adjacent monitoring points saved in advance can be queried through the display unit, and the correlation analysis of the processing unit can realize intelligent recording and storage of the video, thereby realizing effective storage. The present invention is applicable to both manned and unmanned operations, and reduces labor while improving the security capability.

[0068] As a second aspect of the present application, a security monitoring method is also provided, such as Figure 2 As shown, including:

[0069] S1. When the monitoring device is activated by a moving object, the real-time video monitoring interface is called to record and store the real-time video;

[0070] S2, read serialized video data, and perform abnormal behavior detection on the video data, perform correlation analysis on the video data of abnormal behavior based on multiple monitoring points, and record the monitoring points with correlation in real time;

[0071] Among them, abnormal behaviors include abnormal wandering behavior, gathering of people, and illegal parking behavior.

[0072] Specifically, the correlation analysis methods include:

[0073] The spatial attributes of monitoring devices within a certain range are input into the spatial association model based on the Moran index to calculate whether there is a relationship between monitoring devices within a certain range. The spatial association model is:

[0074]

[0075] Where n represents the total number of monitoring devices within the monitoring range, z i It represents the deviation between the number of abnormal behaviors of the i-th monitoring device and the average number of abnormal behaviors. ω i,j is the path weight between the i-th monitoring device and the j-th monitoring device, indicating the spatial adjacency relationship between the two points; S0 represents the sum of all path weights, When the I value is greater than 1, it means that there is a correlation between the two, and the larger the I value, the stronger the correlation.

[0076] More specifically, the monitoring device stores video data intelligently. Video data recorded by related monitoring devices is automatically deleted after being stored for a long period, and other video data is automatically deleted after being stored for a short period. This allows for effective storage of video data and saves storage space.

[0077] S3. Query and review the associated abnormal behavior video data, identify and display the target screen of the abnormal behavior, and display multiple associated monitoring screens on the same display screen.

[0078] As a third aspect of the present application, the present application provides a computer device, such as Figure 3 As shown, the computer device 200 includes a processor 210, a memory 220 and a communication circuit 230. The processor 210 is coupled to the memory 220 and the communication circuit 230 respectively. The memory 220 stores a computer program. The processor 210 implements the steps in any of the above-mentioned implementation methods by executing the program data in the memory 220. The detailed steps can be found in the above-mentioned implementation methods and will not be repeated here.

[0079] As a fourth aspect of the present application, the present application provides a computer-readable storage medium, such as Figure 4As shown, the computer-readable storage medium 400 stores a computer program 410, and the computer program 410 can be executed by a processor to implement the steps in any of the above methods.

[0080] Among them, the computer-readable storage medium 400 can specifically be a device that can store the computer program 410, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, or it can also be a server that stores the computer program 410. The server can send the stored computer program 410 to other devices for execution, or it can also run the stored computer program 410 by itself.

[0081] Those skilled in the art will appreciate that although some embodiments described herein include certain features included in other embodiments but not other features, the combination of features from different embodiments is meant to be within the scope of the present application and to form different embodiments.

[0082] Those skilled in the art will appreciate that the description of each embodiment has its own emphasis, and for parts not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0083] Although the embodiments of the present application are described in conjunction with the accompanying drawings, those skilled in the art may make various modifications and variations without departing from the spirit and scope of the present application, and such modifications and variations all fall within the scope defined by the attached claims. The above are only specific embodiments of the present invention, but the protection scope of the present invention is not limited thereto. Any technician familiar with the technical field can easily think of various equivalent modifications or substitutions within the technical scope disclosed by the present invention, and these modifications or substitutions should be included in the protection scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.

Claims

1. A security monitoring system, characterized in that: include: The acquisition unit is used to call the video real-time monitoring interface to record and store real-time video when the monitoring device is activated by a moving object; A processing unit is used to read serialized video data, detect abnormal behavior of the video data, perform correlation analysis on the video data of abnormal behavior according to multiple monitoring points, and record the monitoring points with correlation in real time; A display unit is used to query and review the video data of abnormal behaviors that are related, identify and display the target screens of abnormal behaviors, and display multiple related monitoring screens on the same display screen; The correlation analysis method comprises: The spatial attributes of the monitoring devices within a certain range are input into the spatial association model based on the Moran index to calculate whether there is a relationship between the monitoring devices within a certain range. The spatial association model is: Where n represents the total number of monitoring devices within the monitoring range, z i It represents the deviation between the number of abnormal behaviors of the i-th monitoring device and the average number of abnormal behaviors. ω i,j is the path weight between the i-th monitoring device and the j-th monitoring device, indicating the spatial adjacency relationship between the two points; S0 represents the sum of all path weights, When the I value is greater than 1, it indicates that there is a correlation between the two, and the larger the I value is, the stronger the correlation is. The monitoring device intelligently stores the video data, automatically deletes the video data recorded by the monitoring device with correlation after storing it for a long period, and automatically deletes other video data after storing it for a short period.

2. A security monitoring system according to claim 1, characterized in that: The acquisition unit comprises: The device registration module is used to read the json file that stores the basic information of the monitoring devices and register the monitoring devices in turn; Motion detection module, used for registered monitoring devices to enable motion detection and record real-time video of moving objects; The video storage module is used to determine whether the monitoring device stops recording within a scheduled period of time, name and store the video, and then start the next recording.

3. A security monitoring system according to claim 2, characterized in that: The processing unit comprises: A video reading module is used to read the video data in the acquisition unit; Anomaly detection module, used to detect abnormal behavior in video data; The video analysis module is used to compress the video data of abnormal behavior, perform correlation analysis on the video data of abnormal behavior based on multiple monitoring points, and record the monitoring points with correlation in real time.

4. A security monitoring system according to claim 3, characterized in that: The display unit comprises: Management module, used to add or delete monitoring device information in the management interface; The backtracking module is used to view video data in real time and review abnormal events; A display module is used to detect target images with abnormal behavior, mark and display them, and display multiple related monitoring images on the same display screen; The tracking module is used to generate the moving route of the moving object, predict the possible moving path of the moving object based on the security map, and track the moving object; The alarm module is used to generate alarm information and send it to the alarm terminal. The alarm information includes the location and possible moving path of the moving object.

5. A security monitoring method, characterized in that: include: When the monitoring device is activated by a moving object, the real-time video monitoring interface is called to record and store the real-time video; Read serialized video data, detect abnormal behavior on the video data, conduct correlation analysis on the video data of abnormal behavior based on multiple monitoring points, and record the monitoring points with correlation in real time; Query and review the video data of abnormal behaviors that are related, identify and display the target screens of abnormal behaviors, and display multiple related monitoring screens on the same display screen; The correlation analysis method comprises: The spatial attributes of the monitoring devices within a certain range are input into the spatial association model based on the Moran index to calculate whether there is a relationship between the monitoring devices within a certain range. The spatial association model is: Where n represents the total number of monitoring devices within the monitoring range, z i It represents the deviation between the number of abnormal behaviors of the i-th monitoring device and the average number of abnormal behaviors. ω i,j is the path weight between the i-th monitoring device and the j-th monitoring device, indicating the spatial adjacency relationship between the two points; S0 represents the sum of all path weights, When the I value is greater than 1, it indicates that there is a correlation between the two, and the larger the I value is, the stronger the correlation is. The monitoring device intelligently stores the video data, automatically deletes the video data recorded by the monitoring device with correlation after storing it for a long period, and automatically deletes other video data after storing it for a short period.

6. A security monitoring method according to claim 5, characterized in that: The abnormal behaviors include abnormal wandering behaviors, gathering behaviors and illegal parking behaviors.

7. A computer device comprising a memory, a processor and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the computer program, the method according to any one of claims 5 to 6 is implemented.

8. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the method according to any one of claims 5 to 6 is implemented.

Images