Video content pre-auditing and safety monitoring system and method

Abstract

The invention discloses a video content pre-auditing and safety monitoring system and method, and particularly relates to computer vision monitoring, and the system comprises a video collection module which is used for collecting video signals of a monitoring area in real time; the video analysis module is used for performing deep learning analysis on the video signal to extract feature information; the pre-auditing judgment module is used for pre-auditing the video content according to the feature information and identifying potential safety hazards; the early warning mechanism is used for sending alarm information to related personnel when the abnormal event is recognized; and the data storage module is used for storing the pre-audited video data. According to the video content pre-auditing and safety monitoring system and method, efficient pre-auditing and real-time monitoring of the video content can be achieved, the safety protection capability is improved, manual intervention can be reduced through the intelligent analysis capability of the system, the monitoring efficiency is improved, potential safety hazards are reduced, and the video content pre-auditing and safety monitoring system and method can be widely applied to multiple fields and have wide application prospects.

Description

Technical Field

[0001] The present invention relates to the field of computer vision monitoring, and in particular to a video content pre-screening and security monitoring system and method. Background Art

[0002] With the widespread application of video surveillance technology, security monitoring systems play an increasingly important role in public places, enterprises and homes. However, existing monitoring systems often face problems such as difficulty in storing and retrieving video data, as well as insufficient real-time early warning capabilities for potential threats. Therefore, it is particularly important to develop a system that can effectively pre-screen video content and perform real-time security monitoring.

[0003] Chinese patent publication number CN105100730A discloses a monitoring method, wherein the camera device includes a sensor and a digital signal processor, wherein the digital signal processor includes a camera driver and a monitoring module, wherein the method includes obtaining image data collected by the sensor; determining whether a preset object uses the electronic device based on the image data, and generating a determination result, and controlling the electronic device to switch the working mode based on the determination result. The above invention also discloses a camera device, which adopts the above invention technical solution to reduce the power consumption during camera monitoring, and can support the system wake-up function, thereby improving the user experience; however, the following defects still exist in the implementation process:

[0004] In the implementation process of the above patent document, although it can reduce the power consumption of the camera during monitoring and support the system wake-up function to improve the user experience, it still has the problem of being unable to provide timely warnings, resulting in weak security prevention capabilities. Summary of the invention

[0005] The main purpose of the present invention is to provide a video content pre-screening and security monitoring system and method, which can effectively solve the problem of being unable to provide timely warnings and resulting in weak security prevention capabilities.

[0006] To achieve the above object, the technical solution adopted by the present invention is:

[0007] A video content pre-screening and security monitoring system, the system includes a video acquisition module, a video analysis module, a pre-screening judgment module, an early warning mechanism and a data storage module, wherein:

[0008] Video acquisition module, used to collect video signals of the monitoring area in real time;

[0009] Video analysis module, used to perform deep learning analysis on video signals to extract feature information;

[0010] A pre-judgment module is used to pre-judgment the video content according to the feature information to identify potential safety hazards;

[0011] An early warning mechanism is used to send alarm information to relevant personnel when abnormal events are identified;

[0012] The data storage module is used to store the pre-screened video data.

[0013] Preferably, the video acquisition module includes a camera, a video acquisition card and a video server / gateway, which is responsible for real-time acquisition of video signals in the monitored area and transmission to the video analysis module.

[0014] Preferably, the video analysis module includes a deep learning unit and an image processing technology unit. The image processing technology unit includes but is not limited to face recognition technology, behavior recognition technology and anomaly detection technology. The deep learning unit includes a deep learning algorithm and transfer learning and training to perform real-time analysis of video content.

[0015] Preferably, the pre-trial judgment module pre-screens the video content according to the analysis results of the video analysis module, identifies potential safety hazards, and classifies them to determine whether there are safety hazards.

[0016] Preferably, the early warning mechanism includes an audible and visual alarm and an email and text message sending device. The audible and visual alarm sounds an alarm when an abnormality is detected, and the email and text message sending device sends an alarm message to relevant personnel. All abnormal events and alarm messages will be recorded for subsequent investigation and analysis.

[0017] Preferably, the data storage module includes a database, and the database saves the analyzed original video and the marked abnormal events in the database.

[0018] Preferably, the original video and marked abnormal events analyzed in the database are statistically analyzed, and security monitoring reports are generated regularly to analyze information including but not limited to monitoring data, abnormal events and response time over a period of time. According to statistical results and technological development, the system model and algorithm are continuously updated to improve the monitoring effect.

[0019] A method for pre-screening and security monitoring of video content, the method for pre-screening and security monitoring of video content comprises the following steps:

[0020] a. First, the surveillance camera collects video data in the surveillance area in real time.

[0021] b. Then the collected video data is transmitted to the video analysis module for processing, and deep learning analysis is performed on the video signal to extract feature information.

[0022] c. Then, through the pre-trial judgment module, using face recognition technology, identify the identity of the people in the video, apply the behavior recognition algorithm, analyze the behavior patterns of the people, and detect whether there are abnormal behaviors, including but not limited to fighting and gathering; at the same time, conduct environmental monitoring and identify dangerous signals, including but not limited to smoke and flames.

[0023] d. The analysis results are then input into the pre-trial judgment module to automatically determine whether there are any safety hazards. If it is determined to be abnormal, the alarm system in the alarm mechanism will immediately send a notification to the monitoring personnel.

[0024] e. Finally, all analysis data and alarm records are stored in the database, and data statistics are performed at the same time. Security monitoring reports are generated regularly to analyze the past period of time, including but not limited to monitoring data, abnormal events and response time information. According to statistical results and technological development, the system model and algorithm are continuously updated to improve the monitoring effect.

[0025] Compared with the prior art, the present invention has the following beneficial effects:

[0026] 1. In the specific implementation process of the present invention, efficient pre-examination and real-time monitoring of video content can be achieved, alarms can be automatically triggered through an early warning mechanism, and relevant personnel can be notified through text messages, emails or application push notifications, thereby significantly improving security prevention capabilities. At the same time, the system's intelligent analysis capabilities can reduce manual intervention, improve monitoring efficiency, and reduce safety hazards.

[0027] 2. In addition, the present invention can be widely used in many fields such as public safety, traffic monitoring, enterprise security and home monitoring, providing users with a safer living and working environment, and can effectively respond to security challenges in modern society, and has broad application prospects. BRIEF DESCRIPTION OF THE DRAWINGS

[0028] Figure 1 It is the overall flow chart of the present invention. DETAILED DESCRIPTION

[0029] In order to make the technical means, creative features, objectives and effects achieved by the present invention easy to understand, the present invention is further explained below in conjunction with specific implementation methods.

[0030] like Figure 1 As shown, the video content pre-screening and security monitoring system is characterized in that the system includes a video acquisition module, a video analysis module, a pre-screening judgment module, an early warning mechanism and a data storage module, wherein:

[0031] Video acquisition module, used to collect video signals of the monitoring area in real time;

[0032] Video analysis module, used to perform deep learning analysis on video signals to extract feature information;

[0033] The pre-trial judgment module is used to pre-screen the video content based on feature information and identify potential safety hazards;

[0034] An early warning mechanism is used to send alarm information to relevant personnel when abnormal events are identified;

[0035] The data storage module is used to store the pre-screened video data.

[0036] First, determine the monitoring area, target, application scenario and specific needs, install relevant electronic equipment, and then through the mutual coordination of the video acquisition module, video analysis module, pre-trial judgment module, early warning mechanism and data storage module in the relevant equipment, the video content pre-trial and security monitoring system can efficiently identify and handle security risks in the video, provide real-time security prevention capabilities, and ensure the safety of the monitoring area.

[0037] The video acquisition module includes a camera, a video acquisition card and a video server / gateway, which is responsible for real-time acquisition of video signals in the monitored area and transmission to the video analysis module.

[0038] The video acquisition module is responsible for real-time acquisition of video signals in the monitoring area. It uses high-resolution surveillance cameras to collect video streams in the target area in real time and transmits the collected video signals to the video analysis module for analysis.

[0039] It should be noted that:

[0040] High-definition surveillance cameras are used to capture video signals of the surveillance area in real time;

[0041] Infrared camera, which can effectively monitor even in low light conditions;

[0042] Panoramic camera, providing wide-angle view, suitable for large-area monitoring;

[0043] Video capture card: converts analog signals into digital signals for subsequent processing;

[0044] Video Server / Gateway: For network video sources, a video server or gateway device may be required to collect video data from multiple cameras and transmit it to the video analysis module through the network.

[0045] The video analysis module includes a deep learning unit and an image processing technology unit. The image processing technology unit includes but is not limited to face recognition technology, behavior recognition technology and anomaly detection technology. The deep learning unit includes deep learning algorithms and transfer learning and training to perform real-time analysis of video content.

[0046] Use deep learning and image processing technology to analyze video content in real time, including but not limited to face recognition, behavior recognition and anomaly detection. Use face recognition technology to identify the identity of people in the video, apply behavior recognition algorithms to analyze the behavior patterns of people, detect whether there are abnormal behaviors, including but not limited to fighting and gathering, conduct environmental monitoring, and identify danger signals, including but not limited to smoke and flames;

[0047] The pre-trial judgment module pre-screens the video content based on the analysis results of the video analysis module, identifies potential safety hazards, and classifies them to determine whether there are safety hazards.

[0048] It should be noted that the video analysis module and the pre-trial judgment module involve:

[0049] Image processor: used to process and analyze the captured video signals in real time;

[0050] Video encoder: compresses and converts the original video signal into a format suitable for storage and transmission;

[0051] Server: used to centrally process and analyze video data and run related artificial intelligence and machine learning algorithms;

[0052] Data storage: including hard disks, cloud storage, etc., used to store video data and analysis results;

[0053] Motion sensor: monitors changes in motion within the monitoring area;

[0054] Environmental sensors: monitor environmental factors such as temperature and humidity to assist in video analysis.

[0055] The early warning mechanism includes sound and light alarms and email and text message sending devices. The sound and light alarms sound an alarm when an abnormality is detected, and the email and text message sending devices send alarm information to relevant personnel. All abnormal events and alarm information will be recorded for subsequent investigation and analysis.

[0056] The data storage module includes a database, and the database saves the analyzed original video and the marked abnormal events into the database.

[0057] The database saves the analyzed original video and marked abnormal events to the database for subsequent playback and query. Based on the monitoring results and user feedback, the algorithm is continuously optimized to improve the recognition rate and accuracy of the system.

[0058] Finally, through the mutual coordination of the above-mentioned related equipment, a complete video content pre-examination and security monitoring system is formed, which can realize efficient and intelligent monitoring and security management. It can be widely used in public safety, traffic monitoring, enterprise security and home monitoring and other fields, providing users with a safer living and working environment. It can effectively respond to the security challenges in modern society and has broad application prospects.

[0059] The original videos and marked abnormal events analyzed in the database are used for data statistics, and security monitoring reports are generated regularly. Information including but not limited to monitoring data, abnormal events and response time over the past period of time is analyzed. According to statistical results and technological development, system models and algorithms are continuously updated to improve monitoring effects.

[0060] The present invention also provides a method for pre-screening and security monitoring of video content. The method for pre-screening and security monitoring of video content comprises the following steps:

[0061] a. First, the surveillance camera collects video data in the surveillance area in real time.

[0062] b. Then the collected video data is transmitted to the video analysis module for processing, and deep learning analysis is performed on the video signal to extract feature information.

[0063] c. Then, through the pre-trial judgment module, using face recognition technology, identify the identity of the people in the video, apply the behavior recognition algorithm, analyze the behavior patterns of the people, and detect whether there are abnormal behaviors, including but not limited to fighting and gathering; at the same time, conduct environmental monitoring and identify dangerous signals, including but not limited to smoke and flames.

[0064] d. The analysis results are then input into the pre-trial judgment module to automatically determine whether there are any safety hazards. If it is determined to be abnormal, the alarm system in the alarm mechanism will immediately send a notification to the monitoring personnel.

[0065] e. Finally, all analysis data and alarm records are stored in the database, and data statistics are performed at the same time. Security monitoring reports are generated regularly to analyze the past period of time, including but not limited to monitoring data, abnormal events and response time information. According to statistical results and technological development, the system model and algorithm are continuously updated to improve the monitoring effect.

[0066] The above shows and describes the basic principles and main features of the present invention and the advantages of the present invention. It should be understood by those skilled in the art that the present invention is not limited to the above embodiments. The above embodiments and descriptions are only for explaining the principles of the present invention. Without departing from the spirit and scope of the present invention, the present invention may have various changes and improvements, which fall within the scope of the present invention to be protected. The scope of protection of the present invention is defined by the attached claims and their equivalents.

Claims

1. A video content pre-screening and security monitoring system, characterized in that: The system includes a video acquisition module, a video analysis module, a pre-trial judgment module, an early warning mechanism and a data storage module, among which: Video acquisition module, used to collect video signals of the monitoring area in real time; Video analysis module, used to perform deep learning analysis on video signals to extract feature information; A pre-judgment module is used to pre-judgment the video content according to the feature information to identify potential safety hazards; An early warning mechanism is used to send alarm information to relevant personnel when abnormal events are identified; The data storage module is used to store the pre-screened video data.

2. The video content pre-screening and security monitoring system according to claim 1, characterized in that: The video acquisition module includes a camera, a video acquisition card and a video server / gateway, which is responsible for real-time acquisition of video signals in the monitored area and transmission to the video analysis module.

3. The video content pre-screening and security monitoring system according to claim 1, characterized in that: The video analysis module includes a deep learning unit and an image processing technology unit. The image processing technology unit is not limited to face recognition technology, behavior recognition technology and anomaly detection technology. The deep learning unit includes a deep learning algorithm and transfer learning and training to perform real-time analysis of video content.

4. The video content pre-screening and security monitoring system according to claim 1, characterized in that: The pre-trial judgment module pre-screens the video content according to the analysis results of the video analysis module, identifies potential safety hazards, and classifies them to determine whether there are safety hazards.

5. The video content pre-screening and security monitoring system according to claim 1, characterized in that: The early warning mechanism includes an audible and visual alarm and an email and text message sending device. The audible and visual alarm sounds an alarm when an abnormality is detected, and the email and text message sending device sends an alarm message to relevant personnel. All abnormal events and alarm messages will be recorded for subsequent investigation and analysis.

6. The video content pre-screening and security monitoring system according to claim 1, characterized in that: The data storage module includes a database, and the database stores the analyzed original video and the marked abnormal events in the database.

7. The video content pre-screening and security monitoring system according to claim 6, characterized in that: The database analyzes the original video and marked abnormal events, performs data statistics, generates security monitoring reports regularly, analyzes the past period of time including but not limited to monitoring data, abnormal events and response time information, and continuously updates system models and algorithms based on statistical results and technological development to improve monitoring effects.

8. A method for pre-screening and security monitoring of video content, the method for pre-screening and security monitoring of video content comprises the following steps: a. First, the surveillance camera collects video data in the surveillance area in real time. b. Then the collected video data is transmitted to the video analysis module for processing, and deep learning analysis is performed on the video signal to extract feature information. c. Then, through the pre-trial judgment module, using face recognition technology, identify the identity of the people in the video, apply the behavior recognition algorithm, analyze the behavior patterns of the people, and detect whether there are abnormal behaviors, including but not limited to fighting and gathering; at the same time, conduct environmental monitoring and identify dangerous signals, including but not limited to smoke and flames. d. The analysis results are then input into the pre-trial judgment module to automatically determine whether there are any safety hazards. If it is determined to be abnormal, the alarm system in the alarm mechanism will immediately send a notification to the monitoring personnel. e. Finally, all analysis data and alarm records are stored in the database, and data statistics are performed at the same time. Security monitoring reports are generated regularly, analyzing the past period of time, including but not limited to monitoring data, abnormal events and response time information. According to statistical results and technological development, the system model and algorithm are continuously updated.

Images