A video multi-frame parallel time sequence analysis intelligent monitoring system

Abstract

The application discloses the technical field of video analysis, and particularly relates to a video multi-frame parallel time sequence analysis intelligent monitoring system, which comprises an image acquisition module, a data preprocessing module and a multi-frame parallel processing module; the image acquisition module is used for shooting an energy plant; the data preprocessing module is used for preprocessing video data collected by the image acquisition module, including denoising, image enhancement and normalization, so as to improve the quality and stability of the video data and provide a better basis for subsequent analysis; and the multi-frame parallel processing module is used for dividing the video data processed by the data preprocessing module into multiple video frames. The GPS chip module, the detection module and the time sequence analysis module are arranged, so that not only the dangerous goods can be tracked and monitored, but also the nearby personnel of the dangerous goods can be identified.

Description

Technical Field

[0001] This invention relates to the field of video analysis technology, specifically to an intelligent monitoring system for multi-frame parallel temporal analysis of video. Background Technology

[0002] While existing monitoring systems can perform functions such as behavior analysis and monitoring, many workers have a habit of smoking, and lighters and other sources of ignition are often found in their pockets, which may prevent effective monitoring of hazardous materials and pose certain safety hazards. Therefore, this paper proposes an intelligent monitoring system for multi-frame parallel temporal analysis of video. Summary of the Invention

[0003] To address the aforementioned technical problems, according to one aspect of the present invention, the present invention provides the following technical solution:

[0004] A video multi-frame parallel temporal analysis intelligent monitoring system, comprising:

[0005] Image acquisition module, used to photograph energy plant buildings;

[0006] The data preprocessing module is used to preprocess the video data acquired by the image acquisition module, including noise reduction, image enhancement, and normalization, in order to improve the quality and stability of the video data and provide a better foundation for subsequent analysis.

[0007] The multi-frame parallel processing module is used to divide the video data processed by the data preprocessing module into multiple video frames;

[0008] The image acquisition module is used to acquire the video frame images divided by the multi-frame parallel processing module;

[0009] The time-series analysis module is used to analyze whether there are dangerous goods in the images acquired by the image acquisition module. If so, it will identify the people in the vicinity.

[0010] A detection module installed on the image acquisition module is used to detect the position of the GPS chip module;

[0011] The acquisition module is used to obtain the location of hazardous materials based on the location detected by the detection module;

[0012] The location analysis module is used to analyze the location status of hazardous materials based on the location obtained by the acquisition module, including moving speed and moving range;

[0013] The notification module is used to notify personnel when there are analysis anomalies in the time series analysis module and the location analysis module;

[0014] The time series analysis module includes:

[0015] The first analysis module is used to analyze whether there are hazardous materials in the images acquired by the image acquisition module;

[0016] The second analysis module is used to analyze the identity of nearby personnel when dangerous goods are present in the images acquired by the image acquisition module.

[0017] As a preferred embodiment of the intelligent monitoring system for multi-frame parallel temporal analysis of video described in this invention, the first analysis module includes:

[0018] The feature extraction module is used to extract image features acquired by the image acquisition module;

[0019] The first storage module is used to store images of various hazardous materials and their appearance.

[0020] As a preferred embodiment of the intelligent monitoring system for multi-frame parallel temporal analysis of video described in this invention, the first analysis module further includes:

[0021] The first comparison module is used to compare the image features extracted by the feature extraction module with the images stored in the first storage module;

[0022] The first judgment module is used to determine whether the image features extracted by the feature extraction module are similar to those in the first storage module. If they are, then there are dangerous goods.

[0023] As a preferred embodiment of the intelligent monitoring system for multi-frame parallel temporal analysis of video described in this invention, the second analysis module includes:

[0024] The personnel analysis module is used to analyze the people near hazardous materials;

[0025] The facial feature analysis module is used to perform facial feature analysis on nearby people identified by the personnel analysis module.

[0026] As a preferred embodiment of the intelligent monitoring system for multi-frame parallel temporal analysis of video described in this invention, the second analysis module further includes:

[0027] The second storage module is used to store facial images of staff and supervisors;

[0028] The input module is used to input the facial images of staff and supervisors into the second storage module;

[0029] The deletion module is used to delete facial images of staff and supervisors from the second storage module.

[0030] As a preferred embodiment of the intelligent monitoring system for multi-frame parallel temporal analysis of video described in this invention, the second analysis module further includes:

[0031] The second comparison module is used to compare the facial features analyzed by the facial feature analysis module with the facial images stored in the second storage module.

[0032] The second judgment module is used to determine whether the facial features analyzed by the facial feature analysis module exist in the second storage module. If they do not exist, they will be uploaded to the notification module.

[0033] As a preferred embodiment of the intelligent monitoring system for multi-frame parallel temporal analysis of video described in this invention, the notification module includes:

[0034] The information storage module is used to store the contact information of the guardians;

[0035] The reminder information storage module is used to store reminder information for the monitoring personnel.

[0036] As a preferred embodiment of the intelligent monitoring system for multi-frame parallel temporal analysis of video described in this invention, the notification module further includes:

[0037] The SMS notification module is used to send reminders via SMS based on the information stored in the information storage module.

[0038] The telephone notification module is used to send reminders via telephone based on the information stored in the information storage module.

[0039] Compared with existing technologies:

[0040] By setting up GPS chip modules, detection modules, and time-series analysis modules, it is possible not only to track and monitor hazardous materials, but also to identify people near hazardous materials. Attached Figure Description

[0041] Figure 1 This is a schematic diagram of the process of the present invention. Detailed Implementation

[0042] To make the objectives, technical solutions, and advantages of the present invention clearer, the embodiments of the present invention will be described in further detail below with reference to the accompanying drawings.

[0043] This invention provides an intelligent monitoring system for multi-frame parallel temporal analysis of video. Please refer to [link / reference]. Figure 1 ;

[0044] The system includes: an image acquisition module for capturing images of the energy plant; a data preprocessing module for preprocessing the video data acquired by the image acquisition module, including noise reduction, image enhancement, and normalization, to improve the quality and stability of the video data and provide a better foundation for subsequent analysis; a multi-frame parallel processing module for dividing the video data processed by the data preprocessing module into multiple video frames; an image acquisition module for acquiring the images of the video frames divided by the multi-frame parallel processing module; a time-series analysis module for analyzing whether there are hazardous materials in the images acquired by the image acquisition module, and if so, for identifying nearby personnel; a detection module on the image acquisition module for locating the hazardous materials; a detection module for detecting the location of the GPS chip module; an acquisition module for acquiring the location of the hazardous materials based on the location detected by the detection module; a location analysis module for analyzing the location status of the hazardous materials based on the location acquired by the acquisition module, including movement speed and movement range; and a notification module for notifying personnel when there are analysis anomalies in the time-series analysis module and the location analysis module.

[0045] The time-series analysis module includes: a first analysis module, used to analyze whether there are hazardous materials in the images acquired by the image acquisition module; and a second analysis module, used to analyze the identity of nearby personnel when hazardous materials are found in the images acquired by the image acquisition module.

[0046] The first analysis module includes: a feature extraction module for extracting image features acquired by the image acquisition module; a first storage module for storing images of various hazardous materials and their appearance; a first comparison module for comparing the image features extracted by the feature extraction module with the images stored in the first storage module; and a first judgment module for judging whether the image features extracted by the feature extraction module are similar to those in the first storage module, and if so, whether hazardous materials exist.

[0047] The second analysis module includes: a personnel analysis module for analyzing personnel near hazardous materials; a facial feature analysis module for performing facial feature analysis on personnel identified by the personnel analysis module; a second storage module for storing facial images of staff and supervisors; an input module for inputting facial images of staff and supervisors into the second storage module; a deletion module for deleting facial images of staff and supervisors from the second storage module; a second comparison module for comparing the facial features analyzed by the facial feature analysis module with the facial images stored in the second storage module; and a second judgment module for determining whether the facial features analyzed by the facial feature analysis module are identical to those in the second storage module. If not, the feature is uploaded to the notification module.

[0048] The notification module includes: an information storage module for storing the contact information of the guardian; a reminder information storage module for storing reminder information for the guardian; an SMS notification module for sending SMS notifications based on the information stored in the information storage module; and a telephone notification module for sending telephone notifications based on the information stored in the information storage module.

[0049] In practical use, the specific operating steps for those skilled in the art are as follows:

[0050] Step 1: The location of the hazardous materials is located using the GPS chip module. After location is established, the location of the GPS chip module is detected by the detection module. After detection, the location of the hazardous materials is obtained by the acquisition module based on the location detected by the detection module. After acquisition, the location analysis module analyzes the location status of the hazardous materials based on the location obtained by the acquisition module, including the moving speed and moving range. If there is an anomaly in the analyzed location status, the personnel will be notified through the notification module.

[0051] Step 2: After the detection module detects the location of the GPS chip module, the image acquisition module is controlled to capture images of the GPS chip module's location. Then, the data preprocessing module preprocesses the video data acquired by the image acquisition module. Next, the multi-frame parallel processing module divides the video data processed by the data preprocessing module into multiple video frames. Finally, the image acquisition module acquires the images of the video frames divided by the multi-frame parallel processing module.

[0052] Step 3: The feature extraction module extracts the image features acquired by the image acquisition module. After extraction, the first comparison module compares the image features extracted by the feature extraction module with the images stored in the first storage module. After comparison, the first judgment module determines whether the image features extracted by the feature extraction module are similar to those in the first storage module. If they are similar, there are hazardous materials. If they are not similar, the notification module will notify the personnel.

[0053] Step 4: The personnel analysis module identifies nearby personnel (nearby refers to the dangerous distance between the dangerous goods and personnel, and the dangerous distance is set according to the type of dangerous goods, etc.). After analysis, the facial feature analysis module performs facial feature analysis on the nearby personnel identified by the personnel analysis module. After analysis, the second comparison module compares the facial features analyzed by the facial feature analysis module with the facial images stored in the second storage module. After comparison, the second judgment module determines whether the facial features analyzed by the facial feature analysis module are identical in the second storage module. If they are not identical, the information is uploaded to the notification module.

[0054] Although the present invention has been described above with reference to embodiments, various modifications can be made and components can be replaced with equivalents without departing from the scope of the invention. In particular, as long as there is no structural conflict, the features in the disclosed embodiments can be combined with each other in any manner. The lack of an exhaustive description of these combinations in this specification is merely for the sake of brevity and resource conservation. Therefore, the present invention is not limited to the specific embodiments disclosed herein, but includes all technical solutions falling within the scope of the claims.

Claims

1. A video multi-frame parallel temporal analysis intelligent monitoring system, characterized in that, include: Image acquisition module, used to photograph energy plant buildings; The data preprocessing module is used to preprocess the video data acquired by the image acquisition module, including noise reduction, image enhancement, and normalization, in order to improve the quality and stability of the video data and provide a better foundation for subsequent analysis. The multi-frame parallel processing module is used to divide the video data processed by the data preprocessing module into multiple video frames and to put the multiple video frames in parallel. The image acquisition module is used to acquire the video frame images divided by the multi-frame parallel processing module; The time-series analysis module is used to analyze whether there are dangerous goods in the images acquired by the image acquisition module. If so, it will identify the people in the vicinity. GPS chip module, used to locate the position of hazardous materials; A detection module installed on the image acquisition module is used to detect the position of the GPS chip module; The acquisition module is used to obtain the location of hazardous materials based on the location detected by the detection module; The location analysis module is used to analyze the location status of hazardous materials based on the location obtained by the acquisition module, including moving speed and moving range; The notification module is used to notify personnel when there are analysis anomalies in the time series analysis module and the location analysis module; The time series analysis module includes: The first analysis module is used to analyze whether there are hazardous materials in the images acquired by the image acquisition module; The second analysis module is used to analyze the identity of nearby people when dangerous goods are present in the images acquired by the image acquisition module. After the location of the hazardous materials is located by the GPS chip module, the location of the GPS chip module will be detected by the detection module. After detection, the location of the hazardous materials will be obtained by the acquisition module based on the location detected by the detection module. After the detection module detects the location of the GPS chip module, it controls the image acquisition module to capture images of the GPS chip module's location.

2. The intelligent monitoring system for multi-frame parallel temporal analysis of video according to claim 1, characterized in that, The first analysis module includes: a feature extraction module, used to extract image features acquired by the image acquisition module; The first storage module is used to store images of various hazardous materials and their appearance.

3. The intelligent monitoring system for multi-frame parallel temporal analysis of video according to claim 2, characterized in that, The first analysis module further includes: a first comparison module, used to compare the image features extracted by the feature extraction module with the images stored in the first storage module; The first judgment module is used to determine whether the image features extracted by the feature extraction module are similar to those in the first storage module. If they are, then there are dangerous goods.

4. The intelligent monitoring system for multi-frame parallel temporal analysis of video according to claim 1, characterized in that, The second analysis module includes: a personnel analysis module, used to analyze personnel near hazardous materials; The facial feature analysis module is used to perform facial feature analysis on nearby people identified by the personnel analysis module.

5. The intelligent monitoring system for multi-frame parallel temporal analysis of video according to claim 4, characterized in that, The second analysis module further includes: a second storage module for storing facial images of staff and monitoring personnel; The input module is used to input the facial images of staff and supervisors into the second storage module; The deletion module is used to delete facial images of staff and supervisors from the second storage module.

6. The intelligent monitoring system for multi-frame parallel temporal analysis of video according to claim 5, characterized in that, The second analysis module further includes: a second comparison module, used to compare the facial features analyzed by the facial feature analysis module with the facial images stored in the second storage module; The second judgment module is used to determine whether the facial features analyzed by the facial feature analysis module exist in the second storage module. If they do not exist, they will be uploaded to the notification module.

7. The intelligent monitoring system for multi-frame parallel temporal analysis of video according to claim 1, characterized in that, The notification module includes: an information storage module for storing the contact information of the guardian; The reminder information storage module is used to store reminder information for the monitoring personnel.

8. The intelligent monitoring system for multi-frame parallel temporal analysis of video according to claim 7, characterized in that, The notification module further includes: an SMS notification module, used to notify the information stored in the information storage module via SMS based on the information stored in the information storage module; The telephone notification module is used to send reminders via telephone based on the information stored in the information storage module.

Images