An intelligent interactive security monitoring system
By introducing deep learning algorithms and interactive display control modules into the security monitoring system, the problem that traditional security monitoring systems cannot detect abnormalities in real time and adjust brightness automatically is solved, intelligent monitoring and security guarantees for the supervision area are realized, and display effects are improved. System performance.
Patent Information
- Application Number
- CN202410099081.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-01-24
- Publication Date
- 2024-11-26
- Estimated Expiration
- 2044-01-24
AI Technical Summary
Traditional security monitoring systems cannot detect abnormal situations in real time and respond automatically, cannot reasonably analyze and accurately feedback the security warning conditions in the required supervision areas, and cannot automatically and accurately control the brightness of interactive display components, which is low in intelligence.
A smart interactive security monitoring system was designed, including camera monitoring module, intelligent analysis and identification module, intelligent interactive module, interactive display control module and interactive sensitivity evaluation module. Deep learning algorithms are used to perform object detection and behavior analysis to generate regional security Early warning information, and automatically adjust brightness through interactive display control module, evaluate operational sensitivity, and ensure the intelligence and safety of the system.
Effective monitoring and security guarantees of required supervision areas are achieved, display effects are improved, energy consumption is reduced, and the system performance is ensured through regular maintenance.
Smart Images

Figure CN117834821B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of security monitoring, in particular to an intelligent interactive security monitoring system. Background Art
[0002] With the development of economy and the continuous maturity of technology, the security industry has become an important part of the social public security system, playing an increasingly important role in social security, economic development and people's lives. Security monitoring systems have been widely used in homes, enterprises, public places and other fields;
[0003] Traditional security monitoring systems are usually only capable of simple video recording and remote viewing. They are unable to detect abnormal situations in real time and respond automatically. They are also unable to reasonably analyze and accurately feedback the security warning status of the required supervision area. They are also unable to automatically and accurately adjust the brightness of interactive display components and comprehensively evaluate their performance. Their intelligence level is low.
[0004] In view of the above technical defects, a solution is now proposed. Summary of the invention
[0005] The purpose of the present invention is to provide an intelligent interactive security monitoring system, which solves the problems that the prior art is unable to detect abnormal situations in real time and respond automatically, and is unable to reasonably analyze and accurately feedback the security warning status of the required supervision area, and is unable to automatically and accurately control the brightness of interactive display components and comprehensively evaluate their performance, and has a low level of intelligence.
[0006] To achieve the above object, the present invention provides the following technical solutions:
[0007] A smart interactive security monitoring system, comprising a server, a camera monitoring module, an intelligent analysis and recognition module, an intelligent interaction module, an interactive display control module and an interactive sensitivity evaluation module; the camera monitoring module monitors a required supervision area through a camera with a high resolution and wide-angle lens, collects real-time monitoring images of the required supervision area, and sends the real-time monitoring images to the smart analysis and recognition module via the server; the smart analysis and recognition module uses a deep learning algorithm to perform target detection and behavior analysis operations on the real-time monitoring images, and identifies abnormal situations in the required supervision area and generates corresponding regional security warning information, and sends the corresponding regional security warning information to the smart interaction module via the server;
[0008] The smart interactive module displays the security warning information when it receives it and issues a corresponding warning, and the management personnel issue corresponding instructions, view corresponding information and make corresponding parameter setting changes through the smart interactive module; the interactive display control module is used to set the display control area directly in front of the display surface of the smart interactive module, and switch the smart interactive module to sleep mode when the smart interactive module does not receive the regional security warning information or there is no management personnel in the display control area. Otherwise, the display control detection and analysis are used to determine the appropriate display brightness and mark it as the standard brightness, and the smart interactive module is controlled to display and operate according to the standard brightness; the interactive sensitivity evaluation module is used to detect and analyze the operation sensitivity of the smart interactive module, and determine whether to generate a low operation sensitivity signal through analysis, and send the low operation sensitivity signal to the smart terminal of the corresponding maintenance personnel.
[0009] Furthermore, the specific analysis process of the intelligent analysis and identification module is as follows:
[0010] Target detection: Target detection is performed on each frame of real-time surveillance images. It relies on the target detection algorithm in deep learning to quickly and accurately identify objects and people in the surveillance images.
[0011] Behavior analysis: After completing target detection, the detected target is analyzed for behavior. This method relies on the action recognition algorithm in deep learning to analyze the target's motion trajectory, speed, and direction information to determine whether it is an abnormal behavior.
[0012] Anomaly detection: Anomaly detection is performed based on the results of behavioral analysis. Through preset rules or machine learning models, the behavior is analyzed and compared to determine whether it meets the characteristics of abnormal behavior.
[0013] Result output: If an abnormal situation is detected, regional security warning information is generated and output to the intelligent interactive module. The regional security warning information includes the time and location of the abnormality and a description of the abnormal behavior.
[0014] Furthermore, the specific analysis process of display and control detection analysis is as follows:
[0015] The position of the manager in the display and control area is collected, and the distance between the manager's position and the position of the intelligent interactive module is calculated to obtain the display connection value; based on the vision condition of each manager, a set of vision impact values is set in advance for each manager, and the manager's identity is identified, and the vision impact value of the identified manager is marked as the vision weight value;
[0016] And the ambient brightness and air pollution in the display and control area are collected, the display connection value, ambient brightness and air pollution are numerically calculated to obtain the display and control initial inspection value, the display and control initial inspection value is multiplied by the vision weight value to obtain the display and control evaluation value; several groups of preset display and control evaluation value ranges are set in advance, and each group of preset display and control evaluation value ranges corresponds to a group of display brightness, the display and control evaluation value is compared with all the preset display and control evaluation value ranges one by one, the preset display and control evaluation value range that includes the display and control evaluation value is marked as the optimal range, and the display brightness corresponding to the optimal range is marked as the standard brightness.
[0017] Furthermore, the specific operation process of the interactive sensitivity assessment module includes:
[0018] When the manager performs a click operation on the touch screen of the smart interactive module, the click contact time and click finger pressure are collected, and the click contact time and click finger pressure are numerically compared with the preset click contact time range and the preset click finger pressure range, respectively. If the click contact time and the click finger pressure are both within the corresponding preset range, the corresponding click operation is judged to be qualified;
[0019] When judging whether the corresponding click operation is qualified, if the intelligent interactive module does not respond, the corresponding click operation will be marked as an interactive non-sensory operation; otherwise, the interval duration for the intelligent interactive module to respond is collected and marked as the interactive delay value; through interactive sensitivity evaluation analysis to obtain the click interaction evaluation value of the intelligent interactive module, the click interaction evaluation value is numerically compared with the preset click interaction evaluation threshold; if the click interaction evaluation value exceeds the preset click interaction evaluation threshold, a low operation sensitivity signal is generated.
[0020] Furthermore, the specific analysis process of the interactive sensitivity evaluation analysis is as follows:
[0021] All interaction delay values within a unit time are summed up and the average is taken to obtain the interaction time table value, the ratio of the number of interaction delay values exceeding the preset interaction delay threshold within a unit time to the total number of click operations is marked as the delay interaction detection value, and the ratio of the number of interactive non-sensory operations within a unit time to the total number of click operations is marked as the interactive non-sensory detection value, and the interactive non-sensory detection value, the delay interaction detection value and the interaction time table value are numerically calculated to obtain the click interaction evaluation value.
[0022] Furthermore, the server is communicatively connected with the regional management detection and diagnosis module, which is used to set a detection cycle, analyze the security warning status of the area to be supervised within the detection cycle, generate a high control signal or a low control signal through analysis, and analyze the inspection status of the area to be supervised within the detection cycle when generating a high control signal, generate a high-impact inspection signal or a low-impact inspection signal through analysis, and send the high-control signal or the low-control signal as well as the high-impact inspection signal or the low-impact inspection signal to the intelligent interactive module via the server.
[0023] Furthermore, the specific operation process of the regional management detection and diagnosis module includes:
[0024] The generation time of security warning information of all areas is obtained and marked as the security warning time, the time difference between two adjacent groups of security warning times is calculated to obtain the installation warning interval value, the installation warning interval value is numerically compared with the preset installation warning interval threshold, if the installation warning interval value does not exceed the preset security warning interval threshold, the corresponding security warning interval value is marked as the security warning interval value;
[0025] The ratio of the number of installation warning proximity values and the number of installation warning interval values within the detection period is calculated to obtain the installation warning proximity occupancy value, and the number of times the regional security warning information is generated in the required supervision area within the detection period is collected and marked as the regional security warning value, and the installation warning proximity occupancy value and the regional security warning value are numerically calculated to obtain the regional security analysis value; the regional security analysis value is numerically compared with the preset regional security analysis threshold, if the regional security analysis value exceeds the preset regional security analysis threshold, a high control signal is generated; if the regional security analysis value does not exceed the preset regional security analysis threshold, a low control signal is generated.
[0026] Furthermore, when generating a regional high control signal, the number of inspections performed on the area to be supervised within the detection cycle is collected and marked as the regional inspection value, and the inspection duration of each inspection is collected, and all inspection durations within the detection cycle are summed up to obtain the inspection time measurement value;
[0027] The interval between two adjacent inspection processes is marked as the inspection interval, and the inspection interval is compared with the preset inspection interval threshold. If the inspection interval exceeds the preset inspection interval threshold, the corresponding inspection interval is marked as the extended interval, and the ratio of the number of extended intervals to the number of inspection intervals in the detection period is calculated to obtain the high interval inspection value.
[0028] The regional patrol value, the patrol time measurement value and the high interval patrol value are numerically calculated to obtain the regional patrol shadow value, and the regional patrol shadow value is numerically compared with the preset regional patrol shadow threshold. If the regional patrol shadow value exceeds the preset regional patrol shadow threshold, a patrol high impact signal is generated; if the regional patrol shadow value does not exceed the preset regional patrol shadow threshold, a patrol low impact signal is generated.
[0029] Furthermore, the server is communicatively connected to the interactive operation comprehensive judgment module. If no operation low sensitivity signal is generated, the interactive operation comprehensive judgment module conducts a comprehensive analysis of the operation process of the intelligent interactive module within a unit time, and judges the abnormal operation status of the intelligent interactive module, thereby determining whether to generate an operation comprehensive judgment abnormality signal. When the operation comprehensive judgment abnormality signal is generated, it is sent to the intelligent terminal of the corresponding maintenance personnel via the server.
[0030] Furthermore, the specific operation process of the interactive operation comprehensive judgment module is as follows:
[0031] The total operating energy consumption and average operating power of the smart interactive module per unit time are collected, and the ratio of the total operating energy consumption to the average operating power is calculated to obtain the interactive power consumption detection value; and the real-time display brightness and the corresponding standard brightness of the smart interactive module are collected, and the deviation value of the real-time display brightness compared to the corresponding standard brightness is marked as the brightness deviation value, and all the brightness deviation values per unit time are averaged to obtain the display brightness detection value;
[0032] The noise and vibration values generated by the intelligent interactive module at several detection points in unit time are collected, and the interactive noise detection value is obtained by averaging all the noise values in unit time, and the interactive vibration detection value is obtained by averaging all the vibration values in unit time; the interactive consumption detection value, display brightness detection value, interactive noise detection value and interactive vibration detection value are numerically calculated to obtain the interactive comprehensive judgment value, and the interactive comprehensive judgment value is numerically compared with the preset interactive comprehensive judgment threshold. If the interactive comprehensive judgment value exceeds the preset interactive comprehensive judgment threshold, an operation comprehensive judgment abnormal signal is generated.
[0033] Compared with the prior art, the present invention has the following beneficial effects:
[0034] 1. In the present invention, the camera monitoring module is used to monitor the required supervision area and collect its real-time monitoring images. The intelligent analysis and recognition module uses a deep learning algorithm to perform target detection and behavior analysis operations on the real-time monitoring images, and generates corresponding regional security warning information when identifying abnormal situations in the required supervision area. The smart interactive module displays the regional security warning information and issues corresponding warnings, thereby realizing effective monitoring of the required supervision area, which is beneficial to ensuring the safety of the required supervision area; and the security warning status of the required supervision area within the detection cycle is analyzed by the regional management detection and diagnosis module, and the inspection status of the required supervision area within the detection cycle is analyzed when a high control signal is generated. By analyzing and generating a high-impact inspection signal or a low-impact inspection signal, it is beneficial to the subsequent management planning of the required supervision area and ensure the rationality of the planning. The intelligent degree is high, and the brightness of the smart interactive module is automatically and reasonably adjusted by the interactive display control module, which can not only effectively reduce energy consumption, but also significantly improve the display effect;
[0035] 2. In the present invention, the operational sensitivity of the intelligent interactive module is detected and analyzed by the interactive sensitivity evaluation module, and whether an operation low sensitivity signal is generated is determined through analysis. When no operation low sensitivity signal is generated, the operation process of the intelligent interactive module is comprehensively analyzed by the interactive operation comprehensive judgment module, and the operation abnormality of the intelligent interactive module is judged, thereby determining whether to generate an operation comprehensive judgment abnormal signal. When an operation low sensitivity signal or an operation comprehensive judgment abnormal signal is generated, the intelligent interactive module is repaired and inspected, thereby effectively ensuring the performance of the intelligent interactive module. BRIEF DESCRIPTION OF THE DRAWINGS
[0036] In order to facilitate understanding by those skilled in the art, the present invention is further described below in conjunction with the accompanying drawings;
[0037] Figure 1 This is a system block diagram of Embodiment 1 of the present invention;
[0038] Figure 2 This is a system block diagram of Embodiment 2 of the present invention;
[0039] Figure 3 This is a system block diagram of Embodiment 3 of the present invention. DETAILED DESCRIPTION
[0040] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
[0041] Embodiment 1: Figure 1 As shown, the present invention proposes a smart interactive security monitoring system, including a server, a camera monitoring module, an intelligent analysis and recognition module, a smart interaction module, an interactive display control module and an interactive sensitivity evaluation module; the camera monitoring module monitors the required supervision area through a camera with a high resolution and wide-angle lens, collects real-time monitoring images of the required supervision area, and sends the real-time monitoring images to the intelligent analysis and recognition module via the server;
[0042] The intelligent analysis and recognition module uses a deep learning algorithm to perform target detection and behavior analysis on real-time monitoring images, and identifies abnormal situations in the required supervision area and generates corresponding regional security warning information. The corresponding regional security warning information is sent to the smart interactive module via the server to achieve effective monitoring of the required supervision area, which is conducive to ensuring the safety of the required supervision area. The specific analysis process of the intelligent analysis and recognition module is as follows:
[0043] Target detection: Target detection is performed on each frame of real-time monitoring images, relying on target detection algorithms in deep learning, such as YOLO, Faster R-CNN, etc. Through these algorithms, the module can quickly and accurately identify objects or people in the video, providing a basis for subsequent behavior analysis; Behavior analysis: After completing target detection, the detected target is analyzed for behavior, relying on action recognition algorithms in deep learning, such as 3D convolutional neural networks, etc., through which the target's motion trajectory, speed, direction and other information are analyzed to determine whether it is an abnormal behavior;
[0044] Anomaly detection: Anomaly detection is performed based on the results of behavioral analysis. The behavior is analyzed and compared through preset rules or machine learning models to determine whether it meets the characteristics of abnormal behavior. For example, if an object is detected moving too fast or suddenly changes direction in the monitoring area, it may be judged as an abnormal situation. Result output: If an abnormal situation is detected, regional security warning information is generated and output to the intelligent interactive module. The regional security warning information includes the time and place of the abnormality and the description of the abnormal behavior, etc. This information will be used to trigger the warning.
[0045] When the smart interactive module receives security warning information, it displays it and issues corresponding warnings, and the management personnel issue corresponding instructions, view corresponding information and make corresponding parameter setting changes through the smart interactive module; the interactive display control module is used to set the display control area in front of the display surface of the smart interactive module, and switch the smart interactive module to a dormant state when the smart interactive module does not receive the regional security warning information or there is no management personnel in the display control area. Otherwise, the display control detection and analysis is used to determine the appropriate display brightness and mark it as the standard brightness, and control the smart interactive module to display and operate according to the standard brightness, so as to realize automatic and reasonable regulation of the brightness of the smart interactive module, which can not only effectively reduce energy consumption, but also significantly improve the display effect; the specific analysis process of the display control detection and analysis is as follows:
[0046] The position of the manager in the display and control area is collected, and the distance between the manager's position and the position of the intelligent interactive module is calculated to obtain the display connection value; based on the vision condition of each manager, a set of vision impact values corresponding to each manager is set in advance, and the identity of the manager is identified, and the vision impact value of the identified manager is marked as the vision weight value; wherein, the better the vision condition of the corresponding manager, the smaller the value of the vision weight value matching it, and the value of the vision weight value is greater than zero and stored in the server; and the ambient brightness and air pollution in the display and control area are collected, wherein the air pollution is a data value indicating the dust concentration in the display and control area;
[0047] The display control initial inspection value XF is obtained by numerically calculating the display connection value XW, the ambient brightness XL and the air pollution XK through the formula XF=a1*XW+a2*XL+a3*XK, wherein a1, a2 and a3 are preset proportional coefficients, and the values of a1, a2 and a3 are all greater than zero; and the larger the value of the display control initial inspection value XF is, the more difficult it is for the corresponding management personnel to see the content displayed on the smart interactive module, and the more it is necessary to increase the display brightness of the smart interactive module;
[0048] Multiply the initial inspection value of the display and control by the vision weight value to obtain the display and control evaluation value. Set several groups of preset display and control evaluation value ranges in advance, and each group of preset display and control evaluation value ranges corresponds to a group of display brightness, wherein the larger the value of the preset display and control evaluation value range, the larger the value of the display brightness that matches it, and the brighter the display of the intelligent interactive module; compare the display and control evaluation value with all the preset display and control evaluation value ranges one by one, mark the preset display and control evaluation value range that includes the display and control evaluation value as the optimal range, and mark the display brightness corresponding to the optimal range as the standard brightness.
[0049] The interactive sensitivity evaluation module is used to detect and analyze the operation sensitivity of the smart interactive module. Through analysis, it is determined whether to generate a low-sensitivity operation signal, and the low-sensitivity operation signal is sent to the smart terminal of the corresponding maintenance personnel. It can reasonably analyze the operation sensitivity of the smart interactive module and provide accurate feedback, so that the maintenance personnel can perform maintenance inspections on the smart interactive module in a timely manner, thereby ensuring the performance of the smart interactive module. The specific operation process of the interactive sensitivity evaluation module is as follows:
[0050] When the manager performs a click operation on the touch screen of the smart interactive module, the click contact duration and click finger pressure are collected, wherein the click finger pressure is a data value indicating the magnitude of the pressure applied to the smart interactive module when clicking, and the click contact duration is a data value indicating the length of time of contact with the smart interactive module when clicking; the click contact duration and the click finger pressure are numerically compared with the preset click contact duration range and the preset click finger pressure range, respectively; if the click contact duration and the click finger pressure are both within the corresponding preset ranges, the corresponding click operation is judged to be qualified;
[0051] When judging whether the corresponding click operation is qualified, if the intelligent interactive module does not respond, the corresponding click operation is marked as an interactive non-sensory operation; otherwise, the interval time for the intelligent interactive module to respond is collected and marked as the interactive latency value; all interactive latency values in a unit time are summed and averaged to obtain the interactive latency value, and the ratio of the number of interactive latency values exceeding the preset interactive latency threshold in a unit time to the total number of click operations is marked as the interactive latency detection value, and the ratio of the number of interactive non-sensory operations in a unit time to the total number of click operations is marked as the interactive non-sensory detection value;
[0052] And the click interaction evaluation value HX is obtained by numerically calculating the interactive non-sensing detection value HP, the slow interaction detection value HY and the interactive time table value HK through the formula HX=ew1*HP+ew2*HY+ew3*HK / (ew1+ew2), wherein ew1, ew2 and ew3 are preset proportional coefficients, ew1>ew2>ew3>0; and the larger the value of the click interaction evaluation value HX is, the worse the response condition of the intelligent interactive module per unit time and the worse the sensitivity performance is; the click interaction evaluation value HX is numerically compared with the preset click interaction evaluation threshold value. If the click interaction evaluation value HX exceeds the preset click interaction evaluation threshold value, it indicates that the sensitivity performance of the intelligent interactive module is poor, and a low operation sensitivity signal is generated.
[0053] Embodiment 2: Figure 2As shown, the difference between this embodiment and embodiment 1 is that the server is connected to the regional management detection and diagnosis module in communication, and the regional management detection and diagnosis module is used to set the detection period, preferably, the detection period is nine days; the security warning status of the area to be supervised within the detection period is analyzed, and a high control signal or a low control signal is generated through analysis, and when the high control signal is generated, the inspection status of the area to be supervised within the detection period is analyzed, and a high impact inspection signal or a low impact inspection signal is generated through analysis, and the high control signal or the low control signal and the high impact inspection signal or the low impact inspection signal are sent to the intelligent interactive module via the server, which is conducive to the subsequent management planning of the required supervision area and ensures the rationality of the planning, has a high degree of intelligence, and significantly reduces the difficulty of management planning; the specific operation process of the regional management detection and diagnosis module is as follows:
[0054] The generation time of security warning information of all regions is obtained and marked as the security warning time, the time difference between two adjacent groups of security warning time is calculated to obtain the installation warning interval value, the installation warning interval value is numerically compared with the preset installation warning interval threshold, if the installation warning interval value does not exceed the preset security warning interval threshold, the corresponding security warning interval value is marked as the security warning near interval value; the number of installation warning near interval values and the number of installation warning interval values within the detection period are calculated to obtain the installation warning near ratio value, and the number of times the regional security warning information is generated in the required supervision area within the detection period is collected and marked as the regional security warning value;
[0055] The installation warning occupancy value FZ and the regional security warning value FP are numerically calculated by the formula FX=fg1*FZ+fg2*FP to obtain the regional security analysis value FX; wherein, fg1 and fg2 are preset weight coefficients, fg1>fg2>0; and, the larger the numerical value of the regional security analysis value FX, the worse the security performance of the required supervision area during the detection period; the regional security analysis value FX is numerically compared with the preset regional security analysis threshold value, if the regional security analysis value FX exceeds the preset regional security analysis threshold value, it indicates that the security performance of the required supervision area during the detection period is poor and needs to be strengthened, and a high control signal is generated; if the regional security analysis value FX does not exceed the preset regional security analysis threshold value, it indicates that the security performance of the required supervision area during the detection period is good, and a low control signal is generated.
[0056] Furthermore, when generating a regional high control signal, the number of inspections conducted on the area to be supervised within the detection cycle is collected and marked as the regional inspection value, and the inspection duration of each inspection is collected, and all inspection durations within the detection cycle are summed up to obtain the inspection time measurement value; and the interval duration between two adjacent inspection processes is marked as the patrol duration, and the patrol duration is numerically compared with the preset patrol duration threshold. If the patrol duration exceeds the preset patrol duration threshold, the corresponding patrol duration is marked as the extended duration, and the number of extended durations within the detection cycle is ratio-calculated to the number of patrol durations to obtain the high interval patrol value;
[0057] The regional patrol value QX is obtained by numerically calculating the regional patrol value QW, the patrol measurement value QR and the high interval patrol value QK through the formula QX=fy1*QW+fy2*QR / fy3+fy3*QK, wherein fy1, fy2 and fy3 are preset proportional coefficients, and fy3>fy1>fy2>0; and the larger the value of the regional patrol value QX, the greater the probability that the security performance of the required supervision area is poor due to poor patrol conditions during the detection cycle; the regional patrol value QX is numerically compared with the preset regional patrol threshold. If the regional patrol value QX exceeds the preset regional patrol threshold, it indicates that the probability of poor security performance of the required supervision area due to poor patrol conditions during the detection cycle is relatively high, and the regional supervision should be strengthened in the future, and a patrol high impact signal is generated; if the regional patrol value QX does not exceed the preset regional patrol threshold, a patrol low impact signal is generated.
[0058] Embodiment 3: Figure 3 As shown, the difference between this embodiment and embodiment 1 and embodiment 2 is that the server is connected to the interactive operation comprehensive judgment module in communication. If the interactive sensitivity evaluation module does not generate an operation low sensitivity signal, the interactive operation comprehensive judgment module conducts a comprehensive analysis of the operation process of the intelligent interactive module within a unit time, and judges the abnormal operation status of the intelligent interactive module, thereby determining whether to generate an operation comprehensive judgment abnormal signal. When the operation comprehensive judgment abnormal signal is generated, it is sent to the intelligent terminal of the corresponding maintenance personnel via the server to further capture the operation abnormality of the intelligent interactive module and accurately feedback it, so that the maintenance personnel can timely perform maintenance inspections on the intelligent interactive module, thereby effectively ensuring the use performance of the intelligent interactive module and improving its service life; the specific operation process of the interactive operation comprehensive judgment module is as follows:
[0059] The total operating energy consumption and average operating power of the smart interactive module per unit time are collected, and the ratio of the total operating energy consumption to the average operating power is calculated to obtain the interactive consumption detection value; and the real-time display brightness and the corresponding standard brightness of the smart interactive module are collected, and the deviation value of the real-time display brightness compared with the corresponding standard brightness is marked as the brightness deviation value, and all the brightness deviation values per unit time are averaged to obtain the display brightness detection value; wherein, the larger the values of the interactive consumption detection value and the display brightness detection value, the worse the operating condition of the smart interactive module per unit time is;
[0060] And the noise value and vibration value generated by the intelligent interactive module at several detection time points in a unit time are collected, and the interactive noise detection value is obtained by averaging all the noise values in a unit time, and the interactive vibration detection value is obtained by averaging all the vibration values in a unit time; wherein, the larger the values of the interactive noise detection value and the interactive vibration detection value are, the worse the operation condition of the intelligent interactive module in a unit time is;
[0061] The interactive comprehensive judgment value WP is obtained by numerically calculating the interactive consumption detection value WF, the display brightness detection value WY, the interactive noise detection value WQ and the interactive vibration detection value WK through the formula WP=b1*WF+b2*WY+(b3*WQ+b4*WK) / 2, wherein b1, b2, b3, b4 are preset proportional coefficients, and the values of b1, b2, b3, b4 are all positive numbers; and the larger the value of the interactive comprehensive judgment value WP is, the worse the operating condition of the intelligent interactive module is; the interactive comprehensive judgment value WP is numerically compared with the preset interactive comprehensive judgment threshold value. If the interactive comprehensive judgment value WP exceeds the preset interactive comprehensive judgment threshold value, it indicates that the operating condition of the intelligent interactive module is poor, and an operation comprehensive judgment abnormal signal is generated.
[0062] The working principle of the present invention is as follows: when in use, the required supervision area is monitored and its real-time monitoring images are collected through the camera monitoring module. The intelligent analysis and recognition module adopts a deep learning algorithm to perform target detection and behavior analysis operations on the real-time monitoring images, and generates corresponding regional security warning information when abnormal situations in the required supervision area are identified. The smart interactive module displays the regional security warning information and issues corresponding warnings, thereby realizing effective monitoring of the required supervision area, which is beneficial to ensuring the safety of the required supervision area; and the brightness of the smart interactive module is automatically and reasonably adjusted through the interactive display control module, which can not only effectively reduce energy consumption, but also significantly improve the display effect, and the interactive sensitivity evaluation module is used to detect and analyze the operation sensitivity of the smart interactive module, and the analysis is used to determine whether a low operation sensitivity signal is generated. When a low operation sensitivity signal is generated, the smart interactive module is repaired and inspected, thereby ensuring the performance of the smart interactive module.
[0063] The above formulas are all dimensionless and numerical calculations. The formula is a formula obtained by collecting a large amount of data and performing software simulation to obtain the most recent real situation. The preset parameters in the formula are set by technicians in this field according to actual conditions. The preferred embodiments of the present invention disclosed above are only used to help explain the present invention. The preferred embodiments do not describe all the details in detail, nor do they limit the invention to only specific implementation methods. Obviously, many modifications and changes can be made according to the contents of this specification. This specification selects and specifically describes these embodiments in order to better explain the principles and practical applications of the present invention, so that technicians in the relevant technical field can understand and use the present invention well. The present invention is only limited by the claims and their full scope and equivalents.
Claims
1. An intelligent interactive security monitoring system, characterized in that: It includes a server, a camera monitoring module, an intelligent analysis and recognition module, a smart interaction module, an interactive display control module and an interactive sensitivity evaluation module; The camera monitoring module monitors the required supervision area through a high-resolution, wide-angle lens camera, collects real-time monitoring images of the required supervision area, and sends the real-time monitoring images to the intelligent analysis and recognition module via the server; the intelligent analysis and recognition module uses a deep learning algorithm to perform target detection and behavior analysis operations on the real-time monitoring images, and identifies abnormal situations in the required supervision area and generates corresponding regional security warning information, and sends the corresponding regional security warning information to the smart interaction module via the server; The intelligent interactive module displays the security warning information when it is received and issues corresponding warnings, and the management personnel can issue corresponding instructions, view corresponding information and make corresponding parameter setting changes through the intelligent interactive module; The interactive display control module is used to set the display control area in front of the display surface of the smart interactive module, and switch the smart interactive module to a dormant state when the smart interactive module does not receive the regional security warning information or there is no management personnel in the display control area. Otherwise, the display control detection and analysis is performed to determine the appropriate display brightness and mark it as the standard brightness, and the smart interactive module is controlled to display and operate according to the standard brightness; The interactive sensitivity evaluation module is used to detect and analyze the operation sensitivity of the intelligent interactive module, and to determine whether to generate an operation low sensitivity signal through analysis, and to send the operation low sensitivity signal to the intelligent terminal of the corresponding maintenance personnel; The specific analysis process of display and control detection and analysis is as follows: The position of the manager in the display and control area is collected, and the distance between the manager's position and the position of the intelligent interactive module is calculated to obtain the display connection value; based on the vision condition of each manager, a set of vision impact values is set in advance for each manager, and the manager's identity is identified, and the vision impact value of the identified manager is marked as the vision weight value; The ambient brightness and air pollution in the display and control area are collected, and the display and control initial inspection value XF is obtained by numerically calculating the display connection value XW, the ambient brightness XL and the air pollution XK through the formula XF=a1*XW+a2*XL+a3*XK, where a1, a2 and a3 are preset proportional coefficients, and the values of a1, a2 and a3 are all greater than zero; The initial display and control inspection value is multiplied by the visual acuity weight value to obtain a display and control evaluation value; a plurality of preset display and control evaluation value ranges are set in advance, and each preset display and control evaluation value range corresponds to a set of display brightness, and the preset display and control evaluation value range containing the display and control evaluation value is marked as an optimal range, and the display brightness corresponding to the optimal range is marked as a standard brightness; The specific operation process of the interactive sensitivity assessment module includes: When the manager performs a click operation on the touch screen of the smart interactive module, the click contact duration and click finger pressure are collected. If the click contact duration and click finger pressure are both within the corresponding preset range, the corresponding click operation is judged to be qualified; when judging that the corresponding click operation is qualified, if the smart interactive module does not respond, the corresponding click operation is marked as an interactive non-sensory operation, otherwise, the interval duration for the smart interactive module to respond is collected and marked as the interactive delay value; the click interaction evaluation value of the smart interactive module is obtained through interactive sensitivity evaluation analysis, and if the click interaction evaluation value exceeds the preset click interaction evaluation threshold, a low operation sensitivity signal is generated; The specific analysis process of interactive sensitivity evaluation is as follows: All interaction latency values within a unit time are summed up and averaged to obtain an interaction latency value, the ratio of the number of interaction latency values exceeding a preset interaction latency threshold within a unit time to the total number of click operations within a unit time is marked as a latency interaction detection value, and the ratio of the number of interactive non-sensing operations within a unit time to the total number of click operations is marked as an interactive non-sensing detection value; And the interactive non-sensing detection value HP, the slow interactive detection value HY and the interactive time table value HK are numerically calculated by the formula HX=ew1*HP+ew2*HY+ew3*HK / (ew1+ew2) to obtain the click interactive evaluation value HX, where ew1, ew2 and ew3 are preset proportional coefficients, ew1>ew2>ew3>0; The server is in communication connection with the regional management detection and diagnosis module, which is used to set the detection cycle, analyze the security warning status of the area to be supervised within the detection cycle, generate a high control signal or a low control signal through analysis, and analyze the inspection status of the area to be supervised within the detection cycle when the high control signal is generated, generate a high-impact inspection signal or a low-impact inspection signal through analysis, and send the high-control signal or the low-control signal and the high-impact inspection signal or the low-impact inspection signal to the intelligent interactive module via the server; The specific operation process of the regional management detection and diagnosis module includes: The generation time of security warning information of all regions is obtained and marked as the security warning time. The time difference between two adjacent groups of security warning times is calculated to obtain the installation warning interval value. If the installation warning interval value does not exceed the preset security warning interval threshold, the corresponding security warning interval value is marked as the security warning near interval value. The number of installation warning near interval values and the number of installation warning interval values within the detection period are calculated to obtain the installation warning near ratio value, and the number of times the regional security warning information is generated in the required supervision area within the detection period is collected and marked as the regional security warning value; The regional security analysis value FX is obtained by numerically calculating the installation warning occupancy value FZ and the regional security warning value FP through the formula FX=fg1*FZ+fg2*FP; wherein, fg1 and fg2 are preset weight coefficients, fg1>fg2>0; if the regional security analysis value exceeds the preset regional security analysis threshold, a high control signal is generated; if the regional security analysis value does not exceed the preset regional security analysis threshold, a low control signal is generated; When generating a regional high control signal, the number of inspections conducted on the area to be supervised within the detection cycle is collected and marked as the regional inspection value, and the inspection duration of each inspection is collected, and all inspection durations within the detection cycle are summed up to obtain the inspection time measurement value; The interval between two adjacent inspection processes is marked as the inspection interval, and the inspection interval is compared with the preset inspection interval threshold. If the inspection interval exceeds the preset inspection interval threshold, the corresponding inspection interval is marked as the extended interval, and the ratio of the number of extended intervals to the number of inspection intervals in the detection period is calculated to obtain the high interval inspection value. The regional patrol value QX is obtained by numerically calculating the regional patrol value QW, the patrol measurement value QR and the high interval patrol value QK through the formula QX=fy1*QW+fy2*QR / fy3+fy3*QK, wherein fy1, fy2 and fy3 are preset proportional coefficients, and fy3>fy1>fy2>0; if the regional patrol value exceeds the preset regional patrol threshold, a patrol high impact signal is generated; if the regional patrol value does not exceed the preset regional patrol threshold, a patrol low impact signal is generated; The server is connected to the interactive operation comprehensive judgment module for communication. If the low-sensitivity operation signal is not generated, the interactive operation comprehensive judgment module conducts a comprehensive analysis of the operation process of the intelligent interactive module within a unit time, and judges the abnormal operation status of the intelligent interactive module, and determines whether to generate an abnormal operation comprehensive judgment signal based on the abnormal operation status. When the abnormal operation comprehensive judgment signal is generated, it is sent to the intelligent terminal of the corresponding maintenance personnel via the server; The specific operation process of the interactive operation comprehensive judgment module is as follows: The total operating energy consumption and average operating power of the smart interactive module per unit time are collected, and the ratio of the total operating energy consumption to the average operating power is calculated to obtain the interactive power consumption detection value; the real-time display brightness and the corresponding standard brightness of the smart interactive module are collected, and the deviation value of the real-time display brightness compared with the corresponding standard brightness is marked as the brightness deviation value, and all the brightness deviation values per unit time are averaged to obtain the display brightness detection value; and the noise value and vibration value generated by the smart interactive module at several detection time points per unit time are collected, and all the noise values per unit time are averaged to obtain the interactive noise detection value, and all the vibration values per unit time are averaged to obtain the interactive vibration detection value; The interactive comprehensive judgment value WP is obtained by numerically calculating the interactive consumption detection value WF, display brightness detection value WY, interactive noise detection value WQ and interactive vibration detection value WK through the formula WP=b1*WF+b2*WY+(b3*WQ+b4*WK) / 2, where b1, b2, b3, and b4 are preset proportional coefficients, and the values of b1, b2, b3, and b4 are all positive numbers; if the interactive comprehensive judgment value exceeds the preset interactive comprehensive judgment threshold, an operation comprehensive judgment abnormal signal is generated.
