Security monitoring method, device, terminal and computer-readable storage medium

A security monitoring method using sensor-fused data and predictive models automates the monitoring of industrial sites, reducing manual intervention and operational costs by ensuring safety and efficiency.

CN114664061BActive Publication Date: 2024-12-03SUZHOU SHANGLIWEI TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202210175363.3
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-02-24
Publication Date
2024-12-03
Estimated Expiration
2042-02-24

AI Technical Summary

Technical Problem

Industrial sites with automated mechanical equipment require manual monitoring due to complex environments, leading to high operational costs.

Method used

Implement a security monitoring method using multiple sensors to collect and fuse data, apply predictive models to determine the working status and safety level of field equipment, and issue alarms for manual intervention when conditions are not met, thereby automating the monitoring process.

Benefits of technology

This approach reduces the need for manual monitoring, thereby lowering operational costs and enhancing the cost-effectiveness of industrial sites.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114664061B_ABST
    Figure CN114664061B_ABST
Patent Text Reader

Abstract

The present application is applicable to the field of computer technology and provides a security monitoring method, device, terminal and computer-readable storage medium, including: obtaining at least two sensors at t i The field data collected at t, wherein the at least two sensors are installed on the field equipment; i The field data collected at all times and the working status of the field equipment in the historical cycle are used to obtain the working status S of the field equipment in the current cycle. i , the current period is t i Time to t i+1 The cycle corresponding to the moment; according to the working state S of the field device in the current cycle i , get the safety level a of the field device in the current cycle i The present application can solve the problem of high cost of manual monitoring in industrial sites.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application belongs to the field of computer technology, and specifically relates to a security monitoring method, device, terminal and computer-readable storage medium. Background Art

[0002] With the development of autonomous driving technology, industrial sites are increasingly using automated mechanical equipment to replace manual labor to complete on-site operations.

[0003] However, due to the complex environment of industrial sites, industrial sites driven by automated mechanical equipment still require manual monitoring. As a result, when the number of people required for manual monitoring is almost the same as the number of people required for manual driving, the low-cost advantage of industrial sites cannot be realized. Summary of the invention

[0004] In view of this, the present application provides a security monitoring method, device, terminal and computer-readable storage medium, which can solve the problem of high cost of manual monitoring in industrial sites.

[0005] A first aspect of an embodiment of the present application provides a security monitoring method, including:

[0006] Get at least two sensors at t i Field data collected at all times, wherein the at least two sensors are installed on the field equipment, and i is a natural number greater than or equal to 1;

[0007] According to the at least two sensors at t i The field data collected at all times and the working status of the field equipment in the historical cycle are used to obtain the working status S of the field equipment in the current cycle. i , the current period is t i Time to t i+1 The period corresponding to the moment;

[0008] According to the working state S of the field device in the current cycle i , get the safety level a of the field device in the current cycle i .

[0009] In another implementation of the first aspect, in the step of obtaining at least two sensors at t i After collecting the field data at all times, the method further comprises:

[0010] The at least two sensors are placed at t i The field data collected at all times are integrated to obtain fused data;

[0011] Accordingly, the at least two sensors are iThe field data collected at all times and the working status of the field equipment in the historical cycle are used to obtain the working status S of the field equipment in the current cycle. i ,include:

[0012] In the case where the fused data obeys a Gaussian distribution, the expectation of the fused data satisfies a first condition, and the variance of the fused data satisfies a second condition, according to the at least two sensors at t i The field data collected at all times and the working status of the field equipment in the historical cycle are used to obtain the working status S of the field equipment in the current cycle. i .

[0013] In another implementation of the first aspect, after obtaining the fused data, the method further includes:

[0014] In the case where the fused data obeys a Gaussian distribution, if the expectation of the fused data does not satisfy the first condition or the variance of the fused data does not satisfy the second condition, an alarm prompt message is issued, wherein the alarm prompt message is used to request manual intervention;

[0015] In the case that the fused data does not obey the Gaussian distribution, an alarm prompt message is issued, and the alarm prompt message is used to request manual intervention.

[0016] In another implementation of the first aspect, in obtaining the security level a of the field device in the current cycle i Afterwards, the method further comprises:

[0017] According to the safety level of the current cycle a i The safety level of the historical period is obtained by the safety prediction level ω i ;

[0018] At the safety prediction level ω i After the alarm condition is met, an alarm prompt message is issued, and the alarm prompt message is used to request manual intervention.

[0019] In another implementation of the first aspect, the security level a of the current cycle i The safety level of the historical period is obtained by the safety prediction level ω i ,include:

[0020] Set the security level of the current cycle to a i Add the safety level of the last N cycles in history to get the safety prediction level ω i ;

[0021] Set the security level of the current cycle to a i The weighted sum of the safety levels of the last N cycles in history is used to obtain the safety prediction level ωi ;

[0022] Set the security level of the current cycle to a i The weighted sum of the safety levels of all historical periods is used to obtain the safety prediction level ω i .

[0023] In another implementation of the first aspect, the ith historical period in the historical periods is earlier than the jth historical period, and the weight of the security level of the ith historical period is less than the weight of the security level of the jth historical period.

[0024] In another implementation of the first aspect, the sensor includes at least two of the following: a visual sensor, a lidar sensor, a positioning sensor, and a state observer.

[0025] A second aspect of an embodiment of the present application provides a security monitoring device, including:

[0026] The first acquisition module is used to obtain at least two sensors at t i Field data collected at all times, wherein the at least two sensors are installed on the field equipment;

[0027] The second acquisition module is used to obtain the i The field data collected at all times and the working status of the field equipment in the historical cycle are used to obtain the working status S of the field equipment in the current cycle. i , the current period is t i Time to t i+1 The period corresponding to the moment;

[0028] The third acquisition module is used to obtain the working state S of the field device in the current cycle according to the working state S of the field device in the current cycle. i , get the safety level a of the field device in the current cycle i .

[0029] A third aspect of an embodiment of the present application provides a terminal, comprising: a processor, wherein the processor is used to run a computer program stored in a memory to implement the security monitoring method as described in the first aspect.

[0030] A fourth aspect of an embodiment of the present application provides a computer-readable storage medium, in which a computer program is stored. When the computer program is executed on a processor, the security monitoring method of any one of the first aspects of the present application is implemented.

[0031] In this embodiment of the present application, at least two sensors are obtained at t i The field data collected at t, wherein the at least two sensors are installed on the field equipment; iThe field data collected at all times and the working status of the field equipment in the historical cycle are used to obtain the working status S of the field equipment in the current cycle. i , the current period is t i Time to t i+1 The cycle corresponding to the moment; according to the working state S of the field device in the current cycle i , get the safety level a of the field device in the current cycle i Through the above method, automatic monitoring of the safety level of industrial sites can be achieved, thereby effectively solving the problem of high cost of manual monitoring of industrial sites. It can be understood that the beneficial effects of the second to fourth aspects can be found in the relevant description of the first aspect, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0032] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without exceeding the scope of protection required by the present application.

[0033] Figure 1 A schematic diagram showing a flow chart of a security monitoring method provided by an embodiment of the present application is shown;

[0034] Figure 2 A schematic diagram showing a flow chart of a security monitoring method provided by another embodiment of the present application;

[0035] Figure 3 A schematic diagram showing a system model provided by an embodiment of the present application;

[0036] Figure 4 A schematic diagram showing a flow chart of a security monitoring method provided by another embodiment of the present application;

[0037] Figure 5 A schematic diagram showing a flow chart of a security monitoring method provided by another embodiment of the present application;

[0038] Figure 6 A schematic diagram showing a flow chart of a security monitoring method provided by another embodiment of the present application;

[0039] Figure 7 A schematic diagram showing the relationship of an attenuation function provided in an embodiment of the present application is shown;

[0040] Figure 8 A schematic block diagram showing the composition of a security monitoring device provided in an embodiment of the present application is shown;

[0041] Fig. 9A schematic block diagram of the composition of a terminal provided in an embodiment of the present application is shown. DETAILED DESCRIPTION

[0042] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of the present application.

[0043] In addition, described feature, structure or characteristic can be combined in one or more embodiments in any suitable manner. In the following description, many specific details are provided to provide a full understanding of the embodiments of the present application. However, those skilled in the art will appreciate that the technical scheme of the present application can be put into practice without one or more of the specific details, or other methods, components, devices, steps, etc. can be adopted. In other cases, known methods, devices, realizations or operations are not shown or described in detail to avoid blurring the various aspects of the application.

[0044] Those skilled in the art will appreciate that the drawings are only schematic diagrams of example embodiments and may not be to scale. The modules or processes in the drawings are not necessarily required to implement the present application and therefore cannot be used to limit the scope of protection of the present application.

[0045] See also Figure 1 , is a flow chart of a safety monitoring method provided by an embodiment of the present invention. As shown in the figure, the pavement disease detection method may include the following steps:

[0046] S11, obtain at least two sensors at t i The field data collected at all times, at least two sensors are installed on the field equipment, and i is a natural number greater than or equal to 1.

[0047] In an embodiment of the present application, the field data may be data from an industrial site (e.g., a mine) collected by unmanned mechanical equipment. Accordingly, the field equipment may be an unmanned mechanical equipment having at least two sensors installed thereon. The sensors installed on the unmanned mechanical equipment may be actual sensors (e.g., visual sensors, lidar sensors, and positioning sensors, etc.) or virtual sensors (e.g., state observers).

[0048] As an example, the field data can be a three-dimensional map of a mine (the three-dimensional map of a mine can be obtained by using data collected by visual sensors and lidar sensors mounted on drones, or by using wheeled vehicles equipped with visual sensors and lidar sensors; the three-dimensional map of a mine can also be obtained by using vehicles equipped with sensors to traverse and collect data from the mine environment), the positioning position of machinery (the positioning position of unmanned machinery can be obtained by using data collected by positioning sensors on unmanned mechanical equipment), imaging data of visual sensors or lidar sensors, and so on.

[0049] S12, based on at least two sensors at t i The field data collected at all times and the working status of the field equipment in the historical cycle are used to obtain the working status S of the field equipment in the current cycle. i , the current cycle is t i Time to t i+1 The period corresponding to the moment.

[0050] As an example, assume that the unmanned mechanical equipment 1 (i.e., the field equipment) in the mine is i The field data collected at all times is U i , unmanned mechanical equipment 1 in the historical period (t i-1 Time to t i The working state at the moment is S i-1 . Will U i and S i-1 After inputting the pre-trained working status prediction model, the working status prediction model is based on S i =FS i-1 +U i , predict the current cycle t i (t i Time to t i+1 At time ), the working state S of the unmanned mechanical equipment 1 i , as an example, Among them, p x,m,i ,p y,m,i ,p z,m,i is the predicted field device in the current cycle t i Time to t i+1 The three-axis coordinates at the moment, υ x,m.i ,υ y,m.i ,υ z,m.i is the predicted field device in the current cycle t i Time to t i+1 It should be noted that in the embodiment of the present application, the gate of the mine can be used as the origin to establish the coordinate system, but other key points can also be used as the origin of the mine three-coordinate system for other reasons.

[0051] Where F is the state update matrix. The state update matrix can be manually input or learned by the working state prediction model based on the training set. As an example, F can be the following matrix:

[0052]

[0053] As an example, D can refer to the following matrix:

[0054]

[0055] Of course, it should be noted that the above-mentioned working state prediction model is obtained after training a hidden Markov model (HiddenMarkov Model, HMM) or a recurrent neural network (Recurrent Neural Network, RNN). When the working state prediction model is a model obtained after training a hidden Markov model (Hidden Markov Model, HMM), F is a state update matrix manually input into the HMM model, and the state update matrix is ​​fixed. When the working state prediction model is a model obtained after training the RNN model, F is a state update matrix automatically learned by the RNN according to the training set, and it can be understood that although F is also fixed at this time, it is no longer simple, and it can have strong nonlinearity, that is, strong nonlinearity can make the working state of the predicted field equipment closer to the fact. In practical applications, suitable models can be selected for training as needed to obtain the working state prediction model in this application.

[0056] After obtaining the working state prediction model, the following working state update equation is used iteratively to predict the working state of the field equipment after time n:

[0057]

[0058] When training the selected HMM or RNN, first obtain a first sample training set, wherein the first sample training set includes the working status of the on-site equipment, the working status of the historical period and its corresponding predicted working status; use the first sample training set to train the HMM or RNN model to obtain a trained working status prediction model.

[0059] S13, according to the working status S of the field equipment in the current cycle i , get the safety level a of the field equipment in the current cycle i .

[0060] In the embodiment of the present application, the current cycle (t i Time to t i+1 The working state S of the cycle corresponding to the momenti After that, the working state S i Input into the safety level prediction model to get the current period (t i Time to t i+1 The safety level of the field equipment is a i .

[0061] Among them, the safety level prediction model is a model obtained by training the deep neural network (Deep Neural Networks, DNN) through the obtained second sample training set, wherein the second sample training set includes the working status of the on-site equipment and its corresponding safety level.

[0062] See also Figure 2 In another embodiment of the present application, after obtaining at least two sensors at t i In addition to the on-site data collected at all times, it also includes:

[0063] S22, at least two sensors are connected at t i The field data collected at all times are fused to obtain fused data.

[0064] As an example, see Figure 3 The schematic diagram of the system model provided in the embodiment of the present application is shown in the figure, where the field data collected by sensors such as the laser radar sensor, the visual sensor and the positioning sensor on the field equipment are fused to obtain fused data U1, U2, U3 and U4. It should be noted that Figure 3 The fusion data U1, U2, U3, U4 and the field data M collected by the sensors on the field equipment t1 、M t2 、M t3 、M t4 They are essentially the same and can both be called field data at industrial sites.

[0065] Accordingly, according to at least two sensors at t i The field data collected at all times and the working status of the field equipment in the historical cycle are used to obtain the working status of the field equipment in the current cycle, including:

[0066] S23, when the fused data obeys Gaussian distribution, the expectation of the fused data satisfies the first condition, and the variance of the fused data satisfies the second condition, according to at least two sensors at t i The field data collected at all times and the working status of the field equipment in the historical cycle are used to obtain the working status S of the field equipment in the current cycle. i .

[0067] In the embodiment of the present application, when the fused data satisfies the Gaussian distribution N(μ,σ 2 ), where μ is the expected value and σ2 is the variance; and it is expected that μ satisfies the preset first condition and the variance σ 2 When the preset second condition is met, the working state S of the field device in the current cycle can be obtained by the method described in S12. i .

[0068] As an example, the first condition may be that the expectation of the fused data satisfies a first preset threshold, and the second condition may be that the variance of the fused data satisfies a second preset threshold. Of course, the first preset threshold and the second preset threshold may be the same or different, and this application does not specifically limit this.

[0069] See also Figure 4 In another embodiment of the present application, after obtaining the fused data, the method further includes:

[0070] S43, when the fused data obeys Gaussian distribution, if the expectation of the fused data does not satisfy the first condition or the variance of the fused data does not satisfy the second condition, an alarm prompt message is issued, and the alarm prompt message is used to request manual intervention.

[0071] In the embodiment of the present application, when the fused data follows the Gaussian distribution N(μ,σ 2 ), where μ is the expected value and σ 2 is the variance; if the expected μ does not meet the first preset condition (for example, the expected μ does not meet the first preset threshold) or the variance σ 2 When the preset second condition is not met (for example, the variance σ 2 does not meet the second preset threshold), indicating that there is an obvious contradiction in the fusion data. At this time, an alarm prompt information can be pushed to the monitoring background. The alarm prompt information can be an alarm prompt sound, or an early warning text message, or an alarm prompt sound and an early warning text message can be sent at the same time. This application does not make any special restrictions on this.

[0072] As an example, when the following situations occur, it can be determined that the fused data has obvious contradictions:

[0073] When the field data collected by the LiDAR sensor determines that there is an obstacle ahead (due to dust interference), and the field data collected by the visual sensor determines that the field ahead is safe. For example, when the displacement given by the GPS positioning information is obviously smaller than the distance given by the speed sensor on the field equipment (due to ground sliding), it can be determined that the fused data has an obvious contradiction, that is, the current scene of the industrial site is relatively complex.

[0074] See also Figure 5 In another embodiment of the present application, after obtaining the fused data, the method further includes:

[0075] S53: When the fused data does not obey the Gaussian distribution, an alarm prompt message is issued, and the alarm prompt message is used to request manual intervention.

[0076] In the embodiment of the present application, when the fused data does not obey the Gaussian distribution, it can be determined that the environment of the industrial site is complex at the current moment. At this time, an alarm prompt information can be pushed to the background monitoring personnel to request manual intervention.

[0077] As an example, when the fused data does not obey the Gaussian distribution, although the fused data also has its own expectation and variance, the expectation at this time cannot meet the first condition, and the variance cannot meet the second condition. In this way, it can be determined that the current environment of the industrial site is complex, and an alarm prompt message is directly issued to request manual intervention.

[0078] See also Figure 6 In another embodiment of the present application, after obtaining the security level a of the field device in the current cycle i After that, it also includes:

[0079] S64, according to the security level of the current cycle a i The safety level of the historical period is obtained by the safety prediction level ω i .

[0080] In another embodiment of the present application, according to the security level a of the current cycle i The safety level of the historical period is obtained by the safety prediction level ω i ,include:

[0081] Set the security level of the current cycle to a i Add the safety level of the last N cycles in history to get the safety prediction level ω i .

[0082] As an example, see Figure 3 , assuming that the security level of the current cycle is a4, and the security levels of the last N cycles in history are a3 and a2. Then a4, a3 and a2 are directly accumulated to obtain the security prediction level ω of the current cycle i .

[0083] Set the security level of the current cycle to a i The weighted sum of the safety levels of the last N cycles in history is used to obtain the safety prediction level ω i .

[0084] As an example, take Figure 3 , assuming that the security level of the current cycle is a4, and the security levels of the last N cycles in history are a3 and a2. Figure 7 , assuming Figure 7The functional relationship is A=f(t), the weighted coefficient of security level a4 is A1=f(0), the weighted coefficient of security level a3 is A2=f(t4-t3), the weighted coefficient of security level a3 is A3=f(t4-t3), and the weighted coefficient of security level a2 is A2=f(t4-t2).

[0085] according to Figure 7 It can be seen that the function is in a decreasing pattern, so A4>A3>A2. The safety level a4 and the corresponding weighted value A4, the safety level a3 and the corresponding weighted value A3, the safety level a2 and the corresponding weighted value A2 are cumulatively calculated as follows to obtain the safety prediction level ω4:

[0086] ω4=a4*A4+a3*A3+a2*A2

[0087] Set the security level of the current cycle to a i The weighted sum of the safety levels of all historical periods is used to obtain the safety prediction level ω i .

[0088] As an example, take Figure 3 , assuming that the security level of the current period is a4, then the security levels of all historical periods are a3, a2 and a1.

[0089] Similarly, see Figure 7 , assuming Figure 7 The functional relationship is A=f(t), the weighted coefficient of security level a4 is A1=f(0), the weighted coefficient of security level a3 is A2=f(t4-t3), the weighted coefficient of security level a3 is A3=f(t4-t3), the weighted coefficient of security level a2 is A2=f(t4-t2), and the weighted coefficient of security level a1 is A1=f(t4-t1).

[0090] because Figure 7 The function is in a decreasing pattern, so A4>A3>A2>A1. The safety level a4 and the corresponding weighted value A4, the safety level a3 and the corresponding weighted value A3, the safety level a2 and the corresponding weighted value A2, the safety level a1 and the corresponding weighted value A1 are cumulatively calculated as follows to obtain the safety prediction level ω4:

[0091] ω4=a4*A4+a3*A3+a2*A2+a1*A1

[0092] Of course, when there are many field devices at the industrial site, the safety level of all field devices in the current cycle and the safety level of all historical cycles can be weighted and summed to obtain the safety level of the industrial site. The specific formula is as follows:

[0093]

[0094] Where L is the sum of all field devices in the industrial field, a n=1,j=3 represents the safety level of the first car at time 3. Obviously, a n=1,j=3 It will also decay over time.

[0095] S65, in the safety prediction level ω i When the alarm condition is met, an alarm prompt message is issued, and the alarm prompt message is used to request manual intervention.

[0096] As an example, assume that the alarm condition is that the safety prediction level is greater than or equal to 8, then an alarm prompt message is issued. i When the alarm condition is met, an alarm prompt message is issued to request manual intervention. In another embodiment of the present application, the i-th historical cycle in the historical cycle is earlier than the j-th historical cycle, and the weight of the security level of the i-th historical cycle is less than the weight of the security level of the j-th historical cycle.

[0097] For description of the embodiments of the present application, please refer to Figure 7 The description of the related embodiments will not be repeated here.

[0098] See also Figure 8 As shown, Figure 8 : is a schematic diagram of the structure of a security monitoring device provided in an embodiment of the present application. The security monitoring device 8 is applied to a terminal. The security monitoring device 8 of this embodiment includes:

[0099] The first acquisition module 810 is used to obtain the at least two sensors at t i Field data collected at all times, at least two sensors are installed on the field equipment;

[0100] The second acquisition module 820 is used to obtain the value of the at least two sensors at t i The field data collected at all times and the working status of the field equipment in the historical cycle are used to obtain the working status S of the field equipment in the current cycle. i , the current cycle is t i Time to t i+1 The period corresponding to the moment;

[0101] The third acquisition module 830 is used to obtain the current working state S of the field device according to the working state S of the field device in the current cycle. i , get the safety level a of the field equipment in the current cycle i .

[0102] In another embodiment of the present application, the security monitoring device further includes:

[0103] The fourth acquisition module is used to obtain at least two sensors at t i The field data collected at all times are fused to obtain fused data.

[0104] Accordingly, the second acquisition module 820 is further used for: when the fused data obeys Gaussian distribution, the expectation of the fused data satisfies the first condition, and the variance of the fused data satisfies the second condition, according to the at least two sensors at t i The field data collected at all times and the working status of the field equipment in the historical cycle are used to obtain the working status S of the field equipment in the current cycle. i .

[0105] In another embodiment of the present application, the security monitoring device further includes:

[0106] A first alarm module is used to issue an alarm prompt message when the expectation of the fused data does not meet the first condition or the variance of the fused data does not meet the second condition when the fused data obeys the Gaussian distribution, and the alarm prompt message is used to request manual intervention;

[0107] When the fused data does not obey the Gaussian distribution, an alarm prompt message is issued, and the alarm prompt message is used to request manual intervention.

[0108] In another embodiment of the present application, the security monitoring device further includes:

[0109] The fifth acquisition module is used to obtain the security level a of the current cycle. i The safety level of the historical period is obtained by the safety prediction level ω i ;

[0110] The second alarm module is used to i When the alarm condition is met, an alarm prompt message is issued, and the alarm prompt message is used to request manual intervention.

[0111] In another embodiment of the present application, the fifth acquisition module is further used for:

[0112] Set the security level of the current cycle to a i Add the safety level of the last N cycles in history to get the safety prediction level ω i ;

[0113] Set the security level of the current cycle to a i The weighted sum of the safety levels of the last N cycles in history is used to obtain the safety prediction level ω i ;

[0114] Set the security level of the current cycle to a i The weighted sum of the safety levels of all historical periods is used to obtain the safety prediction level ω i .

[0115] Optionally, the ith historical period in the historical period is earlier than the jth historical period, and the weight of the security level of the ith historical period is less than the weight of the security level of the jth historical period.

[0116] Optionally, the sensors on the field equipment include at least two of the following: a visual sensor and a lidar sensor.

[0117] It should be noted that the execution process and information interaction between the above-mentioned devices / units are based on the same concept as the security monitoring method provided in the embodiment of the present application. For its specific functions and the technical effects brought about, please refer to the method embodiment part, and will not be repeated here.

[0118] See also Fig. 9 As shown, Fig. 9 : is a schematic diagram of the structure of a terminal provided in an embodiment of the present application. The terminal 9 of this embodiment includes:

[0119] One or more processors 910, a memory 920, and a computer program 930 stored in the memory 920 and executable on the processor 910. When the processor 910 executes the computer program 939, the steps in the above-mentioned various method embodiments are implemented, for example Figure 1 Steps S11 to S13 are shown.

[0120] Exemplarily, the computer program 930 may be divided into one or more units, and the one or more units are stored in the memory 920 and executed by the processor 910 to complete the application. The one or more units may be a series of computer program instruction segments that can complete specific functions, and the instruction segments are used to describe the execution process of the computer program 930 in the terminal 9. For example, the computer program 930 may be divided into the following modules, which are exemplary:

[0121] The first acquisition module 810 is used to obtain the at least two sensors at t i Field data collected at all times, at least two sensors are installed on the field equipment;

[0122] The second acquisition module 820 is used to obtain the value of the at least two sensors at t i The field data collected at all times and the working status of the field equipment in the historical cycle are used to obtain the working status S of the field equipment in the current cycle. i , the current cycle is t i Time to t i+1 The period corresponding to the moment;

[0123] The third acquisition module 830 is used to obtain the current working state S of the field device according to the working state S of the field device in the current cycle.i , get the safety level a of the field equipment in the current cycle i .

[0124] The terminal includes but is not limited to a processor 910 and a memory 920. Those skilled in the art will appreciate that Fig. 9 It is only an example of terminal 9 and does not constitute a limitation on terminal 9. It may include more or fewer components than shown in the figure, or a combination of certain components, or different components. For example, the terminal 9 may also include an input device, an output device, a network access device, a bus, etc.

[0125] The processor 910 may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or any conventional processor, etc.

[0126] The memory 920 may be an internal storage unit of the terminal 9, such as a hard disk or memory of the terminal 9. The memory 920 may also be an external storage device of the terminal 9, such as a plug-in hard disk, a smart media card (SMC), a secure digital (SD) card, a flash card, etc. equipped on the terminal 9. Further, the memory 920 may also include both an internal storage unit of the terminal 9 and an external storage device. The memory 920 is used to store the computer program and other programs and data required by the terminal 9. The memory 920 may also be used to temporarily store data that has been output or is to be output.

[0127] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described or recorded in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0128] Another embodiment of the present application provides a computer-readable storage medium. If the security monitoring method provided in the embodiment of the present application is implemented in the form of a software function module and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the present application implements all or part of the processes in the above-mentioned embodiment method, and can also be completed by instructing the relevant hardware through a computer program. The computer program can be stored in a computer-readable storage medium, and when the computer program is executed by one or more processors, the steps of each of the above-mentioned method embodiments can be implemented.

[0129] Similarly, as a computer program product, when the computer program product runs on a terminal, the terminal can implement the steps in the above-mentioned various method embodiments when executing the computer program product.

[0130] The computer program includes computer program code, which may be in source code form, object code form, executable file or some intermediate form, etc. The computer readable medium may include: any entity or device capable of carrying the computer program code, recording medium, USB flash drive, mobile hard disk, magnetic disk, optical disk, computer memory, read-only memory (ROM), random access memory (RAM), electric carrier signal, telecommunication signal and software distribution medium, etc. It should be noted that the content contained in the computer readable medium may be appropriately increased or decreased according to the requirements of legislation and patent practice in the jurisdiction. For example, in some jurisdictions, according to legislation and patent practice, computer readable media do not include electric carrier signals and telecommunication signals.

[0131] The embodiments described above are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, a person skilled in the art should understand that the technical solutions described in the aforementioned embodiments may still be modified, or some of the technical features may be replaced by equivalents. Such modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application, and should all be included in the protection scope of the present application.

Claims

1. A security monitoring method, characterized in that: include: Get at least two sensors at t i Field data collected at all times, wherein the at least two sensors are installed on the field equipment, and i is a natural number greater than or equal to 1; According to the at least two sensors at t i The field data collected at all times and the working status of the field equipment in the historical cycle are used to obtain the working status S of the field equipment in the current cycle. i , the current period is t i Time to t i+1 The period corresponding to the moment; According to the working state S of the field device in the current cycle i , get the safety level a of the field device in the current cycle i ; In the step of obtaining at least two sensors at t i After collecting the field data at all times, the method further comprises: The at least two sensors are placed at t i The field data collected at all times are integrated to obtain fused data; Accordingly, the at least two sensors are i The field data collected at all times and the working status of the field equipment in the historical cycle are used to obtain the working status S of the field equipment in the current cycle. i ,include: When the fused data obeys Gaussian distribution, the expectation of the fused data satisfies the first condition, and the variance of the fused data satisfies the second condition, the working state S of the field device in the current cycle is obtained according to the fused data and the working state of the field device in the historical cycle. i .

2. The method according to claim 1, characterized in that After obtaining the fused data, the method further includes: In the case where the fused data obeys a Gaussian distribution, if the expectation of the fused data does not satisfy the first condition or the variance of the fused data does not satisfy the second condition, an alarm prompt message is issued, wherein the alarm prompt message is used to request manual intervention; In the case that the fused data does not obey the Gaussian distribution, an alarm prompt message is issued, and the alarm prompt message is used to request manual intervention.

3. The method according to claim 1, characterized in that In the step of obtaining the security level a of the field device in the current cycle i Afterwards, the method further comprises: According to the safety level of the current cycle a i The safety level of the historical period is obtained by the safety prediction level ω i ; At the safety prediction level ω i After the alarm condition is met, an alarm prompt message is issued, and the alarm prompt message is used to request manual intervention.

4. The method according to claim 3, characterized in that The security level a according to the current cycle i The safety level of the historical period is obtained by the safety prediction level ω i ,include: Set the security level of the current cycle to a i Add the safety level of the last N cycles in history to get the safety prediction level ω i ; Set the security level of the current cycle to a i The weighted sum of the safety levels of the last N cycles in history is used to obtain the safety prediction level ω i ; Set the security level of the current cycle to a i The weighted sum of the safety levels of all historical periods is used to obtain the safety prediction level ω i .

5. The method according to claim 4, characterized in that The i-th historical cycle in the historical cycles is earlier than the j-th historical cycle, and the weight of the security level of the i-th historical cycle is less than the weight of the security level of the j-th historical cycle.

6. The method according to claim 1, characterized in that The sensors include at least two of the following: a visual sensor, a lidar sensor, a positioning sensor and a state observer.

7. A security monitoring device, characterized in that: include: The first acquisition module is used to obtain at least two sensors at t i Field data collected at all times, wherein the at least two sensors are installed on the field equipment; The second acquisition module is used to obtain the i The field data collected at all times and the working status of the field equipment in the historical cycle are used to obtain the working status S of the field equipment in the current cycle. i , the current period is t i Time to t i+1 The period corresponding to the moment; The third acquisition module is used to obtain the working state S of the field device in the current cycle according to the working state S of the field device in the current cycle. i , get the safety level a of the field device in the current cycle i ; The fourth acquisition module is used to obtain the at least two sensors at t i The field data collected at all times are integrated to obtain fused data; Correspondingly, the second acquisition module is further used to: obtain the working state S of the field device in the current cycle according to the fused data and the working state of the field device in the historical cycle, when the fused data obeys the Gaussian distribution, the expectation of the fused data satisfies the first condition, and the variance of the fused data satisfies the second condition. i .

8. A terminal, characterized in that: The method comprises a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of the security monitoring method according to any one of claims 1 to 6 when executing the computer program.

9. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the steps of the security monitoring method according to any one of claims 1 to 6 are implemented.