Active management and control method and device for high-risk operation

Abstract

The invention discloses an active management and control method and device for high-risk operation, electronic equipment and a storage medium. The method comprises the following steps: enabling operators related to high-risk operation to carry out operation according to related requirements of construction safeguard measures and risk processing plans in a mode of automatically acquiring videos or images and an active management mode, and carrying out biological feature recognition and identity recognition on the operators so as to ensure that the operators can carry out risk processing according to the related requirements of the construction safeguard measures and the risk processing plans; the system can more intuitively assist enterprise safety management personnel to comprehensively master the safety condition of a working site, form an effective management means, supervise and urge management and execution personnel at all levels to consciously practice three-notice management, namely the management principle of site, notice and reality, and actively go deep into the site, so that the safety management efficiency is improved to the greatest extent, and the safety management efficiency is improved. The safety of a high-risk operation site and the periphery is strictly ensured, the effectiveness of safety management is improved, and a better operation environment is provided for operators.

Description

Technical Field

[0001] The embodiments of the present application relate to monitoring and safety assurance technologies for the working conditions of operators in high-risk operations, and more particularly to an active management and control method and device for high-risk operations. Background Art

[0002] In the current industrial production field, especially in high-risk or high-risk industries such as thermal power plants, petrochemicals, and mining, safety is above all else. All workers entering high-risk work sites need to constrain their own safety behaviors in accordance with the standards and requirements of safe operations. The traditional safety management model mainly relies on visual monitoring, manual records, and manual inspections. Not only are there hidden dangers of human negligence and inaccurate information, but it also often causes safety management to become formalistic, and safety supervision is difficult to implement effectively, resulting in a regulatory situation of "policies from above and countermeasures from below". Safety management is difficult to implement effectively, causing a large number of operational accidents and losses of life and property, which has brought huge challenges to safe production.

[0003] However, in view of the wide range of operations, the complexity of high-risk operations, the relative shortage of dedicated safety managers, and the large number of outsourced personnel, the most advanced and commonly used safety management method is to set up a monitoring center and upload the video footage of the operation site to designated equipment, and the corresponding supervisors will manually monitor the situation at the operation site. This will inevitably lead to poor monitoring. The monitoring footage is only used as retained evidence and cannot detect safety violations in real time and respond to or prevent safety accidents in a timely manner. Therefore, the degree of safety protection for operators is limited and it is difficult to meet the actual needs of safe production.

[0004] Safety issues are particularly prominent in confined spaces. Over the years, coal mine accidents, the disappearance of maintenance personnel due to improper operations, and personal injury caused by excessive gases in confined spaces have occurred repeatedly, all of which have put forward severe tests for the existing safety supervision system. Unfortunately, there is currently no automatic safety control technology for high-risk work sites for reference. There is an urgent need for relevant technologies that can strictly control the safety control process and actively conduct safety control. Summary of the invention

[0005] In view of this, the embodiments of the present application provide an active management and control method and device, electronic device, and storage medium for high-risk operations, which actively obtains diversified management information of high-risk operation sites through integrated innovative technologies, covering but not limited to the behavior of operators, the implementation status of safety measures, the management status of on-the-job personnel, and the degree of implementation of technical measures.

[0006] According to a first aspect of an embodiment of the present application, there is provided a method for active management and control of high-risk operations, comprising:

[0007] Based on the relevant documents or information of construction safeguard measures and risk treatment plans such as work permits, risk assessments, work tickets, work ticket attachments, risk prevention tickets, organizational measures, technical measures, safety measures, environmental protection measures, construction plans, emergency plans, etc. related to high-risk operations, generate the operation safety measures for the operation to be performed, parse the operation safety measures, and at least obtain various safety safeguard clauses related to the safety safeguard of the operation to be performed;

[0008] Segmenting the sentences in the security clause to obtain basic word components constituting the sentences; parsing the meaning of the sentence based on the basic word components, obtaining multiple sentences before the sentence, analyzing the contextual meanings between the multiple sentences and the sentence, and supplementing the meaning of the sentence;

[0009] Based on the results of the sentence analysis, determine the number of operators and the number of operators at the work site to be operated, the responsible and / or supervisory personnel among the relevant responsible persons and their safety responsibilities; determine the identities of the operators and collect their biometric information, and store the collected biometric information;

[0010] Collect image information of the area where the work site is located, input the image information into a safe work image library, obtain a matching image that matches the image information, search for a first work safety specification corresponding to the matching image, and output the first work safety specification;

[0011] generating a second operation specification based on the safety assurance clause and the first operation safety specification, and performing statement analysis on the second operation specification to obtain an analysis result;

[0012] In response to the arrival of the operation time, the video image of the monitoring area is collected, the biometric information of the personnel in the video image is collected, the collected biometric information of the personnel is compared with the stored biometric information, and the identity information of the personnel is determined; and the collected video image and the identity recognition result are transmitted to the background server;

[0013] Based on the identity information, the responsible and / or supervisory personnel among the relevant responsible persons are confirmed to be on duty at the supervision site, and the operation task can be started; otherwise, the locking function of the locking mechanism at the entrance of the operation site is ensured to prevent the operating personnel from entering the operation site;

[0014] Receive the signature of each operator at the monitoring site, store the signature information, and transmit the signature information to the backend server;

[0015] When it is confirmed that the responsible and / or supervisory personnel among the relevant responsible persons are on duty, continue to collect video images collected in the supervisory area, identify the safety education behavior before the operation, determine whether the safety education behavior complies with the safety pre-control rules specified in the second operation specification, and receive the signature information of the person in charge and the operator. When the signature information matches the pre-collected signature, confirm that entry to the operation site is allowed;

[0016] Release the locking function of the locking mechanism at the entrance of the work site, collect the facial image of each worker at the entrance of the work site, count the identity information of the workers entering and the number of workers entering, identify and count the work tools carried by the workers, and generate work records for the workers; if it is determined that the identity of the worker does not match, or the entry time is a period when entry is not allowed, or the number of workers exceeds the number of workers specified in the second work specification, or the type of work tools does not meet the work requirements, output an alarm message to the background server and the monitoring equipment in the monitoring area, and notify the guardian to stop working at the work site;

[0017] In response to the arrival of the detection cycle, the operation behavior of the operator is identified based on the video image of the operation site, and whether the operation behavior conforms to the operation behavior specified in the second operation specification is determined, and the operation behavior of the operator at the operation site is determined to be non-permitted, the operator is located in a prohibited activity area, or the current number of the operator is abnormal, and an alarm message is transmitted to the background server and the monitoring device in the monitoring area, and the guardian is notified to stop working at the operation site;

[0018] In response to the end of the work time, the facial image of each worker coming out of the entrance of the work site is collected, the identity information and number of the workers coming out are counted, and the work tools carried by the workers are identified and counted to ensure that each worker and work tool are evacuated from the work site; when the statistics are abnormal, an alarm message is transmitted to the background server and the monitoring equipment in the monitoring area;

[0019] Receive the signature of each operator coming out of the entrance of the work site at the monitoring site, match the collected signature information with the signature information before the work is started, and transmit the current signature information to the background server to activate the locking function of the locking mechanism at the entrance of the work site;

[0020] Based on the video images of the monitoring site, it is identified whether the monitoring area needs to be cleared. After confirming the clearance, it is identified whether warning signs are placed in the set area, and the identification results of the clearance and warning signs are transmitted to the background server. If the area is not cleared or the warning signs are not placed, the background server will transmit an alarm message.

[0021] In some exemplary embodiments, the method further comprises:

[0022] When the detection device detects a change in the number of workers at the work site during the operation, it outputs an alarm message to the designated background server and the monitoring device in the monitoring area; and re-identifies the identities of the workers in the video image of the work site to determine whether the identities of the workers match the stored identities of the workers. When there are non-matching workers, the images of the non-matching workers are extracted and transmitted to the background server and the monitoring device in the monitoring area.

[0023] In some exemplary embodiments, the method further comprises:

[0024] In response to detecting that the designated on-duty manager appears in the monitoring area or the work site, the biometric information of the on-duty manager is collected. After matching, all the inspection items to be inspected are output to the on-duty manager through the monitoring equipment in the monitoring area, and the verification input of the security inspection result of the on-duty manager is received, and it is detected whether the input result meets the security inspection conditions. If it meets the conditions, it prompts that the security inspection has passed. Otherwise, an alarm message is output and an alarm message indicating that the security inspection has not been completed is transmitted to the background server;

[0025] The behavior of the on-duty management personnel in the monitoring area or the work site is identified to determine whether the safety supervision behavior of the on-duty management personnel complies with the supervision behavior specified in the second work specification, and the video images of the on-duty management personnel in the monitoring area or the work site are transmitted to the background server.

[0026] In some exemplary embodiments, the method further comprises:

[0027] Receive control command input for alarm or abnormal safety work through the monitoring equipment in the monitoring area, collect biometric information of the person who inputs the command, determine the identity information of the person who inputs the command, determine their operation authority, and execute the command to remove the alarm or abnormal safety work prompt information if they have the operation authority;

[0028] Receive the temporary staffing instructions for on-site operations input by the supervisor, collect the biometric information of the staff, receive the signature information of the staff, and transmit the relevant information of the staff to the background server; manage the staff in accordance with the requirements of the work site.

[0029] In some exemplary embodiments, the method further comprises:

[0030] receiving the operation management instruction of the supervisor on the operation site, and determining whether the operation management instruction complies with the provisions of the second operation specification, and allowing the operation management instruction to be executed if it complies;

[0031] Capture video images of all operations performed by the guardian in the monitoring area, record the guardian's operation log through the monitoring equipment, and transmit the guardian's video images and operation log to the background server;

[0032] And through the video images collected by the monitoring equipment, determine whether there are warning signs in the set area of ​​the work site or the passage leading to the work site. When the work warning sign is not detected, transmit the warning sign setting non-compliance alarm to the background server.

[0033] In some exemplary embodiments, the method further comprises:

[0034] Collect environmental information of the work site, the environmental information including at least gas composition information, lighting information, temperature information, humidity information, and electricity consumption information, and determine whether the working conditions are met based on the collected environmental information. If the working conditions are not met, send an alarm message to the background server, and close the entrance channel to the work site through control instructions, lock the locking mechanism at the entrance of the work site, and prevent any person from entering the work site; until the detection results meet the working conditions, after obtaining authorization instructions, open the entrance channel to the work site, release the locking function of the locking mechanism at the entrance of the work site, and allow entry to the work site.

[0035] In some exemplary embodiments, the method further comprises:

[0036] When it is determined based on the collected environmental information that the working conditions are not met and the work is currently in progress, an alarm message is output through the alarm at the work site to prompt the operator to quickly evacuate the work site, and the alarm message is transmitted to the background server and the monitoring equipment in the monitoring area;

[0037] The identity information and number of workers evacuating from the work site are detected through detection equipment to ensure that all workers evacuate the work site.

[0038] According to a second aspect of an embodiment of the present application, there is provided an active control device for high-risk operations, comprising:

[0039] A parsing unit is used to generate the operation safety measures for the operation to be performed based on the relevant documents or information of the operation permit, risk assessment, work ticket, work ticket attachment, risk prevention ticket, organizational measures, technical measures, safety measures, environmental protection measures, construction plan, emergency plan and other construction protection measures and risk treatment plans related to the high-risk operation, and parse the operation safety measures to at least obtain various safety protection clauses related to the safety protection of the operation to be performed;

[0040] An analysis unit is used to segment the sentences in the security clause to obtain basic word components constituting the sentences; based on the basic word components, the meaning of the sentence is analyzed, and multiple sentences before the sentence are obtained, the contextual meanings between the multiple sentences and the sentence are analyzed, and the meaning of the sentence is supplemented;

[0041] The first determination unit is used to determine the number of operators and related personnel at the operation site to be operated, the responsible and / or supervisory related personnel among the relevant responsible persons and their safety responsibilities based on the statement analysis results; determine the identity of the operation-related personnel and collect their biometric information, and store the collected biometric information;

[0042] An image processing unit, used to collect image information of the area where the work site is located, input the image information into a safe work image library, obtain a matching image that matches the image information, search for a first work safety specification corresponding to the matching image, and output the first work safety specification;

[0043] A generating unit, configured to generate a second operation specification based on the safety assurance clause and the first operation safety specification, and perform statement analysis on the second operation specification to obtain an analysis result;

[0044] The identity recognition unit is used to collect video images of the monitoring area in response to the arrival of the operation time, collect biometric information of the personnel in the video image, compare the collected biometric information of the personnel with the stored biometric information, and determine the identity information of the personnel; and transmit the collected video images and identity recognition results to the background server;

[0045] The second determination unit is used to determine, based on the identity information, whether the responsible and / or guardian-related personnel among the relevant responsible persons are on duty at the guardianship site, and determine whether the operation task can be started; otherwise, ensure the locking function of the locking mechanism at the entrance of the operation site to prevent the operating personnel from entering the operation site;

[0046] The first signature processing unit is used to receive the signature of each operator at the monitoring site, store the signature information, and transmit the signature information to the background server;

[0047] A behavior recognition unit is used to determine that the responsible and / or supervisory personnel among the relevant responsible persons are on duty, continue to collect video images collected in the monitoring area, identify the safety education behavior before the operation, determine whether the safety education behavior complies with the safety pre-control rules specified in the second operation specification, and receive the signature information of the person in charge and the operator, and confirm that entry to the operation site is allowed when the signature information matches the pre-collected signature;

[0048] An entrance monitoring unit is used to release the locking function of the locking mechanism at the entrance of the work site, collect facial images of each worker at the entrance of the work site, count the identity information of the workers entering and the number of workers entering, identify and count the work tools carried by the workers, and generate work records for the workers; if it is determined that the identity of the worker does not match, or the entry time is a period not allowed to enter, or the number of workers exceeds the number of workers specified in the second work specification, or the type of work tools does not meet the work requirements, an alarm message is output to the background server and the monitoring equipment in the monitoring area, and the guardian is notified to stop working at the work site;

[0049] A field monitoring unit is used to identify the work behavior of the operator based on the video image of the work site in response to the arrival of the detection cycle, and determine whether the work behavior complies with the work behavior specified in the second work specification, determine whether the work behavior of the operator at the work site has non-permitted work behavior, the operator is located in a prohibited activity area, or the current number of operators is abnormal, transmit an alarm message to the background server and the monitoring device in the monitoring area, and notify the guardian to stop working at the work site;

[0050] The end-of-work monitoring unit is used to respond to the end of the work time, collect the facial images of each worker coming out of the entrance of the work site, count the identity information and number of the workers coming out, identify and count the work tools carried by the workers, and ensure that each worker and work tool evacuates from the work site; when the statistics are abnormal, send an alarm message to the background server and the monitoring equipment in the monitoring area;

[0051] The second signature processing unit is used to receive the signature of each operator coming out of the entrance of the work site at the monitoring site, match the collected signature information with the signature information before the work is started, and transmit the current signature information to the background server to start the locking function of the locking mechanism at the entrance of the work site;

[0052] The operation completion identification unit is used to identify whether the monitored area is cleared based on the video image of the monitored scene. After confirming the clearance, it identifies whether a warning sign is placed in the set area, and transmits the identification results of the clearance process and the identification results of the warning sign to the background server. When the area is not cleared or the warning sign is not placed, the background server transmits an alarm message.

[0053] In some exemplary embodiments, the on-site monitoring unit is further used to:

[0054] When the detection device detects a change in the number of workers at the work site during the operation, it outputs an alarm message to the designated background server and the monitoring device in the monitoring area; and re-identifies the identities of the workers in the video image of the work site to determine whether the identities of the workers match the stored identities of the workers. When there are non-matching workers, the images of the non-matching workers are extracted and transmitted to the background server and the monitoring device in the monitoring area.

[0055] In some exemplary embodiments, the apparatus further comprises:

[0056] The on-the-job monitoring unit is used to respond to the detection of the designated on-the-job management personnel appearing in the monitoring area or the work site, collect the biometric information of the on-the-job management personnel, and after matching, output all the inspection items to be inspected to the on-the-job management personnel through the monitoring equipment in the monitoring area, and receive the verification input of the security inspection results of the on-the-job management personnel, and detect whether the input results meet the security inspection conditions. If they meet the conditions, it prompts that the security inspection has passed, otherwise it outputs an alarm message and transmits an alarm message that the security inspection has not been completed to the background server;

[0057] The behavior of the on-duty management personnel in the monitoring area or the work site is identified to determine whether the safety supervision behavior of the on-duty management personnel complies with the supervision behavior specified in the second work specification, and the video images of the on-duty management personnel in the monitoring area or the work site are transmitted to the background server.

[0058] According to a third aspect of an embodiment of the present application, a computer-readable storage medium is provided, wherein a computer program is stored in the computer-readable storage medium, and when the computer program is executed by a processor, the steps of the active management and control method of high-risk operations are implemented.

[0059] According to a fourth aspect of an embodiment of the present application, there is provided an electronic device, including:

[0060] at least one processor; and

[0061] a memory communicatively connected to the at least one processor; wherein,

[0062] The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the steps of the active management and control method for high-risk operations.

[0063] Compared with traditional safety management methods, the technical solution of the embodiment of the present application, through the automatic collection of videos or images and the active management mode, requires operators involved in high-risk operations to perform their operations in accordance with the relevant requirements of construction safeguards and risk management plans. Through the biometric and identity recognition of the operators, it can more intuitively assist the enterprise safety management personnel to fully control the safety status of the work site, form an effective management method, and urge management and execution personnel at all levels to consciously practice the "three current management", namely the management principle of on-site, actual objects, and reality, take the initiative to go deep into the site, maximize the safety management efficiency, strictly ensure the safety of high-risk work sites and peripheries, improve the effectiveness of safety management, and provide operators with a better working environment. BRIEF DESCRIPTION OF THE DRAWINGS

[0064] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the following is a brief introduction to the drawings required for use in the embodiments or the prior art descriptions. Obviously, the drawings described below are some embodiments of the present invention, and for ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0065] Figure 1 A schematic diagram showing a process flow of an active control method for high-risk operations according to an embodiment of the present application;

[0066] Figure 2 A schematic diagram of the structure of an active control device for high-risk operations according to an embodiment of the present application;

[0067] Figure 3 A schematic diagram of the structure of an electronic device according to an embodiment of the present application. DETAILED DESCRIPTION

[0068] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. Instead, they are merely examples of devices and methods consistent with some aspects of the present disclosure as detailed in the appended claims.

[0069] The essence of the technical solution of the embodiment of the present application is explained in detail below with reference to the accompanying drawings.

[0070] Figure 1 A flow chart of the active control method for high-risk operations in an embodiment of the present application is shown, such as Figure 1 As shown, the active management and control method for high-risk operations in the embodiment of the present application includes the following steps:

[0071] Step 101, based on the relevant documents or information of work permits, risk assessments, work tickets, work ticket attachments, risk prevention tickets, organizational measures, technical measures, safety measures, environmental protection measures, construction plans, construction protection measures of emergency plans and risk management plans related to high-risk operations, generate operation safety measures for the operations to be performed, parse the operation safety measures, and at least obtain various safety protection clauses related to the safety protection of the operations to be performed.

[0072] In the embodiment of the present application, the specific content of the high-risk operation is first obtained, and the high-risk operation includes but is not limited to high-altitude operations such as field high-voltage line maintenance, construction, etc., closed spaces such as large tanker internal maintenance, maintenance, paint spraying, etc., cooling tower reinforcement, repair, cleaning and maintenance in power plants, construction operations at high-rise construction sites, tower crane operations, etc. According to the content of the specific high-risk operation, the embodiment of the present application determines the work ticket, risk pre-control ticket, construction security measures and risk treatment plan files or information related to the content of the high-risk operation, generates the operation safety measures to be operated, analyzes the operation safety measures, and obtains various safety protection clauses related to the safety protection of the operation to be operated. As an example, different types of high-risk operations can be associated with all relevant documents related to their related operation safety requirements. After determining the specific content of the high-risk operation, the work ticket, risk pre-control ticket, construction security measures and risk treatment plan files or information associated with the high-risk operation can be obtained, thereby obtaining various safety protection clauses related to the safety protection of the operation to be operated. In the disclosed embodiment, by performing keyword recognition and automatic text parsing on relevant documents or information such as work permits, risk assessments, work tickets, work ticket attachments, risk prevention tickets, organizational measures, technical measures, safety measures, environmental protection measures, construction plans, construction support measures of emergency plans, and risk management plans, the operation safety measures for the work to be performed are generated. The safety measures here can be the regulations and clauses in the aforementioned documents or information, or can be the improved clauses or derived clauses of the regulations and clauses obtained based on the analysis of the documents or information. These rules and clauses or improved clauses or derived clauses are used as the operation safety measures for the work to be performed.

[0073] Step 102, segment the sentences in the security clause to obtain basic word components that make up the sentences; based on the basic word components, parse the meaning of the sentence, obtain multiple sentences before the sentence, analyze the contextual meanings between the multiple sentences and the sentence, and supplement the meaning of the sentence.

[0074] Analyze the security guarantee clause to obtain its specific meaning, so as to understand the security guarantee clause and better manage the related high-risk operations based on the understanding of the security guarantee clause. As an example, use the semantic recognition technology of Natural Language Processing (NLP) to analyze the security guarantee clause. During the process of using NLP to process the text content, it is necessary to determine the text structure of various security guarantee clauses, analyze the sentence aggregation method based on the text structure, consider various grammars of the text, and refer to the expressions to analyze the semantic expression of the text. Specifically, perform text cleaning on various security guarantee clauses. First, remove special characters, useless spaces, sentence break symbols, numbers, and punctuation marks in the text. For example, remove special characters and punctuation marks such as *, ◎, #, ①, ③, $, etc. Remove stop words such as "of", "is", "in", etc. Although these stop words appear frequently in the text, they are not substantially helpful for text analysis. The stop words can be removed with the help of a stop word list. Delete duplicate data.

[0075] Perform word segmentation on the cleaned text. The methods of word segmentation include but are not limited to segmenting into subwords based on Byte-Level BPE (Byte-Level BPE). This Byte-Level BPE can perform word segmentation at the byte level, capture all possible byte sequences, and ensure that the text to be analyzed can be encoded. The method of segmenting into subwords allows tokens not in the vocabulary to be further broken down into smaller subwords until these subwords can be matched in the preset vocabulary. When it is found that some common tokens are not covered, the vocabulary can be increased by re-running the BPE algorithm in the training data to add these tokens to the vocabulary. The BPE algorithm starts from bytes, constructs all possible byte pairs and gradually merges them into longer subwords, which can theoretically cover almost all possible text sequences, thus improving the accuracy of text analysis and making the text analysis results more objective.

[0076] Based on the word segmentation results and combined with the content of the long text, extract the keywords of the sentences, analyze the extracted keywords, and determine the key information reflecting the text.

[0077] The text is clustered, and clustering is a processing technique for obtaining hidden data structures in unlabeled texts. The embodiment of the present application adopts K-means clustering and hierarchical clustering. Among them, K-means clustering is to divide the text to be analyzed into K groups, randomly select K geometric centers (centroid), calculate the distance of each data point to these geometric centers, assign all points to the center closest to it, and then recalculate the geometric center of each cluster, and then redistribute all points, repeat the operation until the K-means clustering algorithm obtains a final estimate for the position of the geometric center, and records which geometric center each observation is assigned to. Hierarchical clustering treats the text data to be analyzed as independent points through an aglomerative approach, calculates the distance between data points, and then according to a preset merging strategy, first determines the two nearest points in the data set, merges them together and regards them as a new point, repeats this process, obtains a dendrogram, and presents the clustering results through a dendrogram. The distances between data points include but are not limited to: Euclidean distance: the straight-line distance between two points; correlation similarity: the correlation and similarity between two points; Manhattan distance: the sum of the absolute values ​​of the differences between the axial distances of two points in the standard coordinate system.

[0078] Text classification is performed based on text clustering results. Specifically, feature vectors are extracted from text to convert text data into feature vectors that can be understood by a machine. Text data is classified based on the feature vectors. A supervised learning method is used to predict the classification of unknown text data after classification. Machine learning can include algorithm models such as text classification algorithm based on naive Bayes, text classification based on support vector machine, text classification based on random forest, and text classification based on deep learning. The operating mechanism of these specific algorithm models will not be described in detail here.

[0079] The document topic is determined for the text based on the text topic model (Latent Dirichlet Allocation, LDA), and the document topic contains structures such as words, topics and documents.

[0080] Based on the theme of the text, the relevant meaning of the text is determined, and based on the semantics obtained from the analysis results, various safety assurance clauses related to the safety assurance of the operation to be performed are generated. As an implementation method, various safety assurance clauses related to high-risk operations and data associated with high-risk operations can also be stored in a set database. In this way, after determining the relevant content of the high-risk operation, the high-risk operation that matches the content of the high-risk operation is searched in the historical data, and the various safety assurance clauses associated with the matching high-risk operation are used as the various safety assurance clauses for the current high-risk operation. Alternatively, with reference to the various safety assurance clauses for the matching high-risk operation, the various safety assurance clauses associated with the current high-risk operation are revised and guided.

[0081] Step 103, based on the statement analysis results, determine the number of workers at the work site to be operated, the responsible and / or supervisory personnel among the relevant responsible persons and their safety responsibilities; determine the identities of the work-related personnel and collect their biometric information, and store the collected biometric information.

[0082] In an embodiment of the present application, based on the aforementioned semantic analysis results, the workers and their number, the person in charge, the guardians and their safety responsibilities at the work site to be operated are determined, and the biometric characteristics of the relevant personnel are entered to determine whether the number of workers matches the number of determined workers. If the determined number of workers obviously exceeds the maximum or minimum set threshold, an abnormal number of entered workers is prompted and transmitted to the background server to warn of an abnormal number of workers.

[0083] Step 104, collect image information of the area where the work site is located, input the image information into a safe work image library, obtain a matching image that matches the image information, search for a first work safety specification corresponding to the matching image, and output the first work safety specification.

[0084] In the embodiments of the present application, although general safety assurance clauses are determined based on the specific content of high-risk operations, it should be noted that although the types of high-risk operations are the same and the safety assurance clauses have a certain degree of universality, when it comes to the specific work site, it is necessary to formulate work safety specifications that match the specific conditions of the work site based on the specific content of the different operations. For example, in response to sudden work conditions at the work site, or different climatic environments, weather environments, etc., it is necessary to adjust the work safety specifications at the work site, or it is necessary to formulate corresponding work safety specifications for specific situations based on the specific conditions of the work site.

[0085] In the embodiment of the present application, it is necessary to install an image acquisition unit such as a camera at the work site to acquire images of key areas of the work site, including at least all work areas, areas where passage or entry is prohibited, etc., and after the set period arrives, perform image recognition on the acquired images to obtain the work feature information therein, input the acquired image information into the safe work image library, obtain a matching image that matches the image information, search for the first work safety specification corresponding to the matching image, and output the first work safety specification. That is, the embodiment of the present application also obtains the work scene that matches the work scene on the site again for the image information of the work site, so as to obtain the first work safety specification under the same or similar work scene as the work safety specification of the current work site, that is, at least the first work safety specification under the same or similar work scene that matches the current work scene on the site is output as a reference for the safety specification.

[0086] In the embodiment of the present application, an image matching algorithm is used to identify the same or similar feature points or feature point areas between multiple images, and the similarity between images is determined by analyzing the similarity and consistency of the corresponding relationship between the specific content, features, structure, relationship, texture and grayscale of the image. The image matching algorithm adopts a matching algorithm based on grayscale matching and features as an additional matching means. Among them, grayscale matching regards the image as a two-dimensional signal, and statistically finds the relevant matching degree between the two-dimensional signals. It mainly uses similarity metrics such as correlation function, covariance function, sum of squares of difference, and sum of absolute values ​​of difference to determine the corresponding relationship and correlation relationship between images. As an example, the embodiment of the present application adopts a normalized grayscale matching method to determine the matching degree between images, and finds the best match by comparing the grayscale matrix of the image window pixel by pixel. Of course, the pixel matching degree between images can also be determined by using an amplitude sorting correlation algorithm, an FFT correlation algorithm, and a hierarchical search sequence judgment algorithm to determine the matching degree between images.

[0087] On the basis of grayscale matching, the embodiment of the present application also performs feature matching on the collected images to further confirm the similarity between the images. The embodiment of the present application extracts feature points of multiple images, or feature lines and feature point areas composed of feature points. The embodiment of the present application adopts the Scale Invariant Feature Transformation (SIFT) local feature detection algorithm to determine the similarity between multiple images. SIFT matches image feature points by obtaining feature points and their descriptors in the image, and has scale invariance, rotation invariance and stability under illumination changes. Therefore, it is suitable for various complex image conditions, including changing the rotation angle, image brightness and shooting angle, etc., to ensure the stability of image feature comparison and determine the accuracy of image similarity confirmation. In the embodiment of the present application, when the difference between the similarity determined by grayscale and the similarity determined by feature points is large, the similarity determined by feature points shall prevail, or a pre-set similarity weight shall be installed to determine the final similarity as the final basis for determining the image similarity.

[0088] Step 105: Generate a second operating specification based on the safety assurance clause and the first operating safety specification, and perform statement analysis on the second operating specification to obtain an analysis result.

[0089] In the embodiment of the present application, based on the aforementioned safety assurance clauses and the first operation safety specification, combined with the specific conditions of the current operation site, the operation safety specification applicable to the current operation site is generated. For example, the aforementioned NLP can be used to parse the safety assurance clauses and the first operation safety specification to determine the operation safety specification applicable to the current operation site, i.e., the second operation safety specification.

[0090] Step 106, in response to the arrival of the operation time, collect video images of the monitored area, collect biometric information of the personnel in the video image, compare the collected biometric information of the personnel with the stored biometric information, and determine the identity information of the personnel; and transmit the collected video images and identity recognition results to the background server.

[0091] In the embodiment of the present application, when the set operation time limit arrives, the monitoring area is imaged by an image acquisition unit arranged in the monitoring area. Personnel object recognition is performed on the acquired image, that is, the relevant information of the operator in the acquired image is identified. Specifically, face recognition in the acquired image can be performed by geometric feature matching. The facial feature is a biological feature of the operator. Specifically, the geometric feature matching method depends on the geometric features of the operator's face, such as the shape, size and position relationship of the eyes, nose and mouth, to identify the operator. By obtaining the facial image of the person to be identified, based on the identified facial image, the distance, angle and ratio between these features are measured, and a feature vector describing the face can be constructed. Then, by comparing the feature vectors of different faces, face recognition is achieved. For the face in the acquired image, the face in the image can be determined by the feature point method of the image. For the acquired facial image, it can be determined based on the image displacement between adjacent frames or multiple frames. After determining the face, facial feature recognition can be performed based on the facial image to determine the identity of the operator. The facial feature information of the operator can be obtained by pre-collection.

[0092] In the embodiment of the present application, the template matching method can also be used to identify the identity of a person based on a face image. The template matching method constructs a standard face template, then compares the face image to be identified with the template, and determines whether it belongs to the same person by calculating the similarity between the two. Alternatively, face recognition can also be performed by machine learning. The machine learning method can automatically learn facial features by training a large amount of face data and build an efficient classification model. In the embodiment of the present application, the machine learning method can adopt the machine learning method of support vector machine (SVM) and artificial neural network (ANN). SVM divides different categories of face data by finding the optimal hyperplane, while ANN learns and identifies facial features by simulating the connection mode of human brain neurons. The machine learning method can handle more complex facial feature changes and improve the accuracy and robustness of recognition.

[0093] The embodiment of the present application collects images of the workers at the monitoring site and identifies the identity information of the workers in the images in real time, thereby determining whether the workers at the monitoring site match the workers determined in advance, thereby determining whether there are illegal workers at the work site. In the embodiment of the present application, the biometric features preferably use facial features. This is mainly because the embodiment of the present application needs to collect a large amount of on-site videos, and facial recognition is easier to identify than features in the image. Without considering pure image collection and recognition, the identity of the workers can also be identified by iris, fingerprints, etc. When there are many people in the video image, the embodiment of the present application also supports a method of focusing on the facial part of each worker to ensure that the identity of each worker is identified.

[0094] Step 107, based on the identity information, determine whether the responsible and / or supervisory-related personnel among the relevant responsible persons are on duty at the supervisory site, and determine whether the work task can be started; otherwise, ensure the locking function of the locking mechanism at the entrance of the work site to prevent the operating personnel from entering the work site.

[0095] In the embodiment of the present application, through the identity information of the collected operators, it is ensured that the identity of each operator is legal and meets the prescribed number of safety management. And identify the responsible and / or guardian-related personnel among the relevant responsible persons in the operators, ensure that the responsible and / or guardian-related personnel are on duty, so as to facilitate the next step of operation. If the responsible and / or guardian-related personnel are not detected, the information of the absent responsible and / or guardian-related personnel is transmitted to the background server, and the current operation is stopped until the responsible and / or guardian-related personnel are re-determined, or until the responsible and / or guardian-related personnel arrive. For high-risk operations, each process is strictly limited and must be operated in strict accordance with the operating specifications. Any behavior and events that do not meet the operating specifications must be recorded as a safety management log, and the next process cannot be opened. The life safety of the operators is strictly guaranteed, and the operators are ensured to operate in strict accordance with supervision.

[0096] Step 108, receiving the signature of each operator at the monitoring site, storing the signature information, and transmitting the signature information to the background server.

[0097] In the embodiment of the present application, the signature of each operator at the monitoring site is received and stored, while ensuring that the identity of each operator is legal and the responsible and / or supervisory personnel are on duty. This is to leave a trace of the identity of the operator on duty and to ensure that each operator leaves the work site after the operation.

[0098] Step 109, when it is determined that the responsible and / or monitoring personnel among the relevant responsible persons are on duty, continue to collect video images collected in the monitoring area, identify the safety education behavior before the operation, determine whether the safety education behavior complies with the safety prevention and control rules specified in the second operation specification, and receive the signature information of the person in charge and the operator. When the signature information matches the pre-collected signature, confirm that entry to the work site is allowed.

[0099] In the embodiment of the present application, while ensuring that the identity of each operator is legal and the responsible and / or supervisory personnel are on duty, it is also necessary to continue to collect video images collected in the supervisory area to identify whether the operators in the video images are conducting safety education before the operation. Here, in order to reduce the difficulty of identifying the behavior of safety education, it is possible to stipulate the position where each operator should stand and the lecture position of the responsible and / or supervisory personnel, including a special presentation method of the lecture materials, such as presenting the lecture materials to the camera, and moving to a specific position for lecture after the presentation, and the operators who listen to the lecture need to sit or stand in the designated area to ensure the recognition of the lecture behavior. During the lecture, not only the lecture video should be collected in real time, but also the audio on the scene should be collected to ensure that the lecture content is consistent with the required lecture content.

[0100] In the embodiment of the present application, the neural network through behavior recognition can obtain the relevant behavioral actions of the operator, so as to determine whether the operator has implemented the set propaganda actions and ensure that the operator has performed the set behavioral actions in accordance with the operating specifications.

[0101] As an example, the recognition of the preaching behavior can be determined by neural network training, and the behavior recognition can be blind recognition. As an example, feature-based behavior recognition methods such as SIFT, SURF, ORB can be used, or deep learning methods such as CNN, R-CNN, FastR-CNN, FasterR-CNN, etc. can be used to identify the preaching behavior of the operators.

[0102] Step 110, release the locking function of the locking mechanism at the entrance of the work site, collect the facial image of each worker at the entrance of the work site, count the identity information of the workers entering and the number of workers entering, identify and count the work tools carried by the workers, and generate work records for the workers; when it is determined that the identity of the worker does not match, or the entry time is a period when entry is not allowed, or the number of workers exceeds the number of workers specified in the second work specification, or the type of work tools does not meet the work requirements, output an alarm message to the background server and the monitoring equipment in the monitoring area, and notify the guardian to stop working at the work site.

[0103] In the embodiment of the present application, after ensuring that the operating personnel have performed the propaganda behavior and determining that the identity and number of the operating personnel meet the operating specifications, the locking function of the locking mechanism at the entrance of the operating site is released. The locking mechanism here can be a telescopic door controlled by a motor, which is located at the entrance of the operating site. Only when the preliminary operation preparations are performed and meet the requirements, the locking mechanism is opened to allow the operating personnel to enter, otherwise no personnel are allowed to enter the operating site. The locking mechanism can also be an electric control lock, which is opened only when the operating personnel fully comply with the aforementioned operating safety specifications, otherwise the electric control lock is in a normally closed state, and no personnel are allowed to enter the operating site.

[0104] Collect the facial image of each worker at the entrance to the work site, count the identity information of the workers entering and the number of workers entering, identify and count the work tools carried by the workers, and generate work records for the workers; when it is determined that the worker's identity does not match, or the entry time is a period when entry is not allowed, or the number of workers exceeds the number of workers specified in the second work specification, or the type of work tools does not meet the work requirements, output an alarm message to the background server and the monitoring equipment in the monitoring area, and notify the guardian to stop working at the work site.

[0105] Step 111, in response to the arrival of the detection cycle, the working behavior of the operator is identified based on the video image of the working site, and it is determined whether the working behavior complies with the working behavior specified in the second working specification, and it is determined that the working behavior of the operator at the working site has non-permitted working behavior, the operator is located in a prohibited activity area, or the current number of operators is abnormal, and an alarm message is transmitted to the background server and the monitoring equipment in the monitoring area, and the guardian is notified to stop working at the working site.

[0106] In the embodiment of the present application, the status of the operators who have entered the work site is also monitored in real time, and it is determined whether the work behavior complies with the work behavior specified in the second work specification, and it is determined whether the work behavior of the operators at the work site has non-permitted work behavior, the operators are located in a prohibited activity area, or the current number of operators is abnormal. As an example, the embodiment of the present application can use feature-based behavior recognition methods such as SIFT, SURF, and ORB, or deep learning methods such as CNN, R-CNN, FastR-CNN, FasterR-CNN, etc. to identify the behavior of operators to ensure that the operator's behavior is specified in the work specification, and no prohibited behavior occurs or prohibited areas are entered.

[0107] Step 112, in response to the end of the working time, collect the facial image of each worker coming out of the entrance of the working site, count the identity information of the workers coming out and the number of people coming out, identify and count the work tools carried by the workers, and ensure that each worker and work tool evacuates from the working site; when the statistics are abnormal, send an alarm message to the background server and the monitoring equipment in the monitoring area.

[0108] In the embodiment of the present application, when the on-site work of the operator is completed or the end time of the work is reached, the operator must evacuate the work site. At this time, it is necessary to take the facial image of each operator coming out of the entrance of the work site, count the identity information of the operator coming out and the number of operators coming out, identify and count the work tools carried by the operator, and ensure that each operator and the work tools are evacuated from the work site. When an abnormality occurs, an alarm message is transmitted to the background server and the monitoring equipment in the monitoring area as soon as possible to ensure that relevant measures are taken as soon as possible to ensure the safe evacuation of all operators.

[0109] Step 113, receiving the signature of each worker coming out of the entrance of the work site at the monitoring site, matching the collected signature information with the signature information before the work starts, and transmitting the current signature information to the background server to activate the locking function of the locking mechanism at the entrance of the work site.

[0110] In the embodiment of the present application, it is also necessary to collect the signatures of each worker who evacuates the work site, so as to compare them with the previously collected signature information, and ensure that each worker who enters the work site is evacuated. The embodiment of the present application ensures that each worker at the work site is evacuated when their identity matches, and ensures the personal safety of the workers, by means of face recognition, number of personnel, and personnel signatures.

[0111] Step 114, based on the video image of the monitoring site, identify whether the monitoring area is cleared. After confirming the clearance, identify whether a warning sign is placed in the set area, and transmit the identification results of the clearance process and the identification results of the warning sign to the background server. If the area is not cleared or the warning sign is not placed, the background server transmits an alarm message.

[0112] In the embodiment of the present application, after ensuring that the workers have evacuated the work site, it is also identified whether the monitored area has been cleared and whether warning signs have been placed in the set area to ensure that the entire work area is clean and in compliance with the work specifications, and that operations and management are carried out in full compliance with the work specifications.

[0113] In the embodiment of the present application, the aforementioned active management and control method for high-risk operations may also include:

[0114] When the detection device detects a change in the number of workers at the work site during the operation, it outputs an alarm message to the designated background server and the monitoring device in the monitoring area; and re-identifies the identities of the workers in the video image of the work site to determine whether the identities of the workers match the stored identities of the workers. When there are non-matching workers, the images of the non-matching workers are extracted and transmitted to the background server and the monitoring device in the monitoring area.

[0115] In an embodiment of the present application, in response to detecting that a designated on-duty manager appears in a monitoring area or a work site, the biometric information of the on-duty manager is collected. After matching, all inspection items to be inspected are output to the on-duty manager through the monitoring equipment in the monitoring area, and the verification input of the security inspection results of the on-duty manager is received to detect whether the input results meet the security inspection conditions. If so, a prompt prompting that the security inspection has passed is given. Otherwise, an alarm message is output and an alarm message indicating that the security inspection has not been completed is transmitted to the background server.

[0116] The behavior of the on-duty management personnel in the monitoring area or the work site is identified to determine whether the safety supervision behavior of the on-duty management personnel complies with the supervision behavior specified in the second work specification, and the video images of the on-duty management personnel in the monitoring area or the work site are transmitted to the background server.

[0117] In the embodiment of the present application, for the on-the-job management personnel, it is necessary to output the work items to be tested to avoid omissions in supervision, and it is also possible to record the additional testing behaviors of the on-the-job management personnel to improve their supervision execution. In addition, it is also necessary to regulate the behaviors of the on-the-job management personnel to ensure that the on-the-job management personnel supervise in accordance with the supervision behaviors specified in the second operation specification.

[0118] In the embodiment of the present application, it also includes: receiving the control command input for alarm or abnormal safety work through the monitoring equipment of the monitoring area, and collecting the biometric information of the personnel who input the command, determining the identity information of the personnel who input the command, determining their operating authority, and executing the command in the case of operating authority, and removing the prompt information of the alarm or abnormal safety work. Considering the complexity of the operation at the work site and in order to improve the management efficiency, the monitoring personnel of the monitoring equipment in the monitoring area are allowed to have certain management authority, such as temporary personnel entering the work site. At this time, it is necessary to collect the biometric information of the temporary personnel as the personnel allowed to enter the work site. Alternatively, after receiving the alarm information of the false alarm or the mandatory behavior specified in the operation specification, the alarm can be removed. Receive the temporary increase in personnel instructions for the on-site operation input by the monitoring personnel, collect the biometric information of the increase in personnel, receive the signature information of the increase in personnel, and transmit the relevant information of the increase in personnel to the background server; manage the increase in personnel according to the requirements of the work site. It should be emphasized that the number of increase in personnel for the on-site operation of the monitoring personnel is set, and it is not allowed when the number of increase in personnel is exceeded. The monitoring equipment will synchronize the recruitment information to the background management server to ensure that the identity of the recruited personnel can be traced and the recruitment behavior of the monitoring personnel is legal and compliant.

[0119] In the embodiment of the present application, the aforementioned active management and control method for high-risk operations may also include:

[0120] Receive the supervisory personnel's work management instructions for the work site, and determine whether the work management instructions comply with the provisions of the second work specification, and allow the execution of the work management instructions if they comply; in the embodiment of the present application, the supervisory personnel has the function of supervising and managing the work site. For example, when the supervisory personnel determines through the monitoring video that an operator has not performed the work in accordance with the work specification, the supervisory personnel can execute the corresponding work management instructions and report relevant information of the illegal work to the background server.

[0121] Video images are collected for all operations performed by the supervisor in the supervisory area, and the supervisor's operation log is recorded through the supervisory equipment. The video images and operation log of the supervisor are transmitted to the background server. Through the video images collected by the supervisory equipment, it is determined whether there are warning signs in the set area of ​​the work site or in the passage leading to the work site. When no operation warning sign is detected, a warning sign setting non-compliance alarm is transmitted to the background server.

[0122] In the embodiment of the present application, the aforementioned active management and control method for high-risk operations may also include:

[0123] Collect environmental information of the work site, which includes at least gas composition information, lighting information, temperature information, humidity information, and power consumption information. Determine whether the work conditions are met based on the collected environmental information. If the work conditions are not met, send an alarm message to the background server, and close the access channel to the work site through control instructions, lock the locking mechanism at the entrance of the work site, and prevent any personnel from entering the work site; until the test results meet the work conditions, after the authorization instruction is obtained, open the access channel to the work site, release the locking function of the locking mechanism at the entrance of the work site, and allow entry to the work site. For high-risk operations, the environmental information of the operators is always related to the physical and mental health of the operators. It is necessary to collect environmental information of the work site to ensure that the gas composition information in the work environment meets the work requirements, such as whether the oxygen content is lower than the set threshold, whether the harmful gas components exceed the standard, whether the working temperature of the on-site operation exceeds the standard, etc. When the working environment of the work site is abnormal, it is necessary to stop the on-site operation immediately and ensure that each operator evacuates the work site.

[0124] In the embodiment of the present application, the aforementioned active management and control method for high-risk operations may also include:

[0125] If it is determined based on the collected environmental information that the operating conditions are not met and the work is currently in progress, an alarm message is output through the alarm at the work site, prompting the operator to quickly evacuate the work site, and the alarm message is transmitted to the backend server and the monitoring equipment in the monitoring area; if it is determined during the operation that the environmental information at the work site does not meet the operating conditions, the operator is prompted to quickly evacuate the work site, and the alarm message is transmitted to the backend server and the monitoring equipment in the monitoring area. The identity information and number of operators evacuated from the work site are detected by the detection equipment to ensure that all operators evacuate the work site.

[0126] Compared with traditional safety management methods, the technical solution of the embodiment of the present application, through the automatic collection of videos or images and the active management mode, requires operators involved in high-risk operations to perform their operations in accordance with the relevant requirements of construction safeguards and risk management plans. Through the biometric and identity recognition of the operators, it can more intuitively assist the enterprise safety management personnel to fully control the safety status of the work site, form an effective management method, and urge management and execution personnel at all levels to consciously practice the "three current management", namely the management principle of on-site, actual objects, and reality, take the initiative to go deep into the site, maximize the safety management efficiency, strictly ensure the safety of high-risk work sites and peripheries, improve the effectiveness of safety management, and provide operators with a better working environment.

[0127] Figure 2Schematic diagram of the composition structure of the active control device for high-risk operations in the embodiment of the present application, such as Figure 2 As shown, the active control device for high-risk operations in the embodiment of the present application includes:

[0128] The parsing unit 20 is used to generate the operation safety measures for the operation to be performed based on the relevant documents or information of the operation permit, risk assessment, work ticket, work ticket attachment, risk prevention ticket, organizational measures, technical measures, safety measures, environmental protection measures, construction plan, emergency plan and other construction security measures and risk treatment plans related to the high-risk operation, and parse the operation safety measures to at least obtain various security clauses related to the security of the operation to be performed;

[0129] The analysis unit 21 is used to segment the sentences in the security clause to obtain basic word components constituting the sentences; based on the basic word components, the meaning of the sentence is analyzed, and multiple sentences before the sentence are obtained, the contextual meanings between the multiple sentences and the sentence are analyzed, and the meaning of the sentence is supplemented;

[0130] The first determination unit 22 is used to determine the number of operators and related personnel at the operation site to be operated, the responsible and / or supervisory related personnel among the relevant responsible persons and their safety responsibilities based on the statement analysis results; determine the identity of the operation-related personnel and collect their biometric information, and store the collected biometric information;

[0131] The image processing unit 23 is used to collect image information of the area where the operation site is located, input the image information into the safe operation image library, obtain a matching image that matches the image information, search for a first operation safety specification corresponding to the matching image, and output the first operation safety specification;

[0132] A generating unit 24, configured to generate a second operation specification based on the safety assurance clause and the first operation safety specification, and perform statement analysis on the second operation specification to obtain an analysis result;

[0133] The identity recognition unit 25 is used to collect video images of the monitoring area in response to the arrival of the operation time, collect biometric information of the personnel in the video image, compare the collected biometric information of the personnel with the stored biometric information, and determine the identity information of the personnel; and transmit the collected video images and the identity recognition results to the background server;

[0134] The second determination unit 26 is used to determine, based on the identity information, whether the responsible and / or guardian-related personnel among the relevant responsible persons are on duty at the guardianship site, and determine whether the operation task can be started; otherwise, ensure the locking function of the locking mechanism at the entrance of the operation site to prevent the operating personnel from entering the operation site;

[0135] The first signature processing unit 27 is used to receive the signature of each operator at the monitoring site, store the signature information, and transmit the signature information to the background server;

[0136] The behavior recognition unit 28 is used to determine that the responsible and / or supervisory personnel among the relevant responsible persons are on duty, continue to collect video images collected in the monitoring area, identify the safety education behavior before the operation, determine whether the safety education behavior complies with the safety pre-control rules specified in the second operation specification, and receive the signature information of the person in charge and the operator. If the signature information matches the pre-collected signature, confirm that entry to the operation site is allowed;

[0137] The entrance monitoring unit 29 is used to release the locking function of the locking mechanism at the entrance of the work site, collect the facial image of each worker at the entrance of the work site, count the identity information of the workers entering and the number of workers entering, identify and count the work tools carried by the workers, and generate work records for the workers; when it is determined that the identity of the workers does not match, or the entry time is a period not allowed to enter, or the number of workers exceeds the number of workers specified in the second work specification, or the type of work tools does not meet the work requirements, output alarm information to the background server and the monitoring equipment in the monitoring area, and notify the guardian to stop working at the work site;

[0138] The on-site monitoring unit 30 is used to identify the working behavior of the operator based on the video image of the working site in response to the arrival of the detection cycle, and determine whether the working behavior complies with the working behavior specified in the second working specification, determine whether the working behavior of the operator at the working site has an unauthorized working behavior, the operator is located in a prohibited activity area, or the current number of the operator is abnormal, transmit an alarm message to the background server and the monitoring device in the monitoring area, and notify the guardian to stop working at the working site;

[0139] The work end monitoring unit 31 is used to collect the facial image of each worker coming out of the entrance of the work site in response to the end of the work time, count the identity information of the workers coming out and the number of workers coming out, identify and count the work tools carried by the workers, and ensure that each worker and work tool evacuates from the work site; when the statistics are abnormal, an alarm message is transmitted to the background server and the monitoring equipment in the monitoring area;

[0140] The second signature processing unit 32 is used to receive the signature of each operator coming out of the entrance of the work site at the monitoring site, match the collected signature information with the signature information before the work is started, and transmit the current signature information to the background server to start the locking function of the locking mechanism at the entrance of the work site;

[0141] The operation completion identification unit 33 is used to identify whether the monitored area is to be cleared based on the video image of the monitored scene. After confirming the clearance, it is used to identify whether a warning sign is placed in the set area, and transmit the identification results of the clearing process and the identification results of the warning sign to the background server. When the clearing process is not performed or the warning sign is not placed, the background server transmits an alarm message.

[0142] In the embodiment of the present application, the on-site monitoring unit 30 is also used for:

[0143] When the detection device detects a change in the number of workers at the work site during the operation, it outputs an alarm message to the designated background server and the monitoring device in the monitoring area; and re-identifies the identities of the workers in the video image of the work site to determine whether the identities of the workers match the stored identities of the workers. When there are non-matching workers, the images of the non-matching workers are extracted and transmitted to the background server and the monitoring device in the monitoring area.

[0144] In the embodiment of the present application, the device further includes:

[0145] On-site monitoring unit ( Figure 2 (not shown in the figure), which is used to respond to the detection of the designated on-duty manager appearing in the monitoring area or the work site, collect the biometric information of the on-duty manager, and after matching, output all the inspection items to be inspected to the on-duty manager through the monitoring equipment in the monitoring area, and receive the verification input of the security inspection result of the on-duty manager, detect whether the input result meets the security inspection condition, and prompt that the security inspection is passed if it meets the condition, otherwise output an alarm message and transmit an alarm message that the security inspection has not been completed to the background server;

[0146] The behavior of the on-duty management personnel in the monitoring area or the work site is identified to determine whether the safety supervision behavior of the on-duty management personnel complies with the supervision behavior specified in the second work specification, and the video images of the on-duty management personnel in the monitoring area or the work site are transmitted to the background server.

[0147] In an exemplary embodiment, the aforementioned units and the like may be implemented by one or more central processing units (CPU), graphics processing units (GPU), application specific integrated circuits (ASIC), DSPs, programmable logic devices (PLD), complex programmable logic devices (CPLD), field programmable gate arrays (FPGA), general-purpose processors, controllers, microcontrollers (MCU), microprocessors, or other electronic components.

[0148] Regarding the device in the above embodiment, the specific manner in which each module and unit performs operations has been described in detail in the embodiment of the method, and will not be elaborated here.

[0149] Figure 3 Schematic diagram of the structure of the electronic device according to the embodiment of the present application. Figure 3 As shown, the electronic device 800 supports multi-screen output, and the electronic device 800 may include one or more of the following components: a processing component 802, a memory 804, a power component 806, a multimedia component 808, an audio component 810, an input / output (I / O) interface 812, a sensor component 814, and a communication component 816.

[0150] The processing component 802 generally controls the overall operation of the electronic device 800, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 802 may include one or more processors 820 to execute instructions to complete all or part of the steps of the above-mentioned method. In addition, the processing component 802 may include one or more modules to facilitate the interaction between the processing component 802 and other components. For example, the processing component 802 may include a multimedia module to facilitate the interaction between the multimedia component 808 and the processing component 802.

[0151] The memory 804 is configured to store various types of data to support operations on the device 800. Examples of such data include instructions for any application or method operating on the electronic device 800, contact data, phone book data, messages, pictures, videos, etc. The memory 804 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.

[0152] The power component 806 provides power to the various components of the electronic device 800. The power component 806 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the electronic device 800.

[0153] The multimedia component 808 includes a screen that provides an output interface between the electronic device 800 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 808 includes a front camera and / or a rear camera. When the device 800 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera may receive external multimedia data. Each front camera and the rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

[0154] The audio component 810 is configured to output and / or input audio signals. For example, the audio component 810 includes a microphone (MIC), and when the electronic device 800 is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode, the microphone is configured to receive an external audio signal. The received audio signal can be further stored in the memory 804 or sent via the communication component 816. In some embodiments, the audio component 810 also includes a speaker for outputting audio signals.

[0155] I / O interface 812 provides an interface between processing component 802 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include but are not limited to: a home button, a volume button, a start button, and a lock button.

[0156] The sensor assembly 814 includes one or more sensors for providing various aspects of status assessment for the electronic device 800. For example, the sensor assembly 814 can detect the open / closed state of the device 800, the relative positioning of components, such as the display and keypad of the electronic device 800, and the sensor assembly 814 can also detect the position change of the electronic device 800 or a component of the electronic device 800, the presence or absence of contact between the user and the electronic device 800, the orientation or acceleration / deceleration of the electronic device 800, and the temperature change of the electronic device 800. The sensor assembly 814 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor assembly 814 may also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 814 may also include an accelerometer, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0157] The communication component 816 is configured to facilitate wired or wireless communication between the electronic device 800 and other devices. The electronic device 800 can access a wireless network based on a communication standard, such as Wi-Fi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 816 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 816 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0158] In an exemplary embodiment, the electronic device 800 can be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors or other electronic components to perform the steps of the active management and control method for high-risk operations of the above-mentioned embodiments.

[0159] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 804 including instructions, and the instructions can be executed by a processor 820 of an electronic device 800 to complete the steps of the active management and control method for high-risk operations of the above embodiment. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0160] The embodiment of the present application also describes a computer-readable storage medium, in which a computer program is stored. When the computer program is executed by a processor, the steps of the active management and control method for high-risk operations of the embodiment are implemented.

[0161] It should be understood that "one embodiment" or "an embodiment" mentioned throughout the specification means that specific features, structures or characteristics related to the embodiment are included in at least one embodiment of the present invention. Therefore, "in one embodiment" or "in an embodiment" appearing throughout the specification does not necessarily refer to the same embodiment. In addition, these specific features, structures or characteristics can be combined in one or more embodiments in any suitable manner. It should be understood that in various embodiments of the present invention, the size of the sequence number of the above-mentioned processes does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiment of the present application. The above-mentioned sequence numbers of the embodiments of the present application are for description only and do not represent the advantages and disadvantages of the embodiments.

[0162] It should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or device including the element.

[0163] In the several embodiments provided in this application, it should be understood that the disclosed devices and methods can be implemented in other ways. The device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation, such as: multiple units or components can be combined, or can be integrated into another system, or some features can be ignored or do not exist.

[0164] The units described above as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units; some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.

[0165] The above is only an embodiment of the present invention, but the protection scope of the present invention is not limited thereto. Any person skilled in the art can easily think of changes or substitutions within the technical scope disclosed by the present invention, which should be included in the protection scope of the present invention. Therefore, the protection scope of the present invention should be based on the protection scope of the claims.

Claims

1. A proactive management and control method for high-risk operations, characterized in that: The method comprises: Based on the relevant documents or information of the work permit, risk assessment, work ticket, work ticket attachment, risk prevention ticket, organizational measures, technical measures, safety measures, environmental protection measures, construction plan, construction safeguard measures of the emergency plan and risk treatment plan related to the high-risk work, generate the work safety measures for the work to be done, parse the work safety measures, and at least obtain various safety safeguard clauses related to the safety safeguard of the work to be done; Segmenting the sentences in the security clause to obtain basic word components constituting the sentences; parsing the meaning of the sentence based on the basic word components, obtaining multiple sentences before the sentence, analyzing the contextual meanings between the multiple sentences and the sentence, and supplementing the meaning of the sentence; Based on the results of the sentence analysis, determine the number of operators and the number of operators at the work site to be operated, the responsible and / or supervisory personnel among the relevant responsible persons and their safety responsibilities; determine the identities of the operators and collect their biometric information, and store the collected biometric information; Collect image information of the area where the work site is located, input the image information into a safe work image library, obtain a matching image that matches the image information, search for a first work safety specification corresponding to the matching image, and output the first work safety specification; generating a second operation specification based on the safety assurance clause and the first operation safety specification, and performing statement analysis on the second operation specification to obtain an analysis result; In response to the arrival of the operation time, the video image of the monitoring area is collected, the biometric information of the personnel in the video image is collected, the collected biometric information of the personnel is compared with the stored biometric information, and the identity information of the personnel is determined; and the collected video image and the identity recognition result are transmitted to the background server; Based on the identity information, the responsible and / or supervisory personnel among the relevant responsible persons are confirmed to be on duty at the supervision site, and the operation task can be started; otherwise, the locking function of the locking mechanism at the entrance of the operation site is ensured to prevent the operating personnel from entering the operation site; Receive the signature of each operator at the monitoring site, store the signature information, and transmit the signature information to the backend server; When it is confirmed that the responsible and / or supervisory personnel among the relevant responsible persons are on duty, continue to collect video images collected in the supervisory area, identify the safety education behavior before the operation, determine whether the safety education behavior complies with the safety pre-control rules specified in the second operation specification, and receive the signature information of the person in charge and the operator. When the signature information matches the pre-collected signature, confirm that entry to the operation site is allowed; Release the locking function of the locking mechanism at the entrance of the work site, collect the facial image of each worker at the entrance of the work site, count the identity information of the workers entering and the number of workers entering, identify and count the work tools carried by the workers, and generate work records for the workers; if it is determined that the identity of the worker does not match, or the entry time is a period when entry is not allowed, or the number of workers exceeds the number of workers specified in the second work specification, or the type of work tools does not meet the work requirements, output an alarm message to the background server and the monitoring equipment in the monitoring area, and notify the guardian to stop working at the work site; In response to the arrival of the detection cycle, the operation behavior of the operator is identified based on the video image of the operation site, and whether the operation behavior conforms to the operation behavior specified in the second operation specification is determined, and the operation behavior of the operator at the operation site is determined to be non-permitted, the operator is located in a prohibited activity area, or the current number of the operator is abnormal, and an alarm message is transmitted to the background server and the monitoring device in the monitoring area, and the guardian is notified to stop working at the operation site; In response to the end of the work time, the facial image of each worker coming out of the entrance of the work site is collected, the identity information and number of the workers coming out are counted, and the work tools carried by the workers are identified and counted to ensure that each worker and work tool are evacuated from the work site; when the statistics are abnormal, an alarm message is transmitted to the background server and the monitoring equipment in the monitoring area; Receive the signature of each operator coming out of the entrance of the work site at the monitoring site, match the collected signature information with the signature information before the work is started, and transmit the current signature information to the background server to activate the locking function of the locking mechanism at the entrance of the work site; Based on the video images of the monitoring site, it is identified whether the monitoring area needs to be cleared. After confirming the clearance, it is identified whether warning signs are placed in the set area, and the identification results of the clearance and warning signs are transmitted to the background server. If the area is not cleared or the warning signs are not placed, the background server will transmit an alarm message.

2. The method according to claim 1, characterized in that: The method further comprises: When the detection device detects a change in the number of workers at the work site during the operation, it outputs an alarm message to the designated background server and the monitoring device in the monitoring area; and re-identifies the identities of the workers in the video image of the work site to determine whether the identities of the workers match the stored identities of the workers. When there are non-matching workers, the images of the non-matching workers are extracted and transmitted to the background server and the monitoring device in the monitoring area.

3. The method according to claim 1, characterized in that: The method further comprises: In response to detecting that the designated on-duty manager appears in the monitoring area or the work site, the biometric information of the on-duty manager is collected. After matching, all the inspection items to be inspected are output to the on-duty manager through the monitoring equipment in the monitoring area, and the verification input of the security inspection result of the on-duty manager is received, and it is detected whether the input result meets the security inspection conditions. If it meets the conditions, it prompts that the security inspection has passed. Otherwise, an alarm message is output and an alarm message indicating that the security inspection has not been completed is transmitted to the background server; The behavior of the on-duty management personnel in the monitoring area or the work site is identified to determine whether the safety supervision behavior of the on-duty management personnel complies with the supervision behavior specified in the second work specification, and the video images of the on-duty management personnel in the monitoring area or the work site are transmitted to the background server.

4. The method according to claim 1, characterized in that The method further comprises: Receive control command input for alarm or abnormal safety work through the monitoring equipment in the monitoring area, collect biometric information of the person who inputs the command, determine the identity information of the person who inputs the command, determine their operation authority, and execute the command to remove the alarm or abnormal safety work prompt information if they have the operation authority; Receive the temporary staffing instructions for on-site operations input by the supervisor, collect the biometric information of the staff, receive the signature information of the staff, and transmit the relevant information of the staff to the background server; manage the staff in accordance with the requirements of the work site.

5. The method according to claim 4, characterized in that The method further comprises: receiving the operation management instruction of the supervisor on the operation site, and determining whether the operation management instruction complies with the provisions of the second operation specification, and allowing the operation management instruction to be executed if it complies; Capture video images of all operations performed by the guardian in the monitoring area, record the guardian's operation log through the monitoring equipment, and transmit the guardian's video images and operation log to the background server; And through the video images collected by the monitoring equipment, determine whether there are warning signs in the set area of ​​the work site or the passage leading to the work site. When the work warning sign is not detected, transmit the warning sign setting non-compliance alarm to the background server.

6. The method according to claim 1, characterized in that The method further comprises: Collect environmental information of the work site, the environmental information including at least gas composition information, lighting information, temperature information, humidity information, and electricity consumption information, and determine whether the working conditions are met based on the collected environmental information. If the working conditions are not met, send an alarm message to the background server, and close the entrance channel to the work site through control instructions, lock the locking mechanism at the entrance of the work site, and prevent any person from entering the work site; until the detection results meet the working conditions, after obtaining authorization instructions, open the entrance channel to the work site, release the locking function of the locking mechanism at the entrance of the work site, and allow entry to the work site.

7. The method according to claim 6, characterized in that The method further comprises: When it is determined based on the collected environmental information that the working conditions are not met and the work is currently in progress, an alarm message is output through the alarm at the work site to prompt the operator to quickly evacuate the work site, and the alarm message is transmitted to the background server and the monitoring equipment in the monitoring area; The identity information and number of workers evacuating from the work site are detected through detection equipment to ensure that all workers evacuate the work site.

8. An active control device for high-risk operations, characterized in that: The device comprises: A parsing unit, for generating the operation safety measures for the operation to be performed based on the relevant documents or information of the operation permit, risk assessment, work ticket, work ticket attachment, risk prevention ticket, organizational measures, technical measures, safety measures, environmental protection measures, construction plan, construction guarantee measures of the emergency plan and risk handling plan related to the high-risk operation, and parsing the operation safety measures to obtain at least various safety guarantee clauses related to the safety guarantee of the operation to be performed; An analysis unit is used to segment the sentences in the security clause to obtain basic word components constituting the sentences; based on the basic word components, the meaning of the sentence is analyzed, and multiple sentences before the sentence are obtained, the contextual meanings between the multiple sentences and the sentence are analyzed, and the meaning of the sentence is supplemented; The first determination unit is used to determine the number of operators and related personnel at the operation site to be operated, the responsible and / or supervisory related personnel among the relevant responsible persons and their safety responsibilities based on the statement analysis results; determine the identity of the operation-related personnel and collect their biometric information, and store the collected biometric information; An image processing unit, used to collect image information of the area where the work site is located, input the image information into a safe work image library, obtain a matching image that matches the image information, search for a first work safety specification corresponding to the matching image, and output the first work safety specification; A generating unit, configured to generate a second operation specification based on the safety assurance clause and the first operation safety specification, and perform statement analysis on the second operation specification to obtain an analysis result; The identity recognition unit is used to collect video images of the monitoring area in response to the arrival of the operation time, collect biometric information of the personnel in the video image, compare the collected biometric information of the personnel with the stored biometric information, and determine the identity information of the personnel; and transmit the collected video images and identity recognition results to the background server; The second determination unit is used to determine, based on the identity information, whether the responsible and / or guardian-related personnel among the relevant responsible persons are on duty at the guardianship site, and determine whether the operation task can be started; otherwise, ensure the locking function of the locking mechanism at the entrance of the operation site to prevent the operating personnel from entering the operation site; The first signature processing unit is used to receive the signature of each operator at the monitoring site, store the signature information, and transmit the signature information to the background server; A behavior recognition unit is used to determine that the responsible and / or supervisory personnel among the relevant responsible persons are on duty, continue to collect video images collected in the monitoring area, identify the safety education behavior before the operation, determine whether the safety education behavior complies with the safety pre-control rules specified in the second operation specification, and receive the signature information of the person in charge and the operator, and confirm that entry to the operation site is allowed when the signature information matches the pre-collected signature; An entrance monitoring unit is used to release the locking function of the locking mechanism at the entrance of the work site, collect facial images of each worker at the entrance of the work site, count the identity information of the workers entering and the number of workers entering, identify and count the work tools carried by the workers, and generate work records for the workers; if it is determined that the identity of the worker does not match, or the entry time is a period not allowed to enter, or the number of workers exceeds the number of workers specified in the second work specification, or the type of work tools does not meet the work requirements, an alarm message is output to the background server and the monitoring equipment in the monitoring area, and the guardian is notified to stop working at the work site; A field monitoring unit is used to identify the work behavior of the operator based on the video image of the work site in response to the arrival of the detection cycle, and determine whether the work behavior complies with the work behavior specified in the second work specification, determine whether the work behavior of the operator at the work site has non-permitted work behavior, the operator is located in a prohibited activity area, or the current number of operators is abnormal, transmit an alarm message to the background server and the monitoring device in the monitoring area, and notify the guardian to stop working at the work site; The end-of-work monitoring unit is used to respond to the end of the work time, collect the facial images of each worker coming out of the entrance of the work site, count the identity information and number of the workers coming out, identify and count the work tools carried by the workers, and ensure that each worker and work tool evacuates from the work site; when the statistics are abnormal, send an alarm message to the background server and the monitoring equipment in the monitoring area; The second signature processing unit is used to receive the signature of each operator coming out of the entrance of the work site at the monitoring site, match the collected signature information with the signature information before the work is started, and transmit the current signature information to the background server to start the locking function of the locking mechanism at the entrance of the work site; The operation completion identification unit is used to identify whether the monitored area is cleared based on the video image of the monitored scene. After confirming the clearance, it identifies whether a warning sign is placed in the set area, and transmits the identification results of the clearance process and the identification results of the warning sign to the background server. When the area is not cleared or the warning sign is not placed, the background server transmits an alarm message.

9. The device according to claim 8, characterized in that The on-site monitoring unit is also used for: When the detection device detects a change in the number of people working at the work site during the operation, it outputs an alarm message to the designated background server and the monitoring device in the monitoring area; The identities of the workers in the video images of the work site are re-identified to determine whether the identities of the workers match the stored identities. When there are non-matching persons, the images of the non-matching persons are extracted and transmitted to the background server and the monitoring equipment in the monitoring area.

10. The device according to claim 8, characterized in that The device also includes: The on-the-job monitoring unit is used to respond to the detection of the designated on-the-job management personnel appearing in the monitoring area or the work site, collect the biometric information of the on-the-job management personnel, and after matching, output all the inspection items to be inspected to the on-the-job management personnel through the monitoring equipment in the monitoring area, and receive the verification input of the security inspection results of the on-the-job management personnel, and detect whether the input results meet the security inspection conditions. If they meet the conditions, it prompts that the security inspection has passed, otherwise it outputs an alarm message and transmits an alarm message that the security inspection has not been completed to the background server; The behavior of the on-duty management personnel in the monitoring area or the work site is identified to determine whether the safety supervision behavior of the on-duty management personnel complies with the supervision behavior specified in the second work specification, and the video images of the on-duty management personnel in the monitoring area or the work site are transmitted to the background server.

Images