Safety operation whole-process intelligent management and control method, system and device and storage medium

Abstract

The invention discloses a safety operation whole-process intelligent management and control method, system and device and a storage medium, and relates to the technical field of safety operation and intelligent management and control, and the method comprises the steps: collecting operation admission data, carrying out the matching of an operator and a task according to a preset rule, and generating operation permission information and an operation bill; on the basis of the work permission information and the work bill, work site sensing data of the authorized work personnel in the work process are collected in real time, and work behavior analysis is conducted on the work site sensing data; and based on the operation behavior analysis result, performing collection, association and marking processing on the operation admission data and the operation bill, and outputting marking information. According to the method, compliance matching between operating personnel and tasks is ensured, personnel without qualification or with inconsistent conditions are prevented from entering an operation link, structured management of operation full life cycle data is realized, and subsequent tracking, analysis and intelligent supervision are facilitated.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of safe operation and intelligent management and control, in particular to a safe operation whole-process intelligent management and control method, system, device and storage medium. BACKGROUND

[0002] In recent years, with the continuous expansion of high-risk industries such as power production, chemical industry and mining industry, the safety management of operation sites gradually presents the development trend of digitization and informatization. Personnel identity recognition, operation ticket management, video monitoring, environmental monitoring and other means are generally introduced in operation sites to realize the visual management of the whole operation process. At the same time, the application of intelligent wearable devices, Internet of Things sensors and big data analysis methods enables the real-time collection and processing of multi-source information in operation sites, which provides technical support for ensuring operation safety. These development trends promote the evolution of traditional safety operation management mode to intelligent management and control mode.

[0003] However, the existing safety operation management mode still has many deficiencies. The operation access data and operation tickets are often managed separately, and lack effective collection and dynamic correlation, which leads to the fact that information cannot form a closed loop before, during and after operation. Although sensing devices can collect personnel and environmental data in real time, there is a lack of unified behavior analysis algorithm and marking mechanism, making it difficult to effectively correspond operation behavior with access conditions and operation permission information. In addition, the generation of operation permission and ticket mostly relies on manual review, which has a risk of delay and error, and cannot meet the dynamic safety management and control needs under complex working conditions. Therefore, there is an urgent need for a safe operation whole-process intelligent management and control method that can realize the integration of operation access, permission generation, site sensing, behavior analysis and data collection and correlation, to solve the technical problems of information isolation, insufficient analysis and imperfect marking. SUMMARY

[0004] In view of the above problems, the present application is proposed.

[0005] Therefore, the technical problem solved by the present application is that the existing safety operation management method has the problems of scattered operation access data and operation tickets, lack of collection and marking, operation behavior analysis relying on manual judgment and low accuracy, and dynamic correlation of site sensing data and operation permission information, and how to realize the integration of operation access, permission generation, sensing analysis and data collection and marking under complex working conditions.

[0006] To solve the above technical problems, the present application provides the following technical solutions: a safe operation whole-process intelligent management and control method, comprising collecting operation access data, matching operation personnel and tasks according to preset rules, generating operation permission information and operation tickets; based on the operation permission information and the operation tickets, real-time collection of operation site sensing data of authorized operation personnel in the operation process is performed, and operation behavior analysis is performed on the operation site sensing data; based on the operation behavior analysis result, the operation access data and the operation tickets are collected, associated and marked, and the marked information is output.

[0007] As a preferred scheme of the safe operation whole-process intelligent management and control method, wherein: the collection of operation access data includes identity verification of operation personnel to collect identity information, collection of qualification certificates of operation personnel, retrieval of training records of operation personnel, detection of health status of operation personnel before operation, and registration of borrowing and inspection state of tools.

[0008] As a preferred scheme of the safe operation whole-process intelligent management and control method, wherein: the matching of operation personnel and tasks according to preset rules includes field comparison of qualification certificate number submitted by operation personnel and qualification list required by task, cross comparison of training records of operation personnel and training project number corresponding to task, and numerical comparison of health status of operation personnel before operation and physiological parameter threshold set by task, when the matching result meets the requirements, operation permission information is generated and operation tickets are automatically generated.

[0009] As a preferred scheme of the safe operation whole-process intelligent management and control method, wherein: the real-time collection of operation site sensing data of authorized operation personnel in the operation process includes that the authorized operation personnel include operation personnel who pass identity verification, are qualified in qualification examination, and have confirmed training records, and have legal operation qualifications.

[0010] The generated operation permission information and operation tickets are numbered and archived, the operation task, authorized operation personnel and operation period information are bound with the permission number, real-time collection of voice information of authorized operation personnel is performed, operation image and video information of authorized operation personnel are collected, position information of authorized operation personnel is collected, operation area environment parameters are collected, and use state of operation tools is collected.

[0011] As a preferred scheme of the safe operation whole-process intelligent management and control method, wherein: the operation behavior analysis of operation site sensing data includes construction of operation site sensing data feature vector, fusion of operation site sensing data feature vector, and calculation of operation behavior classification result represented as:

[0012] F=αfv +βf a +γf l +δf e

[0013] Wherein, F is the fusion operation site perception data feature vector, f v is the visual feature vector extracted from the video information, f a is the sound feature vector extracted from the voice information, f l is the position information feature vector extracted from the position information, f e is the environment feature vector extracted from the operation area environment parameter, and alpha, beta, gamma and delta are the weighting coefficients of the feature vectors in the fusion process.

[0014] Based on the fusion operation site perception data feature vector, the standard operation action template is compared, and the operation behavior classification result is calculated.

[0015] As a preferred scheme of the safety operation whole process intelligent management and control method, wherein: the calculation operation behavior classification result includes, the similarity calculation is carried out between the fusion operation site perception data feature vector and the preset standard operation action template, and the behavior classification result is obtained and expressed as:

[0016]

[0017] Wherein, is the operation behavior classification result, is the class index selected from all candidate classes k, which makes the similarity function reach the maximum value, sim(.) is the similarity function, T k is the preset kth standard operation action template.

[0018] Based on the operation behavior classification result, the corresponding behavior identifier is generated, and is associated with the operation permission information, the operation ticket and the real-time collected voice, image, position information and operation area environment parameter of the operation site, so that the behavior data and the operation ticket are labeled and mapped.

[0019] As a preferred scheme of the safety operation whole-process intelligent management and control method, the operation access data and the operation ticket are collected, associated and marked, including: the operation personnel identity information, the qualification certificate number, the training record number and the operation task information are bound with the permission number, the corresponding behavior identification is generated under the permission number based on the fused operation site sensing data feature vector and the operation behavior classification result, the operation ticket is multi-dimensionally associated with the voice information, the image video information, the position information and the operation area environment parameter collected in the operation site, and the corresponding mark is embedded in the operation ticket, and the collection result containing the associated and marked information is output.

[0020] Another object of the present application is to provide a safety operation whole-process intelligent management and control system, which can solve the problems of incomplete process data collection, strong information isolation, lack of real-time tracing and dynamic management and control in the current operation safety management technology by setting the access matching module, the site analysis module and the data marking module.

[0021] As a preferred scheme of the safety operation whole-process intelligent management and control system, the access matching module, the site analysis module and the data marking module are included, the access matching module is used for collecting the operation personnel identity, the qualification, the training and the health state, matching the operation personnel and the task according to the preset rule, generating the operation permission information and the operation ticket, the site analysis module is used for collecting the voice, the video, the position, the environment and the tool use condition of the authorized operation personnel in the operation process based on the operation permission information and the operation ticket, and analyzing the operation behavior through the algorithm, and the data marking module is used for combining the operation behavior analysis result, collecting, associating and marking the operation access data and the operation ticket, generating the marked information output, and tracing and controlling.

[0022] Still another object of the present application is to provide a safety operation whole-process intelligent management and control device, which includes a memory and a processor, the memory stores a computer program, and the processor executes the computer program to realize the steps of the safety operation whole-process intelligent management and control method.

[0023] Still another object of the present application is to provide a safety operation whole-process intelligent management and control storage medium, which stores a computer program, and the computer program is executed by a processor to realize the steps of the safety operation whole-process intelligent management and control method.

[0024] The safety operation whole-process intelligent management and control method provided by the application establishes a work access matching mechanism, rules the adaptation of personnel identity, qualification and task demand, forms work permission and ticket basic information, ensures the compliance matching between work personnel and tasks, avoids personnel without qualification or inconsistent conditions from entering the work link, establishes a work site perception analysis mechanism, dynamically collects and identifies voice, video, location and environment parameters in the work process based on permission information, provides real-time visualization and multi-dimensional monitoring capability of the work process, facilitates timely discovery of abnormal behavior and environmental risks, establishes a work data collection and labeling mechanism, integrates access and process data, and generates a labeled trace record, realizes structured management of work life cycle data, and facilitates subsequent tracking, analysis and intelligent supervision. BRIEF DESCRIPTION OF DRAWINGS

[0025] In order to more clearly illustrate the technical solutions of the embodiments of the application, the following will briefly introduce the drawings needed to be used in the embodiment description. Obviously, the drawings in the following description are only some embodiments of the application, and for those skilled in the art, other drawings can be obtained without creative labor on the basis of these drawings.

[0026] Figure 1 The whole flowchart of a safety operation whole-process intelligent management and control method provided for the embodiment 1 of the application. DETAILED DESCRIPTION

[0027] In order to make the above-mentioned purposes, features and advantages of the application more apparent and easy to understand, the specific embodiments of the application will be described in detail below with reference to the drawings of the specification. Obviously, the described embodiments are part of the embodiments of the application, rather than all the embodiments. Based on the embodiments in the application, all other embodiments obtained by those skilled in the art without creative labor should be within the protection scope of the application.

[0028] Embodiment 1, refer to Figure 1 For an embodiment of the application, a safety operation whole-process intelligent management and control method is provided, which comprises:

[0029] S1: Collect work access data, match work personnel and tasks according to preset rules, and generate work permission information and work tickets.

[0030] Further, as shown in Figure 1 , collecting work access data 100 comprises verifying the identity of the work personnel to collect identity information, collecting the qualification certificate of the work personnel, retrieving the training record of the work personnel, detecting the health status of the work personnel before work, and registering the borrowing and inspection status of tools and instruments.

[0031] It should be noted that identity verification is conducted for operational personnel to collect their identity information. Identity verification can be completed through facial recognition, fingerprint recognition, or document scanning. The verification results are recorded as part of the operational access data. Personnel qualification certificates are also collected. Specifically, this involves obtaining the certificate number, validity period, and other information submitted by the personnel, comparing it with task requirements to determine if the qualification meets the target task requirements, and incorporating the comparison results into the operational access data. Training records for the personnel are also retrieved. By querying training project numbers, training qualification status, and validity periods, a training data set is formed and cross-checked with the training projects required for the task to obtain matching verification results. Before the start of the operation, the health status of the personnel is monitored. Monitoring includes physiological parameters such as body temperature, heart rate, and blood pressure. The measured values ​​are compared with preset thresholds to obtain health status verification results, which are then incorporated into the operational access data. The tools used by the personnel are also monitored and registered. By identifying the tool's identification information, borrowing records, inspection qualification status, and remaining usage period are collected, and the tool status information is recorded as part of the operational access data.

[0032] It should also be noted that identity verification ensures the authenticity of personnel identities and the uniqueness of data; the collection of qualification certificates and comparison with task requirements ensure a high degree of matching between personnel qualifications and tasks; the verification of training records and task correspondence dynamically verifies the suitability of personnel's abilities; health status detection and threshold comparison prevent personnel with abnormal health conditions from entering the work site; and the borrowing and status verification registration of tools ensure that the tools used are within their qualified and valid period, thereby comprehensively improving the safety and compliance of operations.

[0033] Furthermore, matching operators with tasks according to preset rules 200 includes comparing the field of the qualification certificate number submitted by the operator with the qualification list required by the task, cross-comparing the operator's training record with the training project number corresponding to the task, and comparing the operator's health status before the operation with the physiological parameter threshold set by the task. When the matching result meets the requirements, work permit information is generated 201 and work ticket is automatically generated 202.

[0034] It should be noted that a field comparison operation is performed between the qualification certificate numbers submitted by the operators and the qualification list required for the task. Specifically, the qualification conditions in the task requirements, such as certificate type, level, and validity period, are mapped one by one to the qualification certificate number information database submitted by the operators to determine whether they fully meet the requirements of the task. The comparison results are recorded as part of the operation access data. When processing the operators' training records, the required training program numbers are first extracted, and then the corresponding training program numbers are retrieved from the operators' training files to form a cross-comparison set. If the training program number possessed by the operator matches the required number for the task, and the training status is qualified and valid, the training is confirmed to meet the requirements, and the corresponding matching result is generated. If there are missing or unqualified training programs, a non-compliance prompt is output and the generation of operation permit information is prohibited. When comparing the health status of the operators before the operation, the real-time physiological parameter data collected by the operators, including indicators such as heart rate, blood pressure, and blood oxygen saturation, is called and compared with the threshold range set by the task. When all detected values ​​are within the normal thresholds set for the task, the system determines the health status as qualified and allows the user to proceed to the next step. If any parameter exceeds the threshold range, it is recorded as an abnormal state, and automatic generation of work tickets is prohibited.

[0035] It should also be noted that the access data submitted by the operators, such as the qualification certificate number, training program number, and health status, are cross-checked with the task requirements from multiple dimensions. By comparing fields such as certificate type and validity period, it is ensured that the qualifications meet the requirements. Combined with the verification of the training program number and the real-time detection of health parameters, a comprehensive verification chain covering identity, qualifications, training, and health status is formed. This achieves all-round access review from static data to dynamic status. It can automatically screen and determine whether the operators meet the task requirements before the operation, avoid safety hazards caused by unqualified personnel or abnormal health. The comparison results directly drive the generation of work permit information and work tickets, improving the safety and intelligence level of the operation access process.

[0036] S2: Based on work permit information and work tickets, collect real-time work site perception data of authorized workers during the work process, and analyze the work site perception data for work behavior analysis.

[0037] Furthermore, the system collects real-time on-site perception data 300 from authorized operators during the operation process. Authorized operators include those whose identity verification has been passed, whose qualification review has been approved, whose training records have been confirmed, and who possess legal operating qualifications.

[0038] The generated work permit information and work tickets are numbered and archived. The work task, authorized workers and work time period information are bound to the permit number. The voice information of authorized workers, the work image and video information of authorized workers, the location information of authorized workers, the environmental parameters of the work area and the usage status of the work tools are collected in real time.

[0039] It should be noted that authorized personnel are verified through work permit information and work tickets to ensure their identity verification, qualification review, and training record confirmation, thus guaranteeing their legal work qualifications. At the start of the work process, the authorized personnel's on-site perception data is collected in real time based on the permit information. During the data collection process, the generated work permit information and work ticket execution number are archived, and the work task, authorized personnel, and work time period information are bound to the permit number to achieve corresponding data management. The authorized personnel's voice information is collected in real time to record voice communication and abnormal instructions during the work process; the authorized personnel's work image and video information is collected to identify whether the personnel's actions conform to the task specifications; the authorized personnel's location information is collected to monitor whether they are active within the designated work area; environmental parameters of the work area, including temperature, humidity, and gas concentration, are collected to determine whether the work environment meets safety conditions; and the usage status information of the work tools is collected to determine whether the tools are in a usable and safe condition.

[0040] It should also be noted that by encoding and archiving work permit information and work tickets, and binding them with work tasks, personnel, and work periods, and by collecting multi-source sensing data such as voice, video, location, environment, and tool usage status in real time, dynamic monitoring and multi-dimensional cross-verification of the entire work process can be achieved. This enables simultaneous judgment on the compliance of personnel identity, the standardization of actions, the legality of regional operations, environmental safety, and tool availability, thereby forming a complete risk prevention and control closed loop and effectively improving the refinement and intelligence level of work safety management.

[0041] Furthermore, the analysis of work behavior based on the on-site perception data 400 includes constructing a feature vector of the on-site perception data, fusing the feature vectors, and calculating the work behavior classification result, which is represented as follows:

[0042] F=αf v +βf a +γf l +δf e

[0043] Where F is the feature vector of the fused on-site perception data, f v f is the visual feature vector extracted from video information.a f is the sound feature vector extracted from speech information. l f is the location information feature vector extracted from the location information. e The environmental feature vector is extracted from the environmental parameters of the work area, and α, β, γ, and δ are the weighting coefficients of the feature vector in the fusion process.

[0044] Based on the feature vector of the fused on-site perception data, the work behavior classification result is calculated by comparing it with the preset standard work action template.

[0045] It should be noted that the visual feature vector extracted from the video information is represented as follows:

[0046]

[0047] Where T is the total number of frames in the video sequence, t is the index of the current frame in the video sequence, and k is the index of the current frame in the video sequence. t Let be the visual feature vector extracted in frame t.

[0048] The sound feature vector extracted from speech information is represented as:

[0049] f a =FFT(a)

[0050] Where 'a' is the original speech signal sequence.

[0051] The location information feature vector extracted from the location information is represented as follows:

[0052]

[0053] Where, p max p represents the maximum location information point of the operator within a certain time period in the collected location information sequence. min The minimum location information point of the operator within a certain time period in the sequence of collected location information.

[0054] The environmental feature vector extracted from the environmental parameters of the work area is represented as follows:

[0055]

[0056] Where n is the number of environmental parameter samples collected, e i Let be the original value of the environmental parameter at the i-th collection point, μ be the mean of the collected environmental parameter, and σ be the standard deviation of the collected environmental parameter.

[0057] It should also be noted that by fusing visual feature vectors, sound feature vectors, location information feature vectors, and environmental feature vectors from the field perception data, and dynamically adjusting the contribution of each feature vector through weighting coefficients, a unified perception result of work behavior can be formed. This not only captures the workers' actions, voice status, spatial location, and environmental conditions simultaneously, but also achieves the complementarity and unification of multi-dimensional information during the data fusion process. This significantly improves the comprehensiveness and accuracy of work behavior analysis, providing more reliable data support for work safety monitoring and intelligent decision-making.

[0058] Furthermore, the calculation of the operation behavior classification result includes calculating the similarity between the fused operation site perception data feature vector and the preset standard operation action template, and the resulting behavior classification result is expressed as follows:

[0059]

[0060] in, For the classification results of work behavior, To select the category index that maximizes the similarity function among all candidate categories k, let sim(.) be the similarity function, and T be the index of the category. k This is the preset template for the kth standard operation action.

[0061] Based on the classification results of work behaviors, corresponding behavior identifiers are generated and associated with work permit information, work tickets, and real-time voice, image, location information and environmental parameters of the work area, thus completing the annotation and mapping of behavior data with work tickets.

[0062] It should be noted that the similarity calculation is performed between the fused on-site perception data feature vector and the preset set of standard operation action templates. During the similarity calculation process, candidate standard operation action templates are called one by one, and a similarity function is used to measure the similarity between the fused on-site perception data feature vector and the template. The calculation results of all candidate categories are compared, and the category index with the largest similarity function value is selected as the classification result, thereby realizing the automatic identification and classification of operation behavior.

[0063] The pre-set standard operating procedure templates are a set of action patterns established in advance based on historical operation data and operation specifications. By collecting behavioral data of operators in different typical work scenarios, including visual features, auditory features, location information, and environmental parameters of the work area, these multi-source features are mapped and labeled with actual work steps to form standardized action sequence samples. Then, feature extraction and statistical modeling are performed on the collected sample data to obtain a set of feature vectors that characterize the patterns of these actions. Through cluster analysis and normalization of similar action features, a standard operating procedure template library for classification and comparison is constructed. Each standard operating procedure template corresponds to a standardized work behavior pattern, such as equipment start / stop, tool operation, area entry / exit, and communication interaction.

[0064] It should also be noted that by constructing standard operating procedure templates and combining them with feature vectors of real-time collected on-site perception data, a multi-dimensional comparison using a similarity function is achieved, enabling accurate identification and classification of work behaviors. This not only integrates visual features, sound features, location information, and environmental parameters of the work area, but also establishes a standardized template library based on historical work data and work specifications. This ensures that each type of standard operating procedure template highly corresponds to the actual working conditions, thereby guaranteeing the comprehensiveness and accuracy of the classification process. It enables automated identification of cross-modal and multi-dimensional work behaviors, avoiding identification biases caused by a single data source, improving the robustness and intelligence level of work behavior monitoring, and providing technical support for safety supervision and standardized implementation of work processes in complex environments.

[0065] S3: Based on the results of the work behavior analysis, collect, associate and mark the work access data and work tickets, and output the marking information.

[0066] Furthermore, the process of collecting, associating, and tagging work access data and work tickets includes: numbering and archiving the work permit information generated through matching with the corresponding work tickets; binding the worker's identity information, qualification certificate number, training record number, and work task information with the permit number; generating corresponding behavior identifiers under the permit number based on the feature vector of the fused work site perception data and the work behavior classification results; associating the work tickets with the voice information, image and video information, location information, and work area environmental parameters collected at the work site in multiple dimensions; embedding corresponding tags in the work tickets; and outputting the collection results containing association and tagging information.

[0067] It should be noted that by matching the generated work permit information with the corresponding work ticket data, the operator's identity information, qualification certificate number, training record number, and work task information are uniformly archived, and this information is bound to the generated permit number to ensure the legality of the operator's identity and the validity of their qualifications. During the work execution process, based on the fused work site perception data feature vector and work behavior classification results, corresponding behavior identifiers are automatically generated under the permit number, realizing the mapping between behavior and permit number. The work ticket is correlated with the real-time collected voice information, image and video information, location information, and work area environmental parameters in multiple dimensions. Communication records and abnormal information are labeled through voice data, work actions and status are labeled through image and video information, the activity trajectory of the operator is labeled through location information, and the status characteristics of the work environment are labeled through environmental parameters. After completing the fusion and correlation of the above multi-dimensional information, corresponding tags are embedded in the work ticket data, and the final output includes the aggregated results containing correlation and tag information for subsequent safety audits, responsibility tracing, and intelligent analysis.

[0068] It should also be noted that by uniformly collecting and numbering the work access data and work tickets, and through multi-dimensional binding of identity information, qualification certificate number, training record number, and work task information, combined with the feature vector of the fused work site perception data and the work behavior classification results, corresponding behavior identifiers are automatically generated under the permit number. This enables multi-dimensional association between work data and real-time collected voice information, image and video information, location information, and environmental parameters of the work area. Through deep fusion and labeling of multi-source data, accurate traceability and intelligent analysis of the entire work process are achieved, effectively improving the integrity, usability, and security of work information, and providing reliable support for subsequent safety audits and accountability tracking.

[0069] Example 2 is an embodiment of the present invention, which provides a smart management and control system for the entire safe operation process, including an access matching module, an on-site analysis module, and a data marking module.

[0070] The access matching module is used to collect access data such as the identity, qualifications, training, and health status of operators, and to match operators with tasks according to preset rules to generate work permit information and work tickets.

[0071] The on-site analysis module is used to collect real-time data on the voice, video, location, environment, and tool usage of authorized workers during the operation process based on work permit information and work tickets, and analyze the work behavior through algorithms.

[0072] The data tagging module is used to combine the results of work behavior analysis to collect, associate, and tag work access data and work tickets, generating tagged information output for traceability and control.

[0073] This embodiment also provides a computer device, including a memory and a processor. The memory stores a computer program, and when the processor executes the computer program, it implements a personnel positioning safety management visualization analysis system as proposed in the above embodiment.

[0074] This embodiment also provides a computer-readable storage medium storing a computer program thereon, which, when executed by a processor, implements a personnel positioning safety management visualization analysis system as proposed in the above embodiment.

[0075] If the aforementioned functions are implemented as software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, or the part that contributes to the prior art, or a part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present invention. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0076] The logic and / or steps represented in the flowchart or otherwise described herein, for example, can be considered as a sequenced list of executable instructions for implementing logical functions, and can be embodied in any computer-readable medium for use by, or in conjunction with, an instruction execution system, apparatus, or device (such as a computer-based system, a processor-included system, or other system that can fetch and execute instructions from, an instruction execution system, apparatus, or device). For the purposes of this specification, "computer-readable medium" can be any means that can contain, store, communicate, propagate, or transmit programs for use by, or in conjunction with, an instruction execution system, apparatus, or device.

[0077] More specific examples of computer-readable media (a non-exhaustive list) include: electrical connections (electronic devices) having one or more wires, portable computer disk drives (magnetic devices), random access memory (RAM), read-only memory (ROM), erasable and editable read-only memory (EPROM or flash memory), fiber optic devices, and portable optical disc read-only memory (CDROM). Furthermore, computer-readable media can even be paper or other suitable media on which the program can be printed, because the program can be obtained electronically, for example, by optically scanning the paper or other medium, followed by editing, interpreting, or otherwise processing as necessary, and then stored in computer memory.

[0078] It should be understood that various parts of the present invention can be implemented in hardware, software, firmware, or a combination thereof. In the above embodiments, multiple steps or methods can be implemented in software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, it can be implemented using any one or a combination of the following techniques known in the art: discrete logic circuits having logic gates for implementing logical functions on data signals, application-specific integrated circuits (ASICs) having suitable combinational logic gates, programmable gate arrays (PGAs), field-programmable gate arrays (FPGAs), etc.

[0079] It should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention and not to limit it. Although the present invention has been described in detail with reference to preferred embodiments, those skilled in the art should understand that modifications or equivalent substitutions can be made to the technical solutions of the present invention without departing from the spirit and scope of the technical solutions of the present invention, and all such modifications or substitutions should be covered within the scope of the claims of the present invention.

Claims

1. A method for intelligent management and control of the entire safe operation process, characterized in that, include: Collect work access data, match workers with tasks according to preset rules, and generate work permit information and work tickets; Based on work permit information and work tickets, real-time data on the work site perception of authorized workers during the work process is collected, and work behavior analysis is performed on the work site perception data. Based on the results of the work behavior analysis, the work access data and work tickets are collected, associated and marked, and the marking information is output.

2. The intelligent management and control method for the entire safe operation process as described in claim 1, characterized in that: The data collection for operational access includes: verifying the identity of operators to collect their identity information; collecting the qualification certificates of operators; retrieving the training records of operators; detecting the health status of operators before they start work; and registering the borrowing and inspection status of tools and equipment.

3. The intelligent management and control method for the entire safe operation process as described in claim 1 or 2, characterized in that: The process of matching operators with tasks according to preset rules includes: comparing the qualification certificate number submitted by the operator with the qualification list required by the task; cross-comparing the operator's training record with the training project number corresponding to the task; comparing the operator's health status before the operation with the physiological parameter threshold set by the task; and generating work permit information and automatically generating work tickets when the matching results meet the requirements.

4. The intelligent management and control method for the entire safe operation process as described in claim 3, characterized in that: The real-time collection of on-site perception data of authorized operators during the operation process includes authorized operators who have passed identity verification, qualification review, and training record confirmation, and who possess legal operation qualifications; The generated work permit information and work tickets are numbered and archived. The work task, authorized workers and work time period information are bound to the permit number. The voice information of authorized workers, the work image and video information of authorized workers, the location information of authorized workers, the environmental parameters of the work area and the usage status of the work tools are collected in real time.

5. The intelligent management and control method for the entire safe operation process as described in any one of claims 1, 2, or 4, characterized in that: The analysis of work behavior based on the work site perception data includes constructing a feature vector of the work site perception data and fusing the feature vectors, as follows: F=αf v +βf a +γf l +δf e Where F is the feature vector of the fused on-site perception data, f v f is the visual feature vector extracted from video information. a f is the sound feature vector extracted from speech information. l f is the location information feature vector extracted from the location information. e The environmental feature vector is extracted from the environmental parameters of the work area, and α, β, γ, and δ are the weighting coefficients of the feature vector in the fusion process. Based on the feature vector of the fused on-site perception data, the work behavior classification result is calculated by comparing it with the preset standard work action template.

6. The intelligent management and control method for the entire safe operation process as described in claim 5, characterized in that: The calculation of the operation behavior classification result includes calculating the similarity between the fused operation site perception data feature vector and the preset standard operation action template, and the resulting behavior classification result is expressed as follows: in, For the classification results of work behavior, To select the category index that maximizes the similarity function among all candidate categories k, let sim(.) be the similarity function, and T be the index of the category. k This is the preset template for the kth standard operation action; Based on the classification results of work behaviors, corresponding behavior identifiers are generated and associated with work permit information, work tickets, and real-time voice, image, location information and environmental parameters of the work area, thus completing the annotation and mapping of behavior data with work tickets.

7. The intelligent management and control method for the entire safe operation process as described in any one of claims 1, 2, 4, or 6, characterized in that: The process of collecting, associating, and marking work access data and work tickets includes: numbering and archiving the work permit information generated through matching with the corresponding work tickets; binding the worker's identity information, qualification certificate number, training record number, and work task information with the permit number; generating corresponding behavior identifiers under the permit number based on the feature vector of the fused work site perception data and the work behavior classification results; associating the work tickets with the voice information, image and video information, location information, and work area environmental parameters collected at the work site in multiple dimensions; embedding corresponding markers in the work tickets; and outputting the collection results containing association and marking information.

8. A smart management and control system for the entire safe operation process, employing the smart management and control method for the entire safe operation process as described in any one of claims 1 to 7, characterized in that: Includes an admission matching module, an on-site analysis module, and a data labeling module; The access matching module is used to collect access data such as the identity, qualifications, training, and health status of the operators, and match the operators with the tasks according to preset rules to generate work permit information and work tickets; The on-site analysis module is used to collect real-time data on the voice, video, location, environment, and tool usage of authorized personnel during the operation process based on work permit information and work tickets, and to analyze the work behavior through algorithms. The data tagging module is used to combine the results of work behavior analysis to collect, associate, and tag work access data and work tickets, and generate tagged information output for traceability and control.

9. A computer device comprising a memory and a processor, wherein the memory stores a computer program, characterized in that, When the processor executes the computer program, it implements the steps of the intelligent management and control method for the entire safe operation process as described in any one of claims 1 to 7.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by the processor, it implements the steps of the intelligent management and control method for the entire safe operation process as described in any one of claims 1 to 7.

Images