A method for mine identification and abnormal state monitoring based on multi-point video

Abstract

The present invention relates to the field of mine safety technology, and specifically discloses a method for multi-point video mine identification and abnormal state monitoring thereof, comprising: arranging video monitoring equipment in the mine operation area, collecting video data of workers operating a pneumatic drill in a standardized manner; extracting standardized action features of workers operating the pneumatic drill based on the video data, constructing a standardized action model, and calculating a first operation standard value of the workers operating the pneumatic drill; inputting the real-time collected video data of the workers operating the pneumatic drill into the standardized action model, and calculating a second operation standard value; when an abnormal operation state is detected, issuing an early warning signal, and linking the mine management system to start a corresponding rescue response. The present invention determines whether the worker's operation is abnormal by comparing the first operation standard value with the second operation standard value, triggering an early warning and a rescue response when an abnormal operation is detected, and improving the level of mine operation safety monitoring.

Description

Technical Field

[0001] The present invention relates to the field of mine safety technology, and more specifically, to a method for multi-point video mine identification and abnormal state monitoring thereof. Background Art

[0002] The mine operating environment is complex and changeable, and safety issues have always been one of the core challenges in the mine production process. Traditional mine monitoring mainly relies on manual patrols and video surveillance systems. Although these methods can record the situation on the job site, they have significant shortcomings: on the one hand, video surveillance can only provide image storage or real-time viewing functions, and it is difficult to conduct intelligent analysis of workers' behavior in operating pneumatic drills, especially unable to identify whether the operation of pneumatic drills complies with regulations; on the other hand, the identification of workers' abnormal behavior status usually relies on manual observation, which is prone to misjudgment or omission due to subjective factors. In addition, due to the lack of automated early warning and emergency mechanisms, intervention is often required only after an accident occurs, missing the best time for rescue. Summary of the invention

[0003] In order to overcome the above-mentioned defects of the prior art, the present invention provides a method for mine identification and monitoring of its abnormal state by multi-point video, which is through arranging multi-view video monitoring equipment in various areas of the mine, collecting high-quality videos of workers operating pneumatic drills, calculating a first operation specification value based on a standard action model, and comparing a second operation specification value calculated by real-time video data with the first operation specification value to judge whether the worker's operation is standard. If an abnormal operation is detected, an early warning is triggered in time and the mine management system is linked to start a corresponding rescue response, which improves the level of mine operation safety monitoring, reduces accident risks, ensures the safety of workers, and improves the efficiency and intelligence of mine management to solve the problems raised in the above-mentioned background technology.

[0004] To achieve the above object, the present invention provides the following technical solutions:

[0005] A method for mine identification and abnormal state monitoring based on multi-point video includes the following steps:

[0006] Step S1, collecting video data of workers operating a pneumatic drill in a standardized manner through video monitoring equipment arranged in the mine operation area;

[0007] Step S2, importing the acquired video data of the worker operating the pneumatic drill in a standardized manner into the standardized action model, and calculating a first standardized operation value of the worker operating the pneumatic drill;

[0008] Step S3, importing the video data of the worker operating the pneumatic drill collected in real time by the video monitoring device into the standard action model to calculate the second operation standard value;

[0009] Step S4, comparing the second operation standard value with the first operation standard value to determine the standardization degree of the current worker's operation;

[0010] Step S5: When the worker's operation deviates from the predetermined specification, it is determined to be an abnormal operation state, an early warning signal is issued, and the mine management system is linked to initiate a corresponding rescue response.

[0011] As a further solution of the present invention, the standard action model includes the following specific steps: Step Y1, analyzing the collected video data of the worker operating the pneumatic drill in a standard manner, and extracting key features of the worker operating the pneumatic drill, the key features including: the hand position of the worker holding the pneumatic drill, the angle of the drill bit when the worker uses the pneumatic drill, the arm position of the worker holding the pneumatic drill, and the position of the center of gravity of the worker's body when holding the pneumatic drill;

[0012] Step Y2, according to the extracted worker's hand position, drill bit angle, worker's arm position and center of gravity position, calculate the hand movement normative function , drill angle adjustment standard function , arm motion trajectory normative function and the normative function of the change of body center of gravity ;

[0013] Step Y3, sum the functions and calculate the first operation standard value .

[0014] As a further solution of the present invention, the first operation specification value The calculation formula is: ,

[0015] in, is the first operation specification value; is the total number of frames in the video; is the current frame index; The weight coefficient for the worker's hand position when holding the pneumatic drill; The weight coefficient of the drill bit angle when the worker holds the pneumatic drill; The weight factor for the worker's arm position when holding the pneumatic drill; The weight coefficient of the change in the center of gravity of the worker's body when holding the pneumatic drill; the standardization function of the hand movement satisfy ,in, For the The position of the worker’s hands during the frame; Standardize the hand position for workers to hold the pneumatic drill; The minimum deviation value of the hand position when the worker holds the pneumatic drill; the drill angle adjustment standard function satisfy , For the The angle of the drill bit when the worker uses the pneumatic drill during the frame; Standardize the angle of the drill bit when workers use air drills; The minimum deviation value of the drill bit angle when the worker uses the pneumatic drill; the normative function of the arm movement trajectory satisfy ,in, For the The position of the worker's arm when holding the pneumatic drill during the frame; The corresponding The position of the arm at the time of the frame; The minimum deviation value of the arm position when the worker holds the pneumatic drill; the normative function of the change of the center of gravity of the body satisfy ,in, For the The position of the worker's body center of gravity when holding the pneumatic drill during the frame; Standardize the center of gravity position of workers holding the pneumatic drill; It is the preset minimum deviation value of the worker's body center of gravity when using a pneumatic drill.

[0016] As a further solution of the present invention, video data of workers operating air drills in a standardized manner is collected by video monitoring equipment arranged in the mine operation area, including the following specific contents: the video monitoring equipment is installed on a fixed bracket slightly higher than the head in front of the worker operating the air drill, facing the working surface of the air drill at a top-down angle. This position can directly capture the operating actions of the worker's hands, including holding the air drill handle and adjusting the drill bit angle, and can also record the contact between the drill bit and the working surface and its movement trajectory. In order to avoid the worker's body blocking the key operating area, the position of the monitoring equipment needs to be slightly offset from the central axis, but remain parallel to the operating path of the air drill equipment. Secondly, another monitoring device is arranged on the side of the worker's operating area. This device can horizontally view the dynamics of the worker's sideways operation, record the movement of the arm and the change of the body's center of gravity during the operation. The side view can effectively supplement the operating details that may be missed by the front view, and provide a reference angle for observing the relative position between the equipment and the worker's body. In addition, the top monitoring device is installed above the operating area, capturing a plan view of the entire work scene by looking down vertically. This bird's-eye view can not only comprehensively monitor the workers' standing posture, movement path, and equipment location distribution, but also provide additional perspectives for when the pneumatic drill equipment is offset or the workers' movements are abnormal.

[0017] The ambient light in the mine is usually insufficient, so the video monitoring equipment must have a highly sensitive imaging sensor to generate high-quality images under low-light conditions; for extremely dark environments, an external LED light source is added to further improve the brightness and clarity of the picture. The video monitoring equipment operates at a frame rate of 30 frames per second to ensure that the fast movements of workers operating the pneumatic drill can be recorded smoothly. At the same time, a 1080p high-resolution camera is used to capture the details of the workers' hand movements and the slight changes in the pneumatic drill equipment. In addition, the real-time performance of the monitoring equipment also depends on the communication network conditions in the mine, and a connection is established with the data processing center through an industrial-grade wired network. Each video monitoring device transmits the collected video data to the data processing center in real time through the network. At the same time, the embedded preprocessing module of the video monitoring device is used for preliminary optimization, and a noise reduction model is established to reduce the noise of the collected video data of workers operating the pneumatic drill in a standardized manner to ensure the image quality. The formula of the noise reduction model is: ,

[0018] Where: is the pixel value after noise reduction processing, is the horizontal coordinate of the pixel in the image, is the vertical coordinate of the pixel in the image; is the radius of the filter window, and the window size is ; is a Gaussian weight function, which is used to weight the pixels in the domain. satisfy ,in, To control the parameters of the Gaussian function shape, determine the weight distribution range of pixels in the neighborhood; is the position in the original image The pixel value of is the weight normalization factor, which ensures that the sum of all weights is 1, thereby maintaining the scale consistency of the pixel values ​​and avoiding the pixel values ​​being too bright or too dark due to weighted summation.

[0019] As a further solution of the present invention, the video data of the worker operating the air drill collected in real time by the video monitoring device is imported into the standard action model to calculate the second operation standard value, including the following specific contents: through the high-resolution video monitoring device, the video data of the worker operating the air drill is captured in real time, and the video data is transmitted to the data processing center in the form of streaming media. The data processing center performs frame processing and feature extraction on the received video data, extracts key action feature points from each frame, and the extracted real-time feature data is then input into the pre-established standard action model for analysis. The standard action model performs multi-dimensional processing on the real-time feature points and calculates the second operation standard value, which quantifies the standardization degree of the worker's current operation behavior and is a comprehensive evaluation of the consistency between the current action and the standard action.

[0020] As a further solution of the present invention, the second operation standard value is compared with the first operation standard value to judge the standard degree of the current worker's operation, including the following specific contents: after calculating the second operation standard value, it is compared with the first operation standard value stored in the standard action model, the first operation standard value is an individual operation standard established based on a large amount of standard operation data, and is used to measure whether the current operation meets the predetermined standard. If the second operation standard value is less than or equal to the first operation standard value, it means that the deviation between the current operation and the standard action is within an acceptable range, and it is determined that the worker's operation behavior meets the standard; if the second operation standard value is greater than the first operation standard value, it means that the current operation deviates from the standard standard, and it is determined that the worker is in an abnormal operation state.

[0021] As a further solution of the present invention, when the worker's operation deviates from the predetermined specification and is determined to be an abnormal operation state, a warning signal is issued, and the mine management system is linked to initiate a corresponding rescue response, including the following specific contents: through real-time monitoring, it is determined that the second operation specification value is greater than the first operation specification value, indicating that the current worker's operation behavior deviates from the standard specification and is determined to be an abnormal operation state. At this time, a real-time warning signal will be immediately issued, and the alarm information will be transmitted to workers and managers in various ways. In the worker's operation area, the on-site sound and light alarm device will be activated, emitting high-frequency sound or flashing warning lights to attract the attention of workers and surrounding personnel, reminding them that there are potential risks in the current operation and requiring them to stop related operations immediately. In addition, the monitoring terminal in the mine control room displays specific alarm information, including the time of occurrence of the abnormal operation, the specific location of the worker, the real-time video clip of the current operation, and the preliminary analysis results of the abnormal type, providing reference data for managers to quickly evaluate and respond.

[0022] At the same time, the mine management system is linked to start the corresponding rescue response mechanism, and selects the appropriate response measures for the current abnormal situation according to the preset processing rules. If the abnormal behavior may cause the failure of the pneumatic drill equipment or a safety accident, a shutdown command is sent to the pneumatic drill equipment through the control interface to prevent the accident from further expanding; for more serious abnormal situations, such as workers losing balance or being pinched by the pneumatic drill equipment due to improper operation, the emergency rescue personnel at the mine site are immediately notified and accurate location information is provided to ensure that the rescue personnel can arrive at the scene in the shortest time to carry out rescue. In addition, the mine's emergency broadcast system is triggered to issue safety reminders to surrounding workers to prevent other workers from being affected by potential risks.

[0023] After completing the on-site alarm and initial rescue, the data related to the worker's abnormal operation is stored in the database, including the key feature point information of the worker's current operation, the conditions for the worker's abnormal operation, and the change trend of the standard value. The relevant data can be used by managers for in-depth analysis afterwards to evaluate the effectiveness of the current rescue response and provide a reference for the rapid handling of similar situations in the future. By statistics on abnormal behavior data, the existing operating standards and equipment management processes can be optimized, thereby further reducing the probability of risk occurrence.

[0024] The technical effects and advantages of a method for multi-point video mine identification and monitoring of its abnormal state of the present invention are as follows: the present invention arranges multi-view video monitoring equipment in the mine operation area, utilizes high-sensitivity imaging sensors, high frame rate and high-resolution cameras, thereby realizing high-quality collection and preliminary optimization of videos of workers operating pneumatic drills; calculates a first operation specification value based on a standard action model, and compares a second operation specification value calculated by real-time video data collection with the first operation specification value, thereby determining whether the manual operation is abnormal; when an abnormal operation is detected, various forms of early warning signals can be issued in time and the mine management system can be linked to initiate a corresponding rescue response, and abnormal operation data can be stored for subsequent analysis, thereby optimizing operation specifications and management processes, effectively improving the level of mine operation safety monitoring, reducing accident risks, ensuring worker safety, and improving mine management efficiency and intelligence. BRIEF DESCRIPTION OF THE DRAWINGS

[0025] Figure 1 The present invention is a flow chart of a method for multi-point video mine identification and abnormal state monitoring. DETAILED DESCRIPTION

[0026] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0027] Example 1

[0028] See also Figure 1 As shown in the flowchart, the embodiment of the present invention provides a method for mine identification and abnormal state monitoring based on multi-point video, which includes the following steps:

[0029] Step S1, collecting video data of workers operating a pneumatic drill in a standardized manner through video monitoring equipment arranged in the mine operation area;

[0030] Step S2, importing the acquired video data of the worker operating the pneumatic drill in a standardized manner into the standardized action model, and calculating a first standardized operation value of the worker operating the pneumatic drill;

[0031] Step S3, importing the video data of the worker operating the pneumatic drill collected in real time by the video monitoring device into the standard action model to calculate the second operation standard value;

[0032] Step S4, comparing the second operation standard value with the first operation standard value to determine the standardization degree of the current worker's operation;

[0033] Step S5: When the worker's operation deviates from the predetermined specification, it is determined to be an abnormal operation state, an early warning signal is issued, and the mine management system is linked to initiate a corresponding rescue response.

[0034] Furthermore, video data of workers operating pneumatic drills in a standardized manner is collected by video monitoring equipment arranged in the mine operation area, including the following specific contents: the video monitoring equipment is installed on a fixed bracket slightly higher than the head in front of the worker operating the pneumatic drill, facing the pneumatic drill working surface at a bird's-eye view. This position can directly capture the operating actions of the worker's hands, including the whole process of holding the pneumatic drill handle, adjusting the drill bit angle, starting and pushing the pneumatic drill, and can also record the contact between the drill bit and the working surface and its movement trajectory. In order to avoid the worker's body blocking the key operating area, the position of the monitoring equipment needs to be slightly offset from the central axis, but remain parallel to the operating path of the pneumatic drill equipment. Secondly, another monitoring device is arranged on the side of the worker's operating area. This device can horizontally view the dynamics of the worker's sideways operation, record the horizontal movement of the arm, the propulsion force of the pneumatic drill, and the changes in the body's center of gravity during the operation. The side view can effectively supplement the operating details that may be missed by the front view, and provide a reference angle for observing the relative position between the equipment and the worker's body. In addition, the top monitoring device is installed above the operating area, capturing a plan view of the entire work scene by looking down vertically. This bird's-eye view can not only comprehensively monitor the workers' standing posture, movement path, and equipment location distribution, but also provide additional perspectives for when the pneumatic drill equipment is offset or the workers' movements are abnormal.

[0035] The ambient light in the mine is usually insufficient, so the video monitoring equipment must have a highly sensitive imaging sensor to generate high-quality images under low-light conditions; for extremely dark environments, an external LED light source is added to further improve the brightness and clarity of the picture. The video monitoring equipment operates at a frame rate of 30 frames per second to ensure that the fast movements of workers operating the pneumatic drill can be recorded smoothly. At the same time, a 1080p high-resolution camera is used to capture the details of the workers' hand movements and the slight changes in the pneumatic drill equipment. In addition, the real-time performance of the monitoring equipment also depends on the communication network conditions in the mine, and a connection is established with the data processing center through an industrial-grade wired network. Each video monitoring device transmits the collected video data to the data processing center in real time through the network. At the same time, the embedded preprocessing module of the video monitoring device is used for preliminary optimization, and a noise reduction model is established to reduce the noise of the collected video data of workers operating the pneumatic drill in a standardized manner to ensure the image quality. The formula of the noise reduction model is: ,

[0036] Where: is the pixel value after noise reduction processing, is the horizontal coordinate of the pixel in the image, is the vertical coordinate of the pixel in the image; is the radius of the filter window, and the window size is ; is a Gaussian weight function, which is used to weight the pixels in the domain. satisfy ,in, To control the parameters of the Gaussian function shape, determine the weight distribution range of pixels in the neighborhood; is the position in the original image The pixel value of is the weight normalization factor, which ensures that the sum of all weights is 1, thereby maintaining the scale consistency of the pixel values ​​and avoiding the pixel values ​​being too bright or too dark due to weighted summation.

[0037] Furthermore, the acquired video data of the worker operating the pneumatic drill in a standardized manner is imported into the standardized action model, and the first operation standard value of the worker operating the pneumatic drill is calculated, including the following specific contents: the collected video data of the worker operating the pneumatic drill in a standardized manner is analyzed, and the key feature points when the worker operates the pneumatic drill are extracted. The key feature points reflect the core information of the worker's operation action, including the movement trajectory and posture changes of the hands, arms and body. The extraction of the key feature points is achieved by processing the video frames frame by frame, and the joints, limbs and equipment interaction points of the worker during the operation are located from the video screen. When the worker holds the pneumatic drill handle, the feature points include the position of the worker's hand when holding the pneumatic drill, the angle of the drill bit when the worker uses the pneumatic drill, and the trajectory of the arm movement. The trajectory of the arm movement is calculated by the position change of multiple frames of continuous key points. In order to ensure the comprehensiveness of motion capture, it is also necessary to extract the changes in the center of gravity of the worker's body during the operation. The extracted key feature points constitute the original data set of the worker's operation behavior, establish a standardized action model, and calculate the first operation standard value. The formula of the standardized action model is:

[0038] ,

[0039] Where: is the first operation standard value, which is used to quantify the standardization of workers' operation of the pneumatic drill; is the total number of frames in the video; is the current frame index; For the The position of the worker’s hands during the frame; Standardize the hand position for workers to hold the pneumatic drill; It is the preset minimum deviation value of the worker's hand position when holding the pneumatic drill; The weight coefficient for the worker's hand position when holding the pneumatic drill; For the The angle of the drill bit when the worker uses the pneumatic drill during the frame; Standardize the angle of the drill bit when workers use air drills; The minimum deviation value of the drill bit angle when the worker uses the pneumatic drill is preset; The weight coefficient of the drill bit angle when the worker holds the pneumatic drill; For the The position of the worker's arm when holding the pneumatic drill during the frame; The corresponding The position of the arm at the time of the frame; It is the preset minimum deviation value of the worker's arm position when holding the pneumatic drill; The weight factor for the worker's arm position when holding the pneumatic drill; For the The position of the worker's body center of gravity when holding the pneumatic drill during the frame; Standardize the center of gravity position of workers holding the pneumatic drill; The preset minimum deviation value of the worker's body center of gravity when using the pneumatic drill; is the weight coefficient of the change in the center of gravity of the worker's body when holding the pneumatic drill; the standard action model is used to analyze and calculate the key feature points frame by frame to comprehensively evaluate the standardization of the worker's actions when operating the pneumatic drill.

[0040] Furthermore, the video data of the worker operating the air drill collected in real time by the video monitoring device is imported into the standard action model to calculate the second operation standard value, including the following specific contents: through high-resolution video monitoring equipment, the video data of the worker operating the air drill is captured in real time, and the video data is transmitted to the data processing center in the form of streaming media. The data processing center performs frame processing and feature extraction on the received video data, extracts key action feature points from each frame, and the extracted real-time feature data is then input into the pre-established standard action model for analysis. The standard action model performs multi-dimensional processing on the real-time feature points and calculates the second operation standard value, which quantifies the standardization degree of the worker's current operation behavior and is a comprehensive evaluation of the consistency between the current action and the standard action.

[0041] Furthermore, the second operation standard value is compared with the first operation standard value to judge the standard degree of the current worker's operation, including the following specific contents: after calculating the second operation standard value, it is compared with the first operation standard value stored in the standard action model, the first operation standard value is an individual operation standard established based on a large amount of standard operation data, and is used to measure whether the current operation meets the predetermined standard. If the second operation standard value is less than or equal to the first operation standard value, it means that the deviation between the current operation and the standard action is within an acceptable range, and it is determined that the worker's operation behavior meets the standard; if the second operation standard value is greater than the first operation standard value, it means that the current operation deviates from the standard standard, and it is determined that the worker is in an abnormal operation state.

[0042] Furthermore, when the worker's operation deviates from the predetermined specifications and is determined to be an abnormal operation state, a warning signal is issued, and the mine management system is linked to initiate a corresponding rescue response, including the following specific contents: through real-time monitoring, it is determined that the second operation specification value is greater than the first operation specification value, indicating that the current worker's operation behavior deviates from the standard specifications and is determined to be an abnormal operation state. At this time, a real-time warning signal will be issued immediately, and the alarm information will be transmitted to workers and managers in various ways. In the worker's operation area, the on-site sound and light alarm device will be activated, emitting high-frequency sounds or flashing warning lights to attract the attention of workers and surrounding personnel, reminding them that there are potential risks in the current operation and requiring them to stop related operations immediately. In addition, the monitoring terminal in the mine control room displays specific alarm information, including the time of occurrence of the abnormal operation, the specific location of the worker, the real-time video clips of the current operation, and the preliminary analysis results of the abnormal type, providing reference data for managers to quickly evaluate and respond.

[0043] At the same time, the mine management system is linked to start the corresponding rescue response mechanism, and selects the appropriate response measures for the current abnormal situation according to the preset processing rules. If the abnormal behavior may cause the failure of the pneumatic drill equipment or a safety accident, a shutdown command is sent to the pneumatic drill equipment through the control interface to prevent the accident from further expanding; for more serious abnormal situations, such as workers losing balance or being pinched by the pneumatic drill equipment due to improper operation, the emergency rescue personnel at the mine site are immediately notified and accurate location information is provided to ensure that the rescue personnel can arrive at the scene in the shortest time to carry out rescue. In addition, the mine's emergency broadcast system is triggered to issue safety reminders to surrounding workers to prevent other workers from being affected by potential risks.

[0044] After completing the on-site alarm and initial rescue, the data related to the worker's abnormal operation is stored in the database, including the key feature point information of the worker's current operation, the conditions for the worker's abnormal operation, and the change trend of the standard value. The relevant data can be used by managers for in-depth analysis afterwards to evaluate the effectiveness of the current rescue response and provide a reference for the rapid handling of similar situations in the future. By statistics on abnormal behavior data, the existing operating standards and equipment management processes can be optimized, thereby further reducing the probability of risk occurrence.

[0045] The present invention arranges multi-viewing angle video monitoring equipment in the mine operation area, utilizes high-sensitivity imaging sensors, high frame rate and high-resolution cameras, thereby realizing high-quality collection and preliminary optimization of videos of workers operating pneumatic drills; calculates a first operation specification value based on a standard action model, and compares a second operation specification value calculated by real-time video data collection with the first operation specification value, thereby determining whether the worker's operation is abnormal; when an abnormal operation is detected, various forms of early warning signals can be promptly issued, and the mine management system can be linked to initiate a corresponding rescue response, and abnormal operation data can be stored for subsequent analysis, thereby optimizing operation specifications and management processes, effectively improving the level of mine operation safety monitoring, reducing accident risks, ensuring worker safety, and improving mine management efficiency and intelligence.

[0046] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art who is familiar with the present technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

[0047] Finally: The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present invention should be included in the protection scope of the present invention.

Claims

1. A method for monitoring abnormal conditions of mine operations using multi-point video, characterized in that: The steps include: Step S1, collecting video data of workers operating a pneumatic drill in a standardized manner through video monitoring equipment arranged in the mine operation area; Step S2, importing the acquired video data of the worker operating the pneumatic drill in a standardized manner into the standardized action model, and calculating a first standardized operation value of the worker operating the pneumatic drill; Step S3, importing the video data of the worker operating the pneumatic drill collected in real time by the video monitoring device into the standard action model to calculate the second operation standard value; Step S4, comparing the second operation standard value with the first operation standard value to determine the standardization degree of the current worker's operation; Step S5: When the worker's operation deviates from the predetermined specification, it is determined to be an abnormal operation state, an early warning signal is issued, and the mine management system is linked to initiate a corresponding rescue response; The standard action model includes the following specific steps: Step Y1, analyzing the collected video data of the worker operating the pneumatic drill in a standardized manner, and extracting key features of the worker operating the pneumatic drill, wherein the key features include: the position of the worker's hand when holding the pneumatic drill, the angle of the drill bit when the worker uses the pneumatic drill, the position of the worker's arm when holding the pneumatic drill, and the position of the worker's body center of gravity when holding the pneumatic drill; Step Y2, according to the extracted worker's hand position, drill bit angle, worker's arm position and center of gravity position, calculate the hand movement normative function , drill angle adjustment standard function , arm motion trajectory normative function and the normative function of the change of body center of gravity ; Step Y3, sum the functions and calculate the first operation standard value ; The first operation specification value The calculation formula is: , in, is the first operation specification value; is the total number of frames in the video; is the current frame index; The weight coefficient for the worker's hand position when holding the pneumatic drill; The weight coefficient of the drill bit angle when the worker holds the pneumatic drill; The weight factor for the worker's arm position when holding the pneumatic drill; The weight coefficient of the change in the center of gravity of the worker's body when holding the pneumatic drill; the standardization function of the hand movement satisfy ,in, For the The position of the worker’s hands during the frame; Standardize the hand position for workers to hold the pneumatic drill; The minimum deviation value of the hand position when the worker holds the pneumatic drill; the drill angle adjustment standard function satisfy , For the The angle of the drill bit when the worker uses the pneumatic drill during the frame; Standardize the angle of the drill bit when workers use air drills; The minimum deviation value of the drill bit angle when the worker uses the pneumatic drill; the normative function of the arm movement trajectory satisfy ,in, For the The position of the worker's arm when holding the pneumatic drill during the frame; The corresponding The position of the arm at the time of the frame; The minimum deviation value of the arm position when the worker holds the pneumatic drill; the normative function of the change of the center of gravity of the body satisfy ,in, For the The position of the worker's body center of gravity when holding the pneumatic drill during the frame; Standardize the center of gravity position of workers holding the pneumatic drill; The preset minimum deviation value of the worker's body center of gravity when using the pneumatic drill; In step S1, the collected video data of the worker operating the pneumatic drill in a standardized manner is subjected to noise reduction processing to ensure the image quality. The formula of the noise reduction model is: , Where: is the pixel value after noise reduction processing, is the horizontal coordinate of the pixel in the image, is the vertical coordinate of the pixel in the image; is the radius of the filter window, and the window size is ; is a Gaussian weight function, which is used to weight the pixels in the domain. satisfy ,in, To control the parameters of the Gaussian function shape, determine the weight distribution range of pixels in the neighborhood; is the position in the original image The pixel value of is the weight normalization factor, ensuring that the sum of all weights is 1, thus maintaining the scale consistency of pixel values.

2. The method for monitoring abnormal conditions of mine operations using multi-point video according to claim 1, characterized in that: In step S1, the video monitoring device is installed on a fixed bracket slightly higher than the head in front of the worker operating the pneumatic drill, facing the working surface of the pneumatic drill at a top-down angle, and is slightly offset from the central axis and parallel to the operating path of the pneumatic drill equipment, so as to capture the worker's two-hand operating movements and drill-related conditions.

3. The method for monitoring abnormal state of mine operation by multi-point video according to claim 1, characterized in that: In step S1, another monitoring device is arranged on the side of the worker's operating area to horizontally observe the worker's sideways operating dynamics, record the horizontal movement of the arm and the change of the body's center of gravity, and supplement the operating details missed by the frontal view.

4. The method for monitoring abnormal conditions of mine operations using multi-point video according to claim 1, characterized in that: In step S1, the video monitoring device has a high-sensitivity imaging sensor to generate high-quality images under low-light conditions. In extremely dark environments, an external LED light source is added to improve brightness and clarity. The video monitoring device operates at a frame rate of 30 frames per second and uses a 1080p high-resolution camera to capture details.

5. The method for monitoring abnormal state of mine operation by multi-point video according to claim 1, characterized in that: In step S5, when an abnormal operation state is detected, a real-time warning signal is issued, an on-site sound and light alarm device is activated in the worker operation area, and an alarm message is displayed on the monitoring terminal in the mine control room.

6. The method for monitoring abnormal conditions of mine operations using multi-point video according to claim 1, characterized in that: In step S5, when an abnormal operation state is detected, the mine management system is linked to start a corresponding rescue response mechanism, including sending a shutdown command to the pneumatic drilling equipment, notifying emergency rescue personnel and triggering an emergency broadcast system according to the abnormal situation.

Images