Underground station constructor operation risk identification method and device, terminal and medium

Abstract

The invention provides an underground station constructor operation risk identification method and device, a terminal and a medium. The method comprises the following steps: acquiring monitoring video data in real time through a plurality of cameras arranged in an underground station; preprocessing the monitoring video data to obtain monitoring image information; detecting safety protection equipment and human body skeleton points in the monitoring image information to obtain personnel skeleton point information and protection equipment position information; and according to the personnel skeleton point information and the protection equipment position information, determining the operation risk of the construction personnel. According to the invention, the collected monitoring video is preprocessed, the position of the safety protection equipment and the position of the human skeleton point are identified, and whether the constructor correctly wears the safety belt and the safety helmet or not is judged according to the position of the safety protection equipment and the position of the human skeleton point; the operation risk identification accuracy of constructors in the underground station is improved, and the frequency of triggering error risk prompts is reduced.

Description

Technical Field

[0001] This invention relates to the field of machine vision technology, specifically to a method, device, terminal, and medium for identifying operational risks of construction workers in underground stations. Background Technology

[0002] Urban rail transit is a vital public welfare project, crucial to the realization of overall urban planning and regional economic development. While most urban rail transit projects are underground, some are elevated. Unlike standard-floor construction in building construction, urban rail transit buildings are tall with diverse functional rooms, presenting unique characteristics for safety risk control. Safety management involves numerous and widespread points, and each station has a unique layout. Identifying operational risks for construction workers in underground stations is essential for achieving safety management goals. Relying solely on a limited number of safety management personnel makes safety control challenging, necessitating the introduction of technological means to enhance safety management.

[0003] Currently, in underground station construction scenarios, in order to improve the effectiveness of construction personnel management and construction safety, it is often necessary to set up image acquisition equipment to collect construction monitoring images, identify and locate construction personnel based on the construction monitoring images, and then determine whether there are any safety hazards in the construction personnel's work based on the construction monitoring images. If it is determined that the construction personnel's work is unsafe, a risk warning will be issued.

[0004] However, in existing underground station construction scenarios, the accuracy of identifying risks to construction workers is low, which easily triggers erroneous risk warnings. Summary of the Invention

[0005] To address the shortcomings of existing technologies, this invention proposes a method for identifying operational risks of construction workers in underground stations, aiming to improve the accuracy of risk identification and reduce the number of times erroneous risk warnings are triggered.

[0006] In a first aspect, embodiments of this application provide a method for identifying operational risks for construction workers in underground railway stations, including: Monitoring video data collected in real time by multiple cameras installed in the underground station; The monitoring video data is preprocessed to obtain monitoring image information; By detecting the safety protection equipment and human skeletal points in the monitored image information, the skeletal point information of the person and the location information of the protection equipment are obtained. Based on the personnel skeletal information and the location information of the protective equipment, the operational risks for construction workers are determined.

[0007] Optionally, obtaining personnel skeletal information and protective equipment location information by detecting safety protection equipment and human skeletal points in the monitored image information includes: The human skeleton point information is obtained by detecting human skeleton points in the detected image information using a human skeleton point recognition algorithm.

[0008] Optionally, obtaining personnel skeletal point information and protective equipment location information by detecting safety protection equipment and human skeletal points in the monitored image information includes: performing protective equipment detection on the detection image in the detection image information using a protective equipment recognition algorithm to obtain protective equipment location information.

[0009] Optionally, determining the operational risk of construction workers based on the personnel skeletal information and the location information of the protective equipment includes: Based on the skeletal point information of the personnel, determine whether the orientation of the construction personnel in the detection image meets the condition of facing forward; If the orientation of the construction worker meets the condition of facing forward, the operational risk of the construction worker is determined based on the skeletal information of the worker and the location information of the protective equipment. If the orientation of the construction workers does not meet the frontal orientation condition, then the orientation of the construction workers in the next detection image is checked to see if it meets the frontal orientation condition.

[0010] Optionally, the orientation of the construction workers satisfies the condition of facing forward, including: Based on the position coordinates of the corresponding bone points in the personnel skeletal point coordinate information, calculate the distance ratio between the distance between the left and right hip joints and the distance between the midpoint of the hip and shoulder. If the distance ratio is greater than the first preset ratio threshold and the personnel skeletal point coordinate information meets the conditions for bone point detection and acquisition.

[0011] Optionally, determining the operational risk of construction workers based on the personnel skeletal information and the location information of the protective equipment includes: Based on the skeletal information of the person and the position information of the protective equipment, the wearing posture of the protective equipment is determined, and the wearing posture is compared with the standard wearing posture to determine whether the correct wearing conditions are met. If the protective equipment worn by the construction workers meets the requirements for proper wearing, then the risk of the construction workers' work is determined to be low. If the protective equipment worn by construction workers does not meet the requirements for proper wearing, then the risk of the construction workers' work is determined to be high.

[0012] Optionally, the personnel skeletal point information includes the detection image sequence number and the personnel skeletal point coordinate information corresponding to the detection image; the personnel skeletal point coordinate information includes the coordinates of the left hip joint, right hip joint, left shoulder, right shoulder, left ear, right ear, and nose; the protective equipment location information includes the detection image sequence number and the protective equipment coordinate information corresponding to the detection image; wherein, the protective equipment coordinate information includes the coordinates of the left leg adjustment buckle, right leg adjustment buckle, left shoulder adjustment buckle, right shoulder adjustment buckle, waist belt adjustment buckle, chest adjustment buckle, back support ring, and chin strap buckle; the construction worker's protective equipment does not meet the correct wearing conditions, including: If the angle between the straight line connecting the left shoulder point and the waist belt adjustment buckle and the straight line connecting the right leg adjustment buckle and the waist belt adjustment buckle is less than the first angle threshold, then the protective equipment worn by the construction worker does not meet the conditions for correct wearing. Alternatively, if the angle between the straight line of the right shoulder point and the waist belt adjustment buckle and the straight line of the left leg adjustment buckle and the waist belt adjustment buckle is less than the second angle threshold, then the protective equipment of the construction worker does not meet the conditions for correct wearing. Alternatively, if the angle between the straight line of the left shoulder point and the left shoulder adjustment buckle and the straight line of the left shoulder adjustment buckle and the waist belt adjustment buckle is less than the third angle threshold, then the protective equipment of the construction worker does not meet the conditions for correct wearing. Alternatively, if the angle between the straight line of the right shoulder point and the right shoulder adjustment buckle and the straight line of the right shoulder adjustment buckle and the waist belt adjustment buckle is less than the fourth angle threshold, then the protective equipment of the construction worker does not meet the conditions for correct wearing. Alternatively, if the angle between the straight line of the right shoulder point and the right shoulder adjustment buckle and the straight line of the left leg adjustment buckle and the right shoulder adjustment buckle is less than the fifth angle threshold, then the protective equipment worn by the construction worker does not meet the conditions for correct wearing. Alternatively, if the angle between the straight line of the left shoulder point and the left shoulder adjustment buckle and the straight line of the right leg adjustment buckle and the left shoulder adjustment buckle is less than the sixth angle threshold, then the protective equipment of the construction worker does not meet the conditions for correct wearing. Alternatively, if the angle between the straight line of the waist adjustment buckle and the chest adjustment buckle and the straight line of the chest adjustment buckle and the nose point is less than the seventh angle threshold, then the protective equipment of the construction worker does not meet the conditions for correct wearing; or, if the angle between the straight line of the left shoulder point and the back load-bearing ring and the straight line of the right hip joint point and the back load-bearing ring is less than the eighth angle threshold, then the protective equipment of the construction worker does not meet the conditions for correct wearing. Alternatively, if the angle between the straight line connecting the right shoulder point and the back support ring and the straight line connecting the left hip joint point and the back support ring is less than the ninth angle threshold, then the protective equipment worn by the construction worker does not meet the conditions for proper wearing. Alternatively, if the difference between the distance between the chin strap buckle point and the left ear point and the distance between the chin strap buckle point and the right ear point, and the ratio of the minimum distance between the chin strap buckle point and the left and right ear points, is greater than the second preset ratio threshold, then the protective equipment worn by the construction personnel does not meet the conditions for correct wearing.

[0013] Optionally, the preprocessing of the monitoring video data to obtain monitoring image information includes: The monitored video data within a preset time range is processed by frame extraction to obtain video frame image information; The blurred and repetitive images in the video frame image information are cleaned to obtain cleaned image information; The cleaned image information is subjected to noise reduction, flipping, cropping, scaling and other processing to obtain processed image information; Brightness recognition and adjustment are performed on the processed image information to obtain monitoring image information.

[0014] Secondly, embodiments of this application provide a risk identification device for underground station construction workers, comprising: The data acquisition module is used to collect monitoring video data in real time through multiple cameras installed in the underground station; The image preprocessing module is used to preprocess the monitoring video data to obtain monitoring image information; The location information determination module is used to obtain personnel skeletal point information and protective equipment location information by detecting safety protection equipment and human skeletal points in the monitored image information; The operation risk determination module is used to determine the operation risk of construction personnel based on the personnel skeletal information and the location information of the protective equipment.

[0015] Thirdly, embodiments of this application provide a terminal device, including a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, it implements the underground station construction worker operation risk identification method as described in any of the first aspects above.

[0016] Fourthly, embodiments of this application provide a computer-readable storage medium storing a computer program that, when executed by a processor, implements the method for identifying operational risks of underground station construction workers as described in any of the first aspects above.

[0017] Fifthly, embodiments of this application provide a computer program product that, when run on a terminal device, causes the terminal device to execute the underground station construction worker risk identification method described in any of the first aspects above.

[0018] In this embodiment, monitoring video data is collected in real time by multiple cameras installed in the underground station. The monitoring video data is preprocessed to obtain monitoring image information. By detecting safety protection equipment and human skeletal points in the monitoring image information, personnel skeletal point information and the location information of the protection equipment are obtained. Based on the personnel skeletal point information and the location information of the protection equipment, the operational risks of construction workers are determined. This application improves the accuracy of identifying operational risks of construction workers in underground stations and reduces the number of times erroneous risk warnings are triggered by preprocessing the collected monitoring video, identifying the location of safety protection equipment and the location of human skeletal points, and determining whether construction workers are correctly wearing safety belts and helmets based on the location of the safety protection equipment and the location of the human skeletal points. Attached Figure Description

[0019] To more clearly illustrate the specific embodiments of the present invention or the technical solutions in the prior art, the accompanying drawings used in the description of the specific embodiments or the prior art will be briefly introduced below. In all the drawings, similar elements or parts are generally identified by similar reference numerals. In the drawings, the elements or parts are not necessarily drawn to scale.

[0020] Figure 1 This is a flowchart illustrating the first embodiment of risk identification for underground station construction workers provided in this application. Figure 2 This is a schematic diagram of the structure of the underground station construction worker risk identification device provided in the embodiments of this application; Figure 3 This is a schematic diagram of the structure of the terminal device provided in the embodiments of this application. Detailed Implementation

[0021] In the following description, specific details such as particular system architectures and techniques are set forth for illustrative purposes and not for limitation, in order to provide a thorough understanding of the embodiments of this application. However, those skilled in the art will understand that this application may also be implemented in other embodiments without these specific details. In other instances, detailed descriptions of well-known systems, apparatuses, circuits, and methods have been omitted so as not to obscure the description of this application with unnecessary detail.

[0022] It should be understood that, when used in this application specification and the appended claims, the term "comprising" indicates the presence of the described features, integrals, steps, operations, elements and / or components, but does not exclude the presence or addition of one or more other features, integrals, steps, operations, elements, components and / or a collection thereof.

[0023] It should also be understood that the term “and / or” as used in this application specification and the appended claims means any combination of one or more of the associated listed items and all possible combinations, and includes such combinations.

[0024] The execution entity of the underground station construction worker operation risk identification method provided in this application embodiment can be an underground station construction worker operation risk identification device. The underground station construction worker operation risk identification device collects monitoring video data in real time through multiple cameras installed in the underground rail transit station; preprocesses the monitoring video data to obtain monitoring image information; obtains personnel skeletal point information and protective equipment location information by detecting safety protection equipment and human skeletal points in the monitoring image information; and determines the operation risk of construction workers based on the personnel skeletal point information and the protective equipment location information.

[0025] Figure 1 This illustration shows a flowchart of a first embodiment of the method for identifying operational risks of underground station construction workers provided in this application. It is provided as an example and not as a limitation; this method can be applied to the aforementioned device for identifying operational risks of underground station construction workers. Figure 1 As shown, the method may include: S10 uses multiple cameras installed in the underground station to collect real-time monitoring video data; To improve the accuracy of identifying operational risks for construction workers and reduce the frequency of triggering false risk warnings, the construction worker operational risk identification device in underground stations uses real-time monitoring video data collected by multiple cameras installed within the underground rail transit station. One camera can be installed at each entrance / exit of the underground rail transit station, and another camera can be installed in areas with dense pipelines and significant safety hazards in the equipment area.

[0026] S20, preprocess the monitoring video data to obtain monitoring image information; After acquiring monitoring video data, the risk identification device for construction workers in underground stations preprocesses the monitoring video data to obtain monitoring image information.

[0027] Considering the image recognition capabilities of cameras under power outage conditions within the station, and the obstacles to target capture caused by strong light, backlight, and shadows at the construction site, the selection of camera types was made to meet the information collection requirements of cameras in urban rail transit underground stations. Furthermore, the monitoring video data acquired from underground stations underwent light processing to improve the accuracy of risk identification for construction workers at underground stations.

[0028] As one implementation method, after acquiring monitoring video data, the underground station construction worker operation risk identification device preprocesses the monitoring video data to obtain monitoring image information. This preprocessing may include: extracting frames from the monitoring video data within a preset time range to obtain video frame image information; cleaning up blurry or repetitive images in the video frame image information to obtain cleaned image information; performing noise reduction, flipping, cropping, scaling, and other processing on the cleaned image information to obtain processed image information; and performing brightness recognition and brightness adjustment on the processed image information to obtain monitoring image information.

[0029] As another implementation, the cleaned image information is subjected to noise reduction, flipping, cropping, scaling and other processing to obtain processed image information. This may include: performing noise reduction on the cleaned image information through a convolutional neural network to obtain denoised image information; and performing flipping, cropping, scaling and other processing on the images in the denoised image information to obtain processed image information.

[0030] As another implementation, performing brightness recognition and brightness adjustment on the processed image information to obtain monitoring image information may include: performing brightness recognition on each processed image in the processed image information to obtain image brightness information; determining brightness adjustment parameters through the image brightness information; and processing the image information by calling a brightness compensation model, a highlight suppression model, and a detail enhancement model according to the brightness adjustment parameters to obtain monitoring image information.

[0031] Once the image brightness information is determined, that is, once the image brightness is determined, the brightness that the image needs to be adjusted (that is, the brightness that needs to be compensated, suppressed, or enhanced for detail) can be determined based on the image brightness.

[0032] Among them, the brightness adjustment parameters are ; in This is the brightness compensation coefficient; This is the specular suppression coefficient; Enhancement factor for details; This represents the average image brightness. This represents the maximum brightness value. The standard deviation of image grayscale values.

[0033] The brightness compensation model uses a U-Net structure; the specular highlight suppression model uses a GAN architecture; and the specular highlight suppression model... The discriminator of the specular suppression model uses a PatchGAN structure; the loss function of the specular suppression model is the sum of the Wasserstein distance (distance between distributions) and the perceptual loss. The detail enhancement model uses a wavelet transform structure.

[0034] S30, by detecting the safety protection equipment and human skeletal points in the monitored image information, the personnel skeletal point information and the location information of the protection equipment are obtained; After acquiring monitoring image information, the underground station construction worker operation risk identification device obtains personnel skeletal information and protective equipment location information by detecting safety protection equipment and human skeletal points in the monitoring image information.

[0035] The step of obtaining personnel skeletal information and protective equipment location information by detecting safety protection equipment and human skeletal points in the monitored image information may include: The human skeleton point information is obtained by detecting human skeleton points in the detected image information using a human skeleton point recognition algorithm.

[0036] After acquiring monitoring image information, the underground station construction worker operation risk identification device uses the OpenPose algorithm to detect human skeleton points in the detected images to obtain human skeleton point information. The human skeleton point information includes the detection image number and the coordinate information of the human skeleton point corresponding to the detection image. The coordinate information of the human skeleton point includes the coordinates of the left hip joint, right hip joint, left shoulder, right shoulder, left ear, right ear, and nose. The step of obtaining personnel skeletal information and protective equipment location information by detecting safety protection equipment and human skeletal points in the monitored image information may further include: The protective equipment location information is obtained by detecting the protective equipment in the detection image information using a protective equipment identification algorithm.

[0037] After acquiring monitoring image information, the underground station construction worker operation risk identification device uses the YOLOv8-Pose algorithm to detect protective equipment in the detected images to obtain the location information of the protective equipment. The location information of the protective equipment includes the detection image number and the coordinate information of the protective equipment corresponding to the detection image. The coordinate information of the protective equipment includes the coordinates of the left leg adjustment buckle, the right leg adjustment buckle, the left shoulder adjustment buckle, the right shoulder adjustment buckle, the waist belt adjustment buckle, the chest adjustment buckle, the back support ring, and the chin strap buckle.

[0038] Among them, the coordinates of the left leg adjustment buckle are the coordinates of the left leg adjustment buckle; the coordinates of the right leg adjustment buckle are the coordinates of the right leg adjustment buckle; the coordinates of the left shoulder adjustment buckle are the coordinates of the left shoulder adjustment buckle; the coordinates of the right shoulder adjustment buckle point are the coordinates of the right shoulder adjustment buckle point; the coordinates of the waist belt adjustment buckle are the coordinates of the waist belt adjustment buckle; the coordinates of the chest adjustment buckle are the coordinates of the chest adjustment buckle; the coordinates of the back support ring are the coordinates of the back support ring; and the coordinates of the chin strap buckle point are the coordinates of the chin strap buckle point.

[0039] The five-point safety harness includes: a left leg adjustment buckle for adjusting the length of the strap securing the worker's left leg based on the thickness of their left leg; a right leg adjustment buckle for adjusting the length of the strap securing the worker's right leg based on the thickness of their right leg; a left shoulder adjustment buckle for adjusting the distance between the worker's left shoulder and the waist belt (the length of the left shoulder strap) based on their body length; and a right shoulder adjustment buckle for adjusting the length of the strap based on the worker's body length. The distance between the worker's right shoulder and the waist belt (length of the right shoulder belt); the waist belt adjustment buckle is used to adjust and fix the length of the worker's waist belt according to the worker's waist size when wearing the five-point outdoor safety harness; the chest adjustment buckle is used to adjust and fix the distance between the two shoulder straps according to the worker's chest size when wearing the five-point outdoor safety harness; the back support ring is a connection point set on the worker's back to support the worker's weight when wearing the five-point outdoor safety harness; the chin strap buckle point is the location of the safety component set on the worker's chin when wearing the safety helmet.

[0040] S40, determine the operational risks of construction workers based on the personnel skeletal information and the location information of the protective equipment.

[0041] After acquiring information about the skeletal structure of workers and the location of protective equipment, the risk identification device for construction workers at underground stations determines the operational risks of construction workers based on the skeletal structure information and the location of protective equipment.

[0042] Determining the operational risk of construction workers based on the personnel skeletal information and the location information of the protective equipment may include: determining whether the orientation of the construction workers in the detection image meets the frontal orientation condition based on the personnel skeletal information; if the orientation of the construction workers meets the frontal orientation condition, then determining the operational risk of the construction workers based on the personnel skeletal information and the location information of the protective equipment; if the orientation of the construction workers does not meet the frontal orientation condition, then detecting whether the orientation of the construction workers in the next detection image meets the frontal orientation condition.

[0043] In one implementation, the orientation of the construction worker satisfies the condition of facing forward. This is achieved by calculating the ratio between the distance between the left and right hip joints and the distance between the midpoints of the hip and shoulder joints, based on the position coordinates of the corresponding bone points in the worker's skeletal coordinate information. If this ratio is greater than a first preset threshold and the worker's skeletal coordinate information meets the bone point detection acquisition conditions, then the worker's orientation satisfies the condition of facing forward. Specifically, the bone point detection acquisition conditions are that the worker's skeletal coordinate information contains bone point coordinates that can accurately identify the worker's orientation towards the camera. That is, the first condition is that the worker's skeletal coordinate information includes coordinates of the left ear, right ear, left hip joint, right hip joint, left shoulder, and right shoulder. The distance ratio is greater than the first preset threshold because the ratio between the distances of the hip joints and the distance between the midpoints of the hip and shoulder joints is greater than the first preset threshold.

[0044] Specifically, the ratio between the distance between the left and right hip joints and the distance between the midpoint of the hip and shoulder is calculated. If this ratio is greater than a first preset threshold, the worker's orientation meets the requirement of facing forward. This can include: If R > the first preset proportional threshold, then the orientation of the construction workers meets the frontal orientation condition.

[0045] If R ≤ the first preset ratio threshold, then the orientation of the construction workers does not meet the frontal orientation condition.

[0046] Among them, the ratio of the distance between the hip joints to the distance between the midpoints of the hip and shoulder is... ; Distance between left and right hip joints It can be done Perform calculations; Among them, the coordinates of the left hip joint point for Coordinates of the right hip joint for The distance between the midpoints of the hip and shoulder can be calculated by the distance between the midpoints of the hip and the midpoints of the shoulder. Among them, the midpoint of the hip coordinates ; midpoint of the shoulder coordinates ; Among them, the left shoulder point The coordinates are Right shoulder point The coordinates are ; Among them, the distance between the midpoints of the hip and shoulder ; The first preset ratio threshold is 0.3, 0.35, 0.4, 0.45 or 0.5, and the preset ratio threshold is preferably 0.35.

[0047] As one implementation method, determining the operational risk of construction workers based on the personnel skeletal information and the location information of the protective equipment includes: determining the wearing posture of the protective equipment based on the personnel skeletal information and the location information of the protective equipment, and comparing the wearing posture with the standard wearing posture to determine whether the correct wearing conditions are met; if the construction worker's protective equipment meets the correct wearing conditions, the operational risk of the construction worker is determined to be low; if the construction worker's protective equipment does not meet the correct wearing conditions, the operational risk of the construction worker is determined to be high.

[0048] As another implementation, if any one of the following ten wearing conditions occurs, the protective equipment worn by the construction worker does not meet the correct wearing requirements. The personnel skeletal point information includes the detection image sequence number and the corresponding coordinate information of the personnel skeletal points; the personnel skeletal point coordinate information includes the coordinates of the left hip joint, right hip joint, left shoulder, right shoulder, left ear, right ear, and nose; the protective equipment position information includes the detection image sequence number and the corresponding coordinate information of the protective equipment; wherein, the protective equipment coordinate information includes the coordinates of the left leg adjustment buckle, right leg adjustment buckle, left shoulder adjustment buckle, right shoulder adjustment buckle, waist belt adjustment buckle, chest adjustment buckle, back support ring, and chin strap buckle. As another implementation method, the protective equipment worn by construction workers does not meet the requirements for proper wearing, including: If the angle between the straight line connecting the left shoulder point and the waist belt adjustment buckle and the straight line connecting the right leg adjustment buckle and the waist belt adjustment buckle is less than the first angle threshold, then the protective equipment worn by the construction worker does not meet the conditions for correct wearing. Alternatively, if the angle between the straight line of the right shoulder point and the waist belt adjustment buckle and the straight line of the left leg adjustment buckle and the waist belt adjustment buckle is less than the second angle threshold, then the protective equipment of the construction worker does not meet the conditions for correct wearing. Alternatively, if the angle between the straight line of the left shoulder point and the left shoulder adjustment buckle and the straight line of the left shoulder adjustment buckle and the waist belt adjustment buckle is less than the third angle threshold, then the protective equipment of the construction worker does not meet the conditions for correct wearing. Alternatively, if the angle between the straight line of the right shoulder point and the right shoulder adjustment buckle and the straight line of the right shoulder adjustment buckle and the waist belt adjustment buckle is less than the fourth angle threshold, then the protective equipment of the construction worker does not meet the conditions for correct wearing. Alternatively, if the angle between the straight line of the right shoulder point and the right shoulder adjustment buckle and the straight line of the left leg adjustment buckle and the right shoulder adjustment buckle is less than the fifth angle threshold, then the protective equipment worn by the construction worker does not meet the conditions for correct wearing. Alternatively, if the angle between the straight line of the left shoulder point and the left shoulder adjustment buckle and the straight line of the right leg adjustment buckle and the left shoulder adjustment buckle is less than the sixth angle threshold, then the protective equipment of the construction worker does not meet the conditions for correct wearing. Alternatively, if the angle between the straight line of the waist adjustment buckle and the chest adjustment buckle and the straight line of the chest adjustment buckle and the nose point is less than the seventh angle threshold, then the protective equipment of the construction worker does not meet the conditions for correct wearing; or, if the angle between the straight line of the left shoulder point and the back load-bearing ring and the straight line of the right hip joint point and the back load-bearing ring is less than the eighth angle threshold, then the protective equipment of the construction worker does not meet the conditions for correct wearing. Alternatively, if the angle between the straight line connecting the right shoulder point and the back support ring and the straight line connecting the left hip joint point and the back support ring is less than the ninth angle threshold, then the protective equipment worn by the construction worker does not meet the conditions for proper wearing. Alternatively, if the difference between the distance between the chin strap buckle point and the left ear point and the distance between the chin strap buckle point and the right ear point, and the ratio of the minimum distance between the chin strap buckle point and the left and right ear points, is greater than the second preset ratio threshold, then the protective equipment worn by the construction personnel does not meet the conditions for correct wearing.

[0049] The first wearing condition is that if the angle between the straight line connecting the left shoulder point and the waist belt adjustment buckle and the straight line connecting the right leg adjustment buckle and the waist belt adjustment buckle is less than a first angle threshold, then the construction worker's protective equipment does not meet the correct wearing condition, which may include: like If the angle is less than the first angle threshold, the protective equipment worn by the construction workers does not meet the requirements for proper wearing. The first angle threshold can be 160°, 155°, 150°, 145°, or 140°. 150° is preferred.

[0050] in, ; in, ; ; For belt adjustment buckle coordinates ; Coordinates of the left shoulder point ; Adjust the buckle coordinates for the right leg .

[0051] The second wearing condition is that if the angle between the straight line connecting the right shoulder point and the waist belt adjustment buckle and the straight line connecting the left leg adjustment buckle and the waist belt adjustment buckle is less than a second angle threshold, then the construction worker's protective equipment does not meet the correct wearing condition, which may include: like If the angle is less than the second angle threshold, the protective equipment worn by the construction workers does not meet the requirements for proper wearing. The second angle threshold can be 160°, 155°, 150°, 145°, or 140°. 150° is preferred.

[0052] in, ; in, ; ; For belt adjustment buckle coordinates ; Coordinates of the right shoulder point ; Adjust the buckle coordinates for the left leg .

[0053] The third wearing condition is that if the angle between the straight line connecting the left shoulder point and the left shoulder adjustment buckle and the straight line connecting the left shoulder adjustment buckle and the waist belt adjustment buckle is less than the third angle threshold, then the construction worker's protective equipment does not meet the correct wearing conditions, which may include: like If the angle is less than the third angle threshold, the protective equipment worn by the construction workers does not meet the requirements for proper wearing. The third angle threshold can be 160°, 155°, 150°, 145°, or 140°. 150° is preferred.

[0054] ; in, ; ; For belt adjustment buckle coordinates ; Coordinates of the left shoulder point ; Adjust the buckle coordinates for the left shoulder .

[0055] The fourth wearing condition is that if the angle between the straight line connecting the right shoulder point and the right shoulder adjustment buckle and the straight line connecting the right shoulder adjustment buckle and the waist belt adjustment buckle is less than the fourth angle threshold, then the protective equipment worn by the construction worker does not meet the correct wearing conditions. This can include: like If the value is less than the fourth angle threshold, the protective equipment worn by the construction workers does not meet the requirements for proper wearing. The fourth angle threshold can be 160°, 155°, 150°, 145°, or 140°. 150° is preferred.

[0056] ; in, ; ; For belt adjustment buckle coordinates ; Coordinates of the right shoulder point ; Adjust the buckle coordinates for the right shoulder .

[0057] The fifth wearing condition is that if the angle between the straight line connecting the right shoulder point and the right shoulder adjustment buckle and the straight line connecting the left leg adjustment buckle and the right shoulder adjustment buckle is less than the fifth angle threshold, then the construction worker's protective equipment does not meet the correct wearing conditions, which may include: like If the value is less than the fifth angle threshold, the protective equipment worn by the construction workers does not meet the requirements for proper wearing. The fifth angle threshold can be 160°, 155°, 150°, 145°, or 140°. 150° is preferred.

[0058] ; in, ; ; Adjust the buckle coordinates for the left leg ; Coordinates of the right shoulder point ; Adjust the buckle coordinates for the right shoulder .

[0059] The sixth wearing condition is that if the angle between the straight line connecting the left shoulder point and the left shoulder adjustment buckle and the straight line connecting the right leg adjustment buckle and the left shoulder adjustment buckle is less than the sixth angle threshold, then the construction worker's protective equipment does not meet the correct wearing conditions. This can include: like If the value is less than the sixth angle threshold, the protective equipment worn by the construction workers does not meet the requirements for proper wearing. The sixth angle threshold can be 160°, 155°, 150°, 145°, or 140°. 150° is preferred.

[0060] ; in, ; ; Adjust the buckle coordinates for the right leg ; Coordinates of the left shoulder point ; Adjust the buckle coordinates for the left shoulder .

[0061] The seventh wearing condition is that if the angle between the straight line of the waist adjustment buckle and the chest adjustment buckle and the straight line of the chest adjustment buckle and the nose point is less than the seventh angle threshold, then the construction worker's protective equipment does not meet the correct wearing condition, which may include: like If the angle is less than the seventh angle threshold, the protective equipment worn by the construction workers does not meet the requirements for proper wearing. The seventh angle threshold can be 160°, 155°, 150°, 145°, or 140°. 150° is preferred.

[0062] ; in, ; ; For belt adjustment buckle coordinates ; For belt adjustment buckle coordinates ; Adjust the buckle coordinates for the right shoulder .

[0063] The eighth wearing condition is that if the angle between the straight line connecting the left shoulder point and the back support ring and the straight line connecting the right hip joint point and the back support ring is less than the eighth angle threshold, then the construction worker's protective equipment does not meet the correct wearing condition. This condition may include: like If the angle is less than the eighth angle threshold, the protective equipment worn by the construction workers does not meet the requirements for proper wearing. The eighth angle threshold can be 160°, 155°, 150°, 145°, or 140°. 150° is preferred.

[0064] ; in, ; ; Coordinates of the back support ring ; Coordinates of the left shoulder point ; The coordinates of the right hip joint are ; The ninth wearing condition is that if the angle between the straight line connecting the right shoulder point and the back support ring and the straight line connecting the left hip joint point and the back support ring is less than the ninth angle threshold, then the construction worker's protective equipment does not meet the correct wearing condition. This condition may include: like If the angle is less than the ninth angle threshold, the protective equipment worn by the construction workers does not meet the requirements for proper wearing. The ninth angle threshold can be 160°, 155°, 150°, 145°, or 140°. 150° is preferred.

[0065] ; in, ; ; Coordinates of the back support ring ; Coordinates of the right shoulder point ; The coordinates of the left hip joint are ; The tenth wearing condition is that if the difference between the distance between the chin strap buckle point and the left ear point and the distance between the chin strap buckle point and the right ear point, and the ratio of this difference to the minimum distance between the chin strap buckle point and the left and right ear points, is greater than a second preset ratio threshold, then the construction worker's protective equipment does not meet the correct wearing conditions. This may include: like If the ratio exceeds the second preset threshold, the protective equipment worn by the construction workers does not meet the requirements for proper wearing. The second preset ratio threshold can be 0.1, 0.15, 0.2, 0.25, or 0.3. 0.2 is preferred.

[0066] ; Among them, the distance between the chin strap buckle point and the left ear point The distance between the chin strap buckle point and the right ear point ; Coordinates of the mandibular band buckle points ; Coordinates of the left ear point ; The coordinates of the right ear point are .

[0067] Based on the personnel skeletal data and the location information of the protective equipment, after determining the operational risks of construction workers, the following measures can be taken: when a construction worker is found to be at risk, a voice warning can be issued immediately for obvious violations. For information requiring further analysis, the behavior of construction workers can be tracked to the next camera for close-range identification and judgment in areas such as passageways and entrances / exits. For those who fail to correct their violations voluntarily, rectification information can be pushed to the on-duty station manager. If the potential hazard is not eliminated in a timely manner, the information can be proactively pushed to a higher level, forming a risk control linkage mechanism.

[0068] In summary, this application improves the accuracy of risk identification for construction workers in underground stations by preprocessing the collected video data from multiple cameras installed within the station, thereby reducing the frequency of erroneous risk warnings. This is achieved by preprocessing the collected surveillance video, identifying the locations of safety equipment and human skeletons, and determining whether workers are correctly wearing safety belts and helmets.

[0069] For those consistent with the above, please refer to Figure 2 , Figure 2 This application provides a schematic diagram of the structure of a risk identification device for underground station construction workers. (See attached diagram.) Figure 2 As shown, the device includes: The data acquisition module 201 is used to collect monitoring video data in real time through multiple cameras installed in the underground station; Image preprocessing module 202 is used to preprocess the monitoring video data to obtain monitoring image information; The location information determination module 203 is used to obtain personnel skeletal point information and protective equipment location information by detecting the safety protection equipment and human skeletal points in the monitoring image information; The operation risk determination module 204 is used to determine the operation risk of construction personnel based on the personnel skeletal information and the location information of the protective equipment.

[0070] This application also provides a terminal device, which includes: at least one processor, a memory, and a computer program stored in the memory and executable on the at least one processor. When the processor executes the computer program, it implements the steps in the embodiment of the method for identifying operational risks of underground station construction workers.

[0071] This application also provides a computer storage medium storing a computer program for electronic data interchange, which causes a computer to perform some or all of the steps of any of the underground station construction worker risk identification methods described in the above method embodiments.

[0072] This application also provides a computer program product, which includes a non-transitory computer-readable storage medium storing a computer program that causes a computer to perform some or all of the steps of any of the underground station construction worker risk identification methods described in the above method embodiments.

[0073] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, all or part of the processes in the methods of the above embodiments of this application can be implemented by a computer program instructing related hardware. The computer program can be stored in a computer-readable storage medium, and when executed by a processor, it can implement the steps of the various method embodiments described above. The computer program includes computer program code, which can be in the form of source code, object code, executable files, or certain intermediate forms. The computer-readable storage medium can include at least: any entity or device capable of carrying computer program code to a device / terminal equipment, a recording medium, a computer memory, a read-only memory (ROM), a random access memory (RAM), an electrical carrier signal, a telecommunication signal, and a software distribution medium. Examples include USB flash drives, portable hard drives, magnetic disks, or optical disks. In some jurisdictions, according to legislation and patent practice, computer-readable storage media cannot be electrical carrier signals or telecommunication signals.

[0074] In the above embodiments, the descriptions of each embodiment have different focuses. For parts that are not described in detail or recorded in a certain embodiment, please refer to the relevant descriptions of other embodiments.

[0075] Those skilled in the art will recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0076] In the embodiments provided in this application, it should be understood that the disclosed devices / terminal equipment and methods can be implemented in other ways. For example, the device / terminal equipment embodiments described above are merely illustrative. For instance, the division of modules or units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the displayed or discussed mutual coupling or direct coupling or communication connection may be through some interfaces; the indirect coupling or communication connection between devices or units may be electrical, mechanical, or other forms.

[0077] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

Claims

1. A method of identifying construction worker task risks in an underground station, characterized by, The application relates to a construction personnel operation risk determination method and device. Monitoring video data collected in real time through multiple cameras arranged in an underground station; Preprocessing the monitoring video data to obtain monitoring image information; Detecting safety protection equipment and human body skeleton points in the monitoring image information to obtain personnel skeleton point information and protection equipment position information; Determining a construction personnel operation risk according to the personnel skeleton point information and the protection equipment position information.

2. The underground station construction worker job risk identification method according to claim 1, characterized by, The detection of safety protection equipment and human body skeleton points in the monitoring image information to obtain personnel skeleton point information and protection equipment position information comprises: Detecting human body skeleton points in the detection image information through a personnel skeleton point recognition algorithm to obtain personnel skeleton point information.

3. The underground station construction worker job risk identification method according to claim 2, characterized by, The detection of safety protection equipment and human body skeleton points in the monitoring image information to obtain personnel skeleton point information and protection equipment position information comprises detecting protection equipment in the detection image information through a protection equipment recognition algorithm to obtain protection equipment position information.

4. The underground station construction worker job risk identification method according to claim 3, characterized by, The determination of a construction personnel operation risk according to the personnel skeleton point information and the protection equipment position information comprises: Determining whether the orientation of the construction personnel in the detection image satisfies a front-facing condition according to the personnel skeleton point information; If the orientation of the construction personnel satisfies the front-facing condition, determining a construction personnel operation risk according to the personnel skeleton point information and the protection equipment position information; If the orientation of the construction personnel does not satisfy the front-facing condition, detecting whether the orientation of the construction personnel in the next detection image satisfies the front-facing condition. Or, the orientation of the construction personnel satisfying the front-facing condition comprises: According to the position coordinates of the corresponding skeleton points in the personnel skeleton point coordinate information, calculating the distance ratio between the left and right hip joint distance and the hip shoulder midpoint distance, and if the distance ratio is greater than a first preset ratio threshold and the personnel skeleton point coordinate information satisfies a skeleton point detection acquisition condition.

5. The underground station construction worker's job risk identification method according to claim 3 or 4, characterized by, The determination of a construction personnel operation risk according to the personnel skeleton point information and the protection equipment position information comprises: According to the personnel skeleton point information and the protection equipment position information, determining the wearing pose of the protection equipment, and comparing the wearing pose with a standard wearing pose to determine whether a correct wearing condition is satisfied; If the protection equipment of the construction personnel satisfies the correct wearing condition, determining that the construction personnel operation risk is low; If the protection equipment of the construction personnel does not satisfy the correct wearing condition, determining that the construction personnel operation risk is high.

6. The underground station construction worker job risk identification method according to claim 5, characterized by, The personnel skeleton point information includes detection image serial numbers and personnel skeleton point coordinate information corresponding to the detection images; the personnel skeleton point coordinate information includes left hip joint point coordinates, right hip joint point coordinates, left shoulder point coordinates, right shoulder point coordinates, left ear point coordinates, right ear point coordinates and nose point coordinates; the protective equipment position information includes detection image serial numbers and protective equipment coordinate information corresponding to the detection images; the protective equipment coordinate information includes left leg adjustment buckle coordinates, right leg adjustment buckle coordinates, left shoulder adjustment buckle coordinates, right shoulder adjustment buckle point coordinates, waistband adjustment buckle coordinates, chest adjustment buckle coordinates, back load-bearing ring coordinates and lower jaw belt buckle point coordinates; the protective equipment of the construction personnel does not meet the correct wearing condition, including: If an angle between a straight line of the left shoulder point and the waistband adjustment buckle and a straight line of the right leg adjustment buckle and the waistband adjustment buckle is less than a first angle threshold, the protective equipment of the construction personnel does not meet the correct wearing condition; Or, if an angle between a straight line of the right shoulder point and the waistband adjustment buckle and a straight line of the left leg adjustment buckle and the waistband adjustment buckle is less than a second angle threshold, the protective equipment of the construction personnel does not meet the correct wearing condition; Or, if an angle between a straight line of the left shoulder point and the left shoulder adjustment buckle and a straight line of the left shoulder adjustment buckle and the waistband adjustment buckle is less than a third angle threshold, the protective equipment of the construction personnel does not meet the correct wearing condition; Or, if an angle between a straight line of the right shoulder point and the right shoulder adjustment buckle and a straight line of the right shoulder adjustment buckle and the waistband adjustment buckle is less than a fourth angle threshold, the protective equipment of the construction personnel does not meet the correct wearing condition; Or, if an angle between a straight line of the right shoulder point and the right shoulder adjustment buckle and a straight line of the left leg adjustment buckle and the right shoulder adjustment buckle is less than a fifth angle threshold, the protective equipment of the construction personnel does not meet the correct wearing condition; Or, if an angle between a straight line of the left shoulder point and the left shoulder adjustment buckle and a straight line of the right leg adjustment buckle and the left shoulder adjustment buckle is less than a sixth angle threshold, the protective equipment of the construction personnel does not meet the correct wearing condition; Or, if an angle between a straight line of the waistband adjustment buckle and the chest adjustment buckle and a straight line of the chest adjustment buckle and the nose point is less than a seventh angle threshold, the protective equipment of the construction personnel does not meet the correct wearing condition; or, if an angle between a straight line of the left shoulder point and the back load-bearing ring and a straight line of the right hip joint point and the back load-bearing ring is less than an eighth angle threshold, the protective equipment of the construction personnel does not meet the correct wearing condition; Or, if an angle between a straight line of the right shoulder point and the back load-bearing ring and a straight line of the left hip joint point and the back load-bearing ring is less than a ninth angle threshold, the protective equipment of the construction personnel does not meet the correct wearing condition; Or, if a difference between a distance between the lower jaw belt buckle point and the left ear point and a distance between the lower jaw belt buckle point and the right ear point is greater than a second preset proportion threshold of a minimum distance between the lower jaw belt buckle point and the left and right ear points, the protective equipment of the construction personnel does not meet the correct wearing condition.

7. The underground station construction worker's job risk identification method according to claim 1, 2, 3, 4 or 6, characterized by, The pre-processing of the monitoring video data to obtain monitoring image information includes: frame extraction processing of the monitoring video data in a preset time range to obtain video frame image information; The blurred and repeated images in the video frame image information are cleaned to obtain cleaned image information; The cleaned image information is processed by noise reduction, flipping, cropping, scaling, etc. to obtain processed image information; The processed image information is subjected to brightness identification and brightness adjustment to obtain monitoring image information.

8. An underground station construction worker job risk identification device characterized by, Comprise: A data acquisition module for acquiring monitoring video data in real time through a plurality of cameras arranged in the underground station; An image preprocessing module for preprocessing the monitoring video data to obtain monitoring image information; A position information determination module for detecting personnel skeletal point information and protective equipment position information by detecting safety protection equipment and human skeletal points in the monitoring image information; An operation risk determination module for determining the operation risk of the construction personnel according to the personnel skeletal point information and the protective equipment position information.

9. A terminal device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that, The processor executes the computer program to realize the underground station construction personnel operation risk identification method of any one of claims 1 to 7.

10. A computer-readable storage medium storing a computer program, the computer program comprising instructions that, when executed by a computer, cause the computer to perform the method of any one of claims 1 to 9. The computer program is executed by the processor to realize the underground station construction personnel operation risk identification method of any one of claims 1 to 7.

Images