Computer vision-based unsafe behavior identification method for water conservancy construction site personnel

Abstract

The application discloses a computer vision-based water conservancy construction site personnel unsafe behavior identification method, relates to the technical field of image analysis, and comprises the following steps: forming standard construction actions of operation steps, analyzing to obtain dangerous operation areas of operation projects; forming a safe operation set of operation steps; obtaining actual actions, identifying target operation projects of site personnel; generating non-operation areas; obtaining effective actual actions and ineffective actual actions; pairing the effective actual actions with operation steps of the target operation projects; and utilizing the safe operation set of operation steps to identify the safety of the effective actual actions corresponding to the operation steps. Through the forming of the safe operation set of operation steps, the generation of the non-operation areas, and the obtaining of the effective actual actions and the ineffective actual actions, the accurate identification of the non-completely fixed actions of site personnel can be realized, and the interference of the ineffective actual actions on the unsafe behavior identification can be eliminated.

Description

Technical Field

[0001] This invention relates to the field of image analysis technology, specifically to a method for identifying unsafe behaviors of personnel at water conservancy construction sites based on computer vision. Background Technology

[0002] Water conservancy projects are a general term for various engineering projects constructed to control and utilize water resources and prevent water-related disasters. Their core lies in using engineering techniques to allocate, control, utilize, and protect water in nature. However, the construction procedures involved in water conservancy projects are complex, and the actions of workers are not entirely fixed. Furthermore, workers may engage in behaviors unrelated to the construction process, making it difficult to accurately identify potential safety hazards. Summary of the Invention

[0003] To address the aforementioned technical problems, this technical solution provides a computer vision-based method for identifying unsafe behaviors of personnel at water conservancy construction sites. This solution resolves the issues raised in the background section.

[0004] To achieve the above objectives, the technical solution adopted by the present invention is as follows:

[0005] A computer vision-based method for identifying unsafe behaviors of personnel at water conservancy construction sites includes:

[0006] Obtain at least one work item in water conservancy construction, obtain at least one operation step of the work item, form standard construction actions for the operation steps, and analyze to obtain at least one hazardous work area of ​​the work item;

[0007] Based on standard construction actions and hazardous work areas, a set of safe operation procedures is formed, and the set of safe operation procedures consists of at least one safe construction action.

[0008] Obtain the current location of the personnel on site, identify the continuous actions of the personnel at the current location, obtain at least one actual action, and identify the target work item of the personnel on site based on the actual action.

[0009] Based on the arm size of on-site personnel and the target work items, generate non-work areas;

[0010] Based on the non-operation area, the actual actions are classified to obtain effective and ineffective actual actions;

[0011] The effective actual actions are paired with the operation steps of the target work project, and the safety of the effective actual actions corresponding to the operation steps is identified by using the safe operation set of the operation steps.

[0012] Preferably, the standard construction actions that form the operation steps include the following steps:

[0013] Get the historical standard operation of at least one construction worker for the work project, get the operation location of the operation step of the work project, get the operation location of the historical standard operation, and match the historical standard operation to the operation step of the work project with the smallest difference between its operation location and the operation location.

[0014] Select one of the at least one historical standard operation corresponding to the operation step as the standard construction action of the operation step.

[0015] Preferably, the analysis to identify at least one hazardous work area for the work project includes the following steps:

[0016] Obtain at least one historical non-standard operation of the work item, and obtain the unsafe events caused by the historical non-standard operation;

[0017] The location where an unsafe event occurred in the work project is designated as the unsafe point, and the maximum length of the hands of historical construction workers is designated as the characteristic distance.

[0018] An unsafe circle is formed, satisfying the condition that the center of the unsafe circle is the unsafe point and the radius of the unsafe circle is equal to the characteristic distance;

[0019] If two unsafe circles overlap, they are merged; otherwise, no action is taken.

[0020] At least one area obtained by merging unsafe circles shall be designated as a hazardous work area.

[0021] Preferably, the safe operation set based on standard construction actions and hazardous work areas includes the following steps:

[0022] The positions of the worker's left hand and left shoulder are identified in the standard construction operation and are respectively designated as the first hand position and the first shoulder position.

[0023] The positions of the worker's right hand and right shoulder are identified in the standard construction movements and are respectively designated as the second hand position and the second shoulder position.

[0024] At least one identification point is evenly selected within the construction area where the construction workers are located, and two different identification points are randomly selected as the first elbow position and the second elbow position, respectively.

[0025] The distance from the worker's left hand to his left elbow joint is taken as the first distance, and the distance from the worker's left shoulder to his left elbow joint is taken as the second distance.

[0026] If the distance from the first hand position to the first elbow position is equal to the first distance and the distance from the first shoulder position to the first elbow position is equal to the second distance, then the first elbow position is taken as the first target elbow position; otherwise, no action is taken.

[0027] The action formed by sequentially connecting the first hand position, the first target elbow position, and the first shoulder position is taken as the left action. If the left action does not pass through the hazardous work area, then the left action is taken as the left target action.

[0028] If the distance from the second hand position to the second elbow position is equal to the first distance and the distance from the second shoulder position to the second elbow position is equal to the second distance, then the second elbow position is taken as the second target elbow position; otherwise, no action is taken.

[0029] The action formed by sequentially connecting the second hand position, the second target elbow position, and the second shoulder position is considered the right action. If the right action does not pass through the hazardous work area, then the right action is considered the right target action.

[0030] At least one of the left target actions is randomly combined with at least one of the right target actions to form at least one safe construction action, and these are combined to form a set of safe operation steps corresponding to the standard construction action.

[0031] Preferably, the step of identifying the continuous actions of on-site personnel at their current location to obtain at least one actual action includes the following steps:

[0032] During the on-site personnel's working time, at least one reference point is taken evenly, and motion data is collected at the time point equal to the reference point to obtain at least one actual motion.

[0033] Preferably, identifying the target work item of the on-site personnel based on actual actions includes the following steps:

[0034] The system captures the hand positions of personnel at their current location and uses the moments when these hand positions change as characteristic moments.

[0035] Using adjacent feature moments as endpoints, at least one feature interval is formed. Actual actions that occur in the same feature interval are summarized to form at least one set of actual actions.

[0036] Take one of the actual actions in the set of actual actions as the target actual action, and take the left hand position and right hand position of the target actual action as the first position to be identified and the second position to be identified, respectively.

[0037] If the first location to be identified is the same as the first hand location and the second location to be identified is the same as the second hand location, then the standard construction action will be taken as the target standard construction action.

[0038] The task with the largest number of target standard construction actions is taken as the target task for on-site personnel.

[0039] Preferably, generating the non-work area based on the arm size of on-site personnel and the target work item includes the following steps:

[0040] The overall arm length of the on-site personnel is obtained as the feature length, and the spatial range occupied by the completed building entity of the target work project is taken as the target work area.

[0041] At least one target point is uniformly selected within the target work area. If the distance from a point in the space to one of the target points does not exceed the feature length, then the point in the space is taken as the feature point.

[0042] At least one feature point is aggregated to form the operation extension area, and the area outside the operation extension area is designated as the non-operation area.

[0043] Preferably, classifying actual actions to obtain valid and invalid actual actions includes the following steps:

[0044] Obtain the actual location of the personnel on site when they perform the actual action. If the actual location is outside the work area, the actual action is considered invalid; otherwise, the actual action is considered valid.

[0045] Preferably, the process of matching effective actual actions with the operational steps of the target task includes the following steps:

[0046] Obtain the overlap ratio between effective actual actions and safe construction actions. Take the average of the overlap ratios between safe construction actions and effective actual actions in the safe operation set of the operation steps to obtain the verification value of the operation steps and effective actual actions.

[0047] The effective actual actions are matched to the operation steps in the target task that have the highest verification value with the effective actual actions.

[0048] Preferably, the identification of the safety of the valid actual actions corresponding to the operation steps includes the following steps:

[0049] One of the standard construction actions is randomly selected as the sample action, and the reproducible action generated by the construction workers repeating the sample action at least once is obtained in advance.

[0050] Subtract the overlap ratio between the reproduced action and the sample action from 1 to obtain the error ratio. Take the maximum value of the error ratio as the allowable error.

[0051] If the overlap ratio between the effective actual action and one of the safe construction actions in the set of safe operation steps is less than 1, the effective actual action is judged to be a safe action; otherwise, the effective actual action is judged to be an unsafe action.

[0052] Compared with the prior art, the beneficial effects of the present invention are as follows:

[0053] By forming a set of safe operating procedures, generating non-operating areas, and obtaining effective and ineffective actual actions, the system can decompose water conservancy construction to obtain work items. These items can then be analyzed one by one. Based on the identification of hazardous work areas, standard construction actions can be approximated and transformed to obtain all possible safe operating actions. This allows for accurate identification of actions that are not entirely fixed by on-site personnel, preventing misjudgments. Furthermore, by identifying the relationship between on-site personnel's location and non-operating areas, ineffective actual actions by on-site personnel can be identified, eliminating interference from ineffective actions in the identification of unsafe behaviors and further improving the accuracy of identification. Attached Figure Description

[0054] Figure 1 This is a flowchart illustrating the computer vision-based method for identifying unsafe behaviors of personnel at water conservancy construction sites according to the present invention.

[0055] Figure 2 This is a flowchart illustrating the standard construction actions that form the operational steps of the present invention.

[0056] Figure 3 This is a schematic diagram of the process for obtaining at least one hazardous work area for a work item based on the analysis of the present invention;

[0057] Figure 4 This is a flowchart illustrating the safe operation set of operating steps based on standard construction actions and hazardous work areas, as described in this invention.

[0058] Figure 5 This is a flowchart illustrating the process of identifying the target work items of on-site personnel based on actual actions, according to the present invention.

[0059] Figure 6 This invention generates a flowchart of the non-operation area based on the arm size of on-site personnel and the target work item.

[0060] Figure 7 This is a flowchart illustrating how the present invention pairs effective actual actions with the operational steps of the target task.

[0061] Figure 8 This is a flowchart illustrating the safety identification of the effective actual actions corresponding to the operation steps according to the present invention. Detailed Implementation

[0062] The following description is intended to disclose the invention and enable those skilled in the art to implement it. The preferred embodiments described below are merely examples, and other obvious variations will occur to those skilled in the art.

[0063] Reference Figure 1 As shown, a computer vision-based method for identifying unsafe behaviors of personnel at water conservancy construction sites includes:

[0064] Obtain at least one work item in water conservancy construction, obtain at least one operation step of the work item, form standard construction actions for the operation steps, and analyze to obtain at least one hazardous work area of ​​the work item;

[0065] Based on standard construction actions and hazardous work areas, a set of safe operation procedures is formed, and the set of safe operation procedures consists of at least one safe construction action.

[0066] Obtain the current location of the personnel on site, identify the continuous actions of the personnel at the current location, obtain at least one actual action, and identify the target work item of the personnel on site based on the actual action.

[0067] Based on the arm size of on-site personnel and the target work items, generate non-work areas;

[0068] Based on the non-operation area, the actual actions are classified to obtain effective and ineffective actual actions;

[0069] The effective actual actions are paired with the operation steps of the target work project, and the safety of the effective actual actions corresponding to the operation steps is identified by using the safe operation set of the operation steps.

[0070] In water conservancy construction, different work projects have different operating procedures, and each operating procedure has corresponding standard construction actions. However, not only standard construction actions are safe. Due to their own habits, on-site personnel may use actions that are similar to standard construction actions and achieve the same effect, but the actions themselves are not dangerous. This cannot be identified by simply comparing them with standard construction actions. In addition, not all of the on-site personnel's actions during the entire construction process are related to construction. If they need to rest or have other behaviors unrelated to construction during the work process, these behaviors need to be eliminated, and a series of steps should be set up to deal with them in the future.

[0071] Reference Figure 2 As shown, the standard construction actions that form the operational steps include the following steps:

[0072] Get the historical standard operation of at least one construction worker for the work project, get the operation location of the operation step of the work project, get the operation location of the historical standard operation, and match the historical standard operation to the operation step of the work project with the smallest difference between its operation location and the operation location.

[0073] Select one of the at least one historical standard operation corresponding to the operation step as the standard construction action of the operation step.

[0074] Historical standard operations and operation steps need to be correlated. The correlation is determined by the distance between the operation position and the work position. Since the operation position of the historical standard operation must be applied to the work position of the corresponding operation step of the work item, the operation position of the historical standard operation must be the closest to the work position among all work positions. However, there are multiple historical standard operations, which may correspond to the same operation step. Since they are all actions that meet safety standards, choosing any one of them will meet the requirements. Thus, the standard construction actions of the operation steps are obtained.

[0075] Reference Figure 3 As shown, the analysis of at least one hazardous work area for a work project includes the following steps:

[0076] Obtain at least one historical non-standard operation of the work item, and obtain the unsafe events caused by the historical non-standard operation;

[0077] The location where an unsafe event occurred in the work project is designated as the unsafe point, and the maximum length of the hands of historical construction workers is designated as the characteristic distance.

[0078] An unsafe circle is formed, satisfying the condition that the center of the unsafe circle is the unsafe point and the radius of the unsafe circle is equal to the characteristic distance;

[0079] If two unsafe circles overlap, they are merged; otherwise, no action is taken.

[0080] At least one area obtained by merging unsafe circles shall be designated as a hazardous work area.

[0081] When identifying unsafe points, an unsafe point is just a single location. However, in actual operation, an unsafe location is not just a single point, but an area related to that point. Since construction work is carried out through the coordinated operation of the arm and hand, but the final construction is determined by the hand, the unsafe circle is generated using the size of the hand. When the hand moves within the area of ​​the unsafe circle, it may encounter the unsafe point and trigger a safety problem. Thus, unsafe circles are all risk areas. Aggregating them can yield the hazardous work area.

[0082] Reference Figure 4 As shown, based on standard construction actions and hazardous work areas, the safe operation set of procedures includes the following steps:

[0083] The positions of the worker's left hand and left shoulder are identified in the standard construction operation and are respectively designated as the first hand position and the first shoulder position.

[0084] The positions of the worker's right hand and right shoulder are identified in the standard construction movements and are respectively designated as the second hand position and the second shoulder position.

[0085] At least one identification point is evenly selected within the construction area where the construction workers are located, and two different identification points are randomly selected as the first elbow position and the second elbow position, respectively.

[0086] The distance from the worker's left hand to his left elbow joint is taken as the first distance, and the distance from the worker's left shoulder to his left elbow joint is taken as the second distance.

[0087] If the distance from the first hand position to the first elbow position is equal to the first distance and the distance from the first shoulder position to the first elbow position is equal to the second distance, then the first elbow position is taken as the first target elbow position; otherwise, no action is taken.

[0088] The action formed by sequentially connecting the first hand position, the first target elbow position, and the first shoulder position is taken as the left action. If the left action does not pass through the hazardous work area, then the left action is taken as the left target action.

[0089] If the distance from the second hand position to the second elbow position is equal to the first distance and the distance from the second shoulder position to the second elbow position is equal to the second distance, then the second elbow position is taken as the second target elbow position; otherwise, no action is taken.

[0090] The action formed by sequentially connecting the second hand position, the second target elbow position, and the second shoulder position is considered the right action. If the right action does not pass through the hazardous work area, then the right action is considered the right target action.

[0091] At least one of the left target actions is randomly combined with at least one of the right target actions to form at least one safe construction action, and these are combined to form a set of safe operation steps corresponding to the standard construction action.

[0092] When each person performs the standard construction actions in the operation procedure, as long as they do not touch the hazardous work area, the action is not dangerous. However, it also needs to achieve the same effect as the standard construction action. The operation is ultimately completed by the hands. Therefore, it is sufficient to ensure that the position of the hands is consistent with the position of the hands in the standard construction action. Thus, multiple left and right target actions are generated. Taking the left target action as an example, it is guaranteed not to pass through the hazardous work area. In addition, since it is generated using random points, it is necessary to verify whether it can form a real action. This is mainly judged based on the distance from the shoulder joint to the elbow joint, i.e., the distance from the elbow joint to the hand. Since the left and right arms are the same size, only the size of the left arm is used to judge the left and right target actions. Since the left and right target actions each meet the requirements, any combination of them can form an action that achieves the same effect as the standard construction action, and it does not touch the hazardous work area, so it is safe.

[0093] Identifying the continuous actions of personnel at their current location to obtain at least one actual action includes the following steps:

[0094] During the on-site personnel's working time, at least one reference point is taken evenly, and motion data is collected at the time point equal to the reference point to obtain at least one actual motion.

[0095] Because the speed of motion changes is relatively slow, all actual motions can be captured as long as the spacing between reference points is small.

[0096] Reference Figure 5 As shown, identifying the target work items of on-site personnel based on actual actions includes the following steps:

[0097] The system captures the hand positions of personnel at their current location and uses the moments when these hand positions change as characteristic moments.

[0098] Using adjacent feature moments as endpoints, at least one feature interval is formed. Actual actions that occur in the same feature interval are summarized to form at least one set of actual actions.

[0099] Take one of the actual actions in the set of actual actions as the target actual action, and take the left hand position and right hand position of the target actual action as the first position to be identified and the second position to be identified, respectively.

[0100] If the first location to be identified is the same as the first hand location and the second location to be identified is the same as the second hand location, then the standard construction action will be taken as the target standard construction action.

[0101] The task with the largest number of target standard construction actions is taken as the target task for on-site personnel.

[0102] Since the essence of the work is the change in hand position, and construction is ultimately completed by the hands, a change in the arm does not necessarily indicate a change in the action. Furthermore, as long as the hand position remains unchanged, the overall action will not change significantly due to the limitation of the hand position. Therefore, to simplify identification, a deduplication process is performed, that is, one actual action from the set of actual actions is used to represent all actual actions in the set. Subsequently, the actual actions are used to identify the target standard construction action, thereby selecting the target work item for the on-site personnel, which must be the item with the most overlapping hand positions.

[0103] Reference Figure 6 As shown, generating a non-work area based on the arm size of on-site personnel and the target work item includes the following steps:

[0104] The overall arm length of the on-site personnel is obtained as the feature length, and the spatial range occupied by the completed building entity of the target work project is taken as the target work area.

[0105] At least one target point is uniformly selected within the target work area. If the distance from a point in the space to one of the target points does not exceed the feature length, then the point in the space is taken as the feature point.

[0106] At least one feature point is aggregated to form the operation extension area, and the area outside the operation extension area is designated as the non-operation area.

[0107] The non-work area is the area unrelated to the work location of the target work project. In other words, personnel cannot perform work on the target work project within the non-work area. Since the target work project will eventually result in a building, but this building does not exist before construction, work is carried out within the target work area. However, due to the limited arm length of personnel, they can work on the target work area as long as they are not far away. But if they are far away, they cannot work on the target work area. Actions performed in this case need to be removed because they are not construction actions; they might be routine activities such as eating or resting. Therefore, a work extension area is generated. The work extension area includes all points whose distance to one of the target points does not exceed the characteristic length. Thus, the non-work area consists of points whose distance to the target point exceeds the characteristic length. Even with outstretched arms, personnel cannot work within the target work area. Therefore, actions performed within the non-work area are considered invalid.

[0108] Classifying actual actions into valid and invalid actions involves the following steps:

[0109] Obtain the actual location of the personnel on site when they perform the actual action. If the actual location is outside the work area, the actual action is considered invalid; otherwise, the actual action is considered valid.

[0110] Reference Figure 7 As shown, matching effective actual actions with the operational steps of the target task includes the following steps:

[0111] Obtain the overlap ratio between effective actual actions and safe construction actions. Take the average of the overlap ratios between safe construction actions and effective actual actions in the safe operation set of the operation steps to obtain the verification value of the operation steps and effective actual actions.

[0112] The effective actual actions are matched to the operation steps in the target task that have the highest verification value with the effective actual actions.

[0113] Before judging the valid actual action, it is necessary to determine its corresponding operation steps. Since a set of safe operations corresponding to the operation steps has been generated in advance, the operation steps corresponding to the valid actual action can be determined by comparing with the set of safe operations. Since the set of safe operations consists of similar actions that achieve the same effect, if the valid actual action corresponds to the operation steps, the verification value of the operation steps and the valid actual action must be the largest. Therefore, the operation steps corresponding to the valid actual action are selected accordingly.

[0114] Reference Figure 8 As shown, identifying the safety of the valid actual actions corresponding to the operation steps includes the following steps:

[0115] One of the standard construction actions is randomly selected as the sample action, and the reproducible action generated by the construction workers repeating the sample action at least once is obtained in advance.

[0116] Subtract the overlap ratio between the reproduced action and the sample action from 1 to obtain the error ratio. Take the maximum value of the error ratio as the allowable error.

[0117] If the overlap ratio between the effective actual action and one of the safe construction actions in the set of safe operation steps is less than 1, the effective actual action is judged to be a safe action; otherwise, the effective actual action is judged to be an unsafe action.

[0118] Because there is a certain degree of error in the actions of on-site personnel, that is, the same action will be performed with errors, the error must be taken into account when making judgments; otherwise, judgment errors will occur. Since the set of safe operating procedures includes all safe actions, as long as the effective actual action is safe, the difference from one of them must not exceed the allowable error; otherwise, it indicates that there is an unsafe risk.

[0119] Furthermore, this solution also proposes a storage medium on which a computer-readable program is stored. When the computer-readable program is invoked, it executes the aforementioned method for identifying unsafe behaviors of personnel at water conservancy construction sites based on computer vision.

[0120] It is understandable that the storage medium can be a magnetic medium, such as a floppy disk, hard disk, or magnetic tape; an optical medium, such as a DVD; or a semiconductor medium, such as a solid-state drive (SSD).

[0121] In summary, the advantages of this invention are as follows: By forming a set of safe operating procedures, generating non-operating areas, and obtaining effective and ineffective actual actions, the work items can be obtained through the decomposition of water conservancy construction. Then, each item in the water conservancy construction can be analyzed, and based on the identification of hazardous operating areas, standard construction actions can be approximated and transformed to obtain all possible safe operating actions. This allows for accurate identification of actions that are not entirely fixed by on-site personnel, preventing misjudgments. Furthermore, based on the relationship between the location of on-site personnel and non-operating areas, ineffective actual actions of on-site personnel can be identified, thereby eliminating interference from ineffective actual actions in the identification of unsafe behaviors and further improving the accuracy of identification.

[0122] The foregoing has shown and described the basic principles, main features, and advantages of the present invention. Those skilled in the art should understand that the present invention is not limited to the above embodiments. The embodiments and descriptions in the specification are merely principles of the invention. Various changes and modifications can be made to the invention without departing from its spirit and scope, and all such changes and modifications fall within the scope of the claimed invention. The scope of protection claimed by the appended claims and their equivalents is defined.

Claims

1. A method for identifying unsafe behaviors of personnel at water conservancy construction sites based on computer vision, characterized in that, include: Obtain at least one work item in water conservancy construction, obtain at least one operation step of the work item, form standard construction actions for the operation steps, and analyze to obtain at least one hazardous work area of ​​the work item; Based on standard construction actions and hazardous work areas, a set of safe operation procedures is formed, and the set of safe operation procedures consists of at least one safe construction action. Obtain the current location of the personnel on site, identify the continuous actions of the personnel at the current location, obtain at least one actual action, and identify the target work item of the personnel on site based on the actual action. Based on the arm size of on-site personnel and the target work items, generate non-work areas; Based on the non-operation area, the actual actions are classified to obtain effective and ineffective actual actions; The effective actual actions are paired with the operation steps of the target work project, and the safety of the effective actual actions corresponding to the operation steps is identified by using the safe operation set of the operation steps.

2. The method for identifying unsafe behaviors of personnel at water conservancy construction sites based on computer vision according to claim 1, characterized in that, The standard construction actions that form the operational steps include the following steps: Get the historical standard operation of at least one construction worker for the work project, get the operation location of the operation step of the work project, get the operation location of the historical standard operation, and match the historical standard operation to the operation step of the work project with the smallest difference between its operation location and the operation location. Select one of the at least one historical standard operation corresponding to the operation step as the standard construction action of the operation step.

3. The method for identifying unsafe behaviors of personnel at water conservancy construction sites based on computer vision according to claim 2, characterized in that, The analysis to identify at least one hazardous work area for a work project includes the following steps: Obtain at least one historical non-standard operation of the work item, and obtain the unsafe events caused by the historical non-standard operation; The location where an unsafe event occurred in the work project is designated as the unsafe point, and the maximum length of the hands of historical construction workers is designated as the characteristic distance. An unsafe circle is formed, satisfying the condition that the center of the unsafe circle is the unsafe point and the radius of the unsafe circle is equal to the characteristic distance; If two unsafe circles overlap, they are merged; otherwise, no action is taken. At least one area obtained by merging unsafe circles shall be designated as a hazardous work area.

4. The method for identifying unsafe behaviors of personnel at water conservancy construction sites based on computer vision according to claim 3, characterized in that, The set of safe operating procedures based on standard construction actions and hazardous work areas includes the following steps: The positions of the worker's left hand and left shoulder are identified in the standard construction operation and are respectively designated as the first hand position and the first shoulder position. The positions of the worker's right hand and right shoulder are identified in the standard construction movements and are respectively designated as the second hand position and the second shoulder position. At least one identification point is evenly selected within the construction area where the construction workers are located, and two different identification points are randomly selected as the first elbow position and the second elbow position, respectively. The distance from the worker's left hand to his left elbow joint is taken as the first distance, and the distance from the worker's left shoulder to his left elbow joint is taken as the second distance. If the distance from the first hand position to the first elbow position is equal to the first distance and the distance from the first shoulder position to the first elbow position is equal to the second distance, then the first elbow position is taken as the first target elbow position; otherwise, no action is taken. The action formed by sequentially connecting the first hand position, the first target elbow position, and the first shoulder position is taken as the left action. If the left action does not pass through the hazardous work area, then the left action is taken as the left target action. If the distance from the second hand position to the second elbow position is equal to the first distance and the distance from the second shoulder position to the second elbow position is equal to the second distance, then the second elbow position is taken as the second target elbow position; otherwise, no action is taken. The action formed by sequentially connecting the second hand position, the second target elbow position, and the second shoulder position is considered the right action. If the right action does not pass through the hazardous work area, then the right action is considered the right target action. At least one of the left target actions is randomly combined with at least one of the right target actions to form at least one safe construction action, and these are combined to form a set of safe operation steps corresponding to the standard construction action.

5. The method for identifying unsafe behaviors of personnel at water conservancy construction sites based on computer vision according to claim 4, characterized in that, The process of identifying the continuous actions of on-site personnel at their current location to obtain at least one actual action includes the following steps: During the on-site personnel's working time, at least one reference point is taken evenly, and motion data is collected at the time point equal to the reference point to obtain at least one actual motion.

6. The method for identifying unsafe behaviors of personnel at water conservancy construction sites based on computer vision according to claim 5, characterized in that, The process of identifying the target work items of on-site personnel based on actual actions includes the following steps: The system captures the hand positions of personnel at their current location and uses the moments when these hand positions change as characteristic moments. Using adjacent feature moments as endpoints, at least one feature interval is formed. Actual actions that occur in the same feature interval are summarized to form at least one set of actual actions. Take one of the actual actions in the set of actual actions as the target actual action, and take the left hand position and right hand position of the target actual action as the first position to be identified and the second position to be identified, respectively. If the first location to be identified is the same as the first hand location and the second location to be identified is the same as the second hand location, then the standard construction action will be taken as the target standard construction action. The task with the largest number of target standard construction actions is taken as the target task for on-site personnel.

7. The method for identifying unsafe behaviors of personnel at water conservancy construction sites based on computer vision according to claim 6, characterized in that, The process of generating non-work areas based on the arm size of on-site personnel and the target work items includes the following steps: The overall arm length of the on-site personnel is obtained as the feature length, and the spatial range occupied by the completed building entity of the target work project is taken as the target work area. At least one target point is uniformly selected within the target work area. If the distance from a point in the space to one of the target points does not exceed the feature length, then the point in the space is taken as the feature point. At least one feature point is aggregated to form the operation extension area, and the area outside the operation extension area is designated as the non-operation area.

8. The method for identifying unsafe behaviors of personnel at water conservancy construction sites based on computer vision according to claim 7, characterized in that, The process of classifying actual actions into valid and invalid actions includes the following steps: Obtain the actual location of the personnel on site when they perform the actual action. If the actual location is outside the work area, the actual action is considered invalid; otherwise, the actual action is considered valid.

9. The method for identifying unsafe behaviors of personnel at water conservancy construction sites based on computer vision according to claim 8, characterized in that, The process of matching effective actual actions with the operational steps of the target task includes the following steps: Obtain the overlap ratio between effective actual actions and safe construction actions. Take the average of the overlap ratios between safe construction actions and effective actual actions in the safe operation set of the operation steps to obtain the verification value of the operation steps and effective actual actions. The effective actual actions are matched to the operation steps in the target task that have the highest verification value with the effective actual actions.

10. The method for identifying unsafe behaviors of personnel at water conservancy construction sites based on computer vision according to claim 9, characterized in that, The process of identifying the safety of the valid actual actions corresponding to the operation steps includes the following steps: One of the standard construction actions is randomly selected as the sample action, and the reproducible action generated by the construction workers repeating the sample action at least once is obtained in advance. Subtract the overlap ratio between the reproduced action and the sample action from 1 to obtain the error ratio. Take the maximum value of the error ratio as the allowable error. If the overlap ratio between the effective actual action and one of the safe construction actions in the set of safe operation steps is less than 1, the effective actual action is judged to be a safe action; otherwise, the effective actual action is judged to be an unsafe action.

Images