Warning methods for excavator construction

Abstract

The present invention provides a warning method for excavator construction, comprising the following steps: deploying monitoring equipment at the construction site to perform real-time video recording to obtain original video; identifying partial data including the excavator and personnel in the original video and outputting it into a construction picture; establishing a coordinate system based on the construction picture; identifying the excavator and framing it along the edge of the excavator to form a first frame, recording the coordinates of two opposite corners; identifying a person and framing him along the edge of the person to form a second frame, recording the coordinates of two opposite corners; calculating the area overlap of the first frame and the second frame based on the coordinates of the two opposite corners of the first frame and the coordinates of the two opposite corners of the second frame; and issuing several levels of risk alerts based on the value of the overlap. The present invention can automatically identify dangerous behaviors in videos and improve the supervision of dangerous behaviors.

Description

Technical Field

[0001] The present invention relates to the technical field of safe construction, and in particular to a warning method for excavator construction. Background Art

[0002] Due to limited working space, complex construction environments, and the intensive workload of high-risk construction tasks, supervisors are unable to fully monitor and inspect construction site safety at all times. Deploying video surveillance at construction sites allows for remote monitoring of construction progress, achieving comprehensive coverage. However, video surveillance still requires human involvement and lacks intelligent safety monitoring, wasting significant manpower and resources. Furthermore, it is difficult for supervisors to identify potential safety hazards from multiple images in a timely manner, making accidents highly likely to occur. Summary of the Invention

[0003] In view of the above situation, the present invention provides a warning method for excavator construction, which solves the technical problems of inadequate and difficult safety supervision in traditional construction. By digitizing the positional relationship between the excavator and personnel in the video data, and then comparing the data through a program to obtain a comparison result, an alarm is given according to the comparison result. The supervisor only needs to pay close attention to the alarm signal to identify dangerous behavior, thereby improving the supervision of dangerous behavior and improving the safety of construction.

[0004] To achieve the above object, the technical solution adopted by the present invention is:

[0005] A warning method for excavator construction includes the following steps:

[0006] Deploy surveillance equipment at the construction site to record real-time video and obtain original video;

[0007] Identify the data of the excavator and personnel in the original video and output it as a construction picture;

[0008] An XOY coordinate system is established with the upper left corner of the construction picture as the origin, with the X axis of the coordinate system extending along the top edge of the construction picture and the Y axis extending along the left edge of the construction picture;

[0009] The excavator in the construction picture is framed to form a first rectangular frame, including:

[0010] Identifying the extreme point of the excavator along the X-axis, and then drawing a vertical straight line through the extreme point of the X-axis;

[0011] Identify the limit point of the excavator along the Y-axis, draw a horizontal straight line through the limit point of the Y-axis, so that the vertical straight line and the horizontal straight line enclose a first frame, record the coordinates of the upper right corner of the first frame (x1, y1), and record the coordinates of the lower left corner of the first frame (x2, y2);

[0012] Select the person in the construction picture to form a second rectangular frame, record the coordinates of the upper right corner of the second frame (x3, y3), and record the coordinates of the lower left corner of the second frame (x4, y4);

[0013] Calculate the degree of overlap between the areas of the first frame and the second frame according to (x1, y1), (x2, y2), (x3, y3), and (x4, y4);

[0014] A corresponding risk level is issued according to the value of the overlap.

[0015] A further improvement of the warning method for excavator construction of the present invention is that, when calculating the overlap, the method further comprises:

[0016] Calculate the overlapping area of the overlapping portion of the first frame and the second frame and the total area occupied by the first frame and the second frame according to the coordinates (x1, y1), (x2, y2), (x3, y3) and (x4, y4);

[0017] The overlapping area is divided by the total area to obtain the degree of overlap.

[0018] A further improvement of the warning method for excavator construction of the present invention is that, when obtaining the construction picture, it also includes:

[0019] Each frame in the original video is output as a construction picture.

[0020] A further improvement of the warning method for excavator construction of the present invention is that after obtaining the coordinates, the method further comprises:

[0021] Compare (x1, y1), (x2, y2), (x3, y3) and (x4, y4) in the construction pictures with the corresponding four coordinates in the construction picture of the previous frame, and delete the construction picture of the next frame.

[0022] A further improvement of the warning method for excavator construction of the present invention is that it further comprises:

[0023] Delete several construction pictures that only have the first frame or only have the second frame.

[0024] A further improvement of the warning method for excavator construction of the present invention is that the risk level includes a blue alert, a yellow alert, and a red alert;

[0025] When the overlap value is equal to 0, a blue alarm is issued;

[0026] When the overlap value is greater than 0 and less than 1, a yellow alarm is issued;

[0027] When the overlap value is equal to 1, a red alarm is issued.

[0028] A further improvement of the warning method for excavator construction of the present invention is that it further includes a display screen and a buzzer;

[0029] When the overlap value is equal to 0, the display screen shows a blue alarm;

[0030] When the overlap value is greater than 0 and less than 1, the display screen shows a yellow alarm;

[0031] When the value of the overlap is equal to 1, the display screen displays a red alarm and the buzzer sounds.

[0032] A further improvement of the warning method for excavator construction of the present invention is that it further comprises:

[0033] Establishing an SSD learning model and providing a plurality of target images with known overlap, inputting the target images with known overlap into the SSD learning model for processing and obtaining a plurality of test overlaps, and comparing the plurality of test overlaps with the plurality of known overlaps of the target images to obtain a comparison result;

[0034] Adjusting the parameters of the SSD learning model according to the comparison result to form an SSD detection model;

[0035] The construction picture is input into the SSD detection model, and then the excavator and personnel in the construction picture are framed and selected, and the overlap degree is calculated.

[0036] A further improvement of the warning method for excavator construction of the present invention is that, when a person in the construction picture is framed, the method further includes:

[0037] Identify the person's extreme point along the X-axis, and then draw a vertical straight line through the extreme point of the X-axis;

[0038] The limit point of the person along the Y-axis is identified, and then a horizontal straight line is drawn through the limit point of the Y-axis, so that the vertical straight line and the horizontal straight line enclose a second frame.

[0039] The warning method for excavator construction of the present invention outputs video data into a construction picture, processes the construction picture to obtain the spatial relationship between the excavator and the personnel, and then judges whether the personnel are safe based on the spatial relationship. The display and buzzer are used to remind the supervisor, so that the supervisor can identify dangerous behaviors in time, thereby improving the supervision of dangerous behaviors and improving the safety of construction. BRIEF DESCRIPTION OF THE DRAWINGS

[0040] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0041] Figure 1 It is a flow chart of the warning method for excavator construction of the present invention. DETAILED DESCRIPTION

[0042] To facilitate understanding of the present invention, the following description is given with reference to the accompanying drawings and embodiments.

[0043] See also Figure 1 The present invention provides a warning method for excavator construction, comprising the following steps:

[0044] Deploy surveillance equipment at the construction site to record real-time video and obtain original video;

[0045] Identify the data of the excavator and personnel in the original video and output it as a construction picture;

[0046] An XOY coordinate system is established with the upper left corner of the construction picture as the origin, with the X axis of the coordinate system extending along the top edge of the construction picture and the Y axis extending along the left edge of the construction picture;

[0047] Select the excavator in the construction picture to form a first rectangular frame, record the coordinates of the upper right corner of the first frame as (x1, y1), and record the coordinates of the lower left corner of the first frame as (x2, y2);

[0048] Select the person in the construction picture to form a second rectangular frame, record the coordinates of the upper right corner of the second frame as (x3, y3), and record the coordinates of the lower left corner of the second frame as (x4, y4);

[0049] Calculating the degree of overlap between the areas of the first frame and the second frame according to the coordinates (x1, y1), (x2, y2), (x3, y3), and (x4, y4);

[0050] A corresponding risk level is issued according to the value of the overlap.

[0051] A preferred implementation example of the warning method for excavator construction of the present invention is that when calculating the overlap, the method further includes:

[0052] Calculate the overlapping area of the overlapping portion of the first frame and the second frame and the total area occupied by the first frame and the second frame according to the coordinates (x1, y1), (x2, y2), (x3, y3) and (x4, y4);

[0053] The overlapping area is divided by the total area to obtain the degree of overlap.

[0054] Furthermore, when obtaining construction pictures, it also includes:

[0055] Output each frame in the original video as a construction picture.

[0056] Furthermore, after obtaining the coordinates, the following steps are also included:

[0057] The (x1, y1), (x2, y2), (x3, y3) and (x4, y4) in several construction pictures are compared with the corresponding four coordinates in the previous frame of the construction picture. If the comparison results are consistent, the next frame of the construction picture is deleted, which reduces the number of pictures to be processed and improves the detection efficiency.

[0058] Furthermore, it also includes:

[0059] Delete several construction pictures that only have the first frame or only have the second frame.

[0060] Furthermore, the risk level includes blue alert, yellow alert, and red alert;

[0061] When the overlap value is equal to 0, a blue alarm is issued;

[0062] When the overlap value is greater than 0 and less than 1, a yellow alarm is issued;

[0063] When the overlap value is equal to 1, a red alarm is issued.

[0064] Furthermore, it also includes a display screen and a buzzer;

[0065] When the overlap value is equal to 0, the display screen shows a blue alarm;

[0066] When the overlap value is greater than 0 and less than 1, the display screen shows a yellow alarm;

[0067] When the value of the overlap is equal to 1, the display screen displays a red alarm and the buzzer sounds.

[0068] Furthermore, it also includes:

[0069] Establishing an SSD learning model and providing a plurality of target images with known overlap, inputting the target images with known overlap into the SSD learning model for processing and obtaining a plurality of test overlaps, and comparing the plurality of test overlaps with the plurality of known overlaps of the target images to obtain a comparison result;

[0070] Adjusting the parameters of the SSD learning model according to the comparison result to form an SSD detection model;

[0071] The hydraulic engineering image is input into the SSD detection model, and then the SSD detection model outputs each frame of the original video as a construction image, and then selects the excavator and personnel in the construction image, and calculates the overlap degree.

[0072] Furthermore, when the excavator in the construction picture is selected, the following is also included:

[0073] Identify the limit point of the excavator along the X-axis direction, and then draw a vertical straight line through the limit point of the X-axis;

[0074] The limit point of the excavator along the Y-axis direction is identified, and then a horizontal straight line is drawn through the limit point of the Y-axis, so that the vertical straight line and the horizontal straight line enclose each other to form a first frame.

[0075] Furthermore, when selecting a person in the construction picture, it also includes:

[0076] Identify the person's extreme point along the X-axis, and then draw a vertical straight line through the extreme point of the X-axis;

[0077] The limit point of the person along the Y-axis is identified, and then a horizontal straight line is drawn through the limit point of the Y-axis, so that the vertical straight line and the horizontal straight line enclose a second frame.

[0078] Specifically, the overlap is represented by the IOU value.

[0079] Preferably, the coordinates of the two relative corners of the first frame are written into coordinate codes;

[0080] A calculation program is formed based on the area calculation formula table, and the coordinate code is brought into the calculation program to obtain the area values of the first frame and the second frame, and output as an area code. Then, the system calculates the overlap degree according to the area code to output the overlap degree code.

[0081] Specifically, it also includes:

[0082] Provides the Pellet inference engine, which is used to translate the code information of the IOU value into concrete information.

[0083] Specifically, the SSD model is used to pixelate the construction picture so that the construction picture forms a number of unit points, and each unit point corresponds to a spatial coordinate.

[0084] The warning method for excavator construction of the present invention outputs video data into a construction picture, processes the construction picture to obtain the spatial relationship between the excavator and the personnel, and then judges whether the personnel are safe based on the spatial relationship. The display and buzzer are used to remind the supervisor, so that the supervisor can identify dangerous behaviors in time, thereby improving the supervision of dangerous behaviors and improving the safety of construction.

[0085] A specific implementation case of the warning method for excavator construction of the present invention is to deploy monitoring equipment at the construction site to perform real-time video recording to obtain original video;

[0086] The original video is input into the SSD detection model, and then the SSD detection model outputs each frame of the original video as a construction picture;

[0087] The SSD detection model selects the excavator in the construction picture to form a first rectangular frame, records the coordinates of the upper right corner of the first frame as (x1, y1), and records the coordinates of the lower left corner of the first frame as (x2, y2); selects the person in the construction picture to form a second rectangular frame, records the coordinates of the upper right corner of the second frame as (x3, y3), and records the coordinates of the lower left corner of the second frame as (x4, y4); then deletes several pictures in which only the excavator is identified, deletes several pictures in which only the person is identified, deletes several pictures with overlapping coordinates, and then calculates the overlap of the areas of the first frame and the second frame of the remaining pictures;

[0088] When the overlap value is equal to 0, the display screen shows a blue alarm;

[0089] When the overlap value is greater than 0 and less than 1, the display screen shows a yellow alarm;

[0090] When the value of the overlap is equal to 1, the display screen displays a red alarm and the buzzer sounds.

[0091] The above description is merely a preferred embodiment of the present invention and does not constitute any form of limitation to the present invention. Although the present invention has been disclosed as a preferred embodiment as above, it is not intended to limit the present invention. Any technician familiar with this profession can make some changes or modifications to equivalent embodiments of the technical contents disclosed above without departing from the scope of the technical solution of the present invention. However, any simple modifications, equivalent changes and modifications made to the above embodiments based on the technical essence of the present invention without departing from the content of the technical solution of the present invention are still within the scope of the technical solution of the present invention.

Claims

1. A warning method for excavator construction, characterized in that: The steps include: Deploy surveillance equipment at the construction site to record real-time video and obtain original video; Identifying data of the excavator and personnel in the original video and outputting the data into a construction picture; Establishing an XOY coordinate system with the upper left corner of the construction picture as the origin, with the X axis of the coordinate system extending along the top edge of the construction picture and the Y axis extending along the left edge of the construction picture; Selecting the excavator in the construction picture to form a first rectangular frame includes: Identifying the extreme point of the excavator along the X-axis, and then drawing a vertical straight line through the extreme point of the X-axis; Identify the limit point of the excavator along the Y-axis, draw a horizontal straight line through the limit point of the Y-axis, so that the vertical straight line and the horizontal straight line enclose a first frame, record the coordinates of the upper right corner of the first frame (x1, y1), and record the coordinates of the lower left corner of the first frame (x2, y2); Select the person in the construction picture to form a second rectangular frame, record the coordinates of the upper right corner of the second frame (x3, y3), and record the coordinates of the lower left corner of the second frame (x4, y4); Calculating the degree of overlap between the areas of the first frame and the second frame according to (x1, y1), (x2, y2), (x3, y3), and (x4, y4); A corresponding risk level is issued according to the value of the overlap.

2. The warning method for excavator construction according to claim 1, characterized in that: When calculating the overlap, the following steps are also included: Calculate the overlapping area of the overlapping portion of the first frame and the second frame and the total area occupied by the first frame and the second frame according to the coordinates (x1, y1), (x2, y2), (x3, y3) and (x4, y4); The overlapping area is divided by the total area to obtain the degree of overlap.

3. The warning method for excavator construction according to claim 1, characterized in that: When obtaining the construction pictures, the following is also included: Each frame in the original video is output as a construction picture.

4. The warning method for excavator construction according to claim 3, characterized in that: After obtaining the coordinates, the method further includes: Compare (x1, y1), (x2, y2), (x3, y3) and (x4, y4) in the construction pictures with the corresponding four coordinates in the construction picture of the previous frame. If the comparison results are consistent, delete the construction picture of the next frame.

5. The warning method for excavator construction according to claim 4, characterized in that: Also includes: Delete several construction pictures that only have the first frame or only have the second frame.

6. The warning method for excavator construction according to claim 1, characterized in that: The risk levels include blue alert, yellow alert and red alert; When the value of the overlap is equal to 0, a blue alarm is issued; When the value of the overlap is greater than 0 and less than 1, a yellow alarm is issued; When the value of the overlap is equal to 1, a red alarm is issued.

7. The warning method for excavator construction according to claim 6, characterized in that: Also includes a display and buzzer; When the value of the overlap is equal to 0, the display screen displays a blue alarm; When the value of the overlap is greater than 0 and less than 1, the display screen displays a yellow alarm; When the value of the overlap is equal to 1, the display screen displays a red alarm and the buzzer sounds.

8. The warning method for excavator construction according to claim 1, characterized in that: Also includes: Establishing an SSD learning model and providing a plurality of target images with known overlap, inputting the target images with known overlap into the SSD learning model for processing and obtaining a plurality of test overlaps, and comparing the plurality of test overlaps with the plurality of known overlaps of the target images to obtain a comparison result; Adjusting the parameters of the SSD learning model according to the comparison result to form an SSD detection model; The construction picture is input into the SSD detection model, and then the excavator and personnel in the construction picture are framed and selected, and the overlap degree is calculated.

9. The warning method for excavator construction according to claim 1, characterized in that: When you select a person in the construction picture, it also includes: Identify the extreme points of the person along the X-axis, and then draw a vertical straight line through the extreme points of the X-axis; The limit point of the person along the Y-axis is identified, and then a horizontal straight line is drawn through the limit point of the Y-axis, so that the vertical straight line and the horizontal straight line enclose a second frame.

Images