Steel beam hoisting monitoring system and method based on machine vision and tension sensor
By combining machine vision and tension sensor technology, high-precision automation of steel beam lifting monitoring system is achieved, solving the problems of large errors and strong human subjectivity of the existing methods, and improving the reliability and efficiency of the lifting process.
Patent Information
- Application Number
- CN202210264729.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-03-17
- Publication Date
- 2024-12-06
- Estimated Expiration
- 2042-03-17
AI Technical Summary
The existing steel beam lifting monitoring methods have large errors and strong human subjectivity. They cannot effectively determine the relative relationship between the spatial location of the two beam sections, and are greatly affected by environmental factors.
Adopt a steel beam lifting monitoring system based on machine vision and tension sensors, and monitors tension sensor data and image information in real time through industrial cameras and intelligent computing terminals, and automatically adjusts the crane to ensure parallelism and alignment of beam segments, realizing unmanned real-time monitoring and intelligent Auxiliary control.
It improves monitoring accuracy and practicality at the project site, reduces operation and maintenance costs, realizes wireless data transmission and intelligent control, and allows technicians to remotely monitor the lifting situation.
Smart Images

Figure CN114920145B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of monitoring methods for hoisting bridge steel beams, and more specifically, to a monitoring system and method for hoisting steel beams based on machine vision and tension sensors. Background Art
[0002] In the existing bridge steel beam construction, the cantilever assembly method is usually adopted for hoisting. With the increase of bridge span and the development of science and technology, the steel beam construction space becomes more and more complex and the hoisting difficulty becomes greater and greater.
[0003] The traditional method of monitoring the lifting of steel beams is to adjust the posture of the beam before it is lifted, so that it remains horizontal and has no rotation angle. A tension sensor is installed at the crane cable to obtain tension data, and the symmetry of the force is used to determine whether the steel beam is deflected. During the lifting process, the commander observes the displacement and rotation angle of the beam with his naked eyes. This monitoring method has large errors, requires high professional skills of the commander, has strong human subjective uncertainty, and is greatly affected by environmental factors.
[0004] The emerging machine vision-based displacement monitoring technology has many advantages such as non-contact, long-distance, high precision, time-saving and labor-saving, and multi-point monitoring. It has been widely used in bridge deflection and displacement monitoring. However, the existing methods can only measure the in-plane relative displacement of multiple points on the bridge, and cannot determine the relative relationship between the spatial positions of the two beam sections. Summary of the invention
[0005] In order to achieve these purposes and other advantages according to the present invention, a preferred embodiment of the present invention provides a steel beam hoisting monitoring system based on machine vision and tension sensors to monitor the beam sections to be erected and the erected beam sections to facilitate the splicing of the two, including tension sensors, industrial cameras, intelligent computing terminals, wireless bridges, network switches, square reference targets, and square monitoring targets, wherein:
[0006] The bridge crane is connected to the beam section to be erected through a steel wire rope, and the tension sensor is installed on the steel wire rope;
[0007] The industrial camera is fixed on the bridge crane so that its lens faces vertically downward;
[0008] The network switch is respectively connected to the industrial camera, the intelligent computing terminal, and the wireless bridge for communication;
[0009] The square reference targets are located on both sides of the bridge deck of the erected beam section;
[0010] The square monitoring targets are located at both sides of the bridge deck at the end of the beam to be erected, and the square monitoring targets correspond to the square reference targets one by one.
[0011] Preferably, there are four tension sensors and four steel wire ropes, namely tension sensor No. 1, tension sensor No. 2, tension sensor No. 3 and tension sensor No. 4, which are respectively installed on steel wire rope No. 1, steel wire rope No. 2 and steel wire rope No. 3, with the same installation conditions, and are used to monitor the tension of the steel wire ropes.
[0012] Preferably, the wireless bridge includes a transmitting end and a receiving end, and the transmitting end and the receiving end are used in pairs to provide a network for the industrial camera and the intelligent computing terminal.
[0013] Preferably, there are two square reference targets, namely square reference target No. 1 and square reference target No. 2, which are respectively arranged on both sides of the bridge deck of the erected beam section, and the image center line of square reference target No. 1 and square reference target No. 2 is L3.
[0014] Preferably, there are two square monitoring targets, namely square monitoring target No. 1 and square monitoring target No. 2, which are respectively arranged on both sides of the bridge deck of the beam section to be erected, and the image center connection line of square monitoring target No. 1 and square monitoring target No. 2 is L4;
[0015] The two square monitoring targets and the two square reference targets correspond one to one, the image center line between square reference target No. 1 and square monitoring target No. 1 is L1, and the image center line between square reference target No. 2 and square monitoring target No. 2 is L2.
[0016] On the other hand, a preferred embodiment of the present invention also provides a steel beam hoisting monitoring method based on machine vision and tension sensor, comprising the following steps:
[0017] S1. Use a bridge crane to lift the beam section to be erected to a height approximately equal to that of the erected beam section;
[0018] With the longitudinal bridge direction as the X axis, the elevation direction as the Y axis, and the transverse bridge direction as the Z axis, the X axis, Y axis, and Z axis intersect at point O, and the plane XOZ is horizontal;
[0019] S2, Angle monitoring around X axis
[0020] The tension values of the four tension sensors are monitored in real time, and the intelligent computing terminal controls the bridge crane to adjust the beam section to be erected to rotate around the X-axis until the tension values of the No. 2 tension sensor and the No. 4 tension sensor are equal, and the tension values of the No. 1 tension sensor and the No. 3 tension sensor are equal, that is, the tension of the two pairs of steel wire ropes are equal;
[0021] S3: Angle monitoring around the Y axis
[0022] The intelligent computing terminal controls the bridge crane to adjust the beam section to be erected to rotate around the Y axis until the image center line L4 of the square monitoring target No. 1 and the square monitoring target No. 2 is parallel to the image center line L3 of the square reference target No. 1 and the square reference target No. 2;
[0023] S4: Angle monitoring around the Z axis
[0024] The intelligent computing terminal controls the bridge crane to adjust the beam section to be erected to rotate around the Z axis until the tension values of the No. 1 tension sensor and the No. 2 tension sensor are equal, and the readings of the No. 3 tension sensor and the No. 4 tension sensor are equal, that is, the tension of the two pairs of wire ropes are equal;
[0025] S5. Monitor the displacement in the Y direction
[0026] The intelligent computing terminal calculates the relative height difference between the beam segment to be erected and the erected beam segment in real time, and the intelligent computing terminal sends a hoisting instruction to control the bridge deck crane to move the beam segment to be erected along the Y-axis direction until the relative height difference between the beam segment to be erected and the erected beam segment is 0;
[0027] S6. Monitor the displacement of the transverse bridge in the Z direction
[0028] The intelligent computing terminal controls the bridge crane to move the beam segment to be erected along the Z-axis direction until L1 is perpendicular to L3, and L2 is perpendicular to L3;
[0029] S7. Monitor displacement in X direction
[0030] The intelligent computing terminal controls the bridge crane to move the beam segment to be erected along the X-axis direction until the beam segment to be erected and the erected beam segment are close to each other and spliced together.
[0031] 7. The method for monitoring steel beam hoisting based on machine vision and tension sensor according to claim 6 is characterized in that the step S4: monitoring the rotation angle around the Y axis is specifically:
[0032] The intelligent computing terminal monitors in real time whether L3 and L4 are parallel. If they are not parallel, the intelligent computing terminal controls the bridge crane to move the beam section to be erected along the Y-axis direction until L4 is parallel to L3.
[0033] The present invention has at least the following beneficial effects:
[0034] 1. The steel beam hoisting monitoring system based on machine vision and tension sensor proposed in the present invention has a simple structure, a strong practicability in engineering site monitoring method, high monitoring accuracy, low operation and maintenance cost, and has the characteristics of unmanned real-time monitoring, wireless data transmission, and intelligent auxiliary control.
[0035] 2. The steel beam hoisting monitoring method based on machine vision and tension sensor proposed in the present invention combines machine vision technology and tension sensor and applies them to the bridge steel beam erection project. The beam end to be erected is leveled by the tension sensor, and then the target image is collected and transmitted to the intelligent computing terminal by the industrial camera. The intelligent computing terminal recognizes and processes the received target image, calculates the spatial posture of the beam end to be erected, the relative distance between the erected beam end and the beam end to be erected, uploads the calculation results to the cloud database, and issues a beam hoisting control command for reference by the bridge crane operator.
[0036] 3. The steel beam hoisting monitoring method based on machine vision and tension sensors proposed in the present invention allows technicians to download data from the database at any location outside the site to understand the on-site hoisting situation.
[0037] Other advantages, objectives and features of the present invention will be embodied in part through the following description, and in part will be understood by those skilled in the art through study and practice of the present invention. BRIEF DESCRIPTION OF THE DRAWINGS
[0038] Figure 1 It is a structural schematic diagram of the steel beam hoisting monitoring system based on machine vision and tension sensors of the present invention.
[0039] Figure 2 It is a top view of the erected beam section and the beam end to be erected in the present invention.
[0040] Figure 3 This is a schematic diagram of using a tension sensor to monitor the beam section to be erected according to the present invention.
[0041] Description of reference numerals: 1. industrial camera, 2. intelligent computing terminal, 3. wireless bridge, 4. network switch, 5. square reference target, 6. square monitoring target, 7. bridge crane, 8. erected beam section, 9. beam end to be erected, 10. tension sensor,
[0042] 5-1, square benchmark target No. 1, 5-2, square benchmark target No. 2,
[0043] 6-1, square monitoring target No. 1, 6-2, square monitoring target No. 2,
[0044] The image centers of L1, 5-1 and 6-1 are connected, the image centers of L2, 5-2 and 6-2 are connected, the image centers of L3, 5-1 and 5-2 are connected, the image centers of L4, 6-1 and 6-2 are connected,
[0045] 10-1, No. 1 tension sensor, 10-2, No. 2 tension sensor, 10-3, No. 3 tension sensor, 10-4, No. 4 tension sensor. DETAILED DESCRIPTION
[0046] The present invention is further described in detail below in conjunction with the accompanying drawings so that those skilled in the art can implement the invention with reference to the description.
[0047] The following description is used to disclose the present invention so that those skilled in the art can implement the present invention. The preferred embodiments described below are only examples, and those skilled in the art can think of other obvious variations. The basic principles of the present invention defined in the following description can be applied to other embodiments, variations, improvements, equivalents, and other technical solutions that do not deviate from the spirit and scope of the present invention.
[0048] Those skilled in the art should understand that, in the disclosure of the present invention, the orientation or position relationship indicated by the terms "longitudinal", "lateral", "up", "down", "front", "back", "left", "right", "vertical", "horizontal", "top", "bottom", "inside", "outside", etc. are based on the orientation or position relationship shown in the drawings, which are only for the convenience of describing the present invention and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, be constructed and operate in a specific orientation. Therefore, the above terms should not be understood as limiting the present invention.
[0049] It is to be understood that the term "one" should be understood as "at least one" or "one or more", that is, in one embodiment, the number of an element may be one, while in another embodiment, the number of the element may be multiple, and the term "one" should not be understood as a limitation on the quantity.
[0050] like Figure 1-3 As shown, a preferred embodiment of the present invention provides a steel beam hoisting monitoring system based on machine vision and tension sensors to monitor the beam section 9 to be erected and the erected beam section 8 to facilitate the splicing of the two, including a tension sensor 10, an industrial camera 1, an intelligent computing terminal 2, a wireless bridge 3, a network switch 4, a square reference target 5, and a square monitoring target 6, wherein:
[0051] The bridge crane 7 is connected to the beam section 9 to be erected through a steel wire rope, and the tension sensor 10 is installed on the steel wire rope;
[0052] The industrial camera 1 is fixed on the bridge crane 7 so that its lens faces vertically downward;
[0053] The network switch 4 is respectively connected to the industrial camera 1, the intelligent computing terminal 2, and the wireless bridge 3 for communication;
[0054] The square reference targets 5 are located on both sides of the bridge deck where the beam sections 8 have been erected;
[0055] The square monitoring targets are located on both sides of the bridge deck of the beam end 9 to be erected, and the number of the square monitoring targets 6 and the square reference targets 5 are the same and correspond one to one.
[0056] There are four tension sensors 10 and four steel wire ropes, namely tension sensor No. 1 10-1, tension sensor No. 2 10-2, tension sensor No. 3 10-3 and tension sensor No. 4 10-4, which are respectively installed on steel wire rope No. 1, steel wire rope No. 2, steel wire rope No. 3 and steel wire rope No. 4, with the same installation conditions, and are used to monitor the tension of the steel wire ropes.
[0057] The transmitting end of the wireless bridge and the receiving end of the wireless bridge are used in pairs to provide a network for the industrial camera 1 and the intelligent computing terminal 2.
[0058] There are two square reference targets 5, namely square reference target No. 1 5-1 and square reference target No. 2 5-2, which are arranged on both sides of the bridge deck of the erected beam section 8 and are completely symmetrically distributed along the axial direction of the bridge. The image centers of square reference target No. 1 5-1 and square reference target No. 2 5-2 are connected by a line L3.
[0059] There are two square monitoring targets 5, namely, square monitoring target No. 1 6-1 and square monitoring target No. 2 6-2, which are arranged on both sides of the bridge deck of the beam section 9 to be erected, and are completely symmetrically distributed along the bridge axis. The image center line of square monitoring target No. 1 and square monitoring target No. 2 is L4;
[0060] The two square monitoring targets and the two square reference targets correspond one to one, the image center connection line of square reference target No. 1 5-1 and square monitoring target No. 1 6-1 is L1, and the image center connection line of square reference target No. 2 5-2 and square monitoring target No. 2 6-2 is L2.
[0061] Another preferred embodiment of the present invention provides a steel beam hoisting monitoring method based on machine vision and tension sensor, comprising the following steps:
[0062] S1. Use a bridge crane to lift the beam section 9 to be erected to a height approximately equal to that of the erected beam section 8;
[0063] With the longitudinal bridge direction as the X axis, the elevation direction as the Y axis, and the transverse bridge direction as the Z axis, the X axis, Y axis, and Z axis intersect at point O, and the plane XOZ is horizontal;
[0064] Specifically, whether L3 and L4 are parallel is monitored in real time. If they are not parallel, a lifting instruction is sent to control the bridge crane to adjust the posture of the beam section 9 to be erected until L4 is parallel to L3.
[0065] The industrial camera lens is pointed vertically downward. After taking videos and photos, the video and photo information is transmitted to the intelligent computing terminal. After image processing, the intelligent computing terminal can know the number of pixels occupied by square reference target No. 1 5-1, square reference target No. 2 5-2, square monitoring target No. 1 6-1, and square monitoring target No. 2 6-2 in the photo, and the corresponding relationship between pixels and actual geometric dimensions can be obtained. By finding the calibration data relationship line (the corresponding relationship line of the camera distance-geometric dimension-pixel of the industrial camera calibrated in the laboratory in advance), the distance between the industrial camera and the photographed object can be determined, and the distance between the industrial camera and square reference target No. 1 5-1, square reference target No. 2 5-2, square monitoring target No. 1 6-1, and square monitoring target No. 2 6-2 can be determined, and the relative elevation of the erected beam section 8 and the beam end 9 to be erected can be determined.
[0066] S2, monitor the rotation angle around the X axis
[0067] The tension values of the four tension sensors are monitored in real time, and the intelligent computing terminal controls the bridge crane to adjust the beam section to be erected to rotate around the X-axis until the tension values of the No. 2 tension sensor 10-2 and the No. 4 tension sensor 10-4 are equal, and the tension values of the No. 1 tension sensor 10-1 and the No. 3 tension sensor 10-3 are equal, that is, the tension of the two pairs of steel wire ropes are equal;
[0068] S3: Monitor the rotation angle around the Y axis
[0069] The intelligent computing terminal controls the bridge crane to adjust the beam section to be erected to rotate around the Y axis until L4 is parallel to L3;
[0070] S4: Monitor the rotation angle around the Z axis
[0071] The intelligent computing terminal controls the bridge crane to adjust the beam section to be erected to rotate around the Z axis until the tension values of the No. 1 tension sensor 10-1 and the No. 2 tension sensor 10-2 are equal, and the readings of the No. 3 tension sensor 10-3 and the No. 4 tension sensor 10-4 are equal, that is, the tension of the two pairs of wire ropes are equal;
[0072] S5. Monitor the displacement in the Y direction
[0073] The intelligent computing terminal calculates the relative height difference between the beam segment 9 to be erected and the erected beam segment 8 in real time, and the intelligent computing terminal sends a hoisting instruction to control the bridge deck crane to move the beam segment 9 to be erected along the Y-axis direction until the relative height difference between the beam segment 9 to be erected and the erected beam segment 8 is 0;
[0074] S6. Monitor the displacement of the transverse bridge in the Z direction
[0075] The intelligent computing terminal controls the bridge crane to move the beam segment 9 to be erected along the Z-axis direction until L1 is perpendicular to L3, and L2 is perpendicular to L3;
[0076] S7, monitor the displacement along the bridge (X direction)
[0077] The intelligent computing terminal controls the bridge crane to move the beam segment to be erected along the X-axis direction until the beam segment to be erected 9 and the erected beam segment 8 are close to each other and spliced together.
[0078] Among them, step S1, step S2 and step S3 respectively rotate the beam section 9 to be erected around the X-axis direction, the Y-axis direction and the Z-axis direction, and finally adjust the beam section 9 to be erected so as to keep it horizontal.
[0079] Step S4, step S5 and step S6 respectively translate the beam section 9 to be erected in the X-axis direction, the Y-axis direction and the Z-axis direction, and finally realize the splicing of the beam section 9 to be erected and the erected beam section 8.
[0080] Although the embodiments of the present invention have been disclosed as above, they are not limited to the applications listed in the specification and the implementation modes, and they can be fully applied to various fields suitable for the present invention. For those familiar with the art, additional modifications can be easily implemented. Therefore, without departing from the general concept defined by the claims and the scope of equivalents, the present invention is not limited to the specific details and the illustrations shown and described herein.
Claims
1. A steel beam hoisting monitoring system based on machine vision and tension sensors to monitor the beam sections to be erected and the erected beam sections to facilitate the splicing of the two. It is characterized in that It includes tension sensors, industrial cameras, intelligent computing terminals, wireless bridges, network switches, square benchmark targets, and square monitoring targets. The bridge crane is connected to the beam section to be erected through a steel wire rope, and the tension sensor is installed on the steel wire rope; The industrial camera is fixed on the bridge crane so that its lens faces vertically downward; The network switch is respectively connected to the industrial camera, the intelligent computing terminal, and the wireless bridge for communication; The square reference targets are located on both sides of the bridge deck of the erected beam section; The square monitoring targets are located on both sides of the bridge deck at the end of the beam to be erected, and the square monitoring targets correspond to the square reference targets one by one; There are four tension sensors and four steel wire ropes, namely tension sensor No. 1, tension sensor No. 2, tension sensor No. 3 and tension sensor No. 4, which are respectively installed on steel wire rope No. 1, steel wire rope No. 2 and steel wire rope No. 3, and the installation conditions are the same, and they are used to monitor the tension of the steel wire ropes; There are two square reference targets, namely square reference target No. 1 and square reference target No. 2, which are respectively arranged on both sides of the bridge deck of the erected beam section, and the image center line of square reference target No. 1 and square reference target No. 2 is L3; There are two square monitoring targets, namely square monitoring target No. 1 and square monitoring target No. 2, which are arranged on both sides of the bridge deck of the beam section to be erected, and the image center connection line of square monitoring target No. 1 and square monitoring target No. 2 is L4; The two square monitoring targets and the two square reference targets correspond one to one, the image center line between square reference target No. 1 and square monitoring target No. 1 is L1, and the image center line between square reference target No. 2 and square monitoring target No. 2 is L2.
2. According to claim 1, the steel beam hoisting monitoring system based on machine vision and tension sensor, It is characterized in that The wireless bridge includes a transmitting end and a receiving end, which are used in pairs to provide a network for the industrial camera and the intelligent computing terminal.
3. A method for monitoring the lifting of a steel beam based on the steel beam lifting monitoring system based on machine vision and a tension sensor according to any one of claims 1 to 2, It is characterized in that The following steps are involved: S1. Use a bridge crane to lift the beam section to be erected to a height approximately the same as that of the erected beam section; With the longitudinal bridge direction as the X axis, the elevation direction as the Y axis, and the transverse bridge direction as the Z axis, the X axis, Y axis, and Z axis intersect at point O, and the plane XOZ is horizontal; S2, Angle monitoring around X axis The tension values of the four tension sensors are monitored in real time, and the intelligent computing terminal controls the bridge crane to adjust the beam section to be erected to rotate around the X-axis until the tension values of the No. 2 tension sensor and the No. 4 tension sensor are equal, and the tension values of the No. 1 tension sensor and the No. 3 tension sensor are equal, that is, the tension of the two pairs of steel wire ropes are equal; S3: Angle monitoring around the Y axis The intelligent computing terminal controls the bridge crane to adjust the beam section to be erected to rotate around the Y axis until L4 is parallel to L3; S4: Angle monitoring around the Z axis The intelligent computing terminal controls the bridge crane to adjust the beam section to be erected to rotate around the Z axis until the tension values of the No. 1 tension sensor and the No. 2 tension sensor are equal, and the readings of the No. 3 tension sensor and the No. 4 tension sensor are equal; S5. Monitor the displacement in the Y direction The intelligent computing terminal calculates the relative height difference between the beam segment to be erected and the erected beam segment in real time, and the intelligent computing terminal sends a hoisting instruction to control the bridge deck crane to move the beam segment to be erected along the Y-axis direction until the relative height difference between the beam segment to be erected and the erected beam segment is 0; S6. Monitor the displacement of the transverse bridge in the Z direction The intelligent computing terminal controls the bridge crane to move the beam segment to be erected along the Z-axis direction until L1 is perpendicular to L3, and L2 is perpendicular to L3; S7. Monitor the displacement of the longitudinal bridge in the X direction The intelligent computing terminal controls the bridge crane to move the beam segment to be erected along the X-axis direction until the beam segment to be erected and the erected beam segment are close to each other and spliced together.
4. The steel beam hoisting monitoring method of the steel beam hoisting monitoring system based on machine vision and tension sensor according to claim 3, It is characterized in that S3: monitoring the rotation angle around the Y axis, specifically: The intelligent computing terminal monitors in real time whether L3 and L4 are parallel. If they are not parallel, the intelligent computing terminal controls the bridge crane to move the beam section to be erected along the Y-axis direction until L4 is parallel to L3.
