A robotic system and method for acceptance testing of power transmission towers.
By combining a robotic arm, gripping tools, and a vision recognition system, the problems of cross-positioning, gripping, and bolt tightness detection of power tower climbing and acceptance robots in complex environments have been solved, enabling the robot to climb stably and perform precise inspections.
Patent Information
- Application Number
- CN202510034161.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2025-01-09
- Publication Date
- 2026-11-10
- Estimated Expiration
- 2045-01-09
AI Technical Summary
Existing power tower climbing and acceptance robots cannot simultaneously meet the requirements of cross-positioning of target points during climbing, multi-directional accessibility in three-dimensional space, clamping ability in complex environments of power tower bodies, accuracy requirements for bolt tightness detection, and visual positioning and detection capabilities.
The robot uses a combination of robotic arm, gripping tool, binocular depth camera, screwing tool and central controller to climb, grip, check bolt tightness and detect missing or missing parts on power transmission towers through vision recognition and motion control modules.
It enables cross-positioning and three-dimensional spatial accessibility in complex power tower environments. The clamping tool can adapt to the size of angle steel and the installation orientation. It has a large clamping force and is self-locking. It can precisely insert and remove bolts for tightness testing. It can also complete the detection of missing or bent tower materials through image recognition and network transmission.
Smart Images

Figure CN120095805B_ABST
Abstract
Description
Technical Field
[0001] This invention relates to the field of power infrastructure acceptance robot technology, specifically a robot for accepting power line climbing towers. Background Technology
[0002] In the field of power infrastructure construction, the acceptance phase of power transmission towers typically involves manual climbing, which is difficult, dangerous, and requires project management personnel who lack the necessary qualifications for high-altitude operations. This makes it difficult to monitor the tower's condition in real time, compromising the accuracy of the acceptance results. Therefore, developing a power tower climbing and acceptance robot is crucial for the acceptance process. The design of such a robot faces several challenges: First, the target points during climbing are constantly changing, requiring the robot to be capable of cross-positioning and multi-directional access in three-dimensional space. Furthermore, the tower structure has crossbeams and protruding bolts, creating a complex climbing environment. Second, the tower structure can only hold a limited number of objects, and the wide angle steel prevents comprehensive clamping. Fourth, the robot's bolt tightness detection function demands high precision in its end-effector manipulation and requires visual positioning and guidance capabilities. Fifth, the robot needs to detect missing or bent tower components through image recognition, requirements that current climbing robots cannot simultaneously meet. Summary of the Invention
[0003] The technical problem solved by this invention is to provide a robot system and method for climbing and inspecting power transmission towers, so as to solve the problems mentioned in the background art.
[0004] The technical problem solved by this invention is achieved by the following technical solution:
[0005] A robotic system for climbing and inspecting power transmission towers includes a robotic arm, gripping tool I, gripping tool II, binocular depth camera I, binocular depth camera II, screwing tool I, screwing tool II, and a central controller. Gripping tool I, gripping tool II, binocular depth camera I, and binocular depth camera II are respectively fixed to the symmetrical ends of the robotic arm. Screwing tool I and screwing tool II are respectively fixed to the bottom of gripping tool I and gripping tool II. The central controller is mounted on the joints (1-4) of the robotic arm and connects to control the robotic arm, gripping tool I, gripping tool II, binocular depth camera I, and binocular depth camera II. The software modules configured in the central controller include a motion control module for the robotic arm and gripping tools, a visual recognition and positioning module, and a visual image acquisition and network transmission module.
[0006] The aforementioned visual recognition and positioning module acquires point cloud data of the tower's angle steel using a binocular depth camera. Through point cloud filtering and plane fitting, it obtains the normal vector of the angle steel surface, which is determined as the Z-axis of the climbing point. Edge extraction is used to obtain the outer edge of the angle steel, which is defined as the Y-axis of the climbing point. The X-axis is perpendicular to both the Y and Z axes, determining the posture information of the climbing point. Based on 3D point cloud reconstruction, the width information of the angle steel is obtained, determining its clamping area. The intersection of the maximum traversable distance of the angle steel by the robotic arm, the outer edge of the angle steel, and the upper surface of the angle steel is defined as the position information of the climbing point. If the width of the angle steel is less than the clamping surface of the robotic arm's gripping tool, the position of the climbing point is compensated along the X-direction. If there are beams or bolts near the climbing point, the position is compensated along the Y-axis.
[0007] The visual positioning module identifies bolts through machine learning, and then obtains the position and orientation of the upper surface of the bolt by performing three-dimensional reconstruction on the bolt to be inspected.
[0008] The robotic arm is a tandem robotic arm with 7 joints. The robotic arm has a symmetrical structure, with three joints arranged on each side. The rotation axes of these three joints are orthogonal when extended, and the position and pose of the robotic arm's end effector are adjusted through these three intersecting joints. The three joints at both ends are connected by a rotary joint in the middle of the robotic arm, and they can move intersectingly around this rotation axis.
[0009] The robot obtains the pose information of the point to be climbed through the visual recognition module, and the motion control module controls the various drive components of the robotic arm. The robotic arm performs cross-positioning and pose changes, realizing the robot's automatic traversal forward or lateral climbing function.
[0010] The clamping tools I and II include a driving component, an upper clamping plate, a lower clamping plate, a nut screw transmission mechanism, and a rubber pad. The driving component is fixed to the upper clamping plate, which is connected to the end joint of the robotic arm. The lower clamping plate has a nut hole along the extension of the rotation axis of the driving component. The upper end of the nut screw transmission mechanism is connected to the driving component, and the lower end of the nut screw transmission mechanism engages with the nut hole of the lower clamping plate. A nut screw transmission mechanism is provided on each side of the nut screw transmission mechanism to assist in the movement and clamping of the upper and lower clamping plates.
[0011] The aforementioned screwing tool I and screwing tool II include a flange, a connector, and a nut sleeve. The flange is connected to the extension line of the joint rotation axis at the end of the robotic arm on the lower clamping plate. The upper end of the connecting rod inside the connector is connected to the flange using a fixing screw with an elastic rubber pad. A compression spring is wrapped around the outside of the connecting rod. The inside of the nut sleeve is set to a hexagonal shape and has a chamfered design on the edge.
[0012] The visual recognition module obtains the pose information of the bolt to be detected and transmits it to the motion control module in real time. The motion control module then completes the bolt tightness detection based on visual guidance through a position-based visual servo algorithm.
[0013] The image acquisition and network transmission module acquires images of the power tower materials to be inspected using a binocular depth camera, and transmits the acquired images to a ground server via the network transmission module. The ground server then uses image recognition to detect missing or damaged parts and bending of the power tower materials.
[0014] A method for operating a robot used for climbing and inspecting power transmission towers includes the following steps:
[0015] The climbing robot's gripping tools are attached to and clamp onto the metal angle steel of the power tower. When the robot needs to change its target point or pose, the motion control module controls the drive components on the corresponding gripping tools to open the upper and lower clamps. It also controls the drive components in the robotic arm to adjust the gripping tool's pose, causing it to move out of the angle steel. Simultaneously, the module adjusts the pose of the binocular depth camera, enabling it to acquire the 3D point cloud information of the angle steel at the climbing point. The visual positioning module then calculates the climbing point. The position and posture of the robotic arm are determined and sent to the motion control module. The motion control module controls the drive components of the robotic arm, which then performs corresponding actions and changes its posture. This causes the lower surface of the upper clamping plate of the corresponding clamping tool to come into contact with the angle steel of the power tower to be clamped, so that the lower surface of the upper clamping plate of the clamping tool is directly opposite to and tightly attached to the upper surface of the angle steel of the power tower. The motion control module controls the drive components on the clamping tool to bring the upper and lower clamping plates of the clamping tool together and tightly clamp the angle steel, thus completing the forward or lateral climbing motion.
[0016] If errors in the control of the robotic arm and visual measurement cause the lower surface of the upper clamping plate on the clamping tool to not be aligned with and close to the upper surface of the angle steel of the power tower, the motion controller will first control the robotic arm to move downward in a direction perpendicular to the upper surface of the angle steel of the power tower until the motion control module detects that the current of a certain driving component of the robotic arm exceeds the set current threshold, and then the movement will stop.
[0017] If the upper and lower clamping plates of the clamping tool are not completely flat with the angle steel plane during the process of closing, the mechanical arm itself will compensate for this error by its flexible deformation, so that the upper and lower clamping plates of the clamping tool fit against the surface of the angle steel and clamp the angle steel of the power tower.
[0018] A method for operating a robot used for climbing and inspecting power transmission towers includes the following steps:
[0019] The climbing robot's gripping tools are attached to and clamp the metal angle steel of the power tower. When the robot needs to perform bolt tightness testing, the motion control module controls the drive components on the corresponding gripping tools to open the upper and lower clamping plates. It also controls the drive components in the corresponding robotic arm to adjust the gripping tool's pose, causing it to move out of the angle steel. The module adjusts the pose of the binocular depth camera so that it can acquire color images and point cloud information of the bolt to be tested. The visual recognition and positioning module identifies the bolt and obtains the pose of the center point of the bolt's upper surface, sending this pose information to the motion control module. The control module and motion control module control the various drive components of the robotic arm to execute corresponding actions. Based on the posture information of the bolt surface to be tested obtained in real time by the vision recognition and positioning module, the position of the tightening tool is continuously adjusted so that the tightening tool reaches above the bolt and the sleeve at the end of the tightening tool is facing the upper surface of the bolt. The motion control module controls the robotic arm to move slowly along a direction perpendicular to the upper surface of the bolt so that the nut sleeve of the tightening tool covers the bolt. The control module controls the drive component of the end joint of the robotic arm connected to the tightening tool to collect the current information of the drive component, determine the tightness of the tower bolt, and complete the tightness test of the tower bolt.
[0020] A method for operating a robot used for climbing and inspecting power transmission towers includes the following steps:
[0021] The climbing robot's gripping tools are attached to and clamped onto the metal angle steel of the power tower. When the robot needs to detect defects or missing parts in the tower material, the motion control module controls the drive components on the corresponding gripping tools to open the upper and lower clamping plates. It also controls the drive components in the corresponding robotic arm to adjust the posture of the gripping tools, causing them to move out of the angle steel. Then, the robot controls the drive components of the robotic arm to perform corresponding actions and change posture, moving the binocular depth camera to the tower material to be inspected. The depth camera uses the image acquisition module to acquire images of the tower material at the inspection point from all directions and multiple angles. The acquired images are then transmitted to the ground server via the network transmission module. The image recognition module on the ground server detects missing parts, missing components, and bending of the tower material.
[0022] Compared with the prior art, the beneficial effects of the present invention are as follows: The present invention can solve the problem of climbing robots in complex power tower climbing environments, enabling cross-positioning and multi-directional access in three-dimensional space. When only angle steel can be clamped on the power tower, the clamping tool is not limited by the size and installation orientation of the angle steel, and can easily clamp with a large clamping force. It can also self-lock when power is off. The recognition and positioning module of the climbing robot can identify the position of the positioning bolts and guide the robotic arm to perform precise insertion and removal operations in real time to complete the bolt tightness detection of the power tower. The image acquisition and network transmission module can ensure that the climbing robot can acquire the corresponding tower material images according to the image recognition requirements and transmit them to the ground server, which then completes the detection of missing tower materials and tower material bending. Attached Figure Description
[0023] Figure 1 This is a schematic diagram of the structure of the present invention.
[0024] Figure 2 This is a schematic diagram of the robotic arm structure of the present invention.
[0025] Figure 3 This is a schematic diagram of the clamping tool structure of the present invention.
[0026] Figure 4 This is a schematic diagram of the screwing tool structure of the present invention.
[0027] Figure 5 This is a flowchart illustrating the climbing process of the climbing robot of the present invention.
[0028] Figure 6 This is a flowchart of the lateral climbing process of the climbing robot of the present invention.
[0029] Figure 7 This is a flowchart of the gripping process of the climbing robot of the present invention.
[0030] Figure 8 This is a flowchart of the climbing robot's tightness testing process according to the present invention. Detailed Implementation
[0031] To make the technical means, creative features, objectives and effects of the present invention easier to understand, the present invention will be further described below with reference to specific illustrations. In the description of the present invention, it should be noted that, unless otherwise explicitly specified and limited, the terms "installation", "connection" and "connection" should be interpreted broadly. For example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection or an indirect connection through an intermediate medium; it can be a connection between the internal parts of two components.
[0032] like Figures 1-4As shown, a robot system for climbing and inspecting power transmission towers includes: a robotic arm 1, a gripping tool I2, a gripping tool II3, a binocular depth camera I6, a binocular depth camera II7, a screwing tool I4, a screwing tool II5, and a central controller 8. The gripping tool I2, gripping tool II3, and binocular depth camera I6 are fixed to the two ends of the robotic arm 1. The screwing tool I4 is fixed to the bottom of the gripping tool I2, and the screwing tool II5 is fixed to the bottom of the gripping tool II3. The central controller 8 is mounted on the robotic arm 1 and connects to control the robotic arm 1, gripping tool I2, gripping tool II3, binocular depth camera I6, and binocular depth camera II7. The software modules configured in the central controller include a motion control module for the robotic arm and gripping tools, a visual recognition and positioning module, and an image acquisition and network transmission module.
[0033] The binocular depth cameras I6 and II7 acquire point cloud data of the tower angle steel. The visual recognition and positioning module obtains the normal vector of the angle steel surface through point cloud filtering and plane fitting, which is determined as the Z-axis of the climbing point. Edge extraction is used to obtain the outer edge of the angle steel, and this outer edge line is defined as the Y-axis of the climbing point. The X-axis is perpendicular to both the Y and Z axes. Based on the 3D point cloud reconstruction, the width information of the angle steel is obtained, and the clamping area of the angle steel is determined. The intersection of the maximum traversable distance of the angle steel, the outer edge of the angle steel, and the upper surface of the angle steel is defined as the location point of the climbing point. If there are beams or bolt protrusions within a circle centered on the maximum traversable distance and with the length of the clamping tool as its diameter, distance compensation is performed in the negative Y-direction of the climbing point. If the width of the angle steel is less than the clamping surface of the clamping tool, distance compensation is performed in the negative X-direction of the climbing point.
[0034] The binocular depth camera I6 and binocular depth camera II7 acquire color images and three-dimensional point cloud information of the bolt. The visual recognition and positioning module is based on machine learning. It identifies the bolt by the color image of the bolt to be detected, and then performs three-dimensional reconstruction of the bolt by the three-dimensional point cloud information to obtain the pose information of the upper surface of the bolt to be detected.
[0035] The robotic arm 1 is a serial robotic arm with 7 joints: joint 11, joint 12, joint 13, joint 14, joint 15, joint 16, and joint 17. The rotation axes of joint 11 and joint 12 intersect at one point. The parallel line of the rotation axis of joint 13 intersects joint 11 and joint 12. The rotation axes of joint 16 and joint 17 intersect at one point. The parallel line of the rotation axis of joint 15 intersects joint 16 and joint 17. Joint 13 and joint 15 are connected to joint 14 via a connecting rod.
[0036] The robotic arm 1 has a symmetrical structure. The gripping tool 2 or 3 at either end of the robotic arm 1 is fixed to the angle steel of the power tower. The vision recognition and positioning module obtains the three-dimensional information of the point to be climbed. The motion control module controls the operation of each drive component of the 7 joints in the robotic arm to change the position of the other end of the robotic arm and perform the climbing task.
[0037] The clamping tools I2 and II3 include a drive component 21, an upper clamping plate 22, a lower clamping plate 23, a nut screw transmission mechanism 24, rubber pads 25 and 26. The drive component is fixed to the upper clamping plate, which is connected to joint 11 or joint 17. The lower clamping plate has a nut hole along the extension of the rotation axis of the drive component. The upper end of the nut screw transmission mechanism is connected to the drive component, and the lower end of the nut screw transmission mechanism meshes with the nut hole of the lower clamping plate. A nut screw transmission mechanism is provided on both sides of the nut screw transmission mechanism to assist in the movement and clamping of the upper and lower clamping plates. The clamping tools I2 and II3 change the distance between the upper and lower clamping plates 22 and 23 through a motion control module, thereby changing the clamping force of the clamping tools. Combined with the pose changes of the robotic arm 1, this assists in realizing the climbing task of the climbing robot.
[0038] The screwing tool I4 and screwing tool II5 include a flange 31, a connector 32, and a nut sleeve 33. The flange is connected to the extension line of the joint rotation axis at the end of the robotic arm on the lower clamping plate. The upper end of the connecting rod inside the connector is connected to the flange with a fixing screw with an elastic rubber pad. A compression spring is wrapped around the outside of the connecting rod. The inside of the nut sleeve is set to a hexagonal shape and has a chamfered design on the edge.
[0039] The motion control module controls each joint of the robotic arm 1 in real time through the bolt pose information obtained by the visual recognition and positioning module, and adjusts the end pose of the robotic arm 1 so that the tightening tool can be smoothly put on the outside of the bolt with minimal error, thus completing the function of detecting the tightness of the tower bolt.
[0040] The binocular depth camera I6 and binocular depth camera II7 acquire image data of the power tower materials through the image acquisition module, and transmit the image data to the ground server through the network transmission module. The ground server then uses image learning to detect missing or damaged tower materials and tower bending.
[0041] The working principle of this invention is as follows:
[0042] like Figures 5-7 As shown, when a robot used for tower climbing and acceptance is performing climbing work, the process and steps when the climbing robot is climbing forward by crossing are as follows: 1) The motion control module controls the drive component 21 of the clamping tool 2, so that the lower clamping plate 23 of the clamping tool moves away from the lower surface of the angle steel of the power tower, such as... Figure 6As shown in (A), the motion control module controls the various drive components in the robotic arm 1 to move the clamping tool 2 out of the angle iron, as... Figure 6 As shown in (B), the pose of the binocular depth camera 7 is adjusted so that it can acquire the 3D point cloud information of the angle steel at the climbing point. The pose of the climbing point is calculated by the visual positioning module and transmitted to the motion control module. The motion control module controls the drive components of the robotic arm 1, and the robotic arm performs corresponding cross-positioning and flipping actions, moving the gripping tool 2 to the vicinity of the gripping point. Figure 6 As shown in (C), the motion control module controls the robotic arm to perform a translational movement, so that the rubber pad 25 inside the upper clamping plate 22 of the clamping tool 2 is aligned with and pressed against the upper surface of the angle steel of the power tower, and performs a clamping operation to complete the crossing and climbing movement. Figure 6 In section (D), when the climbing robot performs lateral climbing, the process and steps are as follows: 1) The motion control module controls the drive component 21 of the clamping tool 2, so that the lower clamping plate 23 of the clamping tool moves away from the lower surface of the angle steel of the power tower, such as... Figure 7 As shown in (A), the motion control module controls the various drive components in the robotic arm 1 to move the clamping tool 2 out of the angle iron, as... Figure 7 As shown in (B), the pose of the binocular depth camera 7 is adjusted so that it can acquire the 3D point cloud information of the angle steel at the climbing point. The pose of the climbing point is calculated by the visual positioning module and transmitted to the motion control module. The motion control module controls the drive components of the robotic arm 1, and the robotic arm performs a lateral movement of the crossbeam angle steel, moving the clamping tool 2 to the vicinity of the clamping point. Figure 7 As shown in (C), the motion control module controls the robotic arm to perform a translational movement, so that the rubber pad 25 inside the upper clamping plate 22 of the clamping tool 2 is aligned with and pressed against the upper surface of the angle steel of the power tower, and performs a clamping operation to complete the lateral climbing movement. Figure 7 In section (D), the process and steps during clamping of the clamping tool are as follows: 1) The motion control module controls each driving component of the robotic arm 1, causing the end of joint 11 of the robotic arm 1 to move downwards along a direction perpendicular to the surface of the angle steel of the power tower, until the controller 8 detects that the current of the driving component of a certain joint of the robotic arm 1 exceeds the set current threshold, then the movement stops. Figure 8 As shown in Figures (A) and (B), the motion control module controls the drive component 21 on the robotic arm clamping tool 2, causing the upper clamping plate 22 and the lower clamping plate 23 of the clamping tool 2 to come together and tightly clamp the angle steel, as shown in Figures (A) and (B). Figure 8As shown in (C), during the process of the upper and lower clamping plates of the clamping tool 2 approaching each other, due to errors introduced by the robotic arm motion control and vision positioning module, the upper and lower clamping plates 22 and the lower clamping plate 23 of the robotic arm clamping tool 2 cannot be completely parallel to the angle steel. Therefore, during the process of the lower clamping plate approaching and clamping the angle steel, the robotic arm compensates for this error through its own flexible deformation, ensuring that the upper and lower clamping plates of the clamping tool are completely in contact with and clamp the angle steel. Figure 8 As shown in (D), the auxiliary robotic arm 1 completes the forward climbing and lateral climbing movements.
[0043] like Figure 8 As shown, when a robot used for climbing and inspecting power transmission towers performs bolt fastening inspection, the process and steps are as follows: 1) The motion control module controls the drive component 21 of the clamping tool 2, causing the lower clamping plate 23 of the clamping tool to move away from the lower surface of the angle steel of the power transmission tower. The motion control module controls the drive components in the robotic arm 1 to move the clamping tool 2 out of the angle steel and adjust the pose of the binocular depth camera 7 so that the binocular depth camera 7 can acquire the color image and point cloud information of the bolt to be inspected. The visual recognition and positioning module identifies the bolt to be inspected and obtains the pose of the center point of the upper surface of the bolt to be inspected, and transmits the obtained pose information to the motion control module. The control module controls the various drive components of the robotic arm to perform corresponding actions. Based on the posture information of the bolt surface to be tested obtained in real time by the vision recognition and positioning module, the position of the tightening tool 4 is continuously adjusted so that the tightening tool 4 reaches above the bolt to be tested, and the sleeve 33 at the end of the tightening tool 4 is facing the upper surface of the bolt. The motion control module controls the end of the joint 11 of the robotic arm 1 to move slowly along a direction perpendicular to the upper surface of the bolt, so that the nut sleeve 33 of the tightening tool 4 covers the bolt. The motion control module controls the drive components of the joint 17 of the robotic arm 1, and the controller 8 collects the current of the drive components of the joint 11 to determine the tightness of the tower bolt and complete the tightness test of the tower bolt.
[0044] When a robot used for climbing and inspecting power transmission towers detects missing or damaged tower components and bending conditions, the motion control module first controls the drive component 21 of the clamping tool 2 to move the lower clamping plate 23 of the clamping tool away from the lower surface of the angle steel of the power transmission tower. The module then controls the drive components in the robotic arm 1 to move the clamping tool 2 out of the angle steel. Next, the motion control module controls the drive components of the robotic arm 1 to change its position, moving the binocular depth camera 7 to the tower component to be inspected. The binocular depth camera 7 uses an image acquisition module to capture images of the tower component at the inspection point from multiple angles and transmits the images to a ground server via a network transmission module. The image recognition module on the ground server then detects missing or damaged tower components and bending conditions.
[0045] The 7-DOF robotic arm of this invention features a symmetrical structure with redundant degrees of freedom, enabling easy cross-directional changes. The gripping mechanism incorporates a single-drive linkage, controlling the drive components to alter the position of the upper and lower gripping plates and thus the gripping force. This overcomes the challenges of climbing, obstacle crossing, and turning in complex tower environments, enabling the robot to climb along the main structure and beams of power transmission towers. The screwing tool features a chamfered design, allowing for precise bolt manipulation under visual guidance, facilitating bolt tightness checks on the tower. The binocular depth camera not only identifies and positions bolts but also inspects tower materials, detecting missing or bent components.
[0046] This invention utilizes the limited space of the power transmission tower to obtain an effective clamping surface for the tower's angle steel, ensuring that the clamping tool can stably clamp onto the angle steel. When the target point changes or the power transmission tower has protruding beams or bolts, as long as one end of the clamping tool at each end of the 7-DOF robotic arm is clamped onto the angle steel, the overall clamping stability of the robot can be guaranteed. Furthermore, the 7-DOF robotic arm can move flexibly, changing the position and posture of the climbing robot, ensuring its flexible climbing and obstacle-crossing capabilities. Simultaneously, the climbing robot is equipped with a binocular depth camera and a screwing tool, enabling it to detect the tightness of tower bolts, missing or damaged tower components, and tower bending.
[0047] The foregoing has shown and described the basic principles, main features, and advantages of the present invention. Those skilled in the art should understand that the present invention is not limited to the above embodiments. The embodiments and descriptions in the specification are merely illustrative of the principles of the invention. Various changes and modifications can be made to the invention without departing from its spirit and scope, and all such changes and modifications fall within the scope of the present invention as claimed. The scope of protection of the present invention is defined by the appended claims and their equivalents.
Claims
1. A robot system for climbing and inspecting power transmission towers, comprising a 313 configuration serial robotic arm with 7 joints, a gripping tool, a turning tool, a binocular depth camera, and a central controller. The gripping tool and the binocular depth camera are fixed at the end of the robotic arm. A turning tool is provided at the bottom of the gripping tool. The central controller is installed on the extension line of the rotating shaft of the robotic arm joint (1-4). The software modules configured inside the central controller include a motion control module for the robotic arm and the gripping tool, a visual recognition and positioning module, and a visual image acquisition and network transmission module. The robotic arm has a symmetrical structure. The rotation axes of the three joints at the end of the robotic arm are orthogonal, and the posture of the end of the robotic arm can be adjusted through the three cross joints. The clamping tool is a plate-type clamping structure, comprising upper and lower clamping plates. The upper clamping plate of the clamping tool is connected to the end joint pivot of the robotic arm. The screwing tool is a nut sleeve type, which includes a flange, a connector, and a nut sleeve. The flange is connected to the extension line of the joint rotation axis at the end of the robot arm on the lower clamping plate. The gripping tool at either end of the robotic arm is fixed to the angle steel of the power tower; The motion control module controls the robotic arm to move slowly along a direction perpendicular to the upper surface of the bolt, so that the nut sleeve of the tightening tool covers the bolt. It controls the drive component of the end joint of the robotic arm connected to the tightening tool, collects the current information of the drive component, judges the tightness of the tower bolt, and completes the tightness test of the tower bolt.
2. The robot system for climbing and inspecting power transmission towers as described in claim 1, characterized in that: The visual recognition and positioning module uses a binocular depth camera to acquire point cloud information of the angle steel and bolts of the power tower, and calculates the pose information of the climbing point on the angle steel and the bolts.
3. The robot system for climbing and inspecting power transmission towers as described in claim 1, characterized in that: The visual recognition and positioning module acquires point cloud data of the tower angle steel using a binocular depth camera. It obtains the normal vector of the angle steel surface through point cloud filtering and plane fitting, which is then determined as the Z-axis of the climbing point. Edge extraction is used to obtain the outer edge of the angle steel, and the edge line is defined as the Y-axis of the climbing point. The X-axis is perpendicular to both the Y and Z axes. Based on the 3D point cloud reconstruction, the width information of the angle steel is obtained, and its clamping area is determined. The intersection of the maximum traversable distance of the angle steel by the robotic arm, the outer edge of the angle steel, and the upper surface of the angle steel is defined as the position of the climbing point. If the width of the angle steel is less than the clamping surface of the clamping tool, the position of the climbing point is compensated along the X-axis direction. If there are beams or bolts near the climbing point, the position is compensated along the Y-axis direction.
4. The robot system for climbing and inspecting power transmission towers as described in claim 2, characterized in that: The visual recognition and positioning module first identifies bolts through machine learning, and then obtains the position and orientation of the upper surface of the bolt to be detected through three-dimensional reconstruction of the bolt.
5. The robot system for climbing and inspecting power transmission towers as described in claim 1, characterized in that: With the visual recognition and positioning module positioning the surface of the angle steel to be clamped, the motion control module controls the distance between the upper and lower clamping surfaces of the clamping tool, changes the clamping force of the clamping tool on the tower angle steel, and, in conjunction with the cross-positioning of the serial robotic arms, changes the posture to achieve automatic climbing of the robot.
6. The robot system for climbing and inspecting power transmission towers as described in claim 5, characterized in that: The aforementioned serial robotic arm is a robotic arm with 7 joints, and the robotic arm can move crosswise around the joints (1-4).
7. The robot system for climbing and inspecting power transmission towers as described in claim 1, characterized in that: Rubber pads are provided on the clamping plate to enhance the friction between the clamping tool and the angle steel; the drive component is fixedly connected to the upper clamping plate; the lower clamping plate has a nut hole in the direction of the extension of the rotation axis of the drive component, the upper end of the nut screw transmission mechanism is connected to the drive component, and the lower end of the nut screw transmission mechanism meshes with the nut hole of the lower clamping plate. The motion controller controls the drive component, and by changing the distance between the upper and lower clamping plates, the clamping force of the clamping tool is changed, thereby realizing the clamping function of the clamping tool on the angle steel.
8. The robot system for climbing and inspecting power transmission towers as described in claim 1, characterized in that: The upper end of the connecting rod inside the connector is connected to the flange using a fixing screw with an elastic rubber pad. A compression spring is wrapped around the outside of the connecting rod. The inside of the nut sleeve is hexagonal and has a chamfered edge design, which allows the tightening tool to be smoothly fitted onto the outside of the bolt with a small positioning error, thus completing the function of checking the tightness of the tower bolts.
9. The robot system for climbing and inspecting power transmission towers as described in claim 1, characterized in that: The binocular depth camera acquires image data of the power tower materials through the image acquisition module, and transmits the image data to the ground server through the network transmission module. The ground server then uses image learning to detect missing or damaged tower materials and tower bending.
10. The working method of the robot system for climbing and inspecting power transmission towers as described in any one of claims 1, 3, and 5, characterized in that: Includes the following steps: The climbing robot's gripping tools are attached to and clamp onto the metal angle steel of the power tower. When the robot needs to change its target point or pose, the motion control module controls the drive components on the corresponding gripping tools to open the upper and lower clamps. It also controls the drive components in the robotic arm to adjust the gripping tool's pose, causing it to move out of the angle steel. Simultaneously, the module adjusts the pose of the binocular depth camera, enabling it to acquire the 3D point cloud information of the angle steel at the climbing point. The visual positioning module then calculates the climbing point. The position and posture of the robotic arm are determined and sent to the motion control module. The motion control module controls the drive components of the robotic arm, which performs corresponding actions and changes its posture. This causes the lower surface of the upper clamping plate of the corresponding clamping tool to come into contact with the angle steel of the power tower to be clamped, so that the lower surface of the upper clamping plate of the clamping tool is directly opposite to and tightly attached to the upper surface of the angle steel of the power tower. The motion control module controls the drive components on the clamping tool, so that the upper and lower clamping plates of the clamping tool come together and tightly clamp the angle steel, thus completing the forward or lateral climbing motion. If errors in the control of the robotic arm and visual measurement cause the lower surface of the upper clamping plate on the clamping tool to not be aligned with and close to the upper surface of the angle steel of the power tower, the motion controller will first control the robotic arm to move downward in a direction perpendicular to the upper surface of the angle steel of the power tower until the motion control module detects that the current of a certain driving component of the robotic arm exceeds the set current threshold, and then the movement will stop. If the upper and lower clamping plates of the clamping tool are not completely parallel to the plane of the angle steel during the process of closing, the mechanical arm's own flexible deformation will compensate for this error, so that the upper and lower clamping plates of the clamping tool fit against the surface of the angle steel and clamp the angle steel of the power tower.
11. The working method of the robot system for power tower climbing and acceptance as described in any one of claims 1, 4, and 8, characterized in that: Includes the following steps: The climbing robot's gripping tools are attached to and clamp the metal angle steel of the power tower. When the robot needs to perform bolt tightness testing, the motion control module controls the drive components on the corresponding gripping tools to open the upper and lower clamping plates of the gripping tools. It also controls the drive components in the corresponding robotic arm to adjust the posture of the gripping tools, causing them to move out of the angle steel. The module also adjusts the posture of the binocular depth camera so that it can acquire color images and point cloud information of the bolt to be tested. The vision recognition and positioning module identifies the bolt to be tested and obtains the posture of the center point of the upper surface of the bolt. It then sends the obtained posture information to the motion control module. The motion control module controls the drive components of the robotic arm to perform corresponding actions. Based on the posture information of the bolt surface to be tested obtained in real time by the vision recognition and positioning module, the module continuously adjusts the posture of the tightening tool so that the tightening tool reaches above the bolt to be tested, and the sleeve at the end of the tightening tool is directly facing the upper surface of the bolt.
12. The working method of the robot system for power tower climbing and acceptance as described in claim 9, characterized in that, Includes the following steps: The climbing robot's gripping tools are attached to and clamped onto the metal angle steel of the power tower. When the robot needs to detect defects or missing parts in the tower material, the motion control module controls the drive components on the corresponding gripping tools to open the upper and lower clamping plates. It also controls the drive components in the corresponding robotic arm to adjust the position of the gripping tools, causing them to move out of the angle steel. Then, the robot controls the drive components of the robotic arm to perform corresponding actions and change its position, moving the binocular depth camera to the tower material to be inspected. The binocular depth camera uses the image acquisition module to capture images of the tower material at the inspection point from all angles and transmits the captured images to the ground server via the network transmission module. The image recognition module on the ground server then detects missing parts, bent sections, and other defects in the tower material.
Citation Information
Patent Citations
Bionic manipulator able to climb and operate
CN106926224A
Foot clamping mechanism for power iron tower climbing robot
CN109367637A
