Steel bridge deck slab crack image acquisition tracked robot and control method

By designing a tracked robot for acquiring images of steel bridge deck cracks, and using a combination of magnetic tracks and multiple sensors, the robot achieves comprehensive, blind-spot-free acquisition and precise measurement of fatigue cracks in steel bridge decks, solving the problems of low detection efficiency and insufficient accuracy in existing technologies.

CN118907250AActive Publication Date: 2024-11-08SHANGHAI JIAOTONG UNIV +1

Patent Information

Application Number
CN202410969674.6
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-07-19
Publication Date
2024-11-08
Estimated Expiration
2044-07-19

AI Technical Summary

Technical Problem

Existing technologies for detecting fatigue cracks in steel bridge decks are inefficient, costly, and unable to achieve comprehensive, blind-spot-free image acquisition, resulting in inaccurate detection results and affecting the effectiveness of maintenance strategies.

Method used

Design a tracked robot for acquiring images of cracks in steel bridge decks. The robot uses a magnetic track structure and combines a power and transmission device, a crack image acquisition device, a brushless motor gimbal device, and an environmental sensing device to achieve omnidirectional movement of the robot on the steel bridge deck and accurate measurement of cracks.

Benefits of technology

It enables comprehensive, seamless acquisition of fatigue cracks in steel bridge decks and precise measurement of crack dimensions, meeting the requirements for fatigue crack detection of in-service orthotropic steel bridge decks in practical engineering projects.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118907250A_ABST
    Figure CN118907250A_ABST
Patent Text Reader

Abstract

The invention provides a steel bridge deck crack image acquisition tracked robot and a control method. A mechanical main body is of a cavity structure with a magnetic track; the power and transmission device drives the robot to move forwards or backwards or climb over. The crack image acquisition device acquires crack image information and distance information; the brushless motor holder device adjusts the angle of the crack image acquisition device, and obtains a homography transformation matrix between a camera imaging plane and a physical plane where the fatigue crack is located based on crack image information and distance information; the environment sensing device collects environment information in the moving process of the robot. And the main circuit board realizes overall cooperative control and movement of the robot. According to the invention, magnetic adsorption force is uniformly distributed on each section of crawler belt, so that the robot can climb over any plane, omnibearing and dead-corner-free acquisition of fatigue cracks and accurate measurement of crack sizes are completed, and real-time wireless transmission to a remote terminal is realized through the brushless motor holder device.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of steel structure fatigue crack detection devices, and in particular to a steel bridge deck crack image acquisition crawler robot and a control method. Background Art

[0002] my country is a country of bridges and steel. Steel is widely used in bridge construction because of its excellent material properties such as light weight, high strength and good machinability. In the process of modern bridge construction, steel structure bridges are increasingly recognized. According to statistics, in order to alleviate the transportation pressure of the original bridges and to vigorously develop economic construction, the construction speed of steel structure bridges over one thousand meters across large rivers such as the Yangtze River and the Yellow River is six per year, and the average steel consumption per bridge is 10,000 tons. In recent years, my country has built a large number of steel structure bridges, covering a wide range, including railway bridges, highway bridges, highway-railway dual-use bridges and pedestrian bridges.

[0003] Among them, the orthotropic steel bridge deck, which is welded by the longitudinal ribs, cross beams and cover plates, has become the preferred structure for the bridge deck of large and medium span steel structures due to its advantages such as light weight, high overall efficiency, strong spanning capacity and good seismic performance. Today, there are thousands of bridges with orthotropic steel bridge decks in the world. However, since the orthotropic steel bridge deck directly bears the local effects of vehicles, the stress diffusion effect is small, and the passing of vehicles will cause several stress cycles. In addition, the stress concentration of the welding nodes and the inevitable welding defects make the steel bridge deck prone to fatigue cracking, which has a serious impact on the safety and functional reliability of the bridge. In recent decades, fatigue cracks of varying degrees have been found in a large number of steel bridge deck projects at home and abroad. It is necessary to quantitatively evaluate the impact of these cracks and formulate maintenance and repair strategies on this basis to ensure the safe and normal operation of the bridge. Fatigue crack detection and monitoring of steel bridge decks is the most important basic work. Whether the actual crack measurement data is comprehensive and accurate is directly related to the correctness of the evaluation results and the effectiveness of maintenance and repair countermeasures.

[0004] At present, fatigue crack detection of steel bridge decks is mainly carried out manually. The inspectors hold the detection equipment and measure and record the position and length of fatigue cracks at close range. Due to the large workload and discontinuous detection time and space, there are disadvantages such as low detection efficiency, high cost and easy omission of small cracks. The Chinese patent with announcement number CN115772850A proposes an automatic detection robot for cracks on the surface of railway bridges, but the single inspection range of the automatic crack detection robot is small and needs to be manually installed in the crack area, which cannot achieve large-scale detection of fatigue cracks. The Chinese patent with announcement number CN115639209A proposes an intelligent detection system for fatigue cracks of steel box girders, but the detection system must run on a flexible track laid in advance, and there is a problem that the robot cannot walk freely in all directions. The Chinese patent with announcement number CN109613010A proposes an orthotropic steel bridge deck fatigue crack detection system, but the detection system cannot achieve all-round and blind-angle image acquisition. Summary of the invention

[0005] In view of the defects in the prior art, the object of the present invention is to provide a steel bridge deck crack image acquisition crawler robot and a control method thereof.

[0006] According to one aspect of the present invention, there is provided a crawler robot for collecting crack images of steel bridge decks, comprising:

[0007] A mechanical body, wherein the mechanical body is a cavity structure with a magnetic track;

[0008] A power and transmission device, which is connected to the mechanical body and drives the robot to move forward, backward or over;

[0009] A crack image acquisition device, which is disposed outside the mechanical body and collects crack image information and distance information;

[0010] A brushless motor pan-tilt device, which is installed inside the mechanical body, adjusts the angle of the crack image acquisition device, and obtains a homography transformation matrix between a camera imaging plane and a physical plane where fatigue cracks are located based on the crack image information and distance information, so as to extract geometric features of the cracks;

[0011] An environment sensing device, which is arranged outside the mechanical body and collects environmental information during the movement of the robot;

[0012] A main circuit board is arranged inside the mechanical body and communicates with the crack image acquisition device, the brushless motor pan-tilt device and the environmental sensing device to achieve coordinated control and movement of the entire robot.

[0013] Preferably, the mechanical body comprises:

[0014] A bent sheet metal part, wherein two of the bent sheet metal parts are spliced ​​together to form a cavity; the brushless motor pan-tilt device is installed inside the cavity;

[0015] An aluminum profile connected to the bottom of the sheet metal component;

[0016] Side panels, both of which are in the shape of regular triangles and are respectively connected to two sides of the bent sheet metal part;

[0017] A crawler track, the crawler track surrounds the outer periphery of the side plate and has a triangular structure as a whole;

[0018] Permanent magnets are evenly distributed on the crawler, so that the crawler can be adsorbed on the U ribs, beams and top plates, and can be driven by power and transmission devices to achieve straight-line walking, U-turns or steering.

[0019] Preferably, the number of the power and transmission devices is two, which are respectively installed on both sides of the mechanical body; each of the power and transmission devices includes:

[0020] A driving wheel, the driving wheel is arranged at a corner of the side plate and meshes with the crawler track;

[0021] A brushed DC motor, which is arranged inside the side plate, is correspondingly connected to the driving wheel and provides a rotational torque therefor;

[0022] A driven wheel is arranged at the remaining two corners of each of the side plates and is engaged with the crawler track.

[0023] Preferably, there are two crack image acquisition devices, which are respectively installed on two sides of the mechanical body, and each of the crack image acquisition devices includes:

[0024] A base, the base being connected to the brushless motor pan-tilt device;

[0025] A crack image acquisition camera, which is installed on the base and acquires crack image information;

[0026] Laser ranging modules, multiple of which are installed on the base to collect distance information;

[0027] Fill-in light, at least one of which is installed on the base to provide a light source for shooting.

[0028] Preferably, the step of obtaining a homography transformation matrix between a camera imaging plane and a physical plane where the fatigue crack is located based on the crack image information and the distance information, and extracting geometric features of the crack includes:

[0029] The crack image acquisition camera takes a crack picture to obtain crack image information;

[0030] The plurality of laser distance measurement modules work in sequence to measure crack distance information;

[0031] Calculating a homography transformation matrix based on the image information and the distance information;

[0032] The world coordinates of the crack contour are calculated using the homography transformation matrix to calculate the length and width of the crack.

[0033] Preferably, the brushless motor pan-tilt device comprises:

[0034] A pan / tilt base plate, the pan / tilt base plate is fixed inside the mechanical body;

[0035] A pan-tilt circuit board, which is a control panel of the entire brushless motor pan-tilt device and is fixed to the pan-tilt bottom plate. The pan-tilt circuit board includes a communication microcontroller, a flexible circuit board connector, and a plug-in connector. The flexible circuit board connector and the plug-in connector enable the communication microcontroller to have serial communication capability, and to communicate and coordinate with the main circuit board and the crack image acquisition device.

[0036] A brushless motor, the brushless motor is fixed to the pan-tilt circuit board and provides power for adjusting the angle of the crack image acquisition device;

[0037] A crack image acquisition device fixing part, wherein the crack image acquisition device fixing part is connected to the brushless motor and is used for installing the crack image acquisition device.

[0038] Preferably, the main circuit board comprises:

[0039] A power connector, which is used to install a lithium battery to establish power supply;

[0040] A main control single chip microcomputer, the main control single chip is the main control chip of the main circuit board;

[0041] A display screen, which is used to display robot status information and function debugging;

[0042] An undervoltage protection chip, which is used to monitor the voltage of the lithium battery in real time;

[0043] A motor drive buck chip, which is used to step down the battery voltage to drive a brushed DC motor and a brushless motor circuit;

[0044] A digital circuit step-down chip, wherein the digital circuit step-down chip is used to step down the battery voltage to drive the digital circuit;

[0045] The brushed DC motor driving chip is used to receive information from the main control chip and adjust the current to meet the brushed DC motor's demand for driving current.

[0046] Preferably, the environment sensing device comprises:

[0047] A linear tracking camera, which captures the image of the forward direction in real time and transmits it to the main control microcontroller for image processing; the image processing includes calculating the offset angle of the forward path and then obtaining the power percentage output by the brushed DC motor to accurately control the forward path of the robot;

[0048] Laser ranging modules, multiple laser ranging modules are installed in front and on both sides of the mechanical body, and are used to sense the surrounding environment of the robot; the laser ranging module located in the front continuously measures whether there are obstacles in front, and stops the robot from moving forward when there are obstacles; the laser ranging modules located on both sides will continuously measure the distance between the robot and the U-ribs on both sides to determine whether the robot is running correctly on the predetermined route. If the robot deviates from the predetermined route, the main control microcontroller will perform route correction work based on the data measured by the laser ranging module.

[0049] According to a second aspect of the present invention, there is provided a control method for a crawler robot based on steel bridge deck crack image acquisition, comprising:

[0050] Attach the robot to the beam, U-rib or top plate;

[0051] Control the power and transmission device to drive the robot to move to the crack area;

[0052] Controlling the brushless motor pan-tilt device to rotate, adjusting the elevation angle of the crack image acquisition device, so that the crack image acquisition device faces the crack;

[0053] Controlling the crack image acquisition device to acquire crack images and distance information;

[0054] The communication microcontroller installed in the brushless motor pan-tilt device calculates the homography transformation matrix between the imaging plane of the crack image acquisition camera and the plane where the fatigue crack is located, and extracts the geometric characteristics of the crack.

[0055] Preferably, when the robot is running, the linear tracking camera collects the forward direction image in real time and transmits it to the main control microcontroller;

[0056] The laser ranging module will measure the distance between the robot and the U-ribs on both sides in real time and transmit it to the main control chip;

[0057] The main control microcontroller receives the images captured by the linear tracking camera and the distance value measured by the laser ranging module, completes the path planning, determines the direction of travel, and finally outputs the signal to drive the two brushed DC motors.

[0058] Compared with the prior art, the embodiments of the present invention have at least one of the following beneficial effects:

[0059] The steel bridge deck crack image acquisition crawler robot in the embodiment of the present invention does not require a specially designed driving structure. Its magnetic adsorption force is evenly distributed on each track section. The magnetic force can be effectively redistributed to the target wall surface simply by rotating the tracks, thereby achieving smooth movement on the steel bridge deck, allowing the robot to climb over any planes, complete all-round, no-dead-angle acquisition of fatigue cracks and accurate measurement of crack sizes, and transmit the information wirelessly to a remote terminal in real time through a brushless motor pan-tilt device.

[0060] The steel bridge deck crack image acquisition crawler robot in the embodiment of the present invention controls the rotation of a brushed DC motor, uses a permanent magnetic adsorption crawler to walk on the steel bridge deck top plate, cross beam and U-rib, and realizes mutual climbing between the steel bridge deck structural bodies.

[0061] The steel bridge deck crack image acquisition crawler robot in the embodiment of the present invention can adjust the free rotation of the crack image acquisition device by controlling the rotation of the brushless motor pan / tilt, thereby realizing all-round and no-dead-angle acquisition of fatigue cracks in the steel bridge deck and accurate measurement of the crack size, meeting the requirements for fatigue crack detection of orthogonal anisotropic steel bridge decks in service in actual engineering and can be applied to actual engineering. BRIEF DESCRIPTION OF THE DRAWINGS

[0062] Other features, objects and advantages of the present invention will become more apparent from the detailed description of non-limiting embodiments made with reference to the following drawings:

[0063] Figure 1 This is an overall design diagram of a robot according to an embodiment of the present invention;

[0064] Figure 2 A diagram of a crack image acquisition device according to a preferred embodiment of the present invention;

[0065] Figure 3 A diagram of a brushless motor pan-tilt device according to a preferred embodiment of the present invention;

[0066] Figure 4 A diagram of a robot main circuit board according to a preferred embodiment of the present invention;

[0067] Figure 5 This is a steel bridge deck beam crack collection diagram of a preferred embodiment of the present invention;

[0068] Figure 6This is a steel bridge deck U-rib crack collection diagram of a preferred embodiment of the present invention;

[0069] Figure 7 This is a steel bridge deck top plate crack collection diagram according to a preferred embodiment of the present invention.

[0070] In the figure: 1—bent sheet metal; 2—side panel; 3—aluminum profile; 4—driving wheel; 5—driven wheel; 6—bearing; 7—track; 8—permanent magnet; 9—fill light; 10—linear tracking camera; 11—laser ranging module; 12—brushless motor pan-tilt device; 13—robot main circuit board; 14—crack image acquisition device; 15—brush DC motor; 16—pan-tilt base plate; 17—fixing column; 18—communication single-chip microcomputer; 19—flexible circuit board connector; 20—plug-in connector; 21—brushless motor; 22—crack image acquisition device fixing part; 23—crack image acquisition camera; 24—main control single-chip microcomputer; 25—motor drive buck chip; 26—brush DC motor drive chip; 27—power connector; 28—digital circuit buck chip; 29—undervoltage protection chip; 30—display screen; 31—crossbeam; 32—U rib; 33—top plate. DETAILED DESCRIPTION

[0071] The present invention is described in detail below in conjunction with specific embodiments. The following embodiments will help those skilled in the art to further understand the present invention, but are not intended to limit the present invention in any form. It should be noted that, for those of ordinary skill in the art, several variations and improvements may be made without departing from the concept of the present invention. These all belong to the protection scope of the present invention.

[0072] In one embodiment of the present invention, a crawler robot for collecting crack images of steel bridge deck is provided. Figure 1 As shown, including:

[0073] The mechanical body is a hollow structure with a magnetic track;

[0074] The power and transmission device is connected to the mechanical body to drive the robot to move forward, backward or climb over;

[0075] The crack image acquisition device is arranged outside the mechanical body to acquire crack image information and distance information. The distance information refers to the distance between the camera imaging plane and the crack plane.

[0076] The brushless motor pan-tilt device is installed inside the mechanical body, adjusts the angle of the crack image acquisition device, and obtains the homography transformation matrix between the camera imaging plane and the physical plane where the fatigue crack is located based on the crack image information and distance information. The homography transformation matrix describes the transformation relationship between the object point in the world coordinate system and the image point in the pixel coordinate system. For a certain point in the crack image, the world coordinates can be obtained by multiplying the pixel coordinates by the homography transformation matrix.

[0077] The environmental sensing device is arranged outside the mechanical body to collect environmental information during the movement of the robot.

[0078] The main circuit board is arranged inside the mechanical body and communicates with the crack image acquisition device, the brushless motor pan-tilt device and the environmental sensing device to realize the coordinated control and movement of the entire robot.

[0079] In one embodiment of the present invention, a preferred structure of a mechanical body is provided. Specifically, the mechanical body includes a bent sheet metal part 1 , a side plate 2 , an aluminum profile 3 , a track 7 and a permanent magnet 8 .

[0080] The bent sheet metal part 1 is bolted to the aluminum profile 3; the aluminum profile 3 is bolted to the side panels 2 on both sides. The crawler 7 surrounds the outer periphery of the side panels 2, and the permanent magnets 8 are evenly distributed on the crawler 7, so that the crawler 7 can be adsorbed on the U rib, the cross beam and the top plate, and can realize straight-line walking, U-turn or steering through the power and transmission device.

[0081] In some specific embodiments, the bent sheet metal part 1 is a part formed by cutting, folding, and bending a metal sheet. Here, the bent sheet metal parts 1 are combined together to form a housing cavity for placing a brushless motor pan-tilt device. The combination of the bent sheet metal parts 1 is specifically bent into an inverted V-shaped structure and bolted to the aluminum profile 3 at the end of the V. The side panel 2 is designed as a regular triangle structure. The three (platinum part 1, aluminum profile 3 and side panel 2) are assembled together into a cavity structure with a triangular cross-section. The track 7 surrounds the outer periphery of the side panel 2 and also presents a triangular structure. In addition, two circles of permanent magnets 8 are embedded in the track 7, which enables the track to be adsorbed on the U rib 32, the crossbeam 31 and the top plate 33. Through the differential drive of the motor, the structure can realize maneuvering functions such as straight-line walking, U-turns and steering.

[0082] In the above embodiment, the robot is carefully designed into a triangular shape, and its unique feature is that all three sides have the ability to be adsorbed on the steel plate. No matter which side is selected as the adsorption surface, the robot can walk and climb over stably. This feature gives the robot a high degree of flexibility, especially suitable for operation in a small space, significantly improving its applicability and practicality.

[0083] In the above embodiment, the mechanical body adopts a fully covered crawler design. When the mechanical body is inside the robot, the robot can ensure that its three sides can be firmly attached to the steel plate. In addition, the fully wrapped crawler design not only ensures the stability of the robot, but also provides effective protection for the internal devices of the robot during the climbing process.

[0084] In a preferred embodiment of the present invention, a preferred structure of a power and transmission device is provided. The power and transmission device is a group, which is respectively installed on both sides of the mechanical body. Specifically, each power and transmission device includes a driving wheel 4, a driven wheel 5, a bearing 6 and a brushed DC motor 15. The driving wheel 4 is arranged at a corner of the side plate 2 and meshes with the track 7; a brushed DC motor 15 is installed inside each side plate 2, and the brushed DC motor 15 is connected to the driving wheel 4 and provides a rotational torque therefor; the driven wheel 5 is arranged at the remaining two corners of the side plate through the bearing 6, and is also meshed with the track 7.

[0085] The power and transmission device of the above embodiment can drive the track to rotate only by providing a rotational torque through a brushed DC motor, thereby effectively redistributing the magnetic force to the target wall surface, thereby achieving smooth movement on the steel bridge deck.

[0086] In a preferred embodiment of the present invention, a preferred structure of a crack image acquisition device is provided. Specifically, Figure 2 As shown, the crack image acquisition device includes a base, a laser ranging module 11, a crack image acquisition camera 23 and a fill light 9. The base is connected to the brushless motor pan-tilt device; a number of laser ranging modules 11 and fill lights 9 are welded on its surface; the crack image acquisition camera 23 is glued to the center of the base. Among them, the laser ranging module 11 collects distance information, thereby obtaining the external parameters of each crack image, and then extracting the geometric features of the crack; the crack image acquisition camera 23 collects crack image information.

[0087] In a preferred embodiment, the process of acquiring geometric features is as follows: a crack image acquisition camera takes a crack picture to obtain crack image information; multiple laser ranging modules work in sequence to measure crack distance information; based on the image information and distance information, a homography transformation matrix is ​​calculated; the world coordinates of the crack contour are calculated using the homography transformation matrix to calculate the length and width of the crack.

[0088] In a preferred embodiment of the present invention, a preferred structure of a brushless motor pan-tilt device is provided. Specifically, the brushless motor pan-tilt device, such as Figure 3 As shown, it includes: a pan-tilt base plate 16, a pan-tilt circuit board, a brushless motor 21 and a crack image acquisition device fixing part 22.

[0089] The pan-tilt base plate 16 serves as the integrated foundation of the entire brushless motor pan-tilt device, which is fixed inside the machine body, for example, bolted to the aluminum profile 3, so that the entire brushless motor pan-tilt device is installed inside the machine body. The pan-tilt circuit board is the control panel of the entire brushless motor pan-tilt device, which is fixed to the pan-tilt base plate. The brushless motor 21 is fixed to the pan-tilt circuit board to provide power for adjusting the angle of the crack image acquisition device; the crack image acquisition device fixing part 22 is connected to the brushless motor and is used to install the crack image acquisition device.

[0090] In some specific embodiments, the pan-tilt circuit board is mounted on the pan-tilt base plate 16 via the fixing column 17, and the brushless motor is mounted on the pan-tilt circuit board via the fixing column 17. The crack image acquisition device fixing member 22 is bolted to the brushless motor.

[0091] In some specific embodiments, the gimbal circuit board includes a communication microcontroller 18, a flexible circuit board connector 19 and a connector 20, so that the communication microcontroller 18 has serial communication capability and can communicate and coordinate with the robot main circuit board 13 and the crack image acquisition device 14.

[0092] In some specific embodiments, the crack image acquisition device fixing member 22 includes a disc base and connecting rods extending to both sides, the connecting rods extend to the outside of the side plate and are connected to the base of the crack image acquisition device. The crack image acquisition device 14 is mounted on the crack image acquisition device fixing member 22 by four M3 screws, and the crack image acquisition device fixing member 22 is mounted on the brushless motor 21 by four M2.5 screws. Figure 3 The brushless motor 21 will drive the fixing part of the crack image acquisition device to rotate synchronously, thereby changing the pitch angle of the crack image acquisition device.

[0093] Since the actual working environment of the robot is complex and there may be obstacles on the forward route, the robot needs to collect environmental information and then plan the forward route. In a preferred embodiment of the present invention, a preferred structure of an environmental sensing device is provided. Specifically, the environmental sensing device includes a linear tracking camera 10 and a laser ranging module 11. Both are installed on the bent sheet metal part 1. During the entire robot movement process, the linear tracking camera has the following functions:

[0094] A high-definition camera is installed in front of the robot to capture the direction of travel in real time to prevent the robot from deviating from the planned route; the main control microcontroller needs to process the images captured by the tracking camera in real time and perform complex calculations to determine the offset angle of the travel path; based on the deflection angle, it calculates the power percentage that the two motors should output to accurately control the robot's forward route.

[0095] The functions of the laser ranging module are as follows:

[0096] The laser ranging modules are installed on the front and both sides of the robot to sense obstacles in front and on both sides of the robot; the laser ranging module in the front will continuously measure whether there are obstacles in front of the robot. If there are obstacles in front, the robot will stop crawling automatically; the laser ranging modules on both sides will continuously measure the distance between the robot and the U-ribs on both sides to determine whether the robot is running correctly on the predetermined route. If the robot deviates from the predetermined route, the main control microcontroller will correct the route according to the data measured by the laser ranging module.

[0097] The environmental sensing device in the above embodiment helps the robot to collect environmental information, and then plan the forward route to achieve automatic crawling between U ribs.

[0098] In a preferred embodiment of the present invention, a preferred structure of the main circuit board 3 is provided. Specifically, Figure 4 As shown, the robot main circuit board 13 is bolted to the bent sheet metal 1, and mainly includes a main control microcontroller 24, a motor drive buck chip 25, a brushed DC motor drive chip 26, a power connector 27, a digital circuit buck chip 28, an undervoltage protection chip 29, and a display screen 30.

[0099] like Figure 4 As shown, in the main circuit structure of the robot, the lithium battery provides power to the robot through the power connector; the connector 20 enables the robot main circuit board 13 to communicate with the brushless motor pan-tilt device 12 and the crack image acquisition device 14 through the serial port protocol; the motor drive buck chip 25 stabilizes the battery voltage to 12V, which is used to drive the brushed DC motor 15 and the brushless motor 21 to work; the digital circuit buck chip 28 stabilizes the battery voltage to 5V, which is used to drive the digital circuit to work; the brushed DC motor drive chip 26 receives the pulse width modulation signal from the main control microcontroller, and drives the brushed DC motor 5 to work at different speeds; the undervoltage protection chip 29 compares the battery voltage with the reference voltage to prevent the battery from being over-discharged; the main control microcontroller 24 is the central system of the robot, which is responsible for driving the robot to complete various maneuvers, receiving remote control signals, calculating tracking routes, and controlling the operation of the subsequent circuits; the display screen 30 can display the status information of the robot and can also be used for function debugging.

[0100] Based on the same inventive concept, in another embodiment of the present invention, a control method for a crawler robot for collecting crack images of a steel bridge deck is provided, and the specific steps are as follows:

[0101] S100, the robot is attached to the beam, U-rib or top plate;

[0102] S200, the power and transmission device drives the robot to move, so that the robot moves to the crack area;

[0103] S300, controlling the brushless motor pan-tilt device to rotate, adjusting the elevation angle of the crack image acquisition device, so that the crack image acquisition device faces the crack;

[0104] S400, controlling a crack image acquisition device to acquire crack images and distance information;

[0105] S500, the brushless motor pan-tilt device calculates a homography transformation matrix between an imaging plane of a crack image acquisition camera and a plane where the fatigue crack is located, and obtains geometric information of the crack.

[0106] Further, in a specific embodiment, if Figure 5 As shown, the robot first detects the crack on the beam 31, controls and drives the tracks 7 on both sides of the robot to move, and makes the robot run to the crack area; controls the brushless motor pan-tilt device 12 to rotate, adjusts the elevation angle of the crack image acquisition device 14, and makes the image acquisition device 14 face the crack of the beam 31; controls the crack image acquisition camera 23 to acquire crack pictures, and saves them to the internal storage card of the robot; controls the laser ranging module 11 to acquire laser ranging values, and the communication single chip microcomputer 18 will operate on the laser ranging values, calculate the homography transformation matrix between the imaging plane of the crack image acquisition camera 23 and the plane where the fatigue crack is located, and save the parameters to the internal storage card of the robot.

[0107] like Figure 6 , Figure 7 As shown, the robot detects cracks on the U rib 32 or top plate 33 in the second step, controls the robot to move to the junction of the crossbeam 31 and the top plate 33, makes the robot's forward direction perpendicular to the U rib 32 or top plate 33, continues to drive the robot forward, and the robot will transfer and adsorb on the surface of the U rib 32 or top plate 33, and continues to drive the robot forward to the area where the crack is located; controls the brushless motor pan-tilt device 12 to rotate, adjusts the elevation angle of the crack image acquisition device 14, and ensures that the image acquisition device 14 can face the crack on the U rib 32 or top plate 33; controls the crack image acquisition camera 23 to acquire crack images, and saves these images to the robot's internal storage card; controls the laser ranging module 11 to acquire laser ranging values. The communication single-chip microcomputer 18 will calculate these laser ranging values, calculate the homography transformation matrix between the imaging plane of the crack image acquisition camera 23 and the plane where the fatigue crack is located, and save the matrix to the robot's internal storage card.

[0108] The precise calculation of the communication microcontroller results in the homography transformation matrix, which, based on the detailed information of the image pixels, can accurately map the coordinate position of the crack in the real world, and then extract key geometric information such as the length and width of the crack.

[0109] During the overall operation of the robot, each component demonstrates a high degree of coordination and precise control. Specifically:

[0110] For the adjustment of elevation angle, this is achieved by sending precise rotation signals to the brushless motor by the main circuit board.

[0111] At the same time, when the robot is running, the environmental perception device will continuously and in real time collect environmental data. For example, the linear tracking camera will capture the image of the forward direction in real time and transmit the image data to the main control microcontroller. The laser ranging module will continuously measure the distance between the robot and the U-ribs on both sides, and send the distance data to the main control microcontroller in real time. After receiving the image captured by the linear tracking camera and the distance value measured by the laser ranging module, the main control microcontroller will perform precise path planning, determine the best direction of travel, and finally output control signals to drive the two brushed DC motors to run according to the planned path.

[0112] The above describes the specific embodiments of the present invention. It should be understood that the present invention is not limited to the above specific embodiments, and those skilled in the art can make various modifications or variations within the scope of the claims, which does not affect the essence of the present invention. The above preferred features can be used in any combination without conflicting with each other.

Claims

1. A crawler robot for collecting crack images of steel bridge decks, characterized in that: include: A mechanical body, wherein the mechanical body is a cavity structure with a magnetic track; A power and transmission device, which is connected to the mechanical body and drives the robot to move forward, backward or over; A crack image acquisition device, which is disposed outside the mechanical body and collects crack image information and distance information; A brushless motor pan-tilt device, which is installed inside the mechanical body, adjusts the angle of the crack image acquisition device, and obtains a homography transformation matrix between a camera imaging plane and a physical plane where fatigue cracks are located based on the crack image information and distance information, so as to extract geometric features of the cracks; An environment sensing device, which is arranged outside the mechanical body and collects environmental information during the movement of the robot; A main circuit board is arranged inside the mechanical body and communicates with the crack image acquisition device, the brushless motor pan-tilt device and the environmental sensing device to achieve coordinated control and movement of the entire robot.

2. The steel bridge deck crack image acquisition crawler robot according to claim 1, characterized in that: The mechanical body comprises: A bent sheet metal part, wherein two of the bent sheet metal parts are spliced ​​together to form a cavity; the brushless motor pan-tilt device is installed inside the cavity; An aluminum profile connected to the bottom of the sheet metal component; Side panels, both of which are in the shape of regular triangles and are respectively connected to two sides of the bent sheet metal part; A crawler track, the crawler track surrounds the outer periphery of the side plate and has a triangular structure as a whole; Permanent magnets are evenly distributed on the crawler, so that the crawler can be adsorbed on the U ribs, beams and top plates, and can be driven by power and transmission devices to achieve straight-line walking, U-turns or steering.

3. According to claim 2, a steel bridge deck crack image acquisition crawler robot is characterized in that: There are two power and transmission devices, which are respectively installed on both sides of the mechanical body; each power and transmission device includes: A driving wheel, the driving wheel is arranged at a corner of the side plate and meshes with the crawler track; A brushed DC motor, which is arranged inside the side plate, is correspondingly connected to the driving wheel and provides a rotational torque therefor; A driven wheel is arranged at the remaining two corners of each of the side plates and is engaged with the crawler track.

4. The steel bridge deck crack image acquisition crawler robot according to claim 1, characterized in that: There are two crack image acquisition devices, which are respectively installed on both sides of the mechanical body. Each of the crack image acquisition devices includes: A base, the base being connected to the brushless motor pan-tilt device; A crack image acquisition camera, which is installed on the base and acquires crack image information; Laser ranging modules, multiple of which are installed on the base to collect distance information; Fill-in light, at least one of which is installed on the base to provide a light source for shooting.

5. The steel bridge deck crack image acquisition crawler robot according to claim 4, characterized in that: The step of obtaining a homography transformation matrix between a camera imaging plane and a physical plane where the fatigue crack is located based on the crack image information and the distance information, and extracting geometric features of the crack, includes: The crack image acquisition camera takes a crack picture to obtain crack image information; The plurality of laser distance measurement modules work in sequence to measure crack distance information; Calculating a homography transformation matrix based on the image information and the distance information; The world coordinates of the crack contour are calculated using the homography transformation matrix to calculate the length and width of the crack.

6. The steel bridge deck crack image acquisition crawler robot according to claim 1, characterized in that: The brushless motor pan-tilt device comprises: A pan / tilt base plate, the pan / tilt base plate is fixed inside the mechanical body; A pan-tilt circuit board, which is a control panel of the entire brushless motor pan-tilt device and is fixed to the pan-tilt bottom plate. The pan-tilt circuit board includes a communication microcontroller, a flexible circuit board connector, and a plug-in connector. The flexible circuit board connector and the plug-in connector enable the communication microcontroller to have serial communication capability, and to communicate and coordinate with the main circuit board and the crack image acquisition device. A brushless motor, the brushless motor is fixed to the pan-tilt circuit board and provides power for adjusting the angle of the crack image acquisition device; A crack image acquisition device fixing part, wherein the crack image acquisition device fixing part is connected to the brushless motor and is used for installing the crack image acquisition device.

7. The steel bridge deck crack image acquisition crawler robot according to claim 1, characterized in that: The main circuit board comprises: A power connector, which is used to install a lithium battery to establish power supply; A main control single chip microcomputer, the main control single chip is the main control chip of the main circuit board; A display screen, which is used to display robot status information and function debugging; An undervoltage protection chip, which is used to monitor the voltage of the lithium battery in real time; A motor drive buck chip, which is used to step down the battery voltage to drive a brushed DC motor and a brushless motor circuit; A digital circuit step-down chip, wherein the digital circuit step-down chip is used to step down the battery voltage to drive the digital circuit; The brushed DC motor driving chip is used to receive information from the main control chip and adjust the current to meet the brushed DC motor's demand for driving current.

8. The steel bridge deck crack image acquisition crawler robot according to claim 7, characterized in that: The environment sensing device comprises: A linear tracking camera, which captures the image of the forward direction in real time and transmits it to the main control microcontroller for image processing; the image processing includes calculating the offset angle of the forward path and then obtaining the power percentage output by the brushed DC motor to accurately control the forward path of the robot; Laser ranging modules, multiple laser ranging modules are installed in front and on both sides of the mechanical body, and are used to sense the surrounding environment of the robot; the laser ranging module located in the front continuously measures whether there are obstacles in front, and stops the robot from moving forward when there are obstacles; the laser ranging modules located on both sides will continuously measure the distance between the robot and the U-ribs on both sides to determine whether the robot is running correctly on the predetermined route. If the robot deviates from the predetermined route, the main control microcontroller will perform route correction work based on the data measured by the laser ranging module.

9. A control method for a crawler robot for collecting crack images of steel bridge decks according to any one of claims 1 to 8, characterized in that: Attach the robot to the beam, U-rib or top plate; Control the power and transmission device to drive the robot to move to the crack area; Controlling the brushless motor pan-tilt device to rotate, adjusting the elevation angle of the crack image acquisition device, so that the crack image acquisition device faces the crack; Controlling the crack image acquisition device to acquire crack images and distance information; The communication microcontroller installed in the brushless motor pan-tilt device calculates the homography transformation matrix between the imaging plane of the crack image acquisition camera and the plane where the fatigue crack is located, and extracts the geometric characteristics of the crack.

10. The control method of a crawler robot for collecting crack images of steel bridge decks according to claim 9, characterized in that: When the robot is running, the linear tracking camera collects the forward direction image in real time and transmits it to the main control microcontroller; The laser ranging module will measure the distance between the robot and the U-ribs on both sides in real time and transmit it to the main control chip; The main control microcontroller receives the images captured by the linear tracking camera and the distance value measured by the laser ranging module, completes the path planning, determines the direction of travel, and finally outputs the signal to drive the two brushed DC motors.

Citation Information

Patent Citations

  • Orthotropic steel bridge panel fatigue crack detecting system

    CN109613010A

  • Intelligent detection system and method for fatigue cracks of steel box girder

    CN115639209A

  • Railway bridge surface crack automatic detection robot and detection method

    CN115772850A

  • Automatic tracking method of double-foot robot

    CN108181897A

  • Intelligent monitoring device and method for orthotropic steel bridge deck fatigue crack

    CN112098513A

Cited By

  • Multi-layer bridge demolition construction stress assessment method and device

    CN120369170A

  • Magnetic suction mobile platform and piezoelectric portable detection device for steel structure damage detection

    CN122259717A

  • Fatigue detection adsorption robot for steel box girder

    CN224173193U