Control method, system, device and equipment for unmanned aerial vehicle-robot combined operation, readable storage medium and program product
Through the control method of the drone-robot joint operation, the drone release auxiliary up-and-down mechanism and live-operated operation robot are used to perform reel and potential transfer operations, which solves the safety risks and low efficiency of traditional artificial live-operated operations, and improves the Efficiency and reliability of power transmission line maintenance and maintenance.
Patent Information
- Application Number
- CN202411015275.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-07-26
- Publication Date
- 2024-11-05
Smart Images

Figure CN118897569A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of automatic control technology, and in particular to a control method, system, device, computer equipment, computer-readable storage medium and computer program product for drone-robot joint operations. Background Art
[0002] Since transmission lines are exposed to the natural environment for a long time and are damaged, they are prone to problems that threaten the safety of the lines, such as broken wires, loose bolts, and contaminated insulators. If not discovered and handled in time, the stability and safety of the transmission line operation will be undermined. Therefore, regular transmission line maintenance and overhaul operations have become a routine task for the power sector.
[0003] In traditional technology, the maintenance and repair of transmission lines is mainly carried out by manually lifting and lowering the lines. In this solution, workers carry insulating ropes to the towers and then the ground workers manually pull them, and then carry out manual live-line operations. However, in the above solution, the workers who climb the towers cannot perform autonomous lifting and lowering operations and there are great safety risks, resulting in low efficiency and poor reliability. Summary of the invention
[0004] Based on this, it is necessary to provide a control method, device, computer equipment, computer-readable storage medium and computer program product for drone-robot joint operation to address the above-mentioned technical problems.
[0005] In a first aspect, the present application provides a control method for a drone-robot joint operation, which is applied to a control terminal, and the method comprises:
[0006] Detecting the operating status of each first component on the drone, and when the operating status of each first component is normal, controlling the drone to place the auxiliary line-in / line-out mechanism onto the target transmission line, and controlling the drone to return to the ground after the placement is completed;
[0007] Detecting the operating status of each second component on the live working robot, and when the operating status of each second component is normal, controlling the live working robot to embed the insulating rope lowered by the auxiliary upper and lower wire mechanism into the reel mechanism of the upper and lower wire mechanism;
[0008] Control the live working robot to start the reel mechanism to perform a first online operation until the live working robot reaches an equipotential safety distance, and control the equipotential arm of the live working robot to perform a potential transfer operation at the equipotential safety distance;
[0009] When the potential transfer operation is completed, the live working robot is controlled to perform a second online operation until the robot online task is completed, and the live working robot is controlled to start an inspection operation.
[0010] In one embodiment, controlling the drone to place the auxiliary line-in / line-out mechanism onto a target transmission line includes:
[0011] In response to a control instruction for the drone, the drone is controlled to fly to a preset position above the target transmission line; the drone is controlled to release the drone claw for release, so that the auxiliary up-and-down line mechanism is released onto the target transmission line; the auxiliary up-and-down line mechanism lowers the insulating rope by adjusting the reverse buckle device.
[0012] In one embodiment, controlling the live working robot to start the reel mechanism to perform a first online operation until the live working robot reaches an equipotential safety distance includes:
[0013] Control the live working robot to start the reel mechanism to perform the first online operation, and obtain the target distance data measured by the binocular camera in real time; determine whether the live working robot has reached the equipotential safety distance based on the target distance data; when the live working robot has reached the equipotential safety distance, control the live working robot to stop the first online operation.
[0014] In one embodiment, controlling the live working robot to perform a second online operation until the robot online task is completed includes:
[0015] Control the live working robot to perform the second online operation until the walking wheel at the upper end of the walking arm of the live working robot is higher than the target transmission line; control the live working robot to adjust the walking arm to be perpendicular to the target transmission line, lower the live working robot after aligning it with the target transmission line, and control the tensioning wheel of the live working robot to rise to a preset position.
[0016] In one embodiment, the method further comprises:
[0017] During the process of the live working robot performing the first online operation and the second online operation, the posture data corresponding to the live working robot collected by the posture sensor is acquired in real time; based on the posture data, it is determined whether the live working robot is in an unbalanced state; when the live working robot is in the unbalanced state, the posture of the live working robot is adjusted to make the live working robot in a balanced state.
[0018] In the second aspect, the present application also provides a control system for a drone-robot joint operation, the system comprising: a live working robot, a drone and a control terminal; the control terminal is respectively connected to the live working robot and the drone for communication; the live working robot comprises a walking mechanism, an operating mechanism, a potential transfer mechanism and an up-and-down line mechanism; the up-and-down line mechanism comprises a reel mechanism, a reciprocating rotating assembly, a worm gear reduction assembly and a guide roller assembly; the drone comprises a drone main body, a drone gripper and an auxiliary up-and-down line mechanism; the drone main body consists of a propeller and a set-top box;
[0019] The control terminal is used to detect the operating status of each first component on the drone, and when the operating status of each first component is normal, control the drone to drop the auxiliary up-and-down line mechanism onto the target transmission line, and control the drone to return to the ground after the dropping is completed; detect the operating status of each second component on the live working robot, and when the operating status of each second component is normal, control the live working robot to embed the insulating rope lowered by the auxiliary up-and-down line mechanism into the reel mechanism of the up-and-down line mechanism; control the live working robot to start the reel mechanism to perform a first online operation until the live working robot reaches the equipotential safety distance, and control the equipotential arm of the live working robot to perform a potential transfer operation at the equipotential safety distance; when the potential transfer operation is completed, control the live working robot to perform a second online operation until the robot online task is completed, and control the live working robot to start an inspection operation.
[0020] In a third aspect, the present application further provides a control device for a drone-robot joint operation, which is applied to a control terminal, and the device comprises:
[0021] The first control module is used to detect the operating status of each first component on the drone, and when the operating status of each first component is normal, control the drone to place the auxiliary line-in and line-out mechanism on the target transmission line, and control the drone to return to the ground after the placement is completed;
[0022] a second control module, for detecting the operating status of each second component on the live working robot, and controlling the live working robot to embed the insulating rope lowered by the auxiliary upper and lower line mechanism into the reel mechanism of the upper and lower line mechanism when the operating status of each second component is normal;
[0023] A third control module is used to control the live working robot to start the reel mechanism to perform a first online operation until the live working robot reaches an equipotential safety distance, and control the equipotential arm of the live working robot to perform a potential transfer operation at the equipotential safety distance;
[0024] The fourth control module is used to control the live working robot to perform a second online operation when the potential transfer operation is completed until the robot online task is completed, and control the live working robot to start an inspection operation.
[0025] In a fourth aspect, the present application further provides a computer device, comprising a memory and a processor, wherein the memory stores a computer program, and when the processor executes the computer program, the following steps are implemented:
[0026] Detect the operating status of each first component on the drone, and when the operating status of each first component is normal, control the drone to drop the auxiliary up-and-down line mechanism onto the target transmission line, and control the drone to return to the ground after the dropping is completed; detect the operating status of each second component on the live working robot, and when the operating status of each second component is normal, control the live working robot to embed the insulating rope lowered by the auxiliary up-and-down line mechanism into the reel mechanism of the up-and-down line mechanism; control the live working robot to start the reel mechanism to perform the first online operation until the live working robot reaches the equipotential safety distance, and control the equipotential arm of the live working robot to perform a potential transfer operation at the equipotential safety distance; when the potential transfer operation is completed, control the live working robot to perform the second online operation until the robot online task is completed, and control the live working robot to start the inspection operation.
[0027] In a fifth aspect, the present application further provides a computer-readable storage medium having a computer program stored thereon, wherein when the computer program is executed by a processor, the following steps are implemented:
[0028] Detect the operating status of each first component on the drone, and when the operating status of each first component is normal, control the drone to drop the auxiliary up-and-down line mechanism onto the target transmission line, and control the drone to return to the ground after the dropping is completed; detect the operating status of each second component on the live working robot, and when the operating status of each second component is normal, control the live working robot to embed the insulating rope lowered by the auxiliary up-and-down line mechanism into the reel mechanism of the up-and-down line mechanism; control the live working robot to start the reel mechanism to perform the first online operation until the live working robot reaches the equipotential safety distance, and control the equipotential arm of the live working robot to perform a potential transfer operation at the equipotential safety distance; when the potential transfer operation is completed, control the live working robot to perform the second online operation until the robot online task is completed, and control the live working robot to start the inspection operation.
[0029] In a sixth aspect, the present application further provides a computer program product, including a computer program, which implements the following steps when executed by a processor:
[0030] Detect the operating status of each first component on the drone, and when the operating status of each first component is normal, control the drone to drop the auxiliary up-and-down line mechanism onto the target transmission line, and control the drone to return to the ground after the dropping is completed; detect the operating status of each second component on the live working robot, and when the operating status of each second component is normal, control the live working robot to embed the insulating rope lowered by the auxiliary up-and-down line mechanism into the reel mechanism of the up-and-down line mechanism; control the live working robot to start the reel mechanism to perform the first online operation until the live working robot reaches the equipotential safety distance, and control the equipotential arm of the live working robot to perform a potential transfer operation at the equipotential safety distance; when the potential transfer operation is completed, control the live working robot to perform the second online operation until the robot online task is completed, and control the live working robot to start the inspection operation.
[0031] The control method, device, computer equipment, computer-readable storage medium and computer program product of the above-mentioned drone-robot joint operation are controlled by an operator through a control terminal to control a drone carrying an auxiliary on-line and off-line mechanism to fly to a preset position above a target transmission line, and then control the drone to drop the auxiliary on-line and off-line mechanism onto the target transmission line, and then control the live-working robot to embed the insulating rope lowered by the auxiliary on-line and off-line mechanism into the reel mechanism of the on-line and off-line mechanism, and perform the on-line operation until the robot's on-line task is completed. In summary, the entire technical solution uses drones and robots to replace manual operations, avoids the inefficient and dangerous process of manual live-working operations, and reduces the safety risks of operations. While realizing flexible on-line and off-line operations of live-working robots, it can also reduce the deviation of live-working robots during the on-line and off-line processes, thereby improving the efficiency and reliability of transmission line maintenance and inspection operations. BRIEF DESCRIPTION OF THE DRAWINGS
[0032] In order to more clearly illustrate the technical solutions in the embodiments of the present application or related technologies, the drawings required for use in the embodiments of the present application or related technical descriptions will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without paying creative work.
[0033] FIG1 is a diagram of an application environment of a control method for a UAV-robot joint operation according to an embodiment;
[0034] Figure 2 A schematic diagram of a flow chart of a control method for a drone-robot joint operation in one embodiment;
[0035] Figure 3 A schematic diagram of a process flow of a drone on-site operation in one embodiment;
[0036] Figure 4 A schematic diagram of a flow chart of a first online operation step in an embodiment;
[0037] Figure 5 A schematic diagram of the structure of a double-circuit transmission line tower on the same tower in one embodiment;
[0038] Figure 6 A schematic diagram of the structure of a double-circuit power transmission line on the same tower in one embodiment;
[0039] Figure 7 A schematic diagram of the structure of a three-closed-loop control unit of a robot posture in one embodiment;
[0040] Figure 8 It is a flowchart of a control method for a drone-robot joint operation in a specific embodiment;
[0041] Fig. 9 is a structural block diagram of a control device for a drone-robot joint operation in one embodiment;
[0042] FIG. 10 is a diagram showing the internal structure of a computer device in one embodiment. DETAILED DESCRIPTION
[0043] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.
[0044] The control method of the drone-robot joint operation provided in the embodiment of the present application can be applied in the application environment shown in Figure 1. The control terminal communicates with the drone and the live working robot through a network.
[0045] Specifically, the control method for drone-robot joint operation provided in the embodiment of the present application can be executed by a control terminal.
[0046] Exemplarily, the control terminal detects the operating status of each first component on the drone, and when the operating status of each first component is normal, controls the drone to drop the auxiliary online and offline mechanism onto the target transmission line, and controls the drone to return to the ground after the dropping is completed; the control terminal detects the operating status of each second component on the live working robot, and when the operating status of each second component is normal, controls the live working robot to embed the insulating rope lowered by the auxiliary online and offline mechanism into the reel mechanism of the online and offline mechanism; the control terminal controls the live working robot to start the reel mechanism to perform the first online operation until the live working robot reaches the equipotential safety distance, and controls the equipotential arm of the live working robot to perform a potential transfer operation at the equipotential safety distance; when the potential transfer operation is completed, the control terminal controls the live working robot to perform the second online operation until the robot online task is completed, and controls the live working robot to start the inspection operation.
[0047] In the application environment shown in FIG1 , the control terminal may be, but is not limited to, various personal computers, laptops, smart phones, and tablet computers. The drone may be a dedicated maintenance drone specifically used for maintenance and repair of power transmission lines, and the live working robot may be a dedicated maintenance robot specifically used for maintenance and repair of power transmission lines.
[0048] In one embodiment, Figure 2 As shown, a control method for UAV-robot joint operation is provided, which is described by taking the method applied to the control terminal in FIG1 as an example, and includes the following steps:
[0049] Step S201, detect the operating status of each first component on the drone. When the operating status of each first component is normal, control the drone to deploy the auxiliary up-and-down line mechanism to the target transmission line, and control the drone to return to the ground after the deployment is completed.
[0050] Among them, the first component includes but is not limited to the drone main body, the drone gripper and the auxiliary online and offline mechanism, and the drone main body can be composed of a rotor and a set-top box.
[0051] The target transmission line may be a pre-specified section of a 220 kV high-voltage transmission line.
[0052] Specifically, the control terminal detects the operating status of each first component on the drone. When the operating status of each first component is normal, the drone is controlled to fly to a preset position above the target transmission line, and the drone is controlled to release the drone gripper for delivery, so that the auxiliary up and down line mechanism is delivered to the target transmission line, and the drone is controlled to return to the ground after the delivery is completed.
[0053] Step S202, detecting the operating status of each second component on the live working robot, and when the operating status of each second component is normal, controlling the live working robot to embed the insulating rope lowered by the auxiliary upper and lower line mechanism into the reel mechanism of the upper and lower line mechanism.
[0054] Among them, the second component includes but is not limited to a walking mechanism, an operating mechanism, a potential transfer mechanism and an up and down line mechanism. The up and down line mechanism may include a winding mechanism, a reciprocating rotation component, a worm gear reduction component and a guide roller component.
[0055] Specifically, the control terminal detects the operating status of each second component on the live working robot. When the operating status of each second component is normal, the live working robot is controlled to embed the insulating rope lowered by the auxiliary upper and lower line mechanism into the reel mechanism of the upper and lower line mechanism.
[0056] Step S203, controlling the live working robot to start the reel mechanism to perform the first online operation until the live working robot reaches the equipotential safety distance, and controlling the equipotential arm of the live working robot to perform a potential transfer operation at the equipotential safety distance.
[0057] Among them, the equipotential safety distance refers to the safety distance that must be maintained during the inspection or maintenance of power transmission lines to prevent electric shock or other electricity-related injuries.
[0058] Among them, the first online operation refers to the online operation corresponding to the process of the live working robot rising from the ground to the equipotential safety distance.
[0059] Specifically, the control terminal controls the live working robot to start the winding mechanism to perform the first online operation, and obtains the target distance data measured by the binocular camera in real time for identification. When it is identified that the live working robot has reached the equipotential safety distance, the live working robot is controlled to stop the first online operation, and then the equipotential arm of the live working robot is controlled to perform a potential transfer operation at the equipotential safety distance.
[0060] Step S204, when the potential transfer operation is completed, the live working robot is controlled to perform a second online operation until the robot online task is completed, and the live working robot is controlled to start an inspection operation.
[0061] Among them, the second on-line operation refers to the on-line operation corresponding to the process of the live working robot rising from the equipotential safety distance to the point where the walking wheels at the upper end of the walking arm are higher than the transmission line.
[0062] Specifically, when the potential transfer operation is completed, the control terminal controls the live working robot to proceed to the target transmission line, and stops the second online operation when the walking wheel at the upper end of the walking arm of the live working robot is higher than the target transmission line; then the control terminal controls the live working robot to adjust the walking arm to be perpendicular to the target transmission line, lowers the live working robot after aligning it with the target transmission line, and controls the tensioning wheel of the live working robot to rise to a preset position.
[0063] The control method of the above-mentioned drone-robot joint operation is that the operator controls the drone carrying the auxiliary up-and-down line mechanism to fly to a preset position above the target transmission line through the control terminal, and then controls the drone to drop the auxiliary up-and-down line mechanism onto the target transmission line, and then controls the live-line working robot to embed the insulating rope lowered by the auxiliary up-and-down line mechanism into the reel mechanism of the up-and-down line mechanism, and performs the online operation until the robot's online task is completed. In summary, the entire technical solution uses drones and robots to replace manual operations, avoids the inefficient and dangerous process of manual live-line operations, and reduces the safety risks of operations. While realizing the flexible up-and-down line operation of the live-line working robot, it can also reduce the deviation of the live-line working robot during the up-and-down line process, thereby improving the efficiency and reliability of transmission line maintenance and inspection operations.
[0064] In one embodiment, in the above step S201, controlling the drone to place the auxiliary line-in and line-out mechanism onto the target transmission line specifically includes the following steps:
[0065] In response to control instructions for the UAV, the UAV is controlled to fly to a preset position above the target transmission line; the UAV is controlled to release the UAV gripper to release the UAV so that the auxiliary upper and lower line mechanism is released onto the target transmission line; the auxiliary upper and lower line mechanism lowers the insulating rope from the insulating rope rack by adjusting the reverse buckle device.
[0066] The preset position may be a position pre-specified by relevant technical personnel, such as 700 mm directly above the transmission line.
[0067] Specifically, the control terminal responds to the control command for the drone, controls the drone to fly to a preset position above the target transmission line; then controls the drone to release the drone claws for delivery, so that the auxiliary up and down line mechanism is delivered to the target transmission line.
[0068] For example, Figure 3 As shown in the figure, the operation process of the drone is as follows: when all parts of the drone can operate normally, the operator will control the drone carrying the insulating rope rack to fly to 700mm above the transmission line, release the clamp to release the insulating rope rack, and accurately drop it onto the double-split conductor. After the release is completed, the drone will be controlled to return to the ground.
[0069] In this embodiment, the UAV is precisely controlled by sending control instructions, which effectively avoids the process of manual live-line operations and improves the efficiency and reliability of transmission line maintenance and inspection operations.
[0070] In one embodiment, if Figure 4 As shown, in the above step S203, the live working robot is controlled to start the reel mechanism to perform the first online operation until the live working robot reaches the equipotential safety distance, which specifically includes the following steps:
[0071] Step S401, controlling the live working robot to start the reel mechanism to perform a first online operation, and obtaining target distance data measured by a binocular camera in real time.
[0072] Step S402: judging whether the live working robot has reached the equipotential safety distance according to the target distance data.
[0073] Step S403, when the live line working robot reaches the equipotential safety distance, the live line working robot is controlled to stop the first online operation.
[0074] The target distance data may be data identifying the distance between the live working robot and the target transmission line.
[0075] Specifically, the control terminal controls the live working robot to start the winding mechanism to perform the first online operation, and obtains the target distance data measured by the binocular camera in real time; based on the target distance data, it determines whether the live working robot has reached the equipotential safety distance; when it is identified that the live working robot has reached the equipotential safety distance, the live working robot is controlled to stop the first online operation.
[0076] In this embodiment, the first online operation is performed by starting the reel mechanism, and the binocular camera is used to monitor the corresponding distance data in real time, so as to accurately control the live working robot to reach the equipotential safety distance from the ground.
[0077] In one embodiment, in the above step S204, controlling the live working robot to perform a second online operation until the robot online task is completed specifically includes the following steps:
[0078] Control the live working robot to perform the second online operation until the upper walking wheel of the walking arm of the live working robot is higher than the target transmission line; control the live working robot to adjust the walking arm to be perpendicular to the target transmission line, lower the live working robot after aligning it with the target transmission line, and control the tensioning wheel of the live working robot to rise to a preset position.
[0079] Specifically, the control terminal controls the live working robot to perform the second online operation until the walking wheels at the upper end of the walking arm of the live working robot are higher than the target transmission line; controls the live working robot to adjust the walking arm to be perpendicular to the target transmission line, lowers the live working robot after aligning it with the target transmission line, and controls the tensioning wheels of the live working robot to rise to a preset position.
[0080] For example, a 220kV double-circuit transmission line tower Figure 5 As shown in Figure 2, each section of the transmission line is Figure 6 As shown, the live working robot needs to perform live working on a 220kV high voltage transmission line.
[0081] In this embodiment, the live working robot is precisely controlled by sending control instructions, the robot's online task is efficiently completed, and the efficiency and reliability of transmission line maintenance and inspection operations are improved.
[0082] In one embodiment, the method of the present application further includes the following steps:
[0083] During the process of the live working robot performing the first online operation and the second online operation, the posture data corresponding to the live working robot collected by the posture sensor is obtained in real time; based on the posture data, it is determined whether the live working robot is in an unbalanced state; when the live working robot is in an unbalanced state, the posture of the live working robot is adjusted to make the live working robot in a balanced state.
[0084] The posture data may be data describing information such as the current position and direction of the live-working robot in the air, and these data may be collected by a posture sensor.
[0085] Specifically, during the process of the live working robot performing the first online operation and the second online operation, the control terminal obtains in real time the posture data of the live working robot corresponding to the current moment collected by the posture sensor; and based on the posture data, determines whether the live working robot is in an unbalanced state; when it is identified that the live working robot is in an unbalanced state, the posture of the live working robot is adjusted to make the live working robot in a balanced state.
[0086] In this embodiment, a posture sensor is used to record the posture data of the live working robot in the air so as to adjust the posture of the live working robot. This fully takes into account the possibility that the live working robot may shake during the ascent, causing the robot to shift, and effectively ensures that the robot can go online smoothly.
[0087] In one embodiment, as shown in FIG1 , a control system for a drone-robot joint operation is provided, the system comprising: a live-working robot, a drone and a control terminal; the control terminal is respectively connected to the live-working robot and the drone for communication; the live-working robot comprises a walking mechanism, an operating mechanism, a potential transfer mechanism and an up-and-down line mechanism; the up-and-down line mechanism comprises a reel mechanism, a reciprocating rotating assembly, a worm gear reduction assembly and a guide roller assembly; the drone comprises a drone main body, a drone gripper and an auxiliary up-and-down line mechanism; the drone main body consists of a propeller and a set-top box;
[0088] The control terminal is used to detect the operating status of each first component on the drone. When the operating status of each first component is normal, the drone is controlled to drop the auxiliary up-and-down line mechanism onto the target transmission line, and the drone is controlled to return to the ground after the drop is completed; the operating status of each second component on the live working robot is detected. When the operating status of each second component is normal, the live working robot is controlled to embed the insulating rope lowered by the auxiliary up-and-down line mechanism into the reel mechanism of the up-and-down line mechanism; the live working robot is controlled to start the reel mechanism to perform the first online operation until the live working robot reaches the equipotential safety distance, and the equipotential arm of the live working robot is controlled to perform the potential transfer operation at the equipotential safety distance; when the potential transfer operation is completed, the live working robot is controlled to perform the second online operation until the robot online task is completed, and the live working robot is controlled to start the inspection operation.
[0089] To further explain, the live working robot also includes a three-loop control unit for the robot posture, such as Figure 7 As shown in the figure, the inner loop attitude control is the anti-disturbance attitude control, and the outer loop position control is the anti-disturbance position control. and yaw angle Then, the position loop anti-disturbance controller outputs three virtual control quantities: , , ,
[0090] (1)
[0091] (2)
[0092] Then, we can inversely solve equation (1) and equation (2) to obtain:
[0093] (3)
[0094] (4)
[0095] (5)
[0096] (6)
[0097] In this way, the desired attitude command output by the outer loop position controller is obtained. In order to reduce the impact of load swing on robot control, the robot attitude data information is obtained through IMU (Inertial Measurement Unit), and the robot's desired attitude angle is corrected using this information to reduce the impact of robot swing on the UAV system. For the robot's three-dimensional spherical swing, the impact of the robot's swing on the attitude can be obtained according to the Lagrange equation:
[0098] (7)
[0099] (8)
[0100] in, , , is the effect of the robot's swing on the UAV's acceleration. For the UAV-robot system, , , taking the pitch angle channel as an example, assume the Lyapunov function:
[0101] (9)
[0102] Taking its derivative we get:
[0103] (10)
[0104] When formula (10) is negative, we have:
[0105] (11)
[0106] in, is the parameter to be adjusted, so we have:
[0107] (12)
[0108] in, is an intermediate variable. Define the error:
[0109] (13)
[0110] As the robot swings, , taking the derivative of formula (13) and combining it with formula (8), we can get:
[0111] (14)
[0112] Assume the Lyapunov function:
[0113] (15)
[0114] Taking its derivative we get:
[0115] (16)
[0116] set up ,in is the parameter to be adjusted, so we can get:
[0117] (17)
[0118] (18)
[0119] According to the relationship between the robot acceleration and attitude angle:
[0120] (19)
[0121] So the expected pitch angle correction value of the robot is solved:
[0122] (20)
[0123] Similarly, the expected roll angle correction value of the robot can be solved:
[0124] (twenty one)
[0125] In one embodiment, Figure 8 As shown, a control method for UAV-robot joint operation in a specific embodiment is provided, which specifically includes the following steps:
[0126] Step S801, detect the operating status of each first component on the drone. When the operating status of each first component is normal, respond to the control command for the drone and control the drone to fly to a preset position above the target transmission line; control the drone to release the drone gripper to release the auxiliary up and down line mechanism to be dropped onto the target transmission line, and control the drone to return to the ground after the release is completed.
[0127] Step S802, detecting the operating status of each second component on the live working robot, and when the operating status of each second component is normal, controlling the live working robot to embed the insulating rope lowered by the auxiliary upper and lower line mechanism into the reel mechanism of the upper and lower line mechanism.
[0128] Step S803, control the live working robot to start the winding mechanism to perform the first online operation, and obtain the target distance data measured by the binocular camera in real time; determine whether the live working robot has reached the equipotential safety distance based on the target distance data; when the live working robot has reached the equipotential safety distance, control the live working robot to stop the first online operation, and control the equipotential arm of the live working robot to perform a potential transfer operation at the equipotential safety distance.
[0129] Step S804, when the potential transfer operation is completed, control the live working robot to proceed to the target transmission line, and stop the second online operation when the walking wheel at the upper end of the walking arm of the live working robot is higher than the target transmission line; control the live working robot to adjust the walking arm to be perpendicular to the target transmission line, lower the live working robot after aligning it with the target transmission line, control the tensioning wheel of the live working robot to rise to a preset position, and control the live working robot to start inspection operations.
[0130] Step S805, during the process of the live working robot performing the first online operation and the second online operation, the posture data corresponding to the live working robot collected by the posture sensor is obtained in real time; based on the posture data, it is determined whether the live working robot is in an unbalanced state; when the live working robot is in an unbalanced state, the posture of the live working robot is adjusted to make the live working robot in a balanced state.
[0131] The beneficial effects brought by the above embodiments are as follows:
[0132] By using drones and robots to replace manual operations, the inefficient and dangerous process of manual live-line operations is avoided and the safety risks of operations are reduced. While enabling the live-line working robots to flexibly go online and offline, the deviation of the live-line working robots during the online and offline processes can also be reduced, thereby improving the efficiency and reliability of transmission line maintenance and inspection operations.
[0133] It should be understood that, although the various steps in the flowcharts involved in the above-mentioned embodiments are displayed in sequence according to the indication of the arrows, these steps are not necessarily executed in sequence according to the order indicated by the arrows. Unless there is a clear explanation in this article, the execution of these steps does not have a strict order restriction, and these steps can be executed in other orders. Moreover, at least a part of the steps in the flowcharts involved in the above-mentioned embodiments can include multiple steps or multiple stages, and these steps or stages are not necessarily executed at the same time, but can be executed at different times, and the execution order of these steps or stages is not necessarily to be carried out in sequence, but can be executed in turn or alternately with other steps or at least a part of the steps or stages in other steps.
[0134] Based on the same inventive concept, the embodiment of the present application also provides a control device for UAV-robot joint operation for implementing the control method for UAV-robot joint operation involved above. The implementation scheme for solving the problem provided by the device is similar to the implementation scheme recorded in the above method, so the specific limitations in the embodiments of one or more UAV-robot joint operation control devices provided below can refer to the limitations of the control method for UAV-robot joint operation above, and will not be repeated here.
[0135] In an exemplary embodiment, Fig. 9 As shown, a control device for a drone-robot joint operation is provided, comprising:
[0136] The first control module 901 is used to detect the operating status of each first component on the drone, and when the operating status of each first component is normal, control the drone to place the auxiliary line-up and down-line mechanism on the target transmission line, and control the drone to return to the ground after the placement is completed;
[0137] The second control module 902 is used to detect the operating status of each second component on the live working robot, and when the operating status of each second component is normal, control the live working robot to embed the insulating rope lowered by the auxiliary upper and lower wire mechanism into the reel mechanism of the upper and lower wire mechanism;
[0138] The third control module 903 is used to control the live working robot to start the reel mechanism to perform the first online operation until the live working robot reaches the equipotential safety distance, and control the equipotential arm of the live working robot to perform a potential transfer operation at the equipotential safety distance;
[0139] The fourth control module 904 is used to control the live working robot to perform a second online operation when the potential transfer operation is completed until the robot online task is completed, and control the live working robot to start an inspection operation.
[0140] In one embodiment, the first control module 901 is also used to respond to control instructions for the drone, control the drone to fly to a preset position above the target transmission line; control the drone to release the drone claws for delivery, so that the auxiliary up and down line mechanism is delivered to the target transmission line; the auxiliary up and down line mechanism lowers the insulating rope by adjusting the reverse buckle device.
[0141] In one embodiment, the third control module 903 is also used to control the live working robot to start the reel mechanism to perform the first online operation, and obtain the target distance data measured by the binocular camera in real time; based on the target distance data, determine whether the live working robot has reached the equipotential safety distance; when the live working robot has reached the equipotential safety distance, control the live working robot to stop the first online operation.
[0142] In one embodiment, the fourth control module 904 is also used to control the live working robot to perform a second online operation until the walking wheel at the upper end of the walking arm of the live working robot is higher than the target transmission line; control the live working robot to adjust the walking arm to be perpendicular to the target transmission line, lower the live working robot after aligning it with the target transmission line, and control the tensioning wheel of the live working robot to rise to a preset position.
[0143] In one embodiment, the control device for the joint operation of the drone and the robot also includes a posture adjustment module, which is used to obtain in real time the posture data corresponding to the live working robot collected by the posture sensor during the process of the live working robot performing the first online operation and the second online operation; based on the posture data, determine whether the live working robot is in an unbalanced state; when the live working robot is in an unbalanced state, adjust the posture of the live working robot to make the live working robot in a balanced state.
[0144] Each module in the control device for the above-mentioned UAV-robot joint operation can be implemented in whole or in part by software, hardware, or a combination thereof. Each of the above-mentioned modules can be embedded in or independent of the processor in the computer device in the form of hardware, or can be stored in the memory of the computer device in the form of software, so that the processor can call and execute the operations corresponding to each of the above modules.
[0145] In an exemplary embodiment, a computer device is provided, which may be a control terminal, and its internal structure diagram may be shown in FIG10. The computer device includes a processor, a memory, an input / output interface, a communication interface, a display unit, and an input device. The processor, the memory, and the input / output interface are connected via a system bus, and the communication interface, the display unit, and the input device are connected to the system bus via the input / output interface. The processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The input / output interface of the computer device is used to exchange information between the processor and an external device. The communication interface of the computer device is used to communicate with an external terminal in a wired or wireless manner, and the wireless manner may be implemented through WIFI, a mobile cellular network, near field communication (NFC) or other technologies. When the computer program is executed by the processor, a control method for a drone-robot joint operation is implemented. The display unit of the computer device is used to form a visually visible picture, which may be a display screen, a projection device, or a virtual reality imaging device. The display screen can be a liquid crystal display screen or an electronic ink display screen, and the input device of the computer device can be a touch layer covering the display screen, or a button, trackball or touchpad set on the computer device shell, or an external keyboard, touchpad or mouse.
[0146] Those skilled in the art will understand that the structure shown in FIG. 10 is merely a block diagram of a partial structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than shown in the figure, or combine certain components, or have a different arrangement of components.
[0147] In one embodiment, a computer device is further provided, including a memory and a processor, wherein a computer program is stored in the memory, and the processor implements the steps in the above method embodiments when executing the computer program.
[0148] In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the steps in the above-mentioned method embodiments are implemented.
[0149] In one embodiment, a computer program product is provided, including a computer program, which implements the steps in the above method embodiments when executed by a processor.
[0150] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with relevant regulations.
[0151] A person of ordinary skill in the art can understand that all or part of the processes in the above-mentioned embodiment method can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to the memory, database or other medium used in the embodiments provided in the present application can include at least one of non-volatile memory and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. As an illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM). The database involved in each embodiment provided in this application may include at least one of a relational database and a non-relational database. Non-relational databases may include distributed databases based on blockchains, etc., but are not limited to this. The processor involved in each embodiment provided in this application may be a general-purpose processor, a central processing unit, a graphics processor, a digital signal processor, a programmable logic device, a data processing logic device based on quantum computing, an artificial intelligence (AI) processor, etc., but are not limited to this.
[0152] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this application.
[0153] The above-described embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the present application. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the attached claims.
Claims
1. A control method for UAV-robot joint operation, characterized in that: Applied to a control terminal, the method comprises: Detecting the operating status of each first component on the drone, and when the operating status of each first component is normal, controlling the drone to place the auxiliary line-in / line-out mechanism onto the target transmission line, and controlling the drone to return to the ground after the placement is completed; Detecting the operating status of each second component on the live working robot, and when the operating status of each second component is normal, controlling the live working robot to embed the insulating rope lowered by the auxiliary upper and lower wire mechanism into the reel mechanism of the upper and lower wire mechanism; Control the live working robot to start the reel mechanism to perform a first online operation until the live working robot reaches an equipotential safety distance, and control the equipotential arm of the live working robot to perform a potential transfer operation at the equipotential safety distance; When the potential transfer operation is completed, the live working robot is controlled to perform a second online operation until the robot online task is completed, and the live working robot is controlled to start an inspection operation.
2. The method according to claim 1, characterized in that The controlling the drone to place the auxiliary line-in and line-out mechanism onto the target transmission line includes: In response to a control instruction for the UAV, controlling the UAV to fly to a preset position above the target power transmission line; The drone is controlled to release the drone claw for delivery, so that the auxiliary up-and-down line mechanism is delivered to the target transmission line; the auxiliary up-and-down line mechanism lowers the insulating rope by adjusting the reverse buckle device.
3. The method according to claim 1, characterized in that The controlling the live working robot to start the reel mechanism to perform a first online operation until the live working robot reaches an equipotential safety distance includes: Controlling the live working robot to start the reel mechanism to perform the first online operation, and obtaining target distance data measured by a binocular camera in real time; According to the target distance data, determining whether the live working robot has reached the equipotential safety distance; When the live working robot reaches the equipotential safety distance, the live working robot is controlled to stop the first online operation.
4. The method according to claim 1, characterized in that: The controlling the live working robot to perform a second online operation until the robot online task is completed includes: Controlling the live-line working robot to perform the second on-line operation until the upper end walking wheel of the walking arm of the live-line working robot is higher than the target power transmission line; The live working robot is controlled to adjust the walking arm to be perpendicular to the target transmission line, the live working robot is lowered after being aligned with the target transmission line, and the tensioning wheel of the live working robot is controlled to rise to a preset position.
5. The method according to any one of claims 1 to 4, characterized in that: The method further comprises: During the process of the live-working robot performing the first online operation and the second online operation, acquiring in real time posture data corresponding to the live-working robot collected by a posture sensor; According to the posture data, determining whether the live working robot is in an unbalanced state; When the live-line working robot is in the unbalanced state, the posture of the live-line working robot is adjusted so that the live-line working robot is in a balanced state.
6. A control system for UAV-robot joint operation, characterized in that: The system comprises: a live-line working robot, a drone and a control terminal; the control terminal is respectively connected to the live-line working robot and the drone for communication; the live-line working robot comprises a walking mechanism, an operating mechanism, a potential transfer mechanism and an up-and-down line mechanism; the up-and-down line mechanism comprises a reel mechanism, a reciprocating rotating assembly, a worm gear reduction assembly and a guide roller assembly; the drone comprises a drone main body, a drone gripper and an auxiliary up-and-down line mechanism; the drone main body consists of a propeller and a set-top box; The control terminal is used to detect the operating status of each first component on the drone, and when the operating status of each first component is normal, control the drone to drop the auxiliary up-and-down line mechanism onto the target transmission line, and control the drone to return to the ground after the dropping is completed; detect the operating status of each second component on the live working robot, and when the operating status of each second component is normal, control the live working robot to embed the insulating rope lowered by the auxiliary up-and-down line mechanism into the reel mechanism of the up-and-down line mechanism; control the live working robot to start the reel mechanism to perform a first online operation until the live working robot reaches the equipotential safety distance, and control the equipotential arm of the live working robot to perform a potential transfer operation at the equipotential safety distance; when the potential transfer operation is completed, control the live working robot to perform a second online operation until the robot online task is completed, and control the live working robot to start an inspection operation.
7. A control device for UAV-robot joint operation, characterized in that: Applied to a control terminal, the device comprises: The first control module is used to detect the operating status of each first component on the drone, and when the operating status of each first component is normal, control the drone to place the auxiliary line-in and line-out mechanism on the target transmission line, and control the drone to return to the ground after the placement is completed; a second control module, for detecting the operating status of each second component on the live working robot, and controlling the live working robot to embed the insulating rope lowered by the auxiliary upper and lower line mechanism into the reel mechanism of the upper and lower line mechanism when the operating status of each second component is normal; A third control module is used to control the live working robot to start the reel mechanism to perform a first online operation until the live working robot reaches an equipotential safety distance, and control the equipotential arm of the live working robot to perform a potential transfer operation at the equipotential safety distance; The fourth control module is used to control the live working robot to perform a second online operation when the potential transfer operation is completed until the robot online task is completed, and control the live working robot to start an inspection operation.
8. A computer device comprising a memory and a processor, wherein the memory stores a computer program, wherein: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 5 are implemented.
9. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 5 are implemented.
10. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 5 are implemented.
