Aerial work aircraft system and control method thereof
By supplementing environmental information and data processors with the aircraft to generate instructions, the problem of insufficient perception capabilities of air-operated aircraft is solved, the reliability and accuracy of operations are improved, energy consumption and weight are reduced, and operation efficiency and safety are enhanced.
Patent Information
- Application Number
- CN201910194297.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2019-03-14
- Publication Date
- 2024-12-03
- Estimated Expiration
- 2039-03-14
AI Technical Summary
Existing aerial operation aircraft find it difficult to fully sense the surrounding environment during high-voltage line detection, resulting in high risk of collision and fall, and relying on manual operations to pose safety risks.
The accompanying aircraft is used to obtain supplementary environmental information in the blind spot of the operating aircraft field, and generate operation instructions through the data processor to control the aircraft to avoid obstacles or perform tasks, which reduces the burden on the aircraft's own sensors and improves environmental perception capabilities.
It realizes the aircraft's comprehensive perception of the surrounding environment, improves the reliability and accuracy of operations, reduces energy consumption and overall weight, and enhances operating efficiency and safety.
Smart Images

Figure CN109739265B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of aerial work equipment, and more specifically, to an aerial work aircraft system. In addition, the present invention also relates to a control method applied to the aerial work aircraft system. Background Art
[0002] With the rapid development of public facilities, the number of aerial work tasks and frequencies are increasing. For example, in high-voltage line inspection, according to the requirements of the power industry, the insulation performance of the insulation terminals must be measured every 6 years. There are about 7 million high-voltage towers in the country, so the frequency and repeatability of high-voltage line inspection operations are relatively high.
[0003] In the prior art, two methods, manual operation and remote control operation, are usually used to measure the zero value of the insulation terminal on the high-voltage line.
[0004] Manual operation is the mainstream operation method in the industry. Professional workers carry detection equipment, climb up the transmission tower, and use handheld measuring equipment to measure the insulation performance of the insulated terminal. However, manual operation has high labor costs, low operation efficiency, high risks of high-altitude operation, and manual operation is usually carried out when the high-voltage transmission line is energized, so the safety of the workers cannot be well guaranteed.
[0005] Remote control operation means that the operator controls the drone remotely and performs the operation through the first-person perspective provided by the camera on the drone and the communication link between the drone and the ground. In this operation mode, the operator observes the surrounding environment of the drone with the naked eye, controls the drone to avoid obstacles, and obtains relevant information about the operation object through the first-person perspective to assist the operator in the operation.
[0006] Although compared with manual operations, remote control operations ensure the safety of workers and improve work efficiency to a certain extent, due to the limited visual range of the human eye, it is impossible to observe the surrounding environment of the aircraft from multiple angles, and there is a certain delay in the first-person perspective data obtained. Therefore, operators cannot operate effectively, and the requirements for operators to control the aircraft are very high.
[0007] Moreover, currently remote control operations usually use a single aircraft to operate alone, and various sensors installed on the operating aircraft itself collect data and melt the data to avoid obstacles. Since the onboard sensors are limited by factors such as the load capacity, spatial dimensions and blind spots of the aerial operating aircraft, they are often unable to perceive the surrounding environment of the operating aircraft well during operation. Therefore, when working near or inside complex power transmission towers, due to the limited space and complex environment of the operating environment, the aerial operating aircraft is prone to contact and collision with obstacles in the surrounding environment, resulting in the inability to complete the operation content, and even the risk of collision and falling.
[0008] In summary, how to provide an aerial work aircraft system that can fully perceive the surrounding environment of the work aircraft to avoid collision and fall is a problem that needs to be urgently solved by those skilled in the art. Summary of the invention
[0009] In view of this, an object of the present invention is to provide an aerial work aircraft system and a control method thereof, so as to better perceive the surrounding environment information of the work aircraft, so that the work aircraft can reliably avoid obstacles or work accurately.
[0010] In order to achieve the above object, the present invention provides the following technical solutions:
[0011] An aerial work aircraft system, comprising:
[0012] At least one accompanying aircraft, used to obtain supplementary environmental information within the blind spot of the operating aircraft;
[0013] a data processor having a data connection with the accompanying aircraft, and configured to generate an operation instruction according to the supplementary environmental information;
[0014] The operation aircraft having a data connection with the data processor is used to perform aerial operations on the operation object or avoid obstacles according to the operation instructions.
[0015] Preferably, the data processor is disposed in the operating aircraft or the accompanying aircraft.
[0016] Preferably, it further comprises a ground station, and the data processor is arranged at the ground station.
[0017] Preferably, it further comprises a ground station, and the number of the data processors is three, which are respectively arranged in the operating aircraft, the accompanying aircraft and the ground station;
[0018] The ground station is also provided with an instruction generation switching device connected to the three data processors, which is used to enable the three data processors to switch to work one by one.
[0019] Preferably, when the number of the accompanying aircraft is one, the accompanying aircraft has at least one designated posture, so as to obtain the supplementary environmental information within the blind spot of the working aircraft's field of view corresponding to the accompanying aircraft in each designated posture.
[0020] Preferably, the work aircraft is provided with a visual marker, and the companion aircraft is provided with a positioning visual sensor for detecting the visual marker to obtain the relative position and posture of the companion aircraft and the work aircraft.
[0021] Preferably, the working aircraft is provided with a first visual sensor for obtaining the position information of the working object and monitoring the working status of the working aircraft; the supplementary environmental information is the information within the blind spot of the field of view of the first visual sensor, and the accompanying aircraft is provided with a second visual sensor for obtaining the supplementary environmental information.
[0022] Preferably, the positioning vision sensor and the second vision sensor are the same vision sensor.
[0023] A control method for an aerial work aircraft system, applied to any of the above-mentioned aerial work aircraft systems, comprising:
[0024] Use the accompanying aircraft to obtain supplementary environmental information within the blind spot of the operating aircraft;
[0025] Using a data processor to process the supplementary environmental information and generate a job instruction;
[0026] The operation aircraft is controlled according to the operation instruction to perform aerial operations on the operation object or avoid obstacles.
[0027] Preferably, the step of using the accompanying aircraft to obtain the supplementary environmental information within the blind spot of the operating aircraft includes:
[0028] Controlling the accompanying aircraft to adjust its posture to a specified posture;
[0029] Acquire supplementary environmental information within a blind spot of the operating aircraft's field of view corresponding to the accompanying aircraft at the designated posture.
[0030] Preferably, before controlling the accompanying aircraft to adjust the posture to a specified posture, the method includes:
[0031] The relative position and posture of the operating aircraft and the accompanying aircraft are obtained.
[0032] Preferably, the obtaining of the relative position and posture of the operating aircraft and the accompanying aircraft includes:
[0033] The relative position and posture is obtained by detecting visual marking information on the working aircraft by the accompanying aircraft;
[0034] Alternatively, when the aerial work aircraft system includes a ground station, the relative position and posture is calculated by using the real-time position coordinates of the work aircraft and the accompanying aircraft received by the ground station.
[0035] Preferably, the using of a data processor to process the supplementary environmental information and generate an operation instruction; and controlling the operation aircraft to perform aerial operations on the operation object or avoid obstacles according to the operation instruction, comprises:
[0036] When the data processor is provided in the working aircraft, the working aircraft uses the data processor to process the supplementary environmental information and generate working instructions, and the working aircraft performs aerial work on the working object or avoids obstacles according to the working instructions;
[0037] When the data processor is provided in the accompanying aircraft, the accompanying aircraft uses the data processor to perform data processing on the supplementary environmental information and generate an operation instruction, the accompanying aircraft transmits the operation instruction to the operation aircraft, and the operation aircraft performs aerial operations on the operation object or avoids obstacles according to the operation instruction;
[0038] When a ground station is further included and the data processor is arranged at the ground station, the ground station uses the data processor to perform data processing on the supplementary environmental information and generate an operation instruction, the ground station transmits the operation instruction to the operation aircraft, and the operation aircraft performs aerial operations on the operation object or avoids obstacles according to the operation instruction;
[0039] When it also includes a ground station and an instruction generation switching device arranged at the ground station, and the number of the data processors is three, which are respectively arranged at the working aircraft, the accompanying aircraft and the ground station, the instruction generation switching device enables the three data processors to selectively process the supplementary environmental information and generate working instructions, so that the working aircraft, the accompanying aircraft and the ground station switch to control the working aircraft to perform aerial operations on the working object or avoid obstacles.
[0040] The aerial work aircraft system and control method thereof provided by the present invention adopt at least one accompanying aircraft to obtain supplementary environmental information within the blind spot of the working aircraft's field of view, so as to make up for the defect of the working aircraft's own limited field of view, thereby obtaining the full amount of environmental information around the working aircraft, so that the working aircraft can perform operations based on the full amount of environmental information around it, such as avoiding obstacles or performing aerial work tasks on the working object.
[0041] Compared to the technical solutions in the prior art that rely on the working aircraft to work alone, the aerial working aircraft system provided by the present invention can fully perceive the surrounding environment of the working aircraft, solving the technical problems of the limited perception ability of the working aircraft and the limited field of vision of the ground operators in the prior art. Moreover, compared to observing the surrounding environment of the working aircraft through the naked eyes of the ground operators, the accompanying aircraft can observe in the safe area near the working aircraft, and can more comprehensively understand the working position and collision risk of the working aircraft. Therefore, the defects of the blind spots and field of vision of the working aircraft itself are compensated, and the obstacle information and detailed location information of the working object in the blind spots of the field of vision of the working aircraft can be obtained, so that the working aircraft can reliably avoid obstacles or operate more accurately, thereby improving the reliability and accuracy of the working aircraft.
[0042] At the same time, it avoids the operation aircraft itself from carrying too many sensors and corresponding processors, reduces the overall weight of the operation aircraft, reduces the energy consumption of the operation aircraft, and improves the operation performance and work efficiency of the operation aircraft. BRIEF DESCRIPTION OF THE DRAWINGS
[0043] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on the provided drawings without paying creative work.
[0044] Figure 1 This is a structural block diagram of a specific embodiment 1 of the aerial work aircraft system provided by the present invention;
[0045] Figure 2 This is a structural block diagram of a specific embodiment 2 of the aerial work aircraft system provided by the present invention;
[0046] Figure 3 This is a structural block diagram of a specific embodiment 3 of the aerial work aircraft system provided by the present invention;
[0047] Figure 4 It is a structural block diagram of a fourth specific embodiment of the aerial work aircraft system provided by the present invention;
[0048] Figure 5 It is a structural block diagram of a specific embodiment 5 of the aerial work aircraft system provided by the present invention;
[0049] Figure 6 A schematic diagram of a specific embodiment of the aerial work aircraft system provided by the present invention;
[0050] Figure 7A flowchart of a specific embodiment 1 of the control method of the aerial work aircraft system provided by the present invention;
[0051] Figure 8 This is a flow chart of a specific embodiment 2 of the control method of the aerial work aircraft system provided by the present invention;
[0052] Fig. 9 for Figure 5 Schematic diagram of the data processor performing coordinate transformation according to the information collected by the second visual sensor.
[0053] Figures 1 to 9 The reference numerals in the figures are as follows:
[0054] 1 is the operating aircraft, 2 is the accompanying aircraft, and 3 is the ground station. DETAILED DESCRIPTION
[0055] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
[0056] The core of the present invention is to provide an aerial work aircraft system and a control method thereof, so as to better perceive the surrounding environment information of the work aircraft, so that the work aircraft can reliably avoid obstacles or work accurately.
[0057] Please refer to Figure 1-Figure 9 , Figure 1 This is a structural block diagram of a specific embodiment 1 of the aerial work aircraft system provided by the present invention; Figure 2 It is a structural block diagram of a specific embodiment 2 of an aerial work aircraft system; Figure 3 It is a structural block diagram of a specific embodiment 3 of an aerial work aircraft system; Figure 4 It is a structural block diagram of a fourth specific embodiment of an aerial work aircraft system; Figure 5 It is a structural block diagram of a specific embodiment 5 of an aerial work aircraft system; Figure 6 A schematic diagram of an aerial work aircraft system; Figure 7 A flowchart of a specific embodiment 1 of a control method for an aerial work aircraft system; Figure 8 It is a flow chart of a specific embodiment 2 of the control method of the aerial work aircraft system; Fig. 9 for Figure 5 Schematic diagram of the data processor performing coordinate transformation according to the information collected by the second visual sensor.
[0058] The present invention provides an aerial work aircraft system, comprising an aerial work aircraft 1 for performing an aerial work task and an accompanying aircraft 2 for assisting the aerial work aircraft 1 in completing the aerial work task. The main structures of the aerial work aircraft 1 and the accompanying aircraft 2 refer to conventional aircraft structures in the prior art, and the present invention does not specifically limit them.
[0059] Preferably, the operating aircraft 1 and the accompanying aircraft 2 perform signal transmission and data transmission via wireless communication.
[0060] The work aircraft 1 and the accompanying aircraft 2 can be independent of each other, and their routes and flights can be controlled separately. Of course, the work aircraft 1 and the accompanying aircraft 2 can also be connected by a connecting piece, so that the accompanying aircraft 2 and the work aircraft 1 can fly synchronously through the traction of the connecting piece. The present invention does not limit the specific structure of the connecting piece. For example, the connecting piece can be a rope, a cable or other mechanical connection structure, as long as it can achieve the connection between the work aircraft 1 and the accompanying aircraft 2.
[0061] Preferably, the companion aircraft 2 is a tethered UAV, and is connected to the working aircraft 1 via a tethered cable. Through the traction of the tethered cable, the companion aircraft 2 can synchronously follow the working aircraft 1 to ensure that the working aircraft 1 and the companion aircraft 2 fly synchronously to the target working area. The control is simple and easy to implement.
[0062] In addition, considering that the companion aircraft 2 is only responsible for assistance and does not perform work tasks, and its functions are relatively simple, therefore, preferably, the companion aircraft 2 is provided with a power supply device for powering the work aircraft 1, and the work aircraft 1 is provided with a power module. The power module of the work aircraft 1 is connected to the power supply device of the companion aircraft 2 through a tethered cable, so as to power the work aircraft 1 through the companion aircraft 2, thereby increasing the work time of the work aircraft 1. As the main body of the aerial work, the work aircraft 1 is preferably equipped with a mechanical arm for performing work operations.
[0063] In order to facilitate the work aircraft 1 to perform aerial work tasks, the work aircraft 1 is usually equipped with sensors for collecting information about its surrounding environment. The present invention refers to the information obtained by the work aircraft 1's own sensors as basic environmental information, that is, the environmental information within the field of view of the work aircraft 1.
[0064] However, due to the limitation of the load weight of the working aircraft 1 itself, there are certain blind spots in the field of vision of the working aircraft 1 itself.
[0065] In order to obtain more comprehensive environmental information around the operating aircraft 1, the main improvement of the present invention is to use at least one accompanying aircraft 2 to obtain supplementary environmental information within the blind spot of the operating aircraft 1 to make up for the defect of the limited field of vision of the operating aircraft 1 itself, thereby obtaining the full amount of environmental information around the operating aircraft 1, so that the operating aircraft 1 can perform operations based on the full amount of environmental information around it, such as avoiding obstacles or performing aerial work tasks on the operating object.
[0066] The blind spot here mainly refers to the area that cannot be observed by the working aircraft 1, for example, the area outside the field of vision of the working aircraft 1, or the area that cannot be observed due to the obstruction of the working aircraft 1's working actuator (such as a robotic arm).
[0067] The present invention refers to the information in the blind spot of the working aircraft 1 obtained by the accompanying aircraft 2 as supplementary environmental information, and the basic environmental information and the supplementary environmental information form the full amount of environmental information around the working aircraft 1. The basic environmental information and the supplementary environmental information each include the location information of obstacles and / or the location information of the working object.
[0068] It should be noted that when the operating aircraft 1 is operating in an environment with a large operating range, open airspace, or the operating object is relatively prominent and easy to observe, the operating aircraft 1 can perform decision-making operations based on the operating instructions generated by the basic environmental information within its field of view.
[0069] For example, when the working aircraft 1 detects an obstacle in the basic environmental information, it obtains the position coordinates of the obstacle, and according to its relative posture with the obstacle, controls its position in the air through its own flight control system and positioning device to stay away from the obstacle.
[0070] When the work aircraft 1 detects the work object in the basic environmental information, it obtains the position coordinates of the work object, and then flies to the work object through its own flight control system and positioning device to perform work operations.
[0071] However, when the working aircraft 1 is working in a complex environment with a narrow working range, many airspace obstacles or a relatively hidden working object, the accompanying aircraft 2 is required to assist the working aircraft 1 in completing the aerial working task. That is, the working aircraft 1 needs to be controlled to avoid obstacles or perform working operations based on the supplementary environmental information obtained by the accompanying aircraft 2.
[0072] Considering the feasibility of obtaining information by the working aircraft 1 and the accompanying aircraft 2, preferably, the working aircraft 1 is provided with a first visual sensor for obtaining the position information of the working object, and the accompanying aircraft 2 is provided with a second visual sensor for obtaining the supplementary environmental information in the blind spot of the first visual sensor. That is, in this embodiment, the visual range of the first visual sensor is the visual range of the working aircraft 1, the information collected by the first visual sensor is the basic environmental information in the visual range of the working aircraft 1, and the information collected by the second visual sensor is the supplementary environmental information in the blind spot of the visual range of the working aircraft 1.
[0073] Preferably, the first visual sensor is a working camera, and the second visual sensor is a depth camera.
[0074] It is understandable that the first visual sensor is also used to monitor the operating status of the operating aircraft 1, for example, whether the operating execution mechanism (such as a robotic arm) of the operating aircraft 1 is in place, and whether the operating execution mechanism (such as a robotic arm) accurately performs the operating action.
[0075] The aerial work vehicle system also includes a data processor for performing data processing on the supplemental environmental information and generating work instructions.
[0076] The data processor establishes a data connection with the accompanying aircraft 2 to achieve data transmission between the data processor and the accompanying aircraft 2 , so that the data processor receives the supplementary environmental information sent by the accompanying aircraft 2 .
[0077] A data connection is established between the data processor and the operation aircraft 1 to realize data transmission between the data processor and the operation aircraft 1 , so that the data processor sends the operation instructions generated by it to the operation aircraft 1 .
[0078] Preferably, the operating aircraft 1 and the accompanying aircraft 2 are respectively provided with communication modules, and the operating aircraft 1 and the accompanying aircraft 2 are respectively connected to the data processor via their respective communication modules.
[0079] It should be noted that the present invention does not limit the specific location of the data processor, and the data processor can be set on the operating aircraft 1, or on the accompanying aircraft 2, and of course can also be set on other carriers, such as the ground station 3. As long as the data processor can transmit data with the operating aircraft 1 and the accompanying aircraft 2 respectively, and can generate an operation instruction for guiding the operation of the operating aircraft 1 according to the supplementary environmental information sent by the accompanying aircraft 2, it will be sufficient.
[0080] When the data processor is installed in the working aircraft 1, the accompanying aircraft 2 sends the supplementary environmental information it detects to the working aircraft 1, and the working aircraft 1 processes and calculates the supplementary environmental information it receives and generates working instructions. Then, the working aircraft 1 directly controls the flight control system of the working aircraft 1 to adjust the posture of the working aircraft 1 according to the working instructions generated by itself, so that the working aircraft 1 can avoid obstacles or perform aerial working tasks on the working objects.
[0081] It can be seen that when this solution is adopted, only one data transmission is required between the operation aircraft 1 and the accompanying aircraft 2, and the distance between the operation aircraft 1 and the accompanying aircraft 2 is relatively close, so the operation aircraft 1 can perform operations in a timely manner. However, since the data processor is arranged on the operation aircraft 1 and the operation aircraft 1 performs data processing and calculation, the load weight and power consumption of the operation aircraft 1 are increased.
[0082] It should be noted that when the data processor is provided in the work aircraft 1, the data processor may be a central processor of the work aircraft 1 itself, that is, the central processor of the work aircraft 1 is responsible for processing the supplementary environmental information; of course, the data processor may also be a data processing module connected to the central processor of the work aircraft 1. The central processor of the work aircraft 1 is also used to process the basic environmental information and generate an operation instruction for controlling the work aircraft 1 to adjust its posture.
[0083] When the data processor is installed in the companion aircraft 2, the companion aircraft 2 first processes and calculates the supplementary environmental information detected by itself and generates an operation instruction. Then, the companion aircraft 2 sends the generated operation instruction to the operation aircraft 1 to control the operation aircraft 1 to avoid obstacles or perform aerial operation tasks on the operation object.
[0084] That is to say, this solution uses the companion aircraft 2 to directly control the working aircraft 1 to complete obstacle avoidance or local operations, that is, at this time, the flight control system of the working aircraft 1 is directly taken over by the companion aircraft 2.
[0085] When this solution is adopted, since the data processing and calculation work is completed by the accompanying aircraft 2, the load weight and power consumption of the operating aircraft 1 are reduced.
[0086] It should be noted that when the data processor is installed in the companion aircraft 2, the data processor can be the central processing unit of the companion aircraft 2 itself, that is, the central processing unit of the companion aircraft 2 is responsible for processing the supplementary environmental information; of course, the data processor can also be a data processing module connected to the central processing unit of the companion aircraft 2.
[0087] In another preferred embodiment, a ground station 3 is further included, and a data processor is arranged at the ground station 3 .
[0088] Specifically, the companion aircraft 2 sends the supplementary environmental information it obtains to the ground station 3. The ground station 3 processes and calculates the supplementary environmental information it receives, and sends the generated operation instructions to the operation aircraft 1 to control the operation aircraft 1 to avoid obstacles or perform aerial operation tasks on the operation object.
[0089] That is to say, this solution uses the ground station 3 to directly control the operating aircraft 1 to complete obstacle avoidance or local operations. At this time, the flight control system of the operating aircraft 1 is directly taken over by the ground operator of the ground station 3 to manually control the operating aircraft 1.
[0090] It is understandable that the ground station 3 is also used to send aerial work tasks to the work aircraft 1 and monitor the work status of the work aircraft 1. At the same time, the work aircraft 1 and the accompanying aircraft 2 transmit their respective coordinate positions to the ground station 3 in real time, and display them on the display screen of the ground station 3, so that the operator of the ground station 3 can perform monitoring operations.
[0091] It should be noted that when the data processor is arranged in the ground station 3, the data processor may be the central processor of the ground station 3, that is, the central processor of the ground station 3 is responsible for processing the supplementary environmental information; of course, the data processor may also be a data processing module connected to the central processor of the ground station.
[0092] When this solution is adopted, two long-distance data transmissions are required, resulting in serious operation delays. However, the ground station 3 is responsible for data processing and calculation, which can reduce the load weight and power consumption of the operating aircraft 1 and the accompanying aircraft 2. At the same time, the ground station 3 can monitor the operating conditions of the operating aircraft 1 and the accompanying aircraft 2 in real time, with high reliability.
[0093] Taking into account the flexibility and diversity of the control methods, the reliability and safety of the working aircraft 1 are ensured while improving the working efficiency of the working aircraft 1. In another preferred solution, a ground station 3 is also included, and the number of data processors is three, which are respectively arranged in the working aircraft 1, the accompanying aircraft 2 and the ground station 3; the ground station 3 is also provided with an instruction generation switching device, which is respectively connected to the three data processors for enabling the three data processors to switch to work one by one.
[0094] That is, the operating aircraft 1, the accompanying aircraft 2 and the ground station 3 can all control the flight control system of the operating aircraft 1 to adjust the posture of the operating aircraft 1, and control the three to selectively send operating instructions to the flight control system of the operating aircraft 1 through the instruction generation switching device.
[0095] In this solution, the three data processors may be the central processors of the operating aircraft 1 , the accompanying aircraft 2 and the ground station 3 , respectively.
[0096] That is to say, the work aircraft 1 in this embodiment has three posture control modes, namely: an automatic control mode in which the work aircraft 1 directly controls its flight control system, a manual control mode in which the ground operator of the ground station 3 controls the work aircraft 1, and a companion control mode in which the companion aircraft 2 controls the work aircraft 1. The switching of the work aircraft 1 between the three posture control modes is achieved by the instruction generation switching device.
[0097] For example, when the accompanying aircraft 2 cannot confirm whether the obstacle really exists based on its supplementary environmental information, the working aircraft 1 first stops moving and sends a warning message to the ground station 3. The operator of the ground station 3 determines whether the risk really exists based on the content displayed on the display screen of the ground station 3. When the collision risk really exists, the ground operator can select the posture control mode of the working aircraft 1 through the instruction generation switching device to make the working aircraft 1 avoid the collision risk point. When there is no collision risk, the ground operator controls the accompanying aircraft 2 to re-observe, that is, controls the accompanying aircraft 2 to adjust the observation position and change the angle of observing the working aircraft 1, so as to conduct more detailed observation and measurement.
[0098] It is understandable that, in the process of the data processor processing the supplementary environmental information, it is necessary to combine the relative position vectors of the operating aircraft 1 and the accompanying aircraft 2 to perform spatial coordinate transformation to generate operating instructions.
[0099] Specifically, when the companion aircraft 2 detects that there is an obstacle around the working aircraft 1, the position coordinates of the obstacle are obtained. At this time, the position coordinates of the obstacle are the coordinates of the obstacle in the coordinate system of the companion aircraft 2. The data processor calculates the coordinates of the obstacle in the coordinate system of the working aircraft 1 according to the relative posture relationship between the companion aircraft 2 and the working aircraft 1 through the coordinate transformation of the spatial coordinate system, that is, the relative posture of the working aircraft 1 and the obstacle is obtained, so as to adjust the posture of the working aircraft 1 through the flight control system and positioning device of the working aircraft 1, so that the working aircraft 1 is away from the obstacle.
[0100] In addition, as the work aircraft 1 gradually approaches the work object, if the work execution mechanism of the work aircraft 1 (such as a robotic arm) blocks the field of view of the work aircraft 1 or the work aircraft 1 cannot accurately observe the work object, the companion aircraft 2 can be flown to a position with a better observation angle, such as a vertical plane connecting the robotic arm and the work object, and the companion aircraft 2 can be used to monitor the positional relationship between the robotic arm and the work object to ensure that the work aircraft 1 can achieve efficient and accurate operations.
[0101] That is, when the companion aircraft 2 detects the working object, the position coordinates of the working object are obtained. At this time, the position coordinates of the working object are the coordinates of the working object in the coordinate system of the companion aircraft 2. The data processor calculates the coordinates of the working object in the coordinate system of the working aircraft 1 through the coordinate transformation of the spatial coordinate system based on the relative posture relationship between the companion aircraft 2 and the robotic arm of the working aircraft 1, that is, the relative posture of the robotic arm of the working aircraft 1 and the working object is obtained. When the relative posture of the robotic arm and the working object is within a preset safety range, the operating action of the robotic arm is maintained; when the relative posture of the two exceeds the preset safety range, the operating action of the robotic arm is stopped, and the posture of the working aircraft 1 is adjusted so that the robotic arm and the working object have a suitable relative posture to facilitate further operation.
[0102] Preferably, the data processor includes a coordinate transformation unit for performing coordinate transformation. For a data processor that realizes this function, please refer to the data processor of the working robot in the prior art. For example, when the mechanical arm in the working robot is working, the position coordinates of the end of the mechanical arm in the reference coordinate system need to be obtained through coordinate transformation.
[0103] Furthermore, the present application does not limit the manner in which the data processor obtains the relative position and posture of the operating aircraft 1 and the accompanying aircraft 2. For example, since the data processor has established data connections with the operating aircraft 1 and the accompanying aircraft 2 respectively, the operating aircraft 1 and the accompanying aircraft 2 can send their respective position coordinates to the data processor in real time, and the data processor calculates the relative position and posture of the operating aircraft 1 and the accompanying aircraft 2 through their coordinate positions.
[0104] As another preferred solution, the work aircraft 1 is provided with a visual marker, and the companion aircraft 2 is provided with a positioning visual sensor for detecting the visual marker to obtain the relative position of the companion aircraft 2 and the work aircraft 1 .
[0105] That is to say, in this embodiment, the relative position and posture of the accompanying aircraft 2 and the working aircraft 1 are obtained by the positioning vision sensor, and then the relative position and posture detected by the positioning vision sensor is sent to the data processor by the accompanying aircraft 2.
[0106] It should be noted that the specific implementation method of the positioning visual sensor to obtain the information recorded by the visual mark and to obtain the relative position and posture of the working aircraft 1 and the accompanying aircraft 2 through the visual algorithm can be referred to the prior art, and the present invention will not be repeated.
[0107] Preferably, the positioning vision sensor is a positioning camera.
[0108] Furthermore, in order to reduce the load weight of the accompanying aircraft 2, preferably, the positioning vision sensor and the second vision sensor are the same vision sensor.
[0109] For example, the second visual sensor (depth camera) can be directly used to replace the positioning visual sensor (positioning camera) in the companion aircraft 2. In this case, the second visual sensor (depth camera) has the dual functions of environmental perception and precise positioning.
[0110] It should be noted that the present invention does not limit the specific number of the accompanying aircraft 2, and the number of the accompanying aircraft 2 can be one or at least two.
[0111] As a preferred solution, when the number of the accompanying aircraft 2 is one, the accompanying aircraft 2 has at least one designated posture to obtain supplementary environmental information in the blind spot of the working aircraft 1 corresponding to the accompanying aircraft 2 in each designated posture.
[0112] That is, this embodiment obtains the supplementary environmental information in the blind area of the visual field of the working aircraft 1 corresponding to the companion aircraft 2 at different designated positions and postures by changing the position and posture of the companion aircraft 2. The designated positions and postures of the companion aircraft 2 are different, and the relative positions and postures of the companion aircraft 2 and the working aircraft 1 are different. Therefore, the supplementary environmental information in the blind area of the visual field of the working aircraft 1 obtained by the companion aircraft 2 is different, so that the supplementary environmental information at different angles in the blind area of the visual field of the companion aircraft 2 relative to the working aircraft 1 can be obtained by placing the companion aircraft 2 in each designated position and posture.
[0113] Specifically, a preset number of designated postures can be set in advance for the companion aircraft 2, or the companion aircraft 2 can be controlled to fly to a certain designated posture by sending a designated posture control instruction to the companion aircraft 2 in real time according to the needs of the work aircraft 1. Specifically, the work aircraft 1 or the ground station 3 can send the designated posture control instruction to the companion aircraft 2 in real time.
[0114] Preferably, the operating aircraft 1 or the ground station 3 is provided with a controller for sending specified posture control instructions to the flight control system of the accompanying aircraft 2, so that the accompanying aircraft 2 can obtain the supplementary environmental information within the blind spot of the corresponding operating aircraft 1 at the specified posture.
[0115] The controller for sending designated posture control instructions to the flight control system of the accompanying aircraft 2 is preferably the central processing unit of the working aircraft 1 or the ground station 3.
[0116] It is understandable that when the work aircraft 1 sends a designated posture control instruction to the companion aircraft 2 in real time, the designated posture of the companion aircraft 2 refers to the target coordinates of the companion aircraft 2 in the coordinate system of the work aircraft 1. When the companion aircraft 2 is controlled to fly to a certain designated posture, the coordinate transformation of the space coordinate system is required according to the relative posture between the companion aircraft 2 and the work aircraft 1, and the coordinates of the designated posture in the coordinate system of the companion aircraft 2 are determined, so that the companion aircraft 2 can fly to the designated posture through its own flight control system.
[0117] When the ground station 3 sends a designated posture control instruction to the companion aircraft 2 in real time, the designated posture of the companion aircraft 2 refers to the target coordinates of the companion aircraft 2 in the coordinate system of the ground station 3. When controlling the companion aircraft 2 to fly to a certain designated posture, the ground station 3 sends a designated posture control instruction to the companion aircraft 2 according to the current postures of the companion aircraft 2 and the working aircraft 1 in the coordinate system of the ground station 3, and the ground station 3 directly controls the flight control system of the companion aircraft 2 to fly to the designated posture; or, the companion aircraft 2 performs a coordinate transformation of the space coordinate system according to its relative posture with the ground station 3, determines the coordinates of the designated posture in the coordinate system of the companion aircraft 2, and automatically controls its flight control system to fly to the designated posture.
[0118] When the number of the accompanying aircraft 2 is at least two, comprehensive supplementary environmental information within the blind spot of the operating aircraft 1 can be obtained by distributing the plurality of accompanying aircraft 2 around the operating aircraft 1 .
[0119] In summary, the present invention can obtain the full amount of environmental information around the operating aircraft 1 through the synergy between the operating aircraft 1 and the accompanying aircraft 2, and control the operating aircraft 1 to perform operations based on the full amount of environmental information.
[0120] Compared with the technical solution in the prior art that relies on the working aircraft 1 to work alone, the aerial working aircraft system provided by the present invention can fully perceive the surrounding environment of the working aircraft 1, solving the technical problems of the limited perception ability of the working aircraft 1 and the limited field of vision of the ground operators in the prior art. Moreover, compared with observing the surrounding environment of the working aircraft 1 through the naked eyes of the ground operators, the accompanying aircraft 2 can observe in the safe area near the working aircraft 1, and can more comprehensively understand the working position and collision risk of the working aircraft 1. Therefore, the defects of the blind spots and field of vision of the working aircraft 1 itself are compensated, and the obstacle information and detailed position information of the working object in the blind spots of the field of vision of the working aircraft 1 can be obtained, so that the working aircraft 1 can reliably avoid obstacles or operate more accurately, thereby improving the reliability and accuracy of the working aircraft 1.
[0121] At the same time, it avoids the operation aircraft 1 from carrying too many sensors and corresponding processors, reduces the overall weight of the operation aircraft 1, reduces the energy consumption of the operation aircraft 1, and improves the operation performance and work efficiency of the operation aircraft 1.
[0122] In addition to the above-mentioned aerial work aircraft system, the present invention also provides a control method for the aerial work aircraft system disclosed in the above-mentioned embodiment, the control method comprising:
[0123] Step S1: using the accompanying aircraft 2 to obtain supplementary environmental information within the blind spot of the working aircraft 1.
[0124] It can be understood that before executing step S1, step S0 is also included:
[0125] Step S0: Control the working robot and the accompanying robot to fly to the target working area respectively.
[0126] The target operation area mainly refers to the local air area where the target object is located.
[0127] Preferably, the ground station 3 controls the working robot and the accompanying robot to fly to the target working area at the same time.
[0128] Furthermore, it is preferred to use a second visual sensor (such as a depth camera) provided on the accompanying aircraft 2 to obtain supplementary environmental information within the blind spot of the field of vision of the working aircraft 1 .
[0129] As a preferred embodiment, step S1 includes step S11 and step S12:
[0130] Step S11: Control the accompanying aircraft 2 to adjust its posture to a specified posture.
[0131] Preferably, the accompanying aircraft 2 has at least one designated posture.
[0132] Preferably, the work aircraft 1 or the ground station 3 sends a designated posture control instruction to the accompanying aircraft 2 to control the accompanying aircraft 2 to adjust the posture to the designated posture.
[0133] Preferably, before controlling the accompanying aircraft 2 to adjust the posture to the specified posture, step S10 is included:
[0134] Step S10: Obtain the relative position and posture of the working aircraft 1 and the accompanying aircraft 2, so that the accompanying aircraft 2 can accurately fly to the designated position and posture.
[0135] Considering the specific method of obtaining the relative position and posture of the working aircraft 1 and the accompanying aircraft 2, preferably, step S10 includes step S101 or step S102:
[0136] Step S101: The accompanying aircraft 2 detects the visual marking information on the working aircraft 1 to obtain the relative position and posture of the working aircraft 1 and the accompanying aircraft 2.
[0137] That is, a visual marker is provided on the operating aircraft 1, and after the companion aircraft 2 detects the visual marker, the coordinate information of the visual marker in the coordinate system of the companion aircraft 2 is obtained; with the visual marker as a reference point, the coordinate information of the visual marker in the coordinate system of the operating aircraft 1 and the coordinate information of the visual marker in the coordinate system of the companion aircraft 2 are transformed to obtain the relative position and posture of the operating aircraft 1 and the companion aircraft 2.
[0138] As another implementation, when the aerial work aircraft system includes a ground station 3 , step S102 is used to obtain the relative position and posture of the work aircraft 1 and the accompanying aircraft 2 .
[0139] Step S102 , the relative position and posture of the operating aircraft 1 and the accompanying aircraft 2 are calculated by using the real-time position coordinates of the operating aircraft 1 and the accompanying aircraft 2 received by the ground station 3 .
[0140] That is, the operating aircraft 1 and the accompanying aircraft 2 send their respective position coordinates to the ground station 3 in real time. Here, the respective position coordinates of the operating aircraft 1 and the accompanying aircraft 2 are the coordinates in the coordinate system of the ground station 3. The ground station 3 is used as the reference coordinate system, and the relative position and posture of the operating aircraft 1 and the accompanying aircraft 2 are calculated after coordinate transformation.
[0141] Step S12: Obtaining supplementary environmental information within the blind spot of the working aircraft 1 corresponding to the accompanying aircraft 2 at the specified position.
[0142] Step S2: Utilize a data processor to process the supplementary environmental information and generate a job instruction.
[0143] The data processor may be arranged on any one of the operation aircraft 1 , the accompanying aircraft 2 and the ground station 3 .
[0144] Alternatively, the data processor is provided in each of the operating aircraft 1, the accompanying aircraft 2 and the ground station 3, and the data processors in the three are selectively switched to work through the command generation switching device of the ground station 3. Thus, the operating aircraft 1 has three posture control modes.
[0145] When using a data processor to process the supplementary environmental information and generate work instructions, it is preferred to use the coordinate transformation theory of the spatial coordinate system to convert the coordinates of the obstacle or the work object in the supplementary environmental information obtained by the companion aircraft 2 into the coordinates of the obstacle or the work object in the work aircraft 1, so as to obtain the relative position and posture of the obstacle and the work aircraft 1 or the work object and the robotic arm.
[0146] Step S3: Control the work aircraft 1 to perform aerial work on the work object or avoid obstacles according to the work instruction.
[0147] It can be seen from step S2 that the operation instruction can be generated by the data processor of the operation aircraft 1 itself, directly controlling the flight control system of the operation aircraft 1 to realize automatic control of the operation aircraft 1; it can also be generated by the data processor of the companion aircraft 2 and sent to the operation aircraft 1, so that the companion aircraft 2 can directly take over the flight control system of the operation aircraft 1; of course, it can also be generated by the data processor of the ground station 3 and sent to the operation aircraft 1, so that the ground operator can manually control the flight control system of the operation aircraft 1.
[0148] Furthermore, when the operating aircraft 1, the accompanying aircraft 2 and the ground station 3 are all equipped with the data processor, the instruction generation switching device of the ground station 3 can also enable the data processors among the three to switch to work one by one, thereby enabling the operating aircraft 1 to switch between the automatic control mode, the accompanying control mode and the manual control mode.
[0149] In summary, the control method is a method for implementing the operation of the above-mentioned aerial work aircraft system, and has the above-mentioned beneficial effects.
[0150] The various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the various embodiments can be referenced to each other.
[0151] The above is a detailed introduction to the aerial work aircraft system and control method thereof provided by the present invention. Specific examples are used herein to illustrate the principles and implementation methods of the present invention. The description of the above embodiments is only used to help understand the method and core idea of the present invention. It should be pointed out that for ordinary technicians in this technical field, without departing from the principles of the present invention, several improvements and modifications can be made to the present invention, and these improvements and modifications also fall within the scope of protection of the claims of the present invention.
Claims
1. An aerial work aircraft system, characterized in that: include: At least one accompanying aircraft (2) is used to obtain supplementary environmental information within the blind spot of the operating aircraft (1); a data processor having a data connection with the accompanying aircraft (2), and configured to generate an operation instruction according to the supplementary environmental information; The operation aircraft (1) having a data connection with the data processor is used to perform aerial operations on the operation object or avoid obstacles according to the operation instructions; The work aircraft (1) is provided with a sensor for acquiring basic environmental information of the surrounding environment of the work aircraft (1); the basic environmental information and the supplementary environmental information form the full environmental information around the work aircraft (1); the work aircraft (1) is used to perform aerial work on a work object or avoid obstacles based on the full environmental information.
2. The aerial work aircraft system according to claim 1, characterized in that: The data processor is arranged on the operating aircraft (1) or the accompanying aircraft (2).
3. The aerial work aircraft system according to claim 1, characterized in that: It also comprises a ground station (3), wherein the data processor is arranged at the ground station (3).
4. The aerial work vehicle system according to claim 1, characterized in that: It also includes a ground station (3), wherein the number of the data processors is three, which are respectively arranged in the operating aircraft (1), the accompanying aircraft (2) and the ground station (3); The ground station (3) is also provided with an instruction generation switching device connected to the three data processors, which is used to enable the three data processors to switch to work one by one.
5. The aerial work aircraft system according to any one of claims 1 to 4, characterized in that: When the number of the accompanying aircraft (2) is one, the accompanying aircraft (2) has at least one designated posture, so as to obtain supplementary environmental information within the blind spot of the field of vision of the working aircraft (1) corresponding to the accompanying aircraft (2) in each designated posture.
6. The aerial work vehicle system according to claim 5, characterized in that: The work aircraft (1) is provided with a visual marker, and the accompanying aircraft (2) is provided with a positioning visual sensor for detecting the visual marker to obtain the relative position of the accompanying aircraft (2) and the work aircraft (1).
7. The aerial work vehicle system according to claim 6, characterized in that: The working aircraft (1) is provided with a first visual sensor for acquiring position information of the working object and monitoring the working status of the working aircraft (1); the supplementary environmental information is information within a blind spot of the first visual sensor, and the accompanying aircraft (2) is provided with a second visual sensor for acquiring the supplementary environmental information.
8. The aerial work vehicle system according to claim 7, characterized in that: The positioning vision sensor and the second vision sensor are the same vision sensor.
9. A control method for an aerial work aircraft system, characterized in that: The aerial work aircraft system according to any one of claims 1 to 8 comprises: Using the accompanying aircraft (2) to obtain supplementary environmental information within the blind spot of the operating aircraft (1); Using a data processor to process the supplementary environmental information and generate a job instruction; The operation aircraft (1) is controlled according to the operation instruction to perform aerial operations on the operation object or avoid obstacles.
10. The control method of the aerial work aircraft system according to claim 9, characterized in that: The method of using the accompanying aircraft (2) to obtain the supplementary environmental information within the blind spot of the working aircraft (1) comprises: Controlling the accompanying aircraft (2) to adjust its posture to a specified posture; Supplementary environmental information within the blind spot of the field of vision of the working aircraft (1) corresponding to the accompanying aircraft (2) when the accompanying aircraft (2) is in the specified posture is obtained.
11. The control method of the aerial work aircraft system according to claim 10, characterized in that: Before controlling the accompanying aircraft (2) to adjust the posture to the specified posture, the method includes: The relative position and posture of the operating aircraft (1) and the accompanying aircraft (2) are obtained.
12. The control method of the aerial work aircraft system according to claim 11, characterized in that: The step of obtaining the relative position and posture of the operating aircraft (1) and the accompanying aircraft (2) comprises: The relative position and posture is obtained by detecting visual marking information on the working aircraft (1) by the accompanying aircraft (2); Alternatively, when the aerial work aircraft system includes a ground station (3), the relative position and posture is calculated by using the real-time position coordinates of the work aircraft (1) and the accompanying aircraft (2) received by the ground station (3).
13. The control method of an aerial work aircraft system according to any one of claims 9 to 12, characterized in that: The method of using a data processor to process the supplementary environmental information and generate an operation instruction; and controlling the operation aircraft (1) to perform aerial operations on an operation object or avoid obstacles according to the operation instruction, comprises: When the data processor is provided in the operation aircraft (1), the operation aircraft (1) uses the data processor to process the supplementary environmental information and generate operation instructions, and the operation aircraft (1) performs aerial operations on the operation object or avoids obstacles according to the operation instructions; When the data processor is provided in the accompanying aircraft (2), the accompanying aircraft (2) uses the data processor to perform data processing on the supplementary environmental information and generates an operation instruction, the accompanying aircraft (2) transmits the operation instruction to the operation aircraft (1), and the operation aircraft (1) performs aerial operations on the operation object or avoids obstacles according to the operation instruction; When a ground station (3) is further included and the data processor is arranged at the ground station (3), the ground station (3) uses the data processor to perform data processing on the supplementary environmental information and generates an operation instruction, the ground station (3) transmits the operation instruction to the operation aircraft (1), and the operation aircraft (1) performs aerial operations on the operation object or avoids obstacles according to the operation instruction; When it also includes a ground station (3) and an instruction generation switching device disposed on the ground station (3), and the number of the data processors is three, which are disposed respectively on the working aircraft (1), the accompanying aircraft (2) and the ground station (3), the instruction generation switching device enables the three data processors to selectively process the supplementary environmental information and generate working instructions, so that the working aircraft (1), the accompanying aircraft (2) and the ground station (3) switch and control the working aircraft (1) to perform aerial work on the working object or avoid obstacles.
Citation Information
Patent Citations
Unmanned plane aerial photographing system and method of photographing accompanying aircraft
CN105242684A
Unmanned plane flight accompanying aerial photographing system and method
CN105242685A
Unmanned aerial vehicle accompanying method, unmanned aerial vehicle accompanying device and unmanned aerial vehicle accompanying system
CN106054924A
Remote control system and method for engineering operation vehicle
CN106488110A
Unmanned aerial vehicle collaborative operation system and unmanned aerial vehicle collaborative operation method
CN106919184A
Cited By
Data sensing intelligent processing method for low-altitude aircraft
CN119832087A
A data perception intelligent processing method for low-altitude aircraft
CN119832087B
