Message distribution management method for unmanned aerial vehicle ground station double-person operation mode

By classifying and dividing the data links of the drone ground station, the problem of excessive operator load in single-player operation mode is solved, safe control in two-player operation mode is realized, and system compatibility is ensured Sex and safety.

CN119070890APending Publication Date: 2024-12-03西安应用光学研究所
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411345035.9
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-09-25
Publication Date
2024-12-03

AI Technical Summary

Technical Problem

In the single-player operation mode of the drone ground station, the operator is overloaded and complex business needs to separate the operation tasks of shooting gimbals and sensors. The existing technology is difficult to effectively compatible with single-player and double-player operation modes, which affects flight Safety.

Method used

By classifying the control messages and data messages on the drone data link, it is divided into flight control related and payload control related, and combining the parameter configuration file to determine the operating status of the software, so as to realize three types of operations: single terminal, flight control and payload. In the event, formulate message forwarding rules under different working conditions to ensure that the operator can only perform corresponding controls in two-person operating mode to avoid operational interference.

Benefits of technology

It realizes that the drone ground station software is compatible with single and double-person operation modes. It can adapt to different operating modes by modifying configuration parameters, reducing the workload of software development, and effectively blocking the operator's unauthorized operations, ensuring the safety of the system. sex.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119070890A_ABST
    Figure CN119070890A_ABST
Patent Text Reader

Abstract

The invention belongs to the field of unmanned aerial vehicle ground station operation design, and discloses a message distribution management method for a double-person operation mode of an unmanned aerial vehicle ground station, and the method comprises the following steps: S1, carrying out the message classification based on flight control correlation and load control correlation; s2, dividing the operation state of the ground station into three working conditions of single terminal, flight control and load; s3, marking each communication path; and S4, formulating message forwarding rules under three different working conditions. According to the method, unauthorized operation of an operator is shielded based on internal constraints of a communication forwarding mechanism, so that flight control and load control are effectively ensured not to interfere with each other, and the safety of the system is ensured.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The invention belongs to the field of unmanned aerial vehicle ground station operation design, and relates to a message distribution management method for a two-person operation mode of an unmanned aerial vehicle ground station. Background Art

[0002] The present invention is proposed to meet the compatibility design requirements of the single-operation / double-operation modes of the UAV ground station.

[0003] For drones used for aerial photography and reconnaissance applications, since ground-side operations include flight control and control of sensor platforms, when operated by a single person, the operator's proficiency and reaction speed are required to be high. For more complex drone systems, the operator is overloaded. In order to cope with complex business, reduce the operator's load, and ensure flight safety, it is necessary to separate the operating tasks of the shooting gimbal and sensors (also collectively referred to as "photoelectric loads") and have them operated by dedicated personnel. The pilot is only responsible for flight control, thus forming a two-person operation mode. For the original ground station software that copes with the single-person operation mode, this design improvement requires multiple aspects such as interface splitting, control authority management, and data sharing. Summary of the invention

[0004] (I) Purpose of the invention

[0005] The purpose of the present invention is to provide a message distribution management method for the two-person operation mode of the UAV ground station for the original ground station software for single-person operation mode for UAVs used for aerial photography and reconnaissance applications, so that the control software only needs to change the configuration parameters to adapt to the single-person operation and the two-person operation mode in which the load control and flight control are separated.

[0006] (II) Technical solution

[0007] In order to solve the above technical problems, the present invention provides a message distribution management method for a two-person operation mode of an unmanned aerial vehicle ground station, comprising the following steps:

[0008] S1: Classify messages based on flight control and payload control.

[0009] The control messages and data messages on the UAV data link are classified, and the control messages are divided into flight control messages C1 related to aircraft control and load control messages C2 related to load control; the telemetry data packet from the aircraft end to the computer is denoted as D, and the telemetry data packet includes aircraft status data related to aircraft control and load status data related to load control; the video stream data packet from the aircraft end to the computer is denoted as V.

[0010] S2: The ground station operating status is divided into three working conditions: single terminal, flight control, and payload.

[0011] The single-terminal working condition corresponds to the single-operator operation mode of the UAV. In the single-terminal working condition, the ground station software runs on a single computer, and the computer is connected to the data link ground terminal to realize the wireless link with the aircraft end; in the single-terminal working condition, it is operated by a single person, and the operator can control the flight of the UAV and the optoelectronic payload.

[0012] The flight control condition and load condition correspond to the software operation status of the two ground stations in the two-person operation mode respectively: the ground station software is installed on both computers A and B. Machine A is connected to the data link ground terminal to realize the wireless link with the aircraft. At the same time, machines A and B are interconnected through the local area network. The ground station software of machine A runs in the flight control condition, and the operator can only perform flight control but cannot operate the load; the ground station software of machine B runs in the load condition, and the operator can only operate the load but cannot perform flight control.

[0013] The operating status of the ground station is determined as follows: When the ground station software starts, it reads the parameter configuration file and obtains the value of the working mode M. When M is 0, the software runs in a single terminal condition, when M is 1, the software runs in a flight control condition, and when M is 2, the software runs in a load condition. In the flight control mode and the ground station load mode, the ground station cannot perform flight control, and must be interconnected with another ground station running in the flight control mode through a local area network to operate the load.

[0014] S3: Mark each communication path.

[0015] In each communication path, the computer to the aircraft is CH1, the aircraft to the computer is CH2, the A to B is CH3, and the B to A is CH4; the video stream channel sent from the aircraft to the computer is CH5, and the video stream channel sent from A to B is CH6.

[0016] The specific implementation is as follows: Considering the connection status of the two ground stations and the aircraft in the two-person operation mode, the communication paths within the system can be sorted out, including the wireless channel from the computer to the aircraft, the wireless channel from the aircraft to the flight control mode ground station, the LAN channel from the flight control mode ground station (machine A) to the payload mode ground station (machine B), the LAN channel from machine B to machine A, the image transmission channel from the aircraft to the flight control mode ground station, and the forwarding video channel from machine A to machine B (through the LAN).

[0017] The above channels are marked as shown in the table below and extended to single-player mode and the case of only a ground station in flight control mode.

[0018] S4: Formulate message forwarding rules under three different working conditions

[0019] The ground station software interface is divided into the flight control interface and the payload control interface. The human-computer interaction of the payload control interface generates C2.

[0020] Under the single terminal working condition, the human-computer interaction of the flight control interface generates C1, and the human-computer interaction of the payload control interface generates C2. C1 and C2 are sent via CH1; D is obtained from CH2 to complete data analysis and visualization; V is obtained from CH5 to complete video decoding and display;

[0021] Under the flight control condition, the human-machine interaction of the flight control interface generates C1, obtains C2 from CH4, and C1 and C2 are sent via CH1; obtains D from CH2 to complete data analysis and visualization, and D is sent via CH3; obtains V from CH5 to complete video decoding and display, and V is sent via CH6;

[0022] Under load conditions, the human-computer interaction of the load control interface generates C2, which is sent via CH4, obtains D from CH3, completes data analysis and visualization, and obtains V from CH6, completes video decoding and display;

[0023] At this point, based on the above-mentioned message distribution management method, the design of the UAV ground station software that is compatible with single-person operation / two-person operation has been completed. By modifying the configuration file parameters, the same set of software can be used to adapt to the above-mentioned different operation modes.

[0024] (III) Beneficial effects

[0025] The software design method for the two-person operation mode of the UAV ground station provided by the above technical solution has the following advantages:

[0026] (1) For drones used for aerial photography and reconnaissance applications, it can support both single-operator and two-operator modes.

[0027] (2) Configure the software operation mode based on the parameter file, and use one set of software to run in multiple locations, reducing the workload of software development;

[0028] (3) In response to the design requirement of improving the single-operator mode to the two-operator mode, it can adapt to the original air-to-ground link regardless of whether it adopts the point-to-point communication mode or the broadcast mode;

[0029] (4) Based on the inherent constraints of the communication forwarding mechanism, the operator's unauthorized operations are shielded, effectively ensuring that flight control and payload control do not interfere with each other, thereby ensuring the safety of the system. BRIEF DESCRIPTION OF THE DRAWINGS

[0030] Figure 1 This is a connection method of a preferred embodiment of the present invention in a single-operator operation mode.

[0031] Figure 2 This is a connection method of a preferred embodiment of the present invention in a two-person operation mode.

[0032] Figure 3 It is a communication path label of a preferred embodiment of the present invention.

[0033] Figure 4 It is a software interface planning of a preferred embodiment of the present invention. DETAILED DESCRIPTION

[0034] In order to make the purpose, content and advantages of the present invention more clear, the specific implementation methods of the present invention are further described in detail below in conjunction with the drawings and examples.

[0035] like Figure 1 As shown, in the embodiment of the present invention, the ground station software design is completed for a fixed-wing UAV carrying an optoelectronic payload. The fixed-wing UAV takes off and lands by taxiing, and its flight can be controlled by commands such as "level flight", "left turn", and "right turn", and can also be set to route flight; the optoelectronic payload includes sensors such as TV cameras and thermal imagers, which are installed on a three-axis turntable, where the azimuth and pitch can be controlled by the handle, and the roll is automatically controlled to keep the sensor screen level.

[0036] In step S1, in the control protocol involved in the UAV ground station software, the message format uses a 1-byte message type identification field to indicate its type, 1 indicates the type is a flight control message, i.e. C1, 2 indicates the type is a payload control message, i.e. C2, and 3 indicates the type is a telemetry data message.

[0037] In step S2, define the parameter file field "STATIONMODE", for the single terminal working condition "STATIONMODE = 0", the flight control working condition "STATIONMODE = 1", and the load working condition "STATIONMODE = 2".

[0038] When the ground station software starts, it reads the parameter configuration file and obtains the value of the working condition M from the STATIONMODE field. When M is 0, the software runs in the single terminal working condition, when M is 1, the software runs in the flight control working condition, and when M is 2, the software runs in the load working condition. In the single terminal working condition or the flight control working condition, the computer is connected to the data link ground terminal; in the load working condition, the ground station is connected to another ground station running in the flight control working condition through a network cable. Figure 2 Shows how the system is connected in two-player operation mode.

[0039] In step S3, if Figure 3 Label each communication path.

[0040] In step S4, the ground station software is designed as follows: Figure 4As shown, the software interface includes a system button area, a map area, a video area, and a control panel area. The control panel area is a switchable area that can be switched between the flight control interface and the load interface. The human-computer interaction of the flight control interface and the load interface includes key operations and operations of pop-up dialog boxes triggered by keys. The human-computer interaction operation of the flight control interface generates C1, and the human-computer interaction operation of the load interface generates C2. On the other hand, under specific working conditions, certain mouse interaction operations in the map area and the video area will also generate C1 and C2. Obtain D from CH2 or CH3, parse D and complete data visualization in the flight control interface and load-related interfaces;

[0041] CH5 or CH6 is the UDP receiving port, which obtains the video compression package V in H264 raw stream format, decodes the video frame in real time, and displays it in the video display window of the software interface;

[0042] The software is designed to have the following selectively enabled functions:

[0043] F1: Send C1, C2 to CH1

[0044] F2: Send C2 to CH4

[0045] F3: Start data reception on CH4

[0046] F4: Immediately forward the type 3 message received from CH2 to CH3.

[0047] F5: After receiving V from CH5, it is immediately forwarded to CH6.

[0048] In single terminal condition, enable F1;

[0049] Under flight control conditions, enable F1, F3, F4, and F5.

[0050] Under Load Case, enable F2.

[0051] In the single-operation mode, the ground station (operated by general-purpose computer A) establishes a connection with the aircraft through a data link, which may be a network port connection or a high-speed serial port connection. The wireless link between the ground station and the aircraft realizes the control transmission from the ground station to the aircraft (uplink control message) and the status report from the aircraft to the ground station (downlink data message); the video stream is sent from the aircraft to the ground station based on point-to-point streaming media transmission. In the two-person operation mode, the ground station needs to add a computer B for the payload operator to operate, and it is necessary to ensure that the payload operator can only operate the optoelectronic payload and cannot interfere with flight control; similarly, the computer A operated by the pilot can only perform flight control and cannot interfere with payload control.

[0052] The present invention controls and forwards control messages, data messages and video streams sent from the aircraft to the ground station on the data link in a two-person operation mode, so that the computer B added to the ground station can also see the entire interface including the flight status and the optoelectronic payload video, and has the payload control authority; for computer A, all payload control authorities are disabled in the two-person operation mode, so that the same set of UAV ground station software can adapt to the single-person operation mode, and can also realize two-person operation based on the hardware platform of the dual computers without interfering with each other's business.

[0053] The above is only a preferred embodiment of the present invention. It should be pointed out that for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the technical principles of the present invention. These improvements and modifications should also be regarded as the scope of protection of the present invention.

Claims

1. A message distribution management method for a two-person operation mode of an unmanned aerial vehicle ground station, characterized in that: The following steps are involved: S1: Classify messages based on flight control and payload control; S2: The ground station operation status is divided into three working conditions: single terminal, flight control, and payload; S3: mark each communication path; S4: Formulate message forwarding rules under three different working conditions.

2. The message distribution management method for the two-person operation mode of the UAV ground station according to claim 1 is characterized in that: In step S1, the control messages and data messages on the UAV data link are classified, and the control messages are divided into flight control messages C1 related to aircraft control and load control messages C2 related to load control; The telemetry data packet from the aircraft to the computer is denoted as D, which includes aircraft status data related to aircraft control and load status data related to load control; the video stream data packet from the aircraft to the computer is denoted as V.

3. The message distribution management method for the two-person operation mode of the UAV ground station according to claim 2 is characterized in that: In step S2, the single-terminal working condition corresponds to the single-operator operation mode of the UAV; under the single-terminal working condition, the ground station software runs on a single computer, and the computer is connected to the data link ground terminal to realize the wireless link with the aircraft end; under the single-terminal working condition, it is operated by a single person, and the operator not only controls the flight of the UAV, but also controls the optoelectronic payload.

4. The message distribution management method for the two-person operation mode of the UAV ground station according to claim 3 is characterized in that: In step S2, the flight control condition and the load condition correspond to the software operation status of the two ground stations in the two-person operation mode respectively: the ground station software is installed on both computers A and B at the same time, A is connected to the data link ground terminal to realize the wireless link with the aircraft end, and A and B are interconnected through the local area network. The ground station software of A runs in the flight control condition, and the operator can only perform flight control but cannot operate the load; the ground station software of B runs in the load condition, and the operator can only operate the load but cannot perform flight control.

5. The message distribution management method for the two-person operation mode of the UAV ground station according to claim 4 is characterized in that: In step S2, the operating status of the ground station is determined as follows: when the ground station software is started, the parameter configuration file is read to obtain the value of the working mode M; when M is 0, the software runs in a single terminal condition, when M is 1, the software runs in a flight control condition, and when M is 2, the software runs in a load condition.

6. The message distribution management method for the two-person operation mode of the UAV ground station according to claim 5, characterized in that: In step S2, in the flight control mode and the ground station payload mode, the ground station cannot perform flight control and must be interconnected with another ground station operating in the flight control mode through a local area network to operate the payload.

7. The message distribution management method for the two-person operation mode of the UAV ground station according to claim 6 is characterized in that: In step S3, in each communication path, the computer to the aircraft is CH1, the aircraft to the computer is CH2, the A to B is CH3, and the B to A is CH4; the video stream channel sent from the aircraft to the computer is CH5, and the video stream channel sent from A to B is CH6.

8. The message distribution management method for the two-person operation mode of the UAV ground station according to claim 7, characterized in that: In step S3, according to the connection status of the two ground stations and the aircraft in the two-person operation mode, the communication paths within the system are divided into: a wireless channel from the computer to the aircraft, a wireless channel from the aircraft to the flight control mode ground station, a LAN channel from the flight control mode ground station A to the payload mode ground station B, a LAN channel from B to A, an image transmission channel from the aircraft to the flight control mode ground station, and a forwarding video channel from A to B.

9. The message distribution management method for the two-person operation mode of the UAV ground station according to claim 8, characterized in that: In step S4, the ground station software interface is divided into a flight control interface and a payload control interface, and the human-computer interaction of the payload control interface generates C2; Under the single terminal working condition, the human-computer interaction of the flight control interface generates C1, and the human-computer interaction of the payload control interface generates C2. C1 and C2 are sent via CH1; D is obtained from CH2 to complete data analysis and visualization; V is obtained from CH5 to complete video decoding and display; Under the flight control condition, the human-machine interaction of the flight control interface generates C1, obtains C2 from CH4, and C1 and C2 are sent via CH1; obtains D from CH2 to complete data analysis and visualization, and D is sent via CH3; obtains V from CH5 to complete video decoding and display, and V is sent via CH6; Under load conditions, the human-computer interaction of the load control interface generates C2, which is sent via CH4, obtains D from CH3, completes data analysis and visualization, and obtains V from CH6 to complete video decoding and display.

10. An application of a message distribution management method for a two-person operation mode of an unmanned aerial vehicle ground station based on any one of claims 1-9 in the field of unmanned aerial vehicle ground station operation design.