Unmanned aerial vehicle high-definition image transmission scheduling system for 5G millimeter wave communication

Abstract

The invention discloses an unmanned aerial vehicle high-definition image transmission scheduling system for 5G millimeter wave communication, and belongs to the technical field of unmanned aerial vehicle communication. Comprising an unmanned aerial vehicle end, a ground station end and a 5G millimeter wave communication network. The unmanned aerial vehicle end comprises an image acquisition module, a data processing module, a 5G millimeter wave communication module, a flight control module and an edge calculation module, and the ground station end comprises a 5G millimeter wave communication module, a data receiving and resolving module, an image transmission scheduling module, a display module and an edge server. Through fusion of 5G-A millimeter wave communication and radar sensing, a'communication-sensing-control 'closed loop is realized for the first time, and compared with the prior art, a remarkable breakthrough is made in the aspects of environment sensing and communication cooperation. Local real-time processing is achieved through the edge nodes, model training and global optimization are conducted on the cloud, and compared with a traditional centralized architecture, time delay is reduced by 60%. Through combination of block chain authentication and frequency hopping technologies, an end-to-end secure transmission channel is constructed, and the anti-interference capability is improved by 50% compared with that of independent use of AES-256.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of unmanned aerial vehicle communication, more particularly to a high-definition image transmission scheduling system for unmanned aerial vehicles using 5G millimeter wave communication. BACKGROUND

[0002] With the wide application of unmanned aerial vehicles in surveying and mapping, security and protection, logistics and many other fields, the demand for real-time transmission of high-definition image data from unmanned aerial vehicles to ground stations is becoming increasingly urgent. Currently, traditional unmanned aerial vehicle image transmission often uses the 2.4GHz or 5.8GHz frequency band, which has limited spectrum resources and is easily disturbed, resulting in problems such as image transmission lagging, frame loss, etc., and making it difficult to meet the requirements of real-time transmission of high-definition images. Moreover, with the increasing number of multi-unmanned aerial vehicle cooperative operation scenarios, how to efficiently schedule unmanned aerial vehicle image transmission resources has become a difficult problem to be solved. Although 5G technology brings new opportunities, the research and application of 5G millimeter wave communication in the scheduling of unmanned aerial vehicle high-definition image transmission is still in its infancy. Existing related technologies such as the three-dimensional UPF beam tracking technology of the Light Dynamics Intelligent Team, although involving the application of millimeter wave communication in unmanned aerial vehicles, lack deep integration with edge computing and intelligent resource allocation algorithms, resulting in problems such as resource allocation imbalance and excessive transmission delay when multiple unmanned aerial vehicles are working cooperatively; the three-dimensional cooperative perception algorithm of Beijing Telecom has achieved centimeter-level positioning and path optimization, but it has not been effectively combined with communication resource allocation, resulting in a mismatch between communication link quality and positioning accuracy, and an image transmission packet loss rate greater than 5%; task scheduling algorithms based on multi-objective optimization such as KnCMPSO lack intelligent decision-making capabilities when facing dynamic changes in the communication environment of unmanned aerial vehicles. Therefore, mature and innovative systems and solutions are still relatively lacking.

[0003] In view of the above, the present application is proposed to solve the above technical problems. SUMMARY

[0004] The purpose of the present application is to provide a high-definition image transmission scheduling system for unmanned aerial vehicles using 5G millimeter wave communication to solve the technical problems mentioned above.

[0005] To achieve the above-mentioned purpose, the present application provides the following technical solutions: The high-definition image transmission scheduling system for unmanned aerial vehicles using 5G millimeter wave communication comprises an unmanned aerial vehicle end, a ground station end and a 5G millimeter wave communication network. The unmanned aerial vehicle end comprises: An image acquisition module for acquiring high-definition image data during the flight of the unmanned aerial vehicle; A data processing module for preprocessing the high-definition image data acquired by the image acquisition module; 5G millimeter wave communication module, the image data preprocessed by the data processing module is sent to the ground station end through the 5G millimeter wave communication network, and the communication link quality parameters are collected in real time; Flight control module, according to the instruction sent by the ground station end, the flight attitude and flight path of the unmanned aerial vehicle are controlled; Edge computing module, using edge computing module, integrating TensorRT framework, realizing image preprocessing, target identification and other local calculation, and synchronizing model parameters with the ground station end through edge node; The ground station end comprises: 5G millimeter wave communication module, receiving image data sent by the unmanned aerial vehicle end; Data receiving and solving module, decompressing, decoding and processing the data received by the 5G millimeter wave communication module, and restoring the original high-definition image data; Image transmission scheduling module, dynamically allocating image transmission resources according to the task demand, flight state and communication link quality of multiple unmanned aerial vehicles, and optimizing the image transmission path; Display module, displaying the high-definition image data recovered by the data receiving and solving module; Edge server, deploying edge server, supporting real-time data solving and AI model training, using TensorFlowServing, and updating communication quality prediction model in real time; 5G millimeter wave communication network provides high-speed and stable communication link, which is used to ensure the fast and reliable transmission of image data between the unmanned aerial vehicle end and the ground station end, including 5G base station and related signal processing equipment, which can efficiently transmit, receive and process millimeter wave signals, using 5G-A NR protocol, the base station integrates millimeter wave radar, realizes real-time perception of unmanned aerial vehicle position and speed, and fuses with communication link quality data.

[0006] Further, the image transmission scheduling module comprises: Real-time state monitoring: the unmanned aerial vehicle end collects its flight parameters and communication link quality parameters in real time, and sends them to the ground station end through the 5G millimeter wave communication network, and the ground station end simultaneously monitors the task execution of each unmanned aerial vehicle; Resource allocation strategy: the image transmission scheduling module receives the state information and task information of the unmanned aerial vehicle, and adopts a resource allocation algorithm based on priority and communication quality, which introduces a reinforcement learning (DRL) model, inputs task priority, communication quality prediction value and unmanned aerial vehicle remaining power parameters, and outputs the optimal bandwidth allocation scheme; Communication quality prediction: using LSTM neural network, inputting historical signal strength, bit error rate and environmental parameters, predicting the communication quality score in the next 500ms.

[0007] Furthermore, the image acquisition module on the drone uses a high-resolution camera with a resolution of ≥4K to acquire high-definition image data at a frame rate of 15-30 frames per second, depending on the drone's flight mission and scenario requirements.

[0008] Furthermore, the data processing module on the drone uses the H.265 algorithm to compress and encode the acquired image data, with a compression ratio controlled between 10:1 and 20:1, and uses the AES-256 algorithm to encrypt the compressed data.

[0009] Furthermore, 5G base stations in 5G millimeter-wave communication networks employ phased array antennas and beamforming technology. Based on the real-time location information of the UAV, directional beams are formed by adjusting the phase of the antenna array, with a beam pointing angle tracking accuracy of ≤±2°, thereby increasing the millimeter-wave signal gain by 8-15dB. At the same time, three-dimensional environmental maps are constructed using radar echo data.

[0010] Furthermore, the data receiving and processing module at the ground station decrypts the received data using the AES-256 algorithm and decompresses it using the H.265 decoding algorithm. During the processing, it uses the CRC32 check algorithm and LDPC error correction code for data verification and error correction.

[0011] Furthermore, the edge computing module on the drone uses the NVIDIA Jetson AGX Orin platform to perform target detection on the image before transmission, and only uploads the region of interest (ROI) data, reducing the transmission volume by 30%-50%.

[0012] Furthermore, TensorFlow Serving is deployed on the edge servers at the ground stations to update the communication quality prediction model in real time, with a model update cycle of ≤1 minute.

[0013] Furthermore, the drone and ground station use blockchain technology to achieve two-way identity authentication, and the drone integrates a Beidou short message module, which automatically switches to satellite communication when the 5G network is interrupted.

[0014] Compared with the prior art, the beneficial effects of the present invention are as follows: (1) Multimodal collaborative perception: It integrates 5G-A millimeter wave communication and radar perception, and realizes the "communication-perception-control" closed loop for the first time, which is a significant breakthrough in environmental perception and communication collaboration compared with existing technologies.

[0015] (2) Edge-cloud collaborative intelligence: Real-time local processing is achieved through edge nodes, and model training and global optimization are performed in the cloud, reducing latency by 60% compared to the traditional centralized architecture.

[0016] (3) Anti-interference security system: Combining blockchain authentication and frequency hopping technology, an end-to-end secure transmission channel is constructed, and the anti-interference capability is improved by 50% compared with AES-256 alone. Attached Figure Description

[0017] The accompanying drawings, which form part of this application, are used to provide a further understanding of the invention. The illustrative embodiments and descriptions of the invention are used to explain the invention, but do not constitute an undue limitation of the invention. Obviously, the drawings described below are merely some embodiments, and those skilled in the art can obtain other drawings based on these drawings without creative effort. In the drawings: Figure 1 This is a flowchart of the image transmission scheduling system provided in this embodiment of the application. Detailed Implementation

[0018] The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments.

[0019] See Figure 1 As shown, this application provides a 5G millimeter-wave communication-based high-definition image transmission and dispatching system for drones, including a drone terminal, a ground station terminal, and a 5G millimeter-wave communication network; The drone terminal includes: The image acquisition module is used to acquire high-definition image data during the flight of the drone; The data processing module preprocesses the high-definition image data acquired by the image acquisition module, including compression and encoding. The 5G millimeter-wave communication module transmits the image data, which has been preprocessed by the data processing module, to the ground station via the 5G millimeter-wave communication network. At the same time, it collects communication link quality parameters in real time, including signal strength, bit error rate, and signal-to-noise ratio. The flight control module controls the UAV's flight attitude and flight path according to the instructions sent from the ground station; The edge computing module adopts an edge computing module with a computing power of ≥21 TOPS, integrates the TensorRT framework, realizes local computing such as image preprocessing and target recognition, and synchronizes model parameters with the ground station through edge nodes; The ground station includes: The 5G millimeter-wave communication module receives image data sent from the drone. The data receiving and decoding module decompresses and decodes the data received by the 5G millimeter-wave communication module to restore the original high-definition image data. The image transmission scheduling module dynamically allocates image transmission resources, including transmission bandwidth, communication frequency, and transmission power, and optimizes image transmission paths based on factors such as the mission requirements, flight status, and communication link quality of multiple drones. The display module displays the high-definition image data recovered by the data receiving and processing module; Edge servers are deployed to support real-time data processing and AI model training. They utilize TensorFlowServing to update the communication quality prediction model in real time. 5G millimeter-wave communication networks provide high-speed and stable communication links to ensure fast and reliable transmission of image data between UAVs and ground stations. This includes 5G base stations and related signal processing equipment, which can efficiently transmit, receive, and process millimeter-wave signals. Using the 5G-A NR protocol, the base station integrates millimeter-wave radar to achieve real-time perception of the UAV's position (accuracy ≤ 0.5 meters) and speed (accuracy ≤ 0.1 m / s), and fuses this with communication link quality data.

[0020] The image transmission scheduling module includes: Real-time status monitoring: The UAV collects its own flight parameters (position, speed, altitude) and communication link quality parameters in real time (signal strength ≥ -85dBm is preferred, bit error rate ≤ 10⁻). 6 (For priority), and transmit to the ground station via 5G millimeter wave communication network. The ground station simultaneously monitors the mission execution status of each drone (mission priority is divided into four levels: emergency / high / medium / low). Resource allocation strategy: The image transmission scheduling module uses a priority-based and communication quality-based resource allocation algorithm based on the received UAV status and task information. This algorithm incorporates a reinforcement learning (DRL) model, taking task priority, predicted communication quality, and remaining UAV battery parameters as inputs, and outputs the optimal bandwidth allocation scheme. The convergence speed is 40% faster than traditional algorithms, including: Priority quantification: Urgent tasks have a weight of 0.8, high priority 0.6, medium priority 0.4, and low priority 0.2; Communication quality score: A comprehensive score is calculated based on signal strength, bit error rate, and signal-to-noise ratio (out of 100). Resource allocation coefficient = priority weight × 0.6 + communication quality score × 0.4, and bandwidth resources are allocated according to the coefficient ratio; For high-priority tasks, more image transmission resources are allocated first, and for drones with good communication link quality, their transmission bandwidth is appropriately increased. At the same time, a distributed alliance cooperation algorithm is adopted to dynamically divide the task area and allocate spectrum resources according to parameters such as drone type, task priority, and remaining battery power. Adjacent drones use frequency hopping technology (frequency hopping rate ≥ 1000 times / second) combined with power control (formula: P=P0・e^(-d / λ), where λ is the attenuation coefficient) to avoid mutual interference of millimeter wave signals between adjacent drones. Dynamic adjustment: When the communication quality score of a drone is below 60 points for three consecutive sampling periods (sampling period is 1 second), the image transmission scheduling module dynamically adjusts the allocation of image transmission resources in real time, reducing its transmission bandwidth to 50%-70% of the original allocation, and allocating the released resources to drones with a communication quality score ≥80 points. The flight control module then sends a path adjustment command to the drone, causing it to fly to an area with a signal strength ≥-80dBm. Communication quality prediction: Using an LSTM neural network, input historical signal strength, bit error rate, and environmental parameters, predict the communication quality score for the next 500ms (accuracy ≥ 90%).

[0021] The image acquisition module on the drone uses a high-resolution camera with a resolution of ≥4K to acquire high-definition image data at a frame rate of 15-30 frames per second, depending on the drone's flight mission and scenario requirements.

[0022] The data processing module on the drone uses the H.265 algorithm to compress and encode the acquired image data, with a compression ratio controlled between 10:1 and 20:1, and uses the AES-256 algorithm to encrypt the compressed data.

[0023] 5G base stations in 5G millimeter-wave communication networks use phased array antennas (32T32R) and beamforming technology. Based on the real-time location information of the UAV (positioning accuracy ≤1 meter), the antenna array phase is adjusted to form a directional beam with a beam pointing angle tracking accuracy ≤±2°, which improves the millimeter-wave signal gain by 8-15dB. At the same time, radar echo data is used to construct a three-dimensional environment map.

[0024] The data receiving and processing module at the ground station decrypts the received data using the AES-256 algorithm and decompresses it using the H.265 decoding algorithm. During the processing, it uses the CRC32 check algorithm and LDPC error correction code (coding rate ≥ 0.8) for data verification and error correction.

[0025] The edge computing module on the drone uses the NVIDIA Jetson AGX Orin platform to perform target detection on the image before transmission, and only uploads the region of interest (ROI) data, reducing the amount of transmission by 30%-50%.

[0026] TensorFlow Serving is deployed on the edge servers at the ground station to update the communication quality prediction model in real time, with a model update cycle of ≤1 minute.

[0027] The drone and ground station use blockchain technology (PBFT consensus algorithm) to achieve two-way identity authentication with an authentication latency of ≤50ms and a 90% improvement in resistance to man-in-the-middle attacks. The drone also integrates a Beidou short message module, which automatically switches to satellite communication when the 5G network is interrupted.

[0028] Drone-side workflow Image Acquisition: The image acquisition module uses a high-resolution camera with a resolution of ≥4K to acquire high-definition image data at a frame rate of 15-30 frames per second, depending on the UAV flight mission and scenario requirements. For example, in surveying and mapping missions, the camera can be set to acquire 4K image data at a frame rate of 30 frames per second.

[0029] Data preprocessing: The data processing module uses the H.265 algorithm to compress and encode the acquired image data, with a compression ratio controlled between 10:1 and 20:1. While ensuring image quality, the data size is compressed to a suitable range for wireless transmission. Simultaneously, the compressed data is encrypted using the AES-256 algorithm to ensure data transmission security.

[0030] Edge computing processing: The edge computing module uses the NVIDIA Jetson AGX Orin platform to perform object detection on the image before transmission and only uploads the region of interest (ROI) data.

[0031] Data transmission: The 5G millimeter-wave communication module modulates and encodes the pre-processed image data according to the 5G-A NR protocol, and then transmits it through the 5G millimeter-wave band. During transmission, the transmit power and transmission rate are dynamically adjusted according to the communication link quality to ensure reliable data transmission. At the same time, communication link quality parameters are collected in real time and sent to the ground station.

[0032] Flight Control: The flight control module receives flight commands from the ground station, adjusts the UAV's flight attitude, speed, altitude, and other parameters accordingly, and feeds back the UAV's real-time flight status information to the ground station. It integrates a BeiDou short message module, automatically switching to satellite communication when the 5G network is interrupted.

[0033] Ground station workflow Data reception: The 5G millimeter-wave communication module receives image data from the drone, performs demodulation, decoding and other processing, and restores the compressed and encrypted image data.

[0034] Data processing: The data receiving and processing module uses the AES-256 algorithm to decrypt the recovered image data and the H.265 decoding algorithm to decompress it, restoring the original high-definition image data. During processing, the CRC32 checksum algorithm and LDPC error correction code (coding rate ≥ 0.8) are used for data verification and error correction to ensure the integrity and accuracy of the image data.

[0035] Edge server processing: The edge server deploys TensorFlow Serving, updates the communication quality prediction model in real time, receives model parameters from the edge computing module on the drone and synchronizes them.

[0036] Image transmission scheduling: The image transmission scheduling module acquires real-time flight status, communication link quality, and mission information for each UAV. Based on a priority- and communication quality-based resource allocation algorithm (including a reinforcement learning model), it calculates the image transmission resources to be allocated to each UAV, such as transmission bandwidth and transmit power. For UAVs performing emergency rescue missions, high transmission bandwidth is prioritized to ensure timely image transmission. Simultaneously, frequency planning and power control coordinate the millimeter-wave signal transmission of multiple UAVs to avoid interference. The communication quality prediction model is trained using historical communication data (containing over 200,000 samples), employing the Adam optimizer with a learning rate of 0.001, a training cycle of 50 epochs, and a test set MAE ≤ 5 points (out of 100). The reinforcement learning model runs a deep Q-network (DQN) at the ground station. The state space includes 12-dimensional parameters such as UAV position, mission priority, and predicted communication quality, while the action space includes bandwidth allocation levels (1-10 levels). An experience replay mechanism is used to improve training efficiency.

[0037] Identity authentication: Two-way identity authentication between the drone and the device is achieved using blockchain technology (PBFT consensus algorithm).

[0038] Image display: The display module displays the processed high-definition image data, and the operator can view the image information in real time through the monitor, so as to make decisions and adjustments for the UAV flight mission.

[0039] Workflow of 5G millimeter wave communication networks Signal Transmission and Reception: The 5G base station transmits downlink signals to the drone via a millimeter-wave antenna (32T32R) and simultaneously receives uplink signals from the drone. The base station employs beamforming technology, adjusting the antenna array phase to form a directional beam based on the drone's real-time location information (positioning accuracy ≤1 meter). The beam pointing angle tracking accuracy is ≤±2°, increasing the millimeter-wave signal gain by 8-15dB, improving signal directivity and gain, and enhancing signal coverage and transmission quality. The base station integrates millimeter-wave radar to achieve real-time perception of the drone's position and speed.

[0040] Signal processing: The base station demodulates, decodes, and corrects errors in the received signals, extracting image data and UAV status information. Simultaneously, it encodes and modulates the commands and control information to be sent to the UAV before transmitting them via a millimeter-wave antenna. A 3D environment map is constructed using radar echo data.

[0041] Network Management: The 5G network management system monitors and manages the entire 5G millimeter-wave communication network, including base station operating status, signal strength, and interference. Based on network conditions and drone communication needs, it dynamically adjusts network parameters such as bandwidth allocation and power control to ensure stable network operation and efficient communication.

[0042] The foregoing has shown and described the basic principles, main features, and advantages of the present invention. Those skilled in the art should understand that the present invention is not limited to the above embodiments. The embodiments and descriptions in the specification are merely preferred examples and are not intended to limit the invention. Various changes and modifications can be made to the invention without departing from its spirit and scope, and all such changes and modifications fall within the scope of the present invention as claimed. The scope of protection of the present invention is defined by the appended claims and their equivalents.

Claims

A 1.5G millimeter-wave communication-based UAV high-definition image transmission and dispatch system is characterized by: This includes drone terminals, ground station terminals, and 5G millimeter-wave communication networks; The drone terminal includes: The image acquisition module is used to acquire high-definition image data during the flight of the drone; The data processing module preprocesses the high-definition image data acquired by the image acquisition module; The 5G millimeter-wave communication module transmits the image data preprocessed by the data processing module to the ground station via the 5G millimeter-wave communication network, while simultaneously collecting communication link quality parameters in real time. The flight control module controls the UAV's flight attitude and flight path according to the instructions sent from the ground station; The edge computing module integrates the TensorRT framework to perform local computations such as image preprocessing and target recognition, and synchronizes model parameters with the ground station through edge nodes. The ground station includes: The 5G millimeter-wave communication module receives image data sent from the drone. The data receiving and decoding module decompresses and decodes the data received by the 5G millimeter-wave communication module to restore the original high-definition image data. The image transmission scheduling module dynamically allocates image transmission resources and optimizes image transmission paths based on factors such as the mission requirements, flight status, and communication link quality of multiple drones. The display module displays the high-definition image data recovered by the data receiving and processing module; Edge servers are deployed to support real-time data processing and AI model training. They utilize TensorFlowServing to update the communication quality prediction model in real time. The 5G millimeter-wave communication network provides a high-speed and stable communication link to ensure fast and reliable transmission of image data between the UAV and the ground station. It includes 5G base stations and related signal processing equipment, which can efficiently transmit, receive and process millimeter-wave signals. It adopts the 5G-A NR protocol, and the base station integrates millimeter-wave radar to realize real-time perception of the UAV's position and speed, and fuses it with communication link quality data.

2. The 5G millimeter-wave communication UAV high-definition image transmission and dispatch system according to claim 1, characterized in that, The image transmission scheduling module includes: Real-time status monitoring: The drone terminal collects its own flight parameters and communication link quality parameters in real time and sends them to the ground station terminal through the 5G millimeter wave communication network. The ground station terminal simultaneously monitors the mission execution status of each drone. Resource allocation strategy: The image transmission scheduling module adopts a priority-based and communication quality-based resource allocation algorithm based on the received UAV status information and task information. This algorithm introduces a reinforcement learning (DRL) model, takes task priority, communication quality prediction value, and UAV remaining power parameters as input, and outputs the optimal bandwidth allocation scheme. Communication quality prediction: Using an LSTM neural network, input historical signal strength, bit error rate, and environmental parameters, predict the communication quality score for the next 500ms.

3. The 5G millimeter-wave communication UAV high-definition image transmission and dispatch system according to claim 1, characterized in that, The image acquisition module on the drone uses a high-resolution camera with a resolution of ≥4K to acquire high-definition image data at a frame rate of 15-30 frames per second, depending on the drone's flight mission and scenario requirements.

4. The 5G millimeter-wave communication UAV high-definition image transmission and dispatch system according to claim 3, characterized in that, The data processing module on the UAV terminal uses the H.265 algorithm to compress and encode the acquired image data, with a compression ratio controlled between 10:1 and 20:1, and uses the AES-256 algorithm to encrypt the compressed data.

5. The 5G millimeter-wave communication UAV high-definition image transmission and dispatch system according to claim 4, characterized in that, The 5G base station in the 5G millimeter-wave communication network adopts phased array antennas and beamforming technology. Based on the real-time location information of the UAV, the antenna array phase is adjusted to form a directional beam with a beam pointing angle tracking accuracy of ≤±2°, which improves the millimeter-wave signal gain by 8-15dB. At the same time, a three-dimensional environment map is constructed using radar echo data.

6. The 5G millimeter-wave communication UAV high-definition image transmission and dispatch system according to claim 5, characterized in that, The data receiving and processing module at the ground station decrypts the received data using the AES-256 algorithm and decompresses it using the H.265 decoding algorithm. During the processing, it uses the CRC32 check algorithm and LDPC error correction code for data verification and error correction.

7. The 5G millimeter-wave communication UAV high-definition image transmission and dispatch system according to claim 6, characterized in that, The edge computing module on the drone uses the NVIDIA Jetson AGX Orin platform to perform target detection on the image before transmission, and only uploads the region of interest (ROI) data, reducing the transmission volume by 30%-50%.

8. The 5G millimeter-wave communication UAV high-definition image transmission and dispatch system according to claim 7, characterized in that, The edge server at the ground station deploys TensorFlow Serving to update the communication quality prediction model in real time, with a model update cycle of ≤1 minute.

9. The 5G millimeter-wave communication UAV high-definition image transmission and dispatch system according to claim 8, characterized in that, The drone terminal and the ground station terminal use blockchain technology to achieve two-way identity authentication, and the drone terminal integrates a Beidou short message module, which automatically switches to satellite communication when the 5G network is interrupted.

Images