Rapid image transmission circuit of unmanned aerial vehicle

Abstract

The utility model relates to the technical field of unmanned aerial vehicles, in particular to a rapid image transmission circuit of an unmanned aerial vehicle. The system comprises an image acquisition module, an image processing and coding module, a wireless transmission module, a receiving end decoding module and a power management control module. The image acquisition module comprises a high-end camera and a high-resolution CMOS sensor and is used for capturing video images. The image processing and encoding module comprises an STM32F4 single-chip microcomputer, an H.265 hardware encoder and an ISP unit, and is used for efficiently processing and encoding image data. And the wireless transmission module comprises a 5G communication module and is used for sending the encoded image data to a cloud streaming media server. The receiving end decoding module comprises a decoding chip and a display device and is used for receiving and decoding the image data. The power management control module comprises a power management unit and a control module, and manages the power supply and control of the system. According to the utility model, the problems of high transmission delay and unstable transmission quality are solved, and efficient and stable image transmission and real-time control are realized.

Description

Technical Field

[0001] The utility model relates to the technical field of unmanned aerial vehicles (UAVs), in particular to a fast image transmission circuit for UAVs. Background Art

[0002] In recent years, drone technology has experienced rapid development, finding widespread application in a variety of fields, including aerial photography, agricultural monitoring, environmental monitoring, logistics distribution, and security surveillance. The use of drones not only improves work efficiency but also expands human vision and operational scope. However, with this expanding range of applications, the requirements for drone image transmission are becoming increasingly stringent, particularly in terms of real-time performance and transmission quality. While existing drone image transmission technologies have made considerable progress, some shortcomings remain.

[0003] First, existing drone image transmission systems suffer from high latency over long distances, making them incapable of meeting the demands of real-time applications such as security monitoring and emergency rescue. This is primarily due to the slow transmission speeds of existing communication technologies when processing large amounts of data, which impacts the real-time nature of image transmission. Second, existing communication technologies are susceptible to interference in complex electromagnetic environments, resulting in degraded image transmission quality, including lags and frame drops. Utility Model Content

[0004] The purpose of the utility model is to provide a fast image transmission circuit for a drone to solve the problems of high transmission delay and unstable transmission quality in the prior art.

[0005] To achieve the above objectives, a fast image transmission circuit for a drone is provided, comprising an image acquisition module, an image processing and encoding module, a wireless transmission module, a receiving-end decoding module, and a power management and control module. The image acquisition module is connected to the image processing and encoding module, which is connected to the wireless transmission module. The wireless transmission module is connected to the receiving-end decoding module via a cloud streaming media server. The power management and control module is connected to the image acquisition module, the image processing and encoding module, the wireless transmission module, and the receiving-end decoding module.

[0006] The image acquisition module is used to capture video images, including a high-end camera and a high-resolution CMOS sensor;

[0007] The image processing and encoding module is used to process and encode image data, including an STM32F4 microcontroller, an H.265 hardware encoder and an ISP unit;

[0008] The wireless transmission module is used to send the encoded image data to the cloud streaming server, including a 5G communication module and a Wi-Fi module;

[0009] The receiving end decoding module is used to receive and decode image data from the cloud streaming server, including a decoding chip and a display device;

[0010] The power management control module is used to manage the power and control of the system, and includes a power management unit and a control module.

[0011] As a further improvement of the present technical solution, the high-end camera in the image acquisition module is connected to a high-resolution CMOS sensor, and the high-resolution CMOS sensor is connected to an STM32F4 single-chip microcomputer in the image processing and encoding module.

[0012] As a further improvement of this technical solution, the STM32F4 single-chip microcomputer in the image processing and encoding module is connected to the H.265 hardware encoder, and the H.265 hardware encoder is connected to the ISP unit.

[0013] As a further improvement of this technical solution, the 5G communication module in the wireless transmission module is connected to the STM32F4 single-chip microcomputer in the image processing and coding module, and the Wi-Fi module is connected to the STM32F4 single-chip microcomputer in the image processing and coding module.

[0014] As a further improvement of the present technical solution, the decoding chip in the receiving-end decoding module is connected to the display device, and the decoding chip is connected to the cloud streaming media server via a network.

[0015] As a further improvement of the present technical solution, the power management unit in the power management control module is connected to the image acquisition module, the image processing and encoding module, the wireless transmission module and the receiving end decoding module, and the control module is connected to the image acquisition module, the image processing and encoding module, the wireless transmission module and the receiving end decoding module.

[0016] As a further improvement of the present technical solution, the NRF wireless communication module in the control module is connected to the STM32F4 single chip microcomputer in the image processing and encoding module.

[0017] Compared with the prior art, the present invention has the following beneficial effects:

[0018] 1. The drone's fast image transmission circuit utilizes an STM32F4 microcontroller in the image processing and encoding module, in conjunction with an H.265 hardware encoder and an ISP unit, to achieve efficient image data processing and encoding. The H.265 hardware encoder utilizes advanced compression algorithms, significantly reducing the amount of transmitted data and improving transmission efficiency. The ISP unit performs image optimization, such as anti-shake and denoising, to ensure image quality.

[0019] 2. The drone's fast image transmission circuit achieves long-distance, low-latency, and high-bandwidth image transmission through the collaboration of a 5G communication module in the wireless transmission module and an STM32F4 microcontroller in the image processing and encoding module. The introduction of 5G communication technology significantly improves the stability and real-time performance of image transmission, meeting the requirements of beyond-visual-range operations.

[0020] 3. The drone's fast image transmission circuit utilizes an NRF wireless communication module in the control module in conjunction with an STM32F4 microcontroller in the image processing and encoding module to achieve short-range, low-power, and low-latency control command transmission. The NRF wireless communication module's low power consumption helps extend the drone's flight time, while its low latency ensures the timeliness and accuracy of control commands. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] Figure 1 It is a schematic block diagram of the overall structure of the utility model;

[0022] Figure 2 This is the connection circuit diagram of the STM32F411CE chip and the HiSilicon HI3519AV100 chip of the utility model;

[0023] Figure 3 This is a circuit diagram of the power management unit of the utility model;

[0024] Figure 4 This is the H.265 video encoding framework diagram. DETAILED DESCRIPTION

[0025] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the embodiments described are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of the present invention.

[0026] In the description of the present invention, it should be understood that the terms "center", "longitudinal", "lateral", "length", "width", "thickness", "up", "down", "front", "back", "left", "right", "vertical", "horizontal", "top", "bottom", "inside", "outside", "clockwise", "counterclockwise" and the like to indicate orientations or positional relationships based on the orientations or positional relationships shown in the accompanying drawings, and are only for the convenience of describing the present invention and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore should not be understood as a limitation on the present invention.

[0027] Furthermore, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of the technical features being referred to. Thus, a feature specified as "first" or "second" may explicitly or implicitly include one or more of such features. In the description of this utility model, "plurality" means two or more, unless otherwise specifically defined.

[0028] See also Figure 1-4 As shown, the purpose of this embodiment is to provide a fast image transmission circuit for a drone, including an image acquisition module, an image processing and encoding module, a wireless transmission module, a receiving-end decoding module and a power management control module. The image acquisition module is connected to the image processing and encoding module, the image processing and encoding module is connected to the wireless transmission module, the wireless transmission module is connected to the receiving-end decoding module through a cloud streaming media server, and the power management control module is connected to the image acquisition module, the image processing and encoding module, the wireless transmission module and the receiving-end decoding module.

[0029] The image acquisition module consists of a high-end camera and a high-resolution CMOS sensor. The high-end camera is a GoPro HERO4 outdoor sports satellite HD camera, capable of recording 1440p, 1080p, and 720p videos, supporting high resolution and high frame rates, ensuring video quality. The camera is mounted on a drone and secured by a robotic arm and gimbal to ensure stability during filming. The high-resolution CMOS sensor uses the Sony IMX377, featuring high resolution and sensitivity, effectively converting optical images into electrical signals, providing high-quality image data. The high-end camera connects to the high-resolution CMOS sensor via the CSI interface, which in turn connects to the STM32F4 microcontroller in the image processing and encoding module via the MIPI CSI-2 interface, forming an efficient image acquisition and processing system.

[0030] The image processing and encoding module consists of an STM32F4 MCU, an H.265 hardware encoder, and an ISP unit. The STM32F4 MCU, as the core processor, uses the STM32F411CE chip with a main frequency of 440MHz. It has powerful data processing capabilities and is primarily responsible for image data preprocessing and control logic. The H.265 hardware encoder is based on the HiSilicon HI3519AV100 video processing chip, which has a built-in advanced H.265 hardware encoder that can significantly reduce the amount of transmitted data and improve transmission efficiency. Figure 2As shown in the figure, the main interfaces connecting the STM32F411CE chip and the HiSilicon HI3519AV100 video processing chip are: the I2C interface is used for low-speed data transmission and is usually used for configuration and control tasks; the SPI interface is used for high-speed data transmission and is suitable for fast exchange of video data; the UART interface provides an asynchronous serial communication method that can be used to output debugging information or communicate with other serial devices; the GPIO interface provides general input and output functions and can be used for various custom control signals or status indications. Figure 4 As shown in the figure, the encoder first divides the input image into pixel blocks of different sizes, and then uses the spatial and temporal similarity of the video screen to compress the picture through intra-frame prediction and inter-frame prediction. It then uses frequency domain correlation to perform variation coding and quantization on the predicted residual value. It then performs entropy coding on the quantized transform coefficients and other related parameter information such as motion mode. It uses entropy coding to eliminate statistical redundancy in the output signal, and uses a low-pass filter to remove ringing and blocking effects in the picture, and finally outputs a binary code stream.

[0031] The ISP unit, also integrated into the HiSilicon HI3519AV100 chip, is dedicated to performing image optimization tasks such as stabilization, denoising, and color correction to ensure final image quality. The high-resolution CMOS sensor connects to the STM32F4 microcontroller via the MIPI CSI-2 interface. The STM32F4 microcontroller communicates with the H.265 hardware encoder via the SPI interface, which in turn interacts with the ISP unit via the I2C interface. The STM32F4 microcontroller runs an image preprocessor that implements functions such as image cropping, scaling, and color correction to ensure that the image data meets encoding requirements. After preprocessing, the STM32F4 microcontroller sends the image data to the H.265 hardware encoder for efficient compression, generating an H.265 encoded stream. Furthermore, the ISP unit performs further optimization on the image data to ensure optimal output image quality.

[0032] The wireless transmission module consists of a 5G communication module and a Wi-Fi module, designed to provide a flexible and reliable solution for both long- and short-range data transmission. The 5G communication module uses the ZTE ZM9000 module, which supports the 5G NR sub-6GHz frequency band and offers high-speed, low-latency communication performance, making it suitable for long-distance data transmission. The Wi-Fi module uses the ESP32-CAM, which supports the 2.4GHz Wi-Fi standard and is primarily designed for short-range data transmission, serving as a complementary solution to 5G communication. Both modules connect to the STM32F4 microcontroller in the image processing and encoding module via a USB interface, which controls the data transmission process. Specifically, the 5G communication module connects to the cloud streaming server via a dedicated 4G / 5G antenna, while the Wi-Fi module communicates with the local receiving device via a 2.4GHz antenna. The data transmission control program running on the STM32F4 microcontroller ensures that H.265-encoded image data is efficiently and accurately transmitted to the target location through either module. To ensure the reliability of data transmission, the 5G communication module uses the TCP / IP protocol, while the Wi-Fi module uses the UDP protocol. The combination of the two ensures both the speed and stability of data transmission.

[0033] The receiving-end decoding module includes a decoding chip and a display device. The decoding chip uses AmlogicS905D3, supports H.265 decoding, and provides high-performance decoding capabilities. The decoding chip receives the encoded image data from the cloud streaming server, decodes it, and restores it to the original video signal. The decoded video signal is transmitted to the display device via the HDMI interface for real-time display. The decoding chip is connected to the cloud streaming server via a network interface to ensure real-time data transmission. The display device uses a 1080p high-definition display, receives the decoded video signal through the HDMI interface, and provides a clear display effect. During the entire process, the decoding chip runs the decoding program, receives the encoded image data from the cloud streaming server, decodes it, and restores it to the original video signal. The decoded video signal is transmitted to the display device via the HDMI interface to provide real-time display.

[0034] The power management control module includes a power management unit and a control module. Figure 3As shown, the power management unit uses the TPS62056 chip, responsible for supplying power to each module, supporting multiple power outputs and providing efficient power management. It controls the voltage conversion process. The input voltage is first filtered by a 10μF capacitor C1 to reduce power supply noise. The voltage then enters the VIN pin of the TPS62056 chip. The chip's EN pin is connected to the input voltage through a 130kΩ resistor R5 and a 100kΩ resistor R6 to set the enable voltage, ensuring the chip starts at the appropriate voltage. The TPS62056's SW pin is connected to a 10μH inductor L1, a key component of the buck converter, used for energy storage and current smoothing. The other end of the inductor is connected to two 1MΩ resistors R3 and R4, which form a feedback network that feeds a portion of the output voltage back to the FB pin to regulate output voltage stability. The output voltage is further stabilized by an 820kΩ resistor R1 and a 91kΩ resistor R2, and filtered by a 6.8pF capacitor C2 and a 22μF capacitor C3 to reduce output noise and ripple. These components together ensure the stability and purity of the output voltage.

[0035] The power management unit connects to the STM32F4 microcontroller via the I2C interface. The STM32F4 microcontroller controls the power supply to each module, ensuring low-power operation and extending the drone's flight time. The control module, which includes the NRF wireless communication module, is responsible for receiving remote control commands, controlling the drone's flight, and acquiring images. It uses the NRF24L01 chip and connects to the STM32F4 microcontroller via the SPI interface, enabling real-time communication between the remote control and the drone. The control module receives remote control commands, controls the drone's flight, and acquires images, ensuring overall system coordination and control, and improving system stability and reliability. The STM32F4 microcontroller also runs the power management and control program, including control of the power management unit and communication with the NRF wireless communication module.

[0036] The above shows and describes the basic principles, main features, and advantages of the present invention. Those skilled in the art should understand that the present invention is not limited to the above embodiments. The above embodiments and descriptions are merely preferred examples of the present invention and are not intended to limit the present invention. Various changes and improvements may be made to the present invention without departing from the spirit and scope of the present invention, and such changes and improvements fall within the scope of the present invention. The scope of protection claimed in the present invention is defined by the appended claims and their equivalents.

Claims

1. The fast image transmission circuit of the UAV is characterized by: It includes an image acquisition module, an image processing and encoding module, a wireless transmission module, a receiving end decoding module and a power management control module. The image acquisition module is connected to the image processing and encoding module, the image processing and encoding module is connected to the wireless transmission module, the wireless transmission module is connected to the receiving end decoding module via a cloud streaming media server, and the power management control module is connected to the image acquisition module, the image processing and encoding module, the wireless transmission module and the receiving end decoding module; The image acquisition module is used to capture video images, including a high-end camera and a high-resolution CMOS sensor; The image processing and encoding module is used to process and encode image data, including an STM32F4 microcontroller, an H.265 hardware encoder and an ISP unit; The wireless transmission module is used to send the encoded image data to the cloud streaming server, including a 5G communication module and a Wi-Fi module; The receiving end decoding module is used to receive and decode image data from the cloud streaming server, including a decoding chip and a display device; The power management control module is used to manage the power and control of the system, and includes a power management unit and a control module.

2. The fast image transmission circuit for a drone according to claim 1, characterized in that: The high-end camera in the image acquisition module is connected to a high-resolution CMOS sensor, and the high-resolution CMOS sensor is connected to an STM32F4 single-chip microcomputer in the image processing and coding module.

3. The fast image transmission circuit for a drone according to claim 2, characterized in that: The STM32F4 single-chip microcomputer in the image processing and coding module is connected to the H.265 hardware encoder, and the H.265 hardware encoder is connected to the ISP unit.

4. The fast image transmission circuit for a drone according to claim 1, characterized in that: The 5G communication module in the wireless transmission module is connected to the STM32F4 single-chip microcomputer in the image processing and coding module, and the Wi-Fi module is connected to the STM32F4 single-chip microcomputer in the image processing and coding module.

5. The fast image transmission circuit for a drone according to claim 1, characterized in that: The decoding chip in the receiving end decoding module is connected to the display device, and the decoding chip is connected to the cloud streaming media server through the network.

6. The fast image transmission circuit for a drone according to claim 1, characterized in that: The power management unit in the power management control module is connected to the image acquisition module, image processing and encoding module, wireless transmission module and receiving end decoding module, and the control module is connected to the image acquisition module, image processing and encoding module, wireless transmission module and receiving end decoding module.

7. The fast image transmission circuit for a drone according to claim 1, characterized in that: The NRF wireless communication module in the control module is connected to the STM32F4 single-chip microcomputer in the image processing and coding module.

Images