Unmanned aerial vehicle optical detection system

Abstract

The utility model discloses an optical detection system of an unmanned aerial vehicle, which belongs to the technical field of unmanned aerial vehicles, comprises a control unit and a DSP (digital signal processor) controller, solves the technical problem of high-efficiency transmission of video data of multiple cameras of the unmanned aerial vehicle, and adopts a high-integration controller and a buffer to reduce the number of discrete components, so that the system is more compact, and the cost is reduced. The system is simple in structure and lower in power consumption, synchronous processing of infrared and visible light camera data can be achieved through cooperation of the video processing controller and the EISM module, continuity and synchronism of the data are ensured, compatibility and expansibility of the system are improved through unified interface design, hardware design and follow-up maintenance are simplified, STM32F407VG is used as a communication controller, and the cost is reduced. And asynchronous communication is carried out through an RS422 bus, so that real-time communication between the flight control module and the microwave module is ensured, and efficient transmission of data is ensured.

Description

Technical Field

[0001] The utility model belongs to the technical field of unmanned aerial vehicles (UAVs), and in particular relates to an optical detection system for UAVs. Background Art

[0002] At present, drones are widely used in the field of optical detection, especially in disaster monitoring and environmental surveys.

[0003] The UAV dual-optical pod system uses a high-precision two-axis carrier turntable, which can control a visible light camera and an infrared camera to capture video of the target. The two-axis carrier turntable is also equipped with a microwave controller for communication with ground control.

[0004] Existing drone video data acquisition boards usually consist of multiple discrete processing modules, such as an independent video processing unit, a communication unit, and a control unit.

[0005] These technologies have the following problems in practical applications:

[0006] Low data transmission efficiency: The data transmission interface between different modules is complex and prone to delays.

[0007] Poor synchronization: The synchronization processing capability of multiple cameras is weak, which easily leads to data frame loss or asynchrony.

[0008] Inconsistent interfaces: Conversion between multiple interfaces is cumbersome, increasing the difficulty of design and maintenance. Utility Model Content

[0009] The purpose of the utility model is to provide an optical detection system for unmanned aerial vehicles (UAVs), which solves the technical problem of efficient transmission of video data from multiple cameras of UAVs.

[0010] In order to achieve the above purpose, the present invention adopts the following technical solutions:

[0011] An optical detection system for a drone includes a control unit and a DSP controller. The control unit includes a video data processing unit, a communication unit, and a camera control unit. The video data processing unit is connected to an infrared camera and a visible light camera of the drone, respectively, and is also connected to the DSP controller.

[0012] The communication unit is connected to the flight control module and microwave module of the UAV respectively, and the communication unit is also connected to the DSP controller;

[0013] The camera control unit is connected to the infrared camera, visible light camera and turntable controller of the UAV respectively, and the camera control unit is also connected to the DSP controller.

[0014] Preferably, the video data processing unit includes an ITU buffer, a YUV buffer, a video processing controller, an EISM module and a YUV interface, the input end of the ITU buffer and the input end of the YUV buffer are respectively connected to the infrared camera and the visible light camera, the output end of the ITU buffer and the output end of the YUV buffer are both connected to the video processing controller, the video processing controller is also connected to the EISM module, the EISM module is connected to the YUV interface, and the YUV interface is connected to the DSP controller.

[0015] Preferably, the models of the ITU buffer and the YUV buffer are both MT41K256M16HA-125, the model of the video processing controller is XC7Z010-1CLG400C, and the model of the EISM module is ADV7181D.

[0016] Preferably, the communication unit includes a communication controller, an asynchronous transceiver A and an asynchronous transceiver B, the asynchronous transceiver A is connected to the flight control module via an RS422 bus, the asynchronous transceiver B is connected to the microwave module via an RS422 bus, both the asynchronous transceiver A and the asynchronous transceiver B are connected to the communication controller, and the communication controller is connected to the DSP controller via an SSPI interface.

[0017] Preferably, the model of the communication controller is STM32F407VG, and the models of the asynchronous receiver and transmitter A and the asynchronous receiver and transmitter B are both SN75179B.

[0018] Preferably, the camera control unit includes a camera controller, a serial port module and an asynchronous transceiver C. The serial port module is connected to the infrared camera and the visible light camera respectively through two RS232 buses. The serial port module is also connected to the camera controller. The asynchronous transceiver C is connected to the turntable controller through the RS422 bus. The asynchronous transceiver is also connected to the camera controller. The camera controller is connected to the DSP controller through the MSPI interface.

[0019] Preferably, the model of the camera controller is Xilinx Zynq-7000 SoC, the model of the serial port module is Exar XR16V798, and the model of the asynchronous receiver and transmitter C is SN75179B.

[0020] Preferably, the video data processing unit, the communication unit, the camera control unit and the DSP controller are all powered by a battery pack of the drone.

[0021] The utility model discloses an optical detection system for unmanned aerial vehicles (UAVs), which solves the technical problem of efficient transmission of video data from multiple cameras of UAVs. The utility model uses a highly integrated controller and buffer, reduces the number of discrete components, makes the system more compact, and reduces power consumption. The cooperation between the video processing controller and the EISM module can realize the synchronous processing of infrared and visible light camera data, ensuring the continuity and synchronization of data. Through the unified interface design, the compatibility and scalability of the system are improved, and the hardware design and subsequent maintenance are simplified. The STM32F407VG is used as the communication controller, and asynchronous communication is performed through the RS422 bus, which ensures real-time communication between the flight control module and the microwave module, and guarantees efficient data transmission. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] Figure 1 It is a system architecture diagram of the utility model;

[0023] Figure 2 It is a principle diagram block diagram of the utility model. DETAILED DESCRIPTION

[0024] Depend on Figure 1-Figure 2 The optical detection system of a drone shown in the figure includes a control unit and a DSP controller. The control unit includes a video data processing unit, a communication unit and a camera control unit. The video data processing unit, the communication unit, the camera control unit and the DSP controller are all powered by the battery pack of the drone.

[0025] The video data processing unit is connected to the infrared camera and visible light camera of the UAV respectively, and the video data processing unit is also connected to the DSP controller;

[0026] The video data processing unit includes an ITU buffer, a YUV buffer, a video processing controller, an EISM module and a YUV interface. The input end of the ITU buffer and the input end of the YUV buffer are respectively connected to the infrared camera and the visible light camera. The output end of the ITU buffer and the output end of the YUV buffer are both connected to the video processing controller. The video processing controller is also connected to the EISM module. The EISM module is connected to the YUV interface, and the YUV interface is connected to the DSP controller.

[0027] The models of the ITU buffer and the YUV buffer are both MT41K256M16HA-125, the model of the video processing controller is XC7Z010-1CLG400C, and the model of the EISM module is ADV7181D.

[0028] In this embodiment, the ITU buffer (MT41K256M16HA-125) is used to store and buffer data from the infrared camera to ensure smooth transmission and processing of the data stream.

[0029] The YUV buffer (MT41K256M16HA-125) is used to store and buffer data from the visible light camera, similar to the function of the ITU buffer.

[0030] In this embodiment, the infrared camera and the visible light camera are connected to and communicate with the ITU buffer and the YUV buffer respectively through their respective digital video interfaces. The digital video interface can be a BT.656 interface, a BT.1120 interface or a MIPI CSI camera serial interface.

[0031] The video processing controller (XC7Z010-1CLG400C) is responsible for secondary processing of video data from infrared cameras and visible light cameras. Secondary processing can be customized according to customer needs, such as data formatting and synchronization, to ensure that video data can be transmitted to the DSP controller.

[0032] The EISM module (ADV7181D) is responsible for synchronizing the video data from the infrared camera and the visible light camera to ensure synchronization between multiple video sources.

[0033] The YUV interface is responsible for transmitting video data to the DSP controller, which can be used for further video encoding processing, such as H264 encoding processing.

[0034] The communication unit is connected to the flight control module and microwave module of the UAV respectively, and the communication unit is also connected to the DSP controller;

[0035] The communication unit includes a communication controller, an asynchronous transceiver A and an asynchronous transceiver B. The asynchronous transceiver A is connected to the flight control module via an RS422 bus, the asynchronous transceiver B is connected to the microwave module via an RS422 bus, both the asynchronous transceiver A and the asynchronous transceiver B are connected to the communication controller, and the communication controller is connected to the DSP controller via an SSPI interface.

[0036] The model of the communication controller is STM32F407VG, and the models of the asynchronous receiver / transmitter A and the asynchronous receiver / transmitter B are both SN75179B.

[0037] In the present embodiment, the communication controller (STM32F407VG) is the core unit of communication, which is responsible for controlling the communication with the flight control module and the microwave module. Specifically, it can be connected with asynchronous receiver and transmitter A and asynchronous receiver and transmitter B through the RS422 interface, and communicate with the flight control module and the microwave module through these two asynchronous receivers to ensure the real-time transmission of data and the correct execution of instructions. The data after communication can be output to the DSP controller for buffering or user-defined secondary development processing.

[0038] The camera control unit is connected to the infrared camera, visible light camera and turntable controller of the UAV respectively, and the camera control unit is also connected to the DSP controller.

[0039] The camera control unit includes a camera controller, a serial port module and an asynchronous transceiver C. The serial port module is connected to the infrared camera and the visible light camera respectively through two RS232 buses. The serial port module is also connected to the camera controller. The asynchronous transceiver C is connected to the turntable controller through the RS422 bus. The asynchronous transceiver is also connected to the camera controller. The camera controller is connected to the DSP controller through the MSPI interface.

[0040] The model of the camera controller is Xilinx Zynq-7000 SoC, the model of the serial port module is ExarXR16V798, and the model of the asynchronous receiver and transmitter C is SN75179B.

[0041] In this embodiment, the camera controller (Xilinx Zynq-7000 SoC) is responsible for controlling the actions of the camera and turntable, and communicates with the DSP controller through the MSPI interface. In actual application, the DSP controller can issue control instructions and other protocol instructions related to controlling the camera and turntable to the camera controller according to user needs. The camera controller forwards these protocol instructions to the camera and turntable, thereby realizing control of the camera and turntable.

[0042] The serial port module (Exar XR16V798) is connected to the CAM port of the infrared camera and the CAM port of the visible light camera through the RS232 interface, and is used to receive and send protocol instructions related to camera control, such as control instructions, working status, error reports, etc.

[0043] The asynchronous receiver-transmitter C (SN75179B) is connected to the turntable controller via the RS422 bus and is used to receive and send protocol instructions related to the control of the turntable.

[0044] The utility model discloses an optical detection system for unmanned aerial vehicles (UAVs), which solves the technical problem of efficient transmission of video data from multiple cameras of UAVs. The utility model uses a highly integrated controller and buffer, reduces the number of discrete components, makes the system more compact, and reduces power consumption. The cooperation between the video processing controller and the EISM module can realize the synchronous processing of infrared and visible light camera data, ensuring the continuity and synchronization of data. Through the unified interface design, the compatibility and scalability of the system are improved, and the hardware design and subsequent maintenance are simplified. The STM32F407VG is used as the communication controller, and asynchronous communication is performed through the RS422 bus, which ensures real-time communication between the flight control module and the microwave module, and guarantees efficient data transmission.

Claims

1. An optical detection system for unmanned aerial vehicles, characterized by: It includes a control unit and a DSP controller. The control unit includes a video data processing unit, a communication unit and a camera control unit. The video data processing unit is connected to the infrared camera and the visible light camera of the drone respectively, and the video data processing unit is also connected to the DSP controller. The communication unit is connected to the flight control module and microwave module of the UAV respectively, and the communication unit is also connected to the DSP controller; The camera control unit is connected to the infrared camera, visible light camera and turntable controller of the UAV respectively, and the camera control unit is also connected to the DSP controller.

2. The optical detection system for drones according to claim 1, wherein: The video data processing unit includes an ITU buffer, a YUV buffer, a video processing controller, an EISM module and a YUV interface. The input end of the ITU buffer and the input end of the YUV buffer are respectively connected to the infrared camera and the visible light camera. The output end of the ITU buffer and the output end of the YUV buffer are both connected to the video processing controller. The video processing controller is also connected to the EISM module. The EISM module is connected to the YUV interface, and the YUV interface is connected to the DSP controller.

3. The optical detection system for unmanned aerial vehicles according to claim 2, wherein: The models of the ITU buffer and the YUV buffer are both MT41K256M16HA-125, the model of the video processing controller is XC7Z010-1CLG400C, and the model of the EISM module is ADV7181D.

4. The optical detection system for unmanned aerial vehicles according to claim 1, wherein: The communication unit includes a communication controller, an asynchronous transceiver A and an asynchronous transceiver B. The asynchronous transceiver A is connected to the flight control module via an RS422 bus, the asynchronous transceiver B is connected to the microwave module via an RS422 bus, both the asynchronous transceiver A and the asynchronous transceiver B are connected to the communication controller, and the communication controller is connected to the DSP controller via an SSPI interface.

5. The optical detection system for unmanned aerial vehicles according to claim 4, wherein: The model of the communication controller is STM32F407VG, and the models of the asynchronous receiver / transmitter A and the asynchronous receiver / transmitter B are both SN75179B.

6. The optical detection system for unmanned aerial vehicles according to claim 1, wherein: The camera control unit includes a camera controller, a serial port module and an asynchronous transceiver C. The serial port module is connected to the infrared camera and the visible light camera respectively through two RS232 buses. The serial port module is also connected to the camera controller. The asynchronous transceiver C is connected to the turntable controller through the RS422 bus. The asynchronous transceiver is also connected to the camera controller. The camera controller is connected to the DSP controller through the MSPI interface.

7. The optical detection system for unmanned aerial vehicles according to claim 6, wherein: The model of the camera controller is Xilinx Zynq-7000 SoC, the model of the serial port module is Exar XR16V798, and the model of the asynchronous receiver and transmitter C is SN75179B.

8. The optical detection system for unmanned aerial vehicles according to claim 1, wherein: The video data processing unit, the communication unit, the camera control unit and the DSP controller are all powered by the battery pack of the drone.

Images