Airborne portable medium-wave refrigeration infrared acquisition device

Abstract

An airborne portable medium-wave refrigeration infrared acquisition device adopts a medium-wave refrigeration thermal infrared imager as a detection subsystem, performs medium-wave infrared data acquisition on a target and a background, and completes photoelectric load optical axis stabilization and optical axis motion driving through a high-precision three-axis stabilization platform. Therefore, the airborne portable medium-wave refrigeration infrared acquisition device can acquire stable and clear images in an airborne environment. One path of infrared image is compressed and returned in real time, one path of image display observation and remote control of the airborne portable medium-wave refrigeration infrared acquisition device are completed through a ground workstation, and meanwhile, the remote camera image storage and deletion functions are achieved, and acquired original image data can be stored in an internal solid state disk of an image storage module in real time; the storage data comprises GPS coordinates, time and attitude information and can be copied to a ground workstation through a reserved data transmission interface. The storage function of the original infrared image and the unmanned aerial vehicle flight control information is added, the operation is convenient, and the use process is greatly simplified.

Description

Technical Field

[0001] This application relates to the field of infrared acquisition device technology, and in particular to an airborne portable mid-wave cooled infrared acquisition device. Background Technology

[0002] In existing technologies, drone platforms are widely used due to their flexibility and are equipped with various application platforms.

[0003] However, it is precisely the flexibility of the drone platform that makes it difficult for the various application platforms it carries to transmit data via wired connections and to maintain stable data exchange with other parts of the device. Specifically, as the drone platform rotates flexibly, it pulls on the data cable. Over time, the data cable ages rapidly due to the mechanical rotation, leading to data transmission interruptions or errors.

[0004] Therefore, there is an urgent need for an airborne portable mid-wave cooled infrared acquisition device that adopts a new data transmission method and solves various problems caused by data cable transmission. Utility Model Content

[0005] This application provides an airborne portable mid-wave cooled infrared data acquisition device. By setting up a network switch, data from the integrated control component, the mid-wave cooled infrared thermal imager, and the servo stabilization platform are uniformly transmitted to the network switch. The data is then wirelessly transmitted to the image processing module via the network switch. This achieves stable wireless data transmission. The specific technical solution is as follows:

[0006] An airborne portable mid-wave cooled infrared acquisition device, the device comprising: a mid-wave cooled infrared thermal imager, a servo stabilization platform, an integrated control component, an image processing module, and a network switch;

[0007] The mid-wave cooled infrared thermal imager is electrically connected to the integrated control component, and the integrated control component is electrically connected to the servo stabilization platform; the mid-wave cooled infrared thermal imager is signal-connected to the network switch, the image processing module is signal-connected to the network switch, and the integrated control component is signal-connected to the network switch.

[0008] The mid-wave cooled infrared thermal imager acquires a raw mid-wave infrared image of the target and transmits it to the network switch. The network switch then sends the raw mid-wave infrared image to the image processing module. The integrated control component determines servo control information based on the flight control attitude and position information and acquires servo feedback information from the servo stabilization platform. The integrated control component sends the flight control attitude and position information and the servo feedback information to the network switch, which in turn sends them to the image processing module. The image processing module performs data processing on the raw mid-wave infrared image based on the flight control attitude and position information and the servo feedback information to eliminate the influence of the servo stabilization platform and flight jitter on the image.

[0009] In another embodiment of this application, the device further includes: an image storage module;

[0010] The image storage module is connected to the image processing module, and the image storage module is used to store the original mid-wave infrared image.

[0011] In another embodiment of this application, the servo stabilization platform adopts a three-axis stabilization platform load mode and uses a universal quick-release installation structure that can be quickly disassembled and installed.

[0012] In another embodiment of this application, the servo stabilization platform adopts external synchronization control, which can effectively control the mid-wave cooled infrared image synchronization function, making it easier for the UAV attitude information to achieve precise alignment.

[0013] In another embodiment of this application, the mid-wave cooled infrared thermal imager is used to store GPS information, attitude information and time information of the UAV platform POS system, and to store raw mid-wave image storage and target information, target flight characteristics and communication commands in real time.

[0014] In another embodiment of this application, the device further includes: a secondary power supply;

[0015] The secondary power supply converts the onboard power into the power required inside the platform cabin, and filters and isolates the power to improve the electromagnetic compatibility of the system. It is used to power the mid-wave infrared thermal imager, the integrated control component, the image processing module, and the image storage module.

[0016] In another embodiment of this application, the network switch enables the interconnection of interfaces within the airborne portable mid-wave cooled infrared acquisition device via a gigabit network, allowing for real-time data and image exchange.

[0017] In another embodiment of this application, the detector material of the mid-wave cooled infrared thermal imager is mercury cadmium telluride.

[0018] In another embodiment of this application, the detector of the mid-wave cooled infrared thermal imager is externally synchronized to ensure consistent image timing.

[0019] In another embodiment of this application, the image processing module adopts an FPGA+DSP+ARM architecture.

[0020] The beneficial effects of this utility model are as follows:

[0021] This application provides an airborne portable mid-wave cooled infrared data acquisition device. By setting up a network switch, data from the integrated control component, the mid-wave cooled infrared thermal imager, and the servo stabilization platform are uniformly transmitted to the network switch. The data is then wirelessly transmitted to the image processing module via the network switch. This achieves stable wireless data transmission.

[0022] Furthermore, during image acquisition, mid-wave cooled infrared thermal imagers suffer from image blurring due to drone vibration and servo stabilization platform rotation. Existing technologies address this by mechanically stabilizing the imager with a servo stabilization platform and deblurring the image data using algorithms. This solution addresses this by real-time acquisition of drone flight trends and servo stabilization platform rotation trends to directionally eliminate blurry data in the image, achieving real-time high-definition image acquisition. Attached Figure Description

[0023] Figure 1 This is a schematic diagram showing the connections of various modules in an airborne portable mid-wave cooled infrared acquisition device.

[0024] Figure 2 Three-view diagram of an airborne portable mid-wave cooled infrared acquisition device;

[0025] Figure 3 This is one of the structural schematic diagrams of an airborne portable mid-wave cooled infrared acquisition device;

[0026] Figure 4 This is one of the structural schematic diagrams of an airborne portable mid-wave cooled infrared acquisition device;

[0027] Figure 5 This is one of the structural schematic diagrams of an airborne portable mid-wave cooled infrared acquisition device;

[0028] Figure 6 This is one of the structural schematic diagrams of an airborne portable mid-wave cooled infrared acquisition device;

[0029] Figure 7 This is one of the structural schematic diagrams of an airborne portable mid-wave cooled infrared acquisition device;

[0030] Figure 8 This is a flowchart illustrating the operation of an airborne portable mid-wave cooled infrared data acquisition device.

[0031] Figure 9 This is a flowchart illustrating the deblurring steps of an airborne portable mid-wave cooled infrared acquisition device.

[0032] The system comprises: 1. Mid-wave cooled infrared thermal imager; 2. Servo stabilization platform; 3. Integrated control components; 4. Image processing module; 5. Image storage module; 6. Secondary power supply; 7. Network switch; 8. System structure; and 9. Quick-release installation structure. Detailed Implementation

[0033] To make the objectives, technical solutions, and advantages of this specification clearer, the technical solutions of this application will be clearly and completely described below in conjunction with specific embodiments and corresponding drawings. Obviously, the described embodiments are only a part of the embodiments in this specification, and not all of them. All other embodiments obtained by those skilled in the art based on the embodiments in this application without creative effort are within the scope of protection of this document.

[0034] The following combination Figure 1-9 This specification provides a detailed description of the technical solutions provided in each embodiment. Specific Implementation Example 1:

[0036] The purpose of this application is to provide an airborne portable mid-wave cooled infrared acquisition device as a key device for detecting typical targets and acquiring data. The system uses a mid-wave cooled infrared thermal imager as the detection subsystem to acquire mid-wave infrared data of the target and background. A high-precision three-axis stabilization platform is used to stabilize the optical axis of the photoelectric payload and drive its optical axis movement, thereby ensuring that the airborne portable mid-wave cooled infrared acquisition device can acquire stable and clear images in the airborne environment. One infrared image is compressed and transmitted back in real time. One image is displayed and observed through a ground workstation, and the airborne portable mid-wave cooled infrared acquisition device can be remotely controlled. It also has remote camera image storage and deletion functions, and can store the acquired raw image data in real time to the internal solid-state hard drive of the image storage module. The stored data includes GPS coordinates, time and attitude information, and can be copied to the ground workstation through a reserved data transmission interface.

[0037] An airborne portable mid-wave cooled infrared acquisition device includes: a mid-wave cooled infrared thermal imager 1, a three-axis stabilization platform 2, an integrated control component 3, an image processing module 4, an image storage module 5, a secondary power supply 6, a switch 7, and a system structure 8.

[0038] The mid-wave cooled infrared thermal imager 1 completes the detection and real-time imaging of the mid-wave radiation energy of the target, acquiring the raw mid-wave infrared image of the target; the airborne portable mid-wave cooled infrared acquisition device is adapted to the mid-wave cooled infrared thermal imager for a certain product's UAV, and the mid-wave cooled infrared thermal imager meets the following parameters:

[0039] a) Detector material: Mercury cadmium telluride;

[0040] b) Detector type: Mid-wave infrared (3µm~5µm), Stirling cooled;

[0041] c) Detector resolution: 640×512;

[0042] d) Pixel size: 15um × 15um;

[0043] e) Focal length: 11mm, fixed focal length with no heating, 25mm, 35mm, and 50mm are optional;

[0044] f) F number: 2;

[0045] g) Lens field of view: 50°×40° (±5%);

[0046] h) Lens distortion: ≤1%;

[0047] i) The detector triggering and storage frame rate is adjustable, with a maximum of no less than 25 frames / s;

[0048] j) Data bit width: ≥14 bits;

[0049] k) The detector uses external synchronization triggering to ensure consistent image timing.

[0050] The three-axis stabilization platform 2 can isolate various disturbances in the carrier environment, allowing the mid-wave cooled infrared thermal imager to acquire clear and stable images; it is the actuator that realizes the optical axis movement, collects information such as angle and angular velocity in real time, and forms the necessary control signals according to the target deviation information obtained by the image tracking module, based on the working mode and the corresponding control algorithm, to control the movement of the servo stabilization platform, realize the tracking of the target, and can output the frame angle and angular velocity in real time.

[0051] The integrated control component 3 receives and parses commands from the ground control terminal, and is responsible for communication between the mid-wave infrared thermal imager, three-axis stabilization platform, image processing module, image storage module and UAV flight control attitude information inside the airborne portable mid-wave cooled infrared acquisition device. It is also responsible for communication between the airborne portable mid-wave cooled infrared acquisition device and the ground workstation (display and control software).

[0052] Image processing module 4 performs functions such as reading, preprocessing, tracking, compression encoding, and communication of mid-wave infrared raw images, enabling real-time tracking of targets and image output display;

[0053] Image storage module 5 stores raw data from the mid-wave cooled infrared thermal imager. It can parse and store GPS, attitude, and time information from the POS system, storing it in the first line of the image information. Data on the image storage board can be read and deleted via a gigabit network interface. It can store raw mid-wave images and control data such as target information, target flight characteristics, and communication commands in real time. It has functions such as starting data recording, stopping data recording, and clearing recorded data. The file name is related to the system time, and a cyclic recording mode is used to prevent data loss due to full storage space.

[0054] Secondary power supply 6 converts the onboard power into the power required inside the platform cabin, and filters and isolates the power to improve the electromagnetic compatibility of the system. It is used to power the mid-wave infrared thermal imager, integrated control components, image processing module, and image storage module.

[0055] Switch 7 enables the interconnection of interfaces within the airborne portable mid-wave cooled infrared acquisition device via a gigabit network, allowing for real-time data and image exchange.

[0056] System structure 8: Internal assembly of a fixed-mount airborne portable mid-wave cooled infrared acquisition device.

[0057] The mid-wave cooled infrared thermal imager, integrated control unit, image processing module, image storage module, secondary power supply, and switch are fixedly mounted on the load structure of the three-axis stabilized platform via a system structure. The load structure is a crucial component of the system, and its frame structure significantly reduces weight. The mid-wave cooled infrared thermal imager is mounted at the front of the load structure of the three-axis stabilized platform; the integrated control unit is mounted on the right side of the load structure (viewed from back to front); the image processing module and image storage module are mounted on the top of the load structure; the secondary power supply is mounted at the rear of the load structure; and the switch is mounted at the bottom of the load structure. The optical axis of the mid-wave cooled infrared thermal imager is parallel to the three-axis stabilized platform; at the default zero position, the optical axis of the mid-wave cooled infrared thermal imager points horizontally forward.

[0058] The three-axis stabilized platform uses a universal quick-release mounting structure for its external installation interface. This structure includes both mechanical and electrical interfaces, facilitating rapid disassembly and assembly. The electrical interfaces include RS232 communication, gigabit network, power supply, external synchronization signals, and flight control input interfaces. The mechanical interfaces provide locking and securing capabilities, ensuring precise alignment. Once the quick-release mounting structure is locked, the onboard portable mid-wave cooled infrared acquisition device can be quickly powered, communicated with, and output images via the DJI M300 drone.

[0059] The airborne portable mid-wave cooled infrared acquisition device employs the following workflow: First, it is installed on the UAV platform via a quick-release mechanism. After power-on, it performs a self-test and captures the target area through scanning. Second, it conducts reconnaissance of the target area through manual search, automatic search, and digital guidance, achieving target identification. Third, it selects the target for human-in-the-loop tracking. Fourth, after stable tracking, it confirms the target and performs parameter control, image acquisition, and storage functions. Fifth, it verifies the normality of the acquired data based on the status and target images transmitted back by the acquisition system in real time. Sixth, it reads, processes, and manages the stored data to obtain actual target and scene information.

[0060] This application adopts an integrated design, which features high integration, small size and light weight. It adopts a universal quick-release installation structure, which is convenient to use and meets the adaptation and installation requirements of drones. Specific Implementation Example 2:

[0062] This application provides an airborne portable mid-wave cooled infrared data acquisition device. By setting up a network switch, data from the integrated control component, the mid-wave cooled infrared thermal imager, and the servo stabilization platform are uniformly transmitted to the network switch. The data is then wirelessly transmitted to the image processing module via the network switch. This achieves stable wireless data transmission. The specific technical solution is as follows:

[0063] An airborne portable mid-wave cooled infrared acquisition device, the device comprising: a mid-wave cooled infrared thermal imager, a servo stabilization platform, an integrated control component, an image processing module, and a network switch;

[0064] The mid-wave cooled infrared thermal imager is electrically connected to the integrated control component, and the integrated control component is electrically connected to the servo stabilization platform; the mid-wave cooled infrared thermal imager is signal-connected to the network switch, the image processing module is signal-connected to the network switch, and the integrated control component is signal-connected to the network switch.

[0065] The mid-wave cooled infrared thermal imager acquires a raw mid-wave infrared image of the target and transmits it to the network switch. The network switch then sends the raw mid-wave infrared image to the image processing module. The integrated control component determines servo control information based on the flight control attitude and position information and acquires servo feedback information from the servo stabilization platform. The integrated control component sends the flight control attitude and position information and the servo feedback information to the network switch, which in turn sends them to the image processing module. The image processing module performs data processing on the raw mid-wave infrared image based on the flight control attitude and position information and the servo feedback information to eliminate the influence of the servo stabilization platform and flight jitter on the image.

[0066] In another embodiment of this application, the device further includes: an image storage module;

[0067] The image storage module is connected to the image processing module, and the image storage module is used to store the original mid-wave infrared image.

[0068] In another embodiment of this application, the servo stabilization platform adopts a three-axis stabilization platform load mode and uses a universal quick-release installation structure that can be quickly disassembled and installed.

[0069] In another embodiment of this application, the servo stabilization platform adopts external synchronization control, which can effectively control the mid-wave cooled infrared image synchronization function, making it easier for the UAV attitude information to achieve precise alignment.

[0070] In another embodiment of this application, the mid-wave cooled infrared thermal imager is used to store GPS information, attitude information and time information of the UAV platform POS system, and to store raw mid-wave image storage and target information, target flight characteristics and communication commands in real time.

[0071] In another embodiment of this application, the device further includes: a secondary power supply;

[0072] The secondary power supply converts the onboard power into the power required inside the platform cabin, and filters and isolates the power to improve the electromagnetic compatibility of the system. It is used to power the mid-wave infrared thermal imager, the integrated control component, the image processing module, and the image storage module.

[0073] In another embodiment of this application, the network switch enables the interconnection of interfaces within the airborne portable mid-wave cooled infrared acquisition device via a gigabit network, allowing for real-time data and image exchange.

[0074] In another embodiment of this application, the detector material of the mid-wave cooled infrared thermal imager is mercury cadmium telluride.

[0075] In another embodiment of this application, the detector of the mid-wave cooled infrared thermal imager is externally synchronized to ensure consistent image timing.

[0076] In another embodiment of this application, the image processing module adopts an FPGA+DSP+ARM architecture. Specific Implementation Example 3:

[0078] like Figure 6 As shown, this application provides an airborne portable mid-wave cooled infrared acquisition device. The airborne portable mid-wave cooled infrared acquisition device employs the following workflow: First, it is installed on a UAV platform via a quick-release structure. After power-on, it performs a self-test and captures the target area through scanning. Second, it conducts reconnaissance of the target area through manual search, automatic search, and digital guidance, achieving target identification. Third, it selects the target for human-in-the-loop tracking. Fourth, after stable tracking, it confirms the target and performs parameter control, image acquisition, and storage functions of the airborne portable mid-wave cooled infrared acquisition device. Fifth, it confirms the normality of the acquired data in real time based on the status and target images transmitted back by the acquisition system. Sixth, it reads, processes, and manages the stored data to obtain actual target and scene information. Specific Implementation Example 4:

[0080] like Figure 9 As shown, an image data processing method for an airborne portable mid-wave cooled infrared acquisition device is described. When the device is used on a drone, the movement of the drone, the rotation of the servo stabilization platform, and the movement of the target object can all cause directional image shifts in the original mid-wave infrared image. To eliminate such shifts, existing technologies typically employ only two solutions: one is to use mechanical devices to counteract the relative movement between the mid-wave cooled infrared thermal imager and the target, ensuring that they are relatively stationary. Specifically, this involves using the movement of the drone and the servo stabilization platform to counteract the movement of the target. The other solution is to process the data of the original mid-wave infrared image itself to eliminate blurry data. Mechanical methods require high control standards and involve expensive equipment. Data algorithm methods rely solely on the data itself, and the processing effect depends on the data itself. A pre-set algorithm may perform well under certain conditions, but it may struggle to achieve good blurring results when processing data from different environments.

[0081] Therefore, this application determines the relative motion direction between the mid-wave cooled infrared thermal imager and the target by acquiring the motion direction of the UAV, the rotation of the servo-stabilized platform, and the motion direction of the target. This allows for the determination of the directional blur caused by the relative motion between the object being photographed and the object being photographed. Theoretically, determining any one of the three factors—the motion direction of the UAV, the rotation of the servo-stabilized platform, or the motion direction of the target—is sufficient to determine the blur direction of the original image. Since the motion amplitudes of these three factors differ, the largest change in motion amplitude will determine the blur direction of the original image. To further determine the blur distance of the original image, i.e., the deviation of a deviated pixel from its actual position, the blur distance of pixels in the original image can be determined based on the distance between the mid-wave cooled infrared thermal imager and the target, the distance the UAV moves during the imaging period, the rotation angle of the servo-stabilized platform, and the motion distance of the target.

[0082] The above steps determine the direction and distance of the pixel's deviation from its original position. This ensures that the blurring process of the original image has a clear direction and distance measurement.

[0083] Example embodiments have been disclosed herein, and while specific terminology has been used, it is for general illustrative purposes only and should not be construed as limiting. In some embodiments, it will be apparent to those skilled in the art that features, characteristics, and / or elements described in connection with particular embodiments may be used alone, or in combination with features, characteristics, and / or elements described in connection with other embodiments, unless otherwise expressly indicated. Therefore, those skilled in the art will understand that various changes in form and detail may be made without departing from the scope of the invention as set forth by the appended claims.

Claims

1. An airborne portable mid-wave cooled infrared acquisition device, characterized in that, The device includes: a mid-wave cooled infrared thermal imager, a servo stabilization platform, an integrated control component, an image processing module, and a network switch; The mid-wave cooled infrared thermal imager is electrically connected to the integrated control component, and the integrated control component is electrically connected to the servo stabilization platform; the mid-wave cooled infrared thermal imager is signal-connected to the network switch, the image processing module is signal-connected to the network switch, and the integrated control component is signal-connected to the network switch. The mid-wave cooled infrared thermal imager acquires a raw mid-wave infrared image of the target and transmits it to the network switch. The network switch then sends the raw mid-wave infrared image to the image processing module. The integrated control component determines servo control information based on the flight control attitude and position information and acquires servo feedback information from the servo stabilization platform. The integrated control component sends the flight control attitude and position information and the servo feedback information to the network switch, which in turn sends them to the image processing module. The image processing module performs data processing on the raw mid-wave infrared image based on the flight control attitude and position information and the servo feedback information to eliminate the influence of the servo stabilization platform and flight jitter on the image.

2. The airborne portable mid-wave cooled infrared acquisition device as described in claim 1, characterized in that, The device further includes: an image storage module; The image storage module is connected to the image processing module, and the image storage module is used to store the original mid-wave infrared image.

3. The airborne portable mid-wave cooled infrared acquisition device as described in claim 1, characterized in that, The servo stabilization platform adopts a three-axis stabilization platform load mode and uses a universal quick-release installation structure that allows for rapid disassembly and installation.

4. The airborne portable mid-wave cooled infrared acquisition device as described in claim 3, characterized in that, The servo stabilization platform adopts external synchronization control, which can effectively control the synchronization function of mid-wave cooled infrared images, facilitating the precise alignment of UAV attitude information.

5. The airborne portable mid-wave cooled infrared acquisition device as described in claim 1, characterized in that, The mid-wave cooled infrared thermal imager is used to store GPS information, attitude information, and time information of the UAV platform POS system, and to store raw mid-wave images, target information, target flight characteristics, and communication commands in real time.

6. The airborne portable mid-wave cooled infrared acquisition device as described in claim 1, characterized in that, The device further includes: a secondary power supply; The secondary power supply converts the onboard power into the power required inside the platform cabin, and filters and isolates the power to improve the electromagnetic compatibility of the system. It is used to power the mid-wave infrared thermal imager, the integrated control component, the image processing module, and the image storage module.

7. The airborne portable mid-wave cooled infrared acquisition device as described in claim 1, characterized in that, The network switch enables the interconnection of interfaces within the airborne portable mid-wave cooled infrared acquisition device via a gigabit network, allowing for real-time data and image exchange.

8. The airborne portable mid-wave cooled infrared acquisition device as described in claim 1, characterized in that, The detector material of the medium-wave cooled infrared thermal imager is mercury cadmium telluride.

9. The airborne portable mid-wave cooled infrared acquisition device as described in claim 1, characterized in that, The detector of the medium-wave cooled infrared thermal imager uses external synchronization triggering to ensure consistent image timing.

10. The airborne portable mid-wave cooled infrared acquisition device as described in claim 1, characterized in that, The image processing module adopts an FPGA+DSP+ARM architecture.

Images