A multi-modal remote sensing data hardware integrated acquisition and processing device

By integrating components such as power conversion modules, time synchronization boards, and switches, a multimodal remote sensing data hardware integrated acquisition and processing device has been developed, solving the problem of poor multimodal data synchronization and achieving efficient and accurate data acquisition and processing.

CN224385532UActive Publication Date: 2026-06-19WUHAN JINGSHI TELEMETRY TECH CO LTD

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Utility models(China)
Current Assignee / Owner
WUHAN JINGSHI TELEMETRY TECH CO LTD
Filing Date
2025-08-20
Publication Date
2026-06-19

Smart Images

  • Figure CN224385532U_ABST
    Figure CN224385532U_ABST
Patent Text Reader

Abstract

This utility model relates to an integrated hardware acquisition and processing device for multimodal remote sensing data, including a power conversion module, a time synchronization board, a switch, an industrial control computer, a color area array camera, a thermal infrared camera, a GNSS board, and a GNSS antenna. The power conversion module supplies power to each component, the time synchronization board triggers the area array camera, the industrial control computer triggers the infrared camera, the GNSS board transmits data to the time synchronization board and the industrial control computer, and the data from the camera and the time synchronization board is aggregated to the industrial control computer via the switch. This utility model, through integrated hardware, achieves synchronous acquisition and aggregation processing of multimodal remote sensing data. The cooperation between the time synchronization board and the GNSS board ensures data time alignment, and the connection between the switch and the industrial control computer enables centralized data storage. The overall structure improves acquisition efficiency and data accuracy, and also reduces the difficulty of multimodal data acquisition and processing.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This utility model relates to the field of data acquisition equipment technology, and in particular to a multimodal remote sensing data hardware integrated acquisition and processing device. Background Technology

[0002] In remote sensing internship courses, the joint processing of multimodal remote sensing data such as panchromatic images and infrared images requires data alignment first. However, most existing acquisition devices are designed in a decentralized manner and lack integrated hardware, resulting in poor data synchronization, cumbersome acquisition processes, difficulty in aligning multimodal data, and unstable processing quality. This not only raises the threshold for students to learn multimodal remote sensing data acquisition and processing, but also hinders the efficient implementation of experimental teaching.

[0003] Therefore, there is an urgent need to provide a technical solution to address the above problems. Utility Model Content

[0004] To solve the above-mentioned technical problems, this utility model provides a multimodal remote sensing data hardware integrated acquisition and processing device, including: a power conversion module, a time synchronization board, a switch, an industrial control computer, a color area array camera, a thermal infrared camera, a GNSS board and a GNSS antenna;

[0005] The power input terminal of the power conversion module is connected to an external power supply interface; the power output terminal of the power conversion module is connected to the power input terminal of the industrial control computer, the power input terminal of the time synchronization board, the power input terminal of the switch, and the power input terminal of the thermal infrared camera, respectively.

[0006] The power output terminal of the time synchronization board is connected to the power input terminal of the GNSS board; the trigger output terminal of the time synchronization board is connected to the trigger input terminal of the color area array camera; and the trigger output terminal of the industrial control computer is connected to the trigger input terminal of the thermal infrared camera.

[0007] The time and positioning data output terminals of the GNSS board are connected to the signal input terminals of the time synchronization board; the time synchronization output terminal of the GNSS board is connected to the signal input terminal of the industrial control computer; and the radio frequency input terminal of the GNSS board is connected to the signal output terminal of the GNSS antenna.

[0008] The image data output terminal of the color area array camera, the infrared data output terminal of the thermal infrared camera, and the synchronization data output terminal of the time synchronization board are respectively connected to the data input terminal of the switch via network cables; the summary data output terminal of the switch is connected to the multimodal data input terminal of the industrial control computer.

[0009] The beneficial effects of this utility model's integrated hardware acquisition and processing device for multimodal remote sensing data are as follows:

[0010] This invention achieves synchronous acquisition and aggregation processing of multimodal remote sensing data through integrated hardware. The time synchronization board and GNSS board work together to ensure data time alignment, and the connection between the switch and the industrial control computer enables centralized data storage. The overall structure improves acquisition efficiency and data accuracy, and also reduces the difficulty of multimodal data acquisition and processing.

[0011] In one alternative approach, a square casing is also included;

[0012] The square housing has a handle on the top and mounting holes on the bottom; the power conversion module, the time synchronization board, the switch, the industrial computer, the color area array camera, the thermal infrared camera, and the GNSS board are all installed inside the square housing.

[0013] In the above-mentioned optional methods, the power conversion module, time synchronization board, switch, industrial computer, color area array camera, thermal infrared camera and GNSS board are integrated and installed in a square shell. The top is equipped with a handle and the bottom is equipped with fixing holes, which not only facilitates the transportation and installation of the equipment, but also ensures the safety and stability of the equipment when it is installed on the robot chassis, avoids loosening or damage caused by decentralized installation, and improves the integration and ease of use of the equipment.

[0014] In one alternative embodiment, the GNSS antenna is mounted on the top cover of the square housing and connected to the RF input terminal of the GNSS board via an RF cable.

[0015] In the above-mentioned optional method, the GNSS antenna is set on the top cover of the square shell and connected to the GNSS board through an RF cable. The top position is unobstructed, which can receive satellite signals more efficiently, improve the accuracy of satellite time and positioning information acquisition, provide a more reliable foundation for subsequent data time alignment, and ensure the accuracy of multimodal data.

[0016] In one alternative approach, a UV filter is also included;

[0017] The UV mirrors are respectively disposed on the left and right sides of the front of the square housing, and the lenses of the color area array camera and the thermal infrared camera are respectively disposed corresponding to the UV mirrors.

[0018] In the above-mentioned optional methods, UV filters are set on the left and right sides of the front of the square housing, and the lenses of the color area array camera and the thermal infrared camera are respectively corresponding to the UV filters. This can effectively protect the camera lenses from the influence of external factors such as ultraviolet rays and dust, reduce the impact of lens contamination or damage on image quality, ensure that the acquired image data is clear and accurate, and improve the quality of post-processing.

[0019] In one alternative approach, it also includes: a flight insert plate;

[0020] The aircraft insert plate is located on the rear side of the square housing; the external power supply interface is the power input interface on the aircraft insert plate.

[0021] In the above-mentioned optional method, the flight board is set on the rear side of the square shell, and the external power supply interface is set as the power input interface on the flight board. This simplifies the external wiring of the equipment. Only one DC24V cable needs to be connected during data acquisition, which improves the ease of use of the equipment and avoids confusion or misconnection caused by multiple cable connections.

[0022] In one alternative embodiment, the aviation plug-in board is further provided with an HDMI interface, a USB interface, and an encoder interface; the HDMI interface and the USB interface are respectively connected to the debugging output terminal of the industrial control computer; the signal input terminal of the time synchronization board is connected to the output terminal of the encoder interface.

[0023] In the above-mentioned optional methods, an HDMI interface, a USB interface, and an encoder interface are provided on the aviation plug-in board. The HDMI interface and the USB interface are connected to the debugging output of the industrial control computer, which facilitates the debugging of the device and data transmission. The encoder interface is connected to the signal input of the time synchronization board and has reserved an expansion interface to facilitate the subsequent connection of external encoders and other devices, thereby improving the flexibility and expandability of the device.

[0024] In one alternative approach, a fan is also included;

[0025] The fan is located inside the square housing; the power input terminal of the fan is connected to the power output terminal of the power conversion module.

[0026] In the above-mentioned optional methods, a fan is installed inside the square casing and connected to the power output terminal of the power conversion module, which can effectively dissipate the heat inside the equipment, prevent electronic components from being damaged or degraded due to overheating, ensure the stable operation of the equipment, and improve the reliability and service life of the equipment.

[0027] In one alternative approach, a storage hard drive is also included;

[0028] The storage hard disk is installed inside the industrial control computer; the input terminal of the storage hard disk is connected to the multimodal data input terminal of the industrial control computer.

[0029] In the above-mentioned optional methods, setting up a storage hard drive in the industrial control computer and connecting it to a multimodal data input terminal can centrally store the acquired color area array camera image data, thermal infrared camera infrared data, and time synchronization board synchronous data, which facilitates data management and post-processing, avoids data loss or confusion caused by scattered storage, and improves data processing efficiency.

[0030] In one alternative embodiment, the installation distance between the color area array camera and the thermal infrared camera inside the square housing is 70 cm.

[0031] In the above-mentioned optional methods, the installation distance between the color area array camera and the thermal infrared camera inside the square housing is set to 70cm. This facilitates the calibration of the binocular camera, provides a suitable spatial basis for the subsequent application of binocular algorithms to process data, ensures the spatial alignment of multimodal data, and improves the accuracy and usability of the data.

[0032] In one alternative embodiment, the power input terminal of the power conversion module receives a DC24V voltage, and the power output terminal of the power conversion module outputs a regulated DC12V voltage to the power input terminals of the industrial computer, the time synchronization board, the switch, and the thermal infrared camera.

[0033] In the above optional method, the power conversion module receives DC24V voltage at the power input terminal and outputs regulated DC12V voltage at the output terminal to the industrial control computer, time synchronization board, switch and thermal infrared camera. The voltage regulation process can ensure that each component obtains a stable operating voltage, prevent voltage fluctuations from damaging the equipment or affecting the data acquisition quality, and improve the stability of the equipment and the reliability of data acquisition.

[0034] The above description is merely an overview of the technical solution of this utility model. In order to better understand the technical means of this utility model and to implement it in accordance with the contents of the specification, and to make the above and other objects, features and advantages of this utility model more obvious and understandable, specific embodiments of this utility model are given below. Attached Figure Description

[0035] The accompanying drawings are for illustrative purposes only and are not intended to limit the scope of the invention. Furthermore, the same reference numerals denote the same parts throughout the drawings. In the drawings:

[0036] Figure 1 A schematic diagram of a hardware-integrated acquisition and processing device for multimodal remote sensing data;

[0037] Figure 2 An internal diagram of a multimodal remote sensing data hardware-integrated acquisition and processing device;

[0038] Figure 3 Multiple views of a multimodal remote sensing data hardware integrated acquisition and processing device;

[0039] Figure 4 A flight board illustration of a multimodal remote sensing data hardware integrated acquisition and processing device;

[0040] Figure 5This is a diagram illustrating the implementation of a multimodal remote sensing data hardware-integrated acquisition and processing device. Detailed Implementation

[0041] Exemplary embodiments of the present invention will now be described in more detail with reference to the accompanying drawings. Although exemplary embodiments of the present invention are shown in the drawings, it should be understood that the present invention may be implemented in various forms and should not be limited to the embodiments set forth herein.

[0042] Figure 1 This is a schematic diagram of a multimodal remote sensing data hardware integrated acquisition and processing device according to this utility model. Figure 1 As shown, it includes: a power conversion module, a time synchronization board, a switch, an industrial computer, a color area array camera, a thermal infrared camera, a GNSS board, and a GNSS antenna;

[0043] The power input terminal of the power conversion module is connected to an external power supply interface; the power output terminal of the power conversion module is connected to the power input terminal of the industrial control computer, the power input terminal of the time synchronization board, the power input terminal of the switch, and the power input terminal of the thermal infrared camera, respectively.

[0044] The power output terminal of the time synchronization board is connected to the power input terminal of the GNSS board; the trigger output terminal of the time synchronization board is connected to the trigger input terminal of the color area array camera; and the trigger output terminal of the industrial control computer is connected to the trigger input terminal of the thermal infrared camera.

[0045] The time and positioning data output terminals of the GNSS board are connected to the signal input terminals of the time synchronization board; the time synchronization output terminal of the GNSS board is connected to the signal input terminal of the industrial control computer; and the radio frequency input terminal of the GNSS board is connected to the signal output terminal of the GNSS antenna.

[0046] The image data output terminal of the color area array camera, the infrared data output terminal of the thermal infrared camera, and the synchronization data output terminal of the time synchronization board are respectively connected to the data input terminal of the switch via network cables; the summary data output terminal of the switch is connected to the multimodal data input terminal of the industrial control computer.

[0047] The power conversion module is used to convert external power into a stable operating power supply for internal components. The power input terminal of the power conversion module receives the DC24V input voltage from the external power supply interface. After voltage regulation and conversion, the voltage is transmitted through the power output terminal to the power input terminals of the industrial control computer, time synchronization board, switch, and thermal infrared camera, providing stable power to these core components.

[0048] The time synchronization board is used to power the GNSS board and trigger the color area array camera to take pictures. The power input terminal of the time synchronization board receives the power output from the power conversion module and transmits it to the power input terminal of the GNSS board to power the GNSS board; at the same time, it generates a trigger signal through the trigger output terminal and transmits it to the trigger input terminal of the color area array camera to control the color area array camera to take pictures at the synchronized time.

[0049] The GNSS board is used to receive satellite signals and generate positioning data and time synchronization signals. The RF input terminal of the GNSS board receives RF signals (such as GPS / BeiDou signals) transmitted by satellites via a GNSS antenna, processes them to generate positioning data (latitude, longitude, altitude, etc.) and time synchronization signals (such as PPS pulses). The time and positioning data are transmitted to the signal input terminal of the time synchronization board through the positioning data output terminal, and the time synchronization signal is transmitted to the signal input terminal of the industrial control computer through the time synchronization output terminal.

[0050] The GNSS antenna is used to receive satellite radio frequency signals. Mounted on the top of the device, the GNSS antenna receives the radio frequency signals transmitted by satellites and transmits them via radio frequency cables to the radio frequency input of the GNSS board, providing the GNSS board with a satellite signal source.

[0051] The color area scan camera is used to receive trigger signals, capture color images, and transmit data. The trigger input terminal of the color area scan camera receives the trigger signal transmitted from the trigger output terminal of the time synchronization board, triggering the camera to capture a color image; the generated image data is transmitted to the data input terminal of the switch via a network cable through the image data output terminal.

[0052] The thermal infrared camera is used to receive trigger signals, capture thermal infrared images, and transmit data. The power input terminal of the thermal infrared camera receives the power output from the power conversion module; the trigger input terminal receives a soft trigger signal (such as a software-controlled pulse signal) transmitted from the trigger output terminal of the industrial control computer, triggering the camera to capture a thermal infrared image; the generated infrared data is transmitted to the data input terminal of the switch via an infrared data output terminal using a network cable as the transmission medium.

[0053] The switch is used to aggregate multimodal data (color images, thermal infrared images, and synchronization data) and transmit them to the industrial control computer. The switch's power input receives power output from the power conversion module; its data input receives image data from the color area scan camera, infrared data from the thermal infrared camera, and synchronization data (such as timestamps) transmitted from the synchronization data output of the time synchronization board via a network cable. After aggregating this data, it transmits it to the multimodal data input of the industrial control computer via a network cable through the aggregated data output.

[0054] The industrial control computer (ICC) is used to receive time synchronization signals, trigger the thermal infrared camera, and store / process multimodal data. The ICC's power input receives the power output from the power conversion module; its signal input receives the time synchronization signal (such as a PPS pulse) transmitted from the GNSS board's time synchronization output to achieve synchronization with satellite time; it generates a soft trigger signal through the trigger output and transmits it to the thermal infrared camera's trigger input to control the camera to take pictures; simultaneously, it receives multimodal data (color images, thermal infrared images, and synchronization data) transmitted from the switch's aggregated data output through its multimodal data input and stores it on its internal hard drive for later processing.

[0055] This utility model discloses a multimodal remote sensing data hardware integrated acquisition and processing device. Through integrated hardware, it realizes the synchronous acquisition and summary processing of multimodal remote sensing data. The time synchronization board and GNSS board work together to ensure the time alignment of the data. The connection between the switch and the industrial control computer realizes the centralized storage of data. The overall structure improves the acquisition efficiency and data accuracy, and also reduces the difficulty of multimodal data acquisition and processing.

[0056] In one alternative approach, a square casing is also included;

[0057] The square housing has a handle on the top and mounting holes on the bottom; the power conversion module, the time synchronization board, the switch, the industrial computer, the color area array camera, the thermal infrared camera, and the GNSS board are all installed inside the square housing.

[0058] The square casing allows for better integration of the equipment, protects internal electronic components, and improves installation stability. For example... Figure 2 As shown, the square casing houses and secures the power conversion module, time synchronization board, switch, industrial computer, color area array camera, thermal infrared camera, fan, and GNSS board within a compact, integrated structure. The square design meets the installation space requirements of the robot chassis, preventing component loosening or collisions caused by distributed installations and ensuring the stability of the equipment during operation.

[0059] The top handles enhance the ease of handling and installation of the equipment. Located on both sides of the top of the square housing, the top handles facilitate gripping and moving of the equipment, solving the problem of difficult handling of integrated devices due to their weight or size.

[0060] The bottom mounting holes are used to securely connect the device to the robot chassis. These holes are located on the bottom of the square housing, and the device is fixed to the corresponding position on the robot chassis using bolts or clips. This prevents the device from shifting or falling during robot movement, ensuring the continuity and safety of the data collection process.

[0061] In one alternative embodiment, the GNSS antenna is mounted on the top cover of the square housing and connected to the RF input terminal of the GNSS board via an RF cable.

[0062] Among them, the GNSS antenna is used to receive radio frequency signals transmitted by satellites (such as navigation signals from GPS / BeiDou satellites), providing the original signal source for the GNSS board, which is a prerequisite for obtaining satellite time and positioning information.

[0063] The top cover of the square casing provides an unobstructed mounting position for the GNSS antenna, preventing internal electronic components or external obstacles from blocking satellite signals and ensuring the stability and strength of signal reception. Figure 3 As shown, the GNSS antenna is mounted on the top cover of the square housing to receive radio frequency signals (including time and location information) transmitted by the satellite.

[0064] RF cable: Used to transmit the RF signal received by the GNSS antenna to the RF input terminal of the GNSS board, ensuring that the signal is not interfered with during transmission and maintaining its integrity and accuracy. The RF signal is transmitted to the RF input terminal of the GNSS board through the RF cable. The GNSS board demodulates and decodes the received RF signal to generate satellite time and positioning information (such as PPS pulse time signal, latitude and longitude coordinates).

[0065] The GNSS board transmits the processed time and positioning data to the time synchronization board, and transmits the time synchronization signal to the industrial control computer, providing a foundation for time alignment (time synchronization between the synchronization control board and the industrial control computer) and spatial alignment (binocular camera calibration) of multimodal data.

[0066] In one alternative approach, a UV filter is also included;

[0067] The UV mirrors are respectively disposed on the left and right sides of the front of the square housing, and the lenses of the color area array camera and the thermal infrared camera are respectively disposed corresponding to the UV mirrors.

[0068] The UV filter is used to filter ultraviolet rays and protect the camera lens from external contaminants and scratches, ensuring clear and accurate image data. The UV filters are fixed on the left and right sides of the front of the square housing, corresponding one-to-one with the lenses of the internal color area array camera and thermal infrared camera. When the equipment is installed on the robot chassis for data acquisition, light must first pass through the corresponding UV filter before entering the camera lens. The UV filter can effectively filter ultraviolet rays in sunlight, reduce ultraviolet interference with the camera image sensor, and avoid the blue-purple color cast problem in the color image. At the same time, the UV filter, as a physical barrier for the lens, can prevent dust, sand and other contaminants generated during the journey from directly contacting the lens surface, avoiding lens scratches or contamination, maintaining lens transmittance, thereby ensuring the stable quality of image data captured by the color area array camera and infrared data acquired by the thermal infrared camera, meeting the requirements of multimodal remote sensing data alignment and post-processing.

[0069] In one alternative approach, it also includes: a flight insert plate;

[0070] The aircraft insert plate is located on the rear side of the square housing; the external power supply interface is the power input interface on the aircraft insert plate.

[0071] In one alternative embodiment, the aviation plug-in board is further provided with an HDMI interface, a USB interface, and an encoder interface; the HDMI interface and the USB interface are respectively connected to the debugging output terminal of the industrial control computer; the signal input terminal of the time synchronization board is connected to the output terminal of the encoder interface.

[0072] Among them, such as Figure 4 As shown, the flight board is used to centrally integrate the external interfaces of the multimodal remote sensing data hardware integrated acquisition and processing device, including a switch, 4G interface, WIFI interface, antenna interface, power input interface, network interface, debugging interface (HDMI, USB), encoder interface, and reserved interfaces. This facilitates connection between the device and external power supplies and debugging equipment, and provides interface support for future functional expansion. Its location on the rear of the square housing avoids interference with the front camera's field of view. The flight board is fixedly installed on the rear of the square housing. The power input interface on the flight board serves as the external power supply interface for the device. During data acquisition, external power is connected through this interface, transmitted through internal circuitry to the power conversion module, and then regulated and converted by the power conversion module to power components such as the industrial control computer, time synchronization board, switch, thermal infrared camera, and fan. Simultaneously, the HDMI and USB debugging interfaces on the flight board are connected to the debugging output of the industrial control computer for data transmission and video output during device debugging. The reserved encoder interface provides expansion space for connecting external encoders and other devices, achieving centralization and standardization of the device's external interfaces.

[0073] In one alternative approach, a fan is also included;

[0074] The fan is located inside the square housing; the power input terminal of the fan is connected to the power output terminal of the power conversion module.

[0075] The fan is used to dissipate heat from the electronic components inside the square housing, preventing overheating damage or performance degradation caused by heat buildup during prolonged operation, and ensuring the stable operation of the multimodal remote sensing data acquisition and processing device. The fan is fixedly installed inside the square housing, and its power input is connected to the power output of the power conversion module. When the power conversion module converts external power into a stable voltage and outputs it to the components, the fan simultaneously powers on and starts, using its rotating blades to promote air circulation inside the housing. This dissipates heat generated by the electronic components through the housing's heat dissipation structure (such as ventilation holes), reducing the internal temperature and ensuring that all components operate at a suitable temperature.

[0076] In one alternative approach, a storage hard drive is also included;

[0077] The storage hard disk is installed inside the industrial control computer; the input terminal of the storage hard disk is connected to the multimodal data input terminal of the industrial control computer.

[0078] The storage hard drive is used to centrally store multimodal data, including image data from the color area array camera, infrared data from the thermal infrared camera, and synchronization data from the time synchronization board, acquired by the integrated hardware acquisition and processing device for multimodal remote sensing data. This ensures data integrity and accessibility, facilitating subsequent data alignment, processing, and application. The storage hard drive is fixedly installed inside the industrial control computer (ICC). Its input is connected to the ICC's multimodal data input via internal wiring. When the switch aggregates the multimodal data from the color area array camera, thermal infrared camera, and time synchronization board and transmits it to the ICC's multimodal data input, the ICC writes this data to the storage hard drive in real time, achieving centralized storage of multimodal data and providing a foundation for data processing and analysis in subsequent remote sensing practical courses.

[0079] In one alternative embodiment, the installation distance between the color area array camera and the thermal infrared camera inside the square housing is 70 cm.

[0080] The installation distance between the color area array camera and the thermal infrared camera inside the square housing is set at 70cm. This serves to provide a suitable baseline length for the calibration of the binocular camera. The operating principle is to acquire color and infrared images of the same scene by fixing the distance between the two cameras, and combine the intrinsic parameters (such as focal length and principal point) and extrinsic parameters (such as rotation and translation) obtained from calibration to achieve spatial alignment of multimodal data. The 70cm distance has been experimentally verified to facilitate installation within the limited housing space and meet the baseline length requirements of subsequent binocular algorithms (such as stereo matching and depth estimation), ensuring the spatial consistency of multimodal data. This allows the image data stored in the industrial control computer to be aligned one by one, improving data accuracy and facilitating data processing and application in subsequent remote sensing internship courses.

[0081] In one alternative embodiment, the power input terminal of the power conversion module receives a DC24V voltage, and the power output terminal of the power conversion module outputs a regulated DC12V voltage to the power input terminals of the industrial computer, the time synchronization board, the switch, and the thermal infrared camera.

[0082] The power conversion module receives a DC24V input and outputs a regulated DC12V voltage to the industrial computer, time synchronization board, switch, and thermal infrared camera. Its function is to convert the external vehicle-mounted power supply's DC24V into a stable DC12V required by the internal electronic components. The external DC24V is stepped down to 12V and stably output through the power conversion module's step-down circuit (such as a Buck circuit) and filter circuit, ensuring that each component receives the appropriate operating voltage. The DC24V input is chosen because the robot chassis vehicle's onboard power supply typically provides DC24V, while the rated voltage of internal components (such as the industrial computer and synchronization board) is DC12V. The purpose of voltage regulation is to prevent overvoltage damage to components, ensure stable equipment operation, extend the lifespan of electronic components, improve the reliability of multimodal data acquisition, and meet the power supply requirements of the vehicle environment.

[0083] like Figure 5As shown, the overall process in a specific implementation is as follows: During the robot chassis's movement, the data acquisition software is first activated. After the entire system starts, it connects to the GNSS board to obtain satellite time and positioning information, which is then sent to the synchronization control board. Upon receiving the information, the synchronization control board synchronizes its time with the industrial control computer and triggers the front-facing color area array camera to take pictures. The thermal infrared camera is controlled by the industrial control computer to take pictures via a soft trigger. All acquired multimodal data (color images, infrared images, etc.) is stored in the industrial control computer's hard drive. Simultaneously, the binocular cameras (color area array camera and thermal infrared camera) in the device are pre-calibrated. The synchronization control board uses the acquired GNSS satellite time and positioning information to align the image data stored in the industrial control computer in both time and space, ensuring the accuracy of the acquired data for later processing and application.

[0084] Although embodiments of the present invention have been shown and described above, it is understood that the above embodiments are exemplary and should not be construed as limiting the present invention. Those skilled in the art can make changes, modifications, substitutions and variations to the above embodiments within the scope of the present invention.

Claims

1. A hardware-integrated multimodal remote sensing data acquisition and processing device, characterized in that, include: Power conversion modules, time synchronization boards, switches, industrial control computers, color area array cameras, thermal infrared cameras, GNSS boards and GNSS antennas; The power input terminal of the power conversion module is connected to an external power supply interface; The power output terminal of the power conversion module is connected to the power input terminal of the industrial control computer, the power input terminal of the time synchronization board, the power input terminal of the switch, and the power input terminal of the thermal infrared camera, respectively. The power output terminal of the time synchronization board is connected to the power input terminal of the GNSS board; the trigger output terminal of the time synchronization board is connected to the trigger input terminal of the color area array camera; and the trigger output terminal of the industrial control computer is connected to the trigger input terminal of the thermal infrared camera. The time and positioning data output terminals of the GNSS board are connected to the signal input terminals of the time synchronization board. The time synchronization output terminal of the GNSS board is connected to the signal input terminal of the industrial control computer. The RF input terminal of the GNSS board is connected to the signal output terminal of the GNSS antenna; The image data output terminal of the color area array camera, the infrared data output terminal of the thermal infrared camera, and the synchronization data output terminal of the time synchronization board are respectively connected to the data input terminal of the switch via network cables; the summary data output terminal of the switch is connected to the multimodal data input terminal of the industrial control computer.

2. The multimodal remote sensing data hardware integrated acquisition and processing device according to claim 1, characterized in that, Also includes: Square casing; The square housing has a handle on the top and mounting holes on the bottom; the power conversion module, the time synchronization board, the switch, the industrial computer, the color area array camera, the thermal infrared camera, and the GNSS board are all installed inside the square housing.

3. The multimodal remote sensing data hardware integrated acquisition and processing device according to claim 2, characterized in that, The GNSS antenna is mounted on the top cover of the square housing and is connected to the RF input terminal of the GNSS board via an RF cable.

4. The multimodal remote sensing data hardware integrated acquisition and processing device according to claim 3, characterized in that, Also includes: UV mirror; The UV mirrors are respectively disposed on the left and right sides of the front of the square housing, and the lenses of the color area array camera and the thermal infrared camera are respectively disposed corresponding to the UV mirrors.

5. The multimodal remote sensing data hardware integrated acquisition and processing device according to claim 4, characterized in that, Also includes: Aircraft insert board; The aircraft insert is located on the rear side of the square housing; the external power supply interface is the power input interface on the aircraft insert.

6. The multimodal remote sensing data hardware integrated acquisition and processing device according to claim 5, characterized in that, The aviation plug-in board is also equipped with an HDMI interface, a USB interface, and an encoder interface; the HDMI interface and the USB interface are respectively connected to the debugging output terminal of the industrial control computer; the signal input terminal of the time synchronization board is connected to the output terminal of the encoder interface.

7. The multimodal remote sensing data hardware integrated acquisition and processing device according to claim 6, characterized in that, Also includes: fan; The fan is located inside the square housing; the power input terminal of the fan is connected to the power output terminal of the power conversion module.

8. The multimodal remote sensing data hardware integrated acquisition and processing device according to claim 7, characterized in that, Also includes: Storage hard drive; The storage hard disk is installed inside the industrial control computer; The input terminal of the storage hard disk is connected to the multimodal data input terminal of the industrial control computer.

9. The multimodal remote sensing data hardware integrated acquisition and processing device according to claim 8, characterized in that, The installation distance between the color area array camera and the thermal infrared camera inside the square housing is 70cm.

10. The multimodal remote sensing data hardware integrated acquisition and processing device according to claim 8, characterized in that, The power input terminal of the power conversion module receives a DC24V voltage, and the power output terminal of the power conversion module outputs a regulated DC12V voltage to the power input terminals of the industrial computer, the time synchronization board, the switch, and the thermal infrared camera.