Highly integrated visual fusion monitoring equipment

Abstract

The utility model discloses a highly integrated visual fusion monitoring device, which comprises a shell, a power supply module and a mainboard, the power supply module and the mainboard are fixedly arranged in the shell, the mainboard is electrically connected with the power supply module, the front surface of the shell is provided with a high-definition 4K camera, an infrared camera, a laser radar and a millimeter wave radar, the back surface of the shell is provided with an external interface, and the external interface is electrically connected with the mainboard. The 4K camera, the infrared camera, the laser radar and the millimeter wave radar are electrically connected with the mainboard. According to the utility model, the laser radar, the millimeter wave radar, the high-definition 4K camera and the infrared camera are integrated, the monitoring capability, the real-time performance and the reliability are obviously improved, and the system can be widely applied to the fields of moving target detection, multi-modal data fusion, high-precision object deformation monitoring and the like.

Description

Technical Field

[0001] The utility model relates to the technical field of visual detection, in particular to a highly integrated visual fusion monitoring device. Background Art

[0002] Since the 1960s, LiDAR technology has seen a wide range of applications from meteorology and aerospace to GIS and self-driving cars. Cost reductions and advances in camera technology have provided a breeding ground for visual fusion technology, which combines the visual information of the camera and the distance measurement of the LiDAR to improve the accuracy and robustness of environmental perception. At present, most monitoring equipment uses this technology for detection, but there are still obvious deficiencies in the monitoring capabilities in some extreme environments, as well as the real-time and reliability of high-precision long-term monitoring. For this reason, it is necessary to improve the existing detection equipment to adapt to more industries, such as power tower monitoring, slope stability analysis, and wind power equipment monitoring. Utility Model Content

[0003] The purpose of the utility model is to propose a highly integrated visual fusion monitoring device to address the shortcomings of the existing technology. The device integrates laser radar, millimeter wave radar, high-definition 4K camera and infrared camera, and has significantly improved monitoring capability, real-time performance and reliability. It can be widely used in fields such as mobile target detection, multimodal data fusion and high-precision object deformation monitoring.

[0004] The technical solution to achieve the purpose of this utility model is:

[0005] A highly integrated visual fusion monitoring device includes a shell and a power module and a mainboard fixedly installed in the shell, wherein the mainboard is electrically connected to the power module, a high-definition 4K camera, an infrared camera, a laser radar and a millimeter-wave radar are arranged on the front of the shell, and an external interface is arranged on the back, wherein the 4K camera, the infrared camera, the laser radar and the millimeter-wave radar are all electrically connected to the mainboard.

[0006] Furthermore, the mainboard adopts a multi-core processor of model RK3588S.

[0007] Furthermore, the high-definition 4K camera and the infrared camera are both electrically connected to the multi-core processor via a USB interface.

[0008] Furthermore, the model of the high-definition 4K camera is IMX377, and the model of the infrared camera is OV2710.

[0009] Furthermore, an Ethernet chip is electrically connected between the laser radar and the multi-core processor, and two ends of the Ethernet chip are electrically connected to the laser radar and the multi-core processor respectively through an MDI interface.

[0010] Furthermore, the model of the laser radar is CH128X1.

[0011] Furthermore, the millimeter wave radar is electrically connected to the multi-core processor via a serial port.

[0012] Furthermore, the model of the millimeter wave radar is RDAF-14FM.

[0013] Furthermore, the external interface includes a power interface, a data network port and a debugging serial port, the power interface is electrically connected to the power module, an Ethernet chip is connected between the data network port and the multi-core processor, and the debugging serial port is electrically connected to the multi-core processor.

[0014] Furthermore, the top and both sides of the shell are provided with arranged and distributed inclined grooves.

[0015] By adopting the above technical solution, the utility model has the following beneficial effects:

[0016] (1) The monitoring equipment of this utility model is optimized on the basis of the existing single camera and laser radar, integrating laser radar, millimeter wave radar, high-definition 4K camera and infrared camera, and the monitoring capability, real-time performance and reliability are significantly improved. It can be widely used in the fields of mobile target detection, multimodal data fusion and high-precision object deformation monitoring.

[0017] (2) The mainboard of the utility model adopts a multi-core processor model RK3588S, which can be used to handle complex computing tasks and run the system platform. As the data center, it processes image and sensor data in real time, and uses its efficient image processing capabilities and computing power to process data collected by lidar, millimeter-wave radar and cameras. It also supports processing data provided by millimeter-wave radar in low visibility environments, ensuring that the system can accurately perceive the environment even in severe weather conditions.

[0018] (3) The utility model adopts a USB interface to connect the high-definition 4K camera and the infrared camera, which is convenient for connection.

[0019] (4) The model of the high-definition 4K camera of the utility model is IMX377, which adopts high-resolution characteristics and can provide clear image details to meet the needs of complex fusion monitoring applications. The model of the infrared camera is OV2710, which supplements the image acquisition in low-light environments and enhances the performance of the monitoring system under low-light conditions.

[0020] (5) The model CH128X1 of the utility model laser radar can effectively convert the measurement data and transmit it to the RK3588S core processor through the network interface. It has a 128-line scanning capability and supports multi-angle synchronous scanning, which significantly improves the efficiency and accuracy of data collection. The detection range reaches 200 meters and the detection accuracy is maintained at 3 centimeters, ensuring the ability to accurately measure the environment.

[0021] (6) The model of the millimeter-wave radar of the utility model is RDAF-14FM, which has excellent penetration ability in rainy, snowy and foggy weather. At the same time, in low-visibility environments, compared with lidar and cameras, it provides more stable and reliable detection data, enhancing the system's environmental perception and data collection capabilities under adverse weather conditions.

[0022] (7) The utility model is provided with a variety of external interfaces to facilitate functional expansion and connection. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] In order to make the content of the utility model easier to understand, the utility model is further described in detail below according to specific embodiments and in conjunction with the accompanying drawings, wherein:

[0024] Figure 1 It is a three-dimensional diagram of the utility model;

[0025] Figure 2 It is a rear view of the utility model;

[0026] Figure 3 This is a hardware structure diagram of the utility model.

[0027] The reference numerals in the accompanying drawings are:

[0028] Shell 1, chute 1-1, power module 2, mainboard 3, high-definition 4K camera 4, infrared camera 5, laser radar 6, millimeter-wave radar 7, external interface 8, power interface 8-1, data network port 8-2, debugging serial port 8-3. DETAILED DESCRIPTION

[0029] In order to better understand the above technical solution, the above technical solution will be described in detail below in conjunction with the accompanying drawings and specific implementation methods.

[0030] (Example 1)

[0031] like Figures 1 to 3The highly integrated visual fusion monitoring device shown includes a housing 1, in which a power module 2 and a mainboard 3 are fixedly installed, a high-definition 4K camera 4, an infrared camera 5, a laser radar 6 and a millimeter-wave radar 7 are arranged on the front, and an external interface 8 is arranged on the back, wherein the mainboard 3 is electrically connected to the power module 2, and the 4K camera 4, the infrared camera 5, the laser radar 6 and the millimeter-wave radar 7 are all electrically connected to the mainboard 3. Compared with the existing monitoring equipment equipped with only a single camera and a laser radar, this device integrates a laser radar, a millimeter-wave radar, a high-definition 4K camera and an infrared camera, and the monitoring capability, real-time performance and reliability are significantly improved, and can be widely used in the fields of mobile target detection, multimodal data fusion and high-precision object deformation monitoring.

[0032] Since the device performs efficient data processing when in use, higher heat dissipation requirements are imposed. Therefore, the top and both sides of the shell 1 of this embodiment are provided with arranged and distributed inclined grooves 1-1, thereby increasing the heat dissipation area of ​​the shell surface and improving the heat dissipation effect.

[0033] Motherboard 3 uses a multi-core processor model RK3588S, which can be used to handle complex computing tasks and run system platforms. As the data center, it processes image and sensor data in real time, and uses its efficient image processing capabilities and computing power to process data collected by lidar, millimeter-wave radar and cameras. It also supports processing data provided by millimeter-wave radar in low-visibility environments, ensuring that the system can accurately perceive the environment even in severe weather conditions.

[0034] The high-definition 4K camera 4 and the infrared camera 5 are both electrically connected to the multi-core processor via a USB interface. The model of the high-definition 4K camera 4 is IMX377, which adopts high-resolution characteristics and can provide clear image details to meet the needs of complex fusion monitoring applications. The model of the infrared camera is OV2710, which supplements the image acquisition in low-light environments and enhances the performance of the monitoring system under low-light conditions.

[0035] An Ethernet chip is electrically connected between the laser radar 6 and the multi-core processor, and the two ends of the Ethernet chip are electrically connected to the laser radar 6 and the multi-core processor respectively through the MDI interface. The model of the laser radar is CH128X1, which can effectively convert the measurement data and transmit it to the RK3588S core processor through the network interface. It has a 128-line scanning capability and supports multi-angle synchronous scanning, which significantly improves the efficiency and accuracy of data collection. The detection range reaches 200 meters and the detection accuracy is maintained at 3 centimeters, ensuring the ability to accurately measure the environment.

[0036] The millimeter-wave radar 7 is electrically connected to the multi-core processor through a serial port. Its model is RDAF-14FM. It has excellent penetration capability in rainy, snowy and foggy weather. At the same time, in low-visibility environments, it provides more stable and reliable detection data compared to lidar and cameras, enhancing the system's environmental perception and data collection capabilities under adverse weather conditions.

[0037] The external interface 8 includes a power interface 8-1, a data network port 8-2 and a debugging serial port 8-3, wherein the power interface 8-1 is electrically connected to the power module 2, an Ethernet chip is connected between the data network port 8-2 and the multi-core processor, and the debugging serial port 8-3 is electrically connected to the multi-core processor. By setting up rich external interfaces, function expansion and connection are facilitated.

[0038] The monitoring equipment of this embodiment is optimized on the basis of the existing single camera and lidar, and integrates lidar, millimeter-wave radar, high-definition 4K camera and infrared camera. By fusing visual images with lidar information, the monitoring target and its location information are intuitively displayed, and the monitoring capability, real-time and reliability are significantly improved. It can be widely used in fields such as mobile target detection, multimodal data fusion and high-precision object deformation monitoring.

[0039] The specific embodiments described above further illustrate the purpose, technical solutions and beneficial effects of the present invention. It should be understood that the above description is only a specific embodiment of the present invention and is not intended to limit the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present invention should be included in the protection scope of the present invention.

Claims

1. A highly integrated visual fusion monitoring device, characterized by: It includes a shell and a power module and a mainboard fixedly installed in the shell, wherein the mainboard is electrically connected to the power module, a high-definition 4K camera, an infrared camera, a laser radar and a millimeter-wave radar are arranged on the front of the shell, and an external interface is arranged on the back, wherein the 4K camera, the infrared camera, the laser radar and the millimeter-wave radar are all electrically connected to the mainboard.

2. A highly integrated visual fusion monitoring device according to claim 1, characterized in that: The motherboard adopts a multi-core processor model RK3588S.

3. The highly integrated visual fusion monitoring device according to claim 2, characterized in that: The high-definition 4K camera and the infrared camera are both electrically connected to the multi-core processor via a USB interface.

4. The highly integrated visual fusion monitoring device according to claim 3, characterized in that: The model of the high-definition 4K camera is IMX377, and the model of the infrared camera is OV2710.

5. The highly integrated visual fusion monitoring device according to claim 2, characterized in that: An Ethernet chip is electrically connected between the laser radar and the multi-core processor, and two ends of the Ethernet chip are electrically connected to the laser radar and the multi-core processor respectively through an MDI interface.

6. The highly integrated visual fusion monitoring device according to claim 5, characterized in that: The model of the laser radar is CH128X1.

7. The highly integrated visual fusion monitoring device according to claim 2, characterized in that: The millimeter wave radar is electrically connected to the multi-core processor via a serial port.

8. The highly integrated visual fusion monitoring device according to claim 7, characterized in that: The model of the millimeter wave radar is RDAF-14FM.

9. The highly integrated visual fusion monitoring device according to claim 2, characterized in that: The external interface includes a power interface, a data network port and a debugging serial port. The power interface is electrically connected to a power module. An Ethernet chip is connected between the data network port and the multi-core processor. The debugging serial port is electrically connected to the multi-core processor.

10. A highly integrated visual fusion monitoring device according to any one of claims 1 to 9, characterized in that: The top and both sides of the shell are provided with arranged and distributed inclined grooves.

Images