Acoustic-optical-electric multi-mode integrated sensing system carried on unmanned aerial vehicle
By integrating a multimodal sensing system with acoustic, optical, and electronic components such as microphone arrays, polarization cameras, and millimeter-wave radar, the problem of misjudgment in high-altitude target detection has been solved, and stable and accurate detection of high-altitude targets has been achieved.
Patent Information
- Application Number
- CN202520318238.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Utility models(China)
- Current Assignee / Owner
- Filing Date
- 2025-02-26
- Publication Date
- 2025-12-16
- Estimated Expiration
- 2035-02-26
AI Technical Summary
In existing technologies, high-altitude target detection is easily affected by the surrounding environment, resulting in insufficient image features, misjudgment, and reduced accuracy in perceiving and detecting small high-altitude targets.
The system employs an integrated acoustic, optical, and electronic multimodal sensing system mounted on a drone, which integrates components such as a microphone array, polarization camera, and millimeter-wave radar. Through a reasonable layout, structural fixation, and protection, it provides multimodal information detection.
It has achieved stable operation in various environments, improved the accuracy of high-altitude target detection and data acquisition quality, and ensured the stability and reliability of the UAV system and detection.
Smart Images
Figure CN223679354U_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The utility model relates to high altitude micro - small target's perception application field, concretely for a sound - light - electricity multimodal integration perception system of carrying on unmanned aerial vehicle. BACKGROUND
[0002] With the rapid development of science and technology, in the security monitoring field, the dangerous target that needs to face gradually turns from the ground to the high altitude, for example, there was a high altitude flying vehicle bombing event abroad, caused millions of losses, this makes people pay more attention to the detection of high altitude flying target in recent years. However, the ordinary polarization vision imaging system researched at present is extremely susceptible to the influence of the surrounding environment when carrying out high altitude target detection, leading to too few image features collected, causing the target detection to appear misjudgment, thereby reducing the accuracy of the perception detection of high altitude micro - small target. UTILITY MODEL CONTENT
[0003] The utility model discloses a sound - light - electricity multimodal integration perception system of carrying on unmanned aerial vehicle.
[0004] Technical scheme: a sound - light - electricity multimodal integration perception system of carrying on unmanned aerial vehicle, including microphone array, bottom plate, integrated system shell, millimeter wave radar, radar fixed cover and multiple polarization cameras, the integrated system shell includes side shell and upper shell, and the side shell, upper shell and bottom plate form the containing cavity between, the containing cavity is used for containing millimeter wave radar, and the connecting hole connected with unmanned aerial vehicle is arranged on the bottom plate, and the installation window is opened on the bottom plate, and the microphone array is installed on the installation window of the bottom plate, and the installation window is opened on the upper shell, and the millimeter wave radar is installed on the installation window of the upper shell through the radar fixed cover, and multiple polarization cameras are installed on the outer surface of the upper shell.
[0005] Further, it further includes radar protection cover, and the radar protection cover is located in the containing cavity, and the radar protection cover is installed on the inner surface of the upper shell and covers the millimeter wave radar, and the radar fixed cover is connected with the upper shell through the screw, and the radar fixed cover is fixedly combined with the millimeter wave radar.
[0006] Further, the upper shell is semispherical, and the polarization camera has eight, wherein six polarization cameras are uniformly arranged in a circular shape on the outer surface of the upper shell, and the other two polarization cameras are installed on the two sides of the millimeter wave radar respectively.
[0007] Further, it further includes multiple square structures, and the square structure is installed on the outer surface of the upper shell, and the square structure is used for fixing and containing the polarization camera, and the lens of the polarization camera extends from the upper surface of the square structure.
[0008] Further, a plurality of lens protective covers are further included, which are installed above the cuboid structure and cover the lens of the polarization camera without blocking.
[0009] Further, the polarization camera is a short-wave infrared camera.
[0010] Further, the bottom plate is a flat cover plate, four ears are arranged on the side shell and the bottom plate, through holes are arranged on the four ears, the integrated system shell and the bottom plate are connected through screws, and the integrated system shell is installed on the unmanned aerial vehicle.
[0011] Further, the polarization camera adopts a camera with a model of SG2-1MX390C-5200-FPDLink-H30X, and a camera module of the polarization camera adopts a Sony IMX390 CMOS image sensor, a GW5200 image processor and a DS90UB953TIFPDLink serializer.
[0012] Further, the millimeter wave radar adopts an ARS 548 RDI 77GHz long-distance 4D millimeter wave radar, and the millimeter wave radar includes a new type of radio frequency antenna array for providing a digital beam.
[0013] Further, the materials of the bottom plate, the integrated system shell and the radar fixing cover are light resin photocuring materials.
[0014] Compared with the prior art, the sound-optical-electric multi-modal integrated sensing system carried on the unmanned aerial vehicle has the following beneficial effects: simple structure, convenient installation, the polarization camera, the microphone array and the millimeter wave radar are installed on the unmanned aerial vehicle through a reasonable and ingenious layout structure, the integrated system shell, the bottom plate, the radar fixing cover and the radar protective cover are connected and matched, and each electronic component can be fully fixed and protected. The connection and installation between the unmanned aerial vehicle are convenient, the stable operation of the system is ensured, multi-modal information is provided for detecting high-altitude targets of the unmanned aerial vehicle, whether the unmanned aerial vehicle is in any operating state, the stable detection and data collection of the system can be ensured, and the unmanned aerial vehicle flight action is not affected in the information detection and data transmission process. BRIEF DESCRIPTION OF DRAWINGS
[0015] Figure 1 It is a structural schematic view of the sound-optical-electric multi-modal integrated sensing system carried on the unmanned aerial vehicle.
[0016] Figure 2 It is an exploded view of the sound-optical-electric multi-modal integrated sensing system carried on the unmanned aerial vehicle.
[0017] Figure 3 It is the inside of the integrated system shell from the bottom surface.
[0018] Figure 4This is a schematic diagram of the installation of the integrated acoustic, optical, and electronic sensing system mounted on a drone and the drone itself. Detailed Implementation
[0019] The present invention will be further explained and described below with reference to the accompanying drawings and specific embodiments.
[0020] like Figure 1 and Figure 2 As shown, a multimodal integrated sensing system for an unmanned aerial vehicle (UAV) includes a microphone array 1, a base plate 2, an integrated system housing 3, a millimeter-wave radar 4, a radar mounting cover 5, and multiple polarization cameras 6. The integrated system housing 3 includes a side housing 31 and an upper housing 32, forming a receiving cavity between the side housing 31, the upper housing 32, and the base plate 2. This cavity houses the millimeter-wave radar 4. The base plate 2 has a connection hole for connecting to the UAV and a mounting window 21. The microphone array 1 is mounted on the mounting window 21 on the base plate. The upper housing 32 also has a mounting window, and the millimeter-wave radar 4 is mounted on the mounting window of the upper housing 32 via the radar mounting cover 5, which is a small cover. Multiple polarization cameras 6 are mounted on the outer surface of the upper housing 32. The upper housing 32 is hemispherical and is used to mount the multiple polarization cameras 6 and the millimeter-wave radar 4. The base plate 2 is used to mount the microphone array 1 for sound reception. The dimensions of the base plate 2 match the bottom dimensions of the integrated system housing 3. The two are connected by screws, which ensures a tight fit after the drone is installed, thereby reducing the entry of external dust into the system and ensuring stable and reliable operation of the system.
[0021] It also includes a radar protective cover 7, which is located within the receiving cavity. The radar protective cover 7 is installed on the inner surface of the upper housing, covering the millimeter-wave radar 4 and serving to protect the millimeter-wave radar 4. Figure 3 As shown, the radar protective cover 7 has openings for power supply and communication, and is closed via the base plate 2. The radar mounting cover 5 is connected to the upper housing 32 by screws, and the radar mounting cover 5 is tightly fitted and fixed to the millimeter-wave radar 4. This ensures that the millimeter-wave radar 4 is housed within the space formed by the radar mounting cover 5 and the radar protective cover 7, guaranteeing stable and reliable system operation.
[0022] The upper housing 32 is hemispherical, and there are eight polarization cameras 6. Six of the polarization cameras 6 are evenly arranged in a circle on the outer surface of the upper housing, and the other two polarization cameras 6 are respectively installed on both sides of the millimeter-wave radar 4. The eight cameras work together to achieve a 360° field of view without blind spots, effectively improving the quality of image acquisition.
[0023] It also includes multiple cuboid structures 8, which are mounted on the outer surface of the upper housing 32. The cuboid structures 8 are used to fix and accommodate the polarization camera 6, and the lens of the polarization camera 6 extends from the upper surface of the cuboid structures 8.
[0024] A plurality of lens protective covers 9 are also included, which are installed above the cuboid structure 8 through M2 screws, ensure that the connection is tightly fitted, cover the lens of the polarization camera 6 without blocking, serve the purpose of fixing and protecting the camera, and ensure that the system can operate stably for a long time.
[0025] The bottom plate 2 is a plane cover plate, four ears 10 are arranged on the side shell 31 and the bottom plate 2, through holes are formed in the four ears 10, the integrated system shell 3 and the bottom plate 2 are connected through M6 screws, and are installed on the unmanned aerial vehicle. Figure 4 As shown in the installation schematic view, the sound-optical-electric multi-modal integrated sensing system 11 carried on the unmanned aerial vehicle in the embodiment is provided with four ears 10 around the bottom plate, and is rigidly connected with the lower surface of the unmanned aerial vehicle 12 through M6 screws.
[0026] The polarization camera 6 is a short-wave infrared camera. The polarization camera 6 adopts a camera with a model of SG2-1MX390C-5200-FPDLink-H30X, the camera module of the polarization camera 6 adopts a Sony IMX390 CMOS image sensor, a GW5200 image processor and a DS90UB953 TIFPDLink serializer, meets vehicle-level performance and has high-quality image effects after professional image debugging, and is provided with an M12 vehicle-mounted specification lens, and the whole module can reach an IP67 protection level.
[0027] The millimeter wave radar 4 adopts an ARS 548 RDI 77GHz long-distance 4D millimeter wave radar, and the millimeter wave radar 4 includes a new radio frequency antenna array for providing a digital beam. The ARS 548 RDI is based on a new frequency modulation pulse compression technology, and can independently measure the distance, speed (Doppler principle) and angle of a non-reflector object in one measurement cycle. This improves the distance resolution of the entire FoV range, and makes the scanning frequency reach 20 times per second. At the same time, the target measurement distance reaches 300m of detection output, and the relative speed and angle of each target in the yaw and vertical directions have high resolution in the RDI (Radar Detection Interface).
[0028] The materials of the bottom plate 1, the integrated system shell 3, the radar fixing cover 6, the radar protective cover 7, the cuboid structure 8 and the lens protective cover 9 are light resin photocuring materials, which greatly reduce the weight while considering the strength.
[0029] The utility model discloses a patent structure is simple, and installation is convenient, and can stably operate under various environmental conditions, realizes sound-optical-electric multi-modal integrated sensing detection.
Claims
1. A multimodal integrated sensing system for acoustics, optoelectronics, and electro-optics, mounted on an unmanned aerial vehicle (UAV), characterized in that: The system includes a microphone array (1), a base plate (2), an integrated system housing (3), a millimeter-wave radar (4), a radar mounting cover (5), and multiple polarization cameras (6). The integrated system housing (3) includes a side housing (31) and an upper housing (32). A receiving cavity is formed between the side housing (31), the upper housing (32), and the base plate (2). The receiving cavity is used to house the millimeter-wave radar (4). The base plate (2) has a connection hole for connecting to the UAV. The base plate (2) has an installation window (21). The microphone array (1) is installed on the installation window (21) of the base plate. The upper housing (32) has an installation window. The millimeter-wave radar (4) is installed on the installation window of the upper housing (32) through the radar mounting cover (5). Multiple polarization cameras (6) are installed on the outer surface of the upper housing (32).
2. The integrated acoustic-optical-electrical-multimodal sensing system mounted on an unmanned aerial vehicle according to claim 1, characterized in that, It also includes a radar protective cover (7), which is located in the receiving cavity. The radar protective cover (7) is installed on the inner surface of the upper housing and covers the millimeter-wave radar (4). The radar fixing (5) cover is connected to the upper housing (32) by screws, and the radar fixing cover (5) is tightly fitted and fixed to the millimeter-wave radar (4).
3. The integrated acoustic-optical-electric multimodal sensing system mounted on an unmanned aerial vehicle according to claim 1 or 2, characterized in that, The upper housing (32) is hemispherical, and there are eight polarization cameras (6). Six of the polarization cameras (6) are arranged in a circular and uniform manner on the outer surface of the upper housing, and the other two polarization cameras (6) are installed on both sides of the millimeter-wave radar (4).
4. The integrated acoustic-optical-electric multimodal sensing system mounted on an unmanned aerial vehicle according to claim 3, characterized in that, It also includes multiple cuboid structures (8), which are mounted on the outer surface of the upper housing (32). The cuboid structures (8) are used to fix and accommodate the polarization camera (6), and the lens of the polarization camera (6) extends from the upper surface of the cuboid structures (8).
5. The integrated acoustic-optical-electrical-multimodal sensing system mounted on an unmanned aerial vehicle according to claim 4, characterized in that, It also includes multiple lens covers (9), which are mounted on top of the cuboid structure (8) and cover the lens of the polarizing camera (6) without obstructing it.
6. The integrated acoustic-optical-electric multimodal sensing system mounted on an unmanned aerial vehicle according to claim 1 or 2, characterized in that, The polarization camera (6) is a short-wave infrared camera.
7. The integrated acoustic-optical-electric multimodal sensing system mounted on an unmanned aerial vehicle according to claim 1 or 2, characterized in that, The base plate (2) is a flat cover plate. The side shell (31) and the base plate (2) are provided with four ears (10). The four ears (10) have through holes. The integrated system shell (3) and the base plate (2) are connected by screws and installed on the UAV.
8. The integrated acoustic-optical-electric multimodal sensing system mounted on an unmanned aerial vehicle according to claim 1 or 2, characterized in that, The polarization camera (6) is a camera with model number SG2-1MX390C-5200-FPDLink-H30X. The camera module of the polarization camera (6) uses a Sony IMX390 CMOS image sensor, a GW5200 image processor and a DS90UB953 TIFPDLink serializer.
9. The integrated acoustic-optical-electric multimodal sensing system mounted on an unmanned aerial vehicle according to claim 1 or 2, characterized in that, The millimeter-wave radar (4) employs an ARS 548 RDI 77GHz long-range 4D millimeter-wave radar, and the millimeter-wave radar (4) includes a novel radio frequency antenna array that provides digital beams.
10. The integrated acoustic-optical-electric multimodal sensing system mounted on an unmanned aerial vehicle according to claim 1 or 2, characterized in that, The base plate (1), the integrated system housing (3), and the radar fixing cover (6) are all made of lightweight resin light-cured material.