Suspended composite audio-visual perception and positioning system

By designing a suspended composite audio-visual perception and positioning system, combining acoustic arrays and multi-spectral image-type fire detection components, the problem of fixed use of equipment is solved, portable and high-precision detection is realized, adapted to complex environments, reduced labor resource costs, and supported Real-time inspection throughout the day.

CN222028675UActive Publication Date: 2024-11-19HUAZHONG UNIV OF SCI & TECH
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202420597100.6
Authority / Receiving Office
CN · China
Patent Type
Utility models(China)
Current Assignee / Owner
Filing Date
2024-03-26
Publication Date
2024-11-19
Estimated Expiration
2034-03-26

AI Technical Summary

Technical Problem

Existing composite audio-visual perception and positioning equipment must be fixed when used, and cannot be easily moved and installed, limiting its application scope and flexibility.

Method used

A suspended composite audio-visual perception and positioning system is designed, including the main body, suspension components, acoustic array components and multi-spectral image composite fire detection components. The suspension column and support column are used to connect the acoustic array device, combining infrared, thermal image and visible Camera, enabling portability and mobility of the device.

Benefits of technology

It realizes the portability and high-precision detection capabilities of the equipment, adapts to complex environments, reduces the cost of artificial resources, supports real-time inspections throughout the day and feedback of abnormal information, and enhances the spatial positioning capabilities of the equipment.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN222028675U_ABST
    Figure CN222028675U_ABST
Patent Text Reader

Abstract

The utility model discloses a suspension type composite audio-visual perception and positioning system, which belongs to the field of image vision and array signal processing and comprises a main body, a suspension assembly, a sound array assembly and a multispectral image type composite fire detection assembly. The suspension assembly is arranged on the top of the body. The sound array assembly comprises two sound array devices of the same structure, and the two sound array devices are symmetrically arranged on the two sides of the upper portion of the body. The multispectral image type composite fire detection assembly is arranged on the upper portion of the body and comprises an infrared camera, a thermal image camera and a visible camera, the thermal image camera is located in the center of the multispectral image type composite fire detection assembly, and the infrared camera and the visible camera are symmetrically arranged on the two sides of the thermal image camera. The system is simple and convenient to use and operate, is suitable for various complex environments, such as fire detection and gas leakage detection, can greatly reduce the labor resource cost, and achieves all-day real-time inspection.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The utility model belongs to the field of image vision and array signal processing, and more specifically, relates to a suspended composite audio-visual perception and positioning system. Background Art

[0002] In the field of composite audio-visual perception and positioning, especially in the fields of fire detection, gas leak detection and equipment fault detection, audio and video signal fusion is usually used for detection. Currently, the most common audio and video fusion equipment is the acoustic camera, and many domestic and foreign companies have designed and produced related equipment.

[0003] The prior art discloses an acoustic camera (application number 202021049314.8) and a calibrator for acoustic cameras and other related applications (application number 202180014550.7). The common feature of the two is that the acoustic array is the main body, and a camera is set in the center of the acoustic array. The camera collects real images, while the acoustic array collects acoustic signals, and the two work together to restore the audio and video information of the object. However, the spatial positioning capability of the acoustic camera using a monocular camera is limited, and the distance between the acoustic array and the object to be measured cannot be accurately measured.

[0004] On the other hand, the prior art also discloses a three-dimensional positioning method for a mobile sound source based on stereo vision and beamforming (application number 202021049314.8). Compared with traditional acoustic cameras, this improved device has achieved technical progress from collecting two-dimensional audio and video signals to three-dimensional audio and video signals, enhanced the spatial positioning capability of the device, and can obtain more detailed information about abnormal points. However, the device must be fixed when in use, which is not convenient for mobile mounting. Utility Model Content

[0005] In view of the above defects or improvement needs of the prior art, the utility model provides a suspended composite audio-visual perception and positioning system, thereby solving the technical problem that the equipment must be fixed when in use and is not convenient for mobile mounting.

[0006] To achieve the above-mentioned purpose, according to one aspect of the utility model, there is provided a suspended composite audio-visual perception and positioning system, which includes a main body, a suspension component, an acoustic array component and a multi-spectral image type composite fire detection component; the suspension component is arranged on the top of the main body; the acoustic array component includes two acoustic array devices with the same structure, and the two acoustic array devices are symmetrically arranged on both sides of the upper part of the main body; the multi-spectral image type composite fire detection component is arranged on the upper part of the main body, and the multi-spectral image type composite fire detection component includes an infrared camera, a thermal imaging camera and a visible camera, the thermal imaging camera is located at the center of the multi-spectral image type composite fire detection component, the infrared camera and the visible camera are symmetrically arranged on both sides of the thermal imaging camera, and the infrared camera, the thermal imaging camera and the visible camera have the same angle with the plane where the main body is located.

[0007] Preferably, the two acoustic array devices are slidably connected to the main body via support columns respectively, and an angle exists between the two acoustic array devices and the plane where the main body is located.

[0008] Preferably, a plurality of circular holes are provided on the surface of the sound array device, and microphone heads are installed in the circular holes.

[0009] Preferably, the plurality of circular holes are distributed in a multi-arm spiral shape from the center of the surface of the acoustic array device to the surrounding areas.

[0010] Preferably, the angle θ between the two acoustic array devices is 120° to 170°, and the angle α between the acoustic array device and the plane where the main body is located is 3°.

[0011] Preferably, the suspension component is a suspension column, one end of which is threadedly connected to the main body, and the other end of which is provided with a suspension interface, and the suspension interface is movably connected to an external device.

[0012] Preferably, the angle α between the infrared camera, the thermal imaging camera and the visible camera and the plane where the main body is located is 3°.

[0013] Preferably, heat dissipation channels are symmetrically arranged on both sides of the main body, and a nozzle can be installed inside the heat dissipation channel.

[0014] Preferably, a microphone is provided in the inner cavity of the main body, and the microphone is located below the multi-spectral imaging type composite fire detection component.

[0015] Preferably, it also includes a light sensing probe, which is installed at the bottom of the main body.

[0016] In general, compared with the prior art, the above technical solution conceived by the utility model has the advantages of high-precision detection of audio and video fusion detection equipment achieved by binocular recognition combined with acoustic array equipment, and also realizes portable and mobile equipment, which can be hung on other existing equipment such as drones. The utility model is easy to use, simple to operate, and adaptable to various complex environments. In the field of composite audio-visual perception and positioning, such as fire detection and gas leak detection, it can greatly reduce the cost of labor resources, realize real-time inspection throughout the day, and feedback abnormal information to users in real time to avoid losses. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] Figure 1 It is a structural schematic diagram of the utility model's suspended composite audio-visual perception and positioning system;

[0018] Figure 2 It is an exploded diagram of the suspended composite audio-visual perception and positioning system of the utility model;

[0019] Figure 3 This is the structural front view of the utility model's suspended composite audio-visual perception and positioning system;

[0020] Figure 4 This is a left view of the structure of the suspended composite audio-visual perception and positioning system of the utility model;

[0021] Figure 5 It is a structural top view of the suspended composite audio-visual perception and positioning system of the utility model.

[0022] In all the drawings, the same reference numerals are used to represent the same elements or structures, among which: 1-main body; 10-optical sensor; 11-microphone; 12-multi-spectral imaging composite fire detection component; 120-infrared camera; 121-thermal imaging camera; 122-visible camera; 13-heat dissipation channel; 2-suspension column; 20-suspension interface; 3-acoustic array device; 30-circular hole; 31-support column. DETAILED DESCRIPTION

[0023] In order to make the purpose, technical solution and advantages of the utility model more clear, the utility model is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the utility model and are not used to limit the utility model. In addition, the technical features involved in each embodiment of the utility model described below can be combined with each other as long as they do not conflict with each other.

[0024] like Figure 1-Figure 5As shown, the utility model proposes a suspended composite audio-visual perception and positioning system, which consists of a main body 1, a suspension column 2 and an acoustic array component; the main functional components on the main body 1 are composed of a light sensing probe 10, a microphone 11, a multi-spectral imaging composite fire detection component 12 and a heat dissipation channel 13.

[0025] For further explanation, the optical sensor 10 is threadedly connected to the bottom of the main body 1 , the microphone 11 and the multi-spectral imaging composite fire detection assembly 12 are welded to the inner cavity of the main body 1 , and the heat dissipation channel 13 runs through the center of the main body 1 at the bottom.

[0026] Further explanation, the main functional components of the multi-spectral imaging composite fire detection assembly 12 are composed of an infrared camera 120, a thermal imaging camera 121 and a visible camera 122. The angle between the lenses of the three cameras and the vertical plane is α. As a preferred embodiment of the utility model, the angle α is 3°.

[0027] Further explanation, one end of the suspension column 2 is provided with a suspension interface 20, and the suspension interface 20 can be combined with a drone connection buckle and other devices to be flexibly connected to a drone or other devices. The suspension column 2 is threadedly connected to the main body 1.

[0028] Further explanation, the sound array assembly is composed of two sound array devices 3 of the same structure, and the sound array device 3 is composed of 32 microphone heads and a support column 31. The sound array device 3 is slidably connected to the main body 1 through the support column 31, and there is an angle θ between the two sides of the sound array, and the angle with the vertical plane is α. As a preferred embodiment of the utility model, the angle θ between the two sound array devices is 120° to 170°, and the angle α between the sound array device and the plane where the main body is located is 3°.

[0029] The working process of the utility model is as follows: the suspension column 2 is suspended under the rotatable joint, and the rotatable joint can be placed on the ceiling or on other movable devices such as drones. When the user turns on the device, the device can automatically detect the surrounding environment through the light sensing probe 10, the multi-spectral imaging type composite fire detection component 12 and the sound array component, and perform composite audio-visual perception and positioning functions. For example, when a potential fire hazard such as a flame or a gas leak is detected, the device will rotate to the corresponding direction, collect on-site data through the multi-spectral imaging type composite fire detection component 12 and the sound array component, and feed back the image and three-dimensional coordinates of the abnormal point to the user in real time, and send out an alarm prompt information through the microphone 11, thereby completing the all-day patrol warning function.

[0030] It will be easily understood by those skilled in the art that the above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present invention shall be included in the protection scope of the present invention.

Claims

1. A suspended composite audio-visual perception and positioning system, characterized in that: The system comprises a main body (1), a suspension component, an acoustic array component and a multi-spectral image type composite fire detection component (12); the suspension component is arranged on the top of the main body (1); the acoustic array component comprises two acoustic array devices (3) of identical structure, the two acoustic array devices (3) are symmetrically arranged on both sides of the upper part of the main body (1); the multi-spectral image type composite fire detection component (12) is arranged on the upper part of the main body (1), the multi-spectral image type composite fire detection component (12) comprises an infrared camera (120), a thermal imaging camera (121) and a visible camera (122), the thermal imaging camera (121) is located at the center of the multi-spectral image type composite fire detection component (12), the infrared camera (120) and the visible camera (122) are symmetrically arranged on both sides of the thermal imaging camera (121), and the infrared camera (120), the thermal imaging camera (121) and the visible camera (122) respectively have the same angle with the plane where the main body (1) is located.

2. A suspended composite audio-visual perception and positioning system according to claim 1, characterized in that: The two acoustic array devices (3) are respectively slidably connected to the main body (1) via support columns (31), and an angle exists between the two acoustic array devices (3) and the plane where the main body (1) is located.

3. A suspended composite audio-visual perception and positioning system according to claim 2, characterized in that: A plurality of circular holes (30) are provided on the surface of the sound array device (3), and microphone heads are installed in the circular holes (30).

4. A suspended composite audio-visual perception and positioning system according to claim 3, characterized in that: A plurality of circular holes (30) are distributed in a multi-arm spiral shape from the center of the surface of the acoustic array device (3) to the surrounding areas.

5. A suspended composite audio-visual perception and positioning system according to claim 2 or 4, characterized in that: The included angle θ between the two acoustic array devices (3) is 120° to 170°, and the included angle α between the acoustic array device (3) and the plane where the main body (1) is located is 3°.

6. A suspended composite audio-visual perception and positioning system according to claim 1, characterized in that: The suspension component is a suspension column (2), one end of which is threadedly connected to the main body (1), and the other end of which is provided with a suspension interface (20), and the suspension interface (20) is movably connected to an external device.

7. The suspended composite audio-visual perception and positioning system according to claim 1, characterized in that: The angle α between the infrared camera (120), the thermal imaging camera (121) and the visible camera (122) and the plane where the main body (1) is located is 3°.

8. The suspended composite audio-visual perception and positioning system according to claim 1, characterized in that: Heat dissipation channels (13) are symmetrically arranged on both sides of the main body (1), and a nozzle can be installed inside the heat dissipation channel (13).

9. The suspended composite audio-visual perception and positioning system according to claim 1, characterized in that: The inner cavity of the main body (1) is provided with a microphone (11), and the microphone (11) is located below the multi-spectral image type composite fire detection component (12).

10. The suspended composite audio-visual perception and positioning system according to claim 1, characterized in that: It also comprises a light sensing probe (10), wherein the light sensing probe (10) is installed at the bottom of the main body (1).