Equipment state monitoring system and method based on acoustic-thermal imaging, equipment and medium

Non-contact monitoring of equipment status is achieved through acoustic and thermal imaging technology, solving the inaccuracy and safety hazards of traditional contact measurement, providing wider coverage and higher monitoring accuracy, suitable for a variety of complex environments, reducing the risk of inaccuracy and safety risks of traditional contact measurements, providing wider coverage and higher monitoring accuracy. Operating costs.

CN119046873APending Publication Date: 2024-11-29TIEKE SCHAEFFLER RAIL TRANSIT TECH CO LTD
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
CN202411118213.4
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-08-15
Publication Date
2024-11-29

AI Technical Summary

Technical Problem

Traditional equipment status monitoring methods mainly rely on contact measurement, which has problems such as inaccurate measurement, safety hazards, complex maintenance and high cost. Especially when dealing with flammable, explosive and leaky media, the safety and reliability are low, and many The synchronization monitoring of equipment is complicated.

Method used

The non-contact monitoring system based on acoustic and thermal imaging is adopted to collect sound and temperature signals in real time through a microphone array and a thermal imaging camera, generate distributed images using the MBF algorithm, and automatically or manually set measurement points to achieve synchronous monitoring and diagnosis of multi-device status.

Benefits of technology

It realizes intuitive and comprehensive monitoring of equipment noise and temperature, with a wide coverage range, avoids sensor wiring complexity, improves monitoring accuracy and safety, reduces operating costs, and is suitable for a variety of complex environments.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119046873A_ABST
    Figure CN119046873A_ABST
Patent Text Reader

Abstract

The invention discloses an equipment state monitoring system and method based on acoustic thermal imaging, equipment and a medium. The monitoring system comprises an acoustic thermal imaging data acquisition module, a sound and temperature distribution image calculation and generation module, a measuring point setting and data extraction module, a noise and temperature data analysis module and a multi-information input multi-equipment state fusion diagnosis module. A diagnosis result display module; collecting multichannel sound signals, video image signals and temperature signals in real time; synchronously calculating the multi-channel sound signals in real time, generating a noise source distribution diagram, and fusing and displaying the noise source distribution diagram and the video image signals to obtain a sound distribution image; calculating and generating a temperature distribution image in real time based on the temperature signal data, and displaying the position of the maximum temperature point and the position of the minimum temperature point in real time; setting a sound monitoring point and a temperature monitoring point in real time; sound feature data and temperature feature data are generated through real-time calculation; a comprehensive evaluation result is given out for the health state of each monitored device, and a diagnosis analysis report is generated and displayed.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of equipment status monitoring, and more specifically, to an equipment status monitoring system, method, equipment and medium based on acoustic thermal imaging. Background Art

[0002] In the daily production process, the monitoring of the operating status of production equipment is of great significance for improving production efficiency, reducing maintenance costs, and ensuring production safety. By real-time monitoring of the status parameters of mechanical equipment (such as temperature, noise, etc.), abnormal signals can be detected and warned early, and maintenance or replacement measures can be taken in advance to avoid production interruptions and losses caused by equipment failure. Effective preventive measures can extend the service life of equipment and reduce maintenance costs. According to the actual condition of the equipment, a reasonable maintenance strategy can be formulated to reduce unnecessary downtime and maintenance work and improve equipment utilization. By online monitoring of equipment status, the energy consumption and operating efficiency of the equipment can be analyzed, the causes of energy waste and potential energy saving space can be found, and corresponding measures can be taken to adjust and optimize. By analyzing and mining data, potential problems can be found, equipment performance can be optimized, process flow can be improved, product quality and production efficiency can be improved, and the development of various degradation processes of equipment can be discovered in time, so as to timely repair and replace before possible failures or performance degradation affect normal work, and avoid accidents that endanger safety.

[0003] Generally speaking, the status monitoring of production equipment is mainly carried out from two aspects: noise and temperature. Production equipment noise monitoring is an important link in the field of environmental protection and industrial production. Common sources of production environment noise include Figure 1 As shown. In terms of environmental protection, by monitoring the noise level of production equipment, we can understand the situation of noise pollution and provide a scientific basis for noise control and management. This helps to reduce the impact of noise on the surrounding environment and residents, and protect the ecological environment and public health. In industrial production, noise monitoring can be used to evaluate the operating conditions of machinery and equipment, predict possible failures, and carry out repairs and maintenance in a timely manner. This helps to ensure the normal operation of equipment, reduce failure rates, and improve production efficiency and product quality. Temperature monitoring of production equipment plays an indispensable role in ensuring product quality, improving production efficiency, ensuring production safety, and supporting fault diagnosis and maintenance.

[0004] Although the traditional single-point infrared temperature measurement method can provide non-contact safe temperature measurement in certain environments, its main disadvantages are its limitations in temperature measurement efficiency and environmental adaptability.

[0005] The traditional scheme of using contact-type vibration sensors and temperature sensors to monitor the status of equipment is in direct contact with the production medium, and has high requirements on the material properties of the sensor contact surface (such as corrosion resistance, heat resistance, etc.). The sensor may be deformed or damaged when it is directly subjected to force, especially when the material is easy to crystallize and has high viscosity, and its attachment to the sensor will cause inaccurate measurement. Maintenance is inconvenient, affecting continuous production, and there are safety hazards for maintenance personnel to contact the medium. There are many openings in the equipment, which is prone to "leakage". The instrument and the measurement drainage pipe must be insulated, heated, and anti-corrosive, which affects the visual management of the production site. The measurement range is affected by the instrument itself, and over-range use may occur, resulting in damage to the instrument. These shortcomings limit the application of contact measurement in specific environments, especially when dealing with toxic, corrosive, pressurized, flammable, explosive, and leaky media, its safety and reliability are relatively low. In addition, the repair and maintenance of contact measurement is also relatively complicated, which increases operating costs. In addition, the traditional status monitoring system uses contact measurement methods to monitor the status of multiple devices simultaneously in real time, which is complicated in terms of sensor installation and wiring. Summary of the invention

[0006] The purpose of the present invention is to overcome the deficiencies in the prior art and propose an equipment status monitoring system, method, equipment and medium based on acoustic thermal imaging. The system adopts a non-contact measurement method and has the advantage of flexible application in setting measurement points based on images. The system can monitor the status of multiple devices within the monitoring area simultaneously without the need for sensor wiring. The system has a wider coverage area and more comprehensive detection information. The system can observe the heating and noise conditions of the equipment more intuitively, which is beneficial for engineering personnel to discover and locate problems in a timely manner.

[0007] The purpose of the present invention can be achieved through the following technical solutions.

[0008] The equipment status monitoring system based on acoustic thermal imaging of the present invention includes the following modules:

[0009] ① Acoustic and thermal imaging data acquisition module: real-time acquisition of multi-channel sound signals, video image signals, and temperature signals within the monitoring area where the monitored equipment is located;

[0010] ② Sound and temperature distribution image calculation and generation module: MBF algorithm is used to synchronously calculate and process multi-channel sound signals and generate a distribution map of noise sources on a two-dimensional plane, which is then fused and displayed in real time with video image signals to obtain a sound distribution image; meanwhile, a temperature distribution image is generated in real time based on temperature signal data;

[0011] ③ Measurement point setting and data extraction module: Based on the sound distribution image and temperature distribution image generated by real-time calculation, the sound monitoring point and temperature monitoring point are manually or automatically set for each monitored device in real time, and each monitoring point is monitored synchronously in real time. The MBF algorithm is used to extract the sound signal of the specified sound monitoring point and filter out the sound signals from other directions outside the specified sound monitoring point;

[0012] ④The noise and temperature data analysis module includes a multi-point noise spectrum and noise distribution analysis module based on acoustic imaging and a multi-point temperature change and temperature distribution analysis module based on thermal imaging.

[0013] The multi-measurement point noise spectrum and noise distribution analysis module based on acoustic imaging calculates the noise spectrum in real time based on the sound signals collected in real time and synchronously at each designated sound monitoring point, analyzes its frequency components, amplitude height, and noise intensity change trend, and generates sound feature data that can reflect the operating status and fault status of each monitored device, and records the noise level change trend of each sound monitoring point within the monitoring range;

[0014] The multi-measurement point temperature change and temperature distribution analysis module based on thermal imaging calculates and analyzes the temperature change trend in real time based on the temperature signals collected synchronously in real time at each designated temperature monitoring point, and generates temperature characteristic data that can reflect the operating status and fault status of each monitored device, and records the temperature change trend of each temperature monitoring point within the monitoring range;

[0015] ⑤ The multi-information input multi-device status fusion diagnosis module gives a comprehensive evaluation result of the health status of each monitored device and generates a diagnosis analysis report based on the sound feature data generated by the multi-measurement point noise spectrum and noise distribution analysis module based on acoustic imaging and the temperature feature data generated by the multi-measurement point temperature change and temperature distribution analysis module based on thermal imaging;

[0016] ⑥ Diagnostic result display module, used to display a diagnostic analysis report reflecting the health status of each monitored device.

[0017] Furthermore, the acoustic and thermal imaging data acquisition module adopts an acoustic and thermal imaging acquisition device, which integrates a microphone array, a video camera, and a thermal imaging camera; the microphone array is composed of 60 digital microphones, which are arranged in a two-dimensional spiral form to achieve sound source positioning in two dimensions, vertical and horizontal, and sound pickup in a specific direction; the video camera and thermal imaging camera adopt an embedded design and are arranged in the center of the microphone array.

[0018] Furthermore, the acoustic and thermal imaging data acquisition module is equipped with a remote control pan-tilt system, which is used for the acoustic and thermal imaging data acquisition module to collect sound signals, video image signals, and temperature signals in different directions to expand the monitoring range.

[0019] Furthermore, the acoustic and thermal imaging data acquisition module uses high-speed Ethernet communication technology to transmit multi-channel sound signals collected in real time by the microphone array, video image signals collected in real time by the video camera, and temperature signals collected in real time by the thermal imaging camera, thereby realizing long-distance signal transmission.

[0020] Furthermore, the sound and temperature distribution image calculation and generation module has the following two functions: acoustic imaging calculation and thermal imaging calculation:

[0021] Acoustic imaging calculation: MBF algorithm is used to synchronously calculate the sound intensity distribution matrix of multi-channel sound signals in real time, generate a sound intensity distribution color cloud map, and display it in real time with the video image to obtain a sound distribution image, which can realize the display of the noise source position in the specified noise frequency range;

[0022] Thermal imaging calculation: The temperature distribution matrix is ​​calculated based on the real-time collected temperature signal data, and a temperature distribution color cloud map, i.e., a temperature distribution image, is generated. The maximum temperature point position and the minimum temperature point position in the current image area are displayed in real time.

[0023] Furthermore, the measuring point setting and data extraction module manually or automatically arranges sound monitoring points and temperature monitoring points at the maximum noise point position and the maximum temperature point position within the monitored equipment range; or automatically identifies the outline of the monitored equipment based on the video image, and automatically arranges measuring points at the maximum noise point or the maximum temperature point within the monitored equipment range.

[0024] The purpose of the present invention can also be achieved through the following technical solutions.

[0025] The device status monitoring method based on acoustic thermal imaging of the present invention comprises the following steps:

[0026] S1 data acquisition: real-time acquisition of multi-channel sound signals, video image signals, and temperature signals within the monitoring area where the monitored equipment is located;

[0027] S2 sound and temperature distribution image calculation and generation

[0028] S201 Sound distribution image calculation and generation: MBF algorithm is used to perform real-time synchronous calculation and processing on multi-channel sound signals and generate a distribution map of noise sources on a two-dimensional plane, which is then fused and displayed in real time with video image signals to obtain a sound distribution image, realizing the display of the noise source position within a specified noise frequency range;

[0029] S202: temperature distribution image calculation and generation: based on the temperature signal data, a temperature distribution image is calculated and generated in real time, and the maximum temperature point position and the minimum temperature point position in the current image area are displayed in real time;

[0030] S3 measurement point setting and data extraction: Based on the sound distribution image and temperature distribution image generated by real-time calculation, the sound monitoring point and temperature monitoring point are manually or automatically set for each monitored device in real time, and each monitoring point is monitored synchronously in real time. The MBF algorithm is used to extract the sound signal of the specified sound monitoring point and filter out the sound signals from other directions outside the specified sound monitoring point;

[0031] S4 Noise and Temperature Data Analysis

[0032] S401 Noise and temperature data analysis: Based on the sound signals collected in real time at each designated sound monitoring point, the noise spectrum is calculated in real time and the frequency components, amplitude height, and noise intensity change trend are analyzed. The sound characteristic data that can reflect the operating status and fault status of each monitored device are generated respectively. At the same time, the noise level change trend of each sound monitoring point within the monitoring range is recorded;

[0033] S402 Noise and temperature data analysis: Based on the temperature signals collected synchronously in real time at each designated temperature monitoring point, the temperature change trend is calculated and analyzed in real time, and temperature characteristic data that can reflect the operating status and fault status of each monitored device is generated respectively. At the same time, the temperature change trend of each temperature monitoring point within the monitoring range is recorded;

[0034] S5 Multi-information input and multi-device status fusion diagnosis: Based on the above-mentioned sound feature data and temperature feature data, a comprehensive evaluation result is given for the health status of each monitored device, and a diagnostic analysis report is generated and displayed.

[0035] The purpose of the present invention can also be achieved through the following technical solutions.

[0036] An electronic device comprises a memory, a processor and a computer program stored in the memory and executable on the processor, wherein the processor implements the above-mentioned device status monitoring system or method based on acoustic thermal imaging when executing the computer program.

[0037] The purpose of the present invention can also be achieved through the following technical solutions.

[0038] A computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the above-mentioned equipment status monitoring system or method based on acoustic thermal imaging is implemented.

[0039] Compared with the prior art, the technical solution of the present invention has the following beneficial effects:

[0040] (1) The present invention is based on a microphone array consisting of 60 microphones, and uses a beamforming algorithm to calculate the noise distribution in the monitoring area in front of the microphone array and generate a noise intensity distribution cloud map. A video camera and a thermal imaging camera are installed in the center of the microphone array. They synchronously collect image signals in real time with the microphone array, and fuse and display them with the acoustic imaging image, which can display the noise distribution of the monitored equipment in the image in real time. In a complex noise environment (there are multiple noise sources in the space), the beamforming algorithm (Microphone Beamforming algorithm, referred to as MBF algorithm) can be used to collect noise in a specified direction, achieve an acoustic spatial filtering effect, improve the signal-to-noise ratio of the acoustic signal in the specified direction, and provide high-quality input signals for subsequent fault diagnosis calculations.

[0041] (2) The thermal imaging camera in the present invention is developed based on the physical phenomenon that all objects above absolute zero will emit infrared radiation. Compared with ordinary video cameras, it is not affected by ambient light. Based on the thermal imaging image, the temperature distribution of the equipment, the location of the highest temperature area and the temperature value of a specific point can be observed. Compared with the traditional single-point infrared temperature measurement method, the thermal imaging temperature detection method has a wider coverage range, more comprehensive detection information, and a more intuitive observation of the heating condition of the equipment, which is conducive to engineering personnel to promptly discover and locate problems.

[0042] (3) Compared with the traditional scheme of using contact-type vibration sensors and temperature sensors to monitor the status of equipment, the equipment status monitoring system based on acoustic thermal imaging of the present invention adopts a non-contact measurement method, and has the advantage of flexible application by setting measurement points based on images. It is more convenient for monitoring the status of multiple equipment within the monitoring area, and does not require sensor wiring. It can avoid the complex work of sensor installation and wiring when the traditional status monitoring system uses a contact measurement method to monitor the status of multiple equipments in real time.

[0043] (4) The present invention monitors the equipment status covered by the acoustic and thermal image acquisition equipment based on the sound, temperature, video image and thermal imaging collected by the acoustic and thermal image acquisition equipment. The maximum noise source and the location of the maximum temperature can be observed in real time based on acoustic imaging and thermal imaging, and the noise and temperature diffusion and distribution can be observed, so as to timely understand the basic health status of the equipment and the possible areas where faults exist. At the same time, the system software supports the measurement point setting function based on real-time images, and the monitoring points can be set at any position on the image, and the noise and temperature changes can be monitored synchronously and in real time at multiple points. The system can obtain the sound signals of each monitoring point in real time and filter the sounds from other directions outside the monitoring point. Based on the calculation, processing and analysis of the sound signals collected at each monitoring point, the operating status of the equipment can be monitored in real time. The calculation and analysis of acoustic signals include noise spectrum frequency component analysis, noise intensity change trend analysis, etc. The system can analyze the maximum temperature value, minimum temperature value and their change trend within the monitoring range based on the real-time acquisition of temperature images and data, and analyze the temperature change trend of multiple monitoring points set on the image. The operation and health status of the monitored equipment are comprehensively analyzed and judged based on the comprehensive acoustic analysis and temperature analysis results. BRIEF DESCRIPTION OF THE DRAWINGS

[0044] Figure 1 Schematic diagram of common noise sources in production environments.

[0045] Figure 2 Schematic diagram of the equipment status monitoring system based on acoustic thermal imaging of the present invention.

[0046] Figure 3 It is a schematic diagram of the acoustic thermal image acquisition device in the present invention.

[0047] Figure 4 It is a schematic diagram of the pan / tilt installation effect of the acoustic thermal image acquisition device in the present invention.

[0048] Figure 5 This is an example diagram of the acoustic imaging monitoring image and sound monitoring point arrangement in the present invention.

[0049] Figure 6 A schematic diagram of acoustic imaging calculation based on a microphone array in the present invention;

[0050] Among them, (a) 3D acoustic simulation model and (b) algorithm test results based on the simulation model.

[0051] Figure 7 This is an example diagram of the thermal imaging monitoring image and temperature monitoring point arrangement in the present invention.

[0052] Figure 8 It is the noise spectrum diagram of each sound monitoring point in the present invention.

[0053] Fig. 9It is a schematic diagram of the temperature change trend of each temperature monitoring point in the present invention.

[0054] Fig.10 The present invention is a data processing flow chart of the equipment status monitoring method based on acoustic thermal imaging.

[0055] Figure numerals: 1-microphone array, 2-video camera, 3-thermal imaging camera, 4-pan head, 5-channel steel, 6-base, 7-mounting bracket, 8-telescopic clamp, 9-disc collector, 10-M8 bolt, 11-M10 bolt. DETAILED DESCRIPTION

[0056] The present invention will be further described below in conjunction with the accompanying drawings.

[0057] The present invention is based on the equipment status monitoring system of acoustic thermal imaging, such as Figure 2 As shown, it mainly includes the following modules:

[0058] ①Acoustic thermal imaging data acquisition module

[0059] The acoustic and thermal imaging data acquisition module is used to collect multi-channel sound signals, video image signals, and temperature signals in real time within the monitoring area where the monitored equipment is located.

[0060] Preferably, the acoustic thermal imaging data acquisition module can use an acoustic thermal imaging acquisition device, such as Figure 3 As shown, a microphone array 1, a video camera 2 (such as a white light camera, etc.), and a thermal imaging camera 3 are integrated. The microphone array can be composed of 60 digital microphones, which can be arranged in a two-dimensional spiral form on a fixed plate, and can realize the sound source positioning in two dimensions of vertical and horizontal directions, as well as the sound pickup in a specific direction. The video camera and thermal imaging camera can be embedded in the center of the microphone array. The two-dimensional microphone array has good spatial filtering characteristics, which can pick up sounds from a specific direction and reduce the influence of noise from other directions. It can effectively improve the signal-to-noise ratio of the fault signal and is conducive to the extraction of fault features. Combined with a thermal imaging camera, three-dimensional monitoring of key components of industrial equipment can be achieved, which increases the dimension of fault diagnosis, thereby effectively improving the accuracy of fault diagnosis.

[0061] Preferably, the acoustic and thermal imaging data acquisition module may also be equipped with a remote control pan-tilt system, which is used for the acoustic and thermal imaging data acquisition module to collect sound signals, video image signals, and temperature signals in different directions to expand the monitoring range. Figure 4As shown, the acoustic and thermal imaging data acquisition module can be installed on the channel steel 5 within the monitoring area. For example, the pan-tilt 4 in the remote control pan-tilt system is installed on the channel steel 5 through the base 6. The upper part of the pan-tilt 4 is provided with a mounting bracket 7. The mounting bracket 7 is connected to the disc collector 9 through the telescopic clamp 8. The circular fixed plate of the disc collector 9 is integrated with a microphone array 1, a video camera 2, and a thermal imaging camera 3. When the pan-tilt 4 rotates, the disc collector 9 can be driven to rotate synchronously, thereby realizing that the microphone array 1, the video camera 2, and the thermal imaging camera 3 collect sound signals, video image signals, and temperature signals in different directions. Among them, the pan-tilt 4 and the base 6 can be fixed by M8 bolts 10, and the base 6 and the channel steel 5 can be fixed by M10 bolts 11.

[0062] Preferably, the acoustic and thermal imaging data acquisition module uses high-speed Ethernet communication technology to transmit multi-channel sound signals collected in real time by the microphone array, video image signals collected in real time by the video camera, and temperature signals collected in real time by the thermal imaging camera, thereby realizing long-distance signal transmission.

[0063] ② Sound and temperature distribution image calculation and generation module

[0064] The sound and temperature distribution image calculation and generation module uses the MBF algorithm to synchronously calculate and process multi-channel sound signals and generate a distribution map of noise sources on a two-dimensional plane, and displays it in real time with the video image signal to obtain a sound distribution image; at the same time, based on the temperature signal data collected by the thermal imaging camera, a temperature distribution image is calculated and generated in real time. The combination of the sound distribution image and the temperature distribution image can help engineering and technical personnel to grasp the main noise and temperature distribution and location in a timely manner.

[0065] The sound and temperature distribution image calculation and generation module has the following two functions: sound imaging calculation and thermal imaging calculation:

[0066] Acoustic imaging calculation: Based on the multi-channel sound signals collected by the microphone array, the MBF algorithm is used to synchronously calculate the sound intensity distribution matrix of the multi-channel sound signals in real time to generate a sound intensity distribution color cloud map (i.e., noise distribution cloud map), which is then fused with the video image collected by the video camera in real time to obtain a sound distribution image, which can realize the display of the noise source position in the specified noise frequency range. Figure 5 As shown, Figure 5 The red part in the middle is the area with the highest current noise intensity. The schematic diagram of acoustic imaging calculation based on microphone array is as follows: Figure 6 shown.

[0067] Thermal imaging calculation: Based on the real-time collected temperature signal data, the temperature distribution matrix is ​​calculated and displayed in real time to generate a temperature distribution color cloud map, i.e., a temperature distribution image, and display the maximum and minimum temperature points in the current image area in real time. Figure 7 As shown in the figure, the bright yellow area is the current highest temperature area. The red cross point is the maximum temperature point, and the blue cross point is the minimum temperature point.

[0068] ③Measurement point setting and data extraction module

[0069] The measurement point setting and data extraction module manually or automatically sets the sound monitoring point and temperature monitoring point for each monitored device in real time based on the sound distribution image and temperature distribution image generated by real-time calculation, performs synchronous real-time monitoring of each monitoring point, and uses the MBF algorithm to extract the sound signal of the specified sound monitoring point and filter out the sound signal from other directions outside the specified sound monitoring point. Figure 5 The red dot in the middle is the arranged sound monitoring point.

[0070] The measuring point setting and data extraction module can set multiple sound monitoring points and temperature monitoring points at any position within the range of the real-time displayed sound distribution image and temperature distribution image. A device can also set multiple monitoring points for real-time status monitoring of the monitored device. Multiple monitoring points perform real-time synchronous sound signal and temperature signal data collection and multi-point synchronous status monitoring. The measuring point setting and data extraction module can also manually or automatically arrange sound monitoring points and temperature monitoring points at the maximum noise point position and maximum temperature point position within the range of the monitored device; or automatically identify the shape of the monitored device based on the video image, and automatically arrange measuring points at the maximum noise point or maximum temperature point within the range of the monitored device. Real-time monitoring and analysis of the maximum noise and maximum temperature of the equipment can be achieved.

[0071] ④Noise and temperature data analysis module

[0072] The noise and temperature data analysis module includes a multi-measurement point noise spectrum and noise distribution analysis module based on acoustic imaging and a multi-measurement point temperature change and temperature distribution analysis module based on thermal imaging.

[0073] The multi-point noise spectrum and noise distribution analysis module based on acoustic imaging calculates the noise spectrum in real time based on the sound signals collected in real time and synchronously at each designated sound monitoring point, and analyzes its frequency components, amplitude height, and noise intensity change trend, and generates sound feature data that can reflect the operating status and fault status of each monitored device, such as the amplitude height at the fault feature frequency of the monitored device, the noise decibel value in the designated noise frequency band, the fault noise difference index, etc. At the same time, the noise level change trend of each sound monitoring point within the monitoring range is recorded, such as Figure 8shown.

[0074] The calculation of the fault noise difference index is shown as follows:

[0075]

[0076] In the formula, EFDI (Equipment Failure Differentiation Index) is the equipment failure noise difference index, which can reflect the difference degree of the equipment failure noise in a noisy environment. C(n) is the characteristic frequency weight coefficient of the equipment failure noise, that is, n is the characteristic frequency number of equipment fault noise, N is the number of characteristic frequency points of equipment fault noise; F EF ( ● ) is the equipment noise spectrum, z(n) is the characteristic frequency of equipment fault noise; F AS ( ● ) is the ambient noise spectrum, m is the frequency point number on the spectrum, and M is the total length of the spectrum.

[0077] The multi-point temperature change and temperature distribution analysis module based on thermal imaging calculates and analyzes the temperature change trend in real time based on the temperature signals collected synchronously in real time at each designated temperature monitoring point, and generates temperature characteristic data that can reflect the operating status and fault status of each monitored device, such as the highest temperature and its position in the designated area, the lowest temperature point and its position, the rate of change of the highest temperature, the rate of change of the lowest temperature, the temperature value and its rate of change of the designated monitoring point, the temperature difference index, etc. At the same time, the temperature change trend of each temperature monitoring point within the monitoring range is recorded, such as Fig. 9 shown.

[0078] The calculation formula of temperature difference index is as follows:

[0079]

[0080] Where ETDI (Equipment Temperature Differentiation Index) is the equipment temperature difference index, which can reflect the difference between the equipment temperature and the ambient temperature. EP is the equipment temperature, Z is the weight coefficient of the temperature measurement point, that is, k is the serial number of the equipment temperature measurement point, K is the total number of equipment temperature measurement points; T RP is the temperature of the ambient temperature reference point, l is the sequence number of the ambient temperature reference point, and L is the total number of ambient temperature reference points.

[0081] ⑤Multi-information input and multi-device status fusion diagnosis module

[0082] According to the sound characteristic data generated by the multi-measurement point noise spectrum and noise distribution analysis module based on acoustic imaging and the temperature characteristic data generated by the multi-measurement point temperature change and temperature distribution analysis module based on thermal imaging, a comprehensive evaluation result is given for the health status of each monitored device, a diagnostic analysis report is generated, and the diagnostic results are output to the diagnostic result display module.

[0083] E HI =G (S c , T c ) (3)

[0084] In the formula, E HI is the equipment health index; G is the equipment health assessment function, which is designed based on the equipment failure mechanism and prior data; S C is a sound feature dataset, which is generated by the multi-point noise spectrum and noise distribution analysis module based on acoustic imaging based on the sound monitoring point data on the same device; C It is a temperature feature data set, which is generated based on the temperature monitoring point data on the same equipment by the multi-measurement point temperature change and temperature distribution analysis module based on thermal imaging.

[0085]

[0086] ⑥Diagnosis result display module

[0087] The diagnosis result display module is used to display the diagnosis analysis report reflecting the health status of each monitored device, and can issue an alarm based on the diagnosis analysis report and display the alarm information.

[0088] The equipment status monitoring system based on acoustic thermal imaging of the present invention has the following main features:

[0089] 1) A microphone array consisting of 60 digital microphones is used.

[0090] 2) An embedded video camera and thermal imaging camera are designed and placed in the center of the microphone array.

[0091] 3) High-speed Ethernet communication technology is used to transmit microphone array audio signals, video camera signals and thermal imaging camera signals. Long-distance signal transmission can be achieved.

[0092] 4) Real-time calculation of noise distribution cloud map (acoustic imaging) based on audio signals collected by microphone array

[0093] 5) Calculate the temperature distribution cloud map (thermal imaging) in real time based on the temperature signal collected by the thermal imaging camera.

[0094] 6) Real-time fusion display of video camera images and noise distribution cloud maps.

[0095] 7) Real-time calculation, analysis and display of noise spectrum based on microphone array signals.

[0096] 8) The noise source location can be displayed according to the specified noise frequency range.

[0097] 9) Multi-point synchronous status monitoring based on acoustic imaging and thermal imaging. Set multiple monitoring points on the real-time displayed image for real-time status monitoring of equipment.

[0098] 10) Recognition of device outline based on images from video cameras.

[0099] 11) Automatic arrangement of real-time monitoring points for noise and temperature based on images. The measuring points can be automatically set according to the acoustic imaging and thermal imaging images. For example, the noise measuring point can be automatically arranged at the location of the maximum noise source, and the temperature measuring point can be automatically arranged at the highest temperature point. The measuring points can also be automatically arranged according to the equipment image recognition results.

[0100] 12) Synchronous real-time display and trend feature analysis function of noise data and temperature data of multiple monitoring points.

[0101] 13) Noise data and temperature data of multiple monitoring points can be saved, read and analyzed offline simultaneously.

[0102] 14) Real-time uploading of monitoring data. Key indicators and image data can be uploaded to the cloud or ground server in real time for data analysis, storage and backup.

[0103] In short, the non-contact equipment condition monitoring system based on noise imaging and thermal imaging can complete manual and automatic measurement point arrangement on the image. The operation is relatively flexible and convenient. It can realize long-term monitoring of noise and temperature at designated measurement points, and can check the noise and temperature data at any position in the image at any time, making it convenient for equipment maintenance personnel to fully understand the equipment status.

[0104] The equipment status monitoring system based on acoustic and thermal imaging of the present invention is arranged at a certain position in the production work area, and can monitor the equipment status within the viewing angle in real time, such as abnormal noise and heating of the equipment, and perform data imaging processing. In particular, the abnormal noise and temperature changes of important equipment are analyzed and diagnosed in real time, and the noise distribution and temperature distribution are visualized. The noise data and temperature data of multiple monitoring points on the image can be recorded synchronously, and trend analysis and comparative analysis can be performed. It can help engineering and technical personnel to timely discover abnormal sound and noise and their locations, as well as abnormal temperature changes, so as to further investigate potential equipment failure hazards. Compared with relying on the subjective auditory perception of engineering personnel to identify and judge abnormal equipment noise, the diagnostic method based on acoustic imaging and thermal imaging technology is safer and more reliable, and can effectively reduce the misjudgment caused by the difference in subjective perception of different personnel, and can realize the quantitative recording of abnormal fault data, and then realize the statistical analysis of fault data in different periods, so as to provide data basis for managers to formulate reasonable maintenance plans, ensure the safe operation of equipment, and reduce production costs.

[0105] Based on the principle of the above-mentioned equipment status monitoring system based on acoustic thermal imaging, the present invention proposes an equipment status monitoring method based on acoustic thermal imaging, such as Fig.10 As shown, the following steps are included:

[0106] S1 data acquisition: real-time acquisition of multi-channel sound signals, video image signals, and temperature signals within the monitoring area where the monitored equipment is located;

[0107] S2 sound and temperature distribution image calculation and generation

[0108] S201 Sound distribution image calculation and generation: MBF algorithm is used to perform real-time synchronous calculation and processing on multi-channel sound signals and generate a distribution map of noise sources on a two-dimensional plane, which is then fused and displayed in real time with video image signals to obtain a sound distribution image, realizing the display of the noise source position within a specified noise frequency range;

[0109] S202: temperature distribution image calculation and generation: based on the temperature signal data, a temperature distribution image is calculated and generated in real time, and the maximum temperature point position and the minimum temperature point position in the current image area are displayed in real time;

[0110] S3 measurement point setting and data extraction: Based on the sound distribution image and temperature distribution image generated by real-time calculation, the sound monitoring point and temperature monitoring point are manually or automatically set for each monitored device in real time, and each monitoring point is monitored synchronously in real time. The MBF algorithm is used to extract the sound signal of the specified sound monitoring point and filter out the sound signals from other directions outside the specified sound monitoring point;

[0111] S4 Noise and Temperature Data Analysis

[0112] S401 Noise and temperature data analysis: Based on the sound signals collected in real time at each designated sound monitoring point, the noise spectrum is calculated in real time and the frequency components, amplitude height, and noise intensity change trend are analyzed. The sound characteristic data that can reflect the operating status and fault status of each monitored device are generated respectively. At the same time, the noise level change trend of each sound monitoring point within the monitoring range is recorded;

[0113] S402 Noise and temperature data analysis: Based on the temperature signals collected synchronously in real time at each designated temperature monitoring point, the temperature change trend is calculated and analyzed in real time, and temperature characteristic data that can reflect the operating status and fault status of each monitored device is generated respectively. At the same time, the temperature change trend of each temperature monitoring point within the monitoring range is recorded;

[0114] S5 Multi-information input and multi-device status fusion diagnosis: Based on the above-mentioned sound feature data and temperature feature data, a comprehensive evaluation result is given for the health status of each monitored device, and a diagnostic analysis report is generated and displayed.

[0115] The present invention also proposes an electronic device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the above-mentioned equipment status monitoring system based on acoustic thermal imaging or the equipment status monitoring method based on acoustic thermal imaging when executing the computer program.

[0116] The present invention also proposes a computer-readable storage medium having a computer program stored thereon. When the computer program is executed by a processor, the above-mentioned equipment status monitoring system based on acoustic thermal imaging or the equipment status monitoring method based on acoustic thermal imaging is implemented.

[0117] Although the functions and working processes of the present invention have been described above in conjunction with the accompanying drawings, the present invention is not limited to the above-mentioned specific functions and working processes, and the above-mentioned specific implementation methods are merely illustrative rather than restrictive. Under the guidance of the present invention, ordinary technicians in this field can also make many forms without departing from the scope of protection of the purpose of the present invention and the claims, which are all within the protection of the present invention.

Claims

1. An equipment status monitoring system based on acoustic thermal imaging, characterized in that: Includes the following modules: ① Acoustic and thermal imaging data acquisition module: real-time acquisition of multi-channel sound signals, video image signals, and temperature signals within the monitoring area where the monitored equipment is located; ② Sound and temperature distribution image calculation and generation module: MBF algorithm is used to synchronously calculate and process multi-channel sound signals and generate a distribution map of noise sources on a two-dimensional plane, which is then fused and displayed in real time with video image signals to obtain a sound distribution image; meanwhile, a temperature distribution image is generated in real time based on temperature signal data; ③ Measurement point setting and data extraction module: Based on the sound distribution image and temperature distribution image generated by real-time calculation, the sound monitoring point and temperature monitoring point are manually or automatically set for each monitored device in real time, and each monitoring point is monitored synchronously in real time. The MBF algorithm is used to extract the sound signal of the specified sound monitoring point and filter out the sound signals from other directions outside the specified sound monitoring point; ④The noise and temperature data analysis module includes a multi-point noise spectrum and noise distribution analysis module based on acoustic imaging and a multi-point temperature change and temperature distribution analysis module based on thermal imaging. The multi-measurement point noise spectrum and noise distribution analysis module based on acoustic imaging calculates the noise spectrum in real time based on the sound signals collected in real time and synchronously at each designated sound monitoring point, analyzes its frequency components, amplitude height, and noise intensity change trend, and generates sound feature data that can reflect the operating status and fault status of each monitored device, and records the noise level change trend of each sound monitoring point within the monitoring range; The multi-measurement point temperature change and temperature distribution analysis module based on thermal imaging calculates and analyzes the temperature change trend in real time based on the temperature signals collected synchronously in real time at each designated temperature monitoring point, and generates temperature characteristic data that can reflect the operating status and fault status of each monitored device, and records the temperature change trend of each temperature monitoring point within the monitoring range; ⑤ The multi-information input multi-device status fusion diagnosis module gives a comprehensive evaluation result of the health status of each monitored device and generates a diagnosis analysis report based on the sound feature data generated by the multi-measurement point noise spectrum and noise distribution analysis module based on acoustic imaging and the temperature feature data generated by the multi-measurement point temperature change and temperature distribution analysis module based on thermal imaging; ⑥ Diagnostic result display module, used to display a diagnostic analysis report reflecting the health status of each monitored device.

2. The equipment status monitoring system based on acoustic thermal imaging according to claim 1 is characterized in that: The acoustic and thermal imaging data acquisition module adopts an acoustic and thermal imaging acquisition device, which integrates a microphone array, a video camera, and a thermal imaging camera; the microphone array consists of 60 digital microphones, which are arranged in a two-dimensional spiral form to achieve sound source positioning in two dimensions, vertical and horizontal, and sound pickup in a specific direction; the video camera and thermal imaging camera adopt an embedded design and are arranged in the center of the microphone array.

3. The equipment status monitoring system based on acoustic thermal imaging according to claim 1 is characterized in that: The acoustic and thermal imaging data acquisition module is equipped with a remote control pan-tilt system, which is used for the acoustic and thermal imaging data acquisition module to collect sound signals, video image signals, and temperature signals in different directions to expand the monitoring range.

4. The equipment status monitoring system based on acoustic thermal imaging according to claim 2 is characterized in that: The acoustic and thermal imaging data acquisition module uses high-speed Ethernet communication technology to transmit multi-channel sound signals collected in real time by a microphone array, video image signals collected in real time by a video camera, and temperature signals collected in real time by a thermal imaging camera, thereby achieving long-distance signal transmission.

5. The equipment status monitoring system based on acoustic thermal imaging according to claim 1 is characterized in that: The sound and temperature distribution image calculation and generation module has the following two functions: sound imaging calculation and thermal imaging calculation: Acoustic imaging calculation: MBF algorithm is used to synchronously calculate the sound intensity distribution matrix of multi-channel sound signals in real time, generate a sound intensity distribution color cloud map, and display it in real time with the video image to obtain a sound distribution image, which can realize the display of the noise source position in the specified noise frequency range; Thermal imaging calculation: The temperature distribution matrix is ​​calculated based on the real-time collected temperature signal data, and a temperature distribution color cloud map, i.e., a temperature distribution image, is generated. The maximum temperature point position and the minimum temperature point position in the current image area are displayed in real time.

6. The equipment status monitoring system based on acoustic thermal imaging according to claim 1 is characterized in that: The measuring point setting and data extraction module manually or automatically arranges sound monitoring points and temperature monitoring points at the maximum noise point position and the maximum temperature point position within the monitored equipment range; or automatically identifies the outline of the monitored equipment based on the video image, and automatically arranges measuring points at the maximum noise point or the maximum temperature point within the monitored equipment range.

7. A device status monitoring method based on the device status monitoring system based on acoustic thermal imaging according to any one of claims 1 to 6, characterized in that: The following steps are involved: S1 data acquisition: real-time acquisition of multi-channel sound signals, video image signals, and temperature signals within the monitoring area where the monitored equipment is located; S2 sound and temperature distribution image calculation and generation S201 Sound distribution image calculation and generation: MBF algorithm is used to perform real-time synchronous calculation and processing on multi-channel sound signals and generate a distribution map of noise sources on a two-dimensional plane, which is then fused and displayed in real time with video image signals to obtain a sound distribution image, realizing the display of the noise source position within a specified noise frequency range; S202: temperature distribution image calculation and generation: based on the temperature signal data, a temperature distribution image is calculated and generated in real time, and the maximum temperature point position and the minimum temperature point position in the current image area are displayed in real time; S3 measurement point setting and data extraction: Based on the sound distribution image and temperature distribution image generated by real-time calculation, the sound monitoring point and temperature monitoring point are manually or automatically set for each monitored device in real time, and each monitoring point is monitored synchronously in real time. The MBF algorithm is used to extract the sound signal of the specified sound monitoring point and filter out the sound signals from other directions outside the specified sound monitoring point; S4 Noise and Temperature Data Analysis S401 Noise and temperature data analysis: Based on the sound signals collected in real time at each designated sound monitoring point, the noise spectrum is calculated in real time and the frequency components, amplitude height, and noise intensity change trend are analyzed. The sound characteristic data that can reflect the operating status and fault status of each monitored device are generated respectively. At the same time, the noise level change trend of each sound monitoring point within the monitoring range is recorded; S402 Noise and temperature data analysis: Based on the temperature signals collected synchronously in real time at each designated temperature monitoring point, the temperature change trend is calculated and analyzed in real time, and temperature characteristic data that can reflect the operating status and fault status of each monitored device is generated respectively. At the same time, the temperature change trend of each temperature monitoring point within the monitoring range is recorded; S5 Multi-information input and multi-device status fusion diagnosis: Based on the above-mentioned sound feature data and temperature feature data, a comprehensive evaluation result is given for the health status of each monitored device, and a diagnostic analysis report is generated and displayed.

8. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the computer program, the system or method for monitoring the equipment status based on acoustic thermal imaging according to any one of claims 1 to 7 is implemented.

9. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the system or method for monitoring the equipment status based on acoustic thermal imaging according to any one of claims 1 to 7 is implemented.

Citation Information

Patent Citations

  • Method for performing equipment diagnosis based on sound features and temperature features

    CN109612757A

  • Train rail edge detection system based on thermal imaging and acoustic imaging technologies

    CN117367842A

  • Substation equipment fault detection method and system based on multi-modal fusion

    CN117809164A

  • Belt conveyor fault diagnosis method and system, terminal and storage medium

    CN118427769A

  • Monitoring area abnormality monitoring system using dual sensor and method thereof

    KR102459503B1