Coal rock interface recognition device and method based on infrared thermal image signal and electromagnetic wave signal

By combining infrared thermal image signals and electromagnetic wave signals identification technology, the Kalman filtering fusion is used to solve the problems of low coal rock identification efficiency and insufficient automation level in the existing technology, and achieve higher recognition accuracy and reliability, providing support for unmanned coal mining.

CN118911767APending Publication Date: 2024-11-08SUZHOU UNIV
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202410715796.2
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-07-30
Publication Date
2024-11-08

AI Technical Summary

Technical Problem

The existing coal rock identification technology has low recognition efficiency under complex coal mine geological conditions and is affected by the environment, and has a low level of mechanical automation, resulting in insufficient identification accuracy and application.

Method used

The coal-rock interface recognition device based on infrared thermal image signals and electromagnetic wave signals is used, combined with the Transformer model and the Vision Transformer model, the electromagnetic wave sequence signal and infrared thermal image signals are processed, and the final recognition results are obtained through Kalman filtering fusion, and the scissor is used to obtain the fork. The automatic lifting platform realizes intelligent identification of the coal-rock interface in front of the coal mining device.

Benefits of technology

It improves the reliability and accuracy of coal-rock interface identification, reduces equipment wear, realizes the construction conditions of unmanned mining work surfaces, and provides more efficient identification means for coal mining.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure FT_1
    Figure FT_1
  • Figure FT_2
    Figure FT_2
  • Figure FT_3
    Figure FT_3
Patent Text Reader

Abstract

The invention discloses a coal rock interface recognition device and method based on an infrared thermal image signal and an electromagnetic wave signal, the device comprises a scissors fork type automatic lifting platform, a storage box body is fixed on the lifting platform, the storage box body comprises a welding support, a handle, an explosion-proof shell, a supporting plate and a high light-transmitting plate, and annular light sources are uniformly distributed on the high light-transmitting plate; an infrared thermal imager is fixed to the supporting plate, a coal rock interface recognition module is fixed to the bottom of the storage box, and a low-frequency electromagnetic wave receiving and transmitting device and a signal receiving and transmitting device are fixed to the top of the storage box. According to the method, the height of the device can be adjusted through the scissors fork type automatic lifting platform, the thermal infrared imager scans the coal rock wall to collect infrared thermal image signals, the electromagnetic wave receiving and transmitting device receives electromagnetic wave signals reflected by the coal rock wall, and the electromagnetic wave signals are intelligently processed through the coal rock interface recognition module to obtain a coal rock interface recognition result. And finally obtained information is transmitted to an external computer by the signal receiving and transmitting device for further observation and analysis.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of automated mining equipment, and in particular to a coal-rock interface recognition device and method based on infrared thermal imaging signals and electromagnetic wave signals. Background Art

[0002] China, as the world's largest energy driving force, is still the country with the largest growth in coal consumption. In the coal mining process, coal rock identification technology is a means of realizing intelligent processing in coal mines and an important basis for promoting efficient mining.

[0003] In the past, coal-rock identification was often done on a human basis, and the level of mechanical automation was low. With the development of coal-rock identification technology, different coal-rock identification methods have been developed based on the different characteristics of coal and rock, and are being continuously improved, including natural gamma ray method, geological radar method, power judgment, vibration analysis method, etc., but they have not been widely used due to their limitations in my country's coal mine environment. First, a single research technology is difficult to adapt to my country's complex coal mine geological conditions; second, the recognition efficiency is greatly affected by the environment, and the wear and tear of the equipment will directly affect the accuracy of the recognition. Therefore, the applicability and recognition accuracy of the coal-rock interface recognition method need to be improved. Summary of the invention

[0004] In order to solve the deficiencies in the prior art, this application proposes a coal-rock interface identification device and method based on infrared thermal imaging signals and electromagnetic wave signals, which realizes the prediction and identification of the coal-rock interface in front of the coal mining device. It has high reliability and good economy, and can provide conditions for the construction of unmanned mining working faces.

[0005] The technical solution adopted by the present invention is as follows:

[0006] A coal-rock interface recognition device based on infrared thermal imaging signals and electromagnetic wave signals, comprising:

[0007] Electromagnetic wave transceiver, infrared thermal imager, coal-rock interface recognition module, signal transceiver; the electromagnetic wave transceiver and infrared thermal imager are both connected to the coal-rock interface recognition module signal, and the coal-rock interface recognition module outputs the recognition result, which is transmitted outwardly by the signal transceiver.

[0008] Furthermore, in the coal-rock interface recognition module, the Transformer model is used to analyze the electromagnetic wave sequence signal to obtain the current-cut coal-rock interface estimation result; the Vision Transformer model is used to analyze the infrared thermal imaging signal to obtain the next-cut coal-rock interface preliminary estimation, and the current-cut coal-rock interface estimation result and the next-cut coal-rock interface preliminary estimation are fused at the Kalman filter result level to obtain the final coal-rock interface recognition result.

[0009] Furthermore, the signal transceiver is connected to an external computer signal to output the recognition result of the coal-rock interface recognition module 6.

[0010] Furthermore, the electromagnetic wave transceiver device includes an electromagnetic wave transceiver antenna, a microcontroller, a digital-to-analog converter and a signal transmission module; the microcontroller controls the electromagnetic wave transceiver antenna to transmit low-frequency electromagnetic waves and receive coal-rock interface reflected waves, the digital-to-analog converter converts the received reflected waves into electromagnetic wave digital signals, and the signal transmission module transmits the electromagnetic wave digital signals to the coal-rock interface identification module.

[0011] Furthermore, the electromagnetic wave transceiver, infrared thermal imager, coal-rock interface recognition module, and signal transceiver are all arranged on the upper part of the scissors-type automatic lifting platform.

[0012] Furthermore, the scissor-type automatic lifting platform includes a top and bottom plate, a connecting rod, and a motor. The connecting rod can be slidably installed on the connecting rod and is connected to the motor power. Under the drive of the motor, the connecting rod retracts and extends to achieve the lifting and lowering adjustment of the scissor-type automatic lifting platform.

[0013] Furthermore, the scissor-type automatic lifting platform is also equipped with a walking mechanism.

[0014] Furthermore, a storage box is provided above the scissor-type automatic lifting platform, and the electromagnetic wave transceiver, infrared thermal imager, coal-rock interface recognition module, and signal transceiver are all arranged on the storage box.

[0015] A coal-rock interface recognition method based on infrared thermal imaging signals and electromagnetic wave signals comprises the following steps:

[0016] S1, moving the coal-rock interface recognition device to a target position;

[0017] S2, using an infrared thermal imager to perform infrared detection on the coal rock wall, collect infrared thermal image signals, and transmit them to a coal rock interface recognition module;

[0018] S3, using an electromagnetic wave transceiver to transmit low-frequency ultra-wideband electromagnetic waves to the coal-rock wall and receive reflected waves from the coal-rock interface; after digital-to-analog conversion, the waves are transmitted to the coal-rock interface identification module;

[0019] S4, the coal-rock interface recognition module processes the infrared thermal image signal and the reflected electromagnetic wave signal respectively to obtain the coal-rock interface recognition result.

[0020] Further, the processing of S4 is as follows:

[0021] S4.1, obtain the sequence feature vector from the electromagnetic wave sequence signal, input it into the Transformer model for analysis to obtain the current knife-coal-rock interface estimation result;

[0022] S4.2, generating infrared thermal image sequence images from infrared thermal image signals, inputting them into the Vision Transformer model, and analyzing them to obtain a preliminary estimate of the coal-rock interface for the next cut;

[0023] S4.3, the current coal-rock interface estimation result and the next coal-rock interface preliminary estimation are fused at the Kalman filter result level to obtain the final coal-rock interface recognition result.

[0024] Beneficial effects of the present invention:

[0025] Compared with the existing technology, the coal-rock interface identification device uses infrared thermal imaging signals and electromagnetic wave signals to intelligently identify the coal-rock interface in front of the coal mining device, and combines the two identification results to construct the coal-rock interface trajectory and the virtual coal-rock interface model. Compared with the existing system, it has higher reliability, higher identification accuracy and better economy. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] The technical solution of the present invention is further described in detail below in conjunction with the accompanying drawings:

[0027] Figure 1 It is a schematic diagram of the structure of the coal-rock interface identification device of the present invention;

[0028] Figure 2 It is a schematic diagram of the electromagnetic wave transceiver of the present invention;

[0029] Figure 3 This is a flow chart of the working method of the coal-rock interface identification module of the device;

[0030] Figure 4 It is the system structure and function block diagram of the present invention;

[0031] In the figure, 1. scissor-type automatic lifting platform, 1-1. top and bottom plates, 1-2. connecting rod, 1-3. motor, 2. storage box, 2-1. welding bracket, 2-2. explosion-proof shell, 2-3. high light transmittance plate, 2-4. ring light source, 2-5. support plate, 2-6. welding handle, 3. electromagnetic wave transceiver, 4. support box, 5. infrared thermal imager, 6. coal-rock interface recognition module, 7. signal transceiver. DETAILED DESCRIPTION

[0032] In order to make the purpose, technical solution and advantages of the present invention more clearly understood, the present invention is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not used to limit the present invention.

[0033] Example 1

[0034] The present invention provides a coal-rock interface recognition device based on infrared thermal imaging signals and electromagnetic wave signals, comprising a scissor-type automatic lifting platform 1, a storage box 2, an electromagnetic wave transceiver 3, a support box 4, an infrared thermal imager 5, a coal-rock interface recognition module 6, and a signal transceiver 7. The electromagnetic wave transceiver 3, the support box 4, the infrared thermal imager 5, the coal-rock interface recognition module 6, and the signal transceiver 7 are all fixed on the storage box 2, and the storage box 2 is placed on the scissor-type automatic lifting platform 1, forming a coal-rock interface recognition device, which can intelligently recognize coal and rock walls.

[0035] The scissor-type automatic lifting platform 1 comprises a top and bottom plate 1-1, a connecting rod 1-2, and a motor 1-3; according to the specific conditions of the coal mining working environment, the scissor-type automatic lifting platform 1 is controlled by the motor 1-3 to automatically rise and fall to a suitable height.

[0036] The storage box 2 is placed above the scissor-type automatic lifting platform 1, and the frame structure of the storage box 2 is composed of four welding brackets 2-1. Multiple layers of support plates 2-5 are laid between the four welding brackets 2-1 to realize the multi-layer design of the storage box 2. An explosion-proof housing 2-2 and a high light-transmittance plate 2-3 are installed between the welding brackets 2-1, and a ring light source 2 is provided in the storage box 2; a welding handle 2-6 can also be installed on the top of the storage box 2.

[0037] The electromagnetic wave transceiver 3 and the signal transceiver 7 are installed on the top of the storage box 2, the support box 4 and the infrared thermal imager 5 are stacked on the support plate 2-5, and the coal-rock interface recognition module 6 is fixed on the bottom of the storage box 2.

[0038] The electromagnetic wave transceiver 3 includes an electromagnetic wave transceiver antenna, a microcontroller, a digital-to-analog converter and a signal transmission module. The electromagnetic wave transceiver 3 transmits low-frequency electromagnetic waves and receives coal-rock interface reflection waves, and transmits electromagnetic wave digital signals to the coal-rock interface identification module 6.

[0039] The infrared thermal imager 5 performs infrared detection on the coal rock wall at the front side, collects and uploads infrared thermal imaging signals through the infrared thermal imager 5, and transmits them to the coal rock interface recognition module 6.

[0040] The coal-rock interface recognition module 6 is used to receive reflected electromagnetic wave signals and infrared thermal imaging signals, output recognition results after processing within the coal-rock interface recognition module 6, and transmit the recognition results to the signal transceiver 7.

[0041] The signal transceiver device 7 is used to transmit the recognition result of the coal-rock interface recognition module 6 to an external computer for further observation and analysis.

[0042] More preferably, the bottom of the coal-rock interface identification device may also be equipped with a walking mechanism so that the coal-rock interface identification device can be moved to a specified position according to control requirements.

[0043] Example 2

[0044] Based on the above-mentioned coal-rock interface recognition device based on infrared thermal imaging signals and electromagnetic wave signals, the present invention also provides a coal-rock interface recognition method based on infrared thermal imaging signals and electromagnetic wave signals, comprising the following steps:

[0045] S1, the scissor-type automatic lifting platform 1 automatically lifts the coal-rock interface identification device to a suitable height through an external computer-controlled motor 1-3 according to the specific conditions in the mine;

[0046] S2, the infrared thermal imager 5 performs infrared detection on the coal rock wall in front, collects the infrared thermal image signal, and transmits it to the coal rock interface recognition module 6;

[0047] S3, the microcontroller controls the electromagnetic wave transceiver antenna of the electromagnetic wave transceiver device 2 to transmit low-frequency ultra-wideband electromagnetic waves and receive coal-rock interface reflection waves; the electromagnetic waves are converted into electromagnetic wave digital signals by the digital-to-analog converter, and the obtained electromagnetic wave digital signals are transmitted to the coal-rock interface recognition module 6 by the signal transmission module;

[0048] S4, the coal-rock interface recognition module 6 processes the infrared thermal imaging signal and the reflected electromagnetic wave signal respectively to obtain the corresponding coal-rock interface position information, and combines the information to obtain the final coal-rock interface recognition result to provide a working basis for the coal mining equipment.

[0049] More specifically, the processing of S4 is as follows:

[0050] S4.1, obtaining the current coal-rock interface estimation result based on the electromagnetic wave signal; the specific process is as follows:

[0051] The coal-rock interface recognition device moves with the coal mining machine, and transmits and receives electromagnetic wave signals at regular intervals to obtain electromagnetic wave sequence signals. The reflected electromagnetic wave signal obtained for the kth time is processed by signal noise reduction pre-processing technology to obtain the received signal x k (t), k = 1, 2, ... K, the output signal covariance matrix is ​​as follows:

[0052]

[0053] in, To receive the signal x k The conjugate transpose of (t).

[0054] Perform eigenvalue decomposition on the signal covariance matrix and obtain the eigenvector with small eigenvalue to generate the noise subspace U N , the eigenvectors with large eigenvalues ​​generate the signal subspace U S ;

[0055] Using U Nand U S The orthogonal characteristics of the spectrum function based on the MUSIC method are as follows:

[0056]

[0057] The angle corresponding to the spectrum peak is the estimated value of the incoming wave direction angle. Taking the center element of the radar sensor as the reference, the index of the radar sensor is set to -M,...0,...,M, d represents the spacing between adjacent sensors, λ represents the carrier wavelength, and there is θ represents the angle of the incoming wave direction, express The conjugate transpose of Indicates U N The conjugate transpose of We can get:

[0058]

[0059] definition:

[0060]

[0061] m1,m2∈[1,M+1],m∈[-M,M],

[0062] Among them, ξ m represents the sum of all elements on the mth diagonal of C, represents the (m1,m2)th element of matrix C. Since C is a symmetric matrix obtained by multiplying two conjugate transposed matrices, Signal characteristics can be expressed using π:

[0063] π=[ξ1,ξ2,...,ξ M ] T ∈C M ,

[0064] Since general deep neural networks cannot handle complex features, it is necessary to separate ξ m The real and imaginary parts of , define the real eigenvector γ as:

[0065]

[0066] in, and Represent the real and imaginary parts of the complex number respectively. γ can be used as the input of the deep neural network.

[0067] The electromagnetic wave sequence signal According to the above process, the sequence feature vector is obtained. Input the Transformer to analyze and obtain the current coal-rock interface estimation result;

[0068] S4.2, obtain a preliminary estimate of the coal-rock interface for the next cut based on the infrared thermal imaging signal;

[0069] The coal-rock interface recognition device moves with the coal mining machine, and acquires the electric infrared thermal imaging signal at a certain interval to obtain the infrared thermal imaging sequence signal.

[0070] Generate infrared thermal image sequence images from infrared thermal image signals And input it into the VisionTransformer model to analyze and get the preliminary estimate of the coal-rock interface for the next cut;

[0071] S4.3, the current coal-rock interface estimation result and the next coal-rock interface preliminary estimation are fused at the Kalman filter result level to obtain the final coal-rock interface recognition result.

[0072] The above steps are repeated as the main body of the coal mining device moves and works.

[0073] S5, the external computer receives the obtained virtual coal-rock interface recognition result through the signal transceiver 7, and further observation and analysis can be performed.

[0074] It will be understood by those skilled in the art that, unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as those generally understood by those skilled in the art in the art to which the present invention belongs. It should also be understood that terms such as those defined in common dictionaries should be understood to have meanings consistent with the meanings in the context of the prior art, and will not be interpreted with idealized or overly formal meanings unless defined as herein.

[0075] The above embodiments are only used to illustrate the design ideas and features of the present invention, and their purpose is to enable those skilled in the art to understand the content of the present invention and implement it accordingly. The protection scope of the present invention is not limited to the above embodiments. Therefore, any equivalent changes or modifications made based on the principles and design ideas disclosed by the present invention are within the protection scope of the present invention.

Claims

1. A coal-rock interface recognition device based on infrared thermal imaging signals and electromagnetic wave signals, characterized in that: include: An electromagnetic wave transceiver (3), an infrared thermal imager (5), a coal-rock interface recognition module (6), and a signal transceiver (7); the electromagnetic wave transceiver (3) and the infrared thermal imager (5) are both connected to the coal-rock interface recognition module (6) by signal, and the coal-rock interface recognition module (6) outputs a recognition result, which is transmitted to the outside by the signal transceiver (7).

2. The coal-rock interface recognition device based on infrared thermal imaging signals and electromagnetic wave signals according to claim 1 is characterized in that: In the coal-rock interface recognition module (6), the Transformer model is used to analyze the electromagnetic wave sequence signal to obtain the current coal-rock interface estimation result; the Vision Transformer model is used to analyze the infrared thermal imaging signal to obtain the next coal-rock interface preliminary estimation, and the current coal-rock interface estimation result and the next coal-rock interface preliminary estimation are fused at the Kalman filter result level to obtain the final coal-rock interface recognition result.

3. The coal-rock interface recognition device based on infrared thermal imaging signals and electromagnetic wave signals according to claim 1 is characterized in that: The signal transceiver (7) is connected to an external computer signal to output the recognition result of the coal-rock interface recognition module (6).

4. The coal-rock interface recognition device based on infrared thermal imaging signals and electromagnetic wave signals according to claim 1 is characterized in that: The electromagnetic wave transceiver (3) comprises an electromagnetic wave transceiver antenna, a microcontroller, a digital-to-analog converter and a signal transmission module; the microcontroller controls the electromagnetic wave transceiver antenna to transmit low-frequency electromagnetic waves and receive coal-rock interface reflected waves, the digital-to-analog converter converts the received reflected waves into electromagnetic wave digital signals, and the signal transmission module transmits the electromagnetic wave digital signals to the coal-rock interface identification module (6).

5. A coal-rock interface recognition device based on infrared thermal imaging signals and electromagnetic wave signals according to any one of claims 1 to 4, characterized in that: The electromagnetic wave transceiver (3), infrared thermal imager (5), coal-rock interface recognition module (6), and signal transceiver (7) are all arranged on the upper part of the scissor-type automatic lifting platform (1).

6. The device for identifying coal-rock interface based on infrared thermal imaging signals and electromagnetic wave signals according to claim 5, characterized in that: The scissor-type automatic lifting platform (1) comprises a top and bottom plate (1-1), a connecting rod (1-2), and a motor (1-3); the connecting rod (1-2) is slidably mounted on the top and bottom plate (1-1) and is power-connected to the motor (1-3); when the motor (1-3) drives the connecting rod (1-2), the connecting rod (1-2) performs a retracting and extending action, thereby realizing the lifting and lowering adjustment of the scissor-type automatic lifting platform (1).

7. The device for identifying coal-rock interface based on infrared thermal imaging signals and electromagnetic wave signals according to claim 5, characterized in that: The scissor-type automatic lifting platform 1 is also equipped with a walking mechanism.

8. The coal-rock interface identification device based on infrared thermal imaging signals and electromagnetic wave signals according to claim 5 is characterized in that: A storage box (2) is provided above the scissor-type automatic lifting platform (1), and the electromagnetic wave transceiver (3), infrared thermal imager (5), coal-rock interface recognition module (6), and signal transceiver (7) are all arranged on the storage box (2).

9. A method for identifying coal-rock interface based on infrared thermal imaging signals and electromagnetic wave signals, characterized in that: The steps include: S1, moving the coal-rock interface recognition device based on infrared thermal imaging signals and electromagnetic wave signals as described in claim 1 to a target position; S2, using an infrared thermal imager (5) to perform infrared detection on the coal rock wall, collect infrared thermal image signals, and transmit them to a coal rock interface recognition module (6); S3, using the electromagnetic wave transceiver (3) to transmit low-frequency ultra-wideband electromagnetic waves to the coal-rock wall and receive reflected waves from the coal-rock interface; after digital-to-analog conversion, the waves are transmitted to the coal-rock interface identification module (6); S4, the coal-rock interface recognition module (6) processes the infrared thermal image signal and the reflected electromagnetic wave signal respectively to obtain a coal-rock interface recognition result.

10. The method for identifying coal-rock interface based on infrared thermal imaging signals and electromagnetic wave signals according to claim 9, characterized in that: The processing of S4 is as follows: S4.1, obtain the sequence feature vector from the electromagnetic wave sequence signal, input it into the Transformer model for analysis to obtain the current knife-coal-rock interface estimation result; S4.2, generating infrared thermal image sequence images from infrared thermal image signals, inputting them into the Vision Transformer model, and analyzing them to obtain a preliminary estimate of the coal-rock interface for the next cut; S4.3, the current coal-rock interface estimation result and the next coal-rock interface preliminary estimation are fused at the Kalman filter result level to obtain the final coal-rock interface recognition result.