Tunneling machine attitude real-time monitoring and control system based on inertial navigation

Through a system based on inertial navigation and image assistance, the dynamic and static attitude data of the boring machine are collected and analyzed in real time and the regulation instructions are generated, which solves the problems of low accuracy and slow response of the traditional boring machine attitude monitoring system, and realizes the boring machine in complex environments efficient and precise control.

CN119021706APending Publication Date: 2024-11-26CHINA AEROSPACE TECH CO LTD (HANGZHOU)
View PDF 0 Cites 1 Cited by

Patent Information

Application Number
CN202411103660.2
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-08-13
Publication Date
2024-11-26

AI Technical Summary

Technical Problem

The traditional posture monitoring system of the boring machine has problems such as low measurement accuracy, slow response speed, and inability to monitor in real time, which limits the efficient operation of the boring machine under complex geological conditions.

Method used

Using a real-time attitude monitoring and control system of the boring machine based on inertial navigation, combining the inertial navigation module, image assist module and ground central control center, dynamic attitude data is collected in real time through the inertial navigation module, and the image assist module obtains static attitude data and uses Kalman. The filter generates calculating attitude data, issues control commands to the boring machine control module to achieve precise control.

Benefits of technology

It improves the accuracy and reliability of attitude monitoring, reduces manual intervention, improves construction efficiency and safety, can effectively deal with complex underground construction environments, and ensures the stable operation of the excavator.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119021706A_ABST
    Figure CN119021706A_ABST
Patent Text Reader

Abstract

The invention discloses a heading machine attitude real-time monitoring and control system based on inertial navigation. The heading machine attitude real-time monitoring and control system comprises an inertial navigation module, an image auxiliary module, an image processing module, a ground center control center and a heading machine control module. By integrating the inertial navigation module, the dynamic attitude data of the heading machine can be obtained in real time, the static attitude data is obtained by using the image auxiliary module, and the actual attitude deviation of the heading machine can be quickly obtained by analyzing the dynamic attitude data, the static attitude data and the theoretical attitude data through the ground center control center. According to the invention, the precision and reliability of attitude monitoring are improved, the requirement of manual intervention is reduced, the construction efficiency and safety are improved, various complex underground construction environments can be effectively coped with, and the construction safety is improved. And the stable operation of the heading machine under different geological conditions is ensured.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of underground engineering equipment, and in particular to a real-time monitoring and control system for the attitude of a tunnel boring machine based on inertial navigation. Background Art

[0002] With the acceleration of urbanization, the demand for underground engineering construction is growing, and the roadheader, as the main equipment for underground engineering construction, plays a vital role in the tunnel excavation process. However, in the complex and changeable underground construction environment, how to accurately control the posture of the roadheader has become one of the key factors affecting construction quality and efficiency.

[0003] The traditional roadheader attitude monitoring system mainly relies on ground measurement technology and manual intervention, and has the disadvantages of low measurement accuracy, slow response speed, and inability to monitor in real time. These limitations restrict the efficient operation of the roadheader under complex geological conditions. Therefore, the development of a system that can realize real-time monitoring and intelligent control of the roadheader attitude has important practical application value. Summary of the invention

[0004] In order to solve the above technical problems, the present invention provides a real-time monitoring and control system for the attitude of a roadheader based on inertial navigation.

[0005] In order to have a basic understanding of some aspects of the disclosed embodiments, a brief summary is given below. This summary is not intended to be a general review, nor is it intended to identify key / important components or to delineate the scope of protection of these embodiments. Its only purpose is to present some concepts in a simple form as a preface to the detailed description that follows.

[0006] The present invention adopts the following technical solution:

[0007] The present invention provides a real-time monitoring and control system for the attitude of a roadheader based on inertial navigation, comprising:

[0008] An inertial navigation module is used to collect dynamic posture data of the tunnel boring machine and upload the collected dynamic posture data to the ground central control center;

[0009] An image auxiliary module is used to shoot the tunnel boring machine, obtain a video of the tunnel boring machine, and send the video of the tunnel boring machine to the image processing module;

[0010] An image processing module is used to perform image processing on the video recording of the tunnel boring machine, obtain static posture data of the tunnel boring machine, and upload the static posture data to the ground central control center;

[0011] The ground central control center is used to obtain the dynamic posture data, the static posture data and the theoretical posture data, and generate the measured posture data according to the dynamic posture data and the static posture data, and issue the control instruction to the tunnel boring machine control module according to the difference between the measured posture data and the theoretical posture data;

[0012] The tunnel boring machine control module is used to drive the tunnel boring machine to perform actions according to the received control instructions.

[0013] Furthermore, the inertial navigation module includes: a pitch angle acquisition unit for acquiring the pitch angle of the tunnel boring machine; a yaw angle acquisition unit for acquiring the yaw angle of the tunnel boring machine; a roll angle acquisition unit for acquiring the roll angle of the tunnel boring machine; and the dynamic posture data consists of the pitch angle, yaw angle and roll angle of the tunnel boring machine.

[0014] Furthermore, the image processing module includes: a video frame extraction unit, used to extract required image frames from the recorded video of the tunnel boring machine; a picture preprocessing unit, used to grayscale, remove noise and enhance contrast of the extracted image frames, and correct the image frames to obtain processed image frames; a feature extraction unit, used to identify and extract feature points of the tunnel boring machine by analyzing the processed image frames; and a posture estimation unit, used to obtain the static posture data based on the extracted feature points of the tunnel boring machine.

[0015] Furthermore, the static posture data are the pitch angle, yaw angle and roll angle of the tunnel boring machine in the image frame.

[0016] Furthermore, the tunnel boring machine control module includes: a control instruction processing unit, which is used to receive the control instructions issued by the ground central control center, and parse the control instructions to obtain action requirements; an action planning and scheduling unit, which is used to generate the action sequence of the tunnel boring machine according to the action requirements; and a mechanism execution unit, which is used to drive the tunnel boring machine to reach a theoretical posture according to the action sequence.

[0017] Furthermore, the image auxiliary module includes: a data acquisition unit, which is used to record the tunnel boring machine based on a camera, and the camera has a resolution of 1080p and a protection level of IP67; an infrared fill light unit, which is used to fill light in the field of view of the camera; and an image transmission unit, which is used to send the tunnel boring machine video to the image processing module.

[0018] Furthermore, the ground central control center generates the measured attitude data based on the dynamic attitude data and the static attitude data, and uses a Kalman filter to generate the measured attitude data from the dynamic attitude data and the static attitude data.

[0019] The beneficial effects brought by the present invention are as follows: by integrating the inertial navigation module, the dynamic posture data of the tunnel boring machine can be obtained in real time, and the static posture data can be obtained by using the image auxiliary module. The ground central control center can quickly obtain the actual posture deviation of the tunnel boring machine by analyzing the dynamic posture data, static posture data and theoretical posture data, and send control instructions to the tunnel boring machine control module accordingly to achieve precise control of the tunnel boring machine. The present invention improves the accuracy and reliability of posture monitoring, reduces the need for manual intervention, improves construction efficiency and safety, can effectively cope with various complex underground construction environments, and ensures the stable operation of the tunnel boring machine under different geological conditions. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0021] Figure 1 It is a schematic diagram of a real-time monitoring and control system of a roadheader attitude based on inertial navigation according to the present invention. DETAILED DESCRIPTION

[0022] The embodiments of the present invention are described in detail below in conjunction with the accompanying drawings. It should be clear that the described embodiments are only part of the embodiments of the present invention, rather than all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0023] In underground engineering operations, the attitude control of the tunnel boring machine is crucial to ensure construction safety, improve work efficiency and guarantee project quality. Traditional tunnel boring machine attitude monitoring mostly relies on the subjective judgment of operators, and there are technical problems such as untimely monitoring and low accuracy. With the development of technology, automated and intelligent monitoring and control systems have gradually become a research hotspot. However, existing technologies usually only focus on attitude monitoring of a single data source, which is difficult to fully reflect the actual working status of the tunnel boring machine, and its adaptability and reliability in complex environments need to be improved.

[0024] In view of this, if Figure 1 As shown, the present invention provides a real-time monitoring and control system for the attitude of a tunnel boring machine based on inertial navigation, comprising: an inertial navigation module, an image auxiliary module, an image processing module, a ground central control center, and a tunnel boring machine control module.

[0025] The inertial navigation module is used to collect the dynamic attitude data of the tunnel boring machine and upload the collected dynamic attitude data to the ground control center through wireless or wired communication. Before the tunnel boring machine is started, the inertial navigation module performs self-calibration to ensure the accuracy of the sensor data. During the operation of the tunnel boring machine, the inertial navigation module collects the acceleration, angular velocity and other data of the tunnel boring machine in real time based on the sensor, and filters, fuses and calculates the collected raw data to obtain accurate attitude information of the tunnel boring machine.

[0026] The inertial navigation module includes: a pitch angle acquisition unit, a yaw angle acquisition unit, and a roll angle acquisition unit. The pitch angle acquisition unit is used to collect the pitch angle of the tunnel boring machine, that is, the angle change of the tunnel boring machine in the vertical plane. By measuring the pitch angle, the verticality of the tunnel boring machine during the tunneling process can be ensured to prevent excessive upward or downward pitch. The yaw angle acquisition unit is used to collect the yaw angle of the tunnel boring machine, that is, to measure the rotation angle of the tunnel boring machine around the vertical axis (longitudinal axis). The measurement of the yaw angle helps to control the direction of travel of the tunnel boring machine and ensure that it moves along the predetermined path. The roll angle acquisition unit is used to collect the roll angle of the tunnel boring machine, that is, the rotation angle of the tunnel boring machine around its own horizontal axis (horizontal axis). The collection of the roll angle helps to maintain the horizontal balance of the tunnel boring machine and prevent it from tipping over during operation.

[0027] Dynamic attitude data consists of the pitch, yaw and roll angles of the tunnel boring machine. Dynamic attitude data is a comprehensive information composed of the three angles of the tunnel boring machine, which together describe the real-time attitude of the tunnel boring machine in three-dimensional space. Dynamic attitude data is the basis for precise navigation and control of the tunnel boring machine.

[0028] The image auxiliary module is used to shoot the tunnel boring machine, obtain the tunnel boring machine video, and send the tunnel boring machine video to the image processing module.

[0029] The image auxiliary module includes: a data acquisition unit, an infrared fill light unit, and an image transmission unit.

[0030] The data acquisition unit is used to record the tunnel boring machine based on a camera. The camera has a resolution of 1080p and a protection level of IP67. The main function of the camera is to conduct real-time video monitoring and recording of the tunnel boring machine and its operating environment. The infrared fill light unit is used to fill the field of view of the camera. The infrared fill light unit emits infrared light, and the camera's photosensitive element can capture the infrared light, so that a clear image can still be formed in low light conditions. The image transmission unit is used to send the video recorded by the tunnel boring machine to the image processing module. The IP67 protection level camera and infrared fill light unit ensure the stable operation of the system in harsh environments.

[0031] The image processing module is used to process the video of the tunnel boring machine, obtain the static posture data of the tunnel boring machine, and upload the static posture data to the ground control center. The image processing module includes: video frame extraction unit, image preprocessing unit, feature extraction unit, and posture estimation unit.

[0032] The video frame extraction unit is used to extract the required image frames from the video recorded by the tunnel boring machine. The video frame extraction unit can extract individual image frames from the video recorded by the tunnel boring machine on demand, such as locating to a specific moment in the video according to specific standards or instructions. These standards may include timestamps, event markers, or user-specified frame numbers. Once the target frame is located, the video frame extraction unit will separate the frame from the video stream to form an independent image file.

[0033] The image preprocessing unit is used to grayscale the extracted image frames, remove noise and enhance contrast, and correct the image frames to obtain processed image frames. Grayscale processing simplifies image data and reduces the complexity of processing. Reducing noise can improve the clarity of the image, making subsequent feature extraction and recognition more accurate. Enhancing contrast can improve the visibility of the image and help highlight important features in the image. Performing geometric correction or distortion correction on the image to eliminate image distortion caused by camera lens characteristics or shooting angles, the corrected image can more realistically reflect the actual situation of the object being photographed, which is crucial for accurate analysis and measurement.

[0034] The feature extraction unit is used to identify and extract the feature points of the roadheader by analyzing the processed image frames. The feature extraction unit analyzes the image data to identify points in the image that represent specific parts of the roadheader. These points usually have unique visual features, such as corner points, edge points, or the geometric center of a specific shape. Once the feature points are identified, the unit extracts relevant information about these points, such as position, intensity, direction, etc., which will be used for subsequent processing and analysis.

[0035] The posture estimation unit is used to obtain static posture data based on the extracted feature points of the roadheader. The feature points extracted in the current image frame are matched with the previously stored or defined reference feature points. The geometric transformation between the images is calculated using the homography or basic matrix mathematical model through the matched feature point pairs, and the posture angle of the roadheader is solved using the geometric transformation model.

[0036] The static attitude data is the pitch angle, yaw angle and roll angle of the tunnel boring machine in the image frame. The static attitude data uses the same indicators as the dynamic attitude data, which simplifies the difficulty of data fusion and improves the overall efficiency of the system.

[0037] The image processing module performs rapid image processing on the acquired video recordings of the tunnel boring machine, extracts static posture data in a timely manner, and ensures that the system monitors the status of the tunnel boring machine in real time. Through the inertial navigation module and the image auxiliary module, the dynamic posture data and static posture data of the tunnel boring machine are collected respectively, providing comprehensive raw data for the posture monitoring of the tunnel boring machine. The combined use of the inertial navigation module and the image auxiliary module can comprehensively monitor the posture changes of the tunnel boring machine. By integrating the dynamic posture data and the static posture data, a closed-loop control mechanism is formed, so that the tunnel boring machine can maintain a stable posture in a complex environment, overcome the limitations of a single sensor, and improve the monitoring accuracy. Moreover, the automated monitoring and control system reduces the reliance on manual monitoring, reduces the workload of operators, and improves the efficiency of construction operations.

[0038] The ground central control center is used to obtain dynamic posture data, static posture data and theoretical posture data, and generate measured posture data based on the dynamic posture data and static posture data. According to the difference between the measured posture data and the theoretical posture data, control instructions are issued to the tunnel boring machine control module.

[0039] The dynamic posture data comes from the inertial navigation module, which reflects the real-time posture changes of the tunnel boring machine during operation; the static posture data is provided by the posture estimation unit, which is obtained based on the image feature point analysis and represents the posture of the tunnel boring machine at a certain moment; the theoretical posture data is the expected posture data calculated based on the predetermined path and operation plan of the tunnel boring machine.

[0040] The ground control center uses Kalman filter to generate measured attitude data from dynamic attitude data and static attitude data. The use of Kalman filter to fuse dynamic and static attitude data solves the problem of multi-source data fusion, can effectively handle data noise and uncertainty, provide smoother attitude data, and improve the reliability of attitude monitoring. Kalman filter is a mathematical algorithm that can estimate the state of a dynamic system based on incomplete and noisy data.

[0041] The ground control center compares the difference between the measured posture data and the theoretical posture data. This difference reflects the deviation between the actual working posture and the expected posture. According to the difference analysis results, the ground control center sends control instructions to the tunnel boring machine control module to adjust the tunnel boring machine's posture to make it closer to the theoretical posture.

[0042] The tunnel boring machine control module is used to drive the tunnel boring machine to perform actions according to the received control instructions. The tunnel boring machine control module includes: a control instruction processing unit, an action planning and scheduling unit, and a mechanism execution unit.

[0043] The control instruction processing unit is used to receive the control instructions issued by the ground control center, parse the control instructions, and obtain the action requirements. After receiving the control instructions, the control instruction processing unit parses the received instructions to understand the specific content and requirements of the instructions, such as parsing the instruction format and content, and converting them into executable action instructions. The control instruction processing unit extracts the action instructions that need to be executed by parsing the instructions, such as speed control, direction adjustment, stop operation, etc., and determines the specific requirements for executing the action according to the instruction content, such as the speed and duration of the action.

[0044] The action planning and scheduling unit is used to generate the action sequence of the tunnel boring machine according to the action requirements. The main task of the action planning and scheduling unit is to generate a series of action sequences of the tunnel boring machine according to the current action requirements. These action sequences usually include the moving path, speed control, direction adjustment, etc. of the tunnel boring machine. These sequences will guide the operation behavior of the tunnel boring machine.

[0045] The mechanism execution unit is used to drive the tunnel boring machine to reach the theoretical posture according to the action sequence. The mechanism execution unit is responsible for receiving the action sequence generated by the action planning and scheduling unit and converting it into control instructions for each actuator of the tunnel boring machine. By controlling the actuators such as the drive motor and hydraulic system of the tunnel boring machine, the mechanism execution unit can adjust the posture of the tunnel boring machine to achieve the predetermined theoretical posture.

[0046] For example, the mechanism execution unit receives the action sequence generated by the action planning and scheduling unit, which usually includes the moving path, speed control, direction adjustment, etc. of the tunnel boring machine. The mechanism execution unit parses these instructions and converts them into control signals for the actuators, such as current, pressure, etc. According to the parsed control signals, the mechanism execution unit controls the actuators of the tunnel boring machine, such as the drive motor, hydraulic cylinder, etc., to achieve the required actions. This ensures that the action sequence generated by the action planning and scheduling unit can be accurately executed, thereby achieving precise control and operation of the tunnel boring machine.

[0047] The above is only a specific embodiment of the present invention, but the protection scope of the present invention is not limited thereto. Any changes or substitutions that can be easily thought of by a person skilled in the art within the technical scope disclosed by the present invention should be included in the protection scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.

Claims

1. A real-time monitoring and control system for roadheader attitude based on inertial navigation, It is characterized in that include: An inertial navigation module is used to collect dynamic posture data of the tunnel boring machine and upload the collected dynamic posture data to the ground central control center; An image auxiliary module is used to shoot the tunnel boring machine, obtain a video of the tunnel boring machine, and send the video of the tunnel boring machine to the image processing module; An image processing module is used to perform image processing on the video recording of the tunnel boring machine, obtain static posture data of the tunnel boring machine, and upload the static posture data to the ground central control center; The ground central control center is used to obtain the dynamic posture data, the static posture data and the theoretical posture data, and generate the measured posture data according to the dynamic posture data and the static posture data, and issue the control instruction to the tunnel boring machine control module according to the difference between the measured posture data and the theoretical posture data; The tunnel boring machine control module is used to drive the tunnel boring machine to perform actions according to the received control instructions.

2. According to claim 1, a real-time monitoring and control system for the attitude of a roadheader based on inertial navigation, It is characterized in that The inertial navigation module comprises: The pitch angle acquisition unit is used to acquire the pitch angle of the tunnel boring machine; the yaw angle acquisition unit is used to acquire the yaw angle of the tunnel boring machine; the roll angle acquisition unit is used to acquire the roll angle of the tunnel boring machine; The dynamic posture data consists of the pitch angle, yaw angle and roll angle of the tunnel boring machine.

3. According to claim 2, a real-time monitoring and control system for the attitude of a roadheader based on inertial navigation, It is characterized in that The image processing module comprises: A video frame extraction unit, used to extract required image frames from the video recorded by the tunnel boring machine; An image preprocessing unit is used to perform grayscale processing, noise removal and contrast enhancement on the extracted image frame, and to correct the image frame to obtain a processed image frame; A feature extraction unit, used to identify and extract feature points of the roadheader by analyzing the processed image frames; A posture estimation unit is used to obtain the static posture data according to the extracted feature points of the tunnel boring machine.

4. According to claim 3, a real-time monitoring and control system for the attitude of a roadheader based on inertial navigation, It is characterized in that The static posture data are the pitch angle, yaw angle and roll angle of the tunnel boring machine in the image frame.

5. According to claim 4, a real-time monitoring and control system for the attitude of a roadheader based on inertial navigation, It is characterized in that The tunnel boring machine control module comprises: A control instruction processing unit is used to receive the control instructions issued by the ground control center, and analyze the control instructions to obtain action requirements; An action planning and scheduling unit, used for generating an action sequence of the roadheader according to the action requirements; The mechanism execution unit is used to drive the tunnel boring machine to reach a theoretical posture according to the action sequence.

6. A real-time monitoring and control system for roadheader attitude based on inertial navigation according to claim 5, It is characterized in that The image auxiliary module includes: The data acquisition unit is used to record the tunnel boring machine based on a camera with a resolution of 1080p and a protection level of IP67; Infrared fill light unit, used to fill light in the camera's field of view; The image transmission unit is used to send the video recorded by the tunnel boring machine to the image processing module.

7. A real-time monitoring and control system for roadheader attitude based on inertial navigation according to claim 6, It is characterized in that The ground central control center generates the measured posture data according to the dynamic posture data and the static posture data, and uses a Kalman filter to generate the measured posture data from the dynamic posture data and the static posture data.

Citation Information

Cited By

  • Construction platform attitude control system based on multi-sensor fusion

    CN120255580A