An automatic segment splicing method and system based on a tunnel boring machine segment assembly machine
By using motion switching servo control and visual inspection technology, the efficient and automatic assembly of tunnel segments is achieved, solving the problems of large computational load and local collisions in existing technologies, and improving assembly accuracy and safety.
Patent Information
- Application Number
- CN202311802553.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2023-12-25
- Publication Date
- 2026-11-17
- Estimated Expiration
- 2043-12-25
AI Technical Summary
In existing shield tunnel segment assembly methods, the overall offset adjustment process involves a large amount of calculation and high parameter dimensionality, which easily leads to local collisions and makes it difficult to achieve efficient and accurate segment assembly.
The system employs a motion-switching servo control method. It detects the position and posture of the tube segments through a line laser sensing module and a vision module. It uses axis and handhole control functions to achieve alignment of the axis of the gripped tube segment with the already assembled tube segment and alignment of the handhole. Combined with hydraulic drive, it completes automatic splicing.
It improves the efficiency and accuracy of shield tunnel segment assembly, reduces the risk of local collisions, ensures the safety of operators, replaces the traditional remote control and inching operation method, and improves operational efficiency.
Smart Images

Figure CN118361266B_ABST
Abstract
Description
Technical Field
[0001] This invention relates to the field of shield tunnel segment assembly machine splicing control technology, and in particular to an automatic segment splicing method and system based on a shield tunnel segment assembly machine. Background Technology
[0002] Chinese invention patent CN108104834B discloses an automatic assembly method and system for tunnel boring machine (TBM) segments, proposing a method to complete the fine-tuning assembly of the segment to be installed based on image information, marker position information, and assembly strategy. Chinese invention patent CN109736836B discloses an automatic assembly method for TBM segments based on tag-code visual measurement, providing a method that uses a computer to calculate the segment offset based on acquired tag-code images, and then controls the TBM to complete the initial and fine-tuning positioning of the segments based on the position offset, thus completing the automatic assembly of the segments. Assembly; Chinese invention patent application CN113107550A discloses an automatic assembly method for tunnel boring machine segments based on machine vision. This method predicts the desired position of the segments to be assembled by detecting the target ArUco code feature corner points on the segments, and uses an image-based visual servo strategy to obtain the desired speed of each mechanism of the segment assembly machine. Finally, the control quantity of each actuator is obtained by joint speed closed-loop control, thereby realizing the automatic assembly of the segments; Chinese invention patent application CN113863966A discloses a segment grasping pose detection device and detection method based on deep learning vision, which realizes the grasping pose detection of the segments to be assembled.
[0003] The above method determines the overall offset based on pose detection, and then makes overall adjustments based on the overall offset. The adjustment process involves high-dimensional parameters, a large amount of computation, and is difficult, making it prone to local collisions. Summary of the Invention
[0004] To solve the above-mentioned technical problems, or at least partially solve them, the present invention provides an automatic segment splicing method based on a tunnel segment assembly machine.
[0005] In a first aspect, the present invention provides an automatic segment splicing method based on a tunnel boring machine segment assembly machine, comprising: The segment assembly machine is guided to move near the segment feeder to complete the gripping of the segments to be assembled; After the segment assembly machine finishes gripping the segment, it automatically plans a collision-free trajectory from the starting point of gripping the segment to the desired assembly position according to the specified desired location. Under the control of the trajectory tracking algorithm, the segment assembly machine transports the gripped segment to the vicinity of the specified desired splicing position, and the position and posture of the assembled segment and the gripped segment are detected by the contour measuring instrument. The motion switching servo control method controls the alignment of the z-axis of the gripping segment with the z-axis of the assembled segment based on the relative posture of the assembled segment and the gripping segment. Then, while maintaining the alignment of the axes of the gripping segment and the assembled segment, it controls the rotation and axial clamping action of the gripping segment to complete the alignment of the bolt hand holes of the assembled segment and the gripping segment and the elimination of circumferential gaps, ultimately realizing the automatic splicing task of the gripping segment. The motion switching servo control method is as follows: ; In the formula, denoted as the allowable control accuracy for the axial direction of the tunnel segment, and × represents the vector cross product. The 2-norm of a vector represents its length. e 1, e 2 are the axis control task function and the handhole control task function, respectively. These are the Jacobian matrices controlling the non-full-rank axes. J 1 and hand-hole control Jacobian matrix J The generalized inverse of 2, λ 1, λ 2 represents the negative feedback proportional coefficient for axis control and hand-hole control, respectively. These are the axial unit vectors of the gripping and assembled segments in the coordinate system {0} of the assembly machine, respectively.
[0006] Furthermore, the contour measuring instrument projects a linear laser beam outward. The linear laser beam intersects with the edge of the segment and the hand hole to be aligned, forming point features. The spatial 3D coordinates of these point features are calculated using a visual sensor. Then, the desired segment coordinate system in the base coordinate system {0} of the segment assembly machine is recovered using the calibration results of the contour measuring instrument and the segment pose measurement algorithm. Spatial pose And the spatial pose of the current segment coordinate system {G} in the base coordinate system {0} of the segment assembly machine. ,in, These are the unit direction vectors of the x, y, and z axes of the {G} coordinate system in the {0} base coordinate system of the segment assembly machine, and the position vector of the origin of the {G} coordinate system in the {0} base coordinate system of the segment assembly machine, respectively. They are respectively The unit direction vectors of the x, y, and z axes in the base coordinate system {0} of the segment assembly machine The position vector of the origin of the coordinate system in the coordinate system {0} of the segment assembly machine.
[0007] Furthermore, the motion switching servo control mode uses the axis control task function to control the movement of the segment assembly machine, so that the axis of the assembled segment and the gripping segment are aligned. The handhole control task function is used to control the movement of the assembly machine, and the handhole alignment is achieved under the condition that the axis of the assembled segment and the gripping segment are aligned.
[0008] Furthermore, the control process of using axis control task functions to control the movement of the segment assembly machine, so that the axis of the assembled segment coincides with the axis of the grasping segment, is as follows: The axis control task function is ; In the formula, × represents the vector cross product operation. This is the axis control task mask, where diag() is a diagonal matrix, processed by... M 1. The mask operation successfully eliminated... z-axis component; According to the rigid body kinematics equations, the velocity of the current segment coordinate system {G} in the segment assembly machine base coordinate system {0} is... The following relationship is satisfied with the rate of change of the axis control task function: ; In the formula I 3×3 It is a 3D identity matrix. For antisymmetric matrix notation, Let be the Jacobian matrix of the axis control task function, and let its rank be... ; Using the base coordinate system {0} of the segment assembly machine as the reference coordinate system, the current velocity of the segment coordinate system {G} is... 0 V G The motion speed of the assembly machine end effector coordinate system {E} 0 V E The mapping relationship between them satisfies: ; In the formula, 0 R E It is the attitude matrix of the end effector coordinate system {E} of the assembly machine in the base coordinate system {0} of the segment assembly machine, which can be calculated by the kinematic model of the assembly machine; E t G This is the position vector of the origin of the current segment coordinate system {G} in the end effector of the assembly machine. When the assembly machine grasps the segment, this value is a known constant. The velocity transformation Jacobian matrix, which characterizes the velocity mapping relationship between different rigidly connected coordinate systems, is of full rank. ; Based on the kinematic model of the segment assembly machine, the mapping relationship between the coordinate system {E} of the end effector and the motion velocity of each joint can be derived: ; In the formula, This is the Jacobian matrix of the robotic arm joints constructed with the base coordinate system {0} of the segment assembly machine as the reference coordinate system. The joint Jacobian matrix represents the movement speed of each joint of the segment assembly machine when the machine is in a non-singular configuration and is full rank. The following kinematic relationship exists between the rate of change of the axis control task function and the joint velocity: ; In the formula, Collectively referred to as axis control Jacobian matrix; Let axis control task function Exponential convergence: ; in Let be the negative feedback proportional coefficient for axis control, then the joint control quantity is: ; In the formula, Jacobian square matrix controlled by non-full-rank axes J The generalized inverse of 1, Under axis control mode, axis control task function e 1. The final convergence is 0, and the axes of the assembled segment and the holding segment are coincident, that is, the inner surfaces of the holding segment and the assembled segment are aligned.
[0009] Furthermore, by using the handhole control task function to control the movement of the assembly machine, the process of aligning the handhole and eliminating the circumferential gap under the condition that the axis of the assembled segment and the gripping segment coincides includes: Handhole control task function: ; in, As a mask for hand-eye control tasks, M2 only retains the z-axis motion of the end effector; The handhole control method and its Jacobian matrix are derived as follows: ; ; ; In the formula, Collectively referred to as the hand-hole control Jacobian matrix; Command the exponent of the hand-held control task function convergence: ; in Let be the negative feedback proportional coefficient for hand-eye control, then the joint control quantity is: ; In the formula, Jacobian squares controlled by non-full-rank handholes J The generalized inverse of 2; Under the hand-hole control mode, the hand-hole control task function e2. The final convergence is 0, and the assembled segments and the holding segments have completed the alignment of the handholes and the elimination of the circumferential gaps.
[0010] Furthermore, after the bolt installation workers have completed the installation of the irregular connecting bolts, the control command causes the segment assembly machine to unload the segment and automatically return to the standby position, waiting for the next segment to be picked up and assembled.
[0011] Secondly, the present invention provides an automatic segment splicing system based on a shield tunnel segment assembly machine, which realizes the automatic segment splicing method based on the shield tunnel segment assembly machine, including: a line laser sensing module, a vision module, a pose calculation module, a motion calculation module, a joint servo control module, an assembly machine hydraulic drive module, and an assembly machine body status sensing module. Line laser sensing module: Installed on the rotary mechanism of the segment assembly machine, it generates line laser and projects it onto the assembled segments and the gripping segments. The line laser intersects with the edge of the segment and the hand hole to be aligned to form point features, providing significant visual features for segments lacking texture features. Vision module: Used to calculate the spatial 3D coordinates of the point features in the sensor coordinate system {L}. L P provides measurement data for calculating the pose of assembled and grasped segments; Pose calculation module: Utilizing the spatial 3D coordinates of point features, combined with the calibration results of the contour measuring instrument's sensor system and the segment pose measurement algorithm, the desired segment coordinate system in the base coordinate system {0} of the segment assembly machine is recovered. Spatial pose And the spatial pose of the current segment coordinate system {G} in the base coordinate system {0} of the segment assembly machine. ; Motion calculation module: Generates motion switching servo control mode. Based on the relative posture of the assembled segment and the gripping segment, the motion switching servo control mode controls the segment assembly machine to first align the z-axis of the gripping segment with the z-axis of the assembled segment. Then, while maintaining the alignment of the axes of the gripping segment and the assembled segment, it controls the rotation and axial clamping actions of the gripping segment to complete the alignment of the bolt hand holes of the assembled segment and the gripping segment and eliminate circumferential gaps, ultimately achieving the automatic splicing task of the gripping segment. The motion switching servo control mode is as follows: ; In the formula, denoted as the allowable control accuracy for the axial direction of the tunnel segment, and × represents the vector cross product. The 2-norm of a vector represents its length. e 1, e 2 are the axis control task function and the handhole control task function, respectively. These are the Jacobian matrices controlling the non-full-rank axes. J 1 and hand-hole control Jacobian matrixJ The generalized inverse of 2, λ 1, λ 2 represents the negative feedback proportional coefficient for axis control and hand-hole control, respectively. These are the axial unit vectors of the gripping and assembled segments in the coordinate system {0} of the assembly machine, respectively. Joint control module: The conventional PID algorithm is used to follow up the displacement and speed control commands of each joint of the assembly machine robot arm generated according to the motion switching servo control mode; Hydraulic drive module for the assembly machine: including hydraulic pump station, hydraulic pipeline, hydraulic valve, hydraulic cylinder, and hydraulic motor, responsible for driving the hydraulic movement of the segment assembly machine; The assembly machine body sensing module includes a pressure valve, a magnetostrictive displacement sensor, and an angle encoder. It is responsible for detecting the angular displacement, linear displacement, angular velocity, and linear velocity of the assembly machine. It works in conjunction with the joint control module and the hydraulic drive module of the assembly machine to complete the high-precision servo control of the assembly machine.
[0012] Furthermore, it includes: Human-machine interface panel: providing a touchable human-machine interface, through which the splicing operator controls the segment assembly machine to grab the segment to the desired position to be assembled, and after the irregular connecting bolts are installed, controls the segment assembly machine to unload the segment and automatically return to the standby position, waiting for the next segment to be grabbed and assembled.
[0013] The technical solutions provided in the embodiments of the present invention have the following advantages compared with the prior art: The purpose of this invention is to address the segment assembly machine. Based on kinematic modeling and sensor system extrinsic parameter calibration, and starting from the segment assembly process, a motion switching control method is designed to achieve efficient and automatic assembly of tunnel boring machine (TBM) segments, replacing the traditional remote-controlled inching operation method and improving assembly efficiency and safety. Operators only need to click on the segment to be assembled position on the human-interactive screen, and the segment assembly machine can automatically complete the TBM segment assembly task. Because this application separates the axial movement of the segments from other directional movements, the segments first complete the alignment of the inner surfaces during assembly, and then complete the alignment of the connecting bolt hand holes and the elimination of circumferential gaps through rotation around the axial direction and translational movement along the axial direction. This control method effectively avoids friction and collision between segments while significantly improving assembly efficiency and accuracy, and strongly ensuring the personal safety of operators. Attached Figure Description
[0014] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with the invention and, together with the description, serve to explain the principles of the invention.
[0015] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, for those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0016] Figure 1 A flowchart of an automatic segment splicing method based on a shield tunnel segment assembly machine provided in an embodiment of the present invention; Figure 2 This is a schematic diagram of the coordinate system provided in an embodiment of the present invention; Figure 3 This is a schematic diagram of an automatic segment splicing system based on a shield tunnel segment assembly machine, provided in an embodiment of the present invention. Figure 4 This is a schematic diagram of an automatic segment splicing system based on a tunnel segment assembly machine, provided in an embodiment of the present invention. Detailed Implementation
[0017] To make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.
[0018] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes said element.
[0019] See Figure 1 As shown, the present invention provides an automatic segment splicing method based on a shield tunnel segment assembly machine, comprising: The segment splicing operator issues control commands through the human-machine interface tablet to move the segment splicing machine to the vicinity of the segment feeder, and manually guides the segment splicing machine to complete the gripping of the segments to be spliced.
[0020] After the segment assembly machine finishes gripping the segment, the segment splicing operator can specify the desired assembly position of the gripped segment through a human-machine interface tablet. Once the desired position is specified, a collision-free trajectory is automatically planned from the starting point of gripping the segment to the desired assembly position.
[0021] Under the control of the trajectory tracking algorithm, the segment assembly machine transports the grasped segments to the vicinity of the designated desired splicing position according to the collision-free trajectory.
[0022] The position and orientation between the assembled pipe segments and the gripping pipe segments are detected using a profile measuring instrument.
[0023] In the specific implementation process Figure 2 The diagram shows the coordinate system during the segment assembly control process. {0} represents the base coordinate system of the segment assembler, and {G} represents the current coordinate system of the segment held by the segment assembler. This represents the desired coordinate system for the assembled tunnel segments. The current segment coordinate system {G} and the desired segment coordinate system are also mentioned. The origin of {G} is the center O of the arc in front of the standard segment, the z-axis coincides with the axis of the standard segment, and the x-axis of {G} lies on the line connecting the center O and the right inner corner of the standard segment. The x-axis and the center of the circle are connected to the hand hole to be aligned. l The included angle is 33.75º.
[0024] The contour measuring instrument projects a linear laser beam outwards. The laser beam intersects with the edge of the segment and the hand hole to be aligned, forming point features. The spatial 3D coordinates of these point features are calculated using a vision sensor. Then, the desired segment coordinate system in the base coordinate system {0} of the segment assembly machine is recovered using the calibration results of the contour measuring instrument and the segment pose measurement algorithm. Spatial pose And the spatial pose of the current segment coordinate system {G} in the base coordinate system {0} of the segment assembly machine. .in, These are the unit direction vectors of the x, y, and z axes of the {G} coordinate system in the {0} base coordinate system of the segment assembly machine, and the position vector of the origin of the {G} coordinate system in the {0} base coordinate system of the segment assembly machine, respectively. They are respectively The unit direction vectors of the x, y, and z axes in the base coordinate system {0} of the segment assembly machine The position vector of the origin of the coordinate system in the coordinate system {0} of the segment assembly machine.
[0025] The motion switching servo control mode controls the alignment of the z-axis of the gripping segment with the z-axis of the assembled segment based on the position and posture of the assembled segment and the gripping segment. Then, while keeping the axes of the gripping segment and the assembled segment aligned, the rotation and axial clamping actions of the gripping segment are controlled to complete the alignment of the bolt hand holes of the assembled segment and the gripping segment and the elimination of the circumferential gap, ultimately realizing the automatic splicing task of the gripping segment.
[0026] Specifically, the motion switching servo control mode uses the axis control task function to control the movement of the segment assembly machine, so that the axis of the assembled segment coincides with the axis of the gripping segment.
[0027] In specific implementation, the control process for axis alignment is as follows: Define the current visual servo feature set for axis coincidence control as follows: The desired visual servo feature set for axis coincidence control is: , Define the axis control task mask as , where diag() is a diagonal matrix.
[0028] The axis control task function is then taken as follows: In the formula, × represents the vector cross product operation, after which... M 1. The mask operation successfully eliminated... The z-axis component.
[0029] According to the rigid body kinematics equations, the velocity of the current segment coordinate system {G} in the segment assembly machine base coordinate system {0} is... The following relationship is satisfied with the rate of change of the axis control task function: ; In the formula I 3×3 It is a 3D identity matrix. For antisymmetric matrix notation, such as: A three-dimensional column vector a Antisymmetric matrix: ; Let be the Jacobian matrix of the axis coincidence control task function, and let its rank be... Therefore, the incomplete axis control task function Unable to achieve Complete control. In fact, when the axis control task function converges to zero, the axes of the segments to be assembled and the segments already assembled coincide, and the inner surfaces can also be aligned without misalignment. However, the hand holes are not aligned and the circumferential gap is not eliminated. At this time, it is still impossible to install irregular connecting bolts.
[0030] Consider the relative pose relationship between the end effector coordinate system {E} of the assembly machine and the current segment coordinate system {G}. Given that the base coordinate system {0} of the segment assembly machine is the reference coordinate system, the current velocity of the segment coordinate system {G} is... 0 V G The motion speed of the assembly machine end effector coordinate system {E} 0 V EThe mapping relationship between them satisfies: ; In the formula, 0 R E It is the attitude matrix of the end effector coordinate system {E} of the assembly machine in the base coordinate system {0} of the segment assembly machine, which can be calculated through the kinematic model of the assembly machine; E t G This is the position of the origin of the current segment coordinate system {G} in the end effector of the assembly machine. This value is a known constant when the assembly machine grips the segment. The velocity transformation Jacobian matrix is called the velocity transformation matrix, which characterizes the velocity mapping relationship between different coordinate systems, and satisfies the following conditions: .
[0031] Based on the kinematic model of the segment assembly machine, the mapping relationship between the coordinate system {E} of the end effector and the motion velocity of each joint can be derived: ; In the formula, This is the Jacobian matrix of the robotic arm joints constructed with the base coordinate system {0} of the segment assembly machine as the reference coordinate system. Let $\fraction \gec$ be the movement speed of each joint of the segment assembly machine. When the assembly machine is in a non-singular configuration, the joint Jacobian matrix satisfies $\fraction \gec$. The rate of change of the axis control task function and the joint velocity satisfy the following kinematic relationship: ; In the formula, Collectively referred to as axis-controlled Jacobian matrices, and .
[0032] Let axis control task function Exponential convergence: ; in Let the coefficient be the exponential convergence coefficient, then the joint control quantity is: ; In the formula, Non-full-rank Jacobian square J The generalized inverse of 1.
[0033] Under axis control mode, axis control task function e The final convergence to 0 means that the axes of the assembled segment and the holding segment are aligned, i.e., the inner surfaces of the holding segment and the assembled segment are aligned.
[0034] The handhole control task function is used to control the movement of the assembly machine, and the handhole alignment is achieved when the axis of the assembled segment and the gripping segment coincides.
[0035] In specific implementation, the control process for manhole alignment and circumferential gap elimination is as follows: To achieve handhole alignment and circumferential gap elimination under the condition of axis coincidence, the current visual servo feature set for handhole alignment control is defined as follows: The desired visual servo feature set for axis coincidence control is , Define the handhole control task mask: ; Handhole control task function: ; exist M 2. Handhole control task function under the action of the mask e 2. Only the rotation and translation components of the z-axis are retained. By controlling the two components, the hand hole alignment and circumferential gap elimination can be completed.
[0036] Based on the derivation process of axis coincidence control, the handhole control law and its Jacobian matrix can be obtained: ; ; ; In the formula, Collectively referred to as the hand-hole controlled Jacobian matrix.
[0037] Command hole control task function Exponential convergence: ; in Let the coefficient be the exponential convergence coefficient, then the joint control quantity is: ; In the formula, Non-full-rank Jacobian square J The generalized inverse of 2.
[0038] Under the hand-hole control mode, the hand-hole control task function e 2 eventually converges to 0, which means that the assembled segments and the holding segments have completed the alignment of the handholes and the elimination of the circumferential gaps.
[0039] The final description of the motion switching servo control method is as follows: ; In the formula, denoted as the allowable control accuracy for the axial direction of the tunnel segment, and × represents the vector cross product. The 2-norm of a vector represents its length. e 1, e 2 are the axis control task function and the handhole control task function, respectively. These are the Jacobian matrices controlling the non-full-rank axes. J1 and hand-hole control Jacobian matrix J The generalized inverse of 2, λ 1, λ 2 represents the negative feedback proportional coefficient for axis control and hand-hole control, respectively. These are the axial unit vectors of the gripping and assembled segments in the coordinate system {0} of the assembly machine, respectively.
[0040] It can be seen that the motion switching servo control method first uses the axis control task function to control the z-axis of the gripping segment to coincide with the z-axis of the assembled segment. Then, while keeping the axes of the gripping segment and the assembled segment coincident, the hand hole control task function is used to control the rotation and axial clamping action of the gripping segment, so as to complete the alignment of the bolt hand hole positions of the assembled segment and the gripping segment and the elimination of the circumferential gap, and finally realize the automatic splicing task of the gripping segment.
[0041] Under the aforementioned motion switching servo control mode, the assembly machine first achieves the alignment of the axis of the grasped segment with that of the assembled segment, and then the grasped segment translates along the aligned axis and rotates around the aligned axis, thereby achieving the assembly of the segment under the premise of conforming to the segment assembly process and assembly operation procedure.
[0042] The human-machine interface tablet indicates that the segment splicing is complete. The operator waits for the bolt installation personnel to complete the installation of the non-standard connecting bolts. Then, the segment splicing operator issues a control command to make the segment assembly machine unload the segment and automatically return to the standby position, waiting for the next segment to be picked up and assembled.
[0043] Example 2 See Figure 3 and Figure 4 As shown, this embodiment of the invention provides an automatic segment splicing system based on a shield tunnel segment assembly robot, which includes: a line laser sensing module, a vision module, a pose calculation module, a motion calculation module, a joint servo control module, an assembly machine hydraulic drive module, and an assembly machine body status sensing module.
[0044] Human-Machine Interface Panel: Provides a touch-sensitive human-machine interface. The splicing operator controls the segment assembly machine to grasp the segment and place it in the desired position for assembly through the human-machine interface. After the bolt installation operator completes the installation of the non-standard connecting bolts, the control command causes the segment assembly machine to unload the segment and automatically return to the standby position, waiting for the next segment to be grasped and assembled.
[0045] Line laser sensing module: Installed on the rotary mechanism of the segment assembly machine, it generates line laser and projects it onto the assembled segments and the gripping segments. The line laser intersects with the edge of the segment and the hand hole to be aligned to form point features, providing significant visual features for segments lacking texture features. Vision module: Used to calculate the spatial 3D coordinates of the point features in the sensor coordinate system {L}. L P provides measurement data for calculating the pose of assembled and grasped segments; Pose calculation module: Utilizing the spatial 3D coordinates of point features, and then using the calibration results of the contour measuring instrument and the segment pose measurement algorithm, the desired segment coordinate system in the base coordinate system {0} of the segment assembly machine is recovered. Spatial pose And the spatial pose of the current segment coordinate system {G} in the base coordinate system {0} of the segment assembly machine. ; Motion calculation module: Generates motion switching servo control mode. Based on the relative posture of the assembled segment and the gripping segment, the motion switching servo control mode controls the segment assembly machine to first achieve alignment of the gripping segment's Z-axis with the assembled segment's Z-axis. Then, while maintaining the alignment of the gripping segment's axis with the assembled segment's axis, it controls the rotation and axial clamping action of the gripping segment to complete the alignment of the bolt hand holes of the assembled segment and the gripping segment and eliminate circumferential gaps, ultimately achieving the automatic splicing task of the gripping segment. The motion switching servo control mode is as follows: ; In the formula, denoted as the allowable control accuracy for the axial direction of the tunnel segment, and × represents the vector cross product. The 2-norm of a vector represents its length. e 1, e 2 are the axis control task function and the handhole control task function, respectively. These are the Jacobian matrices controlling the non-full-rank axes. J 1 and hand-hole control Jacobian matrix J The generalized inverse of 2, λ 1, λ 2 represents the negative feedback proportional coefficient for axis control and hand-hole control, respectively. These are the axial unit vectors of the gripping and assembled segments in the coordinate system {0} of the assembly machine, respectively. The servo loop, composed of a line laser sensing module, a vision module, a pose calculation module, and a motion calculation module, has a sampling period of approximately 100ms and is located in the outer loop of the dual closed-loop servo control system.
[0046] Joint control module: The conventional PID algorithm is used to follow up the displacement and speed control commands of each joint of the assembly machine robot arm generated according to the motion switching servo control mode; Hydraulic drive module for the assembly machine: including hydraulic pump station, hydraulic pipeline, hydraulic valve, hydraulic cylinder, and hydraulic motor, responsible for driving the hydraulic movement of the segment assembly machine; The assembly machine body sensing module includes a pressure valve, a magnetostrictive displacement sensor, and an angle encoder. It is responsible for detecting the angular displacement, linear displacement, angular velocity, and linear velocity of the assembly machine. Together with the joint control module and the hydraulic drive module of the assembly machine, it completes the high-precision servo control of the assembly machine.
[0047] The servo loop formed by the joint control module, the hydraulic drive module of the assembly machine, and the sensing module of the assembly machine body has a sampling period of 2mm, which is much smaller than the sampling period of the outer loop, and is located in the inner loop of the dual closed-loop servo control system.
[0048] The core component is the control unit, which consists of a vision module, a pose calculation module, a motion calculation module, and a joint control module. On one hand, it connects to the hydraulic drive module of the assembly machine and controls the flow of each hydraulic cylinder and hydraulic motor to achieve precise control of the displacement and speed of each joint of the assembly machine. On the other hand, it uses a line laser sensing module to measure and process the pose of the assembled segments and the gripping segments. It also connects wirelessly to a human-machine interface tablet to display the splicing operation status in 3D in real time while receiving control commands from the segment splicing personnel.
[0049] In the embodiments provided by this invention, it should be understood that the disclosed structures and methods can be implemented in other ways. For example, the structural embodiments described above are merely illustrative. For instance, the division of units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interfaces, structures, or units, and may be electrical, mechanical, or other forms.
[0050] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.
[0051] Furthermore, the functional units in the various embodiments of the present invention can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.
[0052] The above description is merely a specific embodiment of the present invention, enabling those skilled in the art to understand or implement the invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the invention. Therefore, the present invention is not to be limited to the embodiments shown herein, but is to be accorded the widest scope consistent with the principles and novel features claimed herein.
Claims
1. An automatic segment splicing method based on a shield tunnel segment assembly machine, characterized in that, include: The segment assembly machine is guided to move near the segment feeder to complete the gripping of the segments to be assembled; After the segment assembly machine finishes gripping the segment, it automatically plans a collision-free trajectory from the starting point of gripping the segment to the desired assembly position according to the specified desired location. The segment assembly machine transports the gripped segment to the vicinity of the specified desired splicing position by tracking the collision-free trajectory; the position and posture of the assembled segment and the gripped segment are detected by the contour measuring instrument. The motion-switching servo control method aligns the z-axis of the gripping segment with the z-axis of the assembled segment based on the pose of the assembled and gripping segments. Then, while maintaining the alignment of their axes, it controls the rotation and axial clamping of the gripping segment to align the bolt handholes and eliminate circumferential gaps, ultimately achieving automatic assembly of the gripping segments. Specifically, the motion-switching servo control method utilizes an axis control task function to control the segment assembly machine's movement, ensuring the alignment of the axes of the assembled and gripping segments. It also utilizes a handhole control task function to control the assembly machine's movement, achieving handhole alignment while maintaining the alignment of the axes of the assembled and gripping segments. The axis control task function is... ; In the formula, These are the current segment coordinate system {G} and the desired segment coordinate system, respectively. The z-axis is the unit direction vector in the coordinate system {0} of the segment assembly machine. These are the current segment coordinate system {G} and the desired segment coordinate system, respectively. The position vector of the origin of the coordinate system in the coordinate system {0} of the segment assembly machine; × is the vector cross product operation, which was successfully eliminated after the M1 mask operation. The z-axis component; This is the axis control task mask, where `diag()` is a diagonal matrix; under axis control mode, the axis control task function... e 1 eventually converges to 0, and generates joint control variables: In the formula, This is the negative feedback proportional coefficient for axis control. Jacobian square matrix controlled by non-full-rank axes J The generalized inverse of 1; the axes of the assembled segment and the holding segment are aligned, that is, the inner surfaces of the holding segment and the assembled segment are aligned. Handhole control task function: ; in, Mask for handhole control task; Joint control parameters for hand-held control tasks: ; In the formula, These are the current segment coordinate system {G} and the desired segment coordinate system, respectively. The x-axis is the unit direction vector in the coordinate system {0} of the segment assembly machine; Jacobian squares controlled by non-full-rank handholes J The generalized inverse of 2, The negative feedback proportional coefficient for hand-eye control; the hand-eye control task function under hand-eye control mode. e 2. The final convergence is 0, and the assembled segments and the holding segments have completed the alignment of the handholes and the elimination of the circumferential gaps; The motion switching servo control method is as follows: ; In the formula, denoted as the allowable control accuracy for the axial direction of the tunnel segment, and × represents the vector cross product. Let be the vector 2-norm, which represents the length of the vector.
2. The automatic segment splicing method based on a shield tunnel segment assembly machine according to claim 1, characterized in that, The contour measuring instrument projects a linear laser beam outwards. The laser beam intersects with the edge of the segment and the hand hole to be aligned, forming point features. The spatial 3D coordinates of these point features are calculated using a vision sensor. Then, the desired segment coordinate system in the base coordinate system {0} of the segment assembly machine is recovered using the calibration results of the contour measuring instrument and the segment pose measurement algorithm. Spatial pose And the spatial pose of the currently held segment coordinate system {G} in the base coordinate system {0} of the segment assembly machine. ,in, These are the unit direction vector of the y-axis of the {G} coordinate system in the base coordinate system {0} of the segment assembly machine, and the position vector of the origin of the {G} coordinate system in the base coordinate system {0} of the segment assembly machine, respectively. They are respectively The unit direction vector of the y-axis in the base coordinate system {0} of the segment assembly machine The position vector of the origin of the coordinate system in the coordinate system {0} of the segment assembly machine.
3. The automatic segment splicing method based on a shield tunnel segment assembly machine according to claim 1, characterized in that, After the bolt installation workers have completed the installation of the irregular connection bolts, the control command causes the segment assembly machine to unload the segment and automatically return to the standby position, waiting for the next segment to be picked up and assembled.
4. The automatic segment splicing method based on a shield tunnel segment assembly machine according to claim 1, characterized in that, According to the rigid body kinematics equations, the velocity of the current segment coordinate system {G} in the segment assembly machine base coordinate system {0} is... The following relationship is satisfied with the rate of change of the axis control task function: ; In the formula I 3×3 It is a 3D identity matrix. For antisymmetric matrix notation, Let be the Jacobian matrix of the axis control task function, and let its rank be... ; Using the base coordinate system {0} of the segment assembly machine as the reference coordinate system, the current velocity of the segment coordinate system {G} is... 0 V G The velocity of the end effector coordinate system {E} in the segment assembly machine base coordinate system {0} 0 V E The mapping relationship between them satisfies: ; In the formula, 0 R E It is the attitude matrix of the end effector coordinate system {E} of the assembly machine in the base coordinate system {0} of the segment assembly machine, which is calculated through the kinematic model of the assembly machine; E t G This is the position vector of the origin of the current segment coordinate system {G} in the coordinate system {E} of the end effector of the assembly machine. When the assembly machine grasps the segment, this position vector is a known constant value. The velocity transformation Jacobian matrix is called the velocity transformation matrix, which characterizes the velocity mapping relationship between different rigidly connected coordinate systems, and satisfies full rank. ; Based on the kinematic model of the segment assembly machine, the mapping relationship between the coordinate system {E} of the end effector and the motion velocity of each joint can be derived: ; In the formula, This is the Jacobian matrix of the robotic arm joints constructed with the base coordinate system {0} of the segment assembly machine as the reference coordinate system. The joint Jacobian matrix represents the movement speed of each joint of the segment assembly machine when the machine is in a non-singular configuration and the joint Jacobian matrix is full rank. The following kinematic relationship exists between the rate of change of the axis control task function and the joint velocity: ; In the formula, Collectively referred to as axis control Jacobian matrix; Let axis control task function Exponential convergence: ; in This is the negative feedback proportional coefficient for axis control.
5. The automatic segment splicing method based on a shield tunnel segment assembly machine according to claim 1, characterized in that, Command hole control task function Exponential convergence: ; The handhole control method and its Jacobian matrix are derived as follows: ; ; ; In the formula, Collectively referred to as the hand-hole controlled Jacobian matrix.
6. An automatic segment splicing system based on a shield tunneling segment assembly machine, implementing the automatic segment splicing method based on a shield tunneling segment assembly machine as described in any one of claims 1-5, characterized in that, include: Line laser sensing module, vision module, pose calculation module, motion calculation module, joint servo control module, assembly machine hydraulic drive module, and assembly machine body status sensing module; Line laser sensing module: Installed on the rotary mechanism of the segment assembly machine, it generates a line laser and projects it onto the assembled segment and the gripping segment. The line laser intersects with the edge of the segment and the hand hole to be aligned to form point features, so as to estimate the relative pose of the assembled segment and the gripping segment. Vision module: Used to calculate the spatial 3D coordinates of the point features described in the sensor coordinate system {L}. L P is used to calculate the pose of the assembled segments and the gripped segments; Pose calculation module: Utilizing the spatial 3D coordinates of point features, combined with the calibration results of the contour measuring instrument and the segment pose measurement algorithm, the desired segment coordinate system in the base coordinate system {0} of the segment assembly machine is recovered. Spatial pose And the spatial pose of the current segment coordinate system {G} in the base coordinate system {0} of the segment assembly machine. ; Motion Calculation Module: Generates motion switching servo control mode. This mode controls the segment assembly machine based on the relative posture of the assembled and gripping segments. First, it aligns the z-axis of the gripping segment with the z-axis of the assembled segment. Then, while maintaining the alignment of their axes, it controls the rotation and axial clamping of the gripping segment, aligning the bolt handholes and eliminating circumferential gaps. This ultimately achieves automatic segment assembly. Specifically, the motion switching servo control mode uses an axis control task function to control the segment assembly machine's movement, ensuring the axes of the assembled and gripping segments are aligned. It also uses a handhole control task function to control the machine's movement, achieving handhole alignment while maintaining the alignment of their axes. The axis control task function is... ; In the formula, These are the current segment coordinate system {G} and the desired segment coordinate system, respectively. The z-axis is the unit direction vector in the coordinate system {0} of the segment assembly machine. These are the current segment coordinate system {G} and the desired segment coordinate system, respectively. The position vector of the origin of the coordinate system in the coordinate system {0} of the segment assembly machine; × is the vector cross product operation, which was successfully eliminated after the M1 mask operation. The z-axis component; This is the axis control task mask, where `diag()` is a diagonal matrix; under axis control mode, the axis control task function... e 1 eventually converges to 0, and generates joint control variables: In the formula, This is the negative feedback proportional coefficient for axis control. Jacobian square matrix controlled by non-full-rank axes J The generalized inverse of 1; the axes of the assembled segment and the holding segment are aligned, that is, the inner surfaces of the holding segment and the assembled segment are aligned. Handhole control task function: ; in, Mask for handhole control task; Joint control parameters for hand-held control tasks: ; In the formula, These are the current segment coordinate system {G} and the desired segment coordinate system, respectively. The x-axis is the unit direction vector in the coordinate system {0} of the segment assembly machine; Jacobian squares controlled by non-full-rank handholes J The generalized inverse of 2, The negative feedback proportional coefficient for hand-eye control; the hand-eye control task function under hand-eye control mode. e 2. The final convergence is 0, and the assembled segments and the holding segments have completed the alignment of the handholes and the elimination of the circumferential gaps; The motion switching servo control method is as follows: ; In the formula, denoted as the allowable control accuracy for the axial direction of the tunnel segment, and × represents the vector cross product. The 2-norm of a vector represents its length. Joint control module: It adopts conventional PID algorithm to follow up the displacement and speed control commands of each joint of the assembly machine robot arm generated according to the motion switching servo control mode; Hydraulic drive module for the assembly machine: including hydraulic pump station, hydraulic pipeline, hydraulic valve, hydraulic cylinder, and hydraulic motor, responsible for driving the hydraulic movement of the segment assembly machine; The assembly machine body sensing module includes a pressure valve, a magnetostrictive displacement sensor, and an angle encoder. It is responsible for detecting the angular displacement, linear displacement, angular velocity, and linear velocity of the assembly machine. Together with the joint control module and the hydraulic drive module of the assembly machine, it completes the high-precision servo control of the assembly machine.
7. The automatic segment splicing system based on a shield tunnel segment assembly machine according to claim 6, characterized in that, include: Human-machine interface panel: Provides a touch-sensitive human-machine interface. The splicing operator controls the segment assembly machine to grab the segment to the desired position for assembly through the human-machine interface. After the bolt installation operator completes the installation of the non-standard connecting bolts, the control command causes the segment assembly machine to unload the segment and automatically return to the standby position, waiting for the next segment to be grabbed and assembled.
Citation Information
Patent Citations
Automatic assembly method and system for tunnel segments
CN108104834B
An Automatic Segment Assembly Method for Tunnel Boring Machines Based on Tag Code Visual Measurement
CN109736836B
Automatic shield segment assembling method based on machine vision
CN113107550A
Duct piece grabbing pose detection device and detection method based on deep learning vision
CN113863966A
Shield pipe segment erector formed by splicing six-degree-of-freedom double arms in staggered way
CN102733819A
