Method for positioning and grabbing pipe segments by assembling machine, assembling machine and tunneling machine
By using cameras and sensors to compare images on the assembly machine, the automatic positioning and grasping of the pipe sheet is achieved, which solves the problem of low positioning and grasping efficiency of the assembly machine in the existing technology, improves the efficiency and quality of the pipe sheet assembly, and improves the Tunnel excavation working conditions.
Patent Information
- Application Number
- CN202210150759.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-02-18
- Publication Date
- 2024-11-12
- Estimated Expiration
- 2042-02-18
AI Technical Summary
The existing assembly machines rely on human eye observation for remote control operation during pipe segment grabbing, resulting in low positioning and grabbing efficiency and cumbersome operation, affecting the efficiency and quality of tunnel boring work.
By setting the camera and sensor on the assembly machine, using the comparison between standard images and real-time images, the position of the assembly machine is automatically adjusted to realize automatic positioning and grabbing of the pipe piece, including standard shooting position, initial state recovery, real-time image acquisition and comparison , adjust the Y-axis coordinates and move to the accurate grab position to grab the pipe slice.
The efficiency and quality of the assembler grabs pipe segments has been improved, the working conditions of tunnel boring workers have been improved, technical preparations have been made to achieve fully automated pipe segment assembly operations, free up labor, and improve the efficiency of pipe segment assembly.
Smart Images

Figure CN114483119B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of tunneling, and in particular to a method for positioning and grabbing pipe segments by an assembling machine, an assembling machine and a tunneling machine. Background Art
[0002] In some related technologies, the operation of the assembly machine mainly relies on the operator (assembler) to remotely control the axial translation, circumferential rotation, radial expansion and contraction of the assembly machine and the roll, pitch, and deflection of the pipe segment grabbing plate through human visual observation, so that the grabbing part of the assembly machine is aligned with the grabbed part of the pipe segment to achieve grabbing. In order to achieve more accurate observation, the operator needs to constantly find the alignment point in the working area outside the assembly machine and constantly control the remote control to adjust the movement of the assembly machine in various dimensions. The operation is cumbersome and inefficient. Summary of the invention
[0003] Some embodiments of the present invention provide a method for positioning and grabbing a pipe segment by an assembler, an assembler, and a tunneling machine, which are used to alleviate the problem of low positioning and grabbing efficiency.
[0004] In one aspect of the present invention, a method for positioning and grabbing a pipe segment by an assembling machine is provided, comprising the following steps:
[0005] S10: The assembly machine is positioned to grab the standard segment successfully. At this time, the position of the assembly machine is the standard grabbing position, and an OXYZ coordinate system is established, wherein the X-axis is parallel to the excavation direction of the tunnel boring machine with the assembly machine, the Y-axis is perpendicular to the X-axis, and the Y-axis and the X-axis are located in the same horizontal plane, and the Z-axis is perpendicular to the X-axis and the Y-axis, and the Z-axis is in the vertical direction;
[0006] S20: causing the assembling machine to release the standard segment, and causing the assembling machine to carry a camera disposed thereon to move along the X-axis in a positive direction by a first distance threshold, and along the Z-axis in a positive direction by a second distance threshold, to reach a standard shooting position, causing the camera to shoot the standard segment as a standard image, and recording the standard telescopic parameters of each cylinder driving the assembling machine at this time;
[0007] S30: Restoring each oil cylinder to an initial state;
[0008] S40: causing each oil cylinder to extend and retract from the initial state according to the standard extension and retraction parameters to reach a standard shooting position, and then causing the camera to shoot a real-time segment as a real-time image;
[0009] S50: comparing the real-time image with the standard image, adjusting the coordinate of the assembling machine on the Y axis so that the coordinate of the assembling machine on the Y axis is consistent with the coordinate of the real-time segment on the Y axis; and
[0010] S60: The assembling machine is moved from the current position to the accurate grabbing position to grab the real-time pipe segment.
[0011] In some embodiments, the standard pipe segment is provided with a grasped portion for being grasped by the assembly machine, and positioning holes are respectively provided on both sides of the grasped portion. When the camera is in the standard shooting position, the camera, the grasped portion and the two positioning holes form a plane perpendicular to the horizontal plane, and the grasped portion and the two positioning holes are included in the standard image.
[0012] In some embodiments, in step S60, moving the assembling machine from the current position to the accurate grasping position includes:
[0013] Move the assembling machine in the negative direction of the X-axis by a first distance, wherein the first distance is less than the first distance threshold;
[0014] Move the assembling machine in the negative direction along the Z axis until the assembling machine reaches the accurate grasping position on the Z axis; and
[0015] The assembling machine is made to continue to move in the negative direction along the X-axis until the assembling machine reaches the accurate grasping position on the X-axis.
[0016] In some embodiments, the step of causing the assembling machine to move in the negative direction along the Z axis until the assembling machine reaches the accurate grasping position on the Z axis includes: while causing the assembling machine to move in the negative direction along the Z axis, detecting by a first sensor disposed on the assembling machine until the detection value of the first sensor is equal to the detection value of the first sensor when the assembling machine is in the standard grasping position in step S10.
[0017] In some embodiments, causing the assembling machine to continue to move in the negative direction of the X-axis until the assembling machine reaches the accurate grasping position on the X-axis includes: in the process of the assembling machine continuing to move in the negative direction of the X-axis, until a second sensor provided on the assembling machine detects a grasped portion provided on the real-time pipe segment for being grasped by the assembling machine.
[0018] In some embodiments, the initial state includes a state where the stroke of each cylinder is zero.
[0019] In some embodiments, the movement of the assembling machine along the X-axis is achieved through linear motion; the movement of the assembling machine along the Y-axis is achieved through rotational motion; and the movement of the assembling machine along the Z-axis is achieved through linear motion.
[0020] In some embodiments, a grasped portion for being grasped by the assembling machine is provided on the real-time pipe segment, positioning holes are provided on both sides of the grasped portion, and the grasped portion and the two positioning holes are included in the real-time image.
[0021] In some embodiments, step S31 is further included between step S40 and step S30: the real-time segment information is collected by the camera and transmitted to the control system, the control system compares the real-time segment information with preset information therein, and when the real-time segment information is consistent with the preset information, controls the execution of step S40, and when the real-time segment information is inconsistent with the preset information, issues a warning.
[0022] In some embodiments, the information of the real-time segment includes the type of the real-time segment, the placement direction of the real-time segment, or the outline of the real-time segment.
[0023] In another aspect of the present invention, an assembling machine is provided, which is configured to implement the above-mentioned method of positioning and grabbing pipe segments by the assembling machine.
[0024] In another aspect of the present invention, a tunnel boring machine is provided, comprising the above-mentioned assembling machine.
[0025] Based on the above technical solution, the present invention has at least the following beneficial effects:
[0026] In some embodiments, by comparing standard images with real-time images, automatic positioning and grabbing of pipe segments by the assembler is achieved, improving the operation mode relying on manual remote control by personnel in related technologies, improving the efficiency and quality of pipe segments grabbing by the assembler, improving the working conditions of tunnel excavation workers, and making technical preparations for realizing fully automated pipe segment assembly operations. BRIEF DESCRIPTION OF THE DRAWINGS
[0027] The drawings described herein are used to provide a further understanding of the present invention and constitute a part of this application. The exemplary embodiments of the present invention and their descriptions are used to explain the present invention and do not constitute an improper limitation of the present invention. In the drawings:
[0028] Figure 1 A schematic diagram of the structure of an assembling machine provided according to some embodiments of the present invention;
[0029] Figure 2 A partially enlarged schematic diagram of an assembling machine provided according to some embodiments of the present invention;
[0030] Figure 3 A schematic diagram of the positions of cameras, sensors and photoelectric switches provided on an assembling machine according to some embodiments of the present invention;
[0031] Figure 4 A schematic top view of a standard image captured by a camera according to some embodiments of the present invention;
[0032] Figure 5A schematic diagram of automatic leveling of a clamping plate relative to a real-time segment according to some embodiments of the present invention;
[0033] Figure 6 A schematic flow chart of a method for positioning and grabbing a pipe segment by an assembling machine according to some embodiments of the present invention;
[0034] Figure 7 A schematic diagram of the overall process of a method for positioning and grabbing a pipe segment by an assembling machine according to some embodiments of the present invention;
[0035] Figure 8 A schematic diagram of a process of real-time segment information recognition according to some embodiments of the present invention;
[0036] Fig. 9 A schematic diagram of a process for obtaining a real-time image of a real-time pipe segment according to some embodiments of the present invention;
[0037] Fig.10 A schematic diagram of a process for realizing alignment of a grasping portion and a grasped portion based on comparison of a standard image and a real-time image according to some embodiments of the present invention;
[0038] Fig.11 A schematic diagram of an operation flow of achieving real-time segment grabbing after a grabbing part is aligned with a grabbed part according to some embodiments of the present invention;
[0039] Fig.12 A schematic diagram of solving the displacement deviation in the Y direction by comparing the real-time image with the standard image according to some embodiments of the present invention;
[0040] Fig.13 A schematic flow chart of a method for positioning and grabbing pipe segments by an assembling machine according to some alternative embodiments of the present invention.
[0041] The reference numerals in the accompanying drawings are described as follows:
[0042] 1-weightlifting clamp arm; 2-clamping plate; 3-axial translation mechanism; 4-radial telescopic mechanism; 5-circumferential rotation mechanism; 6-pitch mechanism; 7-deflection mechanism; 8-camera; 9-photoelectric switch; 10-distance measuring sensor; 11-camera bracket; 12-pipe segment; 13-grasped part; 14-positioning hole; 15-standard image; 16-real-time image; D-displacement deviation.
[0043] It should be understood that the size of each part shown in the accompanying drawings is not drawn according to the actual proportional relationship. In addition, the same or similar reference numerals represent the same or similar components. DETAILED DESCRIPTION
[0044] Various exemplary embodiments of the present invention will now be described in detail with reference to the accompanying drawings. The description of the exemplary embodiments is merely illustrative and is in no way intended to limit the present invention and its application or use. The present invention can be implemented in many different forms and is not limited to the embodiments described herein. These embodiments are provided to make the present invention thorough and complete and to fully express the scope of the present invention to those skilled in the art. It should be noted that unless otherwise specifically stated, the relative arrangement of the parts and steps, the composition of the materials, the numerical expressions and the numerical values set forth in these embodiments should be interpreted as being merely exemplary, rather than as limitations.
[0045] The words "first", "second" and similar words used in the present invention do not indicate any order, quantity or importance, but are only used to distinguish different parts. The words "include" or "comprise" and similar words mean that the elements before the word include the elements listed after the word, and do not exclude the possibility of including other elements. "Up", "down", "left", "right" and the like are only used to indicate relative positional relationships. When the absolute position of the described object changes, the relative positional relationship may also change accordingly.
[0046] In the present invention, when a specific device is described as being located between a first device and a second device, there may or may not be an intermediate device between the specific device and the first device or the second device. When a specific device is described as being connected to other devices, the specific device may be directly connected to the other devices without an intermediate device, or may not be directly connected to the other devices but have an intermediate device.
[0047] All terms (including technical terms or scientific terms) used in the present invention have the same meanings as those understood by ordinary technicians in the field to which the present invention belongs, unless otherwise specifically defined. It should also be understood that terms defined in general dictionaries should be interpreted as having meanings consistent with their meanings in the context of the relevant technology, and should not be interpreted in an idealized or extremely formal sense, unless explicitly defined herein.
[0048] Technologies, methods, and equipment known to ordinary technicians in the relevant art may not be discussed in detail, but where appropriate, the technologies, methods, and equipment should be considered part of the specification.
[0049] The tunnel boring machine is a device used to dig tunnels. The tunnel boring machine includes a segment assembler (hereinafter referred to as an assembler), which is also called a lifting arm. It is a lifting device placed at the tail of the shield and can quickly assemble and fix the segments. The function of the assembler is to quickly and accurately install the segments on the surface of the newly excavated tunnel to support the tunnel surface and prevent groundwater infiltration and surface subsidence.
[0050] refer to Figure 1and Figure 2 In some embodiments, the assembling machine includes a lifting clamp arm 1, a clamping plate 2, an axial translation mechanism 3, a radial telescopic mechanism 4, a circumferential rotation mechanism 5, a pitch mechanism 6, a deflection mechanism 7, a camera 8, a photoelectric switch 9, a distance sensor 10 and a camera bracket 11.
[0051] The axial translation mechanism 3 includes a guide rail parallel to the excavation direction of the tunnel boring machine. The circumferential rotation mechanism 5 includes an annular member, and the guide rail passes through the annular member. The annular member includes a first annular member slidably connected to the guide rail, and a second annular member rotatably connected to the first annular member, and the second annular member is configured to rotate around the guide rail. The radial telescopic mechanism 4 is arranged on the second annular member, and the radial telescopic mechanism 4 drives and connects the weight lifting clamp arm 1 to move the weight lifting clamp arm 1 in the vertical direction. The clamping plate 2 is arranged on the weight lifting clamp arm 1.
[0052] The clamping plate 2 is provided with a gripping portion for gripping the pipe segment. The clamping plate 2 can move along the guide rail, can rotate around the guide rail, and can move vertically relative to the guide rail. Figure 3 The clamping plate 2 is provided with an opening, and the photoelectric switch 9 is provided on the clamping plate 2 and is located at the side of the opening. The distance measuring sensor 10 is provided on the clamping plate 2.
[0053] refer to Figure 3 The camera 8 is arranged on the weight lifting clamp arm 1 through the camera bracket 11. The viewing angle of the camera 8 is obliquely downward, and is used to locate the grasped part on the pipe segment when grasping the pipe segment.
[0054] The pitch mechanism 6 and the deflection mechanism 7 are both provided on the weightlifting clamp arm 1 , and the pitch mechanism 6 is configured to control the pitch motion of the clamping plate 2 . The deflection mechanism 7 is configured to control the rotation motion of the clamping plate 2 relative to the weightlifting clamp arm 1 .
[0055] The axial translation mechanism 3, the radial telescopic mechanism 4, the circumferential rotation mechanism 5, the pitch mechanism 6 and the deflection mechanism 7 each include an oil cylinder for providing power.
[0056] In some related technologies, the operation of the assembly machine mainly relies on the operator (assembler) to remotely control the axial translation, circumferential rotation, radial expansion and contraction of the assembly machine and the roll, pitch, and deflection of the pipe segment grabbing plate through human visual observation, so that the grabbing part of the assembly machine is aligned with the grabbed part of the pipe segment to achieve grabbing. In order to achieve more accurate observation, the operator needs to constantly find the alignment point in the working area outside the assembly machine and constantly control the remote control to adjust the movement of the assembly machine in various dimensions. The operation is cumbersome and inefficient.
[0057] Based on this, some embodiments of the present disclosure propose a method for positioning and grabbing pipe segments by an assembler, an assembler and a tunneling machine, which are used to alleviate the problem of low positioning and grabbing efficiency.
[0058] Figure 6Schematic diagram of some embodiments of the method for positioning and grabbing pipe segments by an assembly machine according to the present invention. Figure 6 In some embodiments, the method for positioning and grabbing a pipe segment by an assembling machine comprises the following steps:
[0059] S10: The assembly machine is positioned to grab the standard segment successfully. At this time, the position of the assembly machine is the standard grabbing position, and an OXYZ coordinate system is established, wherein the X-axis is parallel to the excavation direction of the tunneling machine with the assembly machine, the Y-axis is perpendicular to the X-axis, and the Y-axis and the X-axis are located in the same horizontal plane, and the Z-axis is perpendicular to the X-axis and the Y-axis, and the Z-axis is in the vertical direction;
[0060] S20: The assembly machine releases the standard segment, and the assembly machine carries a camera disposed thereon and moves along the X-axis by a first distance threshold, and along the Z-axis by a second distance threshold, to reach a standard shooting position, so that the camera shoots the standard segment as a standard image, and records the standard telescopic parameters of each cylinder driving the assembly machine at this time;
[0061] S30: Restoring each oil cylinder to its initial state;
[0062] S40: each oil cylinder is extended and retracted from an initial state according to a standard extension and retraction parameter to reach a standard shooting position, and then a camera is used to shoot a real-time segment as a real-time image;
[0063] S50: comparing the real-time image with the standard image, adjusting the coordinate of the assembly machine on the Y axis so that the coordinate of the assembly machine on the Y axis is consistent with the coordinate of the real-time segment on the Y axis; and
[0064] S60: The assembly machine is moved from the current position to the accurate grabbing position to grab the real-time pipe segment.
[0065] In the above embodiment, by comparing the standard image with the real-time image, the automatic positioning and grabbing of the pipe segment by the assembler is realized, the operation mode relying on manual remote control operation by personnel in the related technology is improved, the efficiency and quality of the pipe segment grabbing by the assembler are improved, the working conditions of the tunnel excavation workers are improved, and technical preparations are made for realizing fully automated pipe segment assembly operations.
[0066] refer to Figure 4 In some embodiments, a grasped portion 13 for being grasped by an assembling machine is provided on the standard pipe segment, and positioning holes 14 are respectively provided on both sides of the grasped portion. When the camera is in the standard shooting position, the camera 8, the grasped portion 13 and the two positioning holes 14 form a plane perpendicular to the horizontal plane, and the grasped portion 13 and the two positioning holes 14 are present in the standard image.
[0067] When the camera is in the standard shooting position, the projections of the camera 8, the grasped portion 13 and the two positioning holes 14 on the horizontal plane are located on the same straight line, and the straight line is parallel to the excavation direction.
[0068] Optionally, the grasped portion 13 includes a buckle bolt. The positioning hole 14 includes a pin hole or a bolt hole, and can be a hole provided on the pipe segment.
[0069] In some embodiments, in step S60, moving the assembling machine from the current position to the accurate grasping position includes:
[0070] The assembling machine is moved in the negative direction of the X-axis by a first distance, wherein the first distance is less than a first distance threshold;
[0071] Move the assembling machine in the negative direction of the Z axis until the assembling machine reaches an accurate grasping position on the Z axis; and
[0072] The assembling machine continues to move in the negative direction of the X-axis until the assembling machine reaches the accurate grasping position on the X-axis.
[0073] In some embodiments, the assembling machine is moved in the negative direction along the Z axis until the assembling machine reaches an accurate grasping position on the Z axis, including: while the assembling machine is moving in the negative direction along the Z axis, detection is performed by a first sensor provided on the assembling machine until the detection value of the first sensor is equal to the detection value of the first sensor when the assembling machine is in the standard grasping position in step S10.
[0074] Optionally, the first sensor includes a distance measuring sensor. The distance between the distance measuring sensor and the real-time segment is detected by the distance measuring sensor arranged on the assembling machine until the detection value of the distance measuring sensor is equal to the distance between the distance measuring sensor and the standard segment detected by the distance measuring sensor when the assembling machine is in the standard grabbing position in step S10.
[0075] Optionally, the first sensor includes a piezoresistive sensor, which detects the pressure value between the piezoresistive sensor and the real-time pipe segment through the piezoresistive sensor set on the assembly machine until the detection value of the piezoresistive sensor is equal to the pressure value between the piezoresistive sensor and the standard pipe segment detected by the piezoresistive sensor when the assembly machine is in the standard grabbing position in step S10.
[0076] In some embodiments, the assembling machine continues to move in the negative direction of the X-axis until the assembling machine reaches an accurate grasping position on the X-axis, including: in the process of the assembling machine continuing to move in the negative direction of the X-axis, until a second sensor provided on the assembling machine detects a grasped portion provided on the real-time pipe segment for being grasped by the assembling machine.
[0077] Optionally, the second sensor includes a photoelectric switch, and during the process of the assembling machine continuing to move along the negative direction of the X-axis, the photoelectric switch arranged on the assembling machine detects the grasped portion arranged on the real-time pipe segment for being grasped by the assembling machine.
[0078] Optionally, the second sensor includes a contact switch, and during the process of the assembling machine continuing to move along the negative direction of the X-axis, the contact switch arranged on the assembling machine detects the grasped portion arranged on the real-time pipe segment for being grasped by the assembling machine.
[0079] In some embodiments, the initial state includes a state where the stroke of each cylinder is zero, but is not limited to this state.
[0080] In some embodiments, the movement of the assembler along the X-axis is achieved through linear motion; the movement of the assembler along the Y-axis is achieved through rotational motion; and the movement of the assembler along the Z-axis is achieved through linear motion.
[0081] In some embodiments, a grasped portion for being grasped by an assembling machine is provided on the real-time pipe segment, and positioning holes are respectively provided on both sides of the grasped portion. The grasped portion and the two positioning holes are present in the real-time image.
[0082] Optionally, the grasped portion 13 of the segment 12 (including the real-time segment and the standard segment) includes a buckle bolt, and the positioning hole 14 includes a pin hole.
[0083] In some embodiments, step S31 is also included between step S40 and step S30: real-time segment information is collected through a camera and transmitted to the control system, the control system compares the real-time segment information with the preset information therein, and when the real-time segment information is consistent with the preset information, the control executes step S40, and when the real-time segment information is inconsistent with the preset information, an alarm is issued.
[0084] In some embodiments, the information of the real-time segment includes the type of the real-time segment, the placement direction of the real-time segment, or the outline of the real-time segment.
[0085] A standard segment is one that has the correct placement direction, accurate type information, and meets assembly requirements. A real-time segment can be used as a standard segment if its information meets the requirements.
[0086] refer to Figure 3 In some embodiments, the assembly machine is provided with a camera 8, a distance sensor 10 and a photoelectric switch 9. The photoelectric switch 9 is provided on one side of the opening of the clamping plate 2 to detect whether the grasped portion of the pipe segment has reached the opening. The distance sensor 10 is arranged on the side of the clamping plate 2 of the assembly machine. Two distance sensors 10 are provided on the side of the clamping plate 2 close to the excavation direction, and two distance sensors 10 are provided on the side of the clamping plate 2 not in the excavation direction. The four distance sensors 10 are used to measure the distance between the clamping plate 2 and the pipe segment during auxiliary grasping of the pipe segment, and can also be used to adjust the posture of the clamping plate 2 to make it parallel to the surface of the pipe segment (refer to Figure 5 ).
[0087] For ease of description, a segment assembly machine coordinate system is established for reference, with the positive direction of the X-axis along the excavation direction of the tunnel boring machine; the viewing angle is towards the excavation direction, and the left-hand direction is the positive direction of the Y-axis; and the vertical upward direction is the positive direction of the Z-axis.
[0088] Based on the above embodiment, the method for positioning and grabbing a pipe segment by an assembling machine comprises the following steps:
[0089] 1. First, control the assembly machine to achieve successful positioning and grasping of the standard pipe segment. This position can be used as the standard grasping position. Obtain the distance readings of the four distance sensors when the assembly machine is in the standard grasping position, recorded as L (the measurement values of the four distance sensors should be consistent within a certain threshold range).
[0090] 2. Take the standard image A of the standard segment, see Figure 4
[0091] The camera moves a fixed distance in both directions of the coordinate system at the standard grasping position (the first distance threshold M and the second distance threshold N correspond to the positive direction of the X-axis and the positive direction of the Z-axis, respectively). This position is recorded as the standard shooting position, and a standard image is captured.
[0092] In addition, it is defined that the state when the cylinder stroke of the axial translation mechanism, radial telescopic mechanism, axial rotation mechanism, pitch mechanism, deflection mechanism and other mechanisms of the assembly machine is zero is the initial state of each cylinder of the assembly machine. According to the telescopic parameters of each cylinder of the assembly machine at the standard shooting position relative to the initial state of each cylinder, the displacement stroke of each cylinder of the assembly machine can be obtained as the standard telescopic parameters.
[0093] The standard image is required to be able to capture the grasped part of the standard segment and the two positioning holes on both sides of the grasped part. The grasped part and the two positioning holes on both sides of the grasped part in the standard image are required to be at the center of the inner surface of the segment and on the same straight line. Preferably, the grasped part in the standard image is located at the geometric center of the image as much as possible. Reference Figure 4 In the standard shooting position, in the top view of the standard pipe segment 12 and the camera 8, the grasped portion 13 and the two positioning holes 14 on both sides thereof, and the camera 8 are on the same straight line and parallel to the X-axis.
[0094] 3. Obtain real-time image B of real-time segment
[0095] After the assembling machine obtains the start process instruction issued by the control system, each cylinder of the assembling machine is reset to the initial state, so that the assembling machine is in the initial state;
[0096] After each cylinder is reset to its position, the movement of each cylinder of the assembling machine is controlled according to the standard telescopic parameters pre-stored in the control system, so that the assembling machine is located at the standard shooting position;
[0097] A real-time image B of the real-time segment is acquired at a standard shooting position, wherein the real-time image B includes a grasped portion of the inner surface of the real-time segment and positioning holes on both sides of the grasped portion.
[0098] 4. Image processing and comparison
[0099] The real-time image B is processed using an image processing method to extract features such as the grasped part and the two positioning holes. The features of the grasped part and the two positioning holes in the real-time image B are compared with those in the standard image A, and the difference parameters between the two are calculated. The displacement parameters that the circumferential rotating mechanism of the assembly machine needs to move are then calculated using the camera's intrinsic parameter matrix and focal length and other parameters.
[0100] The calculated parameters are sent to the control system, which controls the movement of the circumferential rotation mechanism of the assembly machine. After it is in place, the real-time image of the pipe segment is acquired again, the image processing is performed again, the error is calculated again, and the circumferential rotation mechanism of the assembly machine is controlled again. This process is repeated until the error is eliminated to zero or reaches the set threshold range. At this time, it can be ensured that the center line of the horizontal projection of the camera is in line with the line connecting the captured part and the two positioning holes.
[0101] 5. Assembly machine realizes segment grabbing
[0102] 1) The assembly machine moves 2M / 3 along the negative direction of the X axis;
[0103] 2) Continue to descend along the negative direction of the Z axis and control the radial telescopic mechanism of the assembly machine, the pitch mechanism of the clamping plate, and the deflection mechanism of the clamping plate according to the parameters of the four distance sensors, so that the detection values of the four distance sensors remain consistent within a certain threshold range, so that the clamping plate is parallel to the inner surface of the pipe segment; continue to descend until the readings of the four distance sensors are L, see Figure 5 .
[0104] 3) The axial translation mechanism of the assembly machine is activated, and the assembly machine moves along the negative direction of the X axis, and translates to the grasped part on the pipe segment to trigger the photoelectric proximity switch on the clamping plate, and the trigger signal is sent to the control system;
[0105] 4) The control system sends a command, the assembly machine translation cylinder moves, and translates the specified distance (the photoelectric switch is installed in a fixed position, and after being triggered, the distance that the grasped part reaches the accurate grasping position is also certain), so that the grasping part of the assembly machine translates to the accurate grasping position;
[0106] 5) The tensioning cylinder of the grabbing part moves to tighten the pipe segment, completing the auxiliary positioning and grabbing process of the pipe area, and feeding back the signal to the control system.
[0107] The disclosed embodiment uses visual and image processing technology to assist in calculating the displacement parameters of each dimension that need to be corrected of the grasping part of the assembling machine relative to the grasped part of the real-time pipe segment, and then controls the action of the action mechanism of each dimension of the assembling machine, sets a suitable process flow in combination with the on-site working conditions, so as to realize the automatic grasping of the real-time pipe segment by the assembling machine.
[0108] The disclosed embodiment can realize the automatic positioning and grasping action of the assembling machine on the pipe segment, liberate the labor of the pipe segment assembling workers, and improve the efficiency of the pipe segment assembly.
[0109] The following is combined with Figures 7 to 12 , describes in detail the specific process of the method for assembling machine positioning and grabbing pipe segments.
[0110] refer to Figure 7 The overall process of the method for positioning and grabbing the pipe segment by the assembly machine includes the following steps:
[0111] Step 1: Acquisition and feature processing of standard images;
[0112] Step 2: Reset the assembly machine;
[0113] Step 3: Real-time segment type and basic status identification;
[0114] Step 4: Obtain a real-time image of the inner surface of the real-time segment;
[0115] Step 5: Image processing and control parameter calculation; realize the alignment between the grabbing part of the assembly machine and the grabbed part on the real-time segment (i.e., the Y values of the two points are consistent);
[0116] Step 6: The assembly machine realizes real-time segment grabbing;
[0117] Step 7: Determine whether the grasping is successful. If the grasping is successful, assemble the pipe segments. If the grasping is unsuccessful, return to step 2.
[0118] In some embodiments, step 1: acquiring and processing features of a standard image specifically includes the following steps:
[0119] Step 11: First, control the assembly machine to achieve successful positioning of the standard pipe segment, control the grabbing part of the assembly machine to successfully grab the grasped part of the standard pipe segment, and use this position of the clamping plate of the assembly machine as the standard grabbing position.
[0120] Step 12: The distance readings of the four distance measuring sensors when obtaining the standard grasping position are recorded as L.
[0121] Step 13: Control the axial translation mechanism of the assembly machine to move the assembly machine clamping plate along the positive direction of the X-axis by the first distance threshold M, and then control the radial telescopic mechanism to move the assembling machine clamping plate along the positive direction of the Z-axis by the second distance threshold N. Record this position as the standard shooting position and take a standard image A.
[0122] Among them, M and N are determined based on practical experience.
[0123] The standard image requires that the captured part of the standard segment and the two positioning holes on both sides of the captured part can be captured, and the straight line connecting the centers of the three is required to be perpendicular to the edges of both sides of the standard image. (First, the camera pitch position is predetermined, and then the assembly machine is continuously moved to find the first distance threshold M and the second distance threshold N that meet the requirements of the standard image.) At the same time, the captured part is required to be located at the center of the standard image (to facilitate feature recognition, subsequent image comparison and error resolution).
[0124] Definition: The state of the assembler when the cylinder stroke of the axial translation mechanism, radial telescopic mechanism, axial rotation mechanism, pitch mechanism, deflection mechanism and other mechanisms of the assembler is zero is the initial state of the assembler, which is also the initial state of each cylinder.
[0125] Among them, the standard shooting position is compared with the initial state of the assembly machine, and the displacement stroke of each actuator of the assembly machine can be known (each cylinder of the assembly machine has a stroke encoder or similar device), and the standard displacement parameters of each actuator between the standard shooting position and the initial state are pre-stored in the control system.
[0126] In some embodiments, step 2: resetting the assembly machine specifically includes: in the actual assembly operation, when the assembling machine receives the start instruction of the segment assembly process issued by the tunnel boring machine control system, each actuator (cylinder) of the assembling machine is reset to the initial state (zero position), so that the assembling machine is in the initial state.
[0127] In some embodiments, reference Figure 8 , Step 3: Real-time segment type and basic status identification, including:
[0128] After the assembly machine is reset to the initial state, it sends an arrival signal to the control system:
[0129] The control system controls the camera to send a signal to identify the segment type and basic status. The camera identifies the identification code with type and direction information prefabricated on the segment or the segment contour information, and after processing the relevant information, it feeds back the information to the control system.
[0130] The control system compares the camera's feedback information with the preset information in it to determine whether the camera's feedback information is correct (the control system is preset with segment type and basic status information);
[0131] If the control system determines that the segment type and basic status information are correct, the control system sends a signal to proceed to the next process;
[0132] If the control system determines that the segment type and basic status information are incorrect, the control system will send out an audible and visual alarm signal to indicate that the segment type or basic status information is incorrect, and interrupt the existing process;
[0133] On-site workers make segment corrections;
[0134] After the correction is completed, the operator presses the reset button, and the control system re-sends a signal to the camera to identify the segment type and basic status.
[0135] In the above embodiments, the basic state of the segment includes the placement position and placement orientation of the segment.
[0136] In some embodiments, reference Fig. 9 , Step 4: Obtain a real-time image of the inner surface of the real-time segment, specifically including:
[0137] After the segment type and basic status identification process is completed, the control system sends a process instruction to the assembly machine to "obtain a real-time image of the inner surface of the segment".
[0138] After receiving the command, the assembly machine starts to perform the following actions:
[0139] 1) The assembly machine in the reset state controls the actions of the actuators (cylinders) of the assembly machine according to the point information of the standard shooting position pre-stored in the control system, so that the camera is located at the standard shooting position.
[0140] Among them, the real-time segment placement position when the assembler is performing segment assembly operations is generally relatively fixed. The standard shooting position positioned in the process of obtaining standard images can ensure that the camera can obtain real-time images of the real-time segments.
[0141] The actions of each actuator (cylinder) of the assembly machine include: the axial translation mechanism moves according to the displacement parameters of the standard shooting position below the control system; the radial telescopic mechanism moves according to the displacement parameters of the standard shooting position below the control system; and the circumferential rotation mechanism moves according to the displacement parameters of the standard shooting position below the control system.
[0142] 2) After the assembler moves to the standard shooting position, the control system sends a shooting command to the camera.
[0143] 3) The camera obtains an image of the inner surface of the real-time segment with the features of the captured portion and two positioning holes as a real-time image.
[0144] In some embodiments, reference Fig.10 , Step 5: Image processing and control parameter calculation to achieve alignment between the grabbing part of the assembly machine and the grabbed part on the real-time segment, specifically including:
[0145] After the camera obtains the real-time image information of the real-time segment, the assembly machine control system begins to use visual methods to solve the deviation parameters that need to be repaired for each actuator, and then controls the action of the actuator. The specific implementation method is as follows:
[0146] 1) Using image processing methods to process the real-time image B, extracting features such as the grasped part and two positioning holes;
[0147] 2) Compare the differences between the feature positions in the real-time image and the feature positions in the standard image;
[0148] 3) Combine the camera's intrinsic parameter matrix and focal length and other pre-set parameters to calculate the displacement deviation D between the features on the Y axis; the real-time image is compared with the standard image to solve the displacement deviation D on the Y axis, referring to Fig.12 ;
[0149] 4) Using 90% of the displacement deviation as the control amount, calculate the circumferential displacement required by the circumferential rotation mechanism of the assembly machine;
[0150] 5) The control system sends the action instructions of the circumferential rotating mechanism and the displacement required to the assembly machine;
[0151] 6) The circumferential rotating mechanism completes the action;
[0152] 7) Obtaining a new real-time image of the inner surface of the real-time segment at the position where the camera is located at this time;
[0153] 8) Perform image processing to determine whether the straight line formed by the captured portion and the centers of the two positioning holes is perpendicular to the edges of both sides of the entire image;
[0154] That is, it is ensured that in the top view of the camera and the segment, the camera is located on the "plane passing through the line connecting the three and perpendicular to the inner surface of the segment", that is, the camera realizes the alignment operation of the three, that is, it is ensured that the grasping part under the segment clamping plate is aligned with the grasped part on the segment, that is, in the top view, the grasped part, the two positioning holes, the grasping part, and the camera are all on the plane where Y=0 in the coordinate system.
[0155] 9) If it is not vertical, repeat steps 1) to 8);
[0156] 10) If it is vertical or vertical within an acceptable set error threshold, the alignment operation is completed, and the alignment operation between the grasping part and the grasped part is completed.
[0157] In some embodiments, see Fig.11 , Step 6: The assembly machine realizes real-time segment grabbing, which includes:
[0158] After the grabbing part and the grabbed part are aligned in the Y dimension of the spatial coordinate system (i.e. their spatial coordinates Y are consistent), the assembly machine starts to perform the segment grabbing operation. The specific process is as follows:
[0159] 1) The assembly machine moves 2M / 3 along the negative direction of the X-axis through the axial translation mechanism;
[0160] 2) The assembly machine realizes continuous descent P along the negative direction of the Z axis through the radial translation mechanism, where P is the stepping distance and P is less than L;
[0161] 3) According to the parameters of the four ranging sensors, the radial telescopic mechanism of the assembly machine, the pitch mechanism of the clamping plate, and the deflection mechanism of the clamping plate are controlled to level the clamping plate;
[0162] 4) judging whether the readings of the four distance measuring sensors are consistent through the readings of the four distance measuring sensors, and if they are inconsistent, continuing to level the clamping plate through the radial telescopic mechanism, the pitch mechanism of the clamping plate, and the deflection mechanism of the clamping plate;
[0163] 5) If they are consistent, further determine whether the readings of the four distance measuring sensors are within a certain threshold range of L. If they are not within the certain threshold range of L, return to step 2) control the radial translation mechanism to continue to descend P;
[0164] 6) If the readings of the four distance measuring sensors are L within a certain threshold range, it means that the clamping plate and the inner surface of the segment are in a relatively parallel state, and the distance between the clamping plate and the real segment is equal to the distance between the clamping plate and the standard segment in the standard gripping position within a certain threshold range;
[0165] 7) The axial translation mechanism of the assembly machine is activated, and the assembly machine moves along the negative direction of the X axis. During the translation process, it is determined whether the captured part of the real-time segment triggers the photoelectric switch. If the photoelectric switch is not triggered, it continues to move along the negative direction of the X axis. If the photoelectric switch is triggered, the trigger signal is sent to the control system;
[0166] 8) The control system sends a command, and the axial translation mechanism of the assembly machine moves and translates the specified distance K (the installation position of the photoelectric switch is fixed. After the photoelectric switch is triggered by the grasping part, it moves 1M / 3 at this time. The distance for the grasping part to reach the accurate grasping position is also certain. This distance is K, which can be obtained at the standard grasping position). At this time, the grasping part translates to the accurate grasping position;
[0167] 9) The gripping part tensioning cylinder moves to tighten the gripped part of the real-time segment, completing the auxiliary positioning gripping process of the pipe area, and feeding back the signal to the control system;
[0168] 10) The control system further determines whether the grasping is successful. If the grasping is successful, the grasping is determined to be successful. If the grasping is not successful, the alignment of the grasping part and the grasped part in the Y dimension of the spatial coordinate system is further adjusted.
[0169] In some embodiments, the distance measuring instrument can also be replaced by a piezoresistive sensor of the support bar seat.
[0170] During the process of aligning the grabbing part of the assembly machine with the grabbed part and performing the pipe segment grabbing operation, the function of the ranging sensor is mainly to realize the leveling operation of the clamping plate. Therefore, the leveling of the clamping plate can be achieved by setting multiple piezoresistive sensors in the two support bar seats under the clamping plate.
[0171] In some embodiments, the photoelectric switch may also be replaced by a contact switch.
[0172] During the process of aligning the grabbing part of the assembly machine with the grabbed part and performing the pipe segment grabbing operation, the photoelectric switch can also be replaced by a contact switch.
[0173] refer to Fig.13 In some alternative embodiments, the method for positioning and grabbing a pipe segment by an assembling machine comprises the following steps:
[0174] 1) Alignment of the gripping part with the gripped part (alignment of the gripping part with the gripped part in the Y dimension of the spatial coordinate system);
[0175] 2) The axial translation mechanism of the assembly machine moves 2M / 3 along the negative direction of the X axis;
[0176] 3) The radial telescopic mechanism of the assembly machine extends along the negative direction of the Z axis;
[0177] 4) Determine whether the clamping plate support bar seat contacts the pipe segment, that is, determine whether the piezoresistive sensor has a trigger value; if there is no trigger value, return to step 3); if triggered, proceed to step 5);
[0178] 5) The pitch mechanism and the deflection mechanism of the clamping plate formulate actions according to the feedback values of multiple piezoresistive sensors to achieve leveling of the clamping plate;
[0179] 6) Determine whether the clamping plate is leveled (whether the pressure feedback values of multiple piezoresistive sensors in the support bar seat are consistent within a certain range), if not, return to step 5), if consistent, continue to step 7);
[0180] 7) The axial translation mechanism of the assembly machine moves along the negative direction of the X axis;
[0181] 8) Determine whether the contact switch is triggered. If not, return to step 7). If triggered, proceed to step 9);
[0182] 9) The grabbing part tightens the grabbed part to grab the pipe segment;
[0183] 10) Determine whether the crawling is successful; if the crawling is not successful, return to step 1). If the crawling is successful, determine that the crawling is successful.
[0184] The disclosed embodiment provides a gripping and positioning device for an assembler, and at the same time provides a method for correcting the deviation when positioning and gripping the pipe segment, thereby realizing automatic positioning and gripping of the pipe segment by the assembler, improving the efficiency of pipe segment assembly to a certain extent, improving the working conditions of tunnel excavation construction personnel, and providing technical reserves for realizing automated pipe segment assembly.
[0185] Some embodiments further provide an assembling machine configured to implement the above-mentioned method for positioning and grabbing pipe segments by the assembling machine.
[0186] Some embodiments further provide a tunnel boring machine, which includes the above-mentioned assembling machine.
[0187] The tunnel boring machines include tunnel boring machines, such as hard rock tunnel boring machines (TBMs) and soft ground tunnel boring machines (shield machines).
[0188] Based on the above-mentioned embodiments of the present invention, unless explicitly denied, the technical features of one embodiment may be beneficially combined with one or more other embodiments.
[0189] Although some specific embodiments of the present invention have been described in detail by way of examples, it should be understood by those skilled in the art that the above examples are for illustration only and are not intended to limit the scope of the present invention. It should be understood by those skilled in the art that the above embodiments may be modified or some technical features may be replaced by equivalents without departing from the scope and spirit of the present invention. The scope of the present invention is defined by the appended claims.
Claims
1. A method for positioning and grabbing pipe segments by an assembling machine, characterized in that: The following steps are involved: S10: The assembly machine is positioned to grab the standard segment successfully. At this time, the position of the assembly machine is the standard grabbing position, and an OXYZ coordinate system is established, wherein the X-axis is parallel to the excavation direction of the tunnel boring machine with the assembly machine, the Y-axis is perpendicular to the X-axis, and the Y-axis and the X-axis are located in the same horizontal plane, and the Z-axis is perpendicular to the X-axis and the Y-axis, and the Z-axis is in the vertical direction; S20: causing the assembling machine to release the standard segment, and causing the assembling machine to carry a camera disposed thereon to move along the X-axis in a positive direction by a first distance threshold, and along the Z-axis in a positive direction by a second distance threshold, to reach a standard shooting position, causing the camera to shoot the standard segment as a standard image, and recording the standard telescopic parameters of each cylinder driving the assembling machine at this time; S30: Restoring each oil cylinder to an initial state; S31: collecting real-time segment information through the camera and transmitting it to the control system, the control system compares the real-time segment information with preset information therein, and when the real-time segment information is consistent with the preset information, controls the execution of step S40, and when the real-time segment information is inconsistent with the preset information, issues a warning; S40: causing each oil cylinder to extend and retract from the initial state according to the standard extension and retraction parameters to reach a standard shooting position, and then causing the camera to shoot a real-time segment as a real-time image; S50: comparing the real-time image with the standard image, and adjusting the coordinate of the assembling machine on the Y axis so that the coordinate of the assembling machine on the Y axis is consistent with the coordinate of the real-time segment on the Y axis; as well as S60: The assembling machine is moved from the current position to the accurate grabbing position to grab the real-time pipe segment.
2. The method for positioning and grabbing pipe segments by an assembling machine according to claim 1, characterized in that: The standard pipe segment is provided with a grasped portion for being grasped by the assembly machine, and positioning holes are respectively provided on both sides of the grasped portion. When the camera is in the standard shooting position, the camera, the grasped portion and the two positioning holes form a plane perpendicular to the horizontal plane, and the grasped portion and the two positioning holes are included in the standard image.
3. The method for positioning and grabbing pipe segments by an assembling machine according to claim 1, characterized in that: In step S60, the assembling machine is moved from the current position to the accurate grasping position, including: Move the assembling machine in the negative direction of the X-axis by a first distance, wherein the first distance is less than the first distance threshold; Move the assembling machine in the negative direction along the Z axis until the assembling machine reaches the accurate grasping position on the Z axis; and The assembling machine is made to continue to move in the negative direction along the X-axis until the assembling machine reaches the accurate grasping position on the X-axis.
4. The method for positioning and grabbing pipe segments by an assembling machine as claimed in claim 3, characterized in that: The step of causing the assembling machine to move in the negative direction along the Z axis until the assembling machine reaches the accurate grasping position on the Z axis includes: while causing the assembling machine to move in the negative direction along the Z axis, detecting by a first sensor arranged on the assembling machine until the detection value of the first sensor is equal to the detection value of the first sensor when the assembling machine is at the standard grasping position in step S10.
5. The method for positioning and grabbing pipe segments by an assembling machine as claimed in claim 3, characterized in that: The step of causing the assembling machine to continue to move in the negative direction of the X-axis until the assembling machine reaches the accurate grasping position on the X-axis includes: during the process of the assembling machine continuing to move in the negative direction of the X-axis, until a second sensor arranged on the assembling machine detects a grasped portion arranged on the real-time pipe segment for being grasped by the assembling machine.
6. The method for positioning and grabbing pipe segments by an assembling machine according to claim 1, characterized in that: The initial state includes a state where the stroke of each cylinder is zero.
7. The method for positioning and grabbing pipe segments by an assembling machine according to claim 1, characterized in that: The movement of the assembling machine along the X-axis is achieved through linear motion; the movement of the assembling machine along the Y-axis is achieved through rotational motion; and the movement of the assembling machine along the Z-axis is achieved through linear motion.
8. The method for positioning and grabbing pipe segments by an assembling machine according to claim 1, characterized in that: The real-time pipe segment is provided with a grasped portion for being grasped by the assembling machine, and positioning holes are respectively provided on both sides of the grasped portion. The real-time image includes the grasped portion and the two positioning holes.
9. The method for positioning and grabbing pipe segments by an assembling machine according to claim 1, characterized in that: The information of the real-time segment includes the type of the real-time segment, the placement direction of the real-time segment, or the outline of the real-time segment.
10. An assembling machine, characterized in that: It is configured to implement the method for positioning and grabbing pipe segments of an assembling machine as described in any one of claims 1 to 9.
11. A tunnel boring machine, characterized in that: Comprising the assembling machine as described in claim 10.
Citation Information
Patent Citations
Automatic vision platform grasping method and system for shield tunneling segment assembling machine
CN107152295A
Automatic identifying and grabbing device for tunnel segments and method thereof
CN107449383A
Tunnel segment assembly method, device and system and heading machine
CN112253167A
Duct piece real-time positioning system and rapid assembling method
CN113847043A
Training device for assembling segment
JP2000265794A
