A registration method, system and device for free-form surface wear model
Through the combination of line laser sensors and robotics, the normal differential factor segmentation and least squares method are used to accurately register the free surface wear model, which solves the problem that traditional technology is difficult to efficiently identify and align free surface wear, and achieves accurate wear Positioning and repair support.
Patent Information
- Application Number
- CN202411262110.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-09-10
- Publication Date
- 2024-11-19
- Estimated Expiration
- 2044-09-10
Smart Images

Figure CN118776462B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of precision measurement technology, and in particular to a registration method, system and device for a free-form surface wear model. Background Art
[0002] Free-form surfaces are widely used in aerospace, automotive, and mold industries due to their smooth appearance and good aerodynamic properties. Wear on the free-form surfaces of core parts will lead to performance degradation. If the worn parts of the free-form surfaces can be accurately repaired, the core parts can be avoided from being scrapped, thereby saving the cost of purchasing new parts and equipment downtime.
[0003] Since the surface shape of free-form surfaces is more complex than that of planes and rotational bodies, there are many difficulties in locating the wear position and measuring the wear amount:
[0004] Traditional coordinate measuring machines (CMMs) cannot efficiently acquire a large number of sampling points on free-form surfaces because they use discrete point sampling. Therefore, they cannot meet the needs of industrial applications and are difficult to integrate with repair processing systems.
[0005] Compared with the original standard model, the outer dimensions and surface morphology of the worn workpiece will change significantly. Directly aligning the scanned model without identifying and processing defects will not guarantee the alignment accuracy in the free-form surface wear repair scenario.
[0006] The patent application with the publication number CN111504223B, entitled "A method, device and system for measuring blade profile based on line laser sensor", discloses a method for directly and integrally registering the scanned point cloud with the standard model by the least squares method. However, this method does not take into account the huge changes in the external dimensions and surface morphology of the parts after wear, which will have a significant impact on the model alignment results, and therefore cannot guarantee the alignment accuracy in the free-form surface wear repair scenario. Summary of the invention
[0007] The object of the present invention is to provide a registration method, system and device for a free-form surface wear model to solve at least one of the above-mentioned technical problems existing in the prior art.
[0008] In a first aspect, in order to solve the above technical problems, the present invention provides a registration method for a free-form surface wear model, comprising the following steps:
[0009] Step 1: A line laser sensor is configured at the end of a robot arm used for repairing and processing a free-form surface to scan the surface; the line laser sensor is used to synchronously collect contour information of several groups of calibration balls when changing the position and posture of the end of the robot arm; a first transformation matrix between the robot arm and the line laser sensor is obtained through matrix operation, thereby completing hand-eye calibration;
[0010] Step 2: drive the robot to scan the measured part at preset multi-angles to obtain the two-dimensional contour information of the measured part at different angles and the position and posture information of the end of the robot; and based on the first transformation matrix, convert these two-dimensional contour information to the robot base coordinate system in real time, and splice and construct a three-dimensional scanning model of the free-form surface; in this way, the three-dimensional scanning model of the free-form surface in the measured part can be obtained quickly and accurately;
[0011] Step 3, preprocessing the three-dimensional scanning model; traversing and calculating the normal differential factor of each scanning point, so as to effectively characterize the surface curvature change of the three-dimensional scanning model; the normal differential factor includes the normal vectors of the neighboring points of two different adjacent radii of the current scanning point;
[0012] Step 4, determine whether the normal differential factor is less than a preset threshold: if so, it means that the normal vectors of the neighboring points of two different adjacent radii are similar in size and distributed continuously, and the current scanning point is determined to be in the unworn area; if not, it means that the normal vectors of the neighboring points of two different adjacent radii are greatly different in size and distributed discontinuously, and the current scanning point is determined to be in the worn area; in this way, the scanning point cloud can be adaptively divided into unworn areas and worn areas according to the significant differences in the normal differential factors of different areas on the free surface, thereby realizing accurate identification of the worn area;
[0013] Step 5: assigning different weights to the unworn area and the worn area, so as to use the unworn area as the primary alignment reference area and the worn area as the secondary alignment reference area; based on the weights, calculating the matching error between the three-dimensional scanning model and the specified area of the original standard model of the measured part; iteratively calculating the optimal second transformation matrix between the two models by the least squares method, and after obtaining the minimum matching error, determining the relative position between the two models after surface alignment;
[0014] Through the above steps, the robot arm in the repair processing system can be simply modified to realize the three-dimensional laser scanning function; the three-dimensional scanned model of the measured part can be segmented and accurately aligned with the original standard model through the normal differential factor, so as to obtain an accurate free-form surface wear model, and the free-form surface wear model can be directly stored in the repair processing system, which is convenient for subsequent efficient wear measurement, wear positioning and free-form surface repair work.
[0015] In a feasible implementation, the communication method for configuring the line laser sensor in step 1 is: based on a dual-port industrial controller, periodic communication is established with the line laser sensor through the TCP / IP protocol, and periodic communication is established with the robot arm through the EtherCAT protocol.
[0016] In a feasible implementation manner, the specific steps of collecting contour information of several groups of calibration balls in step 1 are:
[0017] Step 11: fix the posture of the end of the robot arm, change the position of the end of the robot arm, and collect the contour information of the calibration ball;
[0018] Step 12: Simultaneously change the position and posture of the end of the robot arm to collect the contour information of the calibration ball.
[0019] In a feasible implementation manner, the specific formula of the first transformation matrix in step 1 may be:
[0020] ;
[0021] in, Indicate point In the robot base coordinate system The three-dimensional coordinate values in ; represents the posture matrix of the robot end, and the robot end coordinate system is defined as ; Represents the position matrix of the end of the robot hand; Represents the first rotation transformation matrix from the robot to the line laser sensor; Represents the first translation transformation matrix from the robot arm to the line laser sensor; Indicate point Online laser sensor coordinate system The three-dimensional coordinate values in .
[0022] In a feasible implementation manner, the specific formula of the first transformation matrix can be simplified as follows:
[0023] .
[0024] In a feasible implementation, the preprocessing method in step 3 includes point cloud sparseness and noise reduction processing.
[0025] In a feasible implementation manner, the specific formula for calculating the normal differential factor in step 3 may be:
[0026] ;
[0027] in, represents the normal differential factor; Indicates Scan points; and represents two adjacent radii of different sizes, and ; express In adjacent radius Normal vector of the neighboring point at ; express In adjacent radius The normal vector of the neighboring point at .
[0028] In a feasible implementation manner, the specific formula for calculating the matching error between the three-dimensional scanning model and the original standard model of the measured part in step 5 may be:
[0029] ;
[0030] in, Represents a 3D scanned model and the original Standard Model The matching error between Indicates The scanning point and The weight between the original points; Indicates The scanning point and The distance between the original points; Indicates The three-dimensional coordinates of the scanning points; Indicates The three-dimensional coordinates of the original point; Represents a 3D scanned model Previous scan point and the original Standard Model Any original point The corresponding matching relationship between them can be expressed as follows:
[0031] .
[0032] In a feasible implementation manner, in step 5, the specific formula for calculating the minimum matching error may be:
[0033] ;
[0034] in, The optimal second transformation matrix between the three-dimensional scanning model and the original standard model of the measured part includes a second translation transformation matrix and a second rotation transformation matrix; Indicates the total number of transformations; Indicates The second transformation matrix for the second transformation;
[0035] The above calculation formula for matching error can solve the problem of accurate alignment between the wear model and the original standard model in the free-form surface wear repair scenario.
[0036] In a feasible implementation, the registration method further includes step 6, which specifically includes:
[0037] Step 61: Select the 3D scan model Take any point as the target point and traverse and calculate the original standard model The distances between all points on the target point and the minimum value of these distances is taken as the wear amount of the target point ;
[0038] Step 62: Iteratively select 3D scan model The remaining points on the image are taken as target points, and step 61 is executed until there are no remaining points, and the distribution data of the wear amount is obtained, thereby completing the quantification and positioning of the wear amount.
[0039] In the second aspect, based on the same inventive concept, the present application also provides a registration system for a free-form surface wear model, including a data receiving module, a data processing module and a result generating module;
[0040] The data receiving module is used to receive the contour information of the calibration ball collected by the line laser sensor, the two-dimensional contour information of the measured part, and the position and posture information of the end of the robot where the line laser sensor is located;
[0041] The data processing module includes a hand-eye calibration unit, a three-dimensional scanning model unit, a normal differential factor unit, a wear segmentation unit and a surface alignment unit;
[0042] The hand-eye calibration unit obtains a first transformation matrix between the robot and the line laser sensor through matrix calculation based on the contour information of the calibration ball and the position and posture information of the corresponding robot end at different robot end positions and postures;
[0043] The three-dimensional scanning model unit, based on the two-dimensional contour information of the measured part at different angles and the corresponding position and posture information of the end of the robot arm, converts these two-dimensional contour information into the robot arm base coordinate system in real time through a first transformation matrix, and splices and constructs a three-dimensional scanning model of the free-form surface;
[0044] The normal differential factor unit pre-processes the three-dimensional scanning model; traverses and calculates the normal differential factor of each scanning point; the normal differential factor includes the normal vectors of the neighboring points of the current scanning point with two adjacent radii of different sizes;
[0045] The wear segmentation unit determines whether the normal differential factor is less than a preset threshold value: if so, it is determined that the current scanning point is in an unworn area; if not, it is determined that the current scanning point is in a worn area;
[0046] The surface alignment unit assigns different weights to the unworn area and the worn area, so as to use the unworn area as the primary alignment reference area and the worn area as the secondary alignment reference area; based on the weights, calculates the matching error between the three-dimensional scanning model and the designated area of the original standard model pre-stored in the measured part; iteratively calculates the optimal second transformation matrix between the two models through the least square method, and after obtaining the minimum matching error, determines the relative position between the two models after surface alignment;
[0047] The result generation module is used to send out the three-dimensional scanning model.
[0048] In a feasible implementation manner, the data processing module further includes a wear amount distribution unit, which is used to select any point on the three-dimensional scanning model as a target point, traverse and calculate the distances between all points on the original standard model and the target point, and use the minimum value of these distances as the wear amount of the target point; and obtain the distribution data of the wear amount of all points after iterative calculation;
[0049] The result generation module also sends out the distribution data of the wear amount.
[0050] On the third aspect, based on the same inventive concept, the present application also provides a free-form surface wear model alignment device, including a processor, a memory and a bus, wherein the memory stores instructions and data that can be read by the processor, and the processor is used to call the instructions and data in the memory to execute the free-form surface wear model alignment method as described above, and the bus connects the functional components for transmitting information.
[0051] In a feasible implementation, the alignment device further includes a line laser sensor, which is disposed at the end of a robot arm used for repairing and processing free-form surfaces and is used for scanning the surfaces.
[0052] By adopting the above technical solution, the present invention has the following beneficial effects:
[0053] The present invention provides a registration method, system and device for a free-form surface wear model, which realize the function of real-time communication between a line laser sensor and a robot arm system through an industrial computer; based on hand-eye calibration, the purpose of online reverse reconstruction of the free-form surface is achieved; a normal differential factor is designed to adaptively segment the three-dimensional scanning model, and a segmentation weighted least squares registration method is proposed based on the segmentation result, so that when the workpiece to be measured undergoes wear dimensional deformation and surface morphology changes, the model can be accurately registered, and the accurate wear amount and wear location can be calculated, thereby providing a reliable repair model for subsequent free-form surface intelligent repair work. BRIEF DESCRIPTION OF THE DRAWINGS
[0054] In order to more clearly illustrate the specific implementation methods of the present invention or the technical solutions in the prior art, the drawings required for use in the specific implementation methods or the description of the prior art will be briefly introduced below. Obviously, the drawings in the following description are some implementation methods of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.
[0055] Figure 1 A flow chart of a registration method for a free-form surface wear model provided by an embodiment of the present invention;
[0056] Figure 2 A diagram illustrating a communication method provided by an embodiment of the present invention;
[0057] Figure 3 A diagram illustrating a coordinate system provided in an embodiment of the present invention;
[0058] Figure 4 A schematic diagram of a normal differential factor provided by an embodiment of the present invention;
[0059] Figure 5 A registration system diagram of a free-form surface wear model provided by an embodiment of the present invention;
[0060] Figure 6 An example diagram of double-ball precision measurement results provided by an embodiment of the present invention;
[0061] Figure 7 An example diagram of the registration process of the blade wear model provided in an embodiment of the present invention;
[0062] Figure 8 A color example diagram of the normal differential factor distribution provided by an embodiment of the present invention;
[0063] Fig. 9 A color comparison diagram of wear distribution provided in an embodiment of the present invention. DETAILED DESCRIPTION
[0064] The technical solution of the present invention will be described clearly and completely below in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
[0065] In the description of the present invention, it should be noted that the terms "center", "upper", "lower", "left", "right", "vertical", "horizontal", "inner", "outer", etc., indicating the orientation or positional relationship, are based on the orientation or positional relationship shown in the drawings, and are only for the convenience of describing the present invention and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore cannot be understood as limiting the present invention. In addition, the terms "first", "second", and "third" are used for descriptive purposes only, and cannot be understood as indicating or implying relative importance.
[0066] In the description of the present invention, it should be noted that, unless otherwise clearly specified and limited, the terms "installed", "connected", and "connected" should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection, or it can be indirectly connected through an intermediate medium, or it can be the internal communication of two components. For ordinary technicians in this field, the specific meanings of the above terms in the present invention can be understood according to specific circumstances.
[0067] The present invention is further explained below in conjunction with specific implementation modes.
[0068] It should also be noted that the following specific embodiments or specific implementations are a series of optimized settings listed in the present invention to further explain the specific content of the invention, and these settings can be used in combination or in association with each other.
[0069] Embodiment 1:
[0070] like Figure 1 As shown, the present embodiment provides a registration method for a free-form surface wear model, comprising the following steps:
[0071] Step 1: A line laser sensor is configured at the end of a robot arm used for repairing and processing a free-form surface to scan the surface; the line laser sensor is used to synchronously collect contour information of several groups of calibration balls when changing the position and posture of the end of the robot arm; a first transformation matrix between the robot arm and the line laser sensor is obtained through matrix operation, thereby completing hand-eye calibration;
[0072] Step 2: drive the robot to scan the measured part at preset multi-angles to obtain the two-dimensional contour information of the measured part at different angles and the position and posture information of the end of the robot; and based on the first transformation matrix, convert these two-dimensional contour information to the robot base coordinate system in real time, and splice and construct a three-dimensional scanning model of the free-form surface; in this way, the three-dimensional scanning model of the free-form surface in the measured part can be obtained quickly and accurately;
[0073] Step 3, preprocessing the three-dimensional scanning model; traversing and calculating the normal differential factor of each scanning point, so as to effectively characterize the surface curvature change of the three-dimensional scanning model; the normal differential factor includes the normal vectors of the neighboring points of two different adjacent radii of the current scanning point;
[0074] Step 4, determine whether the normal differential factor is less than a preset threshold: if so, it means that the normal vectors of the neighboring points of two different adjacent radii are similar in size and distributed continuously, and the current scanning point is determined to be in the unworn area; if not, it means that the normal vectors of the neighboring points of two different adjacent radii are greatly different in size and distributed discontinuously, and the current scanning point is determined to be in the worn area; in this way, the scanning point cloud can be adaptively divided into unworn areas and worn areas according to the significant differences in the normal differential factors of different areas on the free surface, thereby realizing accurate identification of the worn area;
[0075] Step 5: assigning different weights to the unworn area and the worn area, so as to use the unworn area as the primary alignment reference area and the worn area as the secondary alignment reference area; based on the weights, calculating the matching error between the three-dimensional scanning model and the specified area of the original standard model of the measured part; iteratively calculating the optimal second transformation matrix between the two models by the least squares method, and after obtaining the minimum matching error, determining the relative position between the two models after surface alignment;
[0076] Through the above steps, the 3D scan model of the measured part can be segmented and accurately aligned with the original standard model through 3D scanning and other methods, so as to obtain an accurate free-form surface wear model, and the free-form surface wear model can be directly stored in the repair processing system to facilitate subsequent efficient wear measurement, wear positioning and free-form surface repair work.
[0077] Furthermore, the communication method for configuring the line laser sensor in step 1 is: based on the dual-port industrial controller, establish periodic communication with the line laser sensor through the TCP / IP protocol, and establish periodic communication with the robot through the EtherCAT protocol, such as Figure 2 shown.
[0078] Furthermore, the specific steps of collecting the contour information of several groups of calibration balls are as follows:
[0079] Step 11: fix the posture of the end of the robot arm, change the position of the end of the robot arm, and collect the contour information of the calibration ball;
[0080] Step 12: Simultaneously change the position and posture of the end of the robot arm to collect the contour information of the calibration ball.
[0081] Furthermore, the specific formula of the first transformation matrix in step 1 may be:
[0082] ;
[0083] in, Indicate point In the robot base coordinate system The three-dimensional coordinate values in ; represents the posture matrix of the robot end, and the robot end coordinate system is defined as ; Represents the position matrix of the end of the robot hand; Represents the first rotation transformation matrix from the robot to the line laser sensor; Represents the first translation transformation matrix from the robot arm to the line laser sensor; Indicate point Online laser sensor coordinate system The three-dimensional coordinate values in Figure 3 shown.
[0084] Furthermore, the specific formula of the first transformation matrix can be simplified as follows:
[0085] .
[0086] Furthermore, the preprocessing method in step 3 includes point cloud sparseness and noise reduction processing.
[0087] Furthermore, the specific formula for calculating the normal differential factor in step 3 can be:
[0088] ;
[0089] in, represents the normal differential factor; Indicates Scan points; and represents two adjacent radii of different sizes, and ; express In adjacent radius Normal vector of the neighboring point at ; express In adjacent radius The normal vector of the neighboring point at , such as Figure 4 shown.
[0090] Furthermore, the specific formula for calculating the matching error between the three-dimensional scanning model and the original standard model of the measured part in step 5 can be:
[0091] ;
[0092] in, Represents a 3D scanned model and the original Standard Model The matching error between Indicates The scanning point and The weights between the original points; Indicates The scanning point and The distance between the original points; Indicates The three-dimensional coordinates of the scanning points; Indicates The three-dimensional coordinates of the original point; Represents a 3D scanned model Previous scan point and the original Standard Model Any original point The corresponding matching relationship between them can be expressed as follows:
[0093] .
[0094] Furthermore, in step 5, the specific formula for calculating the minimum matching error may be:
[0095] ;
[0096] in, The optimal second transformation matrix between the three-dimensional scanning model and the original standard model of the measured part includes a second translation transformation matrix and a second rotation transformation matrix; Indicates the total number of transformations; Indicates The second transformation matrix for the second transformation.
[0097] Furthermore, the registration method further includes step 6, which specifically includes:
[0098] Step 61: Select the 3D scan model Take any point as the target point and traverse and calculate the original standard model The distances between all points on the target point and the minimum value of these distances is taken as the wear amount of the target point ;
[0099] Step 62: Iteratively select 3D scan model The remaining points on the image are taken as target points, and step 61 is executed until there are no remaining points, and the distribution data of the wear amount is obtained, thereby completing the quantification and positioning of the wear amount.
[0100] Embodiment 2:
[0101] like Figure 5 As shown, this embodiment provides a registration system for a free-form surface wear model, including a data receiving module, a data processing module and a result generating module;
[0102] The data receiving module is used to receive the contour information of the calibration ball collected by the line laser sensor, the two-dimensional contour information of the measured part, and the position and posture information of the end of the robot where the line laser sensor is located;
[0103] The data processing module includes a hand-eye calibration unit, a three-dimensional scanning model unit, a normal differential factor unit, a wear segmentation unit and a surface alignment unit;
[0104] The hand-eye calibration unit obtains a first transformation matrix between the robot and the line laser sensor through matrix calculation based on the contour information of the calibration ball and the position and posture information of the corresponding robot end at different robot end positions and postures;
[0105] The three-dimensional scanning model unit, based on the two-dimensional contour information of the measured part at different angles and the corresponding position and posture information of the end of the robot arm, converts these two-dimensional contour information into the robot arm base coordinate system in real time through a first transformation matrix, and splices and constructs a three-dimensional scanning model of the free-form surface;
[0106] The normal differential factor unit pre-processes the three-dimensional scanning model; traverses and calculates the normal differential factor of each scanning point; the normal differential factor includes the normal vectors of the neighboring points of the current scanning point with two adjacent radii of different sizes;
[0107] The wear segmentation unit determines whether the normal differential factor is less than a preset threshold value: if so, it is determined that the current scanning point is in an unworn area; if not, it is determined that the current scanning point is in a worn area;
[0108] The surface alignment unit assigns different weights to the unworn area and the worn area, so as to use the unworn area as the primary alignment reference area and the worn area as the secondary alignment reference area; based on the weights, calculates the matching error between the three-dimensional scanning model and the designated area of the original standard model pre-stored in the measured part; iteratively calculates the optimal second transformation matrix between the two models through the least square method, and after obtaining the minimum matching error, determines the relative position between the two models after surface alignment;
[0109] The result generation module is used to send out the three-dimensional scanning model.
[0110] Furthermore, the data processing module also includes a wear amount distribution unit, which is used to select any point on the three-dimensional scanning model as a target point, traverse and calculate the distances between all points on the original standard model and the target point, and use the minimum value of these distances as the wear amount of the target point; after iterative calculation, the distribution data of the wear amount of all points is obtained;
[0111] The result generation module also sends out the distribution data of the wear amount.
[0112] Embodiment three:
[0113] The present embodiment provides a free-form surface wear model alignment device, including a processor, a memory and a bus, wherein the memory stores instructions and data that can be read by the processor, the processor is used to call the instructions and data in the memory to execute the free-form surface wear model alignment method as described above, and the bus connects the functional components for transmitting information.
[0114] Furthermore, the alignment device also includes a line laser sensor, which is arranged at the end of a robot arm used for repairing and processing free-form surfaces and is used for scanning the surfaces.
[0115] In another embodiment, the present solution can be implemented by an integrated device, which may include corresponding modules for performing each or several steps in the above-mentioned embodiments. The module may be one or more hardware modules specially configured to perform the corresponding steps, or implemented by a processor configured to perform the corresponding steps, or stored in a computer-readable medium for implementation by a processor, or implemented by some combination.
[0116] The processor performs the various methods and processes described above. For example, the method implementation in the present solution can be implemented as a software program, which is tangibly contained in a machine-readable medium, such as a memory. In some embodiments, part or all of the software program can be loaded and / or installed via a memory and / or a communication interface. When the software program is loaded into the memory and executed by the processor, one or more steps in the method described above can be executed. Alternatively, in other embodiments, the processor can be configured to perform one of the above methods by any other appropriate means (for example, by means of firmware).
[0117] The device can be implemented using a bus architecture. The bus architecture can include any number of interconnecting buses and bridges, depending on the specific application and overall design constraints of the hardware. The bus connects various circuits including one or more processors, memories, and / or hardware modules together. The bus can also connect various other circuits such as peripherals, voltage regulators, power management circuits, external antennas, etc.
[0118] The bus can be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, or an Extended Industry Standard Component (EISA) bus, etc. The bus can be divided into an address bus, a data bus, a control bus, etc.
[0119] Embodiment 4:
[0120] In order to verify the effectiveness of this solution, taking the turbine guide worn blade as an example, an experimental verification is carried out based on the method in Example 1.
[0121] Experimental platform construction:
[0122] Fix the line laser sensor to the end of the robot arm through the flange device;
[0123] Select the upper left, lower left, upper right, lower right and center of the square workbench of the robot as sampling points;
[0124] Hand-eye calibration is performed using standard calibration balls (single ball and double ball).
[0125] Through the method in step 11-step 12, the contour information of multiple groups of calibration balls (single balls) is collected; through matrix operation, such as least squares iteration, hand-eye calibration is completed to obtain a first transformation matrix, including:
[0126] The first rotation transformation matrix:
[0127] ;
[0128] The first translation transformation matrix:
[0129] .
[0130] Preferably, in order to verify the measurement error of the device of this scheme after hand-eye calibration, the contour information of the calibration ball (double ball) is scanned at multiple angles through the method in step 12, and the position and posture information of the end of the robot hand is synchronously collected, and the two-dimensional contour discrete points are spliced online to form a three-dimensional point cloud surface and a three-dimensional scanning model; the diameter, spherical error and center distance of the calibration ball in the three-dimensional scanning model are measured by fitting to verify the measurement error after hand-eye calibration, such as Figure 6 The specific values are shown in Table 1:
[0131]
[0132] It can be seen from the data in Table 1 that the measurement error after hand-eye calibration in this scheme is small, and the hand-eye calibration method of this scheme is effective.
[0133] For ease of understanding, Figure 7 As shown, during the processing of each step, the wear scanning image of the blade (step 2), the normal differential factor distribution image (step 3), the wear segmentation image (step 4), the original standard model image (step 5), the point cloud discrete image (step 5), the region selection image (step 5), the surface alignment image (step 5) and the error analysis image (step 6) are intercepted.
[0134] Specifically, the normal differential factor distribution color example, such as Figure 8 As shown: the red area is the area with a larger value of the normal differential factor, and the main location where the blade actually wears is near the trailing edge. This area appears large red, and the surface normal changes intensively and sharply. A preset threshold can be given based on statistics of the experimental data, and the normal differential factor here is judged to exceed the preset threshold and determined as a wear area for subsequent repair processing.
[0135] Specifically, after registration, the average error between the measured 3D scanning model and the original standard model is 0.0591 mm, which can meet the accuracy requirements for wear repair by laser cladding processing.
[0136] Specifically, the wear distribution data is compared with the actual photos, such as Fig. 9 As shown, it can be seen that the segmented wear area is consistent with the wear area in the real object.
[0137] Preferably, the distribution data of the wear amount can be added to the three-dimensional scanning model to construct a repair object model, so that the robot arm can subsequently repair the worn blade according to the wear amount and wear position in the repair object model.
[0138] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or replace some or all of the technical features therein with equivalents. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present invention.
Claims
1. A registration method for a free-form surface wear model, characterized in that: include: Step 1: A line laser sensor is configured at the end of a robot arm used for repairing and processing a free-form surface to scan the surface; the line laser sensor is used to synchronously collect contour information of several groups of calibration balls when changing the position and posture of the end of the robot arm; and a first transformation matrix between the robot arm and the line laser sensor is obtained through matrix operation; Step 2: drive the robot to scan the measured part at preset multi-angles to obtain the two-dimensional contour information of the measured part at different angles and the position and posture information of the end of the robot; and based on the first transformation matrix, convert these two-dimensional contour information to the robot base coordinate system in real time, and splice and construct a three-dimensional scanning model of the free-form surface; Step 3, preprocessing the three-dimensional scanning model; traversing and calculating the normal differential factor of each scanning point; the normal differential factor includes the normal vectors of two neighboring points of the current scanning point with adjacent radii of different sizes; Step 4, determining whether the normal differential factor is less than a preset threshold: if so, determining that the current scanning point is in an unworn area; if not, determining that the current scanning point is in a worn area; Step 5: assigning different weights to the unworn area and the worn area, so as to use the unworn area as the primary alignment reference area and the worn area as the secondary alignment reference area; Based on the weight, the matching error between the three-dimensional scanning model and the specified area of the original standard model of the measured part is calculated; the optimal second transformation matrix between the two models is iteratively calculated through the least squares method, and after the minimum matching error is obtained, the relative position between the two models after surface alignment is determined.
2. The registration method according to claim 1, characterized in that: The communication method for configuring the line laser sensor in step 1 is: based on a dual-network-port industrial controller, periodic communication is established with the line laser sensor through the TCP / IP protocol, and periodic communication is established with the robot arm through the EtherCAT protocol.
3. The registration method according to claim 1, characterized in that: The specific steps of collecting the contour information of several groups of calibration balls in step 1 are: Step 11: fix the posture of the end of the robot arm, change the position of the end of the robot arm, and collect the contour information of the calibration ball; Step 12: Simultaneously change the position and posture of the end of the robot arm to collect the contour information of the calibration ball.
4. The registration method according to claim 1, characterized in that: The specific formula of the first transformation matrix in step 1 is: ; in, Indicate point In the robot base coordinate system The three-dimensional coordinate values in ; represents the posture matrix of the robot end, and the robot end coordinate system is defined as ; Represents the position matrix of the end of the robot hand; Represents the first rotation transformation matrix from the robot to the line laser sensor; Represents the first translation transformation matrix from the robot arm to the line laser sensor; Indicate point Online laser sensor coordinate system The three-dimensional coordinate values in .
5. The registration method according to claim 1, characterized in that: The specific formula for calculating the normal differential factor in step 3 is: ; in, represents the normal differential factor; Indicates Scan points; and represents two adjacent radii of different sizes, and ; express In adjacent radius Normal vector of the neighboring point at ; express In adjacent radius The normal vector of the neighboring point at .
6. The registration method according to claim 1, characterized in that: The specific formula for calculating the matching error between the three-dimensional scanning model and the original standard model of the measured part in step 5 is: ; in, Represents a 3D scanned model and the original Standard Model The matching error between Indicates The scanning point and The weight between the original points; Indicates The scanning point and The distance between the original points; Indicates The three-dimensional coordinates of the scanning points; Indicates The three-dimensional coordinates of the original point; Represents a 3D scanned model Previous scan point and the original Standard Model Any original point The corresponding matching relationship between them is as follows: 。 7. The registration method according to claim 6, characterized in that: In step 5, the specific formula for calculating the minimum matching error is: ; in, The optimal second transformation matrix between the three-dimensional scanning model and the original standard model of the measured part includes a second translation transformation matrix and a second rotation transformation matrix; Indicates the total number of transformations; Indicates The second transformation matrix for the second transformation.
8. The registration method according to claim 6, characterized in that: The registration method further comprises step 6, which specifically comprises: Step 61: Select the 3D scan model Take any point as the target point and traverse and calculate the original standard model The distances between all points on the target point and the minimum value of these distances is taken as the wear amount of the target point ; Step 62: Iteratively select the 3D scan model The remaining points on are taken as target points, and step 61 is executed until there are no remaining points, thereby obtaining the distribution data of the wear amount.
9. A registration system for a free-form surface wear model, characterized in that: It includes a data receiving module, a data processing module and a result generating module; The data receiving module is used to receive the contour information of the calibration ball collected by the line laser sensor, the two-dimensional contour information of the measured part, and the position and posture information of the end of the robot where the line laser sensor is located; The data processing module includes a hand-eye calibration unit, a three-dimensional scanning model unit, a normal differential factor unit, a wear segmentation unit and a surface alignment unit; The hand-eye calibration unit obtains a first transformation matrix between the robot and the line laser sensor through matrix calculation based on the contour information of the calibration ball and the position and posture information of the corresponding robot end at different robot end positions and postures; The three-dimensional scanning model unit, based on the two-dimensional contour information of the measured part at different angles and the corresponding position and posture information of the end of the robot arm, converts these two-dimensional contour information into the robot arm base coordinate system in real time through a first transformation matrix, and splices and constructs a three-dimensional scanning model of the free-form surface; The normal differential factor unit pre-processes the three-dimensional scanning model; traverses and calculates the normal differential factor of each scanning point; the normal differential factor includes the normal vectors of the neighboring points of the current scanning point with two adjacent radii of different sizes; The wear segmentation unit determines whether the normal differential factor is less than a preset threshold value: if so, it is determined that the current scanning point is in an unworn area; if not, it is determined that the current scanning point is in a worn area; The surface alignment unit assigns different weights to the unworn area and the worn area, so as to use the unworn area as a primary alignment reference area and the worn area as a secondary alignment reference area; Based on the weight, calculating the matching error between the three-dimensional scanning model and the specified area of the original standard model pre-stored in the measured part; The optimal second transformation matrix between the two models is iteratively calculated by the least square method, and after obtaining the minimum matching error, the relative position between the two models after surface alignment is determined; The result generation module is used to send out the three-dimensional scanning model.
10. A registration device for a free-form surface wear model, characterized in that: It includes a processor, a memory and a bus, wherein the memory stores instructions and data read by the processor, the processor is used to call the instructions and data in the memory to execute the alignment method as described in any one of claims 1-8, and the bus connects the functional components for transmitting information.
