Plate strip shape detection device and detection method
Through 4 sets of lasers and a monocular high-speed surface array camera imaging system, combined with laser plane calibration and compensation technology, the problem of long strip steel deflection and extraction time in multi-line laser detection is solved, and real-time online height of plate and strip shape is achieved Accuracy detection.
Patent Information
- Application Number
- CN202411212161.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-30
- Publication Date
- 2024-12-06
- Estimated Expiration
- 2044-08-30
AI Technical Summary
The existing plate and strip detection technology based on multi-line lasers is difficult to eliminate the impact of strip deflection on straightness detection, and the single-frame laser image extraction is large and time-consuming, which affects the real-timeness of the detection.
Using 4 sets of lasers and a monocular high-speed surface array camera imaging system, the height point coordinates on the laser line are extracted through laser plane calibration and continuous shooting, and vibration and rotation compensation are performed to calculate the actual height and straightness of the board strip to achieve Real-time online detection.
High-precision detection of plate-strip-shaped plate shape is realized, eliminating the impact of vibration and deflection on measurement, and improving the real-time and accuracy of detection.
Smart Images

Figure CN119076648A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of metallurgical detection technology, and in particular to a plate and strip material shape detection device and detection method. Background Art
[0002] During the rolling process of plate and strip materials, the inconsistency between the cross-sectional profile of the incoming strip steel and the actual load-bearing roll gap shape causes uneven compression in the width direction of the strip steel during rolling, resulting in uneven internal stress between the longitudinal fibers of the strip steel. When the internal stress exceeds the critical yield value, the strip steel buckles, thus affecting the quality of the slab and even causing the strip steel to break, reduce the working speed and damage the equipment. Therefore, in order to evaluate, control and improve the shape of the plate and strip materials, a corresponding plate and strip shape detection system must be established.
[0003] In recent years, with the development of machine vision technology, machine vision technology has been gradually explored and applied in industrial scenarios, showing outstanding advantages such as fast response speed in industrial measurement. Applying machine vision theory to plate shape detection has become an inevitable trend.
[0004] At present, in the field of plate and strip material detection based on machine vision, the proposed plate shape detection technology based on multi-line laser is an improved solution for plate shape detection, but this method still has some problems. First, the position of the multi-line laser is fixed, and the resolution in the length direction cannot be dynamically adjusted, which cannot meet the quality inspection and judgment of steel grades with different rolling quality requirements. In addition, although the plate shape detection method based on multi-line laser can suppress the influence of strip runout on flatness measurement to a certain extent, it cannot cope with the influence of strip deflection. Finally, from the perspective of image processing, the extraction amount of single-frame laser bright lines in multi-line laser images is large and the extraction time is long, which also has a great impact on the real-time performance of industrial detection. Summary of the invention
[0005] The present invention provides a plate and strip shape detection device and method to solve the technical problems existing in the prior art that it is difficult to eliminate the influence of strip deflection on flatness detection, and that the amount of single-frame laser image extraction is large and time-consuming.
[0006] In order to solve the above technical problems, the present invention provides a plate and strip material shape detection device and method, comprising:
[0007] The device includes a laser, a monocular high-speed array camera, a laser velocimeter, a cooling device, a display, a data processing server, a PLC controller, a laser bracket, a camera bracket and a through-beam metal detector. The camera bracket is installed above the roller at the exit of the rolling mill. The monocular high-speed array camera is installed inside the camera bracket to shoot the roller at an angle downward, and the collected image data is transmitted to the data processing server via Gigabit Ethernet. The laser bracket is installed on the inner side of the camera bracket and above the roller at the exit of the rolling mill. The laser is installed on the laser bracket to project 4 groups of lasers vertically downward onto the roller transport plane. The display is connected to the data processing server, and the data processing server is connected to the PLC via Gigabit Ethernet. The PLC controller is connected to the laser, the monocular high-speed area array camera and the through-beam metal detector through a signal line, and controls the switch of the laser, the trigger switch of the monocular high-speed area array camera and the on-off state of the through-beam metal detector respectively; wherein, the laser comprises 4 groups, namely laser A, laser B, laser C and laser D, the monocular high-speed area array camera comprises 4 groups, namely area array camera E, area array camera F, area array camera G and area array camera H, the through-beam metal detector comprises 2 groups, namely through-beam metal detector P and through-beam metal detector Q, the monocular area array camera is connected to a cooling device I, and the laser A, laser B, laser C and laser D are connected to a cooling device J.
[0008] The camera bracket includes a base, a shell, a lifting platform, a camera posture adjustment device, a camera cooling device and a dust removal device. The base is installed on the ground by anchor bolts, the shell is installed on the base by bolts, the lifting platform is installed above the base by bolts, the camera posture adjustment device is installed above the lifting platform by bolts, the camera cooling device is installed on the camera posture adjustment device, except for the lens, the rest of the area array camera is installed inside the camera cooling device, the dust removal part of the dust removal device is installed on the shell window, which is responsible for cleaning the dust and water vapor on the shell window, and the rest of the parts are installed inside the shell.
[0009] The laser bracket includes a rectangular frame, a laser posture adjustment device and a laser cooling device. The rectangular frame is installed on the ground through anchor bolts, the laser posture adjustment device is installed above the rectangular frame, the laser is installed on the laser posture adjustment device, and the laser cooling device is installed on the outside of the laser.
[0010] A method for detecting the shape of a plate or strip material using the device as described above comprises the following steps:
[0011] S0: After the detection device is installed, the four stereo imaging systems are jointly calibrated, and the world coordinate systems of the four systems are unified, where X is the width direction of the plate and strip, Y is the movement direction of the plate and strip, and Z is the height direction;
[0012] S1: When the plate and strip material reaches position P1, the PLC controller turns on the corresponding 4 groups of lasers, among which laser A shoots a laser line along the width direction of the strip, covering the entire width range of the plate and strip material, recorded as L1, and lasers B, C and D shoot 3 parallel laser lines along the length direction of the strip, recorded as L l , L c and L r , located at the center of the width direction of the laser line L1 and its left and right symmetrical points, and the intersection points are marked as CRO l (X l ,Y l ,Z l ), CRO c (X c ,Y c ,Z c ) and CRO r (X r ,Y r ,Z r );
[0013] S2: When the strip reaches position P2, the PLC controller triggers the corresponding monocular high-speed area array camera through a pulse signal to continuously and synchronously shoot 4 groups of lasers L1, L l , L c and L r Images on plate and strip;
[0014] S3: Calculate the translation distance s by the plate and strip speed v and the shooting frame rate f;
[0015] S4: For the acquired image, extract the world coordinates of the points on the entire line on the transverse laser line L1, and extract the world coordinates of the points on the three longitudinal laser lines L l , L c and L r The world coordinates of the points on the entire line are extracted above, for a total of 4 sets of world coordinates;
[0016] S5: According to L l , L c and L r Extract the world coordinates of the point and calculate the vibration amount generated by the plate and strip and the rotation θ final , the height value of the entire horizontal laser measurement is compensated, and each collected image is cyclically calculated until the entire slab leaves position P2, and the actual height of the upper surface of the entire slab is obtained;
[0017] S6: N sampling fibers are divided along the width direction of the plate strip, and the straightness, number of waves, value and position of the minimum wave and the maximum wave are calculated according to the actual height of each fiber, and the real-time plate strip 3D morphology map, real-time 2D contour map, real-time 2D defect mapping map, dynamic cross-sectional elongation distribution bar graph, dynamic cross-sectional profile, dynamic symmetric and asymmetric flatness parameter bar graph and topographic profile of the current steel plate in the length direction are displayed.
[0018] Furthermore, the formula for calculating the translation distance by the plate and strip speed and the shooting frame rate in S3 is:
[0019]
[0020] Among them, s represents the single translation distance; v represents the forward movement speed of the plate and strip; and f represents the camera shooting frame rate.
[0021] Further, in said S5, according to L l , L c and L r The process of extracting the world coordinates of the obtained point and compensating the height value of the entire lateral laser measurement includes:
[0022] According to L l , L c and L r Extract the world coordinates of the point and select the point cloud data P of the overlapping measurement segments in the laser images at time (t-1) and time t (t-1)测 and P t测 ; Calculate point cloud data P (t-1)测 Part of the point cloud data in Ideal point cloud data P after moving along the Y axis for s without vibration or deflection refer ; Traverse the rotation angle θ t ∈(-90°,90°), the point cloud data P t测 Part of the point cloud data in Around The middle point Rotate θ t ,get The rotated point cloud data With the ideal point cloud data P refer The height difference between corresponding points is defined as a set ΔZ(θ t ), find the optimal So that the set ΔZ(θ t ) has the smallest variance; according to the rotated point cloud data The Z coordinate of the point cloud data P refer The Z coordinate of the image is used to calculate the single vibration amount. According to the rotation amount and the cumulative vibration amount, coupling compensation is performed on the points extracted by L1 in each frame of the image to obtain in,
[0023] Calculate the laser images at time (t-1) and time t, L l Extracted point cloud data and Partial point cloud data of overlapping measurement segments and The formula is:
[0024]
[0025] in, Select point cloud data of a specific y-axis range at time (t-1); Y is the y-axis coordinate of the point cloud data at time (t-1); l For L l Intersection point CRO on the left side of L1 l d is the half length of the selected overlapping measurement segment in the y direction; Select point cloud data of a specific y-axis range at time t; is the y-axis coordinate of the point cloud data at time t; s is the single translation distance;
[0026] according to and The calculation method is to calculate the laser images at time (t-1) and time t, L r Extracted point cloud data and Partial point cloud data of overlapping measurement segments and and L c Extracted point cloud data and Partial point cloud data of overlapping measurement segments and
[0027] Calculate point cloud data Ideal point cloud data P after moving along the Y axis for s without vibration or deflection refer The formula is:
[0028]
[0029] in, is the laser line L l Part of the point cloud data of the overlapping measurement segment at time (t-1); refer is the ideal point cloud data; s is the single translation distance of the steel plate along the Y axis;
[0030] Calculate time t The formula for the center point coordinates is:
[0031]
[0032] Among them, m is The center point index of The number of points in ; for The center point of The center points The x-coordinate, y-coordinate and z-coordinate of
[0033] Calculate point cloud Around the center point Rotated point cloud data The z coordinate of the i-th point in The formula is:
[0034]
[0035] Among them, θ lt for Around each point The rotation angle ranges from (-90°, 90°); and The center of rotation The y-coordinate and z-coordinate of and Point cloud data The x-coordinate, y-coordinate and z-coordinate of the i-th point in ; and Point cloud data The x-coordinate, y-coordinate and z-coordinate of the i-th point before rotation;
[0036] Define the rotated point cloud data With the ideal point cloud data P refer The height difference set ΔZ(θ t )for:
[0037]
[0038] in, for The z coordinate of the i-th point in refer ) i P refer The z coordinate of the i-th point in ;
[0039] The formula for calculating the Z coordinate difference of each point is:
[0040]
[0041] Calculate the variance Var(ΔZ(θ t))The formula is:
[0042]
[0043] Among them, num is the point cloud The number of points in ΔZ(θ t ) i is the height difference of the i-th point; is the height difference set The mean of
[0044] calculate The optimal rotation angle for all points in The formula is:
[0045]
[0046] ΔZ(θ t ) is the rotated point cloud data With the ideal point cloud data P refer The set of height differences between corresponding points;
[0047] according to The calculation method of and Rotation angle and
[0048] Calculate the rotation amount θ of the steel plate from time (t-1) to time t final The formula is:
[0049]
[0050] Among them, θ final is the rotation amount of the steel plate from time (t-1) to time t; is time t The rotation angle of all points in ; is time t The rotation angle of all points in ; is time t The rotation angle of all points in ;
[0051] According to the rotated point cloud data The corresponding rotation angle Calculate the translation Δz l The formula is:
[0052]
[0053] Among them, num is the point cloud the number of midpoints; For rotation Point cloud data The height difference of the i-th point;
[0054] According to Δz l The calculation method of and The translation Δz r and Δz c ;
[0055] Calculate the vibration compensation amount of laser line L1 at time t The formula is:
[0056]
[0057] in, is the compensation amount of the steel plate along the z axis; Δz l is time t The translation of all points in Δz r is time t The translation of all points in Δz c is time t The translation of all points in ;
[0058] The calculation formula for the coordinates of the extraction point on L1 after calculating the rotation compensation coupled vibration compensation is:
[0059]
[0060] Among them, θ final is the rotation angle; and The center of rotation The y-coordinate and z-coordinate of is the height compensation; and are the x-coordinate, y-coordinate and z-coordinate of each point extracted on the laser line L1 before rotation; and are the x-coordinate, y-coordinate and z-coordinate of the i-th point coordinate extracted on the laser line L1 after the rotation coupling vibration compensation amount;
[0061] For the coordinates at time (t+1) and later, compensation is performed using the same vibration and rotation coupling compensation calculation method, and the calculation is cyclically performed until the coordinate data at the last time.
[0062] Furthermore, the number N of sampled fibers divided along the width direction of the strip in S6 ranges from 3 to 50.
[0063] Furthermore, the formula for calculating the straightness and maximum height of the strip according to the actual height value of the strip surface in S6 is:
[0064]
[0065] L ref =min(L n )
[0066] ΔL n =L n -L ref
[0067]
[0068] in, represents the segment length on the strip fiber from time (t-1) to time t; Indicates the actual height of the nth measuring point in the horizontal direction of the plate at time t; represents the actual height of the nth measuring point in the horizontal direction of the plate at time (t-1); s represents the single translation distance; L n represents the cumulative length of the nth fiber; L ref Indicates the minimum value of the cumulative length of n fibers; ΔL n represents the difference in extension of the nth fiber; F represents the flatness of the plate and strip; height max is the maximum height; It is the actual height of the point on the strip.
[0069] Furthermore, the display of the real-time three-dimensional strip topography, real-time two-dimensional contour map, real-time two-dimensional defect map, dynamic cross-sectional profile and topographic profile of the current steel plate in the length direction in S6 depends on the real height of the strip and the deflection amount θ of each frame, including:
[0070] The position of each point in the displayed image is restored using each frame to calculate.
[0071] The beneficial effects brought about by the technical solution provided by the present invention include at least:
[0072] The technical solution of the present invention is based on 4 groups of laser-monocular array camera imaging systems, which collect laser images of the upper surface of the plate and strip to complete the light plane calibration, and then continuously shoot when the plate and strip moves, and extract all heights on the laser line for each frame of the image, and compensate for the lateral height value extracted for each frame to obtain the actual height of the entire plate and strip surface. Finally, the straightness and maximum height of the plate and strip are calculated according to the actual height value of the plate and strip surface, and displayed. The present invention has the advantage of eliminating the influence of vibration and deflection on visual measurement during the movement of the plate and strip, and realizes real-time online high-precision detection of the plate shape of the plate and strip. BRIEF DESCRIPTION OF THE DRAWINGS
[0073] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.
[0074] Figure 1 is a schematic diagram of the structure of a detection device provided by an embodiment of the present invention;
[0075] Figure 2 is a schematic structural diagram of a camera bracket provided by an embodiment of the present invention;
[0076] Figure 3 is a schematic structural diagram of a laser bracket provided by an embodiment of the present invention;
[0077] Among them, 1-laser, 1.1-laser A, 1.2-laser B, 1.3-laser C, 1.4-laser D, 2-monocular high-speed array camera, 2.1-array camera E, 2.2-array camera F, 2.3-array camera G, 2.4-array camera H, 3-laser velocimeter, 4-cooling equipment, 5-display, 6-data processing server, 7-PLC controller, 8-laser bracket, 8.1-base, 8.2-housing, 8.3-lifting platform, 8.4-camera posture adjustment device, 8.5-camera cooling device, 8.6-dust removal device, 9-camera bracket, 9.1-rectangular frame, 9.2-laser posture adjustment device, 9.3-laser cooling device, 10-opposite-beam metal detector, 10.1 opposite-beam metal detector P, 10.2-opposite-beam metal detector Q, 4.1-cooling equipment I, 4.2-cooling equipment J. DETAILED DESCRIPTION
[0078] In order to make the technical problems, technical solutions and advantages to be solved by the present invention more clear, a detailed description will be given below with reference to the accompanying drawings and specific embodiments.
[0079] First of all, it should be noted that in the embodiments of the present invention, words such as "exemplarily" and "for example" are used to indicate examples, illustrations or explanations. Any embodiment or design described as "exemplary" in the present invention should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of the word "exemplarily" is intended to present the concept in a concrete way. In addition, in the embodiments of the present invention, the meaning expressed by "and / or" can be both, or it can be either of the two.
[0080] The invention provides a plate and strip material shape detection device and method.
[0081] like Figure 1As shown, the device includes a laser 1, a monocular high-speed array camera 2, a laser velocimeter 3, a cooling device 4, a display 5, a data processing server 6, a PLC controller 7, a laser bracket, a camera bracket and a through-beam metal detector. The camera bracket is installed above the roller at the exit of the rolling mill. The monocular high-speed array camera is installed inside the camera bracket to shoot the roller downward at an angle, and the collected image data is transmitted to the data processing server 6 through Gigabit Ethernet. The laser bracket is installed on the inner side of the camera bracket and above the roller at the exit of the rolling mill. The laser 1 is installed on the laser bracket to project 4 groups of lasers vertically downward onto the roller transport plane. The display 5 is connected to the data processing server 6. The data processing server 6 is connected to the PLC controller 7 through Gigabit Ethernet. The PLC controller 7 is connected to the laser through a signal line. The laser 1, the monocular high-speed area array camera 2 and the through-beam metal detector are connected to control the switch of the laser 1, the trigger switch of the monocular high-speed area array camera 2 and the on-off state of the through-beam metal detector respectively; wherein, the laser includes 4 groups, namely laser A1.1, laser B1.2, laser C1.3 and laser D1.4, the monocular high-speed area array camera includes 4 groups, namely area array camera E2.1, area array camera F2.2, area array camera G2.3 and area array camera H2.4, the through-beam metal detector includes 2 groups, namely through-beam metal detector P10.1 and through-beam metal detector Q10.2, the monocular area array camera is connected to the cooling device I4.1, and the laser A1.1, laser B1.2, laser C1.3 and laser D1.4 are connected to the cooling device J4.2.
[0082] like Figure 2 As shown, the camera bracket includes a base 8.1, a shell 8.2, a lifting platform 8.3, a camera posture adjustment device 8.4, a camera cooling device 8.5 and a dust removal device 8.6. The base 8.1 is installed on the ground by anchor bolts, the shell 8.2 is installed on the base 8.1 by bolts, the lifting platform 8.3 is installed above the base 8.1 by bolts, the camera posture adjustment device 8.4 is installed above the lifting platform 8.3 by bolts, the camera cooling device 8.5 is installed on the camera posture adjustment device 8.4, except for the lens, the rest of the area array camera is installed inside the camera cooling device 8.5, the dust removal part of the dust removal device 8.6 is installed on the shell window, which is responsible for cleaning the dust and water vapor on the shell window, and the rest of the dust removal device is installed inside the shell 8.2.
[0083] like Figure 3 As shown, the laser bracket includes a rectangular frame 9.1, a laser posture adjustment device 9.2 and a laser cooling device 9.3. The rectangular frame 9.1 is installed on the ground by anchor bolts, the laser posture adjustment device 9.2 is installed above the rectangular frame 9.1, the laser 1 is installed on the laser posture adjustment device 9.2, and the laser cooling device 9.3 is installed on the outside of the laser 1.
[0084] When the slab reaches position P1, the PLC controller turns on the corresponding laser and shoots four lasers in the length direction of the strip. When the slab reaches position P2, the PLC controller triggers the corresponding area array camera through a pulse signal to continuously capture the image of the laser on the slab. The shooting ends when the entire slab leaves P2 and the corresponding laser is turned off. The acquired image is transmitted to the data processing server, and the measured height of the upper surface of the plate and strip is obtained through extraction of the center of the light strip and coordinate conversion.
[0085] The states of the through-beam metal detector corresponding to the positions P1 and P2 of the area array camera are:
[0086] Position P1: The Q of the through-beam metal detector is at a low level, and the P of the through-beam metal detector is at a rising edge;
[0087] Position P2: P of the through-beam metal detector is at a high level, and Q of the through-beam metal detector is at a rising edge;
[0088] Among them, the through-beam metal detector P and the through-beam metal detector Q are at a low level when no object passes through, and at a high level when there is an object blocking it.
[0089] The value range of the number N of divided sampling fibers is 3-50. In this embodiment, the value of the number N of divided sampling fibers is 21;
[0090] The formula for calculating the translation distance by the plate and strip speed and the shooting frame rate is:
[0091]
[0092] Where, s represents the single translation distance in mm;
[0093] v represents the forward movement speed of the plate and strip, in mm / s, and in this embodiment, v is taken as 5000 mm / s;
[0094] f represents the camera shooting frame rate, in fps. In this embodiment, f is taken as 1000fps.
[0095] According to L l , L c and L r The process of extracting the world coordinates of the obtained point and compensating the height value of the entire lateral laser measurement includes:
[0096] According to L l , L c and L r Extract the world coordinates of the point and select the point cloud data P of the overlapping measurement segments in the laser images at time (t-1) and time t (t-1)测 and P t测; Calculate point cloud data P (t-1)测 Part of the point cloud data in Ideal point cloud data P after moving along the Y axis for s without vibration or deflection refer ; Traverse the rotation angle θ t ∈(-90°,90°), the point cloud data P t测 Part of the point cloud data in Around The middle point Rotate θ t ,get The rotated point cloud data With the ideal point cloud data P refer The height difference between corresponding points is defined as a set ΔZ(θ t ), find the optimal So that the set ΔZ(θ t ) has the smallest variance; according to the rotated point cloud data The Z coordinate of the point cloud data P refer The Z coordinate of the image is used to calculate the single vibration amount. According to the rotation amount and the cumulative vibration amount, coupling compensation is performed on the points extracted by L1 in each frame of the image to obtain in,
[0097] Calculate the laser images at time (t-1) and time t, L l Extracted point cloud data and Partial point cloud data of overlapping measurement segments and The formula is:
[0098]
[0099] in, Select the point cloud data of a specific y-axis range at time (t-1), dimensionless;
[0100] is the y-axis coordinate of the point cloud data at time (t-1), in mm;
[0101] Y l For L l Intersection point CRO on the left side of L1 l The y coordinate of the axis is in mm;
[0102] d is the half length of the selected overlapping measurement segment in the y direction, in mm, and in this embodiment, d is taken as 4 mm;
[0103] Select the point cloud data of a specific y-axis range at time t, dimensionless;
[0104] is the y-axis coordinate of the point cloud data at time t, in mm;
[0105] s is the single translation distance in mm.
[0106] according to and The calculation method is to calculate the laser images at time (t-1) and time t, L r Extracted point cloud data and Partial point cloud data of overlapping measurement segments and and L c Extracted point cloud data and Partial point cloud data of overlapping measurement segments and
[0107] Calculate point cloud data Ideal point cloud data P after moving along the Y axis for s without vibration or deflection refer The formula is:
[0108]
[0109] in, is the laser line L l Partial point cloud data of overlapping measurement segments at time (t-1), dimensionless;
[0110] P refer is the ideal point cloud data, dimensionless;
[0111] s is the single translation distance of the steel plate along the Y axis, in mm.
[0112] Calculate time t The formula for the center point coordinates is:
[0113]
[0114] Among them, m is The center point index of , dimensionless;
[0115] num is The number of points in , in pieces;
[0116] for The center point of , dimensionless;
[0117] The center points The x-coordinate, y-coordinate and z-coordinate of the measuring unit are in mm.
[0118] Calculate point cloud Around the center point Rotated point cloud data The z coordinate of the i-th point in The formula is:
[0119]
[0120] in, for Around each point The rotation angle ranges from (-90°, 90°);
[0121] and The center of rotation The y and z coordinates of the object are in mm;
[0122] and Point cloud data The x-coordinate, y-coordinate and z-coordinate of the ith point in the equation are in mm;
[0123] and Point cloud data The x-coordinate, y-coordinate, and z-coordinate of the i-th point in the image before rotation, in mm.
[0124] Define the rotated point cloud data With the ideal point cloud data P refer The height difference set ΔZ(θ t )for:
[0125]
[0126] in, for The z coordinate of the i-th point in , in mm;
[0127] Z(P refer ) i P refer The z-coordinate of the ith point in , in mm.
[0128] The formula for calculating the Z coordinate difference of each point is:
[0129]
[0130] Calculate the variance Var(ΔZ(θ t ))The formula is:
[0131]
[0132] Among them, num is the point cloud The number of points in , in pieces;
[0133] ΔZ(θ t ) i is the height difference of the i-th point, in mm;
[0134] is the height difference set The mean value, in mm.
[0135] calculate The optimal rotation angle for all points in The formula is:
[0136]
[0137] ΔZ(θ t ) is the rotated point cloud data With the ideal point cloud data P refer The height difference set between corresponding points, in mm;
[0138] according to The calculation method of and Rotation angle and
[0139] Calculate the rotation amount θ of the steel plate from time (t-1) to time t final The formula is:
[0140]
[0141] Among them, θ final is the rotation amount of the steel plate from time (t-1) to time t, in rad;
[0142] is time t The rotation angle of all points in , in rad;
[0143] is time t The rotation angle of all points in , in rad;
[0144] is time t The rotation angle of all points in , in rad.
[0145] According to the rotated point cloud data The corresponding rotation angle Calculate the translation Δz l The formula is:
[0146]
[0147] Among them, num is the point cloud The number of midpoints, in pieces;
[0148] For rotation Point cloud data The height difference of the i-th point, in mm;
[0149] According to Δz l The calculation method of and The translation Δz r and Δz c .
[0150] Calculate the vibration compensation amount of laser line L1 at time t The formula is:
[0151]
[0152] in, is the compensation amount of the steel plate along the z-axis, in mm;
[0153] Δz l is time t The translation amount of all points in , in mm;
[0154] Δz r is time t The translation amount of all points in , in mm;
[0155] Δz c is time t The translation of all points in , in mm.
[0156] The calculation formula for the coordinates of the extraction point on L1 after calculating the rotation compensation coupled vibration compensation is:
[0157]
[0158] Among them, θ final is the rotation angle, in rad;
[0159] and The center of rotation The y and z coordinates of the object are in mm;
[0160] is the height compensation, in mm;
[0161] and are the x-coordinate, y-coordinate and z-coordinate of each point extracted on the laser line L1 before rotation, in mm;
[0162] and The x-coordinate, y-coordinate and z-coordinate of the i-th point extracted on the laser line L1 after the rotation coupling vibration compensation amount, the unit is mm.
[0163] For the coordinates at time (t+1) and later, compensation is performed using the same vibration and rotation coupling compensation calculation method, and the calculation is cyclically performed until the coordinate data at the last time.
[0164] The formula for calculating the straightness and maximum height of the strip according to the actual height value of the strip surface is:
[0165]
[0166] L ref =min(L n )
[0167] ΔL n =L n -L ref
[0168]
[0169] in, It represents the length of the segment on the strip fiber from time (t-1) to time t, in mm;
[0170] It indicates the actual height of the nth measuring point in the horizontal direction of the strip at time t, in mm;
[0171] It represents the actual height of the nth measuring point in the horizontal direction of the strip at time (t-1), in mm;
[0172] s represents the single translation distance, in mm;
[0173] L n It represents the cumulative length of the nth fiber in mm;
[0174] L ref It represents the minimum value of the cumulative length of n fibers, in mm;
[0175] ΔL n It represents the difference in elongation of the nth fiber, in mm;
[0176] F represents the flatness of the plate and strip, and the unit is I-Unit;
[0177] height max is the maximum height in mm;
[0178] It is the actual height of the point on the strip, in mm.
[0179] The display of real-time strip 3D topography, real-time 2D contour map, real-time 2D defect map, dynamic cross-sectional profile and topographic profile of the current steel plate in the length direction depends on the real height of the strip and the deflection amount θ of each frame, including:
[0180] The position of each point in the displayed image is restored using each frame to calculate.
[0181] In summary, this embodiment provides a device and method for detecting the plate shape of a strip. After the measuring device is installed and the posture is adjusted, based on 4 groups of laser-monocular array camera imaging systems, the laser image of the upper surface of the strip is collected to complete the light plane calibration. Then, when the strip moves, continuous shooting is performed, and all heights on the laser line are extracted for each frame of the image. The lateral height value extracted for each frame is compensated to obtain the actual height of the entire strip surface. Finally, the straightness and maximum height of the strip are calculated according to the actual height value of the strip surface, and displayed. The present invention has the advantage of eliminating the influence of vibration and deflection on visual measurement during the movement of the strip, and realizes real-time online high-precision detection of the shape of the strip in the plate shape detection.
[0182] Finally, it should be noted that the above is only a preferred embodiment of the present invention. It should be pointed out that although the preferred embodiment of the present invention has been described, for ordinary technicians in this technical field, once the basic creative concept of the present invention is known, several improvements and modifications can be made without departing from the principles of the present invention. These improvements and modifications should also be regarded as the protection scope of the present invention. Therefore, the attached claims are intended to be interpreted as including the preferred embodiment and all changes and modifications that fall within the scope of the embodiments of the present invention.
Claims
1. A plate and strip material shape detection device, characterized in that: It includes a laser, a monocular high-speed array camera, a laser speed meter, a cooling device, a display, a data processing server, a PLC controller, a laser bracket, a camera bracket and a through-beam metal detector; the camera bracket is installed above the roller at the exit of the rolling mill, the monocular high-speed array camera is installed inside the camera bracket, tilted downward to shoot the roller, and the collected image data is transmitted to the data processing server through Gigabit Ethernet, the laser bracket is installed on the inner side of the camera bracket and above the roller at the exit of the rolling mill, the laser is installed on the laser bracket, and 4 groups of lasers are projected vertically downward to the roller transport plane, the display is connected to the data processing server, and the data processing server is connected to the PLC controller through Gigabit Ethernet. The PLC controller is connected with the laser, the monocular high-speed area array camera and the through-beam metal detector through a signal line, and controls the switch of the laser, the trigger switch of the monocular high-speed area array camera and the on-off state of the through-beam metal detector respectively; wherein, the laser comprises 4 groups, namely laser A, laser B, laser C and laser D, the monocular high-speed area array camera comprises 4 groups, namely area array camera E, area array camera F, area array camera G and area array camera H, the through-beam metal detector comprises 2 groups, namely through-beam metal detector P and through-beam metal detector Q, the monocular area array camera is connected to a cooling device I, and the laser A, laser B, laser C and laser D are connected to a cooling device J.
2. A method for detecting the shape of a plate or strip material using the device according to claim 1, characterized in that: The steps include: S0: After the detection device is installed, the four stereo imaging systems are jointly calibrated, and the world coordinate systems of the four systems are unified, where X is the width direction of the plate and strip, Y is the movement direction of the plate and strip, and Z is the height direction; S1: When the plate and strip material reaches position P1, the PLC controller turns on the corresponding 4 groups of lasers, among which laser A shoots a laser line along the width direction of the strip, covering the entire width range of the plate and strip material, recorded as L1, and lasers B, C and D shoot 3 parallel laser lines along the length direction of the strip, recorded as L l , L c and L r , located at the center of the width direction of the laser line L1 and its left and right symmetrical points, and the intersection points are marked as CRO l (X l ,Y l ,Z l ), CRO c (X c ,Y c ,Z c ) and CRO r (X r ,Y r ,Z r ); S2: When the strip reaches position P2, the PLC controller triggers the corresponding monocular high-speed area array camera through a pulse signal to continuously and synchronously shoot 4 groups of lasers L1, L l , L c and L r Images on plate and strip; S3: Calculate the translation distance s by the plate and strip speed v and the shooting frame rate f; S4: For the acquired image, extract the world coordinates of the points on the entire line on the transverse laser line L1, and extract the world coordinates of the points on the three longitudinal laser lines L l , L c and L r The world coordinates of the points on the entire line are extracted above, for a total of 4 sets of world coordinates; S5: According to L l , L c and L r Extract the world coordinates of the point and calculate the vibration amount generated by the plate and strip and the rotation θ final , the height value of the entire horizontal laser measurement is compensated, and each collected image is cyclically calculated until the entire slab leaves position P2, and the actual height of the upper surface of the entire slab is obtained; S6: Divide N sampling fibers along the width direction of the plate strip, calculate the straightness, the number of waves, the value and position of the minimum wave and the maximum wave according to the actual height of each fiber, and display the real-time plate strip 3D morphology map, real-time 2D contour map, real-time 2D defect mapping map, dynamic cross-sectional elongation distribution bar graph, dynamic cross-sectional profile, dynamic symmetric and asymmetric straightness parameter bar graph and the topographic profile of the current steel plate in the length direction; The states of the through-beam metal detector corresponding to the positions P1 and P2 of the area array camera are: Position P1: The Q of the through-beam metal detector is at a low level, and the P of the through-beam metal detector is at a rising edge; Position P2: P of the through-beam metal detector is at a high level, and Q of the through-beam metal detector is at a rising edge; Among them, the through-beam metal detector P and the through-beam metal detector Q are at a low level when no object passes through, and at a high level when there is an object blocking it.
3. A plate and strip material shape detection device according to claim 1, characterized in that: The camera bracket and the laser bracket are installed as follows: The camera bracket includes a base, a shell, a lifting platform, a camera posture adjustment device, a camera cooling device and a dust removal device; the base is installed on the ground by anchor bolts, the shell is installed on the base by bolts, the lifting platform is installed above the base by bolts, the camera posture adjustment device is installed above the lifting platform by bolts, the camera cooling device is installed on the camera posture adjustment device, the area array camera is installed inside the camera cooling device except the lens, the dust removal part of the dust removal device is installed on the window of the shell, responsible for cleaning the dust and water vapor on the shell window, and the rest of the dust removal device is installed inside the shell; The laser bracket includes a rectangular frame, a laser position adjustment device and a laser cooling device. The rectangular frame is installed on the ground through anchor bolts, and the laser position adjustment device is installed above the rectangular frame; the laser is installed on the laser position adjustment device, and the laser cooling device is installed on the outside of the laser.
4. The method for detecting the shape of a plate strip as claimed in claim 2, characterized in that: The formula for calculating the translation distance in S3 by the plate and strip speed and the shooting frame rate is: Among them, s represents the single translation distance of the plate and strip; v represents the forward movement speed of the plate and strip; and f represents the camera shooting frame rate.
5. The method for detecting the shape of a plate strip as claimed in claim 2, characterized in that: In S5, according to L l , L c and L r The process of extracting the world coordinates of the obtained point and compensating the height value of the entire lateral laser measurement includes: According to L l , L c and L r Extract the world coordinates of the point and select the point cloud data P of the overlapping measurement segments in the laser images at time (t-1) and time t (t-1) Measure and P t Measure; calculate point cloud data P (t-1) Part of the point cloud data being measured Ideal point cloud data P after moving along the Y axis for s without vibration or deflection refer ; Traverse the rotation angle θ t ∈(-90°,90°), the point cloud data P t Part of the point cloud data being measured Around The middle point Rotation θ t ,get The rotated point cloud data With the ideal point cloud data P refer The height difference between corresponding points is defined as a set ΔZ(θ t ), find the optimal So that the set ΔZ(θ t ) has the smallest variance; according to the rotated point cloud data The Z coordinate of the point cloud data P refer The Z coordinate of the image is used to calculate the single vibration amount. According to the rotation amount and the cumulative vibration amount, coupling compensation is performed on the points extracted by L1 in each frame of the image to obtain in, Calculate the laser images at time (t-1) and time t, L l Extracted point cloud data and Partial point cloud data of overlapping measurement segments and The formula is: in, Select point cloud data of a specific y-axis range at time (t-1); Y is the y-axis coordinate of the point cloud data at time (t-1); l For L l Intersection point CRO on the left side of L1 l d is the half length of the selected overlapping measurement segment in the y direction; Select point cloud data of a specific y-axis range at time t; is the y-axis coordinate of the point cloud data at time t; s is the single translation distance; according to and The calculation method is to calculate the laser images at time (t-1) and time t, L r Extracted point cloud data and Partial point cloud data of overlapping measurement segments and and L c Extracted point cloud data and Partial point cloud data of overlapping measurement segments and Calculate point cloud data Ideal point cloud data P after moving along the Y axis for s without vibration or deflection refer The formula is: in, is the laser line L l Part of the point cloud data of the overlapping measurement segment at time (t-1); refer is the ideal point cloud data; s is the single translation distance of the steel plate along the Y axis; Calculate time t The formula for the center point coordinates is: Among them, m is The center point index of The number of points in ; for The center point of The center points The x-coordinate, y-coordinate and z-coordinate of Calculate point cloud Around the center point Rotated point cloud data The z coordinate of the i-th point in The formula is: in, for Around each point The rotation angle ranges from (-90°, 90°); and The center of rotation The y-coordinate and z-coordinate of and Point cloud data The x-coordinate, y-coordinate and z-coordinate of the i-th point in ; and Point cloud data The x-coordinate, y-coordinate and z-coordinate of the i-th point before rotation; Define the rotated point cloud data With the ideal point cloud data P refer The height difference set ΔZ(θ t )for: in, for The z coordinate of the i-th point in refer ) i P refer The z coordinate of the i-th point in ; The formula for calculating the Z coordinate difference of each point is: Calculate the variance Var(ΔZ(θ t ))The formula is: Among them, num is the point cloud The number of points in ΔZ(θ t ) i is the height difference of the i-th point; is the height difference set The mean of calculate The optimal rotation angle for all points in The formula is: ΔZ(θ t ) is the rotated point cloud data With the ideal point cloud data P refer The set of height differences between corresponding points; according to The calculation method of and Rotation angle and Calculate the rotation amount θ of the steel plate from time (t-1) to time t final The formula is: Among them, θ final is the rotation amount of the steel plate from time (t-1) to time t; is time t The rotation angle of all points in ; is time t The rotation angle of all points in ; is time t The rotation angle of all points in ; According to the rotated point cloud data The corresponding rotation angle Calculate the translation Δz l The formula is: Among them, num is the point cloud the number of midpoints; For rotation Point cloud data The height difference of the i-th point; According to Δz l The calculation method of and The translation Δz r and Δz c ; Calculate the vibration compensation amount of laser line L1 at time t The formula is: in, is the compensation amount of the steel plate along the z axis; Δz l is time t The translation of all points in Δz r is time t The translation of all points in Δz c is time t The translation of all points in ; The calculation formula for the coordinates of the extraction point on L1 after calculating the rotation compensation coupled vibration compensation is: Among them, θ final is the rotation angle; and The center of rotation The y and z coordinates of is the height compensation; and are the x-coordinate, y-coordinate and z-coordinate of each point extracted on the laser line L1 before rotation; and are the x-coordinate, y-coordinate and z-coordinate of the i-th point coordinate extracted on the laser line L1 after the rotation coupling vibration compensation amount; For the coordinates at time (t+1) and later, compensation is performed using the same vibration and rotation coupling compensation calculation method, and the calculation is cyclically performed until the coordinate data at the last time.
6. The method for detecting the shape of a plate strip as claimed in claim 2, characterized in that: The number N of sampled fibers divided along the width direction of the strip in S6 ranges from 3 to 50.
7. The method for detecting the shape of a plate strip as claimed in claim 2, characterized in that: The formula for calculating the straightness and maximum height of the strip according to the actual height value of the strip surface in S6 is: L ref =min(L n ) ΔL n =L n -L ref in, represents the segment length on the strip fiber from time (t-1) to time t; Indicates the actual height of the nth measuring point in the horizontal direction of the plate at time t; represents the actual height of the nth measuring point in the horizontal direction of the plate at time (t-1); s represents the single translation distance; L n represents the cumulative length of the nth fiber; L ref Indicates the minimum value of the cumulative length of n fibers; ΔL n represents the difference in extension of the nth fiber; F represents the flatness of the plate and strip; height max is the maximum height; It is the actual height of the point on the strip.
8. The method for detecting the shape of a plate strip as claimed in claim 2, characterized in that: The display of the real-time three-dimensional strip topography, real-time two-dimensional contour map, real-time two-dimensional defect map, dynamic cross-sectional profile and topographic profile of the current steel plate in the length direction in S6 depends on the real height of the strip and the deflection amount θ of each frame, including: The position of each point in the displayed image is restored using each frame to calculate.
Citation Information
Patent Citations
Band steel deflection and floating quantity laser scanning detection method and deflection correction system
CN102319743A
Plate blank warping detection device and method based on machine vision
CN111521129A
Method for processing deviation curve between finish rolling strip steel racks based on machine vision
CN113828641A
Method for realizing strip steel straightness detection based on multi-plane laser measurement method
CN117589094A
Cited By
Plate strip straightness and width comprehensive detection device and method based on multi-line structured light
CN118565347A
