Line laser external parameter calibration device

By taking only two pictures in the online laser external parameter calibration system, using camera and reference plane posture adjustment and Steger algorithm, the problem of ensuring the area of ​​the laser illumination in large angle scenes is solved, and efficient external parameter calibration is achieved, suitable for consumption Electronics, simplifying operations and reducing costs.

CN118960558AInactive Publication Date: 2024-11-15YUANXING SPACE-TIME TECH (BEIJING) CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411014410.1
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-07-26
Publication Date
2024-11-15
Estimated Expiration
Not applicable · inactive patent

AI Technical Summary

Technical Problem

The existing linear laser external parameter calibration system is difficult to ensure that the laser illuminated area is on the calibration board in large angle scenarios, and multiple pictures are required, which are complex and time-consuming, especially in consumer electronic products with high cost and efficiency requirements. In case.

Method used

Calibrate the external parameters of the laser and the camera by taking only two pictures, use the camera fixing frame and reference plane for fixing and posture adjustment, combine the rotation and translation device to change the relative posture of the camera and reference plane, and use the Steger algorithm to extract the laser light The center point of the line is calculated by backprojection to calculate the spatial coordinate points and solve the external parameters.

Benefits of technology

It greatly improves the calibration efficiency and is suitable for large-angle laser calibration scenarios. The external parameter calibration of the laser and camera can be completed with only two pictures, simplifying the operation process and reducing costs.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118960558A_ABST
    Figure CN118960558A_ABST
Patent Text Reader

Abstract

The invention discloses a line laser extrinsic parameter calibration device, relates to the technical field of production detection equipment, and aims to calibrate extrinsic parameters of a laser and a camera under the condition that only two pictures are shot. The method is suitable for a large-angle line laser calibration scene; the calibration efficiency can be greatly improved, and the external parameters of the laser and the camera can be calibrated under the condition that only two pictures are shot.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The invention relates to the technical field of production detection equipment, and in particular to a linear laser external parameter calibration device. Background Art

[0002] Line laser 3D sensors are widely used in industrial inspection, robot perception and obstacle avoidance, and other fields; the accuracy of the sensor is inseparable from the parameter calibration of the camera system, among which the external parameter calibration is very critical. Sensors are increasingly used in consumer electronic products, such as sweeping robots, and the cost requirements are getting higher and higher; the efficiency of external parameter calibration in manufacturing determines the manufacturing cost and production delivery cycle of the product, so improving the efficiency of calibration is crucial.

[0003] The existing calibration system uses a checkerboard or dot calibration plate; the steps are as follows:

[0004] 1. With the laser turned off, take a picture of the checkerboard (or dot calibration plate);

[0005] 2. Take a photo of the calibration plate with the laser turned on;

[0006] 3. After taking at least two sets of photos, calculate the relative position of the camera and the chessboard (or dot calibration plate) by using the camera intrinsic parameters and the calibration plate chessboard size;

[0007] 4. Extract the center line of the laser illuminated area in the image with laser lines;

[0008] 5. Solve the external parameters of the laser plane and camera plane through algorithms such as solvePNP.

[0009] This approach has the following problems:

[0010] 1. When the camera angle is very large, such as more than 100°, it is difficult to ensure that the laser illuminates the area on the calibration board;

[0011] 2. You need to take at least 4 pictures;

[0012] 3. During the shooting process, it is necessary to first turn on the natural light, turn off the laser to take the calibration plate picture, and then turn off the natural light and turn on the laser to take the picture, which increases the complexity and time of the operation. Summary of the invention

[0013] The present invention provides a linear laser extrinsic parameter calibration device, which solves the above technical problems.

[0014] In order to solve the above technical problems, the present invention provides a line laser extrinsic parameter calibration device, which calibrates the extrinsic parameters of the laser and the camera by taking only two pictures;

[0015] S1, fixing the camera on the surface of the camera fixing frame and fixing the reference plane; the relative position of the camera fixing frame and the reference plane is fixed;

[0016] S2, take pictures and images; turn on the laser and use the camera to collect pictures, in which there are images of laser light;

[0017] S3, changing the relative posture of the reference plane and the camera; driving the reference plane to rotate by a rotating device or changing the position of the camera by a translation device to change the relative posture of the reference plane and the camera;

[0018] S4, take a picture and repeat the operation in S1;

[0019] S5. Calculate the external parameters of the laser plane and the camera plane.

[0020] Preferably, if it is necessary to take more pictures in relative positions in S4, S3 and S2 can be repeated.

[0021] Compared with the related art, the linear laser extrinsic parameter calibration device provided by the present invention has the following beneficial effects:

[0022] The present invention is applicable to large-angle line laser calibration scenarios and can greatly improve the calibration efficiency, and can calibrate the external parameters of the laser and camera by taking only two pictures. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] Figure 1 It is the main structure diagram of the present invention.

[0024] Numbers in the figure: 1, camera fixing bracket; 2, reference plane; 3, translation device; 4, rotation device. DETAILED DESCRIPTION

[0025] Embodiment 1, by Figure 1 It is given that the present invention includes a line laser extrinsic parameter calibration device, which is characterized in that the extrinsic parameters of the laser and the camera are calibrated when only two pictures are taken;

[0026] S1, fix the camera on the surface of the camera fixing frame 1, and fix the reference plane 2; the relative position of the camera fixing frame 1 and the reference plane 2 is fixed;

[0027] S2, take pictures and images; turn on the laser and use the camera to collect pictures, in which there are images of laser light;

[0028] S3, changing the relative posture of the reference plane 2 and the camera; driving the reference plane 2 to rotate by the rotating device 4 or changing the position of the camera by the translation device 3, so as to change the relative posture of the reference plane 2 and the camera;

[0029] S4, take a picture and repeat the operation in S1;

[0030] S5. Calculate the external parameters of the laser plane and the camera plane.

[0031] If it is necessary to take more pictures in relative positions in S4, S3 and S2 can be repeated.

[0032] Two pictures with laser projection images were collected by adjusting the camera and the reference plane; one was that the camera plane was parallel to the reference plane and the two planes were 30 cm apart; the second was that the camera plane was parallel to the reference plane and the two planes were 15 cm apart.

[0033] Set the projection of the coordinate origin of the camera plane on the reference plane as the coordinate origin of the reference plane; extract the center point of the laser bright line in the image through the Steger algorithm, and then calculate the spatial coordinate point of the point under the camera coordinates through back projection. Repeat the calculation of the spatial coordinates of the points in the two images, and finally obtain the external parameters of the camera and laser planes by solving the equations.

[0034] Embodiment 2, by Figure 1 It is given that the present invention includes a line laser extrinsic parameter calibration device, which is characterized in that the extrinsic parameters of the laser and the camera are calibrated when only two pictures are taken;

[0035] S1, fix the camera on the surface of the camera fixing frame 1, and fix the reference plane 2; the relative position of the camera fixing frame 1 and the reference plane 2 is fixed;

[0036] S2, take pictures and images; turn on the laser and use the camera to collect pictures, in which there are images of laser light;

[0037] S3, changing the relative posture of the reference plane 2 and the camera; driving the reference plane 2 to rotate by the rotating device 4 or changing the position of the camera by the translation device 3, so as to change the relative posture of the reference plane 2 and the camera;

[0038] S4, take a picture and repeat the operation in S1;

[0039] S5. Calculate the external parameters of the laser plane and the camera plane.

[0040] If it is necessary to take more pictures in relative positions in S4, S3 and S2 can be repeated.

[0041] Two pictures with laser projection images were collected by adjusting the camera and the reference plane; one was that the camera plane was parallel to the reference plane, and the two planes were 30 cm apart; the second was that the camera and the reference plane were adjusted to form an angle of 30°, and the distance between the two planes projected from the center of the camera to the reference plane was maintained at 30 cm.

[0042] The projection of the coordinate origin of the camera plane on the reference plane is set as the coordinate origin of the reference plane; the center point of the laser bright line in the image is extracted by the Steger algorithm, and then the spatial coordinate point of the point in the camera coordinate is calculated by back projection; the spatial coordinates of the points in the two images are repeatedly calculated, and finally the external parameters of the camera and laser planes are obtained by solving the equations.

[0043] Working principle: For a plane, its equation can be expressed as z=ax+by+c. Fitting the plane by discrete points is actually solving the overdetermined equation:

[0044]

[0045] The above equation can be expressed as A·X=b. Since A is an m×n matrix, we multiply both sides of the equal sign by the transposed matrix A of A. T , so that the coefficient matrix becomes m×n, and then it is solved by multiplying it by the inverse matrix of the coefficient matrix, that is, X=(AA T ) -1 A T b.

Claims

1. A line laser extrinsic parameter calibration device, characterized in that: Calibrate the external parameters of the laser and camera by taking only two pictures; S1, fixing the camera on the surface of the camera fixing frame (1) and fixing the reference plane (2); the relative position of the camera fixing frame (1) and the reference plane (2) is fixed; S2, photo taking and imaging; Turn on the laser and use the camera to capture images, which will contain the laser light images; S3, changing the relative position and posture of the reference plane (2) and the camera; driving the reference plane (2) to rotate by means of a rotating device (4) or changing the position of the camera by means of a translation device (3), thereby changing the relative position and posture of the reference plane (2) and the camera; S4, take a picture and repeat the operation in S1; S5. Calculate the external parameters of the laser plane and the camera plane.

2. A line laser extrinsic parameter calibration device according to claim 1, characterized in that: If it is necessary to take more pictures in relative positions in S4, S3 and S2 can be repeated.