Camera calibration method and device, equipment and storage medium

Through the combination of B-spline surface and perspective projection model, the problem of difficulty in modeling complex distortion in the prior art is solved, and high-precision camera calibration is achieved, which is suitable for cameras with various complex distortions.

CN118982585AActive Publication Date: 2024-11-19江苏华郢智能技术有限公司

Patent Information

Application Number
CN202410977746.1
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-07-22
Publication Date
2024-11-19
Estimated Expiration
2044-07-22

AI Technical Summary

Technical Problem

Existing camera calibration methods are difficult to accurately model complex distortions through physical characteristics, making it difficult to obtain high-precision calibrations in the global scope in industrial applications.

Method used

The nonlinear model of the camera imaging plane to the calibration plate plane map is constructed using B-spline surfaces, and the camera linear model is generated through an ideal perspective projection model, and the internal and external parameter matrices are solved respectively to avoid parameterized modeling of distortion physical characteristics.

Benefits of technology

It realizes high-precision camera calibration in the global range, which can effectively suppress the impact of complex distortions on calibration results, is convenient to operate, and is suitable for cameras with various complex distortions.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118982585A_ABST
    Figure CN118982585A_ABST
Patent Text Reader

Abstract

The invention relates to a camera calibration method, device and equipment and a storage medium, and is applied to the technical field of machine vision, and the method comprises the steps: controlling a camera to obtain calibration plate images of a calibration plate at different preset positions, and generating a calibration plate image set, the calibration plate images being images formed on a camera imaging plane; constructing a camera nonlinear model for mapping from a camera imaging plane to a calibration plate plane by using the B-spline curved surface, and solving the camera nonlinear model to obtain a B-spline curved surface group after fitting; and constructing a perspective projection model of the camera under an ideal condition, generating a camera linear model, and solving the camera linear model to obtain an internal parameter matrix and an external parameter matrix of the camera linear model. The method has the technical effects that the influence of complex distortion on a calibration result is effectively suppressed, and the calibration precision is improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of machine vision technology, and in particular to a camera calibration method, device, equipment and storage medium. Background Art

[0002] Camera calibration is a key link in machine vision technology. Its purpose is to obtain the conversion relationship between the image sensor's pixels and the actual three-dimensional space. Accurate camera calibration is essential for realizing machine vision applications such as high-precision positioning and measurement. In actual industrial applications, there may be some complex lens distortions in the camera's imaging optical path, such as the glass protective cover used to protect the lens during welding, the front windshield of a car, etc. Therefore, a high-precision camera calibration method that can suppress complex distortions can expand the application of machine vision technology in complex industrial environments and improve the precision and quality of processing and manufacturing.

[0003] The commonly used calibration method currently requires parameterized modeling based on the physical properties of the lens, using a small number of parameters representing radial distortion and tangential distortion to model the distortion model of the camera's global field of view. However, the commonly used camera calibration method currently has difficulty in accurately modeling the complex distortions produced by the camera imaging process in actual industrial applications through physical properties, making it difficult to obtain high calibration accuracy in the global range. Summary of the invention

[0004] In order to help solve the problem that traditional camera calibration methods find it difficult to accurately model the complex distortions produced by the camera imaging process in actual industrial applications through physical properties, resulting in difficulty in obtaining high precision on a global scale, the present application provides a camera calibration method, apparatus, device and storage medium.

[0005] In a first aspect, the present application provides a camera calibration method, which adopts the following technical solution: the method is applied to a camera calibration system, the camera calibration system includes a calibration plate, the calibration plate includes a plurality of marking points, and the method includes:

[0006] Controlling the camera to obtain the calibration plate images of the calibration plate at different preset positions, and generating a calibration plate image set, wherein the calibration plate images are images formed on the camera imaging plane;

[0007] A camera nonlinear model for mapping the camera imaging plane to the calibration plate plane is constructed using B-spline surfaces, and the camera nonlinear model is solved to obtain a fitted B-spline surface group;

[0008] A perspective projection model of the camera under ideal conditions is constructed to generate a camera linear model, and the camera linear model is solved to obtain an intrinsic parameter matrix and an extrinsic parameter matrix of the camera linear model.

[0009] In a specific implementation scheme, the coordinate system where the calibration plate plane is located is the calibration plate plane coordinate system, and the calibration plate plane coordinate system includes two directions of the X axis and the Y axis. The coordinate system where the camera imaging plane is located is the imaging plane coordinate system, and the imaging plane coordinate system includes two directions of the U axis and the V axis.

[0010] The camera nonlinear model includes:

[0011]

[0012] Among them, P k,q Represents the coordinates of the control points on the B-spline surface, n G and m G Respectively represent the number of control points in the U-axis direction and the V-axis direction of the imaging plane coordinate system, (u, v) represents the pixel coordinates in the imaging plane coordinate system, u m represents the maximum value of the pixel coordinate (u, v) in the U-axis direction of the imaging plane coordinate system, v m represents the maximum value of the pixel coordinate (u, v) in the V-axis direction of the imaging plane coordinate system, and Respectively represent the pixel coordinates (u, v) according to u m and v m The coordinate components on the U and V axes after normalization, represents the coordinates of the calibration plate plane coordinate system corresponding to the pixel coordinates (u, v); p represents the order of the B-spline, and They represent the U-axis p-order basis function and the V-axis p-order basis function of the B-spline surface respectively;

[0013] The U-axis direction of the imaging plane coordinate system has a node vector U, and the V-axis direction of the calibration plate image coordinate system has a node vector V.

[0014] In a specific implementation scheme, solving the camera nonlinear model to obtain a fitted B-spline surface group includes:

[0015] Identify a number of the marker points in the calibration plate image, detect and calculate the marker point normalized pixel coordinates of the marker points in the imaging plane coordinate system, and the marker point calibration coordinates of the marker points in the calibration plate plane coordinate system;

[0016] Solving the camera nonlinear model according to the normalized pixel coordinates of the marker points and the calibrated coordinates of the marker points, and generating a fitted B-spline surface;

[0017] The camera nonlinear model is constructed and solved for each image in the calibration plate image set to generate a fitted B-spline surface group.

[0018] In a specific implementation scheme, solving the camera nonlinear model according to the normalized pixel coordinates of the marker points and the calibrated coordinates of the marker points and generating a fitted B-spline surface includes:

[0019] According to the preset n G and m G The value of n is constructed on the calibration plate image. G +1 row and m G +1 column of the grid, calculating the normalized coordinates of the intersection points of the grid in the imaging plane coordinate system, and generating the normalized pixel coordinates of the grid points;

[0020] Calculating the node vector U and the node vector V according to the normalized pixel coordinates of the grid points;

[0021] Calculate the U-axis p-order basis function according to the node vector U, calculate the V-axis p-order basis function according to the node vector V, and construct a basis function matrix according to the calculated U-axis p-order basis function and V-axis p-order basis function;

[0022] Constructing a marker point matrix according to the calibrated coordinates of the marker points, and constructing a control point matrix to be solved according to the coordinates of the control points to be solved;

[0023] The control point matrix to be solved is constructed by multiplying the inverse matrix of the basis function matrix with the marker point matrix to obtain a surface solution matrix equation;

[0024] The surface solution matrix equation is solved by the least square method to obtain a control point matrix and generate a fitted B-spline surface.

[0025] In a specific implementation scheme, the coordinate system where the calibration plate plane is located is the calibration plate coordinate plane system, and the calibration plate plane coordinate system includes two directions of the X axis and the Y axis. The coordinate system where the camera imaging plane is located is the imaging plane coordinate system, and the imaging plane coordinate system includes two directions of the U axis and the V axis.

[0026] The perspective projection model of the camera in the ideal case includes:

[0027] sQ′0=A(R i Q′ i +T i )

[0028] Where s represents the scale factor, A represents the intrinsic parameter matrix of the camera linear model, represents the external parameter rotation matrix of the calibration plate at the i-th position, represents the external parameter translation matrix of the calibration plate at the i-th position; Q′ irepresents the homogeneous coordinates of the intersection of the imaging light of a single pixel in the calibration plate image and the calibration plate plane, and Q′0 represents the homogeneous coordinates of the intersection of the imaging light of a single pixel in the calibration plate image and the virtual imaging plane.

[0029] In a specific implementation scheme, solving the camera linear model to obtain an intrinsic parameter matrix and an extrinsic parameter matrix of the camera linear model includes:

[0030] Setting any calibration plate plane among the calibration plate planes as a virtual imaging plane, and setting the center corresponding to the virtual imaging plane as a virtual center;

[0031] Randomly sampling a preset number of pixel points in the calibration plate image, obtaining pixel ray intersection points between the preset number of pixel points and all the calibration plate planes, wherein the pixel ray intersection points include pixel ray virtual intersection points and pixel ray non-virtual intersection points;

[0032] Calculating homogeneous coordinates of the virtual intersection point of the pixel light and the non-virtual intersection point of the pixel light according to the solved camera nonlinear model;

[0033] A transformation relationship between the homogeneous coordinates of the virtual intersection point of the pixel light and the non-virtual intersection point of the pixel light is constructed by using a homography transformation, and a result of a homography transformation matrix is ​​estimated;

[0034] Constructing an internal parameter solution matrix equation through the homography transformation matrix and the internal parameter matrix to be solved, solving the internal parameter solution matrix equation using the result of the homography transformation matrix, and generating an internal parameter matrix of the camera linear model;

[0035] An extrinsic parameter solution matrix equation is constructed using the homography transformation matrix and the extrinsic parameter matrix to be solved, the extrinsic parameter solution matrix equation is solved using the result of the homography transformation matrix, and an extrinsic parameter matrix of the camera linear model is generated, the extrinsic parameter matrix including an extrinsic rotation matrix and an extrinsic translation matrix.

[0036] In a specific implementation scheme, the internal parameter solution matrix equation includes:

[0037]

[0038] The external parameter solution matrix equation includes:

[0039]

[0040] Among them, h i1 、h i2 and h i3 Respectively represent the three column vectors of the homography transformation matrix, r i1 , r i2 , ri3 Represents the three column vectors of the extrinsic rotation matrix, T i represents the external parameter translation matrix, and C represents the coordinates of the virtual center.

[0041] In a second aspect, the present application provides a camera calibration device, which adopts the following technical solution: the device is applied to a camera calibration system, the camera calibration system includes a calibration plate, the calibration plate includes a plurality of marking points, and the device includes:

[0042] An image acquisition module, used to control the camera to acquire the calibration plate images at different preset positions of the calibration plate and generate a calibration plate image set, wherein the calibration plate images are images formed on the camera imaging plane;

[0043] A nonlinear calibration module is used to construct a camera nonlinear model for mapping the camera imaging plane to the calibration plate plane using a B-spline surface, and solve the camera nonlinear model to obtain a fitted B-spline surface group;

[0044] The linear calibration module is used to construct a perspective projection model of the camera under ideal conditions, generate a camera linear model, and solve the camera linear model to obtain an intrinsic parameter matrix and an extrinsic parameter matrix of the camera linear model.

[0045] In a third aspect, the present application provides a computer device, which adopts the following technical solution: it includes a memory and a processor, and the memory stores a computer program that can be loaded by the processor and execute any of the above-mentioned camera calibration methods.

[0046] In a fourth aspect, the present application provides a computer-readable storage medium, which adopts the following technical solution: storing a computer program that can be loaded by a processor and execute any of the above-mentioned camera calibration methods.

[0047] In summary, this application has the following beneficial technical effects:

[0048] The calibration method of this scheme divides the camera imaging model into two parts, linear and nonlinear, and performs modeling and calibration respectively; in the nonlinear part, the mapping relationship between the imaging plane affected by the distortion and the calibration plate plane can be accurately calibrated by fitting the B-spline surface; in the linear part, the intrinsic and extrinsic parameters of the model are accurately estimated by establishing an ideal perspective projection model; in the modeling and calibration involving both the nonlinear and linear parts, the present invention does not introduce any parameters representing the physical characteristics of the lens distortion, so there is no need to perform special modeling on the physical characteristics of the distortion, and can be generally used for cameras with various complex distortions, and can effectively suppress the influence of the complex distortion on the calibration results; the operation is convenient and has a high calibration accuracy. BRIEF DESCRIPTION OF THE DRAWINGS

[0049] Figure 1is a flow chart of a camera calibration method in an embodiment of the present application;

[0050] Figure 2 is a schematic diagram of a B-spline surface regular grid of a camera nonlinear model in an embodiment of the present application;

[0051] Figure 3 is a schematic diagram of a B-spline surface mapping model of a camera nonlinear model in an embodiment of the present application;

[0052] Figure 4 is a schematic diagram of a perspective projection imaging model of a linear portion of a camera in an embodiment of the present application;

[0053] Figure 5 is a schematic diagram of the result of reconstructing the calibration plate point cloud according to the calibration result in an embodiment of the present application;

[0054] Figure 6 is a schematic diagram of a camera calibration device in an embodiment of the present application;

[0055] Figure 7 It is a schematic diagram used to embody a computer device in an embodiment of the present application.

[0056] Reference numerals: 601, image acquisition module; 602, non-linear calibration module; 603, linear calibration module. DETAILED DESCRIPTION

[0057] The following combination Figure 1-Figure 7 This application is described in further detail.

[0058] The embodiment of the present application discloses a camera calibration method, which can suppress the complex lens distortion generated in the camera imaging optical path. The camera calibration method divides the camera imaging model into two parts, linear and nonlinear, and models and calibrates the linear and nonlinear parts respectively to realize the camera calibration; in the modeling and calibration process of the linear and nonlinear parts of the camera, no parameters of the physical characteristics related to the lens distortion are introduced. Therefore, the camera calibration method does not need to specifically model the physical characteristics of the lens distortion, thereby avoiding the use of the physical characteristics of the distortion to build a lens distortion model, so that high precision can be obtained in the global range, and it can be commonly used for cameras with various complex distortions.

[0059] Camera calibration is a key link in machine vision technology, and its purpose is to obtain the conversion relationship between the pixels of the imaging sensor and the actual three-dimensional space; accurate camera calibration is crucial to achieve high-precision positioning, measurement and other machine vision applications. In actual industrial applications, there may be some complex lens distortions in the imaging optical path of the camera, such as the glass protective cover used to protect the lens during welding, the front windshield of the car, etc. Therefore, a high-precision camera calibration method that can suppress complex distortions can expand the application of machine vision technology in complex industrial environments and improve the precision and quality of processing and manufacturing. The currently commonly used calibration method requires parameterized modeling based on the physical properties of the lens, and a small number of parameters representing radial distortion and tangential distortion are used to model the distortion model of the camera's global field of view. However, the currently commonly used camera calibration method is difficult to accurately model the complex distortions generated by the camera imaging process in actual industrial applications through physical properties, which makes it difficult to obtain high calibration accuracy in the global range. In order to help improve the accuracy of camera calibration and improve the versatility of camera calibration methods, the present application provides a camera calibration method.

[0060] Reference Figure 1 , the method comprises the following steps:

[0061] S10, controlling the camera to obtain calibration plate images at different preset positions of the calibration plate, and generating a calibration plate image set, wherein the calibration plate image is an image formed on the camera imaging plane.

[0062] Specifically, before using this camera calibration method, the user can place the calibration plate in any position and posture within the effective field of view of the camera, and control the camera to collect images of the calibration plate at different positions. Figure 2 , the calibration plate contains multiple black solid circles arranged in rows and columns, and the mark point is the center of the black solid circle. The calibration plate obtains a calibration plate image at one position, and sets multiple calibration plate images obtained at different positions as a calibration plate image set. It should be noted that the obtained calibration plate image is an image formed on the camera imaging plane, and the coordinate system where the calibration plate image is located is also the coordinate system where the camera imaging plane is located.

[0063] S20, using B-spline surfaces to construct a camera nonlinear model that maps the camera imaging plane to the calibration plate plane, and solving the camera nonlinear model to obtain a fitted B-spline surface group.

[0064] Specifically, a nonlinear camera model is constructed by using B-spline surfaces to map the camera imaging plane to the calibration plate plane, and the constructed nonlinear camera model is solved to obtain a fitted B-spline surface group to achieve nonlinear calibration of the camera. In the embodiment of the present application, the distortion part is modeled by constructing a plane-to-plane mapping relationship, thereby avoiding modeling specifically for lens distortion, and further avoiding dependence on the physical properties of lens distortion as much as possible, and achieving high-precision calibration in a global range.

[0065] The camera calibration process involves two coordinate systems, the calibration plate plane coordinate system and the camera imaging plane coordinate system. The coordinate system where the calibration plate plane is located is the calibration plate plane coordinate system, which includes two mutually perpendicular X-axis and Y-axis directions. The coordinate system where the camera imaging plane is located is the imaging plane coordinate system, which includes two mutually perpendicular U-axis and V-axis directions. The camera nonlinear model constructed using B-spline surface can be expressed as:

[0066]

[0067] Among them, P k,q represents the coordinates of the control points on the B-spline surface, P = [X P , Y P ] T , X P and Y P Respectively represent the coordinate components of the control point in the X-axis and Y-axis directions of the calibration plate plane coordinate system; n G and m G They represent the number of control points in the U-axis direction and the V-axis direction of the imaging plane coordinate system, respectively. (u, v) represents the pixel coordinates in the imaging plane coordinate system. m Indicates the maximum value of the pixel coordinate (u, v) in the U-axis direction of the imaging plane coordinate system, v m Indicates the maximum value of the pixel coordinate (u, v) in the V-axis direction of the imaging plane coordinate system. and Respectively represent the pixel coordinates (u, v) according to u m and v m The coordinate components on the U and V axes after normalization, represents the coordinates of the calibration plate plane coordinate system corresponding to the pixel coordinates (u, v); p represents the order of the B-spline, and They respectively represent the U-axis p-order basis function and the V-axis p-order basis function of the B-spline surface; the U-axis direction of the imaging plane coordinate system has a node vector U, and the V-axis direction of the calibration plate image coordinate system has a node vector V.

[0068] The U-axis p-order basis function can be expressed as:

[0069]

[0070] The V-axis p-order basis function can be expressed as:

[0071]

[0072] in, n G +p+1-dimensional elements of the node vector U, is m G +p+1-dimensional elements of the node vector V,

[0073] S30, constructing a perspective projection model of the camera under ideal conditions, generating a camera linear model, and solving the camera linear model to obtain an intrinsic parameter matrix and an extrinsic parameter matrix of the camera linear model.

[0074] Specifically, a perspective projection model of the camera under ideal conditions is constructed to generate a camera linear model. The part of the light that does not enter the lens during the imaging process is regarded as an ideal perspective projection imaging, which is defined as the linear part of the camera model. It can also be understood that when the imaging light is not refracted by the lens, the camera imaging can be regarded as an ideal perspective projection imaging. The imaging area that does not enter the lens can be modeled as the linear part of the imaging model to generate a camera linear model. The camera linear model is solved to obtain the intrinsic parameter matrix and extrinsic parameter matrix of the camera linear model to achieve calibration of the linear part of the camera.

[0075] Ideally, the camera's perspective projection model can be expressed as:

[0076] sQ′0=A(R i Q′ i +T i )

[0077] Where s represents the scale factor, A represents the intrinsic parameter matrix of the camera linear model, represents the external parameter rotation matrix of the calibration plate at the i-th position, represents the external parameter translation matrix of the calibration plate at the i-th position; Q′ i represents the homogeneous coordinates of the intersection of the imaging light of a single pixel in the calibration plate image and the calibration plate plane, Q′i=[X i , Y i , 1] T (i=0, 1, ..., n), X i and Y iThey respectively represent the coordinate components of the X-axis and Y-axis of the intersection of the pixel imaging light in the coordinate system of the i-th group of calibration plate planes, and Q′0 represents the homogeneous coordinates of the intersection of the imaging light of a single pixel in the calibration plate image and the virtual imaging plane, that is, the homogeneous coordinates of the intersection of the imaging light of a single pixel with the calibration plate plane when i=0.

[0078] Finally, the camera calibration is completed by combining the linear calibration results and nonlinear calibration results.

[0079] In the present application scheme, the camera imaging model is divided into two parts, linear and nonlinear, which are modeled and calibrated separately; in the nonlinear part, the mapping relationship between the imaging plane affected by the distortion and the calibration plate plane can be accurately calibrated by fitting the B-spline surface; in the linear part, an ideal perspective projection model is established and the precise parameters of the model can be obtained by solving the model; in the modeling and calibration of both the nonlinear and linear parts, no parameters representing the physical characteristics of the lens distortion are introduced, so there is no need to specifically model the physical characteristics of the distortion, thereby avoiding the use of the physical parameters of the distortion to construct the camera imaging model, effectively suppressing the influence of complex distortion on the calibration results, and being applicable to cameras with various complex distortions; in addition, the camera calibration method of the present scheme is easy to operate and has high calibration accuracy.

[0080] In one embodiment, the step of solving the camera nonlinear model to obtain the fitted B-spline surface group can be specifically performed as follows:

[0081] First, identify several landmark points in the calibration plate image, detect and calculate the normalized pixel coordinates of several landmark points in the imaging plane coordinate system. Where n C Indicates the number of detectable landmarks, sorts the detected landmarks, and determines the landmark calibration coordinates Q of several landmarks in the calibration plate plane coordinate system according to the sorting results Cl =[X Cl , Y Cl ] T , X Cl and Y Cl They respectively represent the coordinate components of the lth marker point in the X-axis and Y-axis directions of the calibration plate plane coordinate system. It should be noted that the technology of collecting the calibration plate image, detecting and calculating the normalized pixel coordinates of the marker points and the method of obtaining the calibration coordinates of the marker points can be directly implemented using existing calculation and detection methods, and the existing technologies used will not be repeated in the embodiments of this application.

[0082] Afterwards, the camera nonlinear model is solved according to the normalized pixel coordinates of the marker points and the calibration coordinates of the marker points. The marker points detected on the calibration plate are converted into control point representations on the B-spline surface, and the B-spline surface model is fitted to generate a fitted B-spline surface. Afterwards, the camera nonlinear model is constructed and solved for each image in the calibration plate image set to generate a fitted B-spline surface group.

[0083] The steps of solving the camera nonlinear model according to the normalized pixel coordinates of the marker points and the calibrated coordinates of the marker points and generating the fitted B-spline surface can be specifically performed as follows:

[0084] First, the user sets n in advance G and m G The system calculates the value of n according to the preset value. G and m G The value of n is constructed on the calibration plate image G +1 row and m G +1 column grid, see Figure 2 As shown, the U axis and V axis are the coordinate axes of the imaging plane coordinate system, the X axis and Y axis are the coordinate axes of the calibration plate plane coordinate system, and the normalized coordinates of the intersection of the grid in the imaging plane coordinate system are calculated, and the normalized pixel coordinates of the grid points are generated. The coordinate components of the normalized pixel coordinates of the grid points in the U axis and V axis can be expressed as:

[0085]

[0086] It should be noted that the setting of n G and m G The value of must satisfy (n G +1)×(m G +1)<n C .

[0087] Afterwards, the node vector U and the node vector V are calculated according to the normalized pixel coordinates of the grid points. Taking the node vector U in the U-axis direction as an example, the calculation method of the node elements in the node vector can be expressed as follows:

[0088]

[0089] Similarly, the node vector V in the V-axis direction can be calculated using the above node element calculation formula.

[0090] After that, the node elements in the calculated node vector U and node vector V are substituted into the U-axis p-order basis function and the V-axis p-order basis function respectively to calculate the normalized pixel coordinates The corresponding basis function and The value of and The value of constructs the basis function matrix, and the basis function matrix constructed It can be expressed as:

[0091]

[0092] Construct a marker point matrix based on the marker point calibration coordinates Construct the control point matrix to be solved according to the coordinates of the control points to be solved The marker point matrix can also be understood as a data point matrix, which is composed of the marker point coordinates Q cl =[X Cl , Y Cl ] T Assigning values ​​to the matrix, the control point matrix is ​​the matrix to be solved for the position, and the constructed marker point matrix can be expressed as:

[0093]

[0094] The constructed control point matrix can be expressed as:

[0095]

[0096] After the matrix is ​​constructed, the inverse matrix of the basis function matrix is ​​multiplied by the marker matrix to represent the control point matrix to be solved to obtain the surface solution matrix equation. The constructed surface solution matrix equation can be expressed as: D = N -1 Q. Finally, the least square method is used to solve the surface matrix equation, obtain the control point matrix, and generate the fitted B-spline surface.

[0097] Reference Figure 3 , is a schematic diagram of the B-spline surface mapping model. The black solid circles in the figure represent control points, which are used to construct the parameter points of the B-spline surface. The asterisks represent data points, which can also be understood as calibration points. It should be noted that the number of control points is determined by constructing grid intersections on the calibration plate image. The grid intersections are the parameter points for fitting the B-spline surface. The number of control points in the B-spline surface is consistent with the number of grid intersections. In the matrix equation D = N -1 In Q, the control point matrix is ​​an unknown matrix, and the dimension of the control point matrix is ​​the number of grid points (n G +1)×(m G +1), and the number of detectable landmarks determines the dimension of the landmark matrix. Therefore, in order to make the constructed surface solution matrix equation solvable, n is set G and m G The value of needs to satisfy (n G +1)×(m G +1)<<n C .

[0098] In the present application, the mapping relationship between the imaging plane of the camera affected by the distortion and the calibration plate plane can be accurately calibrated by fitting the B-spline surface. In the basis function, according to the recursive characteristic calculation, there are only p+1 basis functions whose values ​​are not 0, so the coordinate Q Cl The calculation is obtained by interpolating (p+1)*(p+1) control points according to their corresponding basis function values, which is expressed as a local nonlinear interpolation; therefore, by moving the position of the control points, the B-spline surface can be locally close to the real mapping relationship. This feature enables the nonlinear part of the camera model to simulate various complex and irregular special distortions; and the position of the control points can be quickly and accurately adjusted by data fitting. The model construction and data fitting methods can accurately obtain the required mapping relationship when the distortion is parameterized. This method is applicable to any single distortion or combined distortion of multiple lenses in the camera imaging process, and can effectively suppress the influence of complex distortion on the calibration results.

[0099] In one embodiment, the step of solving the camera linear model to obtain the intrinsic parameter matrix and the extrinsic parameter matrix of the camera linear model may be specifically performed as follows:

[0100] First, refer to Figure 4 , set any calibration plane in the calibration plane as a virtual imaging plane, i=0 for the virtual imaging plane, and the center corresponding to the virtual imaging plane is the virtual center. The virtual center can also be understood as the imaging light of all pixels converging at a set virtual center under the perspective projection assumption. The virtual center can be expressed as: C=[C x , C y , C z ] T , where C x , C y and C z They represent the coordinate components of the virtual center in the X-axis, Y-axis, and Z-axis directions in the camera coordinate system of the linear part. It should be noted that A represents the intrinsic parameter matrix of the imaging model of the linear part of the camera. The relationship between the intrinsic parameter matrix A and the virtual center can be expressed as:

[0101]

[0102] After that, a preset number of pixels are randomly sampled in the calibration plate image, and the number of pixels n obtained is P (n P>4), obtain the pixel light intersections of a preset number of pixel points and all calibration planes, the pixel light intersections include the pixel light virtual intersections and the pixel light non-virtual intersections; wherein the pixel light non-virtual intersections can be understood as the intersections of the pixel imaging light and the calibration plane excluding the virtual imaging plane, and the pixel light virtual intersections can be understood as the intersections of the pixel imaging light and the virtual imaging plane of i=0. According to the camera nonlinear model of the B-spline surface obtained by solving, calculate the homogeneous coordinates of the pixel light virtual intersections and the pixel light non-virtual intersections, that is, the homogeneous coordinates Q′ of the pixel light intersections ij =[X ii , Y ij , 1] T (i=0,1,…,n)(j=1,2,…,n P ).

[0103] The homography transformation is used to construct the transformation relationship between the homogeneous coordinates of the virtual intersection point of the pixel ray and the non-virtual intersection point of the pixel ray, and the result of the homography transformation matrix is ​​estimated; specifically, the intersection point Q′ on the calibration plate plane where i≠0 is constructed by the homography transformation ij =[X ij , Y ij , 1] T (i=1,2,...,n)(j=1,2,...,n p ) to the intersection point Q′ on the virtual imaging plane of i=0 0j =[X 0j , Y 0j , 1] T (j=1,2,…,n p ), the conversion relationship can be expressed as:

[0104] s[X 0j Y 0j 1] T =H i [X ij Y ij 1] T

[0105] in, represents the homography matrix from the calibration plate plane to the virtual imaging plane (i is 0), except for the virtual imaging plane (i is not 0), h i1 、h i2 and h i3 They respectively represent the three column vectors of the homography transformation matrix; thereafter, the homography transformation matrix can be estimated by the existing estimation method to obtain the result of the homography transformation matrix.

[0106] Finally, the intrinsic parameter solution matrix equation and the extrinsic parameter solution matrix equation are constructed and the intrinsic parameter matrix and extrinsic parameter matrix of the camera linear model are calculated. Specifically, the intrinsic parameter solution matrix equation is constructed through the homography transformation matrix and the intrinsic parameter matrix to be solved. The intrinsic parameter solution matrix equation can be expressed as:

[0107]

[0108] The result of the homography transformation matrix is ​​used to solve the intrinsic parameter solution matrix equation, and the intrinsic parameter matrix of the camera linear model is generated. The coordinate C of the virtual center is obtained by solving the relationship between the intrinsic parameter matrix and the virtual center. The extrinsic parameter solution matrix equation is constructed by the homography transformation matrix and the extrinsic parameter matrix to be solved. The constructed extrinsic parameter solution matrix equation can be expressed as:

[0109]

[0110] Among them, h i1 、h i2 and h i3 Respectively represent the three column vectors of the homography transformation matrix, r i1 , r i2 , r i3 Represents the three column vectors of the extrinsic rotation matrix, T i represents the external parameter translation matrix, and C represents the coordinates of the virtual center.

[0111] The result of the homography transformation matrix is ​​used to solve the extrinsic matrix equation and generate the extrinsic matrix of the camera linear model. The extrinsic matrix includes the extrinsic rotation matrix R i (i=1, 2, ..., n) and the external parameter translation matrix T i (i=1, 2, ..., n)

[0112] In the present application scheme, the linear part is calibrated and an ideal perspective projection model is established to accurately estimate the intrinsic and extrinsic parameters of the model. In addition, the modeling of the linear part does not use distortion-related parameters, so there is no need to specifically model the distortion. It can be used for cameras with various complex distortions and can effectively suppress the influence of complex distortion on the calibration results.

[0113] It should be noted that in the embodiments of the present application, error detection is performed on the verification camera calibration method through experiments; specifically, the camera calibration method is used to calibrate a camera equipped with a complementary metal oxide semiconductor photosensitive chip, the camera has a resolution of 720×540, and is equipped with a perspective projection lens with a focal length of 10mm, and an irregular curved lens is attached in front of the lens to simulate the complex distortion caused by glass protective covers in actual applications. In order to verify the calibration results, firstly, according to the parameters obtained by calibration, a total of 30 groups of calibration plate images are reconstructed into a three-dimensional point cloud in the camera coordinate system. The reconstruction method can be specifically as follows: First, the three-dimensional coordinates [X, Y, 0]T of each calibration plate plane coordinate system corresponding to each pixel are calculated by B-spline surface parameters and camera nonlinear model, and then converted to the camera coordinate system by extrinsic rotation matrix and extrinsic translation matrix, calculated as: [X0 Y0 Z0] T =R[XY 0] T +T;

[0114] Among them, X0, Y0 and Z0 represent the coordinate components of the point on the calibration plate plane in the X-axis, Y-axis and Z-axis directions of the camera coordinate system; the reconstruction result refers to Figure 5 , accurately restoring the position and posture of the calibration plate, which shows that this calibration method can be used to calibrate cameras with complex distortion.

[0115] In addition, 5 landmark points were selected from each of the 30 calibration plates, and the average reprojection error was calculated based on the camera parameters calibrated by the camera calibration method. The calculation method is:

[0116]

[0117] Among them, Q′ i,j =[X i,j , Y i,j , 1] T represents the homogeneous coordinates of the marker point projected on the virtual imaging plane, Q′ Ci,j =[X Ci,j , Y Ci,j , 1] T It represents the true value of the homogeneous coordinates of the landmark points in the coordinate system of the calibration plate obtained by sorting the landmark points, H l Represents the first two column vectors r of the calibrated internal parameter matrix A and external parameter rotation matrix i1 and r i2 And the external parameter translation matrix T i The obtained homography matrix can be calculated as follows:

[0118] H i =A[r i1 r i2 T i ]

[0119] The average reprojection error obtained through the above calculation is 0.00492mm; as a comparison, the camera calibration method in the traditional OpenCV algorithm library is used to calibrate the above camera, and the reprojection error calculated by the same method is 0.06104mm. The reprojection error obtained by calibrating the camera with complex distortion using this method is significantly lower than the reprojection error using the OpenCV method, indicating that this method can better suppress the influence of complex distortion on the camera calibration accuracy.

[0120] Figure 1 FIG. 1 is a flow chart of a camera calibration method in one embodiment. It should be understood that although Figure 1 The steps in the flowchart are shown in sequence as indicated by the arrows, but the steps are not necessarily executed in the order indicated by the arrows; unless otherwise specified in this document, there is no strict order restriction for the execution of the steps, and the steps may be executed in other orders; and Figure 1 At least part of the steps may include multiple sub-steps or multiple stages. These sub-steps or stages are not necessarily executed at the same time, but can be executed at different times. The execution order of these sub-steps or stages is not necessarily sequential, but can be executed in turn or alternately with other steps or at least part of the sub-steps or stages of other steps.

[0121] Based on the above method, an embodiment of the present application also discloses a camera calibration device.

[0122] Reference Figure 6 , the device includes the following modules:

[0123] The image acquisition module 601 is used to control the camera to acquire the calibration plate images at different preset positions of the calibration plate and generate a calibration plate image set, where the calibration plate images are images formed on the camera imaging plane;

[0124] The nonlinear calibration module 602 is used to construct a camera nonlinear model for mapping the camera imaging plane to the calibration plate plane using B-spline surfaces, and solve the camera nonlinear model to obtain a fitted B-spline surface group;

[0125] The linear calibration module 603 is used to construct a perspective projection model of the camera under ideal conditions, generate a camera linear model, and solve the camera linear model to obtain an intrinsic parameter matrix and an extrinsic parameter matrix of the camera linear model.

[0126] In one embodiment, the coordinate system where the calibration plate plane is located is the calibration plate plane coordinate system, the calibration plate plane coordinate system includes two directions of the X axis and the Y axis, the coordinate system where the camera imaging plane is located is the imaging plane coordinate system, and the imaging plane coordinate system includes two directions of the U axis and the V axis; in the nonlinear calibration module 602, the camera nonlinear model includes:

[0127]

[0128] Among them, P k,q Represents the coordinates of the control points on the B-spline surface, n G and m G They represent the number of control points in the U-axis direction and the V-axis direction of the imaging plane coordinate system, respectively. (u, v) represents the pixel coordinates in the imaging plane coordinate system. m Indicates the maximum value of the pixel coordinate (uv) in the U-axis direction of the imaging plane coordinate system, v m Indicates the maximum value of the pixel coordinate (u, v) in the V-axis direction of the imaging plane coordinate system. and Respectively represent the pixel coordinates (u, v) according to u m and v m The coordinate components on the U and V axes after normalization, represents the coordinates of the calibration plate plane coordinate system corresponding to the pixel coordinates (u, v); p represents the order of the B-spline, and They respectively represent the U-axis p-order basis function and the V-axis p-order basis function of the B-spline surface; the U-axis direction of the imaging plane coordinate system has a node vector U, and the V-axis direction of the calibration plate image coordinate system has a node vector V.

[0129] In one embodiment, the nonlinear calibration module 602 is specifically used to identify a number of marker points in the calibration plate image, detect and calculate the normalized pixel coordinates of the marker points of the marker points in the imaging plane coordinate system, and the calibration coordinates of the marker points of the marker points in the calibration plate plane coordinate system; solve the camera nonlinear model according to the normalized pixel coordinates of the marker points and the calibration coordinates of the marker points, and generate a fitted B-spline surface; construct and solve the camera nonlinear model for each image in the calibration plate image set, and generate a fitted B-spline surface group.

[0130] In one embodiment, the nonlinear calibration module 602 is specifically configured to: G and m G The value of n is constructed on the calibration plate image. G +1 行 and m G+1 column grid, calculate the normalized coordinates of the intersection of the grid in the imaging plane coordinate system, and generate the normalized pixel coordinates of the grid points; calculate the node vector U and the node vector V according to the normalized pixel coordinates of the grid points; calculate the U-axis p-order basis function according to the node vector U, calculate the V-axis p-order basis function according to the node vector V, and construct the basis function matrix according to the calculated U-axis p-order basis function and V-axis p-order basis function; construct the marker point matrix according to the calibration coordinates of the marker points, and construct the control point matrix to be solved according to the coordinates of the control points to be solved; use the inverse matrix of the basis function matrix to multiply the marker point matrix to express the control point matrix to be solved to obtain the surface solution matrix equation; use the least squares method to solve the surface solution matrix equation, obtain the control point matrix, and generate the fitted B-spline surface.

[0131] In one embodiment, the coordinate system where the calibration plate plane is located is the calibration plate coordinate plane system, the calibration plate plane coordinate system includes two directions of the X axis and the Y axis, the coordinate system where the camera imaging plane is located is the imaging plane coordinate system, and the imaging plane coordinate system includes two directions of the U axis and the V axis; in the linear calibration module 603, the perspective projection model of the camera under ideal circumstances includes:

[0132] sQ′0=A(R i Q′ i +T i )

[0133] Among them, s represents the scale factor, A represents the intrinsic parameter matrix of the camera linear model, represents the external parameter rotation matrix of the calibration plate at the i-th position, represents the external parameter translation matrix of the calibration plate at the i-th position; Q′ i represents the homogeneous coordinates of the intersection of the imaging light of a single pixel in the calibration plate image and the calibration plate plane, and Q′0 represents the homogeneous coordinates of the intersection of the imaging light of a single pixel in the calibration plate image and the virtual imaging plane.

[0134] In one embodiment, the linear calibration module 603 is specifically used to set any calibration plate plane in the calibration plate plane as a virtual imaging plane, and the center corresponding to the virtual imaging plane is the virtual center; randomly sample a preset number of pixel points in the calibration plate image, and obtain the pixel light intersections of the preset number of pixel points and all the calibration plate planes, where the pixel light intersections include the pixel light virtual intersections and the pixel light non-virtual intersections; calculate the homogeneous coordinates of the pixel light virtual intersections and the pixel light non-virtual intersections according to the solved camera nonlinear model; and construct the pixel light virtual intersections by using homography transformation. The transformation relationship between the homogeneous coordinates of the point and the non-virtual intersection of the pixel light rays is obtained, and the result of the homography transformation matrix is ​​estimated; the intrinsic parameter solution matrix equation is constructed through the homography transformation matrix and the intrinsic parameter matrix to be solved, and the intrinsic parameter solution matrix equation is solved using the result of the homography transformation matrix, and the intrinsic parameter matrix of the camera linear model is generated; the extrinsic parameter solution matrix equation is constructed through the homography transformation matrix and the extrinsic parameter matrix to be solved, and the extrinsic parameter solution matrix equation is solved using the result of the homography transformation matrix, and the extrinsic parameter matrix of the camera linear model is generated, and the extrinsic parameter matrix includes the extrinsic rotation matrix and the extrinsic translation matrix.

[0135] In one embodiment, solving the matrix equation for the internal parameters in the linear calibration module 603 includes:

[0136]

[0137] The external parameter solution matrix equation includes:

[0138]

[0139] Among them, h i1 、h i2 and h i3 Represents the three column vectors of the homography transformation matrix, r i1 , r i2 , r i3 Represents the three column vectors of the extrinsic rotation matrix, T i represents the external parameter translation matrix, and C represents the coordinates of the virtual center.

[0140] The camera calibration device provided in the embodiment of the present application can be applied to the camera calibration method provided in the above embodiment. For relevant details, refer to the above method embodiment. The implementation principle and technical effect are similar and will not be repeated here.

[0141] It should be noted that: the camera calibration device provided in the embodiment of the present application only uses the division of the above-mentioned functional modules / functional units as an example when performing camera calibration. In actual applications, the above-mentioned functions can be assigned to different functional modules / functional units as needed, that is, the internal structure of the camera calibration device is divided into different functional modules / functional units to complete all or part of the functions described above. In addition, the implementation method of the camera calibration method provided in the above method embodiment and the implementation method of the camera calibration device provided in this embodiment belong to the same concept. The specific implementation process of the camera calibration device provided in this embodiment is detailed in the above method embodiment, which will not be repeated here.

[0142] The embodiment of the present application also discloses a computer device.

[0143] Specifically, if Figure 7 As shown, the computer device can be a computer device such as a desktop computer, a laptop computer, a PDA, and a cloud server. The computer device may include, but is not limited to, a processor and a memory. The processor and the memory may be connected via a bus or otherwise. The processor may be a central processing unit (CPU). The processor may also be other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, graphics processors (GPU), embedded neural network processors (NPU) or other dedicated deep learning coprocessors, discrete gates or transistor logic devices, discrete hardware components and other chips, or a combination of the above-mentioned various chips.

[0144] As a non-transient computer-readable storage medium, the memory can be used to store non-transient software programs, non-transient computer executable programs and modules, such as program instructions / modules corresponding to the methods in the above-mentioned embodiments of the present application. The processor executes various functional applications and data processing of the processor by running the non-transient software programs, instructions and modules stored in the memory, that is, the method in the above-mentioned method implementation is realized. The memory may include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application required for at least one function; the data storage area may store data created by the processor, etc. In addition, the memory may include a high-speed random access memory, and may also include a non-transient memory, such as at least one disk storage device, a flash memory device, or other non-transient solid-state storage device. In some embodiments, the memory may optionally include a memory remotely arranged relative to the processor, and these remote memories may be connected to the processor via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network and a combination thereof.

[0145] The embodiment of the present application also discloses a computer-readable storage medium.

[0146] Specifically, a computer-readable storage medium is used to store a computer program, and when the computer program is executed by a processor, the method in the above-mentioned method implementation is implemented. Those skilled in the art will understand that the implementation of all or part of the process in the above-mentioned implementation method of the present application can be completed by instructing the relevant hardware through a computer program, and the program can be stored in a computer-readable storage medium, and the program, when executed, may include the process of the implementation of the above-mentioned methods. Among them, the storage medium may be a disk, an optical disk, a read-only memory (ROM), a random access memory (RAM), a flash memory (Flash Memory), a hard disk (Hard Disk Drive, abbreviated as: HDD) or a solid-state drive (SSD), etc.; the storage medium may also include a combination of the above-mentioned types of memory.

[0147] This specific embodiment is merely an explanation of the present invention and is not a limitation of the present invention. After reading this specification, those skilled in the art may make non-creative modifications to the present embodiment as needed. However, as long as they are within the scope of the claims of the present invention, they are protected by the patent law.

Claims

1. A camera calibration method, Features: The method is applied to a camera calibration system, the camera calibration system comprises a calibration plate, the calibration plate comprises a plurality of marking points, and the method comprises: Controlling the camera to obtain the calibration plate images of the calibration plate at different preset positions, and generating a calibration plate image set, wherein the calibration plate images are images formed on the camera imaging plane; A camera nonlinear model for mapping the camera imaging plane to the calibration plate plane is constructed using B-spline surfaces, and the camera nonlinear model is solved to obtain a fitted B-spline surface group; A perspective projection model of the camera under ideal conditions is constructed to generate a camera linear model, and the camera linear model is solved to obtain an intrinsic parameter matrix and an extrinsic parameter matrix of the camera linear model.

2. The method according to claim 1, Features: The coordinate system where the calibration plate plane is located is the calibration plate plane coordinate system, and the calibration plate plane coordinate system includes two directions, the X-axis and the Y-axis. The coordinate system where the camera imaging plane is located is the imaging plane coordinate system, and the imaging plane coordinate system includes two directions, the U-axis and the V-axis: The camera nonlinear model includes: Among them, P k,q Represents the coordinates of the control points on the B-spline surface, n G and m G Respectively represent the number of control points in the U-axis direction and the V-axis direction of the imaging plane coordinate system, (u, v) represents the pixel coordinates in the imaging plane coordinate system, u m represents the maximum value of the pixel coordinate (u, v) in the U-axis direction of the imaging plane coordinate system, v m represents the maximum value of the pixel coordinate (u, v) in the V-axis direction of the imaging plane coordinate system, and Respectively represent the pixel coordinates (u, v) according to u m and v m The coordinate components on the U and V axes after normalization, represents the coordinates of the calibration plate plane coordinate system corresponding to the pixel coordinates (u, v); p represents the order of the B-spline, and They represent the U-axis p-order basis function and the V-axis p-order basis function of the B-spline surface respectively; The U-axis direction of the imaging plane coordinate system has a node vector U, and the V-axis direction of the calibration plate image coordinate system has a node vector V.

3. The method according to claim 2, Features: The B-spline surface group obtained by solving the camera nonlinear model includes: Identify a number of the marker points in the calibration plate image, detect and calculate the marker point normalized pixel coordinates of the marker points in the imaging plane coordinate system, and the marker point calibration coordinates of the marker points in the calibration plate plane coordinate system; Solving the camera nonlinear model according to the normalized pixel coordinates of the marker points and the calibrated coordinates of the marker points, and generating a fitted B-spline surface; The camera nonlinear model is constructed and solved for each image in the calibration plate image set to generate a fitted B-spline surface group.

4. The method according to claim 3, Features: The step of solving the camera nonlinear model according to the normalized pixel coordinates of the marker points and the calibrated coordinates of the marker points and generating a fitted B-spline surface comprises: According to the preset n G and m G The value of n is constructed on the calibration plate image. G +1 row and m G +1 column of the grid, calculating the normalized coordinates of the intersection points of the grid in the imaging plane coordinate system, and generating the normalized pixel coordinates of the grid points; Calculating the node vector U and the node vector V according to the normalized pixel coordinates of the grid points; Calculate the U-axis p-order basis function according to the node vector U, calculate the V-axis p-order basis function according to the node vector V, and construct a basis function matrix according to the calculated U-axis p-order basis function and V-axis p-order basis function; Constructing a marker point matrix according to the calibrated coordinates of the marker points, and constructing a control point matrix to be solved according to the coordinates of the control points to be solved; The control point matrix to be solved is constructed by multiplying the inverse matrix of the basis function matrix with the marker point matrix to obtain a surface solution matrix equation; The surface solution matrix equation is solved by the least square method to obtain a control point matrix and generate a fitted B-spline surface.

5. The method according to claim 1, Features: The coordinate system where the calibration plate plane is located is the calibration plate coordinate plane system, and the calibration plate plane coordinate system includes two directions of the X axis and the Y axis. The coordinate system where the camera imaging plane is located is the imaging plane coordinate system, and the imaging plane coordinate system includes two directions of the U axis and the V axis. The perspective projection model of the camera in the ideal case includes: sQ′ 0 =A(R i Q′ i +T i ) Where s represents the scale factor, A represents the intrinsic parameter matrix of the camera linear model, represents the external parameter rotation matrix of the calibration plate at the i-th position, represents the external parameter translation matrix of the calibration plate at the i-th position; Q′ i represents the homogeneous coordinates of the intersection of the imaging light of a single pixel in the calibration plate image and the calibration plate plane, Q′ 0 The homogeneous coordinates representing the intersection of the imaging light of a single pixel in the calibration plate image and the virtual imaging plane.

6. The method according to claim 5, Features: The step of solving the camera linear model to obtain an internal parameter matrix and an external parameter matrix of the camera linear model includes: Setting any calibration plate plane among the calibration plate planes as a virtual imaging plane, and setting the center corresponding to the virtual imaging plane as a virtual center; Randomly sampling a preset number of pixel points in the calibration plate image, obtaining pixel ray intersection points between the preset number of pixel points and all the calibration plate planes, wherein the pixel ray intersection points include pixel ray virtual intersection points and pixel ray non-virtual intersection points; Calculating homogeneous coordinates of the virtual intersection point of the pixel light and the non-virtual intersection point of the pixel light according to the solved camera nonlinear model; A transformation relationship between the homogeneous coordinates of the virtual intersection point of the pixel light and the non-virtual intersection point of the pixel light is constructed by using a homography transformation, and a result of a homography transformation matrix is ​​estimated; Constructing an internal parameter solution matrix equation through the homography transformation matrix and the internal parameter matrix to be solved, solving the internal parameter solution matrix equation using the result of the homography transformation matrix, and generating an internal parameter matrix of the camera linear model; An extrinsic parameter solution matrix equation is constructed using the homography transformation matrix and the extrinsic parameter matrix to be solved, the extrinsic parameter solution matrix equation is solved using the result of the homography transformation matrix, and an extrinsic parameter matrix of the camera linear model is generated, the extrinsic parameter matrix including an extrinsic rotation matrix and an extrinsic translation matrix.

7. The method according to claim 6, Features: The internal parameter solution matrix equation includes: The external parameter solution matrix equation includes: Among them, h i1 、h i2 and h i3 Respectively represent the three column vectors of the homography transformation matrix, r i1 , r i2 , r i3 Represents the three column vectors of the extrinsic rotation matrix, T i represents the external parameter translation matrix, and C represents the coordinates of the virtual center.

8. A camera calibration device, Features: The device is applied to a camera calibration system, the camera calibration system comprises a calibration plate, the calibration plate comprises a plurality of marking points, and the device comprises: An image acquisition module (601) is used to control the camera to acquire the calibration plate images at different preset positions of the calibration plate and generate a calibration plate image set, wherein the calibration plate images are images formed on the camera imaging plane; A nonlinear calibration module (602) is used to construct a camera nonlinear model for mapping a camera imaging plane to a calibration plate plane using a B-spline surface, and solve the camera nonlinear model to obtain a fitted B-spline surface group; The linear calibration module (603) is used to construct a perspective projection model of the camera under ideal conditions, generate a camera linear model, and solve the camera linear model to obtain an internal parameter matrix and an external parameter matrix of the camera linear model.

9. A computer device, It is characterized in that The method comprises a memory and a processor, wherein the memory stores a computer program which can be loaded by the processor and executes the method according to any one of claims 1 to 7.

10. A computer-readable storage medium, It is characterized in that A computer program is stored which can be loaded by a processor and execute the method according to any one of claims 1 to 7.

Citation Information

Patent Citations

  • Camera calibration method based on uniaxial high-precision displacement platform

    CN110298888A

  • Large-field-of-view camera calibration method based on planar target combination

    CN111179357A

  • Mirror surface body surface three-dimensional measurement method based on parametric curved surface

    CN116202444A

  • Underwater vision camera calibration device and method of non-parameter distortion model

    CN117422776A

  • Measuring Apparatus, Measuring Coordinate Setting Method and Measuring Coordinate Number Calculation Method

    US20110060552A1

Cited By

  • Spectrometer wavelength calibration method and device

    CN120740755A