Benchmark calibration method for visual navigation equipment based on collimator

Through the visual navigation equipment reference calibration method based on parallel light tubes, the target surface feature pattern and virtual control points of parallel light tubes are used to realize high-precision reference calibration of navigation equipment, solving the time-consuming, complex operation and cost in the prior art High problem, suitable for batch operations and improve calibration efficiency.

CN118781206BActive Publication Date: 2024-12-06NAT UNIV OF DEFENSE TECH
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411268029.8
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2024-09-11
Publication Date
2024-12-06
Estimated Expiration
2044-09-11

AI Technical Summary

Technical Problem

The camera calibration and reference calibration methods of existing navigation equipment are time-consuming, complex, high-cost, and are not suitable for batch operations. In particular, traditional camera calibration methods rely on calibration plate accuracy and environmental impact, and the inertial navigation system is costly and easily affected. interference.

Method used

By adopting the reference calibration method of visual navigation equipment based on parallel light tubes, by constructing the reference calibration system of visual navigation equipment, using the feature patterns and virtual control points on the target surface of parallel light tubes, the characteristic direction vector of the target surface of parallel light tubes is obtained through the measurement device. Generate virtual control points, take target images for feature extraction and matching, establish internal and external parameters of the camera, and realize high-precision reference calibration of navigation equipment.

Benefits of technology

It realizes high-precision, low-cost, simple operation reference calibration of navigation equipment, suitable for batch operations, avoids dependence on high-precision rotary tables, improves calibration efficiency and operability, and ensures the clarity and detectability of image feature points. sex.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118781206B_ABST
    Figure CN118781206B_ABST
Patent Text Reader

Abstract

The present application relates to a method for benchmark calibration of visual navigation equipment based on collimator. The method comprises: firstly leveling the calibration equipment; obtaining the direction vector of the target surface feature of the collimator through an angle measuring device, a camera with known internal parameters and other devices and generating virtual control points; installing the navigation equipment to be calibrated; controlling the camera in the navigation equipment to be calibrated to collect the target surface image; extracting features from the target surface image; calibrating the internal parameters of the navigation equipment camera according to the virtual control points and the corresponding feature points; calculating the position and posture relationship between the camera coordinate system and the target surface of the collimator using the obtained image and the internal parameters obtained by calibration, and converting it into the position and posture relationship between the camera coordinate system and the navigation equipment benchmark to complete the benchmark calibration. The method has high calibration accuracy, simple operation and low cost.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the technical field of camera calibration and reference calibration, and in particular to a reference calibration method for visual navigation equipment based on a collimator. Background Art

[0002] In the process of visual navigation, the navigation device uses the orientation information of the target in the image to adjust the reference posture of the body to achieve precise guidance. In order to accurately determine the orientation of the image target in the navigation device reference, it is necessary to perform high-precision camera calibration and reference calibration on the camera of the navigation device. According to the different reference information used in the calibration process, the camera calibration method is divided into traditional camera calibration method, camera calibration method based on active vision and self-calibration method. The traditional camera calibration method uses a target with known geometric information as a calibration plate, such as a chessboard calibration plate, a solid circle calibration plate, etc., extracts the characteristic corner points in the target, and realizes camera calibration by constructing the relationship equation between the two-dimensional pixel coordinates of the characteristic corner points and the three-dimensional world coordinates. This method is relatively mature, robust and simple in process. The disadvantage is that the calibration accuracy depends on the accuracy of the calibration plate and is greatly affected by the environment. The camera calibration method based on active vision does not require a calibration plate, and uses known motion information for calibration, such as controlling the camera or the object to be measured to perform special movements, and realizing camera calibration through motion constraints. This method is robust, but the system cost is high and the experimental conditions are high. Self-calibration methods usually perform camera calibration based on geometric constraints between images, such as epipolar constraints. This method can complete calibration tasks in complex environments, but the computational cost is high and the accuracy depends on the initial value. Currently, most navigation equipment camera calibration methods use traditional camera calibration methods, which achieve high-precision calibration of internal parameters by collecting images of planar targets multiple times. However, existing calibration methods are time-consuming and not suitable for batch operations.

[0003] At present, the main methods of posture calibration include inertial navigation calibration and visual calibration. The inertial navigation system uses accelerometers and gyroscopes to sense the direction and posture changes of objects, but complex initial calibration is required before using the inertial navigation. In addition, the inertial navigation system is expensive and susceptible to electromagnetic interference, making it unsuitable for batch calibration of navigation equipment. Visual calibration obtains posture parameters by optically imaging the target and solving the correspondence between the three-dimensional spatial coordinates of the same-name points and the two-dimensional pixel coordinates. It has high accuracy and can be visualized. At present, the benchmark calibration of navigation equipment is mainly carried out through visual calibration, but a high-precision turntable is required to provide the angle transformation relationship between the benchmark and the camera. The operation is complicated, the calibration time is long, and it is heavily dependent on the high-precision turntable.

[0004] In summary, the camera calibration and benchmark calibration tasks of navigation equipment urgently require a calibration method with high calibration accuracy, simple operation, low cost, and batch operation capability. Summary of the invention

[0005] Based on this, it is necessary to provide a reference calibration method for visual navigation equipment based on a parallel light tube, which has high calibration accuracy, simple operation, low cost and can realize batch operation, in order to solve the above technical problems.

[0006] A method for calibrating a visual navigation device based on a collimator, the method comprising:

[0007] Constructing a visual navigation equipment benchmark calibration system; the visual navigation equipment benchmark calibration system includes a calibration frame fixed to the calibration equipment, a collimator, a base for placing the navigation equipment to be calibrated, an illumination light source, and a leveling knob and a leveling lens;

[0008] Adjust the leveling knob to make the substrate parallel to the collimator target surface, turn on the illumination light source, obtain the direction vector of the collimator target surface feature through the measuring device and generate a virtual control point; the measuring device includes an angle measuring device and a camera with known internal parameters;

[0009] The reference surface of the navigation device to be calibrated is placed on the substrate, and the camera in the navigation device to be calibrated is controlled to take a target surface image from the light outlet of the collimator as a calibration image; the star-shaped calibration pattern in the calibration image is extracted, the two-dimensional pixel coordinates of the feature points are read, and each feature point is numbered;

[0010] Matching the two-dimensional pixel coordinates of the feature points with the three-dimensional coordinates of the virtual control points to establish a first corresponding relationship, performing camera calibration on the navigation device to be calibrated based on the first corresponding relationship, and obtaining the camera intrinsic parameters of the navigation device to be calibrated;

[0011] The actual three-dimensional coordinates and number of each feature point on the calibration pattern in the target coordinate system are determined by using the information of the coded mark pattern, and a second corresponding relationship between the three-dimensional point coordinates in the target coordinate system and the two-dimensional feature point coordinates in the image coordinate system is established by matching the number of the actual three-dimensional point with the number of the two-dimensional feature point, and the rotation matrix of the camera of the navigation device to be calibrated relative to the target surface is solved by using the second corresponding relationship and the camera internal parameters of the navigation device to be calibrated;

[0012] Since the collimator target surface is parallel to the base and the reference surface of the navigation device coincides with the base, the collimator target surface is parallel to the reference surface of the navigation device. The rotation matrix of the camera of the navigation device to be calibrated relative to the collimator target surface is converted into the rotation matrix of the camera of the navigation device to be calibrated relative to the reference surface of the navigation device, that is, the external parameters, to realize the calibration of the navigation device reference.

[0013] In one embodiment, the illumination light source is turned on, and the direction vector of the target surface feature of the collimator is obtained by a measuring device and a virtual control point is generated, including:

[0014] There are pre-set star-shaped calibration patterns and coding mark patterns on the target surface of the collimator; the star-shaped calibration pattern is feature extracted according to the feature detection algorithm to obtain feature points in the star-shaped calibration pattern, and each feature is numbered according to the information of the coding mark pattern;

[0015] Turn on the lighting source to ensure that it is stable. Obtain the direction vector of the parallel light tube target surface feature through the measuring equipment, generate a random distance for each feature point, and generate the corresponding virtual control point based on the corresponding feature point direction. The three-dimensional coordinate of the virtual control point is the random distance multiplied by the direction of the feature point to ensure that the number of the virtual control point is consistent with the corresponding feature number.

[0016] In one embodiment, matching the two-dimensional pixel coordinates of the feature point with the three-dimensional coordinates of the virtual control point to establish a first corresponding relationship includes:

[0017] The numbers of the feature points in the calibration image are matched with the numbers of the virtual control points to ensure that each feature point corresponds to the corresponding virtual control point one by one, and the corresponding relationship between the two-dimensional pixel coordinates of the feature point and the three-dimensional coordinates of the virtual control point is established.

[0018] In one embodiment, performing camera calibration on the first correspondence to obtain camera intrinsic parameters of the navigation device to be calibrated includes:

[0019] The first corresponding relationship is solved according to the least square method or other optimization algorithm to obtain the initial values ​​of the camera intrinsic parameters of the navigation device to be calibrated; the initial values ​​of the camera intrinsic parameters are optimized using the bundle adjustment algorithm to obtain the camera intrinsic parameters of the navigation device to be calibrated.

[0020] In one embodiment, the camera internal parameters of the navigation device to be calibrated include equivalent focal length, principal point coordinates, radial distortion parameters, and tangential distortion coefficients.

[0021] In one embodiment, the rotation matrix of the camera of the navigation device to be calibrated relative to the target surface is calculated using the second corresponding relationship and the camera intrinsic parameters of the navigation device to be calibrated, including:

[0022] According to the second corresponding relationship and the intrinsic parameters of the camera of the navigation device to be calibrated, the rotation matrix of the camera of the navigation device to be calibrated relative to the target surface is solved by using an absolute pose estimation algorithm.

[0023] In one embodiment, a collimator is used to assist in calibration by manipulating a leveling knob on the calibration frame. When the crosshairs are observed to coincide with the center through the leveling lens, the calibration device has been leveled, i.e., the target surface of the collimator is parallel to the base of the calibration frame.

[0024] The above-mentioned visual navigation equipment benchmark calibration method based on collimator, this application uses collimator with characteristic pattern and calibration frame with parallel structure to perform navigation equipment benchmark calibration. After obtaining the virtual control point corresponding to the characteristic point, it is only necessary to shoot the collimator target surface once to calibrate the navigation equipment benchmark. The process is simple and easy to operate. According to the property of parallel light beams generated by the collimator, calibration data is provided for the camera of the navigation equipment; at the same time, the designed calibration frame has an independent light source, which avoids the influence of light changes on image quality, and can still provide a stable and controllable calibration environment under complex lighting conditions, ensuring the clarity and detectability of the image feature points. By utilizing the parallel relationship between the collimator target surface and the navigation equipment benchmark surface, the position relationship between the camera and the collimator target surface is converted into the reference position relationship between the camera and the navigation equipment, and the benchmark calibration is realized by the visual calibration method. It avoids the need for a high-precision turntable, saves costs and greatly improves the calibration efficiency. In actual use, after obtaining the direction vector of the parallel light tube target surface feature through angle measuring equipment, cameras with known internal parameters and other equipment and generating virtual control points, the camera in the navigation device to be calibrated can be controlled to take a target surface image, thereby realizing the camera internal parameter calibration and benchmark calibration in the navigation device. The present application has high calibration accuracy, fast calibration speed, low cost, and strong operability, and is suitable for batch calibration of navigation equipment. The entire calibration process has clear steps, standardized operations, and the steps can be fully automated, which is convenient for users to operate according to standard procedures. Even non-professionals can complete the calibration independently and quickly. BRIEF DESCRIPTION OF THE DRAWINGS

[0025] Figure 1 A schematic diagram of a flow chart of a method for benchmark calibration of a visual navigation device based on a collimator in one embodiment;

[0026] Figure 2 Schematic diagram of a visual navigation device benchmark calibration system in one embodiment; wherein (a) is a front view of the visual navigation device benchmark calibration system, and (b) is a side view of the visual navigation device benchmark calibration system;

[0027] Figure 3 A schematic diagram of the key principles of navigation device benchmark calibration in one embodiment. DETAILED DESCRIPTION

[0028] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0029] In one embodiment, Figure 1 As shown, a method for benchmark calibration of a visual navigation device based on a collimator is provided, comprising the following steps:

[0030] Step 102, constructing a visual navigation device benchmark calibration system; the visual navigation device benchmark calibration system includes a calibration frame fixed to the calibration device, a collimator, a base for placing the navigation device to be calibrated, an illumination light source, and a leveling knob and a leveling lens; adjusting the leveling knob to make the base parallel to the collimator target surface, turning on the illumination light source, obtaining the direction vector of the collimator target surface feature through the measuring device and generating a virtual control point; the measuring device includes an angle measuring device and a camera with known internal parameters.

[0031] The visual navigation equipment benchmark calibration system constructed in this application consists of a calibration frame, a base, a collimator, a leveling knob, a leveling lens, and an illumination source, and is installed as follows: Figure 2 (a) and Figure 2 (b); the calibration frame is used to fix the calibration equipment, the collimator is used to assist in calibration, the base is used to place the navigation equipment to be calibrated, the illumination light source is used to provide stable lighting, so as to take higher quality images, and the leveling knob and leveling lens are used to level the calibration equipment; operate the leveling knob on the calibration frame, and when the crosshairs are observed to coincide with the center through the leveling lens, the calibration equipment has been leveled, that is, the collimator target surface is parallel to the calibration frame base. The designed calibration frame has an independent light source, which avoids the influence of light changes on image quality, and can still provide a stable and controllable calibration environment under complex lighting conditions, ensuring the clarity and detectability of image feature points.

[0032] A star-shaped calibration pattern and a coding mark positioning pattern are attached to the target surface of the collimator, wherein the star-shaped calibration pattern facilitates feature extraction, and the coding mark positioning pattern facilitates the positioning of feature points in the real world and assists in numbering; the star-shaped pattern part is subjected to feature extraction through a feature detection algorithm, and each feature is numbered according to the information of the coding mark pattern; the feature direction of each feature point in the camera coordinate system is obtained through an angle measuring device, a camera with known internal parameters and other equipment; a random distance is generated for each feature point to represent its assumed distance in space, and a corresponding virtual control point is generated in combination with the corresponding feature point direction. The three-dimensional coordinates of the virtual control point are the random distance multiplied by the direction of the feature point, ensuring that the numbering of the virtual control point is consistent with the corresponding feature number. The present application utilizes a collimator with a feature pattern and a calibration frame with a parallel structure to perform navigation equipment benchmark calibration. After obtaining the virtual control point corresponding to the feature point, the navigation equipment benchmark can be calibrated by only taking a single shot of the collimator target surface, with a simple process and convenient operation.

[0033] Step 104, placing the reference surface of the navigation device to be calibrated on the substrate, controlling the camera in the navigation device to be calibrated to capture a target surface image from the light outlet of the collimator as a calibration image; extracting features of the star-shaped calibration pattern in the calibration image, reading the two-dimensional pixel coordinates of the feature points and numbering each feature point.

[0034] Install the reference surface of the navigation device to be calibrated on the base of the calibration frame so that they overlap and ensure that the two surfaces are completely aligned. Since the collimator target surface is parallel to the base of the calibration frame, the reference surface of the navigation device is parallel to the collimator target surface, which assists in completing the navigation device reference calibration task.

[0035] The camera in the navigation device to be calibrated is controlled to take a target surface image from the collimator light outlet as a calibration image. Feature extraction is performed on the star pattern portion in the calibration image, the two-dimensional pixel coordinates of the feature points are read, and each feature point is numbered according to the numbering principle in step 102.

[0036] Step 106, matching the two-dimensional pixel coordinates of the feature points with the three-dimensional coordinates of the virtual control points to establish a first corresponding relationship, performing camera calibration of the navigation device to be calibrated on the first corresponding relationship, and obtaining the camera intrinsic parameters of the navigation device to be calibrated.

[0037] Match the feature point numbers in the calibration image with the virtual control point numbers to ensure that each feature point corresponds to the corresponding virtual control point one by one, and establish the correspondence between the two-dimensional pixel coordinates of the feature point and the three-dimensional coordinates of the virtual control point; solve the correspondence between the two-dimensional pixel coordinates of the feature points of some calibration images and the three-dimensional coordinates of the virtual control points, and use the established correspondence to preliminarily estimate the intrinsic parameters of the camera through the least squares method or other optimization algorithms; use the bundle adjustment algorithm to further optimize the initial values ​​of the camera's intrinsic parameters to obtain more accurate intrinsic parameters of the camera to be calibrated. The camera's intrinsic parameters include the equivalent focal length. , , principal point coordinates , , radial distortion parameter , And the tangential distortion coefficient , .

[0038] Step 108, using the information of the coded mark pattern to determine the actual three-dimensional coordinates and number of each feature point on the calibration pattern in the target coordinate system, by matching the number of the actual three-dimensional point with the number of the two-dimensional feature point, establish a second correspondence between the three-dimensional point coordinates in the target coordinate system and the two-dimensional feature point coordinates in the image coordinate system, and use the above second correspondence and the camera internal parameters of the navigation device to be calibrated to solve the rotation matrix of the camera of the navigation device to be calibrated relative to the target surface.

[0039] The geometric information of the coded mark pattern is used to determine the true three-dimensional coordinates of each feature point on the calibration pattern in the target coordinate system. These three-dimensional coordinates are all in the same plane, and a unique number is assigned to each three-dimensional coordinate. By matching the feature point numbers, the correspondence between the three-dimensional coordinates in the world coordinate system and the two-dimensional pixel coordinates of the feature point in the image coordinate system is obtained. Through this correspondence and the known intrinsic parameters of the camera, the absolute pose estimation algorithm is used to solve the rotation matrix of the camera in the target coordinate system.

[0040] Step 110, based on the fact that the collimator target surface is parallel to the base and the reference surface of the navigation device coincides with the base, the collimator target surface is parallel to the reference surface of the navigation device, and the rotation matrix of the camera of the navigation device to be calibrated relative to the collimator target surface is converted into the rotation matrix of the camera of the navigation device to be calibrated relative to the reference surface of the navigation device, i.e., the external parameters, to realize the calibration of the navigation device reference.

[0041] like Figure 3 As shown, the reference plane of the navigation device coincides with the base of the calibration frame, and the target plane of the collimator is parallel to the base of the calibration frame. Therefore, the target plane of the collimator is parallel to the reference plane of the navigation device, and the rotation relationship of the camera relative to the target plane is Convert to the rotation relationship relative to the navigation device reference plane , , thereby achieving the reference calibration of the navigation device. The calibration parameters include the intrinsic parameters of the camera in the navigation device and the extrinsic parameters between the camera coordinate system and the reference coordinate system; among them, the intrinsic parameters of the camera include the equivalent focal length, the principal point coordinates and the distortion coefficient, and the extrinsic parameters between the camera coordinate system and the reference coordinate system are the rotation matrix.

[0042] This application uses the parallel relationship between the collimator target surface and the navigation device reference surface to convert the position relationship between the camera and the collimator target surface into the reference position relationship between the camera and the navigation device, and realizes reference calibration through a visual calibration method. It avoids the need for a high-precision turntable, saves costs and greatly improves calibration efficiency. In addition, the entire calibration process has clear steps, standardized operations, and fully automated steps, which is convenient for users to operate according to standard procedures. Even non-professionals can complete the calibration independently and quickly.

[0043] In the above-mentioned visual navigation device benchmark calibration method based on collimator, the present application uses a collimator with a characteristic pattern and a calibration frame with a parallel structure to perform navigation device benchmark calibration. After obtaining the virtual control point corresponding to the characteristic point, it is only necessary to shoot the collimator target surface once to calibrate the navigation device benchmark. The process is simple and the operation is convenient. According to the property of the collimator to generate parallel light beams, the calibration data is provided for the camera of the navigation device; at the same time, the designed calibration frame has an independent light source, which avoids the influence of light changes on the image quality, and can still provide a stable and controllable calibration environment under complex lighting conditions, ensuring the clarity and detectability of the image feature points. By using the parallel relationship between the collimator target surface and the navigation device reference surface, the position relationship between the camera and the collimator target surface is converted into the position relationship between the camera and the navigation device reference, and the benchmark calibration is realized by the visual calibration method. The need for a high-precision turntable is avoided, the cost is saved and the calibration efficiency is greatly improved. In actual use, after the camera with known internal parameters shoots the target surface to generate virtual control points, the camera in the navigation device to be calibrated can be controlled to shoot a target surface image, so as to realize the camera internal parameter calibration and benchmark calibration in the navigation device. This application has high calibration accuracy, fast calibration speed, low cost, strong operability, and is suitable for batch calibration of navigation equipment. The entire calibration process has clear steps, standardized operations, and fully automated steps, making it easy for users to operate according to standard procedures. Even non-professionals can complete the calibration independently and quickly.

[0044] In one embodiment, the illumination light source is turned on, and the direction vector of the target surface feature of the collimator is obtained by a measuring device and a virtual control point is generated, including:

[0045] There are pre-set star-shaped calibration patterns and coded mark patterns on the target surface of the collimator;

[0046] Extracting features from the star-shaped calibration pattern according to a feature detection algorithm to obtain feature points in the star-shaped calibration pattern, and numbering each feature according to information of the coding mark pattern;

[0047] Turn on the lighting source to ensure that it is stable. Obtain the direction vector of the parallel light tube target surface feature through the measuring equipment, generate a random distance for each feature point, and generate the corresponding virtual control point based on the corresponding feature point direction. The three-dimensional coordinate of the virtual control point is the random distance multiplied by the direction of the feature point to ensure that the number of the virtual control point is consistent with the corresponding feature number.

[0048] In one embodiment, matching the two-dimensional pixel coordinates of the feature point with the three-dimensional coordinates of the virtual control point to establish a first corresponding relationship includes:

[0049] The numbers of the feature points in the calibration image are matched with the numbers of the virtual control points to ensure that each feature point corresponds to the corresponding virtual control point one by one, and the corresponding relationship between the two-dimensional pixel coordinates of the feature point and the three-dimensional coordinates of the virtual control point is established.

[0050] In one embodiment, performing camera calibration on the first correspondence to obtain camera intrinsic parameters of the navigation device to be calibrated includes:

[0051] The first corresponding relationship is solved according to the least square method or other optimization algorithm to obtain the initial values ​​of the camera intrinsic parameters of the navigation device to be calibrated; the initial values ​​of the camera intrinsic parameters are optimized using the bundle adjustment algorithm to obtain the camera intrinsic parameters of the navigation device to be calibrated.

[0052] In one embodiment, the camera internal parameters of the navigation device to be calibrated include equivalent focal length, principal point coordinates, radial distortion parameters, and tangential distortion coefficients.

[0053] In one embodiment, the rotation matrix of the camera of the navigation device to be calibrated relative to the target surface is calculated using the second corresponding relationship and the camera intrinsic parameters of the navigation device to be calibrated, including:

[0054] According to the second corresponding relationship and the intrinsic parameters of the camera of the navigation device to be calibrated, the rotation matrix of the camera of the navigation device to be calibrated relative to the target surface is solved by using an absolute pose estimation algorithm.

[0055] In one embodiment, a collimator is used to assist in calibration by manipulating a leveling knob on the calibration frame. When the crosshairs are observed to coincide with the center through the leveling lens, the calibration device has been leveled, i.e., the target surface of the collimator is parallel to the base of the calibration frame.

[0056] It should be understood that although Figure 1 The steps in the flowchart are shown in sequence as indicated by the arrows, but these steps are not necessarily executed in the order indicated by the arrows. Unless otherwise specified in this document, there is no strict order restriction for the execution of these steps, and these steps can be executed in other orders. Moreover, Figure 1 At least part of the steps may include multiple sub-steps or multiple stages. These sub-steps or stages are not necessarily executed at the same time, but can be executed at different times. The execution order of these sub-steps or stages is not necessarily sequential, but can be executed in turn or alternately with other steps or at least part of the sub-steps or stages of other steps.

[0057] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0058] The above-mentioned embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the invention patent. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the patent of the present application shall be subject to the attached claims.

Claims

1. A method for benchmarking visual navigation equipment based on a collimator, characterized in that: The method comprises: Constructing a visual navigation device benchmark calibration system; the visual navigation device benchmark calibration system includes a calibration frame fixed to the calibration device, a collimator, a base for placing the navigation device to be calibrated, an illumination light source, and a leveling knob and a leveling lens; The leveling knob is adjusted to make the substrate parallel to the collimator target surface, the illumination light source is turned on, and the direction vector of the collimator target surface feature is obtained by a measuring device and a virtual control point is generated, including: There are pre-set star-shaped calibration patterns and coding mark patterns on the target surface of the collimator; the star-shaped calibration pattern is feature extracted according to the feature detection algorithm to obtain feature points in the star-shaped calibration pattern, and each feature is numbered according to the information of the coding mark pattern; Turn on the illumination light source to ensure that the light source is stable, obtain the direction vector of the parallel light tube target surface feature through the measuring device, generate a random distance for each feature point, and generate a corresponding virtual control point in combination with the corresponding feature point direction. The three-dimensional coordinate of the virtual control point is the random distance multiplied by the direction of the feature point, and ensure that the number of the virtual control point is consistent with the corresponding feature number; the measuring device includes an angle measuring device and a camera with known internal parameters; The reference surface of the navigation device to be calibrated is placed on the substrate, and the camera in the navigation device to be calibrated is controlled to take a target surface image from the light outlet of the collimator as a calibration image; the star-shaped calibration pattern in the calibration image is subjected to feature extraction, the two-dimensional pixel coordinates of the feature points are read, and each feature point is numbered; Matching the two-dimensional pixel coordinates of the feature point with the three-dimensional coordinates of the virtual control point to establish a first corresponding relationship, and performing camera calibration of the navigation device to be calibrated on the first corresponding relationship to obtain the camera intrinsic parameters of the navigation device to be calibrated; The actual three-dimensional coordinates and number of each feature point on the calibration pattern in the target coordinate system are determined by using the information of the coded mark pattern, and a second corresponding relationship between the three-dimensional point coordinates in the target coordinate system and the two-dimensional feature point coordinates in the image coordinate system is established by matching the number of the actual three-dimensional point with the number of the two-dimensional feature point, and the rotation matrix of the camera of the navigation device to be calibrated relative to the target surface is solved by using the second corresponding relationship and the camera internal parameters of the navigation device to be calibrated; Since the collimator target surface is parallel to the base and the reference surface of the navigation device coincides with the base, the collimator target surface is parallel to the reference surface of the navigation device. The rotation matrix of the camera of the navigation device to be calibrated relative to the collimator target surface is converted into the rotation matrix of the camera of the navigation device to be calibrated relative to the reference surface of the navigation device, that is, the external parameters, to realize the calibration of the navigation device reference.

2. The method according to claim 1, characterized in that Matching the two-dimensional pixel coordinates of the feature point with the three-dimensional coordinates of the virtual control point to establish a first corresponding relationship, including: The numbers of the feature points in the calibration image are matched with the numbers of the virtual control points to ensure that each feature point corresponds to the corresponding virtual control point one by one, and the corresponding relationship between the two-dimensional pixel coordinates of the feature point and the three-dimensional coordinates of the virtual control point is established.

3. The method according to claim 1, characterized in that Performing camera calibration on the first corresponding relationship to obtain camera intrinsic parameters of the navigation device to be calibrated includes: The first corresponding relationship is solved according to the least square method or other optimization algorithm to obtain the initial values ​​of the camera intrinsic parameters of the navigation device to be calibrated; the initial values ​​of the camera intrinsic parameters are optimized using the bundle adjustment algorithm to obtain the camera intrinsic parameters of the navigation device to be calibrated.

4. The method according to claim 3, characterized in that The camera internal parameters of the navigation device to be calibrated include equivalent focal length, principal point coordinates, radial distortion parameters and tangential distortion coefficients.

5. The method according to claim 1, characterized in that The rotation matrix of the camera of the navigation device to be calibrated relative to the target surface is calculated using the second corresponding relationship and the camera intrinsic parameters of the navigation device to be calibrated, including: According to the second corresponding relationship and the intrinsic parameters of the camera of the navigation device to be calibrated, an absolute pose estimation algorithm is used to solve and obtain a rotation matrix of the camera of the navigation device to be calibrated relative to the target surface.

6. The method according to claim 1, characterized in that The collimator is used to assist in calibration. The leveling knob on the calibration frame is manipulated. When the crosshairs are observed to coincide with the center through the leveling lens, the calibration device has been leveled, that is, the target surface of the collimator is parallel to the base of the calibration frame.