A method for calibrating the intrinsic parameters of a high-altitude camera based on a mobile camera device.
By using a portable camera device, such as a mobile phone, to calibrate the intrinsic parameters of high-altitude cameras, the operation process is simplified, the cost is reduced, and the problems of complexity and high cost in the calibration of high-altitude cameras in the existing technology are solved.
Patent Information
- Application Number
- CN202410561867.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-05-08
- Publication Date
- 2026-11-17
- Estimated Expiration
- 2044-05-08
AI Technical Summary
Existing methods for calibrating intrinsic parameters of high-altitude cameras require precise control platforms and high-precision image processing algorithms, which are costly and complex to operate and difficult to simplify.
Using portable camera devices such as mobile phones for internal parameter calibration, and taking pictures from high-altitude cameras and using distortion correction and geometric relationship calculations, simplifies the operation process and reduces costs.
No additional equipment or complicated operations are required, simplifying the calibration process of high-altitude camera internal parameters, reducing costs, and improving ease of operation.
Smart Images

Figure CN118505814B_ABST
Abstract
Description
Technical Field
[0001] This invention relates to the field of cameras, and more particularly to a method for calibrating the intrinsic parameters of a high-altitude camera based on a portable camera device. Background Technology
[0002] A high-altitude camera is a surveillance device installed at a high position, utilizing sufficient height to achieve precise monitoring over a wide area. High-altitude cameras have wide applications in various fields, such as urban fire monitoring, monitoring of key urban targets, urban security monitoring, urban environmental protection monitoring, forest fire monitoring, border defense monitoring, residential community security monitoring, and factory area monitoring. In general, high-altitude cameras play an increasingly important role in modern society, providing effective solutions for various monitoring needs.
[0003] Due to the limitations of the imaging principle of cameras, the information they collect about objects is only two-dimensional planar position information. In order to obtain accurate three-dimensional spatial position information of objects through camera data, it is usually necessary to perform intrinsic parameter calibration of the camera in order to correctly capture and process image information.
[0004] Traditional methods for calibrating camera intrinsic parameters include:
[0005] Active vision-based calibration methods involve controlling a camera to perform specific movements using an active system. A control platform then captures multiple images based on these movements, and the camera's intrinsic parameters are calculated using the image information and known camera displacement changes. However, this method requires a precise control platform for high-altitude cameras, resulting in high costs.
[0006] Calibration methods based on two-dimensional planar targets rely on a calibration board with known geometric features (such as a checkerboard calibration board). By detecting corner points on the calibration board and utilizing the relationship between the projections of these corner points into the image and their positions in physical space, imaging constraint equations are constructed. Finally, by solving these constraint equations, the camera's intrinsic parameters can be obtained. However, this calibration method for high-altitude cameras requires high-precision image processing algorithms and necessitates acquiring multiple target images from different angles and positions for calibration, making the process more cumbersome and complex. Summary of the Invention
[0007] To address the shortcomings of existing technologies, the present invention aims to provide a method for calibrating the intrinsic parameters of a high-altitude camera based on a movable camera device, comprising the following steps:
[0008] S1: Calibrate the movable camera device to obtain its intrinsic parameter matrix. and distortion coefficient;
[0009] The intrinsic parameter matrix of a movable camera device includes the following parameters: normalized focal length (f x f y ), principal point coordinates (u0, v0), f x and f y It is the pixel focal length along the x-axis and y-axis of the image sensor; the distortion coefficients include k1, k2, k3, p1 and p2, where k1, k2 and k3 are radial distortion coefficients, used to correct the phenomenon of image edges bending inward or outward, and p1 and p2 are tangential distortion coefficients, used to correct the distortion caused by the lens and the imaging plane not being completely parallel.
[0010] S2: Move the movable camera device to the center of the high-altitude camera's field of view and record the current position P of the movable camera device.
[0011] S3: Use a portable camera device to take pictures of high-altitude cameras, and perform distortion correction on the pictures based on the distortion coefficient of the portable camera device.
[0012] S4: Record the pixel coordinates (u, v) in the photo taken by the high-altitude camera in step S3.
[0013] S5: Intrinsic parameter matrix based on mobile camera devices Given the pixel coordinates (u, v) in the photo taken by the high-altitude camera in step S3, the actual physical width L of the high-altitude camera, and the pixel width D in the photo taken by the high-altitude camera in step S3, we can solve for the coordinates (Xp, Yp, Zp) of the high-altitude camera in the movable camera device coordinate system using the following formula:
[0014]
[0015] S6: Calculate the distance S between the high-altitude camera and the movable camera device. The calculation formula is as follows:
[0016]
[0017] S7: Place a rectangular reference plate with known height h0 and width w0 at position P, facing the high-altitude camera.
[0018] S8: Use an aerial camera to photograph a rectangular reference board and record the pixel height h and pixel width w of the rectangular reference board;
[0019] When the focal length of the high-altitude camera is variable, it is also necessary to record the focal length f and calculate the physical lengths dx and dy of a pixel of the high-altitude camera in the x and y directions on the photosensitive plate of the movable camera device. The calculation formula is as follows:
[0020]
[0021]
[0022] S9: When the high-altitude camera cannot change its focal length, the formula for calculating the intrinsic parameter matrix K' is:
[0023]
[0024] When the high-altitude camera has a variable focal length and the focal length changes by f', the formula for calculating the intrinsic parameter matrix K' is:
[0025]
[0026] Among them, c x and c y These represent the total number of pixels in the horizontal and vertical directions of a photo taken by a high-altitude camera, respectively.
[0027] Furthermore, the portable camera device described in this embodiment of the invention is a mobile phone.
[0028] Furthermore, the principal point mentioned in step S1 is the image center of the movable camera device.
[0029] Furthermore, the recorded location P of the movable camera device includes its position and height.
[0030] Furthermore, the parameters used when taking pictures of the high-altitude camera using the movable camera device in step S3 are the same as those in step S1, and the pictures taken can clearly distinguish the outline of the high-altitude camera.
[0031] Furthermore, the pixel coordinates (u, v) mentioned in step S4 are the geometric center coordinates of the photo taken by the high-altitude camera in step S3.
[0032] Furthermore, the rectangular reference plate mentioned in step S7 is clearly visible and unobstructed, and its physical height and width can be measured from the perspective of the high-altitude camera.
[0033] Furthermore, the rectangular reference board is placed perpendicular to the high-altitude camera.
[0034] Compared with the prior art, the beneficial effects of the present invention are as follows:
[0035] This invention eliminates the need for a precise control platform to control the high-altitude camera to perform specific displacements and solve for intrinsic parameters. It also eliminates the need for other professional positioning and ranging equipment, as well as manual calibration board setup. Instead, it utilizes a portable camera device to capture images of the high-altitude camera for intrinsic parameter calibration. Various portable camera devices can be selected, such as mobile phones or cameras. Compared to other professional equipment, users can perform high-altitude camera intrinsic parameter calibration using simple equipment without additional investment, reducing calibration costs. Furthermore, it avoids complex equipment setup and extensive manual operations, simplifying the high-altitude camera intrinsic parameter calibration process and making operation more convenient. Attached Figure Description
[0036] To more clearly illustrate the specific embodiments of the present invention or the technical solutions in the prior art, the accompanying drawings used in the description of the specific embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only one embodiment of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0037] Figure 1 This is a schematic diagram of the process for calibrating the intrinsic parameters of a non-variable focal length high-altitude camera provided in Embodiment 1;
[0038] Figure 2 This is a schematic diagram of the variable focal length high-altitude camera intrinsic parameter calibration method provided in Embodiment 2. Detailed Implementation
[0039] To make the technical means, creative features, objectives and effects of this invention easier to understand, the technical solutions in the specific embodiments of this invention are described clearly and completely below to further illustrate this invention. Obviously, the specific embodiments described are only a part of the embodiments of this invention, and not all of them.
[0040] Example 1
[0041] The focal length of the high-altitude camera in this embodiment is fixed, and its intrinsic parameter calibration method is as follows: Figure 1 As shown, it includes the following steps:
[0042] S1: Calibrate the movable camera device to obtain its intrinsic parameter matrix. And distortion coefficient.
[0043] The portable camera device can be a mobile phone, digital camera, SLR camera, etc. This embodiment uses a mobile phone. The intrinsic parameter matrix of the portable camera device includes the following parameters: normalized focal length (f x f y ), principal point coordinates (u0, v0), f x and f y It is the pixel focal length along the x-axis and y-axis of the image sensor, u0 and v0 are the coordinates of the principal point, which is the image center of the movable camera device; the distortion coefficients include k1, k2, k3, p1 and p2, where k1, k2 and k3 are radial distortion coefficients, used to correct the phenomenon of the image edges bending inward or outward, and p1 and p2 are tangential distortion coefficients, used to correct the distortion caused by the lens and the imaging plane not being completely parallel.
[0044] S2: Move the movable camera device to the center of the high-altitude camera's field of view and record the current position P of the movable camera device.
[0045] The recorded location P of the movable camera device includes its position and height.
[0046] S3: Use a portable camera device to take pictures of high-altitude cameras, and perform distortion correction on the pictures based on the distortion coefficient of the portable camera device.
[0047] When taking the picture, the parameters used must be the same as those in step S1. The picture must be able to clearly distinguish the outline of the high-altitude camera. Distortion correction of the picture can make the geometric shape of the image more realistic and accurate, which is helpful for subsequent measurements.
[0048] S4: Record the pixel coordinates (u, v) in the photo taken by the high-altitude camera in step S3.
[0049] The geometric center coordinates of the high-altitude camera in the photo are taken as its pixel coordinates.
[0050] S5: Intrinsic parameter matrix based on mobile camera devices Given the pixel coordinates (u, v) in the photo taken by the high-altitude camera in step S3, the actual physical width L of the high-altitude camera, and the pixel width D in the photo taken by the high-altitude camera in step S3, we can solve for the coordinates (Xp, Yp, Zp) of the high-altitude camera in the movable camera device coordinate system using the following formula:
[0051]
[0052] The actual physical width L and coordinates (Xp, Yp, Zp) of the high-altitude camera are both in millimeters. The pixel width D in the photo taken by the high-altitude camera in step S3 can be obtained through professional computer software.
[0053] S6: Calculate the distance S between the high-altitude camera and the movable camera device. The calculation formula is as follows:
[0054]
[0055] S7: Place a rectangular reference plate with known height h0 and width w0 at position P, facing the high-altitude camera.
[0056] The size and color of the rectangular reference board are not limited, but it must be clearly visible and unobstructed. Its physical height and width should be measurable from the perspective of the high-altitude camera. When determining the placement of the rectangular reference board, it should be kept as perpendicular to the high-altitude camera as possible to avoid visual distortion. The units for height h0 and width w0 are both millimeters.
[0057] S8: Use an aerial camera to photograph a rectangular reference board and record the pixel height h and pixel width w of the rectangular reference board.
[0058] S9: Calculate the intrinsic parameter matrix K' of the high-altitude camera. The calculation formula is:
[0059]
[0060] Among them, c x and c y The total number of pixels in the horizontal and vertical directions of a photo taken by a high-altitude camera.
[0061] Example 2
[0062] Zoom cameras offer advantages such as wide coverage and high flexibility, making them suitable for urban high-altitude surveillance. Therefore, most urban high-altitude cameras currently use zoom cameras. When the focal length of the high-altitude camera requiring intrinsic parameter calibration is variable, the calibration method is as follows: Figure 2 As shown, it includes the following steps:
[0063] S1: Calibrate the movable camera device to obtain its intrinsic parameter matrix. And distortion coefficient.
[0064] The portable camera device can be a mobile phone, digital camera, SLR camera, etc. This embodiment uses a mobile phone. The intrinsic parameter matrix of the portable camera device includes the following parameters: normalized focal length (f x f y ), principal point coordinates (u0, v0), f x and f y It is the pixel focal length along the x-axis and y-axis of the image sensor, u0 and v0 are the coordinates of the principal point, which is the image center of the movable camera device; the distortion coefficients include k1, k2, k3, p1 and p2, where k1, k2 and k3 are radial distortion coefficients, used to correct the phenomenon of the image edges bending inward or outward, and p1 and p2 are tangential distortion coefficients, used to correct the distortion caused by the lens and the imaging plane not being completely parallel.
[0065] S2: Move the movable camera device to the center of the high-altitude camera's field of view and record the current position P of the movable camera device.
[0066] The recorded location P of the movable camera device includes its position and height.
[0067] S3: Use a portable camera device to take pictures of high-altitude cameras, and perform distortion correction on the pictures based on the distortion coefficient of the portable camera device.
[0068] When taking the picture, the parameters used must be the same as those in step S1. The picture must be able to clearly distinguish the outline of the high-altitude camera. Distortion correction of the picture can make the geometric shape of the image more realistic and accurate, which is helpful for subsequent measurements.
[0069] S4: Record the pixel coordinates (u, v) in the photo taken by the high-altitude camera in step S3.
[0070] The geometric center coordinates of the high-altitude camera in the photo are taken as its pixel coordinates.
[0071] S5: Intrinsic parameter matrix based on mobile camera devices Given the pixel coordinates (u, v) in the photo taken by the high-altitude camera in step S3, the actual physical width L of the high-altitude camera, and the pixel width D in the photo taken by the high-altitude camera in step S3, we can solve for the coordinates (Xp, Yp, Zp) of the high-altitude camera in the movable camera device coordinate system using the following formula:
[0072]
[0073] The actual physical width L and coordinates (Xp, Yp, Zp) of the high-altitude camera are both in millimeters. The pixel width D in the photo taken by the high-altitude camera in step S3 can be obtained through professional computer software.
[0074] S6: Calculate the distance S between the high-altitude camera and the movable camera device. The calculation formula is as follows:
[0075]
[0076] S7: Place a rectangular reference plate with known height h0 and width w0 at position P, facing the high-altitude camera.
[0077] The size and color of the rectangular reference board are not limited, but it must be clearly visible and unobstructed. Its physical height and width should be measurable from the perspective of the high-altitude camera. When determining the placement of the rectangular reference board, it should be kept as perpendicular to the high-altitude camera as possible to avoid visual distortion. The units for height h0 and width w0 are both millimeters.
[0078] S8: Use a high-altitude camera to photograph a rectangular reference board, record the pixel height h, pixel width w of the rectangular reference board, and the focal length f of the high-altitude camera. Calculate the physical lengths dx and dy of one pixel of the high-altitude camera in the x and y directions on the photosensitive plate of the movable camera device. The calculation formula is:
[0079]
[0080]
[0081] The units for f, dx, and dy are all millimeters.
[0082] S9: When the focal length of the high-altitude camera changes to f', calculate the intrinsic parameter matrix K' of the high-altitude camera. The calculation formula is:
[0083]
[0084] Here, cx and cy represent the total number of pixels in the horizontal and vertical directions of the photos taken by the high-altitude camera.
[0085] The main technical features, basic principles, and related advantages of the present invention have been described above. It will be apparent to those skilled in the art that the present invention is not limited to the details of the exemplary embodiments described above, and that the present invention can be implemented in other specific forms without departing from the concept or basic characteristics of the invention. Therefore, the above-described embodiments should be considered exemplary and non-limiting in all respects. The scope of the present invention is defined by the appended claims rather than the foregoing description, and thus all variations falling within the meaning and scope of the equivalents of the claims are intended to be included within the present invention.
[0086] Furthermore, it should be understood that although this specification describes various embodiments, not every embodiment contains only one independent technical solution. This way of describing the specification is only for clarity. Those skilled in the art should regard the specification as a whole, and the technical solutions in each embodiment can also be appropriately combined to form other embodiments that can be understood by those skilled in the art.
Claims
1. A method for calibrating the intrinsic parameters of a high-altitude camera based on a portable camera device, characterized in that, Includes the following steps: S1: Calibrate the movable camera device to obtain its intrinsic parameter matrix. and distortion coefficient; The intrinsic parameter matrix of a movable camera device includes the following parameters: normalized focal length (f x f y ), principal point coordinates (u0, v0), f x and f y It is the pixel focal length along the x-axis and y-axis of the image sensor; the distortion coefficients include k1, k2, k3, p1 and p2, where k1, k2 and k3 are radial distortion coefficients, used to correct the phenomenon of image edges bending inward or outward, and p1 and p2 are tangential distortion coefficients, used to correct the distortion caused by the lens and the imaging plane not being completely parallel. S2: Move the movable camera device to the center of the high-altitude camera's field of view and record the current position P of the movable camera device; S3: Use a portable camera device to take pictures of high-altitude cameras, and perform distortion correction on the pictures based on the distortion coefficient of the portable camera device; S4: Record the pixel coordinates (u, v) in the photo taken by the high-altitude camera in step S3; S5: Intrinsic parameter matrix based on mobile camera devices Given the pixel coordinates (u, v) in the photo taken by the high-altitude camera in step S3, the actual physical width L of the high-altitude camera, and the pixel width D in the photo taken by the high-altitude camera in step S3, we can solve for the coordinates (Xp, Yp, Zp) of the high-altitude camera in the movable camera device coordinate system using the following formula: S6: Calculate the distance S between the high-altitude camera and the movable camera device. The calculation formula is as follows: S7: Place a rectangular reference plate with known height h0 and width w0 at position P, facing the high-altitude camera; S8: Use an aerial camera to photograph a rectangular reference board and record the pixel height h and pixel width w of the rectangular reference board; When the focal length of the high-altitude camera is variable, it is also necessary to record the focal length f and calculate the physical lengths dx and dy of a pixel of the high-altitude camera in the x and y directions on the photosensitive plate of the movable camera device. The calculation formula is as follows: S9: When the high-altitude camera cannot change its focal length, the formula for calculating the intrinsic parameter matrix K' is: When the high-altitude camera has a variable focal length and the focal length changes by f', the formula for calculating the intrinsic parameter matrix K' is: Among them, c x and c y These represent the total number of pixels in the horizontal and vertical directions of the photos taken by the high-altitude camera, respectively.
2. The method for calibrating the intrinsic parameters of a high-altitude camera based on a movable camera device according to claim 1, characterized in that, The portable camera device is a mobile phone.
3. The method for calibrating the intrinsic parameters of a high-altitude camera based on a movable camera device according to claim 1, characterized in that, The principal point mentioned in step S1 is the image center of the movable camera device.
4. The method for calibrating the intrinsic parameters of a high-altitude camera based on a movable camera device according to claim 1, characterized in that, The recorded location P of the movable camera device includes its position and height.
5. The method for calibrating the intrinsic parameters of a high-altitude camera based on a movable camera device according to claim 1, characterized in that, The parameters used when taking pictures of the high-altitude camera using the movable camera device in step S3 are the same as those in step S1, and the pictures taken can clearly distinguish the outline of the high-altitude camera.
6. The method for calibrating the intrinsic parameters of a high-altitude camera based on a movable camera device according to claim 1, characterized in that, The pixel coordinates (u, v) mentioned in step S4 are the geometric center coordinates of the photo taken by the high-altitude camera in step S3.
7. The method for calibrating the intrinsic parameters of a high-altitude camera based on a movable camera device according to claim 1, characterized in that, The rectangular reference plate mentioned in step S7 is clearly visible and unobstructed, and its physical height and width can be measured from the perspective of the high-altitude camera.
8. The method for calibrating the intrinsic parameters of a high-altitude camera based on a movable camera device according to claim 1, characterized in that, In step S7, the rectangular reference plate is placed perpendicular to the high-altitude camera.
Citation Information
Patent Citations
A vehicle-mounted all-round view system, a three-dimensional calibration method thereof and a computer readable storage medium
CN109712194A
A zoom camera dynamic calibration method based on a monocular vision triangulation distance measurement method
CN109727290A
