Automatic calibration control method and device for digital camera
By designing an automatic calibration control system for digital cameras, and using multi-module collaborative work to achieve automatic calibration and image resolution detection, the problems of low detection efficiency and high cost in the prior art are solved, and the detection level and efficiency are improved.
Patent Information
- Application Number
- CN202411175494.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-26
- Publication Date
- 2024-11-26
AI Technical Summary
The prior art lacks methods and devices for automatic calibration of digital cameras, resulting in low detection efficiency and high cost, and the inability to realize automated detection.
A digital camera automatic calibration control system is designed, including software calibration module, internal meta module, external parameter module, external element module, image correction module, wireless communication module, alarm and memory, through the coordinated work of these modules , realizes automatic calibration of the camera and image resolution detection, automatically issue an alarm and notify repairs.
It realizes automated detection of digital cameras, improves detection level and efficiency, reduces detection costs, ensures that the camera's image resolution meets standards, and extends the service life of the equipment.
Smart Images

Figure CN119031121A_ABST
Abstract
Description
Technical Field
[0001] The present invention belongs to the technical field of automatic calibration control of digital cameras, and more specifically, relates to an automatic calibration control method and device for digital cameras involving artificial intelligence. Background Art
[0002] As one of the representatives of modern high-tech products, digital cameras play a pivotal role in the field of photography. With the continuous development of technologies such as deep learning and artificial intelligence, digital cameras have also ushered in new opportunities in terms of intelligence and automation. The continuous integration of functions such as smart focus, smart exposure, and smart photo editing makes shooting more convenient and post-processing more efficient. In the future, digital cameras are expected to have higher pixels, faster shooting speeds, and better image quality while being lighter and more portable. At the same time, with the rise of technologies such as virtual reality and augmented reality, digital cameras may be more integrated and applied with these emerging technologies to bring users a richer and more shocking photography experience. Although the low-end market has been replaced by smartphones, the professional high-end market is still very hot, such as professional photographers, professional journalists interviews, and high-end photography and videography.
[0003] The existing "Camera Inspection Method, Device, Equipment and Storage Medium (Publication No.: CN112381889A)" discloses a vehicle-mounted network camera inspection control technology, but there is no similar public technology for digital camera inspection. Summary of the invention
[0004] In order to solve the deficiencies in the prior art, the purpose of the present invention is to provide a digital camera automatic calibration control method and device. By setting a software calibration module, an internal element module, an external parameter module, an external element module, and an image correction module, the software, internal elements, external parameters, and external elements can be automatically calibrated, and the image resolution can be automatically detected, thereby realizing the automatic detection of digital cameras, improving the camera detection level, reducing the detection cost, and improving the detection efficiency.
[0005] In order to achieve the above object, the technical solution adopted by the present invention is:
[0006] A digital camera automatic calibration control method is applied to a digital camera automatic calibration control system, comprising a software calibration module, an internal number module, an external parameter module, an external element module, an image correction module, a wireless communication module, an alarm, a memory, a processing center, and a smart phone; the software calibration module, the internal number module, the external parameter module, the external element module, the image correction module, the wireless communication module, the alarm, and the memory are respectively connected to the processing center; the smart phone is automatically networked with the wireless communication module within the range of a wireless network or the Internet;
[0007] The wireless communication module is provided with a wireless network unit, which is responsible for sending and receiving wireless network signals and automatically networking with a smart phone within the range of a wireless network or the Internet;
[0008] The alarm device compares the actual image resolution of the camera with the image resolution standard of the camera stored in the memory, and automatically sounds an alarm and notifies for recalibration or maintenance if the standard is not met;
[0009] The memory is responsible for storing information of the software calibration module, the internal element module, the external parameter module, the external element module, the image correction module, the wireless communication module, the alarm, and the image resolution standard of the camera;
[0010] The processing center is responsible for the information transmission of the software calibration module, internal number module, external parameter module, external element module, image correction module, wireless communication module, alarm, and memory. It is the hub of the system and compares the actual image resolution of the camera with the image resolution standard of the camera stored in the memory: if it meets the standard, the calibration is qualified; if it does not meet the standard, it is transmitted to the alarm and notified to re-calibrate or repair;
[0011] The software calibration module includes a white balance unit, a hue saturation unit, a shadow saturation unit, an automatic calibration unit, and a distance verification unit. The software is used to perform fine adjustments of white balance, hue and saturation, shadow and red primary color, and debug the automatic calibration function to achieve the best visual effect, and pass it to the internal metadata module;
[0012] The internal element module includes an internal parameter unit, an internal element unit, a distortion coefficient unit, a frame coordinate unit, a post-distortion difference unit, an eccentricity constant unit, and a synchronization accuracy unit. The internal element of the internal parameters, the internal element, the optical distortion coefficient, and the eccentricity constant is measured to improve the shooting quality and visual effect, and is passed to the external parameter module;
[0013] The external parameter module includes a posture position unit, a translation vector unit, and a rotation matrix unit. The external parameters are obtained by solving the rotation matrix R and the translation vector t between the world coordinate system and the camera coordinate system, and are passed to the external element module;
[0014] The external element module includes a data acquisition unit, a feature detection unit, a feature matching unit, an evaluation and optimization unit, and a result verification unit. It ensures the accuracy of the image by measuring the external orientation elements of the camera's coordinates (X, Y, Z) in the object space and the direction of the light beam (ψ, ω, κ), and transmits them to the image correction module;
[0015] The image correction module includes a test determination unit, a shooting test unit, and an image analysis unit. The image resolution of the camera is obtained by shooting test and calculation to obtain the image resolution test and transmit it to the processing center.
[0016] The present invention also provides a digital camera automatic calibration control method, which is applied to a digital camera automatic calibration control system, wherein the method comprises the following steps:
[0017] S10, during the verification, the software calibration module uses the image editing software to perform fine adjustments of white balance, hue and saturation, shadow and red primary color, and debugs the automatic calibration function, and transmits the results to the internal metadata module;
[0018] S20, the internal element module measures the internal parameters, internal orientation elements, optical distortion coefficients, and internal elements of eccentricity constants to improve the shooting quality and visual effects, and transmits them to the external parameter module;
[0019] S30, the external parameter module obtains the external parameters by solving the rotation matrix R and the translation vector t between the world coordinate system and the camera coordinate system, and passes them to the external element module;
[0020] S40, the exterior element module determines the exterior orientation elements of the camera coordinates (X, Y, Z) in the object space and the direction of the light beam (ψ, ω, κ) to ensure the accuracy of the image, and transmits them to the image correction module;
[0021] S50, the image correction module obtains the image resolution of the camera by shooting test and calculation, so as to obtain the image resolution test, and transmits it to the processing center;
[0022] S60, the processing center compares the actual image resolution of the camera with the camera image resolution standard stored in the memory: if it meets the standard, the calibration is qualified; if it does not meet the standard, it is transmitted to the alarm and notified to re-calibrate or repair.
[0023] Further, the step S10 comprises the following steps:
[0024] S11. The white balance unit adjusts the cold or warm tones or the color temperature through the photo editing software to adjust the color shift of the picture and make the RGB values equal or close, and transmits them to the color saturation unit;
[0025] S12. Hue saturation unit: By adjusting the "hue" slider and saturation slider in the photo editing software, the saturation of a specific color and the overall saturation can be adjusted and passed to the shadow saturation unit;
[0026] S13, the shadow saturation unit adjusts the hue of the shadow part, the hue and saturation of the red primary color through the image editing software to correct the color cast and optimize the image color performance, and transmits it to the automatic calibration unit;
[0027] S14, the automatic calibration unit places the camera in a shooting environment that needs to be calibrated and connects it to the mobile phone through the automatic calibration software, performs automatic calibration by rotating the mobile phone, and transmits the calibration to the distance verification unit;
[0028] S15, the distance verification unit adjusts the clarity and composition of the subject by changing the focal length of the lens and the distance between the camera and the subject, and fixes the slider position to ensure optimal image correction.
[0029] Further, the step S20 includes the following steps:
[0030] S21, the internal parameter unit adapts to different shooting environments by converting the aligned secondary coordinates and the non-homogeneous coordinates, constructing the internal matrix, and optimizing the internal parameters, and transmits them to the internal element unit;
[0031] S22, the inner element unit determines the principal point position and principal distance and determines and sets the principal distance change after focusing to ensure the accuracy of the image geometric relationship and transmits it to the distortion coefficient unit;
[0032] S23, the distortion coefficient unit measures the optical distortion coefficient of the geometric or optical deformation that may be generated by the camera lens during the imaging process to improve the image quality and transmits it to the image frame coordinate unit;
[0033] S24, the image frame coordinate unit determines the x and y axes by the bisector of the angle between the diagonal frame mark lines, determines the frame mark coordinate system with the intersection as the origin of the coordinate system, and transmits it to the post-distortion difference unit;
[0034] S25, the rear distortion difference unit measures the change of the principal distance and the distortion difference after focusing, establishes a digital distortion model, corrects various distortions together, and transmits the correction to the eccentricity constant unit;
[0035] S26, the eccentricity constant unit measures the eccentricity constant of the relative position relationship between the camera lens and the imaging plane to ensure the accuracy and efficiency of the measurement, and transmits it to the synchronization accuracy unit;
[0036] S27, the synchronization accuracy unit uses the PTP protocol to synchronize shooting of multiple cameras to determine the synchronization accuracy of each camera, providing a high-precision time synchronization solution.
[0037] Further, the step S30 includes the following steps:
[0038] S31, the attitude position unit obtains the position and attitude of the camera in the world space through the camera calibration method to ensure the accuracy of the image information obtained by the camera, and transmits it to the translation vector unit;
[0039] S32, the translation vector unit calculates the translation vector of the camera according to the matching information of the feature points and the known world coordinate points, converts it from the camera coordinate system to the world coordinate system, and passes it to the rotation matrix unit;
[0040] S33, the rotation matrix unit calculates the external parameter matrix by using the world coordinate point of the selected calibration point and the normalized plane coordinate to take the inverse thereof through the singular value decomposition method.
[0041] Further, the step S40 includes the following steps:
[0042] S41, the data acquisition unit captures the image using the camera to be inspected by placing feature points in the world coordinate system or using a calibration plate and converts the image into recognizable image coordinate information, and transmits the information to the feature detection unit;
[0043] S42, the feature detection unit obtains detection feature points such as corner points, edges or other identifiable features in the image through an edge algorithm for subsequent feature matching, and transmits them to the feature matching unit;
[0044] S43, the feature matching unit matches the feature points detected in the image with the known world coordinate points, and transmits them to the evaluation and optimization unit;
[0045] S44, the evaluation and optimization unit evaluates and optimizes the external parameters of the camera's pixels, sensor, lens, and shutter by a nonlinear method to improve accuracy, and transmits the evaluation and optimization to the result verification unit;
[0046] S45. The result verification unit verifies whether the external parameters can accurately map points in the world coordinate system to the image, and compares them with known world coordinate points, and verifies through actual photo taking tests.
[0047] Further, the step S50 includes the following steps:
[0048] S51, the test determination unit places the resolution test card on a plane to ensure that it is parallel to the imaging plane of the camera, adjusts the distance to cover the camera imaging area, and transmits it to the shooting test unit;
[0049] S52, the shooting test unit adjusts the focal length, aperture, shutter speed, and ISO parameters of the camera according to the test card requirements and camera performance, shoots the test card, so as to obtain the best imaging effect, and transmits it to the image analysis unit;
[0050] S53, the image analysis unit calculates the image resolution according to the formula "Ri =L×S÷f,R i is the image resolution, L is the distance between the camera and the standard test card, S is the minimum reading number of the test card, and f is the focal length of the camera” to obtain the image resolution.
[0051] A digital camera automatic calibration control system provided by the present invention also includes a computer device and a computer-readable storage medium; the computer device includes a memory and various functional modules, the memory stores a computer program, and the various functional modules implement the steps of any one of the above-mentioned digital camera automatic calibration control methods when executing the computer program; the computer-readable storage medium stores a computer program, and the computer program implements the steps of any one of the above-mentioned digital camera automatic calibration control methods when executed by the various functional modules.
[0052] The present invention also provides a digital camera automatic calibration control device, which is implemented by the above-mentioned digital camera automatic calibration control method.
[0053] The beneficial effects of the present invention compared with the prior art are as follows:
[0054] By setting the software calibration module, internal element module, external parameter module, external element module and image correction module, the software, internal elements, external parameters and external elements can be automatically calibrated, and the image resolution can be automatically detected, thus realizing the automatic detection of digital cameras, improving the camera detection level, reducing the detection cost and improving the detection efficiency. BRIEF DESCRIPTION OF THE DRAWINGS
[0055] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the embodiments or exemplary technical descriptions will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.
[0056] Figure 1 It is a schematic diagram of the system module of the present invention;
[0057] Figure 2 It is a schematic diagram of the software calibration module of the present invention;
[0058] Figure 3 It is a schematic diagram of the internal arithmetic module of the present invention;
[0059] Figure 4 It is a schematic diagram of the external parameter module of the present invention;
[0060] Figure 5 It is a schematic diagram of the external element module of the present invention;
[0061] Figure 6 is a schematic diagram of an image correction module of the present invention;
[0062] Figure 7 It is a schematic diagram of the method flow of the present invention;
[0063] Figure 8 This is a schematic diagram of the process decomposition of step S10 in the method flow of the present invention;
[0064] Fig. 9 This is a schematic diagram of the process decomposition of step S20 in the method flow of the present invention;
[0065] Fig.10 This is a schematic diagram of the process decomposition of step S30 in the method flow of the present invention;
[0066] Fig.11 This is a schematic diagram of the process decomposition of step S40 in the method flow of the present invention;
[0067] Fig.12 It is a schematic diagram of the program decomposition of step S50 in the method flow of the present invention. DETAILED DESCRIPTION
[0068] In order to make the purpose, technical solution and advantages of the present invention more clearly understood, the present invention is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not intended to limit the present invention.
[0069] The specific implementation of the present invention is described in detail below in conjunction with specific embodiments:
[0070] In order to make the technical problems, technical solutions and beneficial effects to be solved by the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.
[0071] It should be noted that when a module is referred to as being "disposed" or "disposed on" another module, it can be directly on the other module or indirectly on the other module. When a module is referred to as being "connected to" or "connected to" another module, it can be directly connected to the other module or indirectly connected to the other module.
[0072] In the description of this application, "multiple" means two or more, unless otherwise clearly and specifically defined. "Several" means one or more, unless otherwise clearly and specifically defined.
[0073] In the description of this application, it should be noted that, unless otherwise clearly specified and limited, the terms "connected" and "connection" should be understood in a broad sense. For example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection or an indirect connection through an intermediate medium, and it can be the internal connection of two elements or the interaction relationship between two elements. For ordinary technicians in this field, the specific meanings of the above terms in this application can be understood according to specific circumstances. The terms "include", "comprise", "have" and their variations all mean "including but not limited to", unless otherwise specifically emphasized in other ways.
[0074] Please refer to Figure 1 As shown, the present invention provides a digital camera automatic calibration control method, which is applied to a digital camera automatic calibration control system, including a software calibration module, an internal number module, an external parameter module, an external element module, an image correction module, a wireless communication module, an alarm, a memory, a processing center, and a smart phone; the software calibration module, the internal number module, the external parameter module, the external element module, the image correction module, the wireless communication module, the alarm, and the memory are respectively connected to the processing center; the smart phone is automatically networked with the wireless communication module within the range of a wireless network or the Internet.
[0075] The wireless communication module is provided with a wireless network unit, which is responsible for sending and receiving wireless network signals and automatically networking with a smart phone within the range of a wireless network or the Internet.
[0076] The alarm compares the actual image resolution of the camera with the image resolution standard of the camera stored in the memory, and automatically sounds an alarm and notifies recalibration or maintenance if the standard is not met.
[0077] The memory is responsible for storing information of the software calibration module, the internal element module, the external parameter module, the external element module, the image correction module, the wireless communication module, and the alarm, and
[0078] The processing center is responsible for information transmission among the software calibration module, internal number module, external parameter module, external element module, image correction module, wireless communication module, alarm, and memory. It is the hub of the system and compares the actual image resolution of the camera with the image resolution standard of the camera stored in the memory: if it meets the standard, the calibration is qualified; if it does not meet the standard, it is transmitted to the alarm and notified for recalibration or maintenance.
[0079] See also Figure 2As shown, the software calibration module includes a white balance unit, a hue saturation unit, a shadow saturation unit, an automatic calibration unit, and a distance verification unit. The white balance, hue and saturation, shadow and red primary color are finely adjusted, and the automatic calibration function is debugged through the photo editing software to achieve the best visual effect and pass it to the internal metadata module.
[0080] Furthermore, the white balance unit adjusts the cool or warm tones, or the color temperature through the photo editing software to adjust the hue shift of the picture and make the RGB values equal or close to avoid the inaccuracy of the white balance, and transmits it to the hue saturation unit; the hue saturation unit adjusts the saturation and overall saturation of a specific color by adjusting the "hue" slider and the saturation slider through the photo editing software, thereby affecting the vividness of the image, and transmits it to the shadow saturation unit; the shadow saturation unit adjusts the hue of the shadow part, the hue and saturation of the red primary color through the photo editing software to correct the color deviation and optimize the color performance of the image, and transmits it to the automatic calibration unit; the automatic calibration unit places the camera in a shooting environment that needs to be calibrated through the automatic calibration software, connects it to the mobile phone, and performs automatic calibration by rotating the mobile phone, and transmits it to the distance verification unit; the distance verification unit adjusts the clarity and composition of the subject by changing the focal length of the lens and the distance between the camera and the subject, and sets the slider to a certain position to ensure the best image correction.
[0081] See also Figure 3 As shown, the internal element module includes an internal parameter unit, an internal element unit, a distortion coefficient unit, a frame coordinate unit, a post-distortion difference unit, an eccentricity constant unit, and a synchronization accuracy unit. The internal parameters, internal elements, optical distortion coefficients, and eccentricity constants are measured to improve the shooting quality and visual effects, and are passed to the external parameter module.
[0082] Furthermore, the internal parameter unit adapts to different shooting environments and conditions by aligning the conversion between the secondary coordinates and the non-homogeneous coordinates, constructing the internal matrix and optimizing the internal parameters, and transmits them to the internal element unit; the internal element unit ensures the accuracy of the image geometric relationship by measuring the principal point position and the principal distance and measuring and setting the principal distance change after focusing, and transmits them to the distortion coefficient unit; the distortion coefficient unit improves the quality and authenticity of the image by measuring the optical distortion coefficient of the geometric or optical deformation that may be generated by the camera lens during the imaging process, and transmits them to the frame coordinate unit; the frame coordinate unit measures the angle between the diagonal frame marks The bisector of the image is used to determine the x and y axes, and the frame mark coordinate system with the intersection as the origin of the coordinate system is determined, and the coordinates are passed to the post-distortion difference unit; the post-distortion difference unit measures the change in the principal distance and the distortion difference after focusing, and establishes a digital distortion model to correct various distortions together, and passes the model to the eccentricity constant unit; the eccentricity constant unit measures the eccentricity constant of the relative position relationship between the camera lens and the imaging plane to ensure the accuracy and efficiency of the measurement, and passes the model to the synchronization accuracy unit; the synchronization accuracy unit synchronizes the shooting of multiple cameras through the PTP protocol to measure the synchronization accuracy of each camera, providing a high-precision time synchronization solution.
[0083] See also Figure 4 As shown, the external parameter module includes a posture position unit, a translation vector unit, and a rotation matrix unit. The external parameters are obtained by solving the rotation matrix R and the translation vector t between the world coordinate system and the camera coordinate system, and are passed to the external element module.
[0084] Furthermore, the posture position unit obtains the position and posture of the camera in the world space through a camera calibration method to ensure the accuracy of the image information obtained by the camera, and passes it to the translation vector unit; the translation vector unit calculates the translation vector of the camera based on the matching information of the feature points and the known world coordinate points, converts its data from the camera coordinate system to the world coordinate system, and passes it to the rotation matrix unit; the rotation matrix unit calculates the external parameter matrix through the singular value decomposition method using the world coordinate points of the selected calibration points and the normalized plane coordinates and taking their inverse.
[0085] See also Figure 5 As shown, the external element module includes a data acquisition unit, a feature detection unit, a feature matching unit, an evaluation and optimization unit, and a result verification unit. The external orientation elements of the camera's coordinates (X, Y, Z) in the object space and the direction of the light beam (ψ, ω, κ) are measured to ensure the accuracy of the image and pass them to the image correction module.
[0086] Furthermore, the data acquisition unit places feature points in the world coordinate system or uses a calibration plate to capture images with the camera to be tested and converts them into recognizable image coordinate information, and transmits them to the feature detection unit; the feature detection unit obtains detection feature points such as corner points, edges or other recognizable features in the image through an edge algorithm for subsequent feature matching, and transmits them to the feature matching unit; the feature matching unit matches the feature points detected in the image with known world coordinate points, and transmits them to the evaluation and optimization unit; the evaluation and optimization unit evaluates and optimizes the external parameters of the camera's pixels, sensors, lenses, and shutters through a nonlinear method to improve accuracy, and transmits them to the result verification unit; the result verification unit verifies whether the external parameters can accurately map points in the world coordinate system to the image, and compares them with known world coordinate points, and verifies through actual photo-taking tests.
[0087] See also Figure 6 As shown, the image correction module includes a test determination unit, a shooting test unit, and an image analysis unit. The image resolution of the camera is obtained by shooting test and calculation to obtain an image resolution test and transmit it to a processing center.
[0088] Further, the test determination unit places the resolution test card on a plane to ensure that it is parallel to the imaging plane of the camera, adjusts the distance to cover the camera imaging area, and transmits it to the shooting test unit; the shooting test unit adjusts the camera's focal length, aperture, shutter speed, ISO parameters according to the test card requirements and camera performance, shoots the test card to obtain the best imaging effect, and transmits it to the image analysis unit; the image analysis unit calculates the resolution according to the image resolution calculation formula "R i =L×S÷f,R i is the image resolution, L is the distance between the camera and the standard test card, S is the minimum reading number of the test card, and f is the focal length of the camera” to obtain the image resolution.
[0089] How the system works:
[0090] During the verification, the software calibration module uses the photo editing software to make fine adjustments to the white balance, hue and saturation, shadow and red primary color, and debug the automatic calibration function, and pass it to the internal element module; then the internal element module improves the shooting quality and visual effect by measuring the internal parameters, internal orientation elements, optical distortion coefficients, and internal elements of the eccentricity constant, and passes it to the external parameter module; the control external parameter module obtains the external parameters by solving the rotation matrix R and the translation vector t between the world coordinate system and the camera coordinate system, and passes it to the external element module; then the external element module ensures the accuracy of the image by measuring the external orientation elements of the camera's coordinates (X, Y, Z) in the object space and the direction of the light beam (ψ, ω, κ), and passes it to the image correction module; then the image correction module obtains the image resolution of the camera through shooting tests and calculations to obtain the image resolution test, and passes it to the processing center; the processing center compares the actual image resolution of the camera with the image resolution standard of the camera stored in the memory: if it meets the standard, the calibration is qualified; if it does not meet the standard, it is passed to the alarm and notified to recalibrate or repair.
[0091] When staff or managers are outdoors or away from home, they can use smartphones to automatically connect to the wireless communication module within the range of a wireless network or the Internet to control or monitor the automatic calibration of digital cameras, thereby realizing automated and intelligent detection, improving the efficiency of digital camera inspection, and reducing the cost of digital camera inspection.
[0092] See also Figure 7 As shown, the present invention also provides a digital camera automatic calibration control method, which is applied to a digital camera automatic calibration control system, and the method comprises the following steps:
[0093] S10. During the verification, the software calibration module uses the image editing software to make fine adjustments to the white balance, hue and saturation, shadow and red primary color, and debugs the automatic calibration function to achieve the best visual effect, and transmits the results to the internal metadata module;
[0094] See also Figure 8 As shown, the step S10 includes the following steps:
[0095] S11. The white balance unit adjusts the cold or warm tones or color temperature through the photo editing software to adjust the color shift of the picture and make the RGB values equal or close to avoid the inaccuracy of white balance, and transmits it to the color saturation unit;
[0096] To further explain, the white balance adjustment is performed by selecting a white or neutral gray object in the captured image as a reference object; and selecting the automatic white balance mode, aiming the camera at the reference object, and ensuring that the reference object fills the photo frame or viewfinder; after shooting, observing that the color of the reference object in the photo is consistent with the predetermined color, it proves that the white balance has been adjusted. If it is inconsistent, selecting the manual white balance mode to fine-tune by adjusting the color temperature or color until the color of the reference object looks correct; since white balance is a very important link in photography and determines the color balance of the photo, the overall hue shift of the picture can be adjusted by cool or warm tones to achieve a personalized hue effect, and by adjusting the color temperature or hue slider, the RGB values can be made equal or close, thereby solving most of the inaccuracies in white balance.
[0097] S12. Hue and Saturation Unit: By adjusting the "Hue" slider and the "Saturation" slider in the photo editing software, you can adjust the saturation of a specific color and the overall saturation, thereby affecting the vividness of the image and passing it to the shadow saturation unit;
[0098] To further explain, the degree of brightness of the color is adjusted through the hue. When it is adjusted to the left in the photo editing software, the picture will tend to cyan, with a retro atmosphere; when it is adjusted to the right, the picture will tend to magenta, which can also be restored by adjusting the hue; the purity or vividness of the color is adjusted through the saturation. By adjusting the saturation slider, reducing the saturation to the left and increasing it to the right in the photo editing software, you can change the vividness of the colors in the image. Reducing the saturation can make the colors softer, while increasing the saturation will make the colors more vivid; the higher the saturation, the vivider the colors, and the lower the saturation, the darker and grayer the colors; generally, for well-exposed photos, slightly adjusting the saturation to increase the saturation can make the colors of the entire photo look more beautiful, but be careful not to pursue vividness excessively, but keep it moderate.
[0099] S13, the shadow saturation unit adjusts the hue of the shadow part, the hue and saturation of the red primary color through the image editing software to correct the color cast and optimize the image color performance, and transmits it to the automatic calibration unit;
[0100] Further explanation: the shadow part of the image is brightened through the "Shadow / Highlight" command to restore details or improve contrast, so as to control the number of shadows (the degree of brightening), hue (the affected shadow range) and radius (the size of local adjacent pixels), so as to accurately adjust the shadow effect to correct the color cast introduced by the lens and sensor, ensure the color accuracy of the shadow part, and affect the color balance of the photo, especially in a mixed light source environment; adjusting the hue of the red primary color can shift it toward orange or magenta, affecting the green to shift toward yellow or cyan, thereby changing the overall hue of the photo; and adjusting the saturation of the red primary color can increase or decrease the purity and intensity of the red, thereby affecting the overall vividness of the photo, making the red more vivid, while reducing the saturation can make the red softer, so as to optimize the color performance of the image.
[0101] S14, the automatic calibration unit places the camera in a shooting environment that needs to be calibrated and connects it to the mobile phone through the automatic calibration software, performs automatic calibration by rotating the mobile phone, and transmits the calibration to the distance verification unit;
[0102] For further instructions, connect the camera to a mobile phone or tablet through the automatic calibration software and open the corresponding application; enter the settings menu and select the automatic calibration or stitching correction option; place the camera in the environment that needs to be calibrated, and ensure that the environment is not a single color or too simple background (such as white walls, blue sky, etc.) to avoid inaccurate calibration; try to avoid using moving objects as calibration references, such as people walking back and forth during the calibration process; level the device and operate according to the prompts on the page.
[0103] S15, the distance verification unit adjusts the clarity and composition of the subject by changing the focal length of the lens and the distance between the camera and the subject, and sets the slider to a certain position to ensure optimal image correction.
[0104] To further explain, the shooting distance calibration of a digital camera includes adjusting the focal length and shooting distance of the camera to ensure that the photographed object presents the best effect in the photo, and also includes adjusting the internal orientation elements and system errors of the camera, as well as considering the optical distortion coefficient to ensure that the geometric relationship of the image is correct, and maintaining an appropriate focal length and shooting distance to ensure the clarity and proportion of the image; by adjusting the internal orientation elements of the relative geometric relationship between the photographic center and the film, to ensure that the light beam shape of each image is correct, so as to obtain accurate measurement results; by calibrating the orientation elements and system errors of the camera, the measurement error can be reduced and the accuracy of the measurement can be improved; in order to correctly restore the light beam shape during photography, the optical distortion coefficient must be guaranteed to ensure that the geometric relationship of the image is correct.
[0105] S20, the internal element module improves the shooting quality and visual effect by measuring the internal parameters, internal orientation elements, optical distortion coefficients, and internal elements of eccentricity constants, and transmits them to the external parameter module;
[0106] See also Fig. 9 As shown, the step S20 includes the following steps:
[0107] S21, the internal parameter unit converts the alignment secondary coordinates and the non-homogeneous coordinates, constructs the internal matrix, and optimizes the internal parameters to adapt to different shooting environments and conditions, and transmits them to the internal element unit;
[0108] It is further explained that the internal parameters, also called intrinsic parameters, include focal length, principal coordinates, lens distortion, aspect ratio, skew, offset, etc., which determine how the camera converts points in the three-dimensional world into pixel positions on the two-dimensional image plane, so that the camera can accurately record the real information of the scene, reduce or eliminate image distortion caused by manufacturing errors, imperfections of the optical system, etc., and measure and adjust parameters such as focal length, principal point position, and distortion coefficient. The focal length determines the size of the image, the principal point position determines the center of the image, and the distortion coefficient affects the distortion of the image, including: aligning the conversion of secondary coordinates and non-homogeneous coordinates, expressing the imaging model of the camera with mathematical formulas, and converting points in the three-dimensional world into pixel positions on the image plane; constructing an intrinsic matrix, which describes the relationship between the internal parameters of the camera and imaging, and contains key information such as focal length and principal point coordinates; optimizing the intrinsic parameters to adapt to different shooting environments and conditions, and adjusting parameters such as focal length and aspect ratio to ensure the accuracy and quality of imaging.
[0109] S22, the inner element unit ensures the accuracy of the image geometric relationship by measuring the principal point position and the principal distance and measuring and setting the principal distance change after focusing, and transmits it to the distortion coefficient unit;
[0110] To further explain, the relative position relationship between the photography center and the photographed image is determined by calibrating the internal orientation elements of the digital camera (focal length, principal point, pixel size of the camera), including the coordinates of the principal point on the image (x 0 ,y 0) and principal distance f, can restore the shape of the light beam during photography, determine the relative position of the photographic center and the film, check and calibrate the internal orientation elements and optical distortion parameters of the digital camera, and transform from the traditional three-dimensional space control field to the two-dimensional plane control field to ensure that the camera can accurately capture and record images, including: the calibration method of the internal orientation elements of the surveying camera based on rotational orthogonality, and the method of calibrating the internal orientation elements of the camera using star points, etc., through precise measurement and calculation, to determine the internal parameters of the camera, such as the effective focal length and the coordinates of the image principal point, as well as possible lens distortion, such as radial distortion, tangential distortion, etc., so as to optimize the imaging quality of the camera, its CCD, CMOS imaging elements can be converted into electronic signals according to different light, and white balance and Gamma value can be adjusted to ensure accurate restoration of the image and true color performance, and also include testing the lighting status of the environment to ensure that it is carried out in a standard color reproduction environment, and consider indicators such as the color temperature and color rendering of the light source.
[0111] S23, the distortion coefficient unit measures the optical distortion coefficient of the geometric or optical deformation that may be generated by the camera lens during the imaging process to improve the quality and authenticity of the image, and transmits the measured optical distortion coefficient to the image frame coordinate unit;
[0112] Further explanation: by measuring the optical distortion coefficient of the digital camera and analyzing the images taken by the camera, the optical distortion caused by lens design, manufacturing defects or environmental factors can be evaluated and corrected. The optical distortion coefficient of the digital camera can be accurately measured and corrected, including: by shooting a special distortion test target plate, shooting once at the long focal end and once at the short focal end, so that the straight line appears non-straight in the image, so as to analyze the distortion at different focal lengths; and through the distortion module and light The falloff module can measure the distortion and uniformity of the digital camera respectively; then the distorted image is mathematically modeled through the geometric correction method, and the image processing technology is used to remap the pixels to achieve the purpose of correcting the distortion; the optical compensation method is used to precisely control the light propagation path of specially designed aspheric lenses, free-form surface lenses and other optical elements to compensate for the distortion in the imaging process and achieve higher correction accuracy; finally, through modern optical distortion correction technology, distortion model establishment, image preprocessing, feature extraction and matching, parameter estimation and optimization and other digital image processing technologies are used to describe the displacement and deformation of each point on the image through mathematical modeling methods, improve image quality, and provide accurate data for subsequent correction.
[0113] S24, the image frame coordinate unit determines the x and y axes by the bisector of the angle between the diagonal frame mark lines, determines the frame mark coordinate system with the intersection as the origin of the coordinate system, and transmits it to the post-distortion difference unit;
[0114] It is further explained that by setting the flattening device and the image frame coordinate system, the stability and consistency of the image during the shooting process are ensured, which provides a basis for image analysis and digital photogrammetry; when the frame mark is difficult to accurately determine, an obvious auxiliary point can be found near the frame mark in the route direction, which can be used to assist in determining the image plane coordinate system, especially when more accurate image measurement and analysis are required; the image principal point and image control point are the basic conditions for establishing the model and conducting the three major orientations, and can be used for epipolar resampling and subsequent product production. The position of the image principal point is usually known in digital cameras, that is, X and Y are both 0, and the focal length f is also a known value. The image principal point coordinates of the frame mark camera are found through the orientation element records in the camera, which are some parameters and settings inside the camera.
[0115] S25, the rear distortion difference unit measures the change of the principal distance and the distortion difference after focusing, establishes a digital distortion model, corrects various distortions together, and transmits the correction to the eccentricity constant unit;
[0116] It is further explained that the change of the principal distance (i.e., the distance from the lens to the photosensitive element) of the camera during the focusing process is set to ensure the clarity of the image; and the changes in distortion differences such as radial distortion and tangential distortion caused by the imperfection of the optical system after the camera is focused are measured, which will affect the geometric shape and size of the image, so as to ensure that the quality of the image after focusing will not be affected by the change of focal length; by measuring the total distortion of each pixel of various imaging systems, a digital distortion model dedicated to the image is established to comprehensively compensate for various distortions generated in various links of various imaging systems, and correct various distortions together, it is possible to effectively measure and correct the distortion differences caused by changes in the optical system characteristics of the digital camera after focusing, so as to ensure the geometric and optical accuracy of the image.
[0117] S26, the eccentricity constant unit measures the eccentricity constant of the relative position relationship between the camera lens and the imaging plane to ensure the accuracy and efficiency of the measurement, and transmits it to the synchronization accuracy unit;
[0118] To further explain, by fixing the camera at a preset position and keeping the reference object at the initial position, wherein the camera is located at the center point of the reference object and the camera is facing a fixed mirror, the camera is lit by a capture card, and a computer is used to take a screenshot of the camera display to obtain a first screenshot, and the camera shooting angle is kept unchanged, the camera is kept at the center point of the reference object and the reference object is rotated at least once, and a screenshot is taken again after each rotation to obtain a second screenshot, etc., by aligning these screenshots and calculating the overlap of the center points of the reference objects in all screenshots, if the overlap is less than a first threshold, the camera is eccentric, otherwise it is centered, so as to ensure the correct shape of each image light beam, that is, restore the relative geometric relationship between the photographic center and the film, and ensure that the light beam shape is correctly restored during photography.
[0119] S27, the synchronization accuracy unit uses the PTP protocol to synchronize shooting of multiple cameras to determine the synchronization accuracy of each camera, providing a high-precision time synchronization solution.
[0120] It is further explained that the PTP (short for Precision Time Protocol) protocol realizes clock synchronization of each node in the network by transmitting timestamp information in the network, ensures that the time of each node in the system is highly consistent, provides a high-precision time reference, can achieve sub-microsecond clock synchronization accuracy, ensures that the time of multiple cameras is highly consistent, and provides a basis for high-precision photography; it is suitable for various types of local area networks, wide area networks, wireless networks and other network environments, and can provide high reliability and stability clock synchronization services for both wired and wireless networks; it has adaptive capabilities and can automatically adjust the clock synchronization strategy according to changes in the network environment to ensure continuous high-precision synchronization effects; it enables equipment from different manufacturers to be seamlessly integrated, provides a unified clock synchronization service, and provides users with more choices and flexibility, but also makes the network sensitive to delays and consumes resources.
[0121] S30, the external parameter module obtains the external parameters by solving the rotation matrix R and the translation vector t between the world coordinate system and the camera coordinate system, and passes them to the external element module;
[0122] See also Fig.10 As shown, the step S30 includes the following steps:
[0123] S31, the attitude position unit obtains the position and attitude of the camera in the world space through the camera calibration method to ensure the accuracy of the image information obtained by the camera, and transmits it to the translation vector unit;
[0124] It is further explained that the camera calibration method uses the characteristic that the two right-angled sides of a right triangle are orthogonal to establish a triangle similar to the calibration device, and then uses the relationship of this triangle to deduce the posture and position of the camera in the world space when the digital camera takes the image, thereby ensuring that the image information obtained from the camera can accurately reflect the scene in the real world, including determining the rotation and translation parameters of the camera, and correcting the distortion parameters to generate a corrected image, and then correcting the distortion of the original image through the obtained camera external parameters, and further performing image correction and three-dimensional scene reconstruction based on the image information to restore the three-dimensional scene.
[0125] S32, the translation vector unit calculates the translation vector of the camera according to the matching information of the feature points and the known world coordinate points, converts its data from the camera coordinate system to the world coordinate system, and passes it to the rotation matrix unit;
[0126] To further illustrate, a set of calibration points are selected from known world coordinate points and corresponding points in the image, and each set requires at least 3 non-linear points; for each selected calibration point, the pixel coordinates (u, v) in the image are converted into normalized plane coordinates (x, y), and this is achieved through the camera's internal parameter calculation formula "x = (u-cx) / fx, y = (v-cy) / fy, cx, cy are the principal point coordinates, fx, fy are the focal lengths of the camera". Using the world coordinate points and normalized plane coordinates of the selected calibration points, the linear or nonlinear least squares method can be used to solve the translation vector (Tx, Ty, Tz) as a three-dimensional vector, and its unit selection depends on the unit of the world coordinates.
[0127] S33, the rotation matrix unit calculates the external parameter matrix by using the world coordinate point of the selected calibration point and the normalized plane coordinate to take the inverse thereof through the singular value decomposition method.
[0128] To further explain, the camera's external parameter matrix describes the camera's position in the world and the direction it points to, the "view matrix" or "model view matrix", which includes a 3x3 rotation matrix and a 3x1 translation vector. In order to describe the camera's external parameters more intuitively, a rigid transformation matrix that describes the camera's posture is constructed, and then its inverse is taken to obtain the external parameter matrix. If C is a column vector describing the position of the camera center in world coordinates, and Rc is a rotation matrix describing the direction of the camera relative to the world coordinate axes, then the transformation matrix describing the camera's posture is [Rc|C]. By adding an extra row (0, 0, 0, 1) to make the matrix square, and then taking the inverse of this matrix, we can get the external parameter matrix, which describes how to convert points in world coordinates to camera coordinates, where the vector t is the position of the world origin in camera coordinates, and the columns of R represent the directions of the world axes in camera coordinates.
[0129] S40, the exterior element module determines the exterior orientation elements of the camera's coordinates (X, Y, Z) in the object space and the direction of the light beam (ψ, ω, κ) to ensure the accuracy of the image, and transmits them to the image correction module;
[0130] See also Fig.11 As shown, the step S40 includes the following steps:
[0131] S41, the data acquisition unit captures the image using the camera to be inspected by placing feature points in the world coordinate system or using a calibration plate and converts the image into recognizable image coordinate information, and transmits the information to the feature detection unit;
[0132] It is further explained that the collected images are corrected, registered, fused and other data processing is performed to ensure the accuracy and consistency of the data; the processed data are subjected to visual inspection, contrast analysis, geographic coordinate verification and other quality inspections to ensure the reliability and validity of the data; the entire data collection and processing process, such as the camera position, camera direction, factors affecting data quality, etc., is recorded and a detailed report is generated to facilitate subsequent data analysis and application, thereby providing reliable data support for subsequent geographic information processing, three-dimensional model construction, etc.
[0133] S42, the feature detection unit obtains detection feature points such as corner points, edges or other identifiable features in the image through an edge algorithm for subsequent feature matching, and transmits them to the feature matching unit;
[0134] It is further explained that the edge algorithm is used to filter the obtained image through a filter to reduce the noise in the image, but it causes some loss of the edge, so the edge needs to be enhanced later to obtain a balance with noise reduction; the points with significant changes in neighborhood intensity values are highlighted by calculating the gradient amplitude, thereby enhancing the visibility of these points, and determining the change value of the neighborhood intensity of each point in the image to make the edge more obvious; by setting the gradient amplitude threshold, those points whose gradient amplitude exceeds the set threshold are judged as edge points; and the position and orientation of the edge are estimated at sub-pixel resolution, and the coordinates of the actual imaging point are determined, ensuring accurate measurement and positioning, so that the edge information in the image can be effectively extracted, providing a basis for subsequent image analysis and understanding.
[0135] S43, the feature matching unit matches the feature points detected in the image with the known world coordinate points, and transmits them to the evaluation and optimization unit;
[0136] It is further explained that the extracted feature points are used to identify the same-name points between two or more images through a matching algorithm, and the correspondence, similarity and consistency of the image content, features, structure, relationship, texture and grayscale are analyzed to find the corresponding relationship in the two images; after the feature points of the images are extracted, the feature points in the two images are matched, and the distance between feature descriptors such as Euclidean distance is calculated, and the minimum distance match is found. In order to reduce false matching, methods such as ratio testing are used, that is, the distance ratio between the current best match and the second best match is compared. If the ratio is less than a certain threshold, the match is considered valid. The external parameters include the position and posture of the camera.
[0137] S44, the evaluation and optimization unit evaluates and optimizes the external parameters of the camera's pixels, sensor, lens, and shutter by a nonlinear method to improve accuracy, and transmits the evaluation and optimization to the result verification unit;
[0138] It is further explained that the external parameter evaluation and optimization of the digital camera include: the camera pixel size of the maximum resolution of the image that can be captured, the higher the pixel, the higher the clarity of the photo; the sensor type of the photoelectric sensor chip inside the camera, different sensor chips have different sizes, which affect parameters such as pixels, color reproduction, noise and dynamic range, and the shooting effect of the full-frame sensor is usually better; the quality of the lens, which is the "eye" of the camera, when selecting the lens, pay attention to factors such as resolution, aperture, distortion, color reproduction, vibration compensation, etc.; the shutter speed used to control the exposure time of the photo, a faster shutter can obtain clear photos in different lighting environments, while a slower shutter helps to capture special effects.
[0139] S45, the result verification unit verifies whether the external parameters can accurately map the points in the world coordinate system to the image, and compares them with the known world coordinate points, and verifies through actual photo taking test.
[0140] To further explain, take pictures with a test card with clarity and color, and record the shooting distance. Usually, the best shooting distance for a digital camera is 1.5 to 3 meters. During the test, take pictures every 0.5 meter at a distance of 0.5 to 5 meters, and record the shooting effect. By comparing the shooting effect with the clarity and color consistency of the test card, the performance of the camera at different distances can be evaluated, especially whether the best effect is obtained within the optimal distance; and test different flash modes such as enhanced flash, forced flash, automatic flash, and no flash to evaluate the performance of the camera under different lighting conditions. For example: enhanced flash is used for dark scene shooting, forced flash flashes regardless of light conditions, automatic flash automatically determines whether to flash according to light intensity, and no flash does not perform fill light under any conditions. This can effectively verify the calibration results of external parameters such as the position and rotation direction of the digital camera to ensure that the performance of the camera in actual use meets expectations.
[0141] S50, the image correction module obtains the image resolution of the camera by shooting test and calculation, so as to obtain the image resolution test, and transmits it to the processing center;
[0142] See also Fig.12 As shown, the step S50 includes the following steps:
[0143] S51, the test determination unit places the resolution test card on a plane to ensure that it is parallel to the imaging plane of the camera, adjusts the distance to cover the camera imaging area, and transmits the resolution test card to the shooting test unit;
[0144] Further instructions: ensure that the lighting conditions of the test environment are uniform and meet the standard requirements, use natural light or standard artificial light sources, and avoid the influence of direct light and reflection on the test results; and prepare the ISO 12233 standard resolution test chart or other similar horizontal and vertical line test patterns to evaluate the resolution of the image; place the resolution ISO 12233 test chart on a stable and flat plane, ensure that the test chart is parallel to the imaging plane of the camera, and adjust the appropriate distance to cover the imaging area of the camera, and select J1, K1 in the horizontal direction, J2, K2 in the vertical direction, and JD, KD in the 45-degree tilt direction for testing.
[0145] S52, the shooting test unit adjusts the focal length, aperture, shutter speed, and ISO parameters of the camera according to the test card requirements and camera performance, and shoots the test card to obtain the best imaging effect, and transmits it to the image analysis unit;
[0146] Further explanation: the test card fills the field of view and is in clear focus. The surface illumination is about 500 lux. The difference between the illumination at each point on the card and the center illumination does not exceed 10%. The optical resolution of the lens assembly used is greater than the resolution of the camera. The lens focal length is not less than the equivalent focal length to prevent the light source from directly hitting the lens. The background of the test chart uses medium gray. The ambient temperature is maintained at 20℃±2℃ and the relative humidity is 50%±20%. Ensure that the camera is stable or use a tripod. Keep the camera and the test card level when shooting, and ensure that the focus is accurate. Avoid hand shaking or camera movement when shooting. Take multiple test card images to ensure that the image is clear and stable, avoid hand shaking or camera movement, so as to facilitate multiple subsequent tests and analyses. Use software to test the center horizontal resolution and center vertical resolution to evaluate the camera's resolution and other performance indicators.
[0147] S53, the image analysis unit calculates the image resolution according to the formula "R i =L×S÷f,R i is the image resolution, L is the distance between the camera and the standard test card, S is the minimum reading number of the test card, and f is the focal length of the camera” to obtain the image resolution.
[0148] Further explanation: the distance L between the camera and the standard test card, the minimum reading number S of the test card, and the focal length f of the camera are obtained through the above tests, wherein the distance L between the camera and the standard test card is the best effective shooting distance of the camera, and the focal length f of the camera is the actual focal length of the camera multiplied by 10 -3 , that is, 0.001; by importing the captured image into the computer and using Imatest image analysis software to evaluate the image resolution, the software will calculate the image resolution based on the line pair pattern on the test card.
[0149] S60: The processing center compares the actual image resolution of the camera with the image resolution standard of the camera stored in the memory. If the standard is met, the calibration is qualified. If not, the alarm is transmitted to the alarm and a recalibration or maintenance is notified.
[0150] To further explain, as the service life of each camera shortens, its image resolution will become worse and worse, so it needs constant calibration or maintenance to ensure that its actual image resolution meets its image resolution standard. Therefore, the longer the camera is used, the more frequently it needs to be calibrated to ensure its normal function.
[0151] It is further explained that the various steps are displayed in sequence as indicated by the arrows, but these steps are not necessarily executed in the order indicated by the arrows. Unless otherwise clearly stated in this document, there is no strict order restriction for the execution of these steps. These steps can also be executed according to other orders, and some steps may include multiple sub-steps or multiple stages. These sub-steps or stages are not necessarily executed and completed at the same time, but can be executed at different times. The execution order of these sub-steps or stages is not necessarily sequential, but can be executed in turn or alternately with other steps or at least part of the sub-steps or stages of other steps.
[0152] A digital camera automatic calibration control system provided by the present invention also includes a computer device and a computer-readable storage medium; the computer device includes a memory and various functional modules, the memory stores a computer program, and the various functional modules implement the steps of any one of the above-mentioned digital camera automatic calibration control methods when executing the computer program; the computer-readable storage medium stores a computer program, and the computer program implements the steps of any one of the above-mentioned digital camera automatic calibration control methods when executed by the various functional modules.
[0153] It is further explained that the computer-readable storage medium includes a memory, which can be used to store non-volatile software programs, non-volatile computer executable programs and modules, such as the program and instructions corresponding to a digital camera automatic calibration control method in an embodiment of the present invention, including information transmission instructions for each module; the memory executes various functional applications and data processing of each module by running the stored non-volatile software programs and instructions, that is, implements a digital camera automatic calibration control method in the above method embodiment; one or more units are stored in the memory, and when executed by the one or more modules, an automatic calibration control method for a digital camera in any of the above method embodiments is executed; the computer-readable storage medium stores computer executable instructions, which are executed by one or more modules, and can also be an automatic calibration control method for a digital camera in any of the above method embodiments.
[0154] To further illustrate, the present invention is described in accordance with the content implemented by a software program of an automatic calibration control system for a digital camera. Each automatic calibration control method for a digital camera is divided into a number of modules or units to implement the software program instructions generated by each step. The software program instructions include the automatic calibration control method for a digital camera described above.
[0155] It is further explained that the contents described above in the present invention are written in accordance with the contents implemented by the software copyrights such as "Digital Camera Lens Detection Software (version number: V1.0, registration date: 2024.4.18.)" and "Digital Camera Automatic Calibration Processing Software (version number: V1.0, registration date: 2024.4.18.)" applied by our company.
[0156] The present invention also provides a digital camera automatic calibration control device, which is implemented by the above-mentioned digital camera automatic calibration control method.
[0157] It is further explained that the automatic calibration control device is an auxiliary control device of the digital camera inspection equipment and a supporting equipment for its use. It can be assembled and connected according to the digital camera inspection equipment to achieve integration with the digital camera inspection equipment, or the control device can be separated from the digital camera inspection equipment and be independent of each other. They are only put together when in use, which is convenient for storage and for user service, and can be effectively connected through a wireless network or data cable.
[0158] It is obvious to those skilled in the art that the present application is not limited to the details of the exemplary embodiments described above, and that the present application can be implemented in other specific forms without departing from the spirit or essential features of the present application. Therefore, no matter from which point of view, the embodiments should be regarded as exemplary and non-restrictive, and the scope of the present application is defined by the appended claims rather than the above description, and it is intended that all changes falling within the meaning and scope of the equivalent elements of the claims are included in the present application.
[0159] Finally, it should be noted that the above embodiments are only used to illustrate the technical solution of the present application and are not intended to limit it. Although the present application has been described in detail with reference to the preferred embodiments, a person of ordinary skill in the art should understand that the technical solution of the present application can be modified or replaced by equivalents, and all should be included in the scope of protection of the present application.
Claims
1. A digital camera automatic calibration control method, characterized in that : Applied to a comprehensive phototherapy and health care control system for moxibustion, the control system includes a software calibration module, an internal number module, an external parameter module, an external element module, an image correction module, a wireless communication module, an alarm, a memory, a processing center, and a smart phone; the software calibration module, the internal number module, the external parameter module, the external element module, the image correction module, the wireless communication module, the alarm, and the memory are respectively connected to the processing center; the smart phone is automatically connected to the wireless communication module within the range of a wireless network or the Internet; The wireless communication module is provided with a wireless network unit, which is responsible for sending and receiving wireless network signals and automatically networking with a smart phone within the range of a wireless network or the Internet; The alarm device compares the actual image resolution of the camera with the image resolution standard of the camera stored in the memory, and automatically sounds an alarm and notifies for recalibration or maintenance if the standard is not met; The memory is responsible for storing information of the software calibration module, the internal element module, the external parameter module, the external element module, the image correction module, the wireless communication module, the alarm, and the image resolution standard of the camera; The processing center is responsible for the information transmission of the software calibration module, internal number module, external parameter module, external element module, image correction module, wireless communication module, alarm, and memory. It is the hub of the system and compares the actual image resolution of the camera with the image resolution standard of the camera stored in the memory: if it meets the standard, the calibration is qualified; if it does not meet the standard, it is transmitted to the alarm and notified to re-calibrate or repair; The software calibration module includes a white balance unit, a hue saturation unit, a shadow saturation unit, an automatic calibration unit, and a distance verification unit. The software is used to perform fine adjustments of white balance, hue and saturation, shadow and red primary color, and debug the automatic calibration function to achieve the best visual effect, and pass it to the internal metadata module; The internal element module includes an internal parameter unit, an internal element unit, a distortion coefficient unit, a frame coordinate unit, a post-distortion difference unit, an eccentricity constant unit, and a synchronization accuracy unit. The internal element of the internal parameters, the internal element, the optical distortion coefficient, and the eccentricity constant is measured to improve the shooting quality and visual effect, and is passed to the external parameter module; The external parameter module includes a posture position unit, a translation vector unit, and a rotation matrix unit. The external parameters are obtained by solving the rotation matrix R and the translation vector t between the world coordinate system and the camera coordinate system, and are passed to the external element module; The external element module includes a data acquisition unit, a feature detection unit, a feature matching unit, an evaluation and optimization unit, and a result verification unit. It ensures the accuracy of the image by measuring the external orientation elements of the camera's coordinates (X, Y, Z) in the object space and the direction of the light beam (ψ, ω, κ), and transmits them to the image correction module; The image correction module includes a test determination unit, a shooting test unit, and an image analysis unit, and obtains the image resolution of the camera through shooting test and calculation to obtain the image resolution test, and transmits it to the processing center; The method described comprises the following steps: S10, during the verification, the software calibration module uses the image editing software to perform fine adjustments of white balance, hue and saturation, shadow and red primary color, and debugs the automatic calibration function, and transmits the results to the internal metadata module; S20, the internal element module measures the internal parameters, internal orientation elements, optical distortion coefficients, and internal elements of eccentricity constants to improve the shooting quality and visual effects, and transmits them to the external parameter module; S30, the external parameter module obtains the external parameters by solving the rotation matrix R and the translation vector t between the world coordinate system and the camera coordinate system, and passes them to the external element module; S40, the exterior element module determines the exterior orientation elements of the camera coordinates (X, Y, Z) in the object space and the direction of the light beam (ψ, ω, κ) to ensure the accuracy of the image, and transmits them to the image correction module; S50, the image correction module obtains the image resolution of the camera by shooting test and calculation, so as to obtain the image resolution test, and transmits it to the processing center; S60, the processing center compares the actual image resolution of the camera with the camera image resolution standard stored in the memory: if it meets the standard, the calibration is qualified; if it does not meet the standard, it is transmitted to the alarm and notified to re-calibrate or repair.
2. The method for automatic calibration and control of a digital camera according to claim 1, characterized in that: The step S10 comprises the following steps: S11. The white balance unit adjusts the cold or warm tones or the color temperature through the photo editing software to adjust the color shift of the picture and make the RGB values equal or close, and transmits them to the color saturation unit; S12. The hue saturation unit can adjust the saturation of a specific color and the overall saturation by adjusting the "hue" slider and the saturation slider through the photo editing software, and pass it to the shadow saturation unit; S13, the shadow saturation unit adjusts the hue of the shadow part, the hue and saturation of the red primary color through the image editing software to correct the color cast and optimize the image color performance, and transmits it to the automatic calibration unit; S14, the automatic calibration unit places the camera in a shooting environment that needs to be calibrated and connects it to the mobile phone through the automatic calibration software, performs automatic calibration by rotating the mobile phone, and transmits the calibration to the distance verification unit; S15, the distance verification unit adjusts the clarity and composition of the subject by changing the focal length of the lens and the distance between the camera and the subject, and fixes the slider position to ensure optimal image correction.
3. The method for automatic calibration and control of a digital camera according to claim 1, characterized in that: The step S20 comprises the following steps: S21, the internal parameter unit adapts to different shooting environments by converting the aligned secondary coordinates and the non-homogeneous coordinates, constructing the internal matrix, and optimizing the internal parameters, and transmits them to the internal element unit; S22, the inner element unit determines the principal point position and principal distance and determines and sets the principal distance change after focusing to ensure the accuracy of the image geometric relationship and transmits it to the distortion coefficient unit; S23, the distortion coefficient unit measures the optical distortion coefficient of the geometric or optical deformation that may be generated by the camera lens during the imaging process to improve the image quality and transmits it to the image frame coordinate unit; S24, the image frame coordinate unit determines the x and y axes by the bisector of the angle between the diagonal frame mark lines, determines the frame mark coordinate system with the intersection as the origin of the coordinate system, and transmits it to the post-distortion difference unit; S25, the rear distortion difference unit measures the change of the principal distance and the distortion difference after focusing, establishes a digital distortion model, corrects various distortions together, and transmits the correction to the eccentricity constant unit; S26, the eccentricity constant unit measures the eccentricity constant of the relative position relationship between the camera lens and the imaging plane to ensure the accuracy and efficiency of the measurement, and transmits it to the synchronization accuracy unit; S27, the synchronization accuracy unit uses the PTP protocol to synchronize shooting of multiple cameras to determine the synchronization accuracy of each camera, providing a high-precision time synchronization solution.
4. The method for automatic calibration and control of a digital camera according to claim 1, characterized in that: The step S30 comprises the following steps: S31, the attitude position unit obtains the position and attitude of the camera in the world space through the camera calibration method to ensure the accuracy of the image information obtained by the camera, and transmits it to the translation vector unit; S32, the translation vector unit calculates the translation vector of the camera according to the matching information of the feature points and the known world coordinate points, converts it from the camera coordinate system to the world coordinate system, and passes it to the rotation matrix unit; S33, the rotation matrix unit calculates the external parameter matrix by using the world coordinate point of the selected calibration point and the normalized plane coordinate to take the inverse thereof through the singular value decomposition method.
5. The method for automatic calibration and control of a digital camera according to claim 1, characterized in that: The step S40 comprises the following steps: S41, the data acquisition unit captures the image using the camera to be inspected by placing feature points in the world coordinate system or using a calibration plate and converts the image into recognizable image coordinate information, and transmits the information to the feature detection unit; S42, the feature detection unit obtains detection feature points such as corner points, edges or other identifiable features in the image through an edge algorithm for subsequent feature matching, and transmits them to the feature matching unit; S43, the feature matching unit matches the feature points detected in the image with the known world coordinate points, and transmits them to the evaluation and optimization unit; S44, the evaluation and optimization unit evaluates and optimizes the external parameters of the camera's pixels, sensor, lens, and shutter by a nonlinear method to improve accuracy, and transmits the evaluation and optimization to the result verification unit; S45. The result verification unit verifies whether the external parameters can accurately map points in the world coordinate system to the image, and compares them with known world coordinate points, and verifies through actual photo taking tests.
6. The method for automatic calibration and control of a digital camera according to claim 1, characterized in that: The step S50 comprises the following steps: S51, the test determination unit places the resolution test card on a plane to ensure that it is parallel to the imaging plane of the camera, adjusts the distance to cover the camera imaging area, and transmits it to the shooting test unit; S52, the shooting test unit adjusts the focal length, aperture, shutter speed, and ISO parameters of the camera according to the test card requirements and camera performance, shoots the test card, so as to obtain the best imaging effect, and transmits it to the image analysis unit; S53, the image analysis unit calculates the image resolution according to the formula "R i =L×S÷f,R i is the image resolution, L is the distance between the camera and the standard test card, S is the minimum reading number of the test card, and f is the focal length of the camera” to obtain the image resolution.
7. The method for automatic calibration and control of a digital camera according to claim 1, characterized in that: The control system also includes a computer device and a computer-readable storage medium; the computer device includes a memory and various functional modules, the memory stores a computer program, and when the various functional modules execute the computer program, the steps of the digital camera automatic calibration control method described in any one of claims 1 to 6 are implemented; the computer-readable storage medium stores a computer program, and when the computer program is executed by the various functional modules, the steps of the digital camera automatic calibration control method described in any one of claims 1 to 6 are implemented.
8. A digital camera automatic calibration control device, characterized in that: The method is implemented by using a digital camera automatic calibration control method as described in any one of claims 1 to 7.
