Multi-Camera Vision Processing for Camera Parameter Deviation Detection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing techniques for estimating camera parameters in multiple cameras require sensors capable of acquiring moving distance information, making it difficult to apply to mobile bodies without such sensors, and deviations due to environmental disturbances reduce accuracy.
Innovation Solution
An information processing apparatus and method that calculates three-dimensional positions of feature points and estimates external camera parameters using images from multiple cameras, determining deviations in these parameters without requiring sensors for moving distance information.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If a sensor capable of acquiring moving distance information is equipped on the mobile body to detect camera parameter deviations, then the accuracy of deviation detection is improved, but the device complexity and cost increase
Solution Approach 1:
The patent introduces a marker as an intermediary object between the cameras and the mobile body. The marker serves as a reference that allows the system to detect camera parameter deviations through image analysis rather than requiring direct measurement sensors on the mobile body. This intermediary approach enables accurate deviation detection while avoiding the need for complex sensor equipment.
Solution Approach 2:
The patent replaces the mechanical/sensor-based approach (using sensors to directly measure position and orientation) with an optical/image-based approach. By using multiple cameras to capture images of a marker and analyzing these images to calculate camera parameters, the system substitutes sensor-based measurement with vision-based measurement, thereby reducing device complexity while maintaining detection accuracy.
2Reliability
If sensors for acquiring moving distance information are installed to enable deviation detection, then the reliability of distance measurement is improved, but the ease of operation and applicability are reduced
Solution Approach 1:
The marker acts as a universal intermediary that can be used with any mobile body regardless of whether it is equipped with sensors. This approach makes the deviation detection system universally applicable to various mobile bodies (drones, robots, vehicles, etc.) without requiring them to have specific sensor equipment, thereby greatly enhancing adaptability and versatility.
Solution Approach 2:
The patent creates a universal deviation detection method that can be applied to any mobile body by using only cameras and a marker. The system is designed to be sensor-agnostic, making it universally applicable across different types of mobile bodies and applications, from drones to ground robots to aerial vehicles, without requiring modification or additional sensor equipment on the mobile body itself.
3Ease of operation
If camera parameters are not accurately maintained to avoid deviation, then the ease of operation is improved, but the measurement precision of distance estimation deteriorates
Solution Approach 1:
The patent implements a feedback mechanism where the system continuously monitors camera parameter deviations by analyzing images of the marker. When deviations are detected, the system can trigger recalibration or compensation procedures. This feedback loop allows the system to maintain measurement precision automatically without requiring frequent manual intervention or calibration, thus balancing ease of operation with measurement accuracy.
Solution Approach 2:
The patent performs preliminary deviation detection by continuously analyzing marker images to determine whether camera parameters have deviated before distance measurements are taken. This preliminary check allows the system to identify and correct potential accuracy issues proactively, ensuring that distance estimations are always based on accurate camera parameters without requiring frequent manual calibration interventions.
Data Source
AI summary
There is proposed a new and improved information processing apparatus, an information processing method, and a program capable of more simply detecting whether or not a deviation related to a camera parameter has occurred in a plurality of cameras. The information processing apparatus includes a calculator that calculates a three-dimensional position of a feature point on the basis of each of images obtained by imaging a subject at a first timing by a plurality of cameras and an external parameter of the plurality of cameras, the feature point being included in each of the images, a first estimator that estimates a first external parameter on the basis of one image included in the images obtained by imaging the subject at a second timing by the plurality of cameras and the three-dimensional position of the feature point, the first external parameter being an external parameter of a camera that has captured the one image among the plurality of cameras at the second timing, a second estimator that estimates a second external parameter that is an external parameter of any one camera of the plurality of cameras at the first timing on the basis of the first external parameter estimated by the first estimator, and a determiner that determines whether or not a deviation related to the external parameter has occurred in the plurality of cameras on the basis of the second external parameter of any one camera of the plurality of cameras and a previous external parameter of the any one camera, the second external parameter having been estimated by the second estimator.