Camera Posture Estimation Using Vanishing Points on a Unit Sphere
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional techniques struggle to accurately estimate vanishing points and determine the posture of a camera, particularly in urban areas with blurred building contours, leading to inaccurate camera posture determination.
Innovation Solution
An information processing apparatus that utilizes machine learning models to estimate vanishing points and intrinsic parameters from images, projecting these points onto a unit sphere to calculate the camera's rotation angle based on errors with reference vanishing points, eliminating the need for odometry or gyro sensors.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If conventional arc detection methods are used to estimate vanishing points, then the process can be implemented without machine learning, but the estimation accuracy deteriorates in places with blurred building contours
Solution Approach 1:
The patent replaces conventional arc detection algorithms with a machine learning model (neural network) to estimate vanishing points directly from images. This substitution enables accurate vanishing point estimation even in challenging environments with blurred building contours, while the model can be deployed on standard computing hardware without requiring specialized mechanical or optical devices.
2Measurement precision
If machine learning models are used to estimate vanishing points, then the estimation accuracy improves in difficult environments, but the computational complexity increases
Solution Approach 1:
The patent performs preliminary actions by pre-training the machine learning model offline with large datasets. Once trained, the model contains learned features and patterns that enable accurate vanishing point estimation during runtime without requiring heavy computational resources for training. This separates the computationally intensive training phase from the deployment phase, allowing accurate inference on devices with limited power.
3Adaptability or versatility
If arc detection is performed to find vanishing points, then the method works in clear environments, but it fails in places causing difficulty in arc detection
Solution Approach 1:
The patent changes the input parameters and features considered by the estimation system. Instead of relying on arc detection parameters that require clear building contours, the machine learning model learns from diverse image features including texture, color, and structural patterns that remain reliable even when building contours are blurred. This enables the system to adapt to various environmental conditions while maintaining reliable vanishing point estimation.
Data Source
AI summary
An information processing apparatus estimates a plurality of vanishing points and an intrinsic parameter of a camera by inputting an image to a learning model trained by machine learning in advance for estimating a vanishing point and an intrinsic parameter of the camera; projects the estimated vanishing points onto a unit sphere in a world coordinate system on the basis of the intrinsic parameter; and calculates a rotation angle indicative of a posture of the camera on the basis of errors between the projected vanishing points and a plurality of reference vanishing points projected onto the unit sphere in advance.


