Camera Posture Estimation Using Vanishing Points on a Unit Sphere

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional techniques struggle to accurately estimate vanishing points and determine the posture of a camera, particularly in urban areas with blurred building contours, leading to inaccurate camera posture determination.

Innovation Solution

An information processing apparatus that utilizes machine learning models to estimate vanishing points and intrinsic parameters from images, projecting these points onto a unit sphere to calculate the camera's rotation angle based on errors with reference vanishing points, eliminating the need for odometry or gyro sensors.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If conventional arc detection methods are used to estimate vanishing points, then the process can be implemented without machine learning, but the estimation accuracy deteriorates in places with blurred building contours

Engineering Contradiction:
Improvevanishing point estimation accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent replaces conventional arc detection algorithms with a machine learning model (neural network) to estimate vanishing points directly from images. This substitution enables accurate vanishing point estimation even in challenging environments with blurred building contours, while the model can be deployed on standard computing hardware without requiring specialized mechanical or optical devices.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Measurement precision

If machine learning models are used to estimate vanishing points, then the estimation accuracy improves in difficult environments, but the computational complexity increases

Engineering Contradiction:
Improvecamera posture determination accuracyVSAvoidcomputational power
Core Design Contradiction:
Measurement precisionVSPower

Solution Approach 1:

The patent performs preliminary actions by pre-training the machine learning model offline with large datasets. Once trained, the model contains learned features and patterns that enable accurate vanishing point estimation during runtime without requiring heavy computational resources for training. This separates the computationally intensive training phase from the deployment phase, allowing accurate inference on devices with limited power.

Inventive Principle:
Principle #10Preliminary action

3Adaptability or versatility

If arc detection is performed to find vanishing points, then the method works in clear environments, but it fails in places causing difficulty in arc detection

Engineering Contradiction:
Improveenvironmental adaptabilityVSAvoidvanishing point estimation reliability
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The patent changes the input parameters and features considered by the estimation system. Instead of relying on arc detection parameters that require clear building contours, the machine learning model learns from diverse image features including texture, color, and structural patterns that remain reliable even when building contours are blurred. This enables the system to adapt to various environmental conditions while maintaining reliable vanishing point estimation.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS20250391055A1Information processing device, information processing method, and non-transitory computer readable recording medium
Publication Date: 2025.12.25 PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO LTD
  • US20250391055A1 patent drawing
  • US20250391055A1 patent drawing
  • US20250391055A1 patent drawing

AI summary

An information processing apparatus estimates a plurality of vanishing points and an intrinsic parameter of a camera by inputting an image to a learning model trained by machine learning in advance for estimating a vanishing point and an intrinsic parameter of the camera; projects the estimated vanishing points onto a unit sphere in a world coordinate system on the basis of the intrinsic parameter; and calculates a rotation angle indicative of a posture of the camera on the basis of errors between the projected vanishing points and a plurality of reference vanishing points projected onto the unit sphere in advance.