Vehicle Camera Pose Estimation for Real-Time Obstacle Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional motion estimation methods for vehicle-mounted cameras are inefficient and not suitable for real-time applications, particularly in environments with non-planar surfaces, as they require iterative algorithms and are not precise enough for dense 3D reconstruction.

Innovation Solution

A non-iterative 2-point motion estimation method using a single quadratic equation subject to coplanarity and orthonormality constraints, combined with a 3-point 2D-to-3D camera pose estimation for subsequent images, to generate accurate motion estimates for plane-sweeping procedures that produce dense depth-maps.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If conventional iterative algorithms (e.g., Newton-Raphson) are used for motion estimation, then measurement precision can be improved, but processing time increases significantly making real-time applications infeasible

Engineering Contradiction:
Improvemotion estimation accuracyVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent employs a single quadratic equation solution that provides accurate motion estimates without requiring iterative refinement. This non-iterative approach delivers precise motion parameters quickly enough for real-time obstacle detection applications, sacrificing the incremental precision improvement of iterative methods for the sake of computational efficiency and real-time performance

Inventive Principle:
Principle #27Cheap short-living objects (Disposable)

Solution Approach 2:

The patent replaces the mechanical iterative optimization process (Newton-Raphson algorithm) with a direct algebraic solution using a single quadratic equation. This substitution eliminates the iterative loop while maintaining sufficient accuracy for obstacle detection, thereby reducing computational time and enabling real-time processing

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Productivity

If minimal solutions (e.g., 2-point or 3-point methods) are used for motion estimation, then processing speed improves, but measurement precision deteriorates especially in non-planar environments

Engineering Contradiction:
Improveprocessing speedVSAvoidmotion estimation accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The patent changes the mathematical formulation from iterative optimization to a direct quadratic equation solution. This parameter change in the solution methodology maintains computational efficiency of minimal solutions while improving precision through an exact algebraic solution that properly handles coplanarity and orthonormality constraints without iterative approximation errors

Inventive Principle:
Principle #35Parameter changes

3Measurement precision

If iterative algorithms with additional constraints are applied to handle non-planar surfaces, then measurement precision improves, but device complexity and computational load increase

Engineering Contradiction:
Improvedense 3D reconstruction accuracyVSAvoidalgorithm complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent segments the motion estimation problem into two parts: using a simplified 2-point method for initial motion estimates and then applying a 3-point 2D-to-3D pose estimation for subsequent images. This segmentation allows the system to handle non-planar surfaces accurately while keeping individual computational steps simple and efficient

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent performs preliminary motion estimation using a 2-point method to establish initial camera poses, then uses these poses as a foundation for more accurate 3-point 2D-to-3D pose estimation on subsequent images. This preliminary action enables the system to handle non-planar surfaces with improved accuracy without requiring complex iterative algorithms for every frame

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS8831290B2Method and system for determining poses of vehicle-mounted cameras for in-road obstacle detection
Publication Date: 2014.09.09 MITSUBISHI ELECTRIC RESEARCH LABORATORIES INC
  • US8831290B2 patent drawing
  • US8831290B2 patent drawing
  • US8831290B2 patent drawing

AI summary

Poses of a movable camera relative to an environment are obtained by determining point correspondences from a set of initial images and then applying 2-point motion estimation to the point correspondences to determine a set of initial poses of the camera. A point cloud is generated from the set of initial poses and the point correspondences. Then, for each next image, the point correspondences and corresponding poses are determined, while updating the point cloud.