Triangulation Device Using Epipolar Polynomial Correction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Triangulation methods using the bundle adjustment method face challenges in converging to globally optimum three-dimensional coordinates due to the infinite search range of the three-dimensional space, leading to potential local solutions, and existing methods either require complex iterative calculations or approximate solutions with uncertain global optimality.

Innovation Solution

A triangulation device and method that calculate correction vectors using a characteristic polynomial including a correction amount or its reciprocal as a variable to satisfy the epipolar equation, allowing for the computation of corrected corresponding points and subsequently determining the three-dimensional coordinates of the measurement target point with guaranteed global optimality.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If bundle adjustment method is used to estimate three-dimensional coordinates, then measurement precision can be improved by minimizing reprojection error, but device complexity increases due to unconstrained nonlinear optimization and the risk of converging to local solutions instead of global optimum

Engineering Contradiction:
Improvethree-dimensional coordinates estimation accuracyVSAvoidoptimization process complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent applies preliminary action by first obtaining initial three-dimensional coordinates through linear least squares method before performing bundle adjustment. This preliminary estimation provides a starting point that guides the nonlinear optimization process, reducing the search space and preventing convergence to local minima. The initial coordinates are calculated using epipolar geometry constraints, establishing a foundation that improves subsequent optimization convergence.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent changes parameters by transforming the optimization problem from unconstrained nonlinear optimization to a constrained problem using epipolar equations. By incorporating epipolar constraints as additional parameters and conditions, the search space is significantly reduced from infinite three-dimensional space to a constrained manifold, ensuring global optimality while maintaining measurement precision.

Inventive Principle:
Principle #35Parameter changes

2Productivity

If linear least squares method is used to obtain initial three-dimensional coordinates, then computation speed is improved, but measurement precision deteriorates because the epipolar equation is generally not satisfied due to noise

Engineering Contradiction:
Improvecomputation speedVSAvoidthree-dimensional coordinates accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The patent segments the triangulation process into two distinct stages: first obtaining initial coordinates through linear least squares method for rapid computation, then refining these coordinates through bundle adjustment with epipolar constraints for high precision. This segmentation allows each method to operate in its optimal regime - speed for initialization, accuracy for refinement - resolving the contradiction between computation speed and measurement precision.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent uses bundle adjustment with epipolar constraints as an intermediary process between the rough initial estimation and the final precise coordinates. This intermediary step corrects the initial coordinates by minimizing reprojection error under epipolar constraints, effectively bridging the gap between fast but inaccurate linear least squares results and the desired high-precision coordinates.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Measurement precision

If corresponding points are corrected to satisfy epipolar equation, then measurement precision is improved, but device complexity increases due to solving sixth-degree polynomial equations

Engineering Contradiction:
Improvecorresponding points coordinate accuracyVSAvoidpolynomial equation solving complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent extracts and corrects only the necessary components - the corresponding point coordinates - to satisfy epipolar constraints, rather than optimizing all three-dimensional coordinates simultaneously. By focusing correction efforts specifically on the image coordinates of corresponding points and using these corrected coordinates for subsequent triangulation, the method reduces computational complexity while maintaining precision improvements.

Inventive Principle:
Principle #2Taking out (Extraction)

Data Source

PatentUS10126115B2Triangulation device, triangulation method, and recording medium recording program therefor
Publication Date: 2018.11.13 NEC CORP
  • US10126115B2 patent drawing
  • US10126115B2 patent drawing
  • US10126115B2 patent drawing

AI summary

A triangulation device for computing a three-dimensional position of a measurement target point using a stereo method, the triangulation device includes: optimum image coordinate estimation unit configured to, based on coordinates of corresponding points corresponding to the measurement target point in two images each of which including an image of the measurement target point, and intrinsic parameters and extrinsic parameters of optical instruments generating the two images, calculate correction vectors by which coordinates of the corrected corresponding points satisfy an epipolar equation composed of the intrinsic parameters and the extrinsic parameters, using a characteristic polynomial including a correction amount of coordinates of the corresponding points or a reciprocal of the correction amount as a variable, and compute coordinates of the corrected corresponding points based on calculated correction vectors; and three-dimensional coordinate calculation unit configured to calculate three-dimensional coordinates of the measurement target point based on coordinates of the corrected corresponding points, the intrinsic parameters and the extrinsic parameters.