Camera-Based 6-DoF Pose Refinement With One-Dimensional Range Data

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image-based pose estimation systems for six degrees of freedom require significant processing and memory resources, and often necessitate precise laser range finders or specialized calibration patterns, increasing cost and complexity.

Innovation Solution

A system utilizing a camera and a range-sensing device to determine a six degrees of freedom pose estimate based on a single one-dimensional measurement, calculating an absolute error and optionally a reprojection error to refine the pose estimate without requiring three-dimensional depth maps or precise laser range finders.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If three-dimensional depth map or numerous two-dimensional distance measurements are used for pose estimate refinement, then measurement precision is improved, but processing requirements and memory allocation increase significantly

Engineering Contradiction:
Improvepose estimate refinement accuracyVSAvoidprocessing and memory requirements
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent extracts and utilizes only the essential one-dimensional distance measurement information from the scene, rather than processing complete three-dimensional depth maps or multiple two-dimensional measurements. By taking out only the critical distance data needed for refinement, the system achieves pose estimate improvement without the computational burden of processing full depth maps or numerous measurements.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent transitions from processing two-dimensional image data to incorporating one-dimensional distance measurements, using a different dimensional approach to achieve pose refinement. This dimensionality change allows the system to gain depth information efficiently without requiring complex three-dimensional depth maps, thereby reducing processing requirements while maintaining measurement precision.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Measurement precision

If laser range finder is used for two-dimensional distance measurements, then measurement precision is improved, but manufacturing cost increases due to precisely manufactured moving parts

Engineering Contradiction:
Improvedistance measurement accuracyVSAvoidsystem cost
Core Design Contradiction:
Measurement precisionVSEase of manufacture

Solution Approach 1:

The patent replaces the mechanical laser range finder system with an optical-based approach using a camera and image processing. Instead of relying on mechanically manufactured moving parts in a laser range finder, the system uses optical measurements and computational methods to achieve distance measurement, thereby eliminating the need for precisely manufactured mechanical components and reducing system cost.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent uses a camera to capture optical images of the scene, creating a visual copy of the environment. This optical copy is then processed to extract distance information, replacing the need for direct mechanical measurement. The copying approach allows distance measurement to be derived from visual data rather than requiring expensive mechanical ranging devices.

Inventive Principle:
Principle #26Copying

3Measurement precision

If specialized calibration patterns or correspondence markers are used for registering scan lines, then measurement precision is improved, but device complexity increases

Engineering Contradiction:
Improvescan line registration accuracyVSAvoidcalibration requirements
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent enables the system to perform self-calibration and self-registration without requiring external calibration patterns or correspondence markers. The system uses the scene itself and the available image data to automatically register and align measurements, making the calibration process self-service rather than requiring additional specialized equipment or patterns.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent creates a system that can handle both calibration and measurement functions using the same camera and image processing pipeline. Rather than requiring separate calibration patterns and measurement devices, the system uses the camera for multiple purposes including scene capture, feature detection, and distance measurement, thereby eliminating the need for specialized calibration equipment.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Reduces processing and memory requirements while eliminating the need for specialized calibration patterns, providing a cost-effective and efficient method for refining six degrees of freedom pose estimation.

Implementation Method 1

The range-sensing device is configured to determine an actual distance measured between the range-sensing device and an actual point of intersection. The range-sensing device projects a line-of-sight that intersects with the target object at the actual point of intersection.

Methodology Applied
Scientific EffectLine-of-sight projection: Optical Tweezers

Data Source

PatentEP4024340B1System for refining a six degrees of freedom pose estimate of a target object
Publication Date: 2025.09.24 THE BOEING CO
  • EP4024340B1 patent drawingFigure 1
  • EP4024340B1 patent drawingFigure 2
  • EP4024340B1 patent drawingFigure 3

AI summary

A system (10) for refining a six degrees of freedom pose estimate (8) of a target object (12) based on a one-dimensional measurement includes a camera (42) and a range-sensing device (44). The range-sensing device (44) is configured to determine an actual distance (d) measured between the range-sensing device (44) and an actual point of intersection (W'). The range-sensing device (44) projects a line-of-sight (L) that intersects with the target object (12) at the actual point of intersection (W'). The system (10) also includes one or more processors (1032) in electronic communication with the camera (42) and the range-sensing device (44) and a memory (1034) coupled to the processors (1032). The memory (1034) stores data into one or more databases (1044) and program code that, when executed by the processors (1032), causes the system (10) to predict (206) the six degrees of freedom pose estimate (8) of the target object (12). The system (8) also determines a revised six degrees of freedom pose estimate of the target object (12) based on at least an absolute error.