Object Pose Recognition Using Depth Atlas and Belief Propagation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current computer vision algorithms face challenges in accurately estimating the pose of objects from depth images, especially when objects are partially occluded, due to limitations in depth sensing technologies and the lack of discriminative features in depth maps.

Innovation Solution

A method that uses an atlas of candidate objects to identify corresponding image elements, calculates compatibility scores based on distance comparisons, and employs belief propagation to rank and refine pose estimates, allowing for efficient and accurate pose estimation without relying on color information.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of manufacture

If computer vision algorithms use depth images for pose estimation, then color information is avoided, but the lack of discriminative features reduces recognition accuracy

Engineering Contradiction:
Improveavoidance of color information requirementsVSAvoidpose estimation accuracy
Core Design Contradiction:
Ease of manufactureVSMeasurement precision

Solution Approach 1:

The patent introduces an intermediary representation layer (depth features + geometric constraints) that mediates between the raw depth image and the pose estimation. This intermediary layer enriches the simple depth data with geometric relationships and spatial constraints, enabling accurate pose estimation without color information.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent transitions from 2D image processing to 3D spatial reasoning by utilizing depth information to reconstruct three-dimensional object representations. This dimensional transition enables the system to leverage geometric structure and spatial relationships that are not present in conventional 2D color images.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Adaptability or versatility

If objects are partially occluded in depth images, then real-world complexity is captured, but feature completeness is reduced

Engineering Contradiction:
Improvehandling of occluded objectsVSAvoidfeature completeness
Core Design Contradiction:
Adaptability or versatilityVSLoss of information

Solution Approach 1:

The patent performs preliminary actions by pre-computing geometric constraints and spatial relationships from the depth image before pose estimation. This preliminary processing creates a rich representation of the scene structure that can compensate for missing information due to occlusions during the subsequent pose estimation process.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent employs feedback mechanisms where the pose estimation process iteratively refines its results by comparing predicted object positions with observed depth features. This feedback loop allows the system to correct errors and maintain accuracy even when objects are partially occluded, adapting to incomplete information dynamically.

Inventive Principle:
Principle #23Feedback

3Productivity

If conventional pose estimation methods are used, then processing speed is moderate, but computational efficiency is low

Engineering Contradiction:
Improvepose estimation speedVSAvoidcomputational efficiency
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent segments the pose estimation process into distinct stages: depth feature extraction, geometric constraint computation, and pose optimization. This segmentation allows each stage to be optimized independently, improving overall computational efficiency while maintaining high processing speed through parallelizable operations.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS9818195B2Object pose recognition
Publication Date: 2017.11.14 KK TOSHIBA
  • US9818195B2 patent drawing
  • US9818195B2 patent drawing
  • US9818195B2 patent drawing

AI summary

A method for use in estimating a pose of an imaged object comprises identifying candidate elements of an atlas that correspond to pixels in an image of the object, forming pairs of candidate elements, and comparing the distance between the members of each pair and with the distance between the corresponding pixels.