3D Object Tracking via Polygonal Plane Segmentation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing 3D model-based tracking methods fail to achieve precise object tracking due to incorrect calculation of the 3D rigid body transform matrix when points are not correctly matched to the object's edge, leading to inaccurate object positioning.

Innovation Solution

Divide the object into a plurality of polygonal planes and track using texture data and geometric data between planes, generating virtual planes when the tracking failure rate is below a designated level and stopping tracking when it exceeds, to ensure accurate object positioning.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If 3D model-based tracking is performed using edge-based tracking of a single 3D model, then the tracking process can be implemented, but the tracking precision deteriorates when points are not correctly matched to the object's edge

Engineering Contradiction:
Improvetracking precisionVSAvoidtracking reliability
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The patent divides the single 3D model into multiple polygonal planes (e.g., front surface, side surfaces, top surface) and tracks each plane independently. This segmentation allows the system to handle complex objects with varying geometries more reliably, as each plane can be tracked using its specific texture and geometric characteristics, reducing the impact of incorrect point matching on overall tracking precision.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies different tracking methods to different planes based on their specific characteristics. Each plane is tracked using its unique texture data and geometric constraints, allowing localized optimization of tracking precision for each surface region rather than applying a uniform tracking approach to the entire model.

Inventive Principle:
Principle #3Local quality

2Manufacturing precision

If a single 3D model is used for tracking, then the model structure is simple, but the tracking accuracy deteriorates due to incorrect calculation of 3D rigid body transform matrix

Engineering Contradiction:
Improvetracking accuracyVSAvoidmodel complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent segments the 3D model into multiple polygonal planes, each with its own tracking parameters and transform matrices. This segmentation enables more accurate tracking by allowing independent optimization of each plane's position and orientation, while the overall model structure remains manageable through hierarchical organization of planes.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent transitions from tracking a single monolithic 3D model to tracking multiple 2D planes that compose the 3D object. This dimensional decomposition allows for more precise texture matching and geometric constraint application on each plane, improving overall tracking accuracy without requiring complex computations on the entire 3D model.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Reliability

If edge-based tracking is performed on the 3D model, then the tracking process can be executed, but the reliability deteriorates when points do not meet the edge of the 3D model correctly

Engineering Contradiction:
Improvetracking reliabilityVSAvoidpositioning precision
Core Design Contradiction:
ReliabilityVSMeasurement precision

Solution Approach 1:

The patent divides the object into multiple polygonal planes and tracks each plane independently using its specific texture and geometric data. This segmentation ensures that point matching is performed locally on each plane's edge, improving reliability by reducing the propagation of errors from incorrect point matching to the overall tracking result.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent incorporates feedback mechanisms to monitor tracking quality and generate virtual planes when tracking failures are detected. This feedback system allows the system to adapt to incorrect point matching by generating corrective virtual planes, thereby maintaining positioning precision even when initial edge-based tracking fails.

Inventive Principle:
Principle #23Feedback

4Duration of action of stationary object

If virtual planes are generated when tracking failure rate is below designated level, then tracking continuity is improved, but the system complexity increases

Engineering Contradiction:
Improvetracking continuityVSAvoidsystem complexity
Core Design Contradiction:
Duration of action of stationary objectVSDevice complexity

Solution Approach 1:

The patent prepares virtual planes in advance as a backup mechanism. When tracking failures are detected, these pre-prepared virtual planes can be quickly generated and applied to maintain tracking continuity without requiring complex real-time computations or system reconfiguration, thus reducing the actual system complexity burden.

Inventive Principle:
Principle #11Beforehand cushioning (Prior cushioning)

Solution Approach 2:

The patent introduces virtual planes as intermediary elements that mediate between the original 3D model and the tracking system. These virtual planes serve as placeholders or corrective elements when tracking failures occur, allowing the system to maintain continuity without directly modifying the original model structure, thereby managing system complexity effectively.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS8737686B23D object tracking method and apparatus
Publication Date: 2014.05.27 SAMSUNG ELECTRONICS CO LTD
  • US8737686B2 patent drawing
  • US8737686B2 patent drawing
  • US8737686B2 patent drawing

AI summary

A 3D object tracking method and apparatus in which a model of an object to be tracked is divided into a plurality of polygonal planes and the object is tracked using texture data of the respective planes and geometric data between the respective planes to enable more precise tracking. The 3D object tracking method includes modeling the object to be tracked to generate a plurality of planes, and tracking the plurality of planes, respectively. The modeling of the object includes selecting points from among the plurality of planes, respectively, and calculating projective invariants using the selected points.