3D Model Alignment Using Neural Network Pose Estimation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current technologies face challenges in accurately aligning three-dimensional (3D) models with two-dimensional (2D) input images, particularly in augmented reality applications, where recognizing objects and estimating their poses is not sufficiently precise, leading to suboptimal user experiences.

Innovation Solution

A method and apparatus using a neural network to detect feature points in 2D images, estimate 3D poses, retrieve target 3D models, and align them with objects based on these features, enhancing accuracy through stepwise approaches and adjustments.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If traditional object recognition techniques are used, then the system complexity is low, but the alignment accuracy between 3D models and 2D images is insufficient

Engineering Contradiction:
Improvealignment accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent replaces traditional mechanical object recognition methods with a neural network-based deep learning system. The neural network automatically learns feature representations from images and performs pose estimation, substituting manual feature extraction and matching algorithms with an intelligent system that achieves higher alignment accuracy between 3D models and 2D images.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent transitions from 2D image processing to 3D pose estimation by introducing depth information. The neural network estimates three-dimensional pose parameters (position and orientation) from two-dimensional images, adding a spatial dimension to the recognition process and enabling accurate alignment of 3D models with their corresponding 2D projections.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Measurement precision

If multiple input images are required for accurate alignment, then the alignment accuracy improves, but the availability and ease of operation of the apparatus decreases

Engineering Contradiction:
Improvealignment accuracyVSAvoidavailability
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The patent performs preliminary action by pre-training the neural network with large amounts of training data before deployment. The network learns robust feature representations and pose estimation capabilities in advance, enabling it to achieve high alignment accuracy with minimal input images during actual operation. This preliminary training phase stores knowledge that eliminates the need for multiple input images during runtime.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The neural network performs self-service by automatically learning and adapting to different objects and scenarios during training. Once trained, the system can independently perform accurate pose estimation and alignment without requiring multiple input images or complex preprocessing, making the apparatus more available and easier to operate in various real-world conditions.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS11295532B2Method and apparatus for aligning 3D model
Publication Date: 2022.04.05 SAMSUNG ELECTRONICS CO LTD
  • US11295532B2 patent drawing
  • US11295532B2 patent drawing
  • US11295532B2 patent drawing

AI summary

Provided is a method and apparatus for aligning a three-dimensional (3D) model. The 3D model alignment method includes acquiring, by a processor, at least one two-dimensional (2D) image including an object, detecting, by the processor, a feature point of the object in the at least one 2D input image using a neural network, estimating, by the processor, a 3D pose of the object in the at least one 2D input image using the neural network, retrieving, by the processor, a target 3D model based on the estimated 3D pose, and aligning, by the processor, the target 3D model and the object based on the feature point.