3D Reconstruction Coordinate Matching for Time-Series Accuracy

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing three-dimensional reconstruction methods fail to maintain consistent coordinate axes over time, leading to inaccurate positional relationships between three-dimensional models when camera positions or subject orientations change between image captures.

Innovation Solution

A method and apparatus for reconstructing three-dimensional models from multi-viewpoint images captured at different times, involving independent reconstruction and coordinate matching of these models to align their world coordinate systems, using reliability-based coordinate matching schemes to correct for deviations in scale, rotation, and translation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If three-dimensional models are reconstructed independently from multi-viewpoint images captured at different times, then the reconstruction process is simple and fast, but the coordinate axes become inconsistent leading to inaccurate positional relationships

Engineering Contradiction:
Improvereconstruction speedVSAvoidpositional relationship accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The patent introduces a coordinate matching process as an intermediary step between independent three-dimensional model reconstructions. This mediator aligns the world coordinate systems of models from different time points by calculating transformation parameters (translation, rotation, scale) that map coordinates from one model's coordinate system to another's, thereby preserving reconstruction speed while ensuring positional accuracy across time-series models

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent changes the parameter representation by introducing coordinate transformation parameters (translation vectors, rotation matrices, scale factors) that describe the relationship between different world coordinate systems. By estimating and applying these parameters, the system maintains independent reconstruction efficiency while achieving consistent positional relationships through parameter-based coordinate system transformation

Inventive Principle:
Principle #35Parameter changes

2Measurement precision

If camera calibration and coordinate conversion are performed for each image set, then accurate three-dimensional models are obtained, but the complexity of processing increases when handling multiple time points

Engineering Contradiction:
Improvethree-dimensional model accuracyVSAvoidprocessing complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent segments the complex processing into two distinct parts: (1) independent three-dimensional model reconstruction from each multi-viewpoint image set, and (2) coordinate matching between the resulting models. This segmentation allows each part to be optimized independently - reconstruction uses standard calibration methods while coordinate matching uses a simpler transformation estimation approach, reducing overall processing complexity

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent performs preliminary three-dimensional model reconstruction from each image set before performing coordinate matching. By first obtaining independent models and then aligning their coordinate systems, the system avoids the complexity of performing full calibration and coordinate conversion for every image set, instead doing it once per model and then matching coordinates between models

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11100706B2Three-dimensional reconstruction method, three-dimensional reconstruction apparatus, and generation method for generating three-dimensional model
Publication Date: 2021.08.24 PANASONIC INTELLECTUAL PROPERTY CORP OF AMERICA
  • US11100706B2 patent drawing
  • US11100706B2 patent drawing
  • US11100706B2 patent drawing

AI summary

A three-dimensional reconstruction method includes: reconstructing a first three-dimensional model from a first multi-viewpoint image obtained by shooting a real space, and reconstructing a second three-dimensional model from a second multi-viewpoint image obtained by shooting the real space at a different time; and matching world coordinate systems of the first three-dimensional model and the second three-dimensional model.