Virtual Solid Figure for 3D Model Camera Planning

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current imaging planning methods for generating three-dimensional models using structure from motion (SfM) and multi-view stereo (MVS) face challenges in accurately estimating camera poses and require extensive processing time, leading to low-quality regions in the models.

Innovation Solution

An imaging planning device that applies a virtual solid figure to a virtual model object, repeatedly arranges and increases the number of virtual cameras to determine the necessary camera positions and numbers for acquiring images, planning the actual camera positions required to generate a three-dimensional model with higher accuracy.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If additional imaging is performed to improve three-dimensional model quality, then manufacturing precision is improved, but loss of time increases

Engineering Contradiction:
Improvethree-dimensional model qualityVSAvoidprocessing time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The patent applies preliminary action by using a virtual solid figure to pre-determine optimal camera positions and imaging parameters before actual imaging. The system calculates and stores the ideal number and positions of cameras in advance, so that when additional imaging is needed to improve model quality, the camera poses can be directly retrieved from the pre-computed virtual model rather than requiring time-consuming real-time calculations.

Inventive Principle:
Principle #10Preliminary action

2Manufacturing precision

If camera pose estimation is performed accurately, then manufacturing precision is improved, but loss of time increases

Engineering Contradiction:
Improvecamera pose estimation accuracyVSAvoidprocessing time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The patent applies copying by creating a virtual solid figure that replicates the essential geometric properties of the target object. This virtual copy allows the system to perform camera pose estimation and imaging parameter optimization in the virtual space, where calculations are faster and can be pre-computed. The results from the virtual model are then applied to guide actual imaging, avoiding time-consuming real-time pose estimation while maintaining high accuracy.

Inventive Principle:
Principle #26Copying

Data Source

PatentUS20240378804A1Imaging planning device and imaging planning method
Publication Date: 2024.11.14 MITSUBISHI ELECTRIC CORP
  • US20240378804A1 patent drawing
  • US20240378804A1 patent drawing
  • US20240378804A1 patent drawing

AI summary

An imaging planning method includes: applying a virtual solid figure having a predetermined shape to a virtual object imitating a shape of a solid object for which a three-dimensional model is to be generated; performing repetition of arrangement of positions of virtual cameras based on a position on a surface of the virtual solid figure, imaging of the virtual object by the virtual cameras after the arrangement, and an increase in the number of the virtual cameras; determining the number and positions of the virtual cameras required to acquire of virtual images regarding the virtual object required to generate a three-dimensional model of the virtual object through the repetition; and planning, based on the number and the positions of the virtual cameras, the number and positions of cameras required to acquire images regarding the solid object that are to be required to generate the three-dimensional model of the solid object.