3D Model Scaling Using Sensor Distance Simulation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing 3D image processing technologies face challenges in accurately determining the scale of 3D objects due to the difficulty in determining the size of physical 3D objects, leading to incorrect relative sizes in digital reconstructions.

Innovation Solution

The method involves using multiple sensors, such as image sensors and single-beam time-of-flight sensors, to estimate distances and scale parameters, and simulating distances between sensors to adjust the scaling of 3D models, ensuring accurate scaling by accounting for the physical distance between sensors and color values.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If multiple sensors are used to capture 3D object data, then the completeness of 3D reconstruction is improved, but the complexity of determining accurate scale increases

Engineering Contradiction:
Improvecompleteness of 3D reconstructionVSAvoidcomplexity of determining accurate scale
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent introduces an intermediary computational process that simulates the distance between sensors and uses scale parameter estimation as a mediator to reconcile data from multiple sensors. This intermediary approach transforms the complex multi-sensor integration problem into a manageable scaling problem that can be solved through simulated distance calculations and optimization algorithms.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent replaces direct physical measurement mechanisms with computational simulation. Instead of using complex mechanical or optical systems to directly measure scale, the system uses software-based simulation of sensor distances and iterative optimization to determine scale parameters, substituting physical measurement complexity with computational processing.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Measurement precision

If sensor offset compensation is implemented, then the precision of 3D model scaling is improved, but the computational complexity increases

Engineering Contradiction:
Improveprecision of 3D model scalingVSAvoidcomputational complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent applies preliminary action by pre-defining the physical distance between sensors and pre-simulating sensor positions before actual 3D reconstruction. This preliminary setup establishes a reference framework that simplifies subsequent scaling calculations, as the sensor geometry is already accounted for in the simulated distances rather than requiring real-time compensation during reconstruction.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent creates a virtual copy of the sensor system in the computational model, simulating sensor positions and distances rather than directly processing raw sensor data with offset corrections. This copying approach allows the system to work with idealized sensor geometries in the virtual model, avoiding the computational complexity of directly compensating for physical sensor offsets in the reconstruction pipeline.

Inventive Principle:
Principle #26Copying

3Manufacturing precision

If scale parameters are determined for each mesh portion, then the accuracy of local 3D reconstruction is improved, but the overall processing time increases

Engineering Contradiction:
Improveaccuracy of local 3D reconstructionVSAvoidprocessing time
Core Design Contradiction:
Manufacturing precisionVSProductivity

Solution Approach 1:

The patent segments the 3D reconstruction process by determining scale parameters for different portions of the mesh representation separately. This segmentation allows each local region to be optimized independently with its own scale parameters, improving local accuracy while enabling parallel processing of different mesh portions to mitigate the overall processing time increase.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent dynamically adjusts scale parameters for different mesh portions based on local characteristics. By changing the scale parameter values according to the specific requirements of each mesh portion, the system achieves high local accuracy without applying a uniform conservative scale to the entire model, thereby reducing unnecessary processing overhead.

Inventive Principle:
Principle #35Parameter changes

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach enhances the precision of 3D model scaling, ensuring correct relative sizes of multiple 3D objects and improving the accuracy of 3D reconstructions by compensating for the offset between different sensors and color variations.

Implementation Method 1

a time-of-flight sensor to generate the second set of measurement data

Methodology Applied
Scientific EffectTime of flight: Time of Flight

Implementation Method 2

the signals generated by the image capture device and reflected off the 3D object

Methodology Applied
Scientific EffectLight reflection: Reflection

Data Source

PatentEP3756164B1Methods of modeling a 3D object, and related devices and computer program products
Publication Date: 2022.05.11 SONY GROUP CORP
  • EP3756164B1 patent drawingFigure 1A
  • EP3756164B1 patent drawingFigure 1B
  • EP3756164B1 patent drawingFigure 1C

AI summary

Methods of modeling a three-dimensional (3D) object are provided. A method of modeling a 3D object includes generating a 3D model of at least a portion of the 3D object based on data from a plurality of two-dimensional (2D) images. Moreover, the method includes scaling the 3D model by estimating a distance to the 3D object. Related devices and computer program products are also provided.