3D Model Generation with Multi-Viewpoint Image Enhancement

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional three-dimensional laser measuring devices require extensive time for obtaining highly accurate and high-density point clouds, are cumbersome to maneuver, and struggle with insufficient color resolution in generated models, especially for large targets.

Innovation Solution

Combine a measuring device that emits electromagnetic waves with cameras capturing multi-viewpoint images to enhance the definition of color and geometry information in three-dimensional models by integrating positional relationships and higher-resolution image data.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If a three-dimensional laser measuring device is used to obtain highly accurate and high-density point clouds, then measurement precision is improved, but productivity deteriorates due to extensive time required

Engineering Contradiction:
Improveaccuracy of point cloudVSAvoidspeed of model generation
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The patent combines a laser measuring device that generates three-dimensional point cloud data with a camera system that captures color information. By merging these two data sources, the system achieves both high measurement precision from the laser scanner and improved productivity through parallel data acquisition from the camera, eliminating the need to sequentially process each type of data separately.

Inventive Principle:
Principle #5Merging (Combining)

2Measurement precision

If a three-dimensional laser measuring device is used to obtain highly accurate point clouds, then measurement precision is improved, but device complexity increases due to cumbersome maneuverability

Engineering Contradiction:
Improveaccuracy of point cloudVSAvoidease of maneuvering
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent integrates multiple functions into a single system by combining the laser measuring device with a camera system and control unit. This multi-functional integration allows the device to simultaneously perform three-dimensional scanning, color image capture, and automated processing, reducing the need for separate equipment and simplifying maneuverability while maintaining high measurement precision.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Loss of information

If a three-dimensional laser measuring device with built-in camera is used, then color information is obtained, but color resolution is insufficient

Engineering Contradiction:
Improvecolor information completenessVSAvoidcolor resolution
Core Design Contradiction:
Loss of informationVSMeasurement precision

Solution Approach 1:

The patent uses a camera system to capture high-resolution color images of the measurement target, creating a detailed color representation that is then mapped onto the three-dimensional point cloud data. This copying approach allows the system to obtain complete color information while maintaining high color resolution, as the camera's imaging capability is superior to the built-in camera of the laser measuring device.

Inventive Principle:
Principle #26Copying

4Manufacturing precision

If extensive measurement time is spent to achieve high-density point clouds, then manufacturing precision is improved, but loss of time increases

Engineering Contradiction:
Improvedensity of point cloudVSAvoidmeasurement time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The patent implements continuous parallel data acquisition by simultaneously operating the laser measuring device and camera system throughout the measurement process. This continuous useful action allows both high-density point cloud generation and color image capture to occur concurrently, maintaining manufacturing precision while significantly reducing the total measurement time compared to sequential processing.

Inventive Principle:
Principle #20Continuity of useful action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach allows for more accurate, denser, and faster generation of three-dimensional models with improved color and geometry details, even for targets that do not easily reflect electromagnetic waves.

Implementation Method 1

a first three-dimensional model generated by a measuring device that emits an electromagnetic wave and obtains a reflected wave which is the electromagnetic wave reflected by a measurement target

Methodology Applied
Scientific EffectReflection: Reflection

Data Source

PatentEP4089361B1Three-dimensional model generation method, information processing device, and program
Publication Date: 2025.08.27 PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO LTD
  • EP4089361B1 patent drawingFigure 1
  • EP4089361B1 patent drawingFigure 2
  • EP4089361B1 patent drawingFigure 3

AI summary

A three-dimensional model generation method executed by an information processing device includes: obtaining a first three-dimensional model from a measuring device that emits an electromagnetic wave and obtains a reflected wave which is the electromagnetic wave reflected by a measurement target to thereby generate a first three-dimensional model including first position information indicating first three-dimensional positions in the measurement target (S101); obtaining a multi-viewpoint image generated by one or more cameras shooting the measurement target from different positions (S101); and generating a second three-dimensional model by enhancing the definition of the first three-dimensional model using the multi-viewpoint image (S104).