3D Panorama Model Construction Using Derived Elevation Color

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing point cloud registration systems face inaccuracies due to misalignment of depth and color information from mobile acquisition devices, which affects the synthesis of accurate color data for constructing 3D panorama models.

Innovation Solution

The system derives color information from elevation data within the point clouds, replacing acquired color information to improve registration accuracy by using three-dimensional positions and normals for aligning adjacent point clouds, and rendering a 3D panorama model.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If acquired color information from mobile acquisition devices is used for point cloud registration, then the registration process can proceed, but the alignment accuracy deteriorates due to misalignment between depth and color information

Engineering Contradiction:
Improveregistration process efficiencyVSAvoidregistration accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The patent extracts and removes the unreliable acquired color information from the registration process. Instead of using the problematic color data from mobile devices, the system derives new color information from elevation data through a dedicated conversion module, thereby eliminating the source of misalignment while maintaining registration efficiency

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent changes the parameter source for color information from acquired sensor data to derived elevation data. By converting elevation values to color space through a systematic transformation process, the system replaces the unreliable color parameter with a more reliable derived parameter that maintains consistency with the point cloud geometry

Inventive Principle:
Principle #35Parameter changes

2Ease of manufacture

If acquired color information is used in point cloud registration, then the registration can be performed, but the color information alignment deteriorates affecting 3D panorama model accuracy

Engineering Contradiction:
Improveregistration process simplicityVSAvoid3D panorama model accuracy
Core Design Contradiction:
Ease of manufactureVSManufacturing precision

Solution Approach 1:

The patent introduces elevation data as an intermediary between the point cloud geometry and the final color information. The elevation data serves as a reliable mediator that is first aligned with the point cloud through accurate geometric registration, then converted to color space, ensuring both geometric and color consistency in the 3D panorama model

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent performs preliminary derivation of color information from elevation data before the registration process. By pre-converting elevation to color space and storing this derived color information with the point cloud data, the system ensures that color and geometric data are already aligned before registration begins, eliminating alignment issues in the final model

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11354853B2Systems and methods for constructing 3D panaroma model
Publication Date: 2022.06.07 REALSEE (BEIJING) TECHNOLOGY CO LTD
  • US11354853B2 patent drawing
  • US11354853B2 patent drawing
  • US11354853B2 patent drawing

AI summary

Systems and methods for constructing a three-dimensional panorama model of an object are disclosed. An exemplary system includes a storage device configured to receive a plurality of point clouds each acquired at a different view angle. Each point cloud includes three-dimensional positions of a plurality of target points on a surface of the object. The system further includes at least one processor configured to determine elevation and normal at each target point in each point cloud and convert the elevation of each target point to color information. The at least one processor is further configured to register every two adjacent point clouds among the plurality of point clouds based on the three-dimensional positions, the normal, and the color information of the respective target points of the two adjacent point clouds. The at least one processor is also configured to render the three-dimensional panorama model based on the registered point clouds.