Semitransparent Point Cloud Overlay for Survey Image Alignment

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The existing techniques for generating three-dimensional models using panoramic images and laser scanning point clouds face issues with blurring and misalignment due to differences in camera viewpoints, making it difficult to visually recognize deviations and misalignments between the images and point clouds.

Innovation Solution

A display controlling device is employed, which includes a panoramic image generating unit, a superposing unit, and a point-cloud-image transparency adjuster, allowing for the adjustment of transparency and color settings of laser scanning point clouds to facilitate visual recognition of deviations and misalignments by dynamically varying the radius of a projection sphere and interpolating virtual scanning points.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If laser scanning point clouds are superposed on a panoramic image with high opacity, then the point cloud recognition is improved, but the underlying panoramic image and its deviations become difficult to visually recognize

Engineering Contradiction:
Improvepoint cloud recognitionVSAvoidvisual recognition of deviations and misalignments
Core Design Contradiction:
Measurement precisionVSDifficulty of detecting and measuring

Solution Approach 1:

The patent applies color changes by making the point cloud image semitransparent with a specific color (e.g., red or yellow) that contrasts with the underlying panoramic image. This allows the point cloud to remain visually distinct and recognizable while simultaneously enabling the underlying image and its deviations to be perceived through the transparent portions, thus resolving the contradiction between point cloud recognition and visual recognition of deviations.

Inventive Principle:
Principle #32Color changes

Solution Approach 2:

The patent uses the concept of porous materials by making the point cloud image semitransparent rather than fully opaque. This allows the underlying panoramic image to pass through the point cloud image, creating a layered visual structure where both the point cloud and the underlying image are simultaneously visible, enabling detection of deviations and misalignments.

Inventive Principle:
Principle #31Porous materials

2Difficulty of detecting and measuring

If the point cloud image is made semitransparent to recognize deviations, then the underlying panoramic image becomes visible, but the point cloud recognition may be compromised

Engineering Contradiction:
Improvevisual recognition of deviationsVSAvoidpoint cloud recognition
Core Design Contradiction:
Difficulty of detecting and measuringVSMeasurement precision

Solution Approach 1:

The patent uses color changes by selecting a specific color for the point cloud image that provides sufficient contrast against the underlying panoramic image. This ensures that even when the point cloud image is semitransparent, the point cloud remains visually distinguishable and recognizable, while still allowing the underlying image to be perceived through the transparent portions.

Inventive Principle:
Principle #32Color changes

3Area of stationary object

If base images are stitched to create a panoramic image, then the survey coverage is improved, but deviations and blurring occur at the borders between stitched images

Engineering Contradiction:
Improvesurvey coverageVSAvoidimage alignment accuracy
Core Design Contradiction:
Area of stationary objectVSManufacturing precision

Solution Approach 1:

The patent applies feedback by superposing the laser scanning point cloud image on the panoramic image and using this composite view to detect and identify deviations and misalignments at the borders between stitched base images. The point cloud serves as a reference framework that provides feedback about the accuracy of the stitching process, enabling users to locate and correct alignment issues.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS10755671B2Device, method, and program for controlling displaying of survey image
Publication Date: 2020.08.25 TOPCON CORPORATION
  • US10755671B2 patent drawing
  • US10755671B2 patent drawing
  • US10755671B2 patent drawing

AI summary

A technique is provided to facilitate visual recognition of deviations and misalignments in a superposed image. The superposed image is generated by superposing laser scanning point clouds on a panoramic image, which is obtained by stitching base images that are taken from different points of view. The panoramic image can include deviations between the base images. The superposed image can include misalignments between the point cloud image and the panoramic image. A display controlling device for a survey image includes a panoramic image generating unit that generates a panoramic image by stitching multiple still images, an image and point-cloud-image superposing unit that superposes laser scanning point clouds on the panoramic image, and a point-cloud-image transparency adjuster that adjusts a transparency of the image of the laser scanning point clouds to cause the laser scanning point clouds to be visually recognized while the underlying panoramic image is also visually recognized.