3D Cityscape Model Texture Mapping via Satellite Imagery

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

3D surface models of real-world cityscapes lack detailed information such as color and texture, which is essential for certain applications, and existing methods fail to provide this information effectively.

Innovation Solution

The method enhances 3D surface models by integrating image data from satellite images, using metadata to geolocate satellite images and aligning them with 3D models, allowing for the addition of detailed imagery to visible surfaces, and adjusting projection models for more accurate geolocation and rendering.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Shape

If point cloud data is converted to a 3D surface model, then the visual representation is improved, but detailed information such as color and texture is lost

Engineering Contradiction:
Improvevisual representationVSAvoidcolor and texture information
Core Design Contradiction:
ShapeVSLoss of information

Solution Approach 1:

The patent combines point cloud data with satellite imagery to create an enhanced 3D surface model. The satellite image data (providing color and texture) is merged with the geometric information from the point cloud, allowing the model to retain both shape accuracy and visual detail information.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent uses satellite imagery as an intermediary source to transfer color and texture information onto the 3D surface model. The satellite image acts as a mediator that bridges the gap between geometric data and visual appearance data, enabling the model to display realistic surface properties.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Loss of information

If satellite imagery is integrated into 3D models, then detailed imagery information is improved, but processing complexity and time increase

Engineering Contradiction:
Improveimagery detailVSAvoidprocessing time
Core Design Contradiction:
Loss of informationVSLoss of time

Solution Approach 1:

The patent performs preliminary geolocation and alignment of satellite imagery with the 3D model coordinates before integration. By pre-processing the satellite data to match the model's coordinate system and identifying visible facades in advance, the actual integration process is accelerated, reducing overall processing time.

Inventive Principle:
Principle #10Preliminary action

3Loss of information

If satellite imagery is integrated into 3D models, then detailed imagery information is improved, but computational resources and memory usage increase

Engineering Contradiction:
Improveimagery detailVSAvoidCPU memory usage
Core Design Contradiction:
Loss of informationVSQuantity of substance

Solution Approach 1:

The patent applies satellite imagery only to visible facades of buildings in the 3D model, rather than uniformly to the entire model. This localized approach ensures that detailed imagery information is added only where visually relevant and visible from the satellite perspective, optimizing memory usage by avoiding redundant processing of hidden or non-visible surfaces.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS11210806B1Using satellite imagery to enhance a 3D surface model of a real world cityscape
Publication Date: 2021.12.28 OBJECTVIDEO LABS LLC
  • US11210806B1 patent drawing
  • US11210806B1 patent drawing
  • US11210806B1 patent drawing

AI summary

Methods and apparatus are disclosed for enhancing urban surface model with image data obtained from a satellite image. Three dimensional models of an urban cityscape obtained from digital surface models may comprise surface location information but lack image information associated with the cityscape, such as the color and texture of building facades. The location of the satellite at the time of recording the satellite image interest may be obtained from metadata associated with the satellite image. A 3D model of a cityscape corresponding to the satellite image may be subjected to a transformation operation to determine portions of the 3D model that are viewable from a location corresponding to the location of the satellite when taking the picture. Visible facades buildings of the 3D model ma be identified and mapped to portions of the satellite image which may then be used in rendering 2D images from the 3D model. In some examples a satellite image projection model may be adjusted to more accurately determine geolocations of portions of the satellite image by analysis of a plurality of satellite images.