3D Mesh Rendering for GIS Panoramic Navigation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Geographic Information Systems (GIS) struggle to render and navigate three-dimensional panoramic images effectively due to a lack of depth information and the inability to seamlessly transition between images, as existing spherical models do not accurately represent the Earth's geometry.

Innovation Solution

A computer-implemented method that generates a three-dimensional mesh from depth maps associated with panoramic images, allowing for immersive navigation within a virtual environment by projecting images onto these meshes and enabling seamless transitions between geographic locations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of manufacture

If a spherical model is used to render photographs, then the photographs can be displayed in a unified format, but the photographs can only be viewed from one position and three-dimensional information is lost

Engineering Contradiction:
Improverendering uniformityVSAvoidthree-dimensional information
Core Design Contradiction:
Ease of manufactureVSLoss of information

Solution Approach 1:

The patent transitions from a two-dimensional spherical projection to a three-dimensional virtual environment by generating depth maps from panoramic images and constructing 3D meshes. This dimensional transformation enables users to navigate and view photographs from multiple positions and angles, recovering the three-dimensional information that was lost in traditional spherical rendering while maintaining rendering uniformity through systematic mesh generation and projection techniques.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Device complexity

If a spherical model is used for rendering, then implementation is simplified, but the model does not correspond to the actual geometry of the Earth

Engineering Contradiction:
Improvemodel simplicityVSAvoidgeometric accuracy
Core Design Contradiction:
Device complexityVSReliability

Solution Approach 1:

The patent changes the geometric parameters of the rendering model from a simplified spherical representation to a more accurate ellipsoidal or geoid-based coordinate system that reflects the actual geometry of the Earth. This is achieved by transforming panoramic images into three-dimensional virtual environments that respect terrestrial curvature and geographic coordinates, thereby improving geometric accuracy while maintaining implementation feasibility through established GIS coordinate transformation methods.

Inventive Principle:
Principle #35Parameter changes

3Adaptability or versatility

If depth maps are generated for panoramic images, then three-dimensional navigation is enabled, but processing complexity and computational requirements increase

Engineering Contradiction:
Improvenavigation capabilityVSAvoidprocessing complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent applies preliminary action by pre-generating depth maps and three-dimensional meshes from panoramic images during an offline processing stage. This allows the computationally intensive tasks of depth estimation and mesh generation to be performed in advance, storing the results for efficient retrieval and rendering during user navigation. This approach enables complex three-dimensional navigation capabilities while reducing real-time processing requirements to simple mesh rendering and camera position updates.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentEP2643820B1Rendering and navigating photographic panoramas with depth information in a geographic information system
Publication Date: 2018.01.24 GOOGLE LLC
  • EP2643820B1 patent drawingFigure 1
  • EP2643820B1 patent drawingFigure 2
  • EP2643820B1 patent drawingFigure 3

AI summary

The capability to render and navigate three-dimensional panoramic images in a virtual three-dimensional environment so as to create an immersive three-dimensional experience is provided. Such a capability can present a three-dimensional photographic experience of the real world that is seamlessly integrated with the virtual three-dimensional environment. Depth values associated with the panoramic images may be used to create three-dimensional geometry, which can be rendered as part of the virtual three-dimensional environment. Further, such a capability can enable a user to roam freely through the environment while providing a more natural free-form exploration of the environment than existing systems.