Overlaying 2D Map Data on 3D Scenes

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current map rendering systems fail to effectively integrate two-dimensional (2D) map data with three-dimensional (3D) scenes, lacking elevation information and vertical relationships, which limits the immersive experience and information richness in digital maps.

Innovation Solution

A method that transforms 2D map data from a 2D coordinate system to a 3D coordinate system based on the virtual camera's perspective, generating a map texture to overlay 2D data on 3D geometry, using linear or non-linear transformations depending on camera altitude, and applying imagery and map textures to terrain and building layers with z-offset adjustments.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If 2D map data is displayed in a plane format, then the map elements are clearly visible and easy to read, but the vertical relationship information with nearby structures, vegetation, or terrain is lost

Engineering Contradiction:
Improvereadability of map elementsVSAvoidvertical relationship information
Core Design Contradiction:
Ease of operationVSLoss of information

Solution Approach 1:

The patent applies dimensionality change by transforming 2D map data into a 3D coordinate system and rendering it as a textured surface that conforms to the 3D terrain mesh. This allows the map to be displayed in three dimensions, preserving vertical relationship information while maintaining the readability of map elements through proper texturing and rendering techniques.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Loss of information

If 3D map data with geometry and textures is used, then elevation information and vertical relationships are preserved, but the integration with traditional 2D map data becomes complex

Engineering Contradiction:
Improvepreservation of elevation informationVSAvoidcomplexity of integrating 2D and 3D data
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent uses an intermediary approach by introducing a coordinate transformation system that converts 2D map data into 3D space. The transformation uses the 3D camera position and terrain mesh information as intermediaries to properly position and orient the 2D map data on the 3D terrain, simplifying the integration process while preserving elevation information.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent applies parameter changes by transforming the coordinate system parameters from 2D to 3D. The map data is repositioned using 3D coordinates that incorporate elevation information from the terrain mesh, and the orientation is adjusted based on the camera's 3D position and the terrain's surface normals, enabling seamless integration of 2D and 3D data.

Inventive Principle:
Principle #35Parameter changes

3Adaptability or versatility

If 2D map data is transformed to 3D coordinate system, then the map can be overlaid on 3D terrain, but the transformation complexity increases with camera perspective changes

Engineering Contradiction:
Improveability to overlay map on 3D terrainVSAvoidtransformation complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent implements dynamics by making the map transformation adaptive to the camera's 3D position and orientation. As the camera moves or changes perspective, the 2D map data is dynamically repositioned and reoriented on the 3D terrain mesh, maintaining correct alignment and elevation relationships throughout the scene.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent creates a universal transformation system that works with any 3D camera position and orientation. The same transformation logic handles various camera perspectives, zoom levels, and terrain configurations, making the solution broadly applicable to different viewing conditions without requiring separate transformation methods for each case.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentEP2973422B1Overlaying two-dimensional map data on a three-dimensional scene
Publication Date: 2024.02.28 GOOGLE LLC
  • EP2973422B1 patent drawingFigure 1
  • EP2973422B1 patent drawingFigure 2A~2B
  • EP2973422B1 patent drawingFigure 2C

AI summary

A method for augmenting a three-dimensional (3D) scene with two-dimensional (2D) map data includes receiving 3D map data having a 3D geometry data and imagery texture data. For a specified perspective of a virtual camera in a 3D coordinate system, geometry of the 3D scene is rendered using the 3D geometry data, wherein the specified perspective includes a position and orientation relative to the 3D scene. A map texture is generated using the 2D map data in accordance with the perspective of the virtual camera in the 3D coordinate system, and the imagery texture and map texture are applied to the rendered geometry.