3D Map Image Superposition for Accurate Spatial Monitoring

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for projecting images on three-dimensional maps fail to accurately determine the corresponding location on the map, leading to reduced connectivity and effectiveness in monitoring.

Innovation Solution

A method and apparatus that determine the position of a virtual photographing apparatus within a 3D electronic map, extract nearest intersecting points, select pixels based on 3D coordinates, convert these to 2D coordinates, and superimpose the captured image in real-time onto the 3D map for accurate display.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If the monitor image is projected on a predetermined position on the map in two-dimensional manner, then the display process is simple, but the connectivity between the image and the map is low and it is difficult to determine which portion of the map corresponds to the projected image

Engineering Contradiction:
Improvedisplay process simplicityVSAvoidposition correspondence accuracy
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The patent transitions from two-dimensional image projection to three-dimensional image superposition on the 3D map. The captured image is projected onto the surface of a three-dimensional building model, allowing precise spatial correspondence between the image and the map. This dimensional change enables accurate determination of which map portion corresponds to the image while maintaining displayability through 3D rendering techniques.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Device complexity

If the monitor image is projected on a predetermined position on the map in two-dimensional manner, then the projection process is simple, but the effectiveness of monitoring is reduced

Engineering Contradiction:
Improveprojection process complexityVSAvoidmonitoring effectiveness
Core Design Contradiction:
Device complexityVSReliability

Solution Approach 1:

By superimposing the captured image on the three-dimensional building model rather than projecting it on a 2D map, the system achieves accurate spatial alignment between the image and the corresponding map portion. This 3D approach enhances monitoring effectiveness by providing precise positional information and contextual understanding, while the use of standard 3D rendering algorithms keeps the process complexity manageable.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Measurement precision

If the captured image is superimposed on the three-dimensional map, then the connectivity between the map and the image is increased, but the processing complexity increases

Engineering Contradiction:
Improveposition correspondence accuracyVSAvoidprocessing complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system pre-processes the captured image by determining its position on the 3D map before actual superposition. The image is projected onto the surface of the three-dimensional building model, and the corresponding 3D coordinates are calculated in advance. This preliminary positioning action simplifies the subsequent superposition process and ensures accurate alignment, reducing overall processing complexity while maintaining high position correspondence accuracy.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS9361731B2Method and apparatus for displaying video on 3D map
Publication Date: 2016.06.07 HANWHA VISION CO LTD
  • US9361731B2 patent drawing
  • US9361731B2 patent drawing
  • US9361731B2 patent drawing

AI summary

Exemplary embodiments disclose a method of projecting an image onto a surface of a three-dimensional (3D) electronic map. The method includes: extracting nearest intersecting points for each of a plurality of virtual view angle vectors with respect to a position of a virtual photographing apparatus and a plurality of polygons that constitute the 3D electronic map; comparing 3D coordinates of the extracted nearest intersecting points and 3D coordinates of a plurality of pixels constituting the plurality of polygons to select pixels that are within a range of the 3D coordinates of the extracted nearest intersecting points; converting 3D coordinates of the selected pixels to two-dimensional (2D) coordinates to display the selected pixels on a 2D display; and superimposing an input image on top of the selected pixels to output the superimposed image in real-time.