Blending 3D Model Fragments with Street View Images
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Map applications often disorient users by making it difficult to maintain spatial context and direction when transitioning between street-level images, especially when they are separated by large distances, as they lack effective visualization of spatial relationships.
Innovation Solution
A method and system that generate blended images by determining fragments of a 3D model based on geospatial location data and blending ratios derived from the position and orientation of a virtual camera, reducing visual distortion and maintaining color consistency between street-level and aerial views.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Area of stationary object
If street-level images are displayed consecutively with large distances between them, then users can view more geographic regions, but users lose spatial context and direction
Solution Approach 1:
The patent introduces an aerial view as an intermediary representation between disconnected street-level images. This aerial view serves as a mediator that preserves spatial context while allowing users to navigate between distant locations, thus resolving the contradiction between viewing more geographic regions and maintaining spatial awareness.
Solution Approach 2:
The patent transitions from a two-dimensional street-level view to a three-dimensional aerial perspective. This dimensional change allows users to perceive spatial relationships and geographic context that are not visible in flat street-level images, enabling broader geographic coverage while maintaining spatial orientation.
2Loss of information
If users toggle between street-level image and aerial image, then spatial context is improved, but visual distortion and color inconsistency occur
Solution Approach 1:
The patent dynamically adjusts rendering parameters including blending ratios, color correction factors, and distortion compensation values based on the virtual camera's position and orientation. This allows smooth transitions between street-level and aerial views while maintaining color consistency and reducing visual distortion throughout the transformation.
Solution Approach 2:
The patent implements a dynamic blending system where the transition between street-level and aerial views is continuous rather than abrupt. The virtual camera's movement triggers gradual parameter changes that maintain visual coherence, allowing users to toggle between views without experiencing jarring color shifts or distortion.
3Loss of information
If 3D model fragments are blended with street-level images, then spatial awareness is enhanced, but computational complexity increases
Solution Approach 1:
The patent divides the 3D model into discrete fragments that can be independently processed and blended with street-level image data. This segmentation allows the system to handle complex 3D rendering tasks in smaller, more manageable units, reducing computational complexity while maintaining spatial awareness enhancement.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
In one aspect, computing device(s) may determine a plurality of fragments for a three-dimensional (3D) model of a geographical location. Each fragment of the plurality of fragments may correspond to a pixel of a blended image and each fragment has a fragment color from the 3D model. The one or more computing devices may determine geospatial location data for each fragment based at least in part on latitude information, longitude information, and altitude information associated with the 3D model. For each fragment of the plurality of fragments, the one or more computing devices may identify a pixel color and an image based at least in part on the geospatial location data, determine a blending ratio based on at least one of a position and an orientation of a virtual camera, and generate the blended image based on at least the blending ratio, the pixel color, and the fragment color.