Mesh Geometry Overlay from Images Using Visual Positioning
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Developers of map-related and gaming applications face challenges in representing complex three-dimensional objects, such as buildings, due to their mathematical complexity, making it difficult to generate accurate mesh geometries for virtual environments.
Innovation Solution
A method is provided to determine a mesh geometry for an object based on an image of the object using a visual positioning system (VPS) and a façade service, which allows for the overlay of the mesh geometry onto the image, enabling accurate representation and interaction with virtual buildings in applications like AR/MR/VR.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If developers manually generate mesh geometries for three-dimensional objects, then accuracy can be maintained, but the complexity and time required for development increases significantly
Solution Approach 1:
The patent uses photogrammetry to create accurate copies of real-world objects by capturing multiple images and automatically generating mesh geometries. This copying approach maintains manufacturing precision while eliminating the need for manual modeling, thereby reducing development complexity.
Solution Approach 2:
The patent replaces manual mechanical modeling processes with automated computational photogrammetry systems. By substituting the mechanical/manual approach with an optical and computational system, the patent achieves both high accuracy and reduced complexity.
2Manufacturing precision
If developers manually create mesh geometries for virtual buildings, then detailed representation is achieved, but the time and resources required for development increase
Solution Approach 1:
The patent performs preliminary actions by capturing images of real buildings before virtual environment creation. This preliminary photogrammetric data collection enables automatic mesh generation later, significantly reducing development time while maintaining detailed representation accuracy.
Solution Approach 2:
By creating accurate copies of real buildings through photogrammetry, the patent eliminates time-consuming manual modeling while preserving detailed geometric representation. The copied data can be directly used in virtual environments.
3Loss of information
If image data is uploaded and processed traditionally, then mesh geometry can be obtained, but resource consumption and processing time increase
Solution Approach 1:
The patent extracts mesh geometry data directly from photogrammetric processing without requiring traditional image upload and buffer copying operations. This extraction approach maintains data completeness while reducing processing resource consumption by eliminating redundant data transfer steps.
Data Source
AI summary
Techniques include providing a mesh geometry for an image of an object to an application. In this way, an application that provides the image of the object can then overlay the mesh geometry onto the image. For example, when the object is a building, an image of a building is provided by a camera used by an application. The application can be configured to determine the three-dimensional location of the building based on the image provided by the camera. The application can be configured to determine a mesh geometry for the building based on the determined location. The application can be configured to obtain the mesh geometry and overlay the image of the building (virtual building) with the mesh geometry.