Building Visual Models From External Imagery for Remote Navigation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods struggle to effectively capture, represent, and utilize building information, including visual data from interiors and exteriors, for remote users, as they are difficult to construct, maintain, and scale accurately, especially in architectural analysis, real estate, and property inspection.
Innovation Solution
Automated generation of 3D Gaussian Splat models or 3D spatial radiance field models using captured external imagery to create visual representations of buildings, enabling real-time rendering and user-controlled viewing from various poses, and integrating additional data for improved navigation and presentation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If floor plans or traditional computer models are used to represent building information, then some information about room layout and building details can be provided, but the models are difficult to construct, maintain, accurately scale, and populate with interior information
Solution Approach 1:
The patent uses photogrammetry to create accurate 3D copies of building exteriors from multiple 2D photographs. Instead of manually constructing complex CAD models, the system automatically generates photorealistic 3D representations by capturing images from multiple angles and synthesizing them into accurate spatial models, eliminating the need for manual modeling while preserving complete building information
Solution Approach 2:
The patent replaces manual mechanical modeling processes with automated photogrammetric reconstruction. Traditional methods required manual measurement and digital modeling, but the invention uses image capture and computational algorithms to automatically generate accurate 3D models, substituting the mechanical construction process with an automated imaging and processing system
2Loss of information
If comprehensive building visual information is captured for remote viewing, then users can understand building layouts and details, but the capture and representation processes become more difficult and resource-intensive
Solution Approach 1:
The patent performs preliminary photogrammetric reconstruction to create a complete 3D model of the building exterior before any user viewing occurs. By pre-capturing and processing all necessary visual information into an accurate 3D representation, the system enables efficient subsequent access and interaction without requiring repeated data collection, thus improving overall productivity
Solution Approach 2:
The system creates a photorealistic 3D copy of the building exterior that preserves all visual information. This digital copy can be viewed from any angle and at any time, providing complete visual information quality while enabling efficient remote access without requiring physical presence or repeated photography
3Adaptability or versatility
If 3D models are generated for real-time rendering from multiple view poses, then user-controlled viewing is enabled, but computational resources and processing time increase
Solution Approach 1:
The patent pre-computes and stores view parameters and projection data for multiple predetermined view poses during the initial photogrammetric reconstruction phase. By calculating and caching the necessary rendering information in advance, the system enables real-time interactive viewing from any stored pose without performing computationally intensive calculations during user interaction, thus reducing energy consumption during operation
Solution Approach 2:
The patent transforms the problem from real-time 3D rendering to pre-computed 2D image projection. By storing projected images and view parameters for multiple predetermined poses rather than maintaining full 3D rendering capability, the system reduces computational requirements while preserving view control flexibility through selection of pre-calculated perspectives
Data Source
AI summary
Techniques are described for automatically generating visual model representations of buildings based at least in part on captured external imagery of the buildings, and using the generated building visual models to generate and present new images and optionally in additional manners, such as to improve navigation of a building and/or its surroundings. The described techniques may include acquiring building data from a plurality of exterior acquisition locations at multiple heights and view angles of an exterior of a building (e.g., using a flying drone and/or other flying device that captures the data), generating visual model representation(s) of the building (e.g., a 3D Gaussian Splat model), and using the generated visual model representation(s) to generate and present a new image with a view of the building exterior from a particular pose along with associated user-manipulatable controls.