Augmented Camera Views for Real-Time Building Interior Navigation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for capturing and representing building interior information are inefficient, inaccurate, and difficult to navigate, especially when remote access is required, and floor plans are cumbersome to construct and maintain.
Innovation Solution
Utilizing automated analysis of building images and information to generate descriptive data enhancements on camera views, including structural elements and attributes, which are overlaid in real-time or near-real-time on mobile device images, using trained machine learning models to identify and render visualizations.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If floor plans are used to represent building interior information, then layout information is provided, but they are difficult to construct, maintain, scale, and populate with information
Solution Approach 1:
The patent uses automated image capture and processing to create digital representations of building interiors, replacing manual floor plan creation. Images are captured with mobile devices and automatically processed to extract layout information, eliminating the need for manual drafting and maintenance of floor plans.
Solution Approach 2:
The patent replaces manual mechanical processes of floor plan creation with automated computer vision and machine learning systems. The system automatically captures images, processes them through neural networks, and generates layout representations without human intervention in the drafting process.
2Loss of information
If textual descriptions of buildings are used, then some information is provided, but they are often inaccurate and incomplete
Solution Approach 1:
The system uses automated image analysis and machine learning models to extract building information directly from visual data, eliminating reliance on manual textual descriptions. The neural networks automatically identify and classify building attributes, ensuring accuracy and completeness without human error.
Solution Approach 2:
The system continuously refines its building information extraction through feedback loops where captured images are processed, results are validated, and the system learns from discrepancies to improve accuracy over time.
3Ease of operation
If a user is present at a building to navigate and determine information, then direct observation is possible, but it is difficult to effectively navigate and determine non-apparent information
Solution Approach 1:
The patent overlays augmented reality information on top of the physical view, adding a digital dimension to the navigation experience. This allows users to see both the physical environment and digital annotations simultaneously, providing access to hidden information without leaving the physical space.
Solution Approach 2:
The mobile device acts as an intermediary between the user and the building environment, capturing images and processing them through machine learning models to extract and present information that would otherwise be invisible to the naked eye.
4Loss of time
If remote access to building interiors is required for analysis and inspection, then physical travel is avoided, but effective capture and representation of interior information is difficult
Solution Approach 1:
The system creates digital copies of building interiors through automated image capture and processing. These digital representations include extracted layout information, object detections, and augmented reality overlays that can be viewed remotely, providing complete building information without physical presence.
Solution Approach 2:
The patent replaces physical travel and manual inspection with automated remote systems. Mobile devices capture images that are automatically processed through machine learning models, enabling remote analysis and inspection with the same effectiveness as physical presence.
Data Source
AI summary
Techniques are described for using computing devices to perform automated operations for using generated building information to further generate and present visual data enhancements on images that are captured by and displayed on a mobile device in the building (e.g., concurrent with capture of the images by a camera of the mobile device, such as in a real-time or near-real-time manner with respect to image capture), such as using descriptive information about a building that is generated from analysis of acquired building images and optionally other building information (e.g., floor plans), and such as to improve navigation of the building (e.g., for autonomous vehicles) and provide other functionality as the mobile device moves through the building. The descriptive building information may include structural elements and other objects identified in the building and other determined attributes of the building, and automatically generated textual descriptions of the objects and other attributes.