Building Camera AR Overlays for Near-Real-Time Navigation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for capturing and representing building interior information are inefficient, inaccurate, and difficult to navigate, especially when remote access is required, and floor plans are cumbersome and often incomplete.
Innovation Solution
Utilizing automated analysis of building images and information to generate descriptive data enhancements on camera views, including structural elements and attributes, using machine learning models to determine and present augmented reality views in real-time or near-real-time on mobile devices.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If floor plans are used to represent building interiors, then layout information is provided, but they are difficult to construct, maintain, and visualize
Solution Approach 1:
The patent uses computer-generated images and augmented reality overlays to create visual copies of building interiors instead of traditional floor plans. The system captures images of building spaces and generates digital representations that can be displayed and manipulated without requiring physical floor plan construction or maintenance
Solution Approach 2:
The patent replaces the manual mechanical process of creating and maintaining floor plans with automated computer vision and image processing systems. The system automatically generates and updates building representations by processing captured images through machine learning models, eliminating the need for manual floor plan drafting and updates
2Loss of information
If textual descriptions of buildings are used, then some building information is provided, but they are often inaccurate and incomplete
Solution Approach 1:
The system enables building information extraction to be self-service through automated image analysis. The machine learning models automatically process captured images to identify and extract building attributes, room layouts, and structural elements without requiring manual verification or supplementation of textual descriptions
Solution Approach 2:
The system incorporates feedback mechanisms where the generated building representations can be compared against the original captured images and existing textual descriptions. Discrepancies are identified and corrected through iterative processing, improving the accuracy and completeness of building information over time
3Measurement precision
If automated analysis of building images is performed to generate descriptive information, then navigation and representation accuracy is improved, but computing power and time requirements increase
Solution Approach 1:
The system performs preliminary action by pre-processing and pre-training machine learning models with building image data before actual use. The models are trained in advance to recognize building structures, rooms, and attributes, so that during operational use, the analysis can be performed quickly on new images without requiring extensive computation time
Solution Approach 2:
The patent segments the building analysis process into distinct components handled by specialized machine learning models. Different models are trained to identify specific building elements (walls, doors, windows, rooms) independently, allowing parallel processing and reducing overall computation time compared to a single comprehensive analysis system
Data Source
AI summary
Techniques are described for using computing devices to perform automated operations for using generated building information to further generate and present visual data enhancements on images that are captured by and displayed on a mobile device in the building (e.g., concurrent with capture of the images by a camera of the mobile device, such as in a real-time or near-real-time manner with respect to image capture), such as using descriptive information about a building that is generated from analysis of acquired building images and optionally other building information (e.g., floor plans), and such as to improve navigation of the building (e.g., for autonomous vehicles) and provide other functionality as the mobile device moves through the building. The descriptive building information may include structural elements and other objects identified in the building and other determined attributes of the building, and automatically generated textual descriptions of the objects and other attributes.