Augmented Reality Overlay for Building Component Location

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing technologies lack the ability to efficiently provide a user interface that identifies the locations of components within a home or building, especially in urgent situations such as fires or burst pipes, where quick access to information is crucial.

Innovation Solution

A system and method that utilize augmented reality (AR) interfaces to dynamically generate informative overlays on real-time images, allowing users to quickly locate components and items relevant to addressing issues within a building. This system includes processors, servers, sensors, and mobile devices that retrieve building data, identify target components, and generate image overlays based on positional data.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of time

If conventional computer-based information retrieval is used, then general maintenance information can be accessed, but specific component locations and emergency response time are insufficient

Engineering Contradiction:
Improveresponse timeVSAvoidcomponent location information
Core Design Contradiction:
Loss of timeVSLoss of information

Solution Approach 1:

The system pre-maps building components and creates a digital twin of the building layout before emergencies occur. This preliminary action stores component locations, maintenance histories, and operational data in advance, enabling instant retrieval during emergencies without time loss for searching or manual location finding.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system creates a virtual copy (digital twin) of the physical building, including all components, their locations, and operational states. This virtual replica allows users to access accurate component location information and maintenance data instantly through AR interfaces, eliminating the need for physical searches or manual record-keeping during emergencies.

Inventive Principle:
Principle #26Copying

2Productivity

If manual searches for component locations are performed, then specific component information can be found, but time consumption and efficiency are reduced

Engineering Contradiction:
Improvemaintenance efficiencyVSAvoidsearch time
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The system enables maintainers to independently locate components and access maintenance procedures through AR-guided interfaces that automatically display relevant information based on their current location and selected components. This self-service capability eliminates the need for manual searches, supervisor assistance, or reference to physical manuals, significantly improving maintenance efficiency and reducing response time.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The AR interface acts as an intermediary between the maintainer and the building components. It overlays digital information (component locations, maintenance procedures, operational data) directly onto the physical view, mediating the interaction and eliminating the need for manual searches or separate reference materials, thereby improving productivity and reducing search time.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Measurement precision

If detailed building data is stored and processed, then accurate component location information is provided, but system complexity and data processing requirements increase

Engineering Contradiction:
Improvecomponent location accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system segments building data into modular components (structural elements, MEP systems, fixtures, equipment) organized by location, type, and functional relationships. This segmentation allows the system to store and process detailed information in manageable units, improving location accuracy while reducing overall system complexity through structured data organization and selective retrieval.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS20250139839A1Systems and methods for augmented reality mapping
Publication Date: 2025.05.01 STATE FARM MUTAL AUTOMOBILE INSURANCE COMPANY
  • US20250139839A1 patent drawing
  • US20250139839A1 patent drawing
  • US20250139839A1 patent drawing

AI summary

A computer system is provided. The computer system may be programmed to: (a) receive, from a user computing device, a request identifying (i) a building, (ii) an inquiry relating to the building, (iii) positional data relating to a position of the user computing device, and/or (iv) an image stream generated by a camera of the user computing device; (b) retrieve building data relating to the building, the building data indicating a location of a plurality of components of the building; (c) identify, based upon the inquiry, one or more target components of the plurality of components of the building, the target components relating to the inquiry; (d) generate, based upon the positional data and the building data, an image overlay including one or more indicators corresponding to locations of the one or more target components; and/or (e) cause the user computing device to display the generated image overlay.