Augmented Reality Overlays for Device Repair or Replacement

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Homeowners and other structure occupants often overlook the need for device repairs or replacements, leading to potential losses and increased insurance premiums, as conventional instructions are ineffective in educating them about necessary updates.

Innovation Solution

A computer-implemented method using Augmented Reality (AR) and machine learning (ML) to visualize recommended updates to existing devices, providing an AR display that indicates the necessary repairs or replacements and their impact on a home score, utilizing devices like AR glasses, smart phones, and servers to analyze device data and insurance claims history.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If conventional instructions are used to educate occupants about device maintenance, then information is provided to occupants, but the information is ineffective in prompting repairs or replacements

Engineering Contradiction:
Improvemaintenance awarenessVSAvoideffectiveness of communication
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

The patent replaces conventional static instructions (mechanical/paper-based information delivery) with an Augmented Reality system that uses optical displays and machine learning to dynamically present maintenance information. The AR device captures images of devices, identifies them through ML models, and overlays contextualized maintenance recommendations, transforming ineffective text instructions into engaging visual overlays that directly appear on the device being viewed.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent introduces an Augmented Reality device as an intermediary between the occupant and the existing devices. This intermediary captures visual data, processes it through machine learning models, and presents tailored maintenance information through overlay displays. The AR device acts as a mediator that translates device status data into comprehensible visual recommendations, bridging the gap between raw data and actionable insights for occupants.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Loss of information

If AR visualization is implemented to show recommended updates, then awareness and engagement improve, but system complexity increases

Engineering Contradiction:
Improvemaintenance awarenessVSAvoidsystem complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent implements a multi-functional system where the AR device performs multiple tasks: capturing device images, identifying devices through machine learning, retrieving maintenance information, calculating home score improvements, and displaying overlay visualizations. By consolidating these functions into a single AR platform, the system manages complexity through integration rather than proliferation of separate components.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system enables self-service through automated machine learning-based device identification and maintenance recommendation generation. The AR device autonomously captures images, identifies the target device, retrieves relevant maintenance information, and presents personalized recommendations without requiring manual input from the occupant. This automation reduces operational complexity while enhancing awareness.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS12423755B2Augmented reality system to provide recommendation to repair or replace an existing device to improve home score
Publication Date: 2025.09.23 STATE FARM MUTAL AUTOMOBILE INSURANCE COMPANY
  • US12423755B2 patent drawing
  • US12423755B2 patent drawing
  • US12423755B2 patent drawing

AI summary

Systems and methods disclosed herein relates generally to using augmented reality (AR) for visualizing recommended updates to devices proximate a structure. In some examples, underlay layer data may be received (e.g., from a camera of an AR viewer device); and overlay layer data may be received (e.g., from a different camera or other overlay layer device). An AR display may be created by correlating the underlay layer data with the overlay layer data. An improved home score indicia may be displayed based upon the recommended update.