Augmented Reality System for Automated Service Estimation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Service technicians face inefficiencies in generating and communicating service project information, such as estimates and invoices, due to reliance on low-tech methods that require multiple trips and manual data entry, leading to customer confusion and increased workload.

Innovation Solution

An augmented reality (AR) system that captures images of a real-world space, identifies physical objects, generates virtual objects associated with those objects, and provides information for service projects, including parts lists, estimates, and invoices, which can be displayed and transmitted to a computer system for record management.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If service technicians use low technology methods (manual inspection, driving back and forth, handwritten invoices), then they can perform service projects with basic tools, but the process becomes cumbersome and causes customer confusion

Engineering Contradiction:
Improveservice project efficiencyVSAvoidservice process complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent replaces manual mechanical processes (driving back and forth, handwritten notes, physical estimate delivery) with an automated digital system. The service technician uses a portable computing device to capture images, automatically generate estimates and invoices, and transmit them electronically, eliminating the need for multiple trips and manual data entry.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system enables the service technician to independently perform all estimation and invoicing functions using the portable device. The automatic object identification and information generation capabilities allow the technician to complete administrative tasks without returning to the office or relying on external systems, making the service process self-contained and efficient.

Inventive Principle:
Principle #25Self-service

2Loss of information

If service technicians drive back and forth between work and customer sites multiple times, then they can inspect objects and deliver estimates, but time is lost and productivity decreases

Engineering Contradiction:
Improveservice information accuracyVSAvoidtrip time
Core Design Contradiction:
Loss of informationVSLoss of time

Solution Approach 1:

The system performs preliminary actions by automatically capturing images and generating complete service information (estimates, invoices, parts lists) at the customer site during the initial inspection. All necessary documentation is created on-the-spot using the portable device, eliminating the need for follow-up trips to deliver estimates or create invoices after service completion.

Inventive Principle:
Principle #10Preliminary action

3Ease of operation

If service technicians manually generate estimates and invoices, then they can document service projects, but the process is cumbersome and increases workload

Engineering Contradiction:
Improveestimate generation easeVSAvoiddocumentation efficiency
Core Design Contradiction:
Ease of operationVSProductivity

Solution Approach 1:

The patent replaces manual documentation processes with automated digital generation. The system uses image recognition and database lookups to automatically create estimates and invoices based on captured images of service objects, eliminating manual data entry and calculation while improving both ease of operation and documentation efficiency.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS11468642B2Use of augmented reality for service projects
Publication Date: 2022.10.11 INTUIT INC
  • US11468642B2 patent drawing
  • US11468642B2 patent drawing
  • US11468642B2 patent drawing

AI summary

Aspects of using augment reality for service projects are described. In some implementations, an augmented reality (AR) system receives one or more images of a real-world space, detects a physical object in the real-world space from the one or more images, and identifies the physical object for a service project. The AR system also generates a virtual object associated with the identified physical object and outputs the virtual object for display in an AR environment. The AR system further receives a selection of one or more portions of the virtual object associated with one or more portions of the physical object to be serviced and generates information for performing the service project based on the one or more portions of the physical object.