Augmented Reality Label Recognition for Device Service

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Users often face difficulties in identifying and accessing repair and service information for devices due to variations in make, model, and serial numbers, especially as manufacturing techniques change over time, and this information is typically inconspicuously located on the device.

Innovation Solution

An augmented reality system using smartphones and tablets equipped with cameras and natural language processing (NLP) to capture and analyze images of identification labels, extract metadata, and connect users with service professionals or retrieve relevant information from databases and online resources.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Shape

If identification labels are placed inconspicuously on devices, then device appearance is improved, but difficulty of detecting and measuring increases

Engineering Contradiction:

Improvedevice appearanceVSAvoidlabel detection difficulty

Core Design Contradiction:

ShapeVSDifficulty of detecting and measuring

Solution Approach 1:

The patent introduces an augmented reality intermediary layer that overlays digital information onto the physical device. The system uses a camera to capture images of the device, then superimposes identification labels, repair information, and service data onto the augmented reality view, making inconspicuously placed labels easily detectable without altering the device's physical appearance.

Inventive Principle:

Principle #24Intermediary (Mediator)

2Adaptability or versatility

If manufacturing techniques vary over time, then device model diversity increases, but loss of information increases

Engineering Contradiction:

Improvedevice model diversityVSAvoidservice information availability

Core Design Contradiction:

Adaptability or versatilityVSLoss of information

Solution Approach 1:

The patent creates a universal information retrieval system that works across diverse device models and manufacturers. The augmented reality platform aggregates repair information, service manuals, and identification data from multiple sources into a single accessible interface, allowing users to obtain relevant information for any device model through image capture and automated recognition.

Inventive Principle:

Principle #6Universality (Multi-functionality)

3Productivity

If optical character recognition is used to detect text, then information retrieval speed is improved, but measurement precision deteriorates

Engineering Contradiction:

Improveinformation retrieval speedVSAvoidtext detection accuracy

Core Design Contradiction:

ProductivityVSMeasurement precision

Solution Approach 1:

The system implements feedback mechanisms where the augmented reality overlay displays detected text and identification information for user verification. Users can interact with the system to confirm or correct detected data, and the system learns from user corrections to improve future detection accuracy, balancing speed with precision through iterative refinement.

Inventive Principle:

Principle #23Feedback

Data Source

PatentUS11790025B2Extracting data and metadata from identification labels using natural language processing

Publication Date: 2023.10.17 STREEM INC

AI summary

Methods and systems disclosed herein are directed to detection and recognition of items of data on labels applied to equipment and identifying metadata labels for the items of data using NLP. Embodiments may include identifying one or more items of data on an image of a label associated with a piece of equipment, determining, using NLP on the one or more items of data of the image, one or more metadata associated, respectively, with the identified one or more items of data, and outputting at least one of the one or more metadata and associated items of data.