Smart Glasses Anomaly Detection via Eye Tracking

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Manually reviewing documents for errors and anomalies is time-consuming and difficult to cover all portions effectively, especially in detail-oriented documents with numerous input data, requiring a more efficient method for real-time anomaly detection.

Innovation Solution

Smart glasses with a scanning device and machine learning capabilities that identify document types and detect anomalies in real-time by capturing images, tracking eye movements, and comparing document characteristics to predefined rules, displaying anomalies on a virtual display and allowing for user interaction.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If manual review of documents is performed, then thorough examination of document details is possible, but the process is time-consuming and difficult to cover every portion effectively

Engineering Contradiction:
Improveanomaly detection accuracyVSAvoiddocument review time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent replaces the mechanical manual review process with an automated optical system. Smart glasses equipped with a scanning device capture images of document portions, and a machine learning model automatically analyzes these images to detect anomalies such as blank fields, formatting issues, and grammatical errors. This substitution eliminates the time-consuming manual examination while maintaining or improving detection accuracy through consistent automated application of review criteria.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system enables self-service anomaly detection by allowing the document itself to be scanned and analyzed without requiring human intervention for each review. The smart glasses and machine learning model work autonomously to identify document types, apply appropriate review rules, and generate anomaly reports, freeing reviewers from routine examination tasks while focusing their attention only on flagged issues.

Inventive Principle:
Principle #25Self-service

2Productivity

If smart glasses with scanning device are used, then real-time anomaly detection is achieved, but device complexity increases

Engineering Contradiction:
Improvedocument processing speedVSAvoidsmart glasses system complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The smart glasses system is designed with multi-functionality to justify its complexity. The device integrates a scanning device for capturing document images, eye-tracking sensors for monitoring user focus, a machine learning model for anomaly detection, and a display for presenting results. This universal platform can handle multiple document types and review scenarios, making the increased device complexity worthwhile by enabling real-time anomaly detection and significantly improving document processing speed across various use cases.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Productivity

If parallel processing of document type determination and anomaly detection is performed, then processing efficiency is improved, but computational complexity increases

Engineering Contradiction:
Improveanomaly detection speedVSAvoidprocessing system complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The system performs preliminary action by determining the document type first through natural language processing and pattern recognition. Once the document type is identified, the appropriate review rules and criteria are pre-loaded and prepared. This preliminary classification enables the subsequent anomaly detection to proceed more efficiently with targeted analysis, reducing the computational complexity of the overall parallel processing system by breaking down the task into manageable stages.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11797708B2Anomaly detection in documents leveraging smart glasses
Publication Date: 2023.10.24 BANK OF AMERICA CORP
  • US11797708B2 patent drawing
  • US11797708B2 patent drawing
  • US11797708B2 patent drawing

AI summary

Systems and methods for leveraging smart glasses for identifying anomalies in a document is provided. Methods may include scanning the document and determining a document type based off pre-defined identifiable features extracted from the document. In parallel to determining, methods may include performing a series of actions to identify any anomalies. Methods may include tracking the user's eye movements and based off of the one or more portions of the document upon which the user's eyes are focused, capturing data from one or more portions, identifying a document characteristic and comparing the document characteristic to a predetermined document rule. When the document characteristic complies to the predetermined document rule, methods may include repeating the series of actions and when the document characteristic fails to comply with the predetermined document rule, methods may include displaying an image of the anomaly, on a display of the smart glasses.