Smart Glasses OCR Content Filtering for Live Stream Extraction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Users face difficulties in extracting and filtering specific information from live, constantly updating data streams, such as stock tickers or airport flight information, as existing technologies do not efficiently provide up-to-date information when the user is not directly viewing the screen.

Innovation Solution

Smart glasses equipped with a camera, display, input/output module, network interface card, and processor, along with a backend computer, utilize a content filtering module that captures images, converts them into text, and blurs irrelevant information, highlighting the desired data using optical character recognition and AI/ML algorithms, allowing users to set filters through voice or gestures.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of time

If users manually search and filter information from live streaming screens, then they can find specific data, but it consumes excessive time and is difficult to keep up with continuously updating information

Engineering Contradiction:
Improvetime to extract informationVSAvoidinformation extraction efficiency
Core Design Contradiction:
Loss of timeVSProductivity

Solution Approach 1:

The patent replaces manual mechanical searching and filtering with an automated optical character recognition (OCR) system. The smart glasses capture images of the screen, and OCR technology automatically extracts and converts text from the live streaming data, eliminating the need for manual searching and significantly reducing time loss.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system enables self-service information extraction by automatically capturing screen content through the camera, processing it via OCR, and presenting filtered results without requiring user intervention. The device serves itself by autonomously performing the entire information extraction workflow from capture to display.

Inventive Principle:
Principle #25Self-service

2Reliability

If users continuously monitor live streaming screens for updates, then they can obtain current information, but it requires constant attention and is impractical when moving away from the screen

Engineering Contradiction:
Improveinformation currencyVSAvoiduser convenience
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The system performs preliminary action by capturing images of the live stream at regular intervals or when changes are detected. This allows the information to be pre-extracted and stored before the user needs it, ensuring currency without requiring continuous monitoring. The data is ready for immediate retrieval and presentation.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The smart glasses act as an intermediary between the live streaming screen and the user. Instead of requiring direct visual contact with the screen, the glasses capture, process, and relay the information through audio output or display, allowing users to obtain current information while moving away from the original screen.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Speed

If smart glasses capture and process live stream images in real-time, then users receive immediate information, but it increases device complexity and processing requirements

Engineering Contradiction:
Improveinformation delivery speedVSAvoidsystem complexity
Core Design Contradiction:
SpeedVSDevice complexity

Solution Approach 1:

The system segments the information processing task into distinct modules: image capture by camera, optical character recognition for text extraction, filtering logic for relevant information selection, and output delivery. This segmentation allows each component to be optimized independently and simplifies the overall system architecture while maintaining real-time processing capability.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS12253678B2Apparatus and methods to extract data with smart glasses
Publication Date: 2025.03.18 BANK OF AMERICA CORP
  • US12253678B2 patent drawing
  • US12253678B2 patent drawing
  • US12253678B2 patent drawing

AI summary

Apparatus and methods are provided for extracting and displaying information and data from a stream of information on a pair of smart glasses. One or more content filters describing the desired information and data may be communicated to a content filtering module. The content filtering module may process the stream of information to search for the desired information and data. When the desired information is found within the stream of information, the content filtering module may highlight the desired information, while blurring all other information, within a display on the pair of smart glasses.