Screen Capture OCR for Wearable Display Integration

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The integration of wearable displays with existing proprietary software systems is hindered by the complexity of custom interfaces, outdated code formats, and reluctance to alter established systems, making it difficult to leverage the efficiency benefits of HUD technology.

Innovation Solution

A method involving optical character recognition (OCR) to extract alphanumeric text strings from a primary display, transmit them to a secondary display, and render the text on the secondary display without requiring extensive software/hardware rework, using a configurable interface to identify and extract relevant text.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If proprietary software applications are developed to interface HMDs with originating computer systems, then display instructions can be provided to workers, but software development complexity and cost increase significantly

Engineering Contradiction:
Improveease of implementing display interfaceVSAvoidsoftware development complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent captures the display output from the primary display device as an image and uses optical character recognition to extract text content, creating a copy of the information rather than integrating with the underlying software system. This avoids the complexity of developing proprietary software interfaces while still enabling the HMD to display the same instructional content.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent introduces an intermediary processing system that captures display output, processes it through OCR, and transmits extracted text to the HMD. This intermediary layer mediates between the primary display device and the HMD, eliminating the need for direct software integration and reducing development complexity.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If direct software integration is implemented between HMD and originating systems, then data access is improved, but vendor compatibility issues and system access restrictions increase

Engineering Contradiction:
Improvedata access reliabilityVSAvoidvendor compatibility
Core Design Contradiction:
ReliabilityVSAdaptability or versatility

Solution Approach 1:

Instead of integrating directly with various vendor systems, the patent captures the visual output from any primary display device and processes it through OCR. This copying approach works with any system that has a display output, making it universally compatible across different vendors without requiring vendor-specific software integration.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent creates a universal interface solution that works with any primary display device regardless of vendor or software system. By capturing display output and using OCR for text extraction, the system achieves multi-functionality and broad compatibility without being constrained by vendor-specific protocols or access restrictions.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Productivity

If wearable displays are integrated with existing software systems, then workflow efficiency is improved, but implementation cost and time increase due to software rework

Engineering Contradiction:
Improveworkflow efficiencyVSAvoidimplementation time
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The patent captures display output from existing software systems and processes it through OCR to extract text for display on wearable devices. This copying approach enables workflow efficiency improvements without requiring any rework of the existing software systems, eliminating implementation delays associated with software integration.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent performs screen capture and text extraction in real-time as the primary display device operates, rather than requiring pre-processing or modification of the software system. This preliminary action approach allows immediate deployment and快速 implementation without extensive software rework or system downtime.

Inventive Principle:
Principle #10Preliminary action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables seamless integration of wearable displays with existing systems by extracting and displaying essential text content from primary displays, enhancing usability and safety without costly reconfiguration.

Implementation Method 1

processing the acquired pixelated image of the first display using optical character recognition to extract one or more alphanumeric text strings from the displayed text content

Methodology Applied
Scientific EffectOptical character recognition:

Data Source

PatentUS12613672B2Deriving personal display content from screen capture of primary display
Publication Date: 2026.04.28 SIX15 TECH
  • US12613672B2 patent drawing
  • US12613672B2 patent drawing
  • US12613672B2 patent drawing

AI summary

A method acquires a screen capture, as a pixelated image, having text content from a first display on a first display device and processes the acquired pixelated image of the first display using optical character recognition to extract one or more alphanumeric text strings from the displayed text content. The first display device transmits the one or more extracted text strings from the first display to a second display device. At least the one or more extracted text strings are rendered on the second display device.