Visual Interface Interpretation for Legacy Device Remote Integration

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing device monitoring systems face challenges in remote integration with devices, particularly in enterprise settings where upgrading to connected devices is costly and complicated, and traditional sensing solutions are too expensive or complex, necessitating a method for establishing remote integration through user interface outputs.

Innovation Solution

A system and method that utilize computer vision and perceptual sensing to extract information from devices with human-interpretable user interfaces, converting visual and audio outputs into formatted data representations, enabling remote integration without altering the device or its interface, and accommodating various device types, including legacy and connected devices.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If upgrading to connected devices is implemented, then remote access capability is improved, but cost and complexity increase

Engineering Contradiction:
Improveremote access capabilityVSAvoiddevice complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent introduces an imaging device as an intermediary component that captures images of the device interface source. This intermediary enables remote access to device information without requiring the device itself to be connected, thus achieving remote access capability while avoiding the complexity of upgrading the entire device to a connected system.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system creates a visual copy of the device interface through image capture. By processing and interpreting images of the interface, the system gains remote access to device information without physically connecting to or modifying the original device, thereby maintaining simplicity while enabling remote access.

Inventive Principle:
Principle #26Copying

2Measurement precision

If conventional sensing solutions are installed, then device monitoring capability is improved, but cost and complexity increase

Engineering Contradiction:
Improvedevice monitoring capabilityVSAvoiddevice complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent replaces conventional mechanical or electronic sensing solutions with an optical-based imaging system. Instead of installing physical sensors to monitor device interfaces, the system uses an imaging device to capture and process visual information, achieving monitoring capability while reducing complexity and cost.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

Rather than using physical sensors to directly detect device states, the system creates visual copies of the interface through imaging. This indirect measurement approach achieves monitoring capability without the complexity of installing and integrating conventional sensing hardware.

Inventive Principle:
Principle #26Copying

3Adaptability or versatility

If device interface extraction is implemented, then remote integration capability is improved, but system complexity increases

Engineering Contradiction:
Improveremote integration capabilityVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent creates a universal system that can extract information from various device interfaces through a common imaging and processing approach. The system is designed to handle multiple device types and interface formats using the same core technology, enabling remote integration across different devices without increasing complexity for each specific case.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The imaging device serves as a universal intermediary that can capture images of any device interface. This standardized intermediary approach enables remote integration with diverse devices without requiring device-specific complex integration solutions, thereby improving adaptability while managing system complexity.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS11997427B2Position-based visual interpretation of device interfaces
Publication Date: 2024.05.28 GRABANGO CO
  • US11997427B2 patent drawing
  • US11997427B2 patent drawing
  • US11997427B2 patent drawing

AI summary

A system and method for extracting uncoupled information from a user interface output that includes collecting image data; processing the image data associated with the device interface source; and exposing the result to the extracted interface representation.