Transparent Overlay for Cross-Platform UI Augmentation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional user interface augmentation techniques are limited to web systems due to architectural constraints and cannot be applied to a wide range of systems, as they rely on DOM trees and specific APIs that other systems do not have.

Innovation Solution

A user interface augmentation system that uses a processor to search for a base point UI on any system screen, displays an additional UI on a transparent background overlay, and circulates data between the existing and additional UIs using accessibility APIs and keyboard emulation, allowing for independent operation and compatibility with various system implementations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If conventional UI augmentation methods (proxy server, browser add-on, DOM manipulation) are used, then additional UI can be displayed on web systems, but the method cannot be applied to non-web systems due to architectural constraints

Engineering Contradiction:
Improvesystem compatibilityVSAvoidarchitecture dependency
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent introduces a transparent background overlay as an intermediary layer between the system screen and the additional UI. This overlay acts as a mediator that can carry additional UI elements without modifying the underlying system architecture, enabling cross-platform compatibility while maintaining system independence

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The transparent background overlay serves multiple functions: it acts as a display canvas for additional UI, maintains system compatibility across different platforms, and enables data circulation between existing and additional UIs through a unified interface. This multi-functional design eliminates the need for platform-specific implementation

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Ease of operation

If additional UI is displayed by inserting HTML or JavaScript into web system, then web system operation is improved, but the method requires modification of existing system structure

Engineering Contradiction:
Improvesystem operabilityVSAvoidsystem modification
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent segments the UI into two independent layers: the existing system UI and the additional UI displayed on the transparent overlay. This segmentation allows the additional UI to be developed, deployed, and operated independently without modifying or complicating the existing system structure

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The transparent background overlay serves as an intermediary that carries additional UI elements without requiring integration into the existing system codebase. This intermediary approach improves operability by allowing independent UI enhancement while avoiding system structure modification

Inventive Principle:
Principle #24Intermediary (Mediator)

3Productivity

If UI augmentation is applied to extend functionality, then business efficiency is improved, but data circulation between existing and additional UI becomes complex

Engineering Contradiction:
Improvebusiness efficiencyVSAvoiddata circulation mechanism
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The transparent background overlay acts as an intermediary data exchange layer between existing UI and additional UI. It provides standardized interfaces for data circulation, simplifying the mechanism by which data flows between different UI layers without requiring complex integration logic

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent implements feedback mechanisms where the additional UI can receive data from and send data back to the existing UI through the transparent overlay. This bidirectional feedback enables efficient business operations by allowing real-time data exchange while maintaining a clear data circulation path

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS12112022B2User interface augmentation system, user interface augmentation method, and user interface augmentation program
Publication Date: 2024.10.08 NIPPON TELEGRAPH & TELEPHONE CORP
  • US12112022B2 patent drawing
  • US12112022B2 patent drawing
  • US12112022B2 patent drawing

AI summary

A user interface augmentation system includes a memory and a processor coupled to the memory. The processor is configured to perform operations including: searching a system screen for a base point UI serving as a base point for display of an additional user interface (UI) to be added to the system screen; displaying a new screen with a transparent background in such a way as to overlap the system screen; and displaying the additional UI at a position based on the base point UI on the new screen.