Remote Display Input Lenses for GUI Region Segmentation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Remote computing devices with lower resolution and smaller displays struggle to effectively render and interact with visually complex applications from local computing devices, requiring excessive panning and zooming due to the inability to display the entire GUI at a productive size and clarity.

Innovation Solution

A remote access system provides composite display information to remote devices, allowing them to display a remote display area with multiple input lenses, each depicting a region of the GUI, which can be manipulated independently, enabling high-resolution display of application content and controls simultaneously without altering other lenses.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of stationary object

If the entire GUI is displayed on a remote device with lower resolution and smaller display, then the display area is maximized, but the clarity and productivity deteriorate due to inability to display at productive size

Engineering Contradiction:
Improvedisplay areaVSAvoiddisplay clarity
Core Design Contradiction:
Area of stationary objectVSMeasurement precision

Solution Approach 1:

The remote display area is segmented into multiple independent input lenses, each displaying a different region of the GUI at high resolution. This allows the limited display area to be divided into functional zones (e.g., one lens for content, another for controls), maximizing both display area utilization and clarity for each region simultaneously.

Inventive Principle:
Principle #1Segmentation

2Measurement precision

If the GUI is zoomed in to improve clarity, then the display precision improves, but the view coverage deteriorates requiring excessive panning and zooming operations

Engineering Contradiction:
Improvedisplay precisionVSAvoidview navigation efficiency
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

By segmenting the GUI into multiple regions displayed in separate input lenses, each region can be shown at optimal zoom level without requiring navigation operations. Users can view detailed content in one lens while accessing controls in another, eliminating the need for excessive panning and zooming.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent transitions from a single two-dimensional view to a multi-dimensional display arrangement where multiple regions exist simultaneously in the display space. This allows users to access different GUI regions without sequential navigation, effectively adding a spatial dimension to the interaction model.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Productivity

If multiple regions of GUI are displayed simultaneously, then the productivity improves, but the device complexity increases due to multiple input lenses

Engineering Contradiction:
Improveinteraction efficiencyVSAvoiddisplay structure complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

Each input lens is designed as a universal component that can display any region of the GUI and respond to input events independently. This multi-functional design allows the same lens structure to serve multiple purposes (content display, control display, different application views) without increasing physical device complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent creates virtual copies of display regions through input lenses rather than requiring physical multi-display setups. Each input lens is a software-based virtual display surface that mirrors or represents a specific region of the remote GUI, enabling multi-region display without additional physical hardware complexity.

Inventive Principle:
Principle #26Copying

4Ease of operation

If a single view is displayed to simplify the interface, then the ease of operation improves, but the ability to access controls and content simultaneously deteriorates

Engineering Contradiction:
Improveinterface simplicityVSAvoidaccess efficiency
Core Design Contradiction:
Ease of operationVSProductivity

Solution Approach 1:

The interface is segmented into multiple input lenses that can be independently manipulated and focused. Each lens maintains simple, direct interaction while the collection of lenses provides comprehensive access to all GUI regions simultaneously, resolving the contradiction between simplicity and efficiency.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS10019127B2Remote display area including input lenses each depicting a region of a graphical user interface
Publication Date: 2018.07.10 HEWLETT PACKARD DEVELOPMENT COMPANY LP
  • US10019127B2 patent drawing
  • US10019127B2 patent drawing
  • US10019127B2 patent drawing

AI summary

Examples disclosed herein relate to a remote display area including input lenses each depicting a region of a graphical user interface. Examples include, in response to detection of a graphical user interface (GUI) input event with a remote computing device within an input lens having input focus, invoking the GUI input event at a location of the GUI of a local computing device within the region of the GUI depicted in the input lens having input focus.