Gesture-Based Viewport Controller for Multi-Screen Alignment

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current techniques lack the ability to rapidly establish a distributed display and control system across multiple touch screen devices of varying sizes and form factors, often requiring perfect alignment and assuming a single display unit, which limits the expansion of a viewport to multiple devices.

Innovation Solution

A gesture-based alignment viewport controller system that allows users to perform composite gestures across multiple devices, using gesture objects with metadata to determine viewport coordinates and image mapping, enabling the display of an image across multiple screens as a single logical screen, regardless of device orientation or alignment.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If traditional pairing mechanisms are used to establish distributed display across multiple devices, then device connection can be achieved, but the system requires perfect alignment and assumes a single display unit, limiting viewport expansion capability

Engineering Contradiction:
Improveviewport expansion capabilityVSAvoidalignment requirement
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent creates a virtual representation (copy) of the physical screen arrangement. The system captures the layout of multiple physical devices and creates a virtual model that maps to this arrangement, allowing the viewport to be distributed across devices without requiring the devices themselves to be perfectly aligned. The virtual screen coordinates are mapped to physical device coordinates, enabling flexible viewport expansion while abstracting away the physical alignment complexity.

Inventive Principle:
Principle #26Copying

2Adaptability or versatility

If screens are controlled via a single display unit, then control simplicity is maintained, but heterogenous screens of different sizes and form factors cannot be effectively utilized

Engineering Contradiction:
Improveheterogenous screen supportVSAvoidcontrol mechanism
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The patent segments the control mechanism by introducing separate modules: a viewport controller that manages the overall viewport coordinates and a screen manager that handles individual device characteristics. This segmentation allows each module to specialize - the viewport controller handles coordinate mapping while the screen manager adapts to heterogenous screen sizes and form factors, maintaining ease of operation through modular design.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces a virtual screen coordinate system as an intermediary layer between the user interface and the physical heterogeneous screens. This virtual coordinate system acts as a mediator that translates user interactions into device-specific coordinates, allowing heterogenous screens to be controlled uniformly without requiring complex device-specific control mechanisms.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Measurement precision

If virtual representation of screen is used for alignment, then alignment can be performed, but it does not account for physical location and device orientation variations

Engineering Contradiction:
Improvescreen alignment accuracyVSAvoiddevice orientation flexibility
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The patent dynamically changes the parameters used for alignment by incorporating device orientation (portrait/landscape) and physical location information into the coordinate mapping process. The system adjusts the virtual-to-physical coordinate transformation based on detected device orientation and position, maintaining alignment accuracy while adapting to various device configurations and orientations.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS10592197B2Gesture-based alignment methodology to extend the viewport on adjacent touch screen devices
Publication Date: 2020.03.17 ADOBE INC
  • US10592197B2 patent drawing
  • US10592197B2 patent drawing
  • US10592197B2 patent drawing

AI summary

Techniques for utilizing a conglomeration of device screens (e.g., mobile device screens and/or tablet screens) in a collective manner to display an image such that the image is distributed across the screens and the conglomeration of screens act as a single screen. A plurality of screen bearing devices are arranged in a tangential rectilinear layout. The layout can be arbitrary and need not be an aligned grid. A swipe or other gesture that is performed across all of the screens is received in a distributed fashion. Based upon the received plurality of gesture/swipe objects and their associated parameters, a coordinate mapping may be performed with respect to each device/screen such that a respective portion of an image to be displayed in a distributed fashion is mapped to a particular device/screen.