Dynamic Multi-Display Viewport Merging via Coordinate Transformation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing technologies fail to effectively align and integrate multiple touch displays of different sizes, aspect ratios, and resolutions into a single viewport, limiting user interaction and output across multiple mobile devices.

Innovation Solution

A method that dynamically configures two or more displays by determining positional information between devices, generating a transform to merge their viewports, and allowing users to add or remove displays from the single viewport, enabling alignment through touch input and processing subsequent inputs and outputs across devices.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of stationary object

If multiple touch displays of different sizes, aspect ratios, and resolutions are used, then the display area and functionality are improved, but the alignment and integration complexity increases

Engineering Contradiction:
Improvedisplay areaVSAvoidalignment complexity
Core Design Contradiction:
Area of stationary objectVSDevice complexity

Solution Approach 1:

The patent merges multiple independent touch displays into a single unified viewport by establishing coordinate transformations between them. The system combines displays of different sizes, aspect ratios, and resolutions into one coherent interaction space, allowing users to interact with content across device boundaries as if it were a single display surface.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent applies parameter transformations to reconcile differences between displays. By calculating and applying transform parameters (including scaling, translation, and rotation) based on each display's physical characteristics, the system maps coordinates from one display's coordinate system to another, enabling seamless alignment despite variations in size, resolution, and aspect ratio.

Inventive Principle:
Principle #35Parameter changes

2Ease of operation

If displays are dynamically merged into a single viewport, then user interaction across devices is improved, but the computational processing required increases

Engineering Contradiction:
Improveuser interactionVSAvoidcomputational processing
Core Design Contradiction:
Ease of operationVSPower

Solution Approach 1:

The patent performs preliminary actions by pre-calculating transform parameters between displays when they are first associated. These transformation matrices are computed in advance based on the physical characteristics and initial positioning of each display, storing the results for efficient reuse during subsequent interaction operations, thereby reducing real-time computational overhead.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent replaces complex real-time coordinate transformation calculations with pre-computed transformation matrices. By substituting the mechanical computation process with stored mathematical transforms, the system achieves efficient coordinate mapping between displays without requiring intensive processing during user interactions.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Adaptability or versatility

If displays of different resolutions are integrated, then the versatility of the system is improved, but the precision of coordinate mapping decreases

Engineering Contradiction:
Improvesystem versatilityVSAvoidcoordinate mapping precision
Core Design Contradiction:
Adaptability or versatilityVSMeasurement precision

Solution Approach 1:

The patent applies resolution normalization through parameter transformation. By incorporating scaling factors into the coordinate transformation equations that account for the ratio between different display resolutions, the system accurately maps coordinates between high-resolution and low-resolution displays, maintaining precision despite resolution differences.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent introduces a virtual coordinate system as an intermediary between physical displays of different resolutions. This intermediate coordinate space serves as a common reference frame, allowing accurate mapping between displays with varying pixel densities by transforming coordinates through the virtual space rather than directly between physical displays.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS9965155B2Dynamically merging multiple screens into one view port
Publication Date: 2018.05.08 GOOGLE LLC
  • US9965155B2 patent drawing
  • US9965155B2 patent drawing
  • US9965155B2 patent drawing

AI summary

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for performing dynamic, stroke-based alignment of touch displays. In one aspect, a method include providing, for output by a first mobile computing device that (i) has a first proximity sensitive display and (ii) has been designated a primary display device, a primary alignment user interface. The methods also includes transmitting, by the first mobile computing device to a second mobile computing device that (i) has a second proximity sensitive display and (ii) has been designated a secondary display device, an instruction to output a secondary alignment user interface.