Multi-touch Display Layer Assignment and Mode Transition

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Multi-touch display devices lack an efficient method to manage user interactions for both annotation and manipulation modes, particularly in assigning detected inputs to specific layers and maintaining visuo-spatial depth while allowing seamless transitions between modes.

Innovation Solution

A multi-touch display device configured to operate in either annotation or manipulation mode, intelligently determining the layer for user interactions and applying annotations or transformations accordingly, with active regions extending beyond visual boundaries to associate annotations with the appropriate layer, and maintaining temporal ordering of annotations for depth consistency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Shape

If the multi-touch display device displays multiple objects concurrently at various different layers, then the sense of depth is improved, but the complexity of managing user interactions and assigning inputs to specific layers increases

Engineering Contradiction:

Improvesense of depthVSAvoidcomplexity of managing user interactions

Core Design Contradiction:

ShapeVSDevice complexity

Solution Approach 1:

The display surface is segmented into multiple virtual layers (e.g., background layer, mid-ground layer, foreground layer) that can be independently managed. Each layer can have its own set of objects and annotations, allowing the system to process user inputs by first determining which layer the input corresponds to, thereby reducing the complexity of managing multi-layer interactions.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

An intermediary layer assignment mechanism is introduced that automatically determines which layer a user interaction should be assigned to. This intermediary system uses the visual boundaries and active regions of objects to mediate between the user input and the multiple layers, simplifying the interaction management process.

Inventive Principle:

Principle #24Intermediary (Mediator)

2Measurement precision

If active regions extend beyond visual boundaries to associate annotations with the appropriate layer, then the accuracy of layer assignment is improved, but the visual precision of object boundaries is compromised

Engineering Contradiction:

Improveaccuracy of layer assignmentVSAvoidvisual precision of object boundaries

Core Design Contradiction:

Measurement precisionVSManufacturing precision

Solution Approach 1:

Different regions of the display are assigned different qualities: the visual boundaries define the visible object areas, while the active regions extend beyond these boundaries to provide a larger interaction zone. This local differentiation allows the system to maintain visual precision for display purposes while providing extended interaction areas for accurate layer assignment.

Inventive Principle:

Principle #3Local quality

3Stability of the object's composition

If the device maintains temporal ordering of annotations for depth consistency, then the visuo-spatial depth is preserved, but the productivity of processing multiple concurrent annotations decreases

Engineering Contradiction:

Improvevisuo-spatial depth consistencyVSAvoidproductivity of processing concurrent annotations

Core Design Contradiction:

Stability of the object's compositionVSProductivity

Solution Approach 1:

The system pre-establishes a temporal ordering framework before processing annotations. By maintaining a queue or stack that automatically orders annotations based on their creation time and layer assignment, the system ensures depth consistency without requiring complex real-time processing of concurrent annotations.

Inventive Principle:

Principle #10Preliminary action

4Ease of operation

If the multi-touch display device enables seamless transitions between annotation and manipulation modes, then the ease of operation is improved, but the device complexity increases

Engineering Contradiction:

Improveease of transitioning between modesVSAvoidcomplexity of mode transition management

Core Design Contradiction:

Ease of operationVSDevice complexity

Solution Approach 1:

The display device implements dynamic mode switching between annotation and manipulation modes based on user interactions. The system can transition between modes in real-time, allowing the same physical display to serve multiple functional purposes. This dynamic capability is achieved through a flexible input interpretation system that adapts its behavior based on the current mode and detected user actions.

Inventive Principle:

Principle #15Dynamics

Data Source

PatentUS9477649B1Multi-layer telestration on a multi-touch display device

Publication Date: 2016.10.25 MICROSOFT TECHNOLOGY LICENSING LLC

AI summary

Objects displayed on a display component of a multi-touch display device may be assigned to and displayed at various visual layers, with each visual layer corresponding to a different depth relative to a foreground (or background) of the display component of the multi-touch display device. One or more annotations may be generated in response to user interaction with the multi-touch display device, with each annotation being assigned to an appropriate visual layer.