Multi-Screen Hold and Page-Flip Gesture for Complex Device Navigation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

As computing devices become increasingly complex with numerous functions and features, traditional interaction techniques such as mice and keyboards become less efficient, posing a challenge for designers to create intuitive and efficient interaction methods for users to navigate and select relevant commands.

Innovation Solution

The implementation of multi-screen gestures that allow users to input commands on multiple screens of a multi-screen system using various gestures like pinch, expand, hold, and page-flip, enabling intuitive interaction and navigation across multiple screens, whether physically connected or communicatively linked.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If traditional input devices (mouse, keyboard) are used, then device compatibility is maintained, but interaction efficiency decreases as device functions increase

Engineering Contradiction:
Improveinteraction efficiencyVSAvoiddevice function complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent extends interaction from single-screen 2D space to multi-screen 3D space, allowing users to navigate complex functions by physically moving across screens rather than navigating through nested menus. The hold input on one screen combined with motion input on another screen creates a spatial dimension for command selection that scales with device complexity.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent divides the interaction space across multiple screens, with each screen handling specific functions or command categories. The hold input segments the selection process (maintaining reference point) from the navigation process (motion on second screen), allowing efficient exploration of complex functions without overwhelming the user.

Inventive Principle:
Principle #1Segmentation

2Adaptability or versatility

If more functions and features are incorporated, then device capability increases, but ease of operation decreases

Engineering Contradiction:
Improvedevice functionalityVSAvoidnavigation difficulty
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

By distributing functions across multiple screens and enabling cross-screen gestures, the patent provides intuitive spatial navigation for complex functions. Users can visually scan across screens to locate desired functions rather than searching through hierarchical menus, making the increased device capability easier to access.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The hold input automatically maintains the selected journal page or function state while the user explores other screens, eliminating the need to continuously monitor or re-select the reference point. This self-maintaining feature allows users to freely navigate complex functions without worrying about losing their place.

Inventive Principle:
Principle #25Self-service

3Ease of operation

If multi-screen gestures are implemented, then interaction intuitiveness improves, but device complexity increases

Engineering Contradiction:
Improveinteraction intuitivenessVSAvoidgesture recognition system
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent implements a universal gesture recognition framework that handles multiple gesture types (hold, motion, combined hold-and-motion) across multiple screens using a unified coordinate system and event processing mechanism. This multi-functional approach allows intuitive cross-screen interaction without requiring separate processing systems for each gesture type.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentEP2539803B1Multi-screen hold and page-flip gesture
Publication Date: 2019.03.27 MICROSOFT TECHNOLOGY LICENSING LLC
  • EP2539803B1 patent drawingFigure 1
  • EP2539803B1 patent drawingFigure 2
  • EP2539803B1 patent drawingFigure 3

AI summary

Embodiments of a multi-screen hold and page-flip gesture are described. In various embodiments, a hold input is recognized at a first screen of a multi screen system, and the hold input is recognized when held to select a journal page that is displayed on the first screen. A motion input is recognized at a second screen of the multi-screen system, and the motion input is recognized while the hold input remains held in place. A hold and page-flip gesture can then be determined from the recognized hold and motion inputs, and the hold and page-flip gesture is effective to maintain the display of the journal page while one or more additional journal pages are flipped for display on the second screen.