Modeless Virtual Trackpad for Multi-Screen Devices

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing virtual on-screen trackpads require users to switch between modes for extended functionality, leading to increased computing resource consumption and user confusion, which can result in inadvertent or incorrect input.

Innovation Solution

The implementation of modeless virtual trackpads that allow users to access extended functionality without switching modes, utilizing a multiple screen computing device with a virtual trackpad area that can receive input from both fingers and digital pens, and enable gestures that initiate UIs and perform commands without mode changes.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If mode switching is implemented to access extended functionality, then functionality is enhanced, but user confusion and incorrect input increase

Engineering Contradiction:

ImprovefunctionalityVSAvoiduser confusion

Core Design Contradiction:

Adaptability or versatilityVSEase of operation

Solution Approach 1:

The virtual trackpad is designed to handle multiple input types (touch input and digital pen input) and perform multiple functions (cursor control, text selection, digital ink input, gesture recognition) within a single unified interface. The system automatically detects the input type and routes it to the appropriate processing mode without requiring the user to manually switch modes, thereby providing extended functionality while maintaining ease of operation.

Inventive Principle:

Principle #6Universality (Multi-functionality)

2Adaptability or versatility

If mode switching is implemented to access extended functionality, then functionality is enhanced, but computing resource consumption increases

Engineering Contradiction:

ImprovefunctionalityVSAvoidcomputing resource consumption

Core Design Contradiction:

Adaptability or versatilityVSUse of energy by moving object

Solution Approach 1:

The system performs preliminary classification of input events at the point of contact detection. The input classification module immediately identifies whether an input is touch or digital pen based on the nature of the contact event itself, before any further processing occurs. This preliminary action prevents the system from executing unnecessary mode-switching code paths and reduces overall computing resource consumption.

Inventive Principle:

Principle #10Preliminary action

3Adaptability or versatility

If explicit mode switches are required, then extended functionality is accessible, but workflow interruption occurs

Engineering Contradiction:

Improveextended functionalityVSAvoidworkflow interruption

Core Design Contradiction:

Adaptability or versatilityVSProductivity

Solution Approach 1:

The virtual trackpad system automatically manages the switching between different functional modes based on the detected input type. When a digital pen is detected, the system automatically transitions to digital ink input mode; when a finger is detected, it transitions to traditional trackpad mode. This self-service approach eliminates the need for users to manually switch modes, thereby preventing workflow interruption while still providing access to extended functionality.

Inventive Principle:

Principle #25Self-service

4Ease of operation

If traditional trackpad functions are provided, then basic functionality is available, but extended functionality requires mode switching

Engineering Contradiction:

Improvebasic functionalityVSAvoidmode switching requirements

Core Design Contradiction:

Ease of operationVSDevice complexity

Solution Approach 1:

The patent merges traditional trackpad functions and extended digital pen functions into a single unified virtual trackpad interface. Both touch input processing and digital ink input processing are combined in the same spatial area, with automatic routing based on input type detection. This merging eliminates the need for separate modes or interfaces, reducing device complexity while maintaining ease of operation for basic functions and providing access to extended functions.

Inventive Principle:

Principle #5Merging (Combining)

Data Source

PatentUS11137905B2Modeless augmentations to a virtual trackpad on a multiple screen computing device

Publication Date: 2021.10.05 MICROSOFT TECHNOLOGY LICENSING LLC

AI summary

The disclosed technologies address various technical and user experience problems by augmenting the functionality provided by virtual on-screen trackpads without requiring users to switch between modes. In this way, users can access extended functionality without interfering with expected traditional trackpad functionality (e.g. moving a cursor, clicking, and scrolling). In particular, technologies are disclosed for modeless digital pen input to a virtual trackpad, modeless gestures for summoning user interfaces, modeless gestures utilizing position relative to adjacent user interfaces, and modeless cursor control and interaction with virtual touch targets.